Skip to main content

REVIEW article

Front. Cell. Infect. Microbiol., 18 July 2022
Sec. Clinical Microbiology
Volume 12 - 2022 | https://doi.org/10.3389/fcimb.2022.956417

The Relationship Between Porphyromonas Gingivalis and Rheumatoid Arthritis: A Meta-Analysis

Yilin Li1,2,3 Rui Guo4,5 Patrick Kwabena Oduro6,7 Tongke Sun1,2,3 Hao Chen1,2,3 Yating Yi1,2,3 Weiqian Zeng1,2,3 Qilong Wang6,7 Ling Leng6,7* Long Yang4,5* Jun Zhang1,2,3*
  • 1Department of Orthodontics, School and Hospital of Stomatology, Cheeloo College of Medicine, Shandong University, Jinan, China
  • 2Shandong Key Laboratory of Oral Tissue Regeneration, Jinan, China
  • 3Shandong Engineering Laboratory for Dental Materials and Oral Tissue Regeneration, Jinan, China
  • 4Research center for Infectious Diseases, Tianjin University of Traditional Chinese Medicine, Tianjin, China
  • 5School of Integrative Medicine, Tianjin University of Traditional Chinese Medicine, Tianjin, China
  • 6Institute of Traditional Chinese Medicine, Tianjin University of Traditional Chinese Medicine, Tianjin, China
  • 7State Key Laboratory of Component-Based Chinese Medicine, Ministry of Education, Tianjin, China

Rheumatoid arthritis (RA) is a systematical autoimmune disease, characterized by chronic synovial joint inflammation and hurt. Porphyromonas gingivalis(P. gingivalis) can cause life-threatening inflammatory immune responses in humans when the host pathogenic clearance machinery is disordered. Some epidemiological studies have reported that P. gingivalis exposure would increase the prevalence of RA. However, the results remain inconsistent. Therefore, a meta-analysis was done to systematically analyze the relationship between P. gingivalis exposure and the prevalence of rheumatoid arthritis. Database including Cochrane Library, Web of Science, PubMed, and EMBASE were searched for published epidemiological articles assessed the relationship between P. gingivalis and RA. Obtained studies were screened based on the predefined inclusion and exclusion criteria. The overall Odds Ratios (ORs) of incorporated articles were pooled by random-effect model with STATA 15.1 software. The literature search returned a total of 2057 studies. After exclusion, 28 articles were included and analyzed. The pooled ORs showed a significant increase in the risk of RA in individuals with P. gingivalis exposure (OR = 1.86; 95% CI: 1.43-2.43). Subgroup analysis revealed that pooled ORs from populations located in Europe (OR = 2.17; 95% CI: 1.46-3.22) and North America (OR = 2.50; 95% CI: 1.23-5.08) were significantly higher than that from population in Asia (OR = 1.11; 95% CI: 1.03-1.20). Substantial heterogeneity was observed but did not significantly influence the overall outcome. In conclusion, our results indicated P. gingivalis exposure was a risk factor in RA. Prompt diagnosis and management decisions on P. gingivalis antimicrobial therapy would prevent rheumatoid arthritis development and progression.

Introduction

Rheumatoid arthritis (RA) is a systemic autoimmune disease characterized by the production of anti-citrullinated protein antibodies (ACPA) (Kharlamova et al., 2016; Białowąs et al., 2020) and chronic synovial joint inflammation. If untreated or improperly controlled, this illness can lead to the destruction of cartilage and bone and decrease the quality of the patient’s life or even cause disability (Laugisch et al., 2016). RA affects about 1% of the population, with a female/male ratio of 2·5/1 (Bender et al., 2018). The disease can happen at any time in life, but its incidence increases with age, with individuals aged 40–70 years at an increased risk. Although what exactly causes RA remains unclear, several genetic alterations and environmental factors have been identified to contribute to RA pathogenesis (Eriksson et al., 2019).

Chronic periodontitis is the most common inflammatory disease worldwide, affecting 1/3 of the adult population. Both periodontal disease (PD) and RA display systemic markers of inflammation and share an association with HLA-DRB1 alleles and chronic inflammatory pathways (Äyräväinen et al., 2017). PD is much more frequent in RA patients compared with healthy people. Indeed, previous study reports have established a causal relationship between PD and RA (Scher and Abramson, 2013; Kim et al., 2018). Many clinical studies have indicated that patients with RA are more likely to exhibit periodontitis than those without RA (Berthelot and Le Goff, 2010). Individuals with RA also had higher levels of periodontal tissue destruction than the controls. Additionally, patients with periodontitis had a higher prevalence of RA than those without periodontitis.

Moreover, the elevated systemic inflammatory problem in people with PD has been coupled with an increased risk of chronic and potentially grievous diseases (Oluwagbemigun et al., 2019), including heart diseases, enterophthisis, kidney failure, cardiovascular diseases, diabetes, pulmonary diseases, premature infants, and cancers (Kononoff et al., 2020). In PD, the dysregulated immune inflammatory response is associated with the dysbiosis of the oral microbiota (Konig et al., 2015). Porphyromonas gingivalis(P. gingivalis) is a gram-negative, rod-shaped, obligate anaerobe of the oral cavity. P. gingivalis is the causative agent of the chronic inflammatory disease periodontitis. Strikingly, the association between RA and PD is because of the oral pathobiont P. gingivalis (Lee et al., 2015).

P. gingivalis and its infection are of clinical concern because of their numerous associations with potentially life-threatening diseases (Fisher et al., 2015). Previous studies report that P. gingivalis can induce an inflammatory response since some immunologic and inflammatory reactions are activated in the host, interfering with the bacterium’s clearance (Johansson et al., 2016). P. gingivalis can invade and penetrate different epithelial cells, and it has a complex mechanism that allows it to alter the cellular defense, notably some of the host’s unique genes (Schulz et al., 2019). Some studies have shown the effects of P. gingivalis, at diverse levels, on some molecules associated with cellular division. Gingival epithelial cells are the first natural barrier of the host periodontal tissue defense mechanism  (Moen et al., 2003; Okada et al., 2011; Mariette et al., 2020; Arévalo-Caro et al., 2022). P. gingivalis can adhere to gingival epithelial cells through specific adhesins, triggering various signaling pathways in gingival epithelial cells and causing its internalization in gingival epithelial cells to trigger cell dysfunction (Reichert et al., 2013).

Previous systematic reviews and clinical studies have linked P. gingivalis infection to RA (Bello-Gualtero et al., 2016). However, most of these studies were limited by small sample size, geographical location, and the absence of subgroup analysis (Leech and Bartold, 2015). In addition, unfortunately, findings on the link between P.gingivalis and RA remain heterogeneous, with some showing a positive correlation and others showing a null correlation between the two (Seror et al., 2015; Janssen et al., 2015). Therefore, current estimates of the risk of RA in P. gingivalis exposed individuals are needed to inform decisions on future drug and vaccine development (Ceccarelli et al., 2018). We, therefore, aimed to conduct a meta-analysis of the prevalence of P. gingivalis in patients with RA.

Material and Methods

Protocol and Registration

This meta-analysis was designed to investigate the relationship between P. gingivalis and RA, with the guidelines provided by the PRISMA statement (Liberati et al., 2009) and the Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. Literature from the Cochrane Library, Web of Science, PubMed, and EMBASE were searched by April 14, 2022, with the search strategy of key words including rheumatoid arthritis and P. gingivalis. After conducting the literature search, the references of all returned studies were managed and screened.

Eligibility Criteria

The searched articles were screened based the predefined eligible criteria: 1) epidemiological studies including cohort study, case-control study or cross-section study; 2) articles exploring the correlation between P. gingivalis and the risk of rheumatoid arthritis. When multiple research articles were available from the same population, the most recent peer-reviewed research article would be selected. On the contrary, articles would be excluded if they are: 1) inappropriate article types, such as comment, letters, review, meta-analysis; 2) results from animal models or in vitro experiments; 3) lack of detailed methodology to detect P. gingivalis exposure; 4) neither reporting exact odds ratio (OR) or risk ratio (RR), nor supplying enough data to calculate them; 5) articles with paradoxical data describing sample size in paragraphs or tables.

Study Selection

The titles and abstracts from each database were downloaded and imported into the literature management software. Duplicate research articles were removed. Two independent reviewers (Yilin L and Rui G) screened the titles and abstracts in parallel based on the inclusion and exclusion criteria. Then the full text was retrieved and evaluated in depth. In addition, in scenarios where conflicts about a study could not be resolved after discussing the full-text among the two review authors, a third author (Tongke S) was consulted.

Data Extraction

Two independent authors (Yilin L and Rui G) extracted data from included articles using a pre-piloted standardized data extraction form. The extracted data including author/year of publication, sample location (country), study design, sample size, match for control, biomarker used for determining P. gingivalis exposure and the reported or calculated OR and 95%CI.

Quality Assessment

The quality of included articles were assessed by Agency for Healthcare Research and Quality (AHRQ) for cross-sectional studies and Newcastle-Ottawa Scale (NOS) for case-control and cohort studies (detailed items could be found in Supplementary Materials Table 1 or in this website http://www.ohri.ca/programs/clinical_ epidemiology/oxford.asp). Yilin L and Rui G scored each item separately, and any discrepancies in the scores were resolved through discussion. All included studies were evaluated based on the final quality score, ranging from 0 to 10. Each study was assigned a low, moderate, or high quality based on the scores 0–5, 6–8, and 9–10, respectively.

Statistical Analysis

Stata 15.1 software was used to conduct the meta-analysis. The relationship between P. gingivalis and RA was reported as odds ratio (OR) and 95% CI. Heterogeneity across studies was measured by I2 statistics. The fixed-effect model was used when the I2 was less than 50%, otherwise the random-effect model was used. Subgroup analysis was conducted to clarify the source of heterogeneity as well as to analyze the diversity among different subgroups. And sensitivity analysis were used to confirm whether the results were robust. Furthermore, Begg’s funnel plots and Egger’s test were used to examine publication bias across studies.

Results

Study Selection and Flow Diagram

Our literature search identified 2057 studies. After removing duplicates, 901 records were screened for inclusion, among which 156 were proceeded for full-text eligibility and review. 86 studies were excluded based on inclusion and exclusion criteria, leaving 70 eligible studies for further analysis. Finally, after deeply evaluating 42 studies were excluded for insufficient data for OR or RR, yielding a total of 28 eligible studies for the synthesis (Figure 1). There were 2 articles reported two different ORs, those were OR calculated before RA treatment and OR after RA treatment (Äyräväinen et al., 2017; Martínez-Rivera et al., 2017). As most of these included articles reported ORs before treatment, in order to minimize the heterogeneity between studies, OR calculated before treatment was chosen in our meta-analysis.

FIGURE 1
www.frontiersin.org

Figure 1 The flow diagram of the selection of the studies.

Characteristics of the Studies

Of the 28 studies, 16 were case-control studies, 4 were cohort studies, and 8 were cross-sectional studies, with a total of 4486 RA patients and 2607 controls. The included studies’ characteristics were displayed in Table 1. Among them, 17 study samples were in Europe, while 5 were in North America, 3 in Asia, and 3 in South America.

TABLE 1
www.frontiersin.org

Table 1 Main characteristics of the studies selected for the systematic review and meta-analysis.

Data Synthase

These 28 studies represented 28 independent populations. Results from our meta-analysis showed a significant increase in the risk of rheumatoid arthritis in individuals with P. gingivalis exposure, with the overall pooled OR 1.86 (95%CI: 1.43, 2.43, Figure 2). There was apparent heterogeneity between these included articles, as the I2 was 81.6% and the estimate of between-study variance Tau-squared was 0.3015. Therefore, the random-effect model was used. Results from Begg’s funnel plot and Egger’s tests indicated that there might exist some publish bias (Egger’s text p= 0.004) (Supplementary Figure 1).

FIGURE 2
www.frontiersin.org

Figure 2 Forest plot for the association between porphyromonas gingivalis (P. gingivalis) and rheumatoid arthritis (RA) of dichotomous data.

As in Arévalo-Caro’s study (Arévalo-Caro et al., 2022), two different ORs were reported because different biomarkers (IgG1 anti-P. gingivalis and IgG2 anti-P. gingivalis) were used to define P. gingivalis exposure. To compare these two different biomarkers on the pooled ORs, the two ORs were calculated separately. The pooled OR showed that P. gingivalis exposure defined by IgG1 anti-P. gingivalis or IgG2 anti-P. gingivalis had limited effect on the final results of the meta-analysis, as the pooled OR were 1.86 vs 1.90 (Supplementary Figure 2) in IgG1 anti-P. gingivalis and IgG2 anti-P. gingivalis respectively. In our pooled data, the OR from IgG1 anti-P. gingivalis were mainly chosen.

Subgroup Analysis

To determine the primary sources of heterogeneity, we conducted a subgroup analysis based on study design (case-control, cohort or cross-sectional study), OR’s sources (reported by the authors or calculated based on their original data), sample size (RA patients ≥150 or < 150), population locations (countries), the biomarker of P. gingivalis (anti-P. gingivalis, P. gingivalis anti-RgpB or anti-RgpA), the detection methods in evaluation P. gingivalis exposure (ELISA, PCR or bacterial culture), the quality (NOS ≥ 8 or < 8) and the population location (continent) (Figure 3 and Table 2). Unfortunately, none of these factors could well explain heterogeneity between studies. Instead, we found that the association might be stronger in Europe and North America than Asia, as the pooled ORs from populations located in Europe (OR = 2.17; 95% CI: 1.46-3.22) and North America (OR = 2.50; 95% CI: 1.23-5.08) were significantly higher than that from population in Asia (OR = 1.11; 95% CI: 1.03-1.20).

FIGURE 3
www.frontiersin.org

Figure 3 Subgroup analyses of the association between P. gingivalis and rheumatoid arthritis in different countries.

TABLE 2
www.frontiersin.org

Table 2 Results of subgroups analysis.

Sensitivity Analysis

A sensitivity analysis (Figure 4) was performed after excluding one of the 28 included studies to evaluate the impact of an individual study on the overall outcome. The overall sensitivity analyses indicated that our results were robust, omitting anyone of the studies would not significantly interfere with the overall measured outcome.

FIGURE 4
www.frontiersin.org

Figure 4 Sensitivity analysis.

Discussion

The relationship between P. gingivalis and RA remains heterogeneous and a subject of concern (Chaparro-Sanabria et al., 2019). Our meta-analysis showed that a patients exposed to P. gingivalis would have a higher risk of RA. According to Seror et al.’s study, there was a significant difference between the early RA group and the HC group for the frequency of P. gingivalis, which is the same as Goh et al.’s study (Seror et al., 2015; Goh et al., 2016). Contrary to our results, Seror et al.’s and Gon et al.’s studies revealed that they did not detect any association of anti-P. gingivalis antibodies with RA or ACPA status (Kharlamova et al., 2017). These results suggest that the association of periodontitis and RA could be linked to bacterial species other than P. gingivalis or a mechanism other than citrullination (Figure 4). This disparity might be due to various factors, including patient health, sample size, and RA treatment types (Kirchner et al., 2017).

Another study by Schmickler and others showed that patients with RA had worse oral health than healthy controls because of the absolute number of missing teeth and periodontal conditions (Rahajoe et al., 2021). The prevalence of all bacteria investigated in RA and HC groups is similar (Arévalo-Caro et al., 2022). The course of the disease, drug for rheumatism, and restricted motor skills, on the other hand, did not affect periodontal conditions (Janssen et al., 2015), even though there was a statistically significant association between a rheumatoid factor and periodontal condition (Kim et al., 2018). Their studies also reported that within the RA group, higher serum levels of P. gingivalis may be a significant marker for the higher burden of the bacteria and invasive periodontal diseases (Martínez-Rivera et al., 2017), which may justify why this bacterium is the only periodontal pathogen correlated with a higher risk of RA (Kononoff et al., 2021).

Also, a comparison between saliva samples of healthy individuals and patients with RA in a recent study indicated a significant relationship between the higher prevalence of P. gingivalis and RA (Mikuls et al., 2009; Schmickler et al., 2017). The possible relationship between RA and P. gingivalis in different studies has been investigated, and most of these studies have shown a positive relationship between them (Unriza-Puin et al., 2017). A study from the USA reported a positive relationship between P. gingivalis and periodontal diseases (Mikuls et al., 2012). Also, it revealed that P. gingivalis was the most potent predictor of periodontal diseases among adolescents (Janssen et al., 2015; Manoil et al., 2021). The importance of our findings of a higher correlation rate of P. gingivalis in RA compared to healthy tissue is uncertain (Rodriguez et al., 2021). However, this bacterium invades healthy and inflammatory tissue more than other bacteria such as candida (de Smit et al., 2014; Rinaudo-Gaujous et al., 2019). Meanwhile, P. gingivalis can intervene in the inflammatory process by inhibiting the host’s cellar death and inducing cell proliferation (Arvikar et al., 2013).

It is suggested that anti-P. gingivalis antibody levels play a significant role in the pathogenesis of RA (Westra et al., 2021), while distinct similarities are shown in both RA and periodontitis (Papageorgiou et al., 2020). The data suggest that RA and periodontitis may be linked to the periodontal pathogen P. gingivalis (Maldonado et al., 2020). Citrullinated variants of the Fibrin chains are considered target autoantigens in the rheumatoid joint (Perricone et al., 2019). P. gingivalis is the only prokaryotic organism that produces PPAD and contributes to the initiation of ACPA generation because of PPAD expression (Quirke et al., 2014). For example, PAD expressed in the joint deaminates synovial fibrin (Valor and de la Torre Ortega, 2012), and these synovial antigens may serve as targets for auto-antibody formation triggered by P. gingivalis associated with periodontitis and epitope spreading (Lee et al., 2015). Because antibody against citrullinated proteins plays a significant role in autoimmunity in RA (Xiao et al., 2020; Jasemi et al., 2021), an assumption is made that individuals predisposed to periodontitis are exposed to citrullinated antigens that become systemic immunogens (Moen et al., 2003). A study shows that antibody responses to P. gingivalis may affect ACPA responses, and the data support a role for the oral pathogen P. gingivalis in the etiology of RA (Arévalo-Caro et al., 2022).

There are differences between the prevalence rates reported by different studies for P. gingivalis that may be associated with the variations of P. gingivalis strains used in different studies (Ziebolz et al., 2011; Scher et al., 2012). Two completely different P. gingivalis strains differ in several aspects. For instance, the strain P. gingivalis ATCC53978 has a recognized capsule as the primary antigen associated with pathogenesis, but the strain P. gingivalis ATCC33277 does not have this antigen. Therefore, it leads to inflammation slightly (Sayehmiri et al., 2015). This meta-analysis did not have enough age, gender, smoking, or alcohol consumption data. These variables are essential and may influence the ability of bacteria to invade the immune system during the invasion of tissues and, therefore, potentially influence the inflammatory process.

As we know, sample size and location were critical factors in meta-analysis. Thus in our subgroup analysis, these included studies were distributed to two groups based on sample size (indicated by RA cases ≥150 or < 150), and ORs were pooled respectively. Our results showed that the differences between these two groups were statistically insignificant, as there was an overlap in 95%CI of individual ORs. In addition, we further analyzed pooled ORs in different sample locations in two ways. Firstly, the included studies were distributed to four groups based on their continents. Then the included studies were distributed to fourteen groups based on their countries. Our results showed there exists some regional differences in the relationship between P. gingivalis exposure and RA, as the pooled ORs from populations located in Europe and North America were significantly higher than that located in Asia. Also, pooled ORs from population located in Italy, Finland and Mexico were relatively higher than that in Japan (Figure 3). This might be due to the lower prevalence of RA in Japan (Silman and Pearson, 2002). It was a pity that no study reported any information about the relationship between P. gingivalis exposure and RA from population located in China. More studies are warranted to clarify the relationship in Chinese populations. Overall, our results suggested that it should be noted that P. gingivalis was a risk factor in RA development in populations around the world, even though the ORs were different across different areas.

This paper mainly conducted a meta-analysis on different regions, populations, research methods, age, sample size and other factors. The results indicated P. gingivalis exposure was a risk factor in RA. Prompt diagnosis and management decisions on P. gingivalis antimicrobial therapy would prevent rheumatoid arthritis development and progression. But, factors such as people smoked or not, drank alcohol, congenital hypoplasia, and whether individual has underlying medical conditions were not taken into account. Furthermore, in the included studies, different exposure methods were adopted for different biomarkers. Enzyme-Linked Immunosorbent Assay (ELISA) is generally used for the detection of serum antibodies, (e.g. Arvikar et al., 2013). There were two ways to detect P. gingivalis: one was bacterial culture (e.g. Janssen et al., 2015) and the other was Polymerase Chain Reaction (PCR) (e.g. Reichert et al., 2013). Results from subgroup analysis showed that the pooled OR were slightly higher in ELISA or PCR groups compared with Bacterial culture group, suggested that different detection method might influence the association between P. gingivalis and RA. This may provide a direction for future research. Meanwhile, a range of biomarkers were involved in the original text, including P. gingivalis, anti-P. gingivalis, anti-RgpB and anti-RgpA. The impact of different biomarkers was also evaluated in our subgroup analysis. The results showed that the differences were not that obvious. More studies are warranted to compare these difference directly.

As a chronic autoimmune disease, Rheumatoid arthritis is developed due to genetics and environmental risks, and periodontitis is one of the consistently reported risk factors (González-Febles and Sanz, 2021). Most importantly, P. gingivalis is one of the commonly found bacterium in periodontitis patients (Jia et al, 2019). It was reported that P. gingivalis has a unique ability to produce citrullinate proteins or peptides by proteolytic cleavage at Arg-X peptide bonds by arginine gingipains, followed by citrullination of carboxy-terminal arginines by bacterial PAD (Smolen et al., 2016). Specific citrullinated peptides generated by P. gingivalis could be worked as self-antigen and lead to the breakdown of immune tolerance at the site of gingival inflammation (Muñoz-Atienza et al, 2020). Epitope spreading to other host citrullinated proteins would lead to chronic and destructive inflammation in the joint, which triggers the development of rheumatoid arthritis (Wegner et al, 2010).

In conclusion, our results indicated P. gingivalis exposure was a potential risk factor in RA. More perspective studies and mechanism research are warranted to confirm the causal link between P. gingivalis exposure and RA process. Prompt diagnosis and management decisions on P. gingivalis antimicrobial therapy would prevent RA development and progression.

Author Contributions

JZ and LY conceived the project. YL, RG and LL designed the whole meta-analysis, including article search and exclusion, quality assessment, and analyzed the data. LL, JZ and LY supervised the project, provided the funding, interpreted the results. YL and RG wrote the manuscript with input from all authors. PO helped revise languages. TS, HC, YY and WZ helped with the data analysis. QW reviewed the data, provided advice and funding. All authors contributed to the article and approved the submitted version.

Funding

This study was supported by the National Key Research and Development Program of China (2019YFC1708803), the Science and Technology Program of Tianjin, China (21ZYJDJC00070), Innovation Team and Talents Cultivation Program of National Administration of Traditional Chinese Medicine (ZYYCXTD-C-202203) and the Education Committee of Tianjin (2021KJ130).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcimb.2022.956417/full#supplementary-material

Supplementary Figure 1 | Publication bias in the risk difference (RD) in dichotomous data, Begg’s funnel plot.

Supplementary Figure 2 | Two different ORs were reported for (A) IgG1 anti-P. gingivalis, (B) IgG2 anti-P. gingivalis were used to define P. gingivalis exposure.

References

Arévalo-Caro, C., Romero-Sánchez, C., Garavito-Rodríguez, E. (2022). Relation Between Anti-Porphyromonas Gingivalis Antibody Titers and HLA-DRB1 Neutral Alleles in Individuals With Rheumatoid Arthritis. Acta Odontol. Scand. 80(2), 131–139. doi: 10.1080/00016357.2021.1959053

PubMed Abstract | CrossRef Full Text | Google Scholar

Arvikar, S. L., Collier, D. S., Fisher, M. C., Unizony, S., Cohen, G. L., McHugh, G., et al. (2013). Clinical Correlations With Porphyromonas Gingivalis Antibody Responses in Patients With Early Rheumatoid Arthritis. Arthritis. Res. Ther. 15 (5), R109. doi: 10.1186/ar4289

PubMed Abstract | CrossRef Full Text | Google Scholar

Äyräväinen, L., Leirisalo-Repo, M., Kuuliala, A., Ahola, K., Koivuniemi, R., Meurman, J. H., et al. (2017). Periodontitis in Early and Chronic Rheumatoid Arthritis: A Prospective Follow-Up Study in Finnish Population. BMJ Open 7 (1), e011916. doi: 10.1136/bmjopen-2016-011916

PubMed Abstract | CrossRef Full Text | Google Scholar

Bello-Gualtero, J. M., Lafaurie, G. I., Hoyos, L. X., Castillo, D. M., De-Avila, J., Munevar, J. C., et al. (2016). Periodontal Disease in Individuals With a Genetic Risk of Developing Arthritis and Early Rheumatoid Arthritis: A Cross-Sectional Study. J. Periodontol. 87 (4), 346–356. doi: 10.1902/jop.2015.150455

PubMed Abstract | CrossRef Full Text | Google Scholar

Bender, P., Egger, A., Westermann, M., Taudte, N., Sculean, A., Potempa, J., et al. (2018). Expression of Human and Porphyromonas Gingivalis Glutaminyl Cyclases in Periodontitis and Rheumatoid Arthritis-A Pilot Study. Arch. Oral. Biol. 97, 223–230. doi: 10.1016/j.archoralbio.2018.10.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Berthelot, J. M., Le Goff, B. (2010). Rheumatoid Arthritis and Periodontal Disease. Joint. Bone Spine. 77 (6), 537–541. doi: 10.1016/j.jbspin.2010.04.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Białowąs, K., Radwan-Oczko, M., Duś-Ilnicka, I., Korman, L., Świerkot, J. (2020). Periodontal Disease and Influence of Periodontal Treatment on Disease Activity in Patients With Rheumatoid Arthritis and Spondyloarthritis. Rheumatol. Int. 40 (3), 455–463. doi: 10.1007/s00296-019-04460-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Ceccarelli, F., Orrù, G., Pilloni, A., Bartosiewicz, I., Perricone, C., Martino, E., et al. (2018). Porphyromonas Gingivalis in the Tongue Biofilm is Associated With Clinical Outcome in Rheumatoid Arthritis Patients. Clin. Exp. Immunol. 194 (2), 244–252. doi: 10.1111/cei.13184

PubMed Abstract | CrossRef Full Text | Google Scholar

Chaparro-Sanabria, J. A., Bautista-Molano, W., Bello-Gualtero, J. M., Chila-Moreno, L., Castillo, D. M., Valle-Oñate, R., et al. (2019). Association of Adipokines With Rheumatic Disease Activity Indexes and Periodontal Disease in Patients With Early Rheumatoid Arthritis and Their First-Degree Relatives. Int. J. Rheumatol. Dis. 22 (11), 1990–2000. doi: 10.1111/1756-185X.13724

CrossRef Full Text | Google Scholar

de Smit, M., van de Stadt, L. A., Janssen, K. M., Doornbos-van der Meer, B., Vissink, A., van Winkelhoff, A. J., et al. (2014). Antibodies Against Porphyromonas Gingivalis in Seropositive Arthralgia Patients do Not Predict Development of Rheumatoid Arthritis. Ann. Rheumatol. Dis. 73 (6), 1277–1279. doi: 10.1136/annrheumdis-2013-204594

CrossRef Full Text | Google Scholar

Eriksson, K., Fei, G., Lundmark, A., Benchimol, D., Lee, L., Hu, Y., et al. (2019). Periodontal Health and Oral Microbiota in Patients With Rheumatoid Arthritis. J. Clin. Med. 8 (5), 630. doi: 10.3390/jcm8050630

CrossRef Full Text | Google Scholar

Fisher, B. A., Cartwright, A. J., Quirke, A. M., de Pablo, P., Romaguera, D., Panico, S., et al. (2015). Smoking, Porphyromonas Gingivalis and the Immune Response to Citrullinated Autoantigens Before the Clinical Onset of Rheumatoid Arthritis in a Southern European Nested Case-Control Study. BMC Musculoskelet. Disord. 16, 331. doi: 10.1186/s12891-015-0792-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Goh, C. E., Kopp, J., Papapanou, P. N., Molitor, J. A., Demmer, R. T. (2016). Association Between Serum Antibodies to Periodontal Bacteria and Rheumatoid Factor in the Third National Health and Nutrition Examination Survey. Arthritis. Rheumatol. 68 (10), 2384–2393. doi: 10.1002/art.39724

PubMed Abstract | CrossRef Full Text | Google Scholar

González-Febles, J., Sanz, M. (2021). Periodontitis and Rheumatoid Arthritis: What Have We Learned About Their Connection and Their Treatment? Periodontol. 87 (1), 181–203. doi: 10.1111/prd.12385

CrossRef Full Text | Google Scholar

Janssen, K. M., de Smit, M. J., Brouwer, E., de Kok, F. A., Kraan, J., Altenburg, J., et al. (2015). Rheumatoid Arthritis-Associated Autoantibodies in non-Rheumatoid Arthritis Patients With Mucosal Inflammation: A Case-Control Study. Arthritis. Res. Ther. 17 (1), 174. doi: 10.1186/s13075-015-0690-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Jasemi, S., Erre, G. L., Cadoni, M. L., Bo, M., Sechi, L. A. (2021). Humoral Response to Microbial Biomarkers in Rheumatoid Arthritis Patients. J. Clin. Med. 10 (21), 5153. doi: 10.3390/jcm10215153

PubMed Abstract | CrossRef Full Text | Google Scholar

Jia, L., Han, N., Du, J., Guo, L., Luo, Z., Liu, Y. (2019). Pathogenesis of Important Virulence Factors of Porphyromonas Gingivalis via Toll-Like Receptors. Front. Cell. Infect. Microbiol. 9. doi: 10.3389/fcimb.2019.00262

CrossRef Full Text | Google Scholar

Johansson, L., Sherina, N., Kharlamova, N., Potempa, B., Larsson, B., Israelsson, L., et al. (2016). Concentration of Antibodies Against Porphyromonas Gingivalis is Increased Before the Onset of Symptoms of Rheumatoid Arthritis. Arthritis. Res. Ther. 18 (1), 201. doi: 10.1186/s13075-016-1100-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Kharlamova, N., Jiang, X., Sherina, N., Potempa, B., Israelsson, L., Quirke, A. M., et al. (2016). Antibodies to Porphyromonas Gingivalis Indicate Interaction Between Oral Infection, Smoking, and Risk Genes in Rheumatoid Arthritis Etiology. Arthritis. Rheumatol. 68 (3), 604–613. doi: 10.1002/art.39491

PubMed Abstract | CrossRef Full Text | Google Scholar

Kharlamova, N., Jiang, X., Sherina, N., Potempa, B., Israelsson, L., Quirke, A. M., et al. (2017). Antibodies to Porphyromonas Gingivalis Indicate Interaction Between Oral Infection, Smoking, and Risk Genes in Rheumatoid Arthritis Etiology. Arthritis. Rheumatol. 68 (3), 604–613. doi: 10.1002/art.39491

CrossRef Full Text | Google Scholar

Kim, J. H., Choi, I. A., Lee, J. Y., Kim, K. H., Kim, S., Koo, K. T., et al. (2018). Periodontal Pathogens and the Association Between Periodontitis and Rheumatoid Arthritis in Korean Adults. J. Periodontal. Implant. Sci. 48 (6), 347–359. doi: 10.5051/jpis.2018.48.6.347

PubMed Abstract | CrossRef Full Text | Google Scholar

Kirchner, A., Jäger, J., Krohn-Grimberghe, B., Patschan, S., Kottmann, T., Schmalz, G., et al. (2017). Active Matrix Metalloproteinase-8 and Periodontal Bacteria Depending on Periodontal Status in Patients With Rheumatoid Arthritis. J. Periodontal. Res. 52 (4), 745–754. doi: 10.1111/jre.12443

PubMed Abstract | CrossRef Full Text | Google Scholar

Konig, M. F., Paracha, A. S., Moni, M., Bingham, C. O., 3rd, Andrade, F. (2015). Defining the Role of Porphyromonas Gingivalis Peptidylarginine Deiminase (PPAD) in Rheumatoid Arthritis Through the Study of PPAD Biology. Ann. Rheumatol. Dis. 74 (11), 2054–2061. doi: 10.1136/annrheumdis-2014-205385

CrossRef Full Text | Google Scholar

Kononoff, A., Elfving, P., Pussinen, P., Hörkkö, S., Kautiainen, H., Arstila, L., et al. (2020). Association of Rheumatoid Arthritis Disease Activity and Antibodies to Periodontal Bacteria With Serum Lipoprotein Profile in Drug Naive Patients. Ann. Med. 52 (1-2), 32–42. doi: 10.1080/07853890.2020.1724321

PubMed Abstract | CrossRef Full Text | Google Scholar

Kononoff, A., Hörkkö, S., Pussinen, P., Kautiainen, H., Elfving, P., Savolainen, E., et al. (2021). Antibodies to Malondialdehyde-Acetaldehyde Modified Low-Density Lipoprotein in Patients With Newly Diagnosed Inflammatory Joint Disease. Scand. J. Rheumatol. 50 (2), 113–117. doi: 10.1080/03009742.2020.1795244

PubMed Abstract | CrossRef Full Text | Google Scholar

Laugisch, O., Wong, A., Sroka, A., Kantyka, T., Koziel, J., Neuhaus, K., et al. (2016). Citrullination in the Periodontium-a Possible Link Between Periodontitis and Rheumatoid Arthritis. Clin. Oral. Investig. 20 (4), 675–683. doi: 10.1007/s00784-015-1556-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Leech, M. T., Bartold, P. M. (2015). The Association Between Rheumatoid Arthritis and Periodontitis. Best. Pract. Res. Clin. Rheumatol. 29 (2), 189–201. doi: 10.1016/j.berh.2015.03.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, J. Y., Choi, I. A., Kim, J. H., Kim, K. H., Lee, E. Y., Lee, E. B., et al. (2015). Association Between Anti-Porphyromonas Gingivalis or Anti-α-Enolase Antibody and Severity of Periodontitis or Rheumatoid Arthritis (RA) Disease Activity in RA. BMC Musculoskelet. Disord. 16 (1), 1–8. doi: 10.1186/s12891-015-0647-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P., et al. (2009). The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Healthcare Interventions: Explanation and Elaboration. BMJ. 339, b2700. doi: 10.1136/bmj.b2700

PubMed Abstract | CrossRef Full Text | Google Scholar

Maldonado, A., Pirracchio, L., Imber, J. C., Bürgin, W., Möller, B., Sculean, A., et al. (2020). Citrullination in Periodontium is Associated With Porphyromonas Gingivalis. Arch. Oral. Biol. 114, 104695. doi: 10.1016/j.archoralbio.2020.104695

PubMed Abstract | CrossRef Full Text | Google Scholar

Manoil, D., Bostanci, N., Mumcu, G., Inanc, N., Can, M., Direskeneli, H., et al. (2021). Novel and Known Periodontal Pathogens Residing in Gingival Crevicular Fluid are Associated With Rheumatoid Arthritis. J. Periodontol. 92 (3), 359–370. doi: 10.1002/JPER.20-0295

PubMed Abstract | CrossRef Full Text | Google Scholar

Mariette, X., Perrodeau, E., Verner, C., Struillou, X., Picard, N., Schaeverbeke, T., et al. (2020). Role of Good Oral Hygiene on Clinical Evolution of Rheumatoid Arthritis: A Randomized Study Nested in the ESPOIR Cohort. Rheumatol. (Oxford). 59 (5), 988–996. doi: 10.1093/rheumatology/kez368

CrossRef Full Text | Google Scholar

Martínez-Rivera, J. I., Xibillé-Friedmann, D. X., González-Christen, J., de la Garza-Ramos, M. A., Carrillo-Vázquez, S. M., Montiel-Hernández, J. L. (2017). Salivary Ammonia Levels and Tannerella Forsythia are Associated With Rheumatoid Arthritis: A Cross Sectional Study. Clin. Exp. Dent. Res. 3 (3), 107–114. doi: 10.1002/cre2.68

PubMed Abstract | CrossRef Full Text | Google Scholar

Mikuls, T. R., Payne, J. B., Reinhardt, R. A., Thiele, G. M., Maziarz, E., Cannella, A. C., et al. (2009). Antibody Responses to Porphyromonas Gingivalis (P. Gingivalis) in Subjects With Rheumatoid Arthritis and Periodontitis. Int. Immunopharmacol. 9 (1), 38–42. doi: 10.1016/j.intimp.2008.09.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Mikuls, T. R., Thiele, G. M., Deane, K. D., Payne, J. B., O'Dell, J. R., Yu, F., et al. (2012). Porphyromonas Gingivalis and Disease-Related Autoantibodies in Individuals at Increased Risk of Rheumatoid Arthritis. Arthritis. Rheumatol. 64 (11), 3522–3530. doi: 10.1002/art.34595

CrossRef Full Text | Google Scholar

Moen, K., Brun, J. G., Madland, T. M., Tynning, T., Jonsson, R. (2003). Immunoglobulin G and A Antibody Responses to Bacteroides Forsythus and Prevotella Intermedia in Sera and Synovial Fluids of Arthritis Patients. Clin. Diagn. Lab. Immunol. 10 (6), 1043–1050. doi: 10.1128/cdli.10.6.1043-1050.2003

PubMed Abstract | CrossRef Full Text | Google Scholar

Muñoz-Atienza, E., Flak, M. B., Sirr, J., Paramonov, N. A., Aduse-Opoku, J., Pitzalis, C., et al. (2020). The P. Gingivalis Autocitrullinome Is Not a Target for ACPA in Early Rheumatoid Arthritis. J. Dent. Res. 99 (4), 456–462. doi: 10.1177/0022034519898144

PubMed Abstract | CrossRef Full Text | Google Scholar

Okada, M., Kobayashi, T., Ito, S., Yokoyama, T., Komatsu, Y., Abe, A., et al. (2011). Antibody Responses to Periodontopathic Bacteria in Relation to Rheumatoid Arthritis in Japanese Adults. J. Periodontol. 82 (10), 1433–1441. doi: 10.1902/jop.2011.110020

PubMed Abstract | CrossRef Full Text | Google Scholar

Oluwagbemigun, K., Yucel-Lindberg, T., Dietrich, T., Tour, G., Sherina, N., Hansson, M., et al. (2019). A Cross-Sectional Investigation Into the Association Between Porphyromonas Gingivalis and Autoantibodies to Citrullinated Proteins in a German Population. Ther. Adv. Musculoskelet. Dis. 11, 1759720X19883152. doi: 10.1177/1759720X19883152

PubMed Abstract | CrossRef Full Text | Google Scholar

Papageorgiou, S. N., Koletsi, D., Iliadi, A., Peltomaki, T., Eliades, T. (2020). Treatment Outcome With Orthodontic Aligners and Fixed Appliances: A Systematic Review With Meta-Analyses. Eur. J. Orthod. 42 (3), 331–343. doi: 10.1093/ejo/cjz094

PubMed Abstract | CrossRef Full Text | Google Scholar

Perricone, C., Ceccarelli, F., Saccucci, M., Di Carlo, G., Bogdanos, D. P., Lucchetti, R., et al. (2019). Porphyromonas Gingivalis and Rheumatoid Arthritis. Curr. Opin. Rheumatol. 31 (5), 517–524. doi: 10.1097/BOR.0000000000000638

PubMed Abstract | CrossRef Full Text | Google Scholar

Quirke, A. M., Lugli, E. B., Wegner, N., Hamilton, B. C., Charles, P., Chowdhury, M., et al. (2014). Heightened Immune Response to Autocitrullinated Porphyromonas Gingivalis Peptidylarginine Deiminase: A Potential Mechanism for Breaching Immunologic Tolerance in Rheumatoid Arthritis. Ann. Rheumatol. Dis. 73 (1), 263–269. doi: 10.1136/annrheumdis-2012-202726

CrossRef Full Text | Google Scholar

Rahajoe, P. S., de Smit, M. J., Raveling-Eelsing, E., du Teil Espina, M., Stobernack, T., Lisotto, P., et al. (2021). No Obvious Role for Suspicious Oral Pathogens in Arthritis Development. Int. J. Environ. Res. Public Health 18 (18), 9560. doi: 10.3390/ijerph18189560

PubMed Abstract | CrossRef Full Text | Google Scholar

Reichert, S., Haffner, M., Keyßer, G., Schäfer, C., Stein, J. M., Schaller, H. G., et al. (2013). Detection of Oral Bacterial DNA in Synovial Fluid. J. Clin. Periodontol. 40 (6), 591–598. doi: 10.1111/jcpe.12102

PubMed Abstract | CrossRef Full Text | Google Scholar

Rinaudo-Gaujous, M., Blasco-Baque, V., Miossec, P., Gaudin, P., Farge, P., Roblin, X., et al. (2019). Infliximab Induced a Dissociated Response of Severe Periodontal Biomarkers in Rheumatoid Arthritis Patients. J. Clin. Med. 8 (5), 751. doi: 10.3390/jcm8050751

CrossRef Full Text | Google Scholar

Rodríguez, J., Lafaurie, G. I., Bautista-Molano, W., Chila-Moreno, L., Bello-Gualtero, J. M., Romero-Sánchez, C. (2021). Adipokines and Periodontal Markers as Risk Indicators of Early Rheumatoid Arthritis: A Cross-Sectional Study. Clin. Oral. Investig. 25 (4), 1685–1695. doi: 10.1007/s00784-020-03469-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Sayehmiri, F., Sayehmiri, K., Asadollahi, K., Soroush, S., Bogdanovic, L., Jalilian, F. A., et al. (2015). The Prevalence Rate of Porphyromonas Gingivalis and its Association With Cancer: A Systematic Review and Meta-Analysis. Int. J. Immunopathol. Pharmacol. 28 (2), 160–167. doi: 10.1177/0394632015586144

PubMed Abstract | CrossRef Full Text | Google Scholar

Scher, J. U., Ubeda, C., Equinda, M., Khanin, R., Buischi, Y., Viale, A., et al. (2012). Periodontal Disease and the Oral Microbiota in New-onset Rheumatoid Arthritis. Arthritis. Rheum 64 (10), 3083–3094. doi: 10.1002/art.34539

PubMed Abstract | CrossRef Full Text | Google Scholar

Scher, J. U., Abramson, S. B. (2013). Periodontal Disease, Porphyromonas Gingivalis, and Rheumatoid Arthritis: What Triggers Autoimmunity and Clinical Disease? Arthritis. Res. Ther. 15 (5), 122. doi: 10.1186/ar4360

PubMed Abstract | CrossRef Full Text | Google Scholar

Schmickler, J., Rupprecht, A., Patschan, S., Patschan, D., Müller, G. A., Haak, R., et al. (2017). Cross-Sectional Evaluation of Periodontal Status and Microbiologic and Rheumatoid Parameters in a Large Cohort of Patients With Rheumatoid Arthritis. J. Periodontol. 88 (4), 368–379. doi: 10.1902/jop.2016.160355

PubMed Abstract | CrossRef Full Text | Google Scholar

Schulz, S., Pütz, N., Jurianz, E., Schaller, H. G., Reichert, S. (2019). Are There Any Common Genetic Risk Markers for Rheumatoid Arthritis and Periodontal Diseases? A Case-Control Study. Mediators. Inflamm., (2013). 2907062. doi: 10.1155/2019/2907062

PubMed Abstract | CrossRef Full Text | Google Scholar

Seror, R., Le Gall-David, S., Bonnaure-Mallet, M., Schaeverbeke, T., Cantagrel, A., Minet, J., et al. (2015). Association of Anti-Porphyromonas Gingivalis Antibody Titers With Nonsmoking Status in Early Rheumatoid Arthritis: Results From the Prospective French Cohort of Patients With Early Rheumatoid Arthritis. Arthritis Rheumatol. 67 (7), 1729–1737. doi: 10.1002/art.39118

PubMed Abstract | CrossRef Full Text | Google Scholar

Silman, A. J., Pearson, J. E. (2002). Epidemiology and Genetics of Rheumatoid Arthritis. Arthritis Res. 4 Suppl 3 (Suppl 3), S265–S272. doi: 10.1186/ar578

PubMed Abstract | CrossRef Full Text | Google Scholar

Smolen, J. S., Aletaha, D., McInnes, I. B. (2016). Rheumatoid Arthritis. Lancet. 388 (10055), 2023–2038. doi: 10.1016/S0140-6736(16)30173-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Unriza-Puin, S., Bautista-Molano, W., Lafaurie, G. I., Valle-Oñate, R., Chalem, P., Chila-Moreno, L., et al. (2017). Are Obesity, ACPAs and Periodontitis Conditions That Influence the Risk of Developing Rheumatoid Arthritis in First-Degree Relatives? Reumatol. Clin. 36 (4), 799–806. doi: 10.1007/s10067-016-3519-z

CrossRef Full Text | Google Scholar

Valor, L., de la Torre Ortega, I. (2012). Should We Use Poor Prognosis Factors to Start Early Treatment in Patients With Rheumatoid Arthritis? Reumatol. Clin. 8 (4), 163–167. doi: 10.1016/j.reuma.2011.12.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Wegner, N., Wait, R., Sroka, A., Eick, S., Nguyen, K. A., Lundberg, K., et al. (2010). Peptidylarginine Deiminase From Porphyromonas Gingivalis Citrullinates Human Fibrinogen and α-Enolase: Implications for Autoimmunity in Rheumatoid Arthritis. Arthritis Rheumatol. 62 (9), 2662–2672. doi: 10.1002/art.27552

CrossRef Full Text | Google Scholar

Westra, J., Brouwer, E., Raveling-Eelsing, E., Arends, S., Eman Abdulle, A., Roozendaal, C., et al. (2021). Arthritis Autoantibodies in Individuals Without Rheumatoid Arthritis: Follow-Up Data From a Dutch Populationbased Cohort (Lifelines). Rheumatology. 60 (2), 658–666. doi: 10.1093/rheumatology/keaa219

CrossRef Full Text | Google Scholar

Xiao, L., Zhang, Q., Peng, Y., Wang, D., Liu, Y. (2020). The Effect of Periodontal Bacteria Infection on Incidence and Prognosis of Cancer: A Systematic Review and Meta-Analysis. Medicine 99 (15), e19698. doi: 10.1097/MD.0000000000019698

PubMed Abstract | CrossRef Full Text | Google Scholar

Ziebolz, D., Pabel, S. O., Lange, K., Krohn-Grimberghe, B., Hornecker, E., Mausberg, R. F. (2011). Clinical Periodontal and Microbiologic Parameters in Patients With Rheumatoid Arthritis. J. Periodontol. 82 (10), 1424–1432. doi: 10.1902/jop.2011.100481

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: porphyromonas gingivalis, rheumatoid arthritis, periodontitis, autoimmune disease, meta-analysis

Citation: Li Y, Guo R, Oduro PK, Sun T, Chen H, Yi Y, Zeng W, Wang Q, Leng L, Yang L and Zhang J (2022) The Relationship Between Porphyromonas Gingivalis and Rheumatoid Arthritis: A Meta-Analysis. Front. Cell. Infect. Microbiol. 12:956417. doi: 10.3389/fcimb.2022.956417

Received: 30 May 2022; Accepted: 23 June 2022;
Published: 18 July 2022.

Edited by:

Zhanbo Zhu, Heilongjiang Bayi Agricultural University, China

Reviewed by:

Yonggang Qu, Shihezi University, China
Mulin Jun Li, Tianjin Medical University, China

Copyright © 2022 Li, Guo, Oduro, Sun, Chen, Yi, Zeng, Wang, Leng, Yang and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ling Leng, lengling@tjutcm.edu.cn; Long Yang, Long.yang@tjutcm.edu.cn; Jun Zhang, zhangj@sdu.edu.cn

Download