Systematic Review ARTICLE
Incidence of New Onset Diabetes Mellitus Secondary to Acute Pancreatitis: A Systematic Review and Meta-Analysis
- 1Department of Endocrinology, Affiliated ZhongDa Hospital, School of Medicine, Southeast University, Nanjing, China
- 2Division of Gastroenterology, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, United States
- 3Institute of Pancreas, Southeast University, Nanjing, China
Background and Aims: Patients who have an episode of acute pancreatitis (AP) frequently develop diabetes mellitus (DM) over time. The reported incidence of DM after AP varies depending on the severity, etiology and the extent of pancreatic necrosis during AP. We performed a systematic review to determine the incidence of new-onset DM after AP episode (s), and compared the rate of DM in AP patients based upon different disease characteristics.
Methods: A total of 31 relevant studies with 13894 subjects were collected from Medline, Embase, and Web of Science. Stata 15 software was used for data analyses in the meta-analysis.
Results: The random-effects pooled incidence was 23.0% for DM (95% CI 16.0–31.0%) and 15.0% (95% CI 9.0–23.0%) for DM treated with insulin. We noted substantial heterogeneity in incidence estimates for DM and DM treated with insulin (I2 = 95.61 and 71.78%; both p < 0·001). The DM incidence was higher in the populations that had a severe AP (SAP) episode than in those with mild acute pancreatitis (MAP) (39 vs. 14%). Patients that displayed pancreatic necrosis during the AP attack(s) had a higher frequency of DM than those without necrosis (37 vs. 11%). In addition, the pooled incidence of DM was higher after alcoholic compared to biliary AP (28 vs. 12%). The incidence of insulin use after SAP and alcoholic AP was 21 and 18%, respectively, with very low heterogeneities. According to duration of follow-up, the pooled rate of DM and insulin use within 5 years after AP was 20 and 14%, while the rate associated with follow-up duration of more than 5 years was elevated to 37 and 25%, respectively. On meta-regression, year of publication, male proportion, age at DM test, and duration of follow-up were neither positively nor negatively associated with the incidence of DM and DM treated with insulin in patients who had a prior AP attack.
Conclusion: Patients with AP developed DM after discharge from hospital with a frequency of about 23%. SAP, alcoholic AP and acute necrotizing pancreatitis (ANP) were associated with increased incidence of DM. Assessments of severity, etiology, and pancreatic necrosis are critical for predicting DM development after AP.
The exocrine and endocrine components comprise about 90 and 2–5%, respectively, of the pancreatic mass. Disorders of the exocrine pancreas including pancreatitis and pancreatic cancer can lead to endocrine dysfunction and abnormal glucose metabolism. The American Diabetes Association and the World Health Organization classified pancreatogenic, pancreoprivic, or apancreatic diabetes mellitus (DM) as type 3c DM. (Expert Committee on the and Classification of Diabetes, 2003; American Diabetes, 2011) Type 3c diabetes is not a single entity as it results from several different exocrine pancreatic diseases including acute, relapsing, and chronic pancreatitis of any etiology, hemochromatosis, cystic fibrosis, fibrocalculous pancreatopathy, pancreatic trauma, pancreatectomy, pancreatic agenesis, and pancreatic cancer (Woodmansey et al., 2017).
Acute pancreatitis (AP) has been reported to cause DM (Lee et al., 2016; Pendharkar et al., 2017; Tu et al., 2017, 2018). However, the data on the incidence of diabetes after AP is controversial, ranging from rare cases to more than half of all patients developing DM (Angelini et al., 1984; Doepel et al., 1993; Halonen et al., 2003; Pelli et al., 2009; Umapathy et al., 2016). Few studies reported progressive improvements (Angelini et al., 1984; Ibars et al., 2002; Shen et al., 2015) or even complete recovery (Ibars et al., 2002) of abnormal glucose metabolism after one episode of AP, while most studies showed sustained impairments of pancreatic endocrine function after attacks of AP. The reasons for such huge variations between studies are attributable to inclusion of heterogenous groups of patients (severe and mild AP, AP with and without pancreatic necrosis) as well as various follow-up periods and the inclusion of patients with and without pancreatic surgery. The severity of AP appears to correlate with the magnitude of the resulting endocrine pancreatic dysfunction. A study by Garip et al. (2013) showed that endocrine dysfunction was present in 56.4% of patients after severe AP (SAP) but only in 23.2% after mild AP (MAP). However, other studies (Wu et al., 2011; Ho et al., 2015; Nikkola et al., 2017) found that DM onset did not differ significantly between the SAP and MAP groups. The criteria to define AP severity include the presence and extent of pancreatic necrosis which reflects the pancreas local situation, and aspects of system organ dysfunction. Tu et al. (2017) reported that AP patients with pancreatic necrosis had much higher incidence of DM later on compared to those who had no pancreatic necrosis. Moreover, in the group of patients with pancreatic necrosis, the rate of DM positively correlated with the area of necrosis. This study also demonstrated that the occurrence of DM continued to increase for a long time after AP, thus the risk became much greater in those patients with more than 5 years' follow-up.
Pancreatic procedures including pancreas resection and necrosectomy in SAP patients, have an obvious effect on the incidence of DM. Nordback and Auvinen (1985) observed a very high incidence of DM in 92% of SAP patients after pancreatic necrosectomy. Similarly, Sabater et al. (2004) showed that patients undergoing necrosectomy had higher incidence of pancreatic endocrine deficiency (75 vs. 26%) in long-term follow up.
Because of the reported variation in DM incidence, there is not currently a consistent model designed to predict the probability of DM after AP. To address this unmet medical need, we undertook a systematic review and meta-analysis to identify the pancreatitis characteristics that account for the variation in DM incidence after AP.
Search Strategy and Selection Criteria
The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (Liberati et al., 2009) were used to perform the review. We searched Medline, Embase and Web of Science to identify reports for our study. The search included reports from 1960 to June 30, 2018. We used search terms AP (“acute pancreatitis” or “pancreatitis, acute”) combined with “endocrine function” OR “endocrine insufficiency” OR “impaired glucose tolerance” OR “glucose homeostasis” OR “diabetes mellitus” OR “prediabetic state” OR “type 2 diabetes mellitus” OR “type 1 diabetes mellitus” OR “adult onset diabetes mellitus” OR “maturity onset diabetes” OR “non-insulin dependent diabetes” OR “insulin dependent diabetes.” The search was limited to English-language publications and human studies.
1. Age equal to or greater than 18 years.
2. Measurements of glucose metabolism in AP patients were performed after more than one month from hospital discharge following episode (s) of AP.
3. Absence of a history of pre-existing pre-diabetes or diabetes before the AP episode.
4. The reports provided standard diagnosis methods for AP.
5. The reports included incidence rates or raw data to calculate the rates.
1. Reports that focused specifically on either AP patients with pancreatic surgery, hereditary pancreatitis or autoimmune pancreatitis.
2. Reports in which the number of DM patients were unavailable.
3. Studies where less than 50% of the patients provided information during the follow-up or there was no report on the percentage of patients providing data during follow-up.
Quality Assessment and Data Extraction
Titles and abstracts of the retrieved studies were scanned by two authors (MMZ reviewed all abstracts, and a second review was performed by MMZ and XYZ) to exclude irrelevant studies. MMZ and XYZ then read in detail the full text of the pre-selected articles to determine whether the studies met inclusion criteria. Reference lists of the selected articles were examined to avoid omission of any papers in the field. The corresponding authors were consulted to seek more information if required. The two authors undertook selection of studies, data extraction and quality assessment work independent of each other with all papers.
Data on the following variables were extracted: (1) year of publication (2) study design (e.g., cohort, case-control study) (3) method of sample selection (4) number and age of participants (5) proportion of male subjects (6) number of AP episodes (7) definition of AP and classification of its severity (8) criteria used to diagnose prediabetes and DM (9) etiology of AP (i.e., biliary, alcohol, other) and number of AP episodes due to each etiology (10) duration of follow-up period (11) glucose homeostasis test employed, (12) onset of prediabetes, DM and DM treated with insulin (13) number of subjects with acute necrotizing pancreatitis (ANP) and (14) occurrence of both abnormal glucose metabolism and ANP (15) presence of surgeries including pancreatic resection, necrosectomy, and lavage (16) presence of exocrine insufficiency and its measurement. If necessary, further clarifications were sought from the authors of relevant studies.
Participants' Key Characteristics and Definitions
AP: AP was confirmed when 2 out of the 3 measures were fulfilled: (1) typical abdominal pain, (2) serum amylase and/or lipase >3 times the upper limit of normal, and/or (3) characteristic findings from abdominal imaging.
Because different definitions of diabetes were used during the years of the reports, we used the following in our review: individuals with FBG ≥7.8 mmol/L or 2 h OGTT ≥11.1 mmol/L or FBG ≥7.0 mmol/L and/or treatment with insulin, oral hypoglycemic drugs or specific dietary management.
The severity classifications of acute pancreatitis have changed over the years: (1) 1974: Ranson's Criteria (Ranson et al., 1974); (2) 1981: Acute Physiology and Chronic Health Examination (APACHE) II score ≥8 (Larvin and McMahon, 1989); (3) 1990: Balthazar computed tomography severity index (CTSI) (Balthazar et al., 1990); (4) 1992: The Atlanta Classification of acute pancreatitis (Bradley, 1993) (5) 2008: Bedside index for severity in AP (BISAP) score (Wu et al., 2008); (6) 2012: The revised Atlanta Classification of acute pancreatitis (Sarr, 2013). Most of the studies included in this review define the severity of AP with Atlanta criteria and revised Atlanta criteria, 2 with Ranson's Criteria (Malecka-Panas et al., 2002; Hochman et al., 2006) and 1 (Yasuda et al., 2008) with APACHE II score system. Further, the participants were categorized as “severe” if they had hemorrhagic AP or necrotizing AP, or met the SAP definition of Japanese severity score (Ogawa et al., 2002). The remaining subjects were considered as “mild.”
Acute necrotizing pancreatitis was determined based on contrast-enhanced CT scan, histology, surgery or medical records.
Pancreatic surgery was noted when the patient underwent pancreatic resection, necrosectomy with peritoneal lavage, retroperitoneal drainage and lavage. Surgeries not related to pancreas (e.g., cholecystectomy, cesarean section, and others) were not recorded as surgery for the purposes of this study.
Recurrent AP was recorded in patients with one or more episodes of confirmed AP since their first AP attack. Those patients with only one confirmed episode of AP were recorded as no recurrence or one single attack of AP.
Exocrine pancreatic insufficiency was determined by using the Fecal elastase (FE-1) test. Abnormal exocrine pancreatic function was defined as Elastase ≤ 200 μg/g stool. Patients with abnormal exocrine pancreatic function tested using the secretin-cerulein test according to Malfertheiner Classification were also deemed to be positive.
Pooled incidence estimates were calculated by the variance-stabilizing double arcsine transformation to generate approximation to the normal distribution, because binary data with low incidence existed in the studies included in the present review (Freeman and Tukey, 1950). With double arcsine transformation, the transformed rates were weighted very slightly toward 50%, and the incidence of zero can thus be analyzed to give the combined proportion. Meanwhile, 95% CIs were calculated by the Wilson method (Newcombe, 1998). We used random-effects models for summary statistics by STATA 15.0. The critical appraisal tool of Munn et al (Munn et al., 2014) was used to grade the quality of our incidence studies (Supplementary Table 1). The heterogeneity between studies was estimated with the I2 statistic, with values of 25, 50, and 75% showing low, moderate, and high degrees of heterogeneity, respectively (Higgins et al., 2003). The research bias in the publications was evaluated with the Egger's (Sterne et al., 2001) test. To evaluate if the results were stable and reliable, a sensitivity analysis was performed after excluding two studies [one with a large population (Ho et al., 2015), and another one with a small population (Seligson et al., 1982)] from the prediabetic and/or diabetic group(s). Forest plots were generated to show incidence proportions. Studies were grouped according to the etiology and severity of AP, and whether the participants had necrosis, recurrence, surgery, or pancreatic exocrine insufficiency. We defined subgroups of etiology (alcoholic, biliary vs. others), severity (MAP vs. SAP), and necrosis (ANP vs. non-ANP). Potential sources of heterogeneity were further investigated by arranging groups of studies according to potentially relevant features and by meta-regression analysis, which attempts to relate differences in effect sizes to study features (Thompson and Higgins, 2002). Four univariate meta-regression analyses (post hoc) were carried out to examine the relation of incidence of diabetes in AP to 4 factors: (1) publication year, (2) age, (3) male proportion, and (4) duration of following up. All these factors could explain the variance of diabetes incidence. All statistical analyses were performed using STATA (version 15.0) with the commands metaprop (for random-effects meta-analysis specifying two variables: double-arcsine-transformed incidence and Wilson CIs) and metareg (for metaregression).
Thirty-one studies were selected for inclusion (Figure 1). We scanned a total of 3691 publications. After removal of duplicates and initial screening of titles and abstracts, 62 papers were reviewed by reading the full text. After exclusion of ineligible reports, the final sample comprised 31 studies (n = 13,894 subjects) published between June 1, 1946, and June 30, 2018, with a total of 31 (13894) on DM (Ohlsen, 1968; Johansen and Ornsholt, 1972; Olszewski et al., 1978; Seligson et al., 1982; Angelini et al., 1984, 1993; Eriksson et al., 1992; Doepel et al., 1993; Malecka-Panas et al., 1996, 2002; Appelros et al., 2001; Ibars et al., 2002; Boreham and Ammori, 2003; Halonen et al., 2003; Szentkereszty et al., 2004; Hochman et al., 2006; Kaya et al., 2007; Yasuda et al., 2008; Gupta et al., 2009; Pelli et al., 2009; Andersson et al., 2010; Uomo et al., 2010; Garip et al., 2013; Vujasinovic et al., 2014; Chandrasekaran et al., 2015; Ho et al., 2015; Winter Gasparoto et al., 2015; Umapathy et al., 2016; Vipperla et al., 2016; Nikkola et al., 2017; Tu et al., 2017), and 10 studies (428) on DM treated with insulin (Ohlsen, 1968; Eriksson et al., 1992; Doepel et al., 1993; Appelros et al., 2001; Malecka-Panas et al., 2002; Boreham and Ammori, 2003; Hochman et al., 2006; Yasuda et al., 2008; Gupta et al., 2009; Chandrasekaran et al., 2015) (Table 1). Sample sizes ranged from 9 to 12284, with most studies including sample sizes between 15 and 150. One study had a minimum size of 9 (Seligson et al., 1982), and other one a maximum size of 12284 (Ho et al., 2015). The critical appraisal tool of Munn et al(Munn et al., 2014) was used to grade the quality of our incidence studies, the results are shown in Supplementary Table 1. We examined the incidence of DM in studies fulfilling all quality criteria. In these 14 studies, the DM incidence was 23% (95% CI 13–35%) (Supplementary Figure 1).
No evidence of funnel plot asymmetry for DM (excluding the study with 12284 subjects) and DM treated with insulin was found (p-values of 0.328 and 0.169 for Egger's test, respectively; Supplementary Figure 2), indicating a lack of publication bias. When we included the large study with 12284 subjects, there was an obvious publication bias by Egger's test.
Estimates of the incidence of DM after AP ranged from 0 to 54.0% (Figure 2); heterogeneity was pronounced (I2 = 95.61%, P < 0.001). The random-effects pooled incidence was 23.0% (95% CI 16.0–31.0%). Removal of either or both of the two studies with the lowest and highest populations did not affect the overall pooled estimate or the level of heterogeneity. The result of sensitivity analysis was shown in Supplementary Table 2. Data were available for DM incidence among subjects with alcoholic etiology in 10 studies (Johansen and Ornsholt, 1972; Doepel et al., 1993; Malecka-Panas et al., 1996, 2002; Boreham and Ammori, 2003; Hochman et al., 2006; Yasuda et al., 2008; Pelli et al., 2009; Andersson et al., 2010; Nikkola et al., 2017), biliary etiology in 7 studies (Johansen and Ornsholt, 1972; Ibars et al., 2002; Malecka-Panas et al., 2002; Boreham and Ammori, 2003; Hochman et al., 2006; Yasuda et al., 2008; Andersson et al., 2010) and other etiology in 6 studies (Johansen and Ornsholt, 1972; Malecka-Panas et al., 2002; Boreham and Ammori, 2003; Hochman et al., 2006; Yasuda et al., 2008; Andersson et al., 2010) (Table 2 and Supplementary Table 3). Incidence of DM in subjects with and without previous history of ANP was reported in 7 (Boreham and Ammori, 2003; Szentkereszty et al., 2004; Yasuda et al., 2008; Uomo et al., 2010; Garip et al., 2013; Umapathy et al., 2016; Tu et al., 2017) and 4 studies (Boreham and Ammori, 2003; Yasuda et al., 2008; Garip et al., 2013; Tu et al., 2017). Besides, 11 (Doepel et al., 1993; Appelros et al., 2001; Ibars et al., 2002; Boreham and Ammori, 2003; Halonen et al., 2003; Hochman et al., 2006; Yasuda et al., 2008; Gupta et al., 2009; Garip et al., 2013; Chandrasekaran et al., 2015; Tu et al., 2017) and 4 studies (Ibars et al., 2002; Boreham and Ammori, 2003; Garip et al., 2013; Tu et al., 2017) reported data of DM morbidity after SAP and MAP (Table 2). In the subgroup analyses, pooled incidence of DM after alcoholic, biliary or AP due to other etiology was, respectively 28% (I2 = 76.3%, P < 0.001), 12% (I2 = 24.6%, P = 0.24) and 24% (I2 = 73.7%, P < 0.001) (Figure 3). In addition, combined incidence of DM after SAP and MAP was 39% (I2 = 63.73%, P < 0.001) and 14% (I2 = 0 %, P = 0.48), respectively (Figure 4). Subjects who developed DM after AP with and without necrosis showed different integrated rates of 37% (I2 = 78.1%, P < 0.001) and 11% (I2 = 78.9%, P < 0.001), respectively (Figure 5). Concerning duration of follow-up (< 5 years or > 5 years), pooled incidence of DM within 5 years was 20%, while that over 5 years was increased to 37% (Table 3). In the meta-regression, we found no association between the incidence of DM after AP and the proportion of the male patients (P = 0.284; Figure 6A), year of publication (P = 0.173; Figure 6B), duration of following up (P = 0.671; Figure 6C), or mean age (P = 0.938; Figure 6D).
Table 3. Incidence of diabetes and insulin usage after acute pancreatitis according to different duration of following up.
Figure 3. Incidence of diabetes after acute pancreatitis caused by different etiologies. CI, confidence interval.
Figure 4. Incidence of diabetes after acute pancreatitis of different severities. SAP, Severe acute pancreatitis; MAP, Mild acute pancreatitis; CI, confidence interval.
Figure 5. Incidence of diabetes after acute pancreatitis with and without necrosis. ANP, acute necrotizing pancreatitis; NANP, Non-ANP; CI, confidence interval.
Figure 6. (A) Meta-regression of relation between male proportion and diabetes incidence after acute pancreatitis (P = 0.284); (B) Meta-regression of relation between year of publication of the studies and diabetes incidence after acute pancreatitis (P = 0.173); (C) Meta-regression of relation between duration of following up and diabetes incidence after acute pancreatitis (P = 0.671); (D) Meta-regression of relation between mean age in the general population and diabetes incidence after acute pancreatitis (P = 0.938).
Estimates of the incidence of insulin-treated DM after AP ranged from 0 to 34.0% (Figure 7); The random-effects pooled incidence was 15.0% (95% CI 9.0–23.0%). There was moderate statistical heterogeneity between studies (I2 = 71.78%, P < 0.001). Therefore, we performed sensitivity analyses, subgroup analyses, and meta-regression to examine this heterogeneity. We constrained our analysis to studies evaluating insulin usage after SAP (Doepel et al., 1993; Appelros et al., 2001; Boreham and Ammori, 2003; Hochman et al., 2006; Yasuda et al., 2008; Gupta et al., 2009; Chandrasekaran et al., 2015) or alcoholic AP (Doepel et al., 1993; Boreham and Ammori, 2003; Hochman et al., 2006), finding pooled incidence of 21% (95% CI 15 to 28%) and 18% (95% CI 5 to 35%), respectively, with low heterogeneity between these studies (I2 = 19.99%, P = 0.28; I2 = 3.01%, P = 0.36) (Supplementary Figures 3, 4). According to duration of follow-up (< 5 years and > 5 years), pooled incidence of the treatment with insulin within 5 years was 14%, while that over 5 years was elevated to 25% (Table 3). The meta-regression could not demonstrate any associations between the insulin-treated DM and factors including proportion of the male, year of publication, duration of following up and mean age (Supplementary Table 4).
Findings from this systematic review and meta-analysis suggest that DM is an important problem for AP patients, although there is wide variation in the incidence of DM between populations from different subgroups. A previous study (Das et al., 2014) reported the pooled estimates of the incidence of endocrine dysfunction (both prediabetes and diabetes) in 40% after a first attack of AP. In this review, we increased the number of included studies and enlarged the population of AP, which could further strengthen the reliability of the result of DM rate after AP. Additionally, we restrictedly focused on the occurrence of diabetes only, finding a similar incidence of DM after AP to the result of the prior meta-analysis in about 23%. What's particularly different from the prior meta-analysis is that we compared the DM rate among AP subjects with various severity and etiology, with and without the presence of pancreatic necrosis. Those subjects with SAP, alcoholic AP and ANP have a DM incidence after the AP attack of 39, 28, and 37% respectively compared with lower DM rates of 14, 12, and 11% in MAP, biliary AP and non-ANP, respectively. This finding indicates the severity, etiology, and necrosis are crucial factors in predicting new-onset DM after AP.
DM secondary to pancreatic diseases is classified as pancreatogenic diabetes (American Diabetes, 2011). Acute pancreatitis, as the most common pancreatic disorder, is more often associated with the development of pancreatic endocrine dysfunction. However, there is little information relating pancreatic exocrine function to the development of diabetes after an episode of AP. Few studies reported full pancreatic functional recovery (both exocrine and endocrine) after AP (Mitchell et al., 1983; Angelini et al., 1993), while other studies found both endocrine and exocrine insufficiency after AP attack(s) (Büchler et al., 1985; Seidensticker et al., 1995). To our knowledge, acute stress, pancreatic microcirculation disorder and excessive secretion of catecholamines after AP could result in disruption of glucose metabolism leading to a transient rise in blood glucose. During the recovery phase of AP, blood glucose levels would rapidly return to normal in most patients (Symersky et al., 2006; Kaya et al., 2007; Garip et al., 2013). However, a subset of the patients will develop DM and need prolonged antidiabetic treatments including insulin (Mentula et al., 2008; Czakó et al., 2009). One possible mechanism of DM secondary to AP could be nutrient maldigestion induced by exocrine insufficiency that causes abnormal incretin secretion and impaired insulin release from β-cells (Ebert and Creutzfeldt, 1980). Increased insulin resistance could be another explanation for abnormal carbohydrate metabolism after AP (Yeo et al., 1989; Buscher et al., 1999). These two possible mechanisms appear to be associated with classical type 2 diabetes (Balzano et al., 2014), which illustrates that T3cDM might be a heterogeneous disorder strongly overlapping with type 2 diabetes. In addition, the loss of pancreatic β cells caused by necrosis is considered to be a main cause of DM after AP, especially in those subjects with necrosectomy. A prior study (Chandrasekaran et al., 2015) made comparison between non-operative and necrosectomy group, higher incidence of abnormal glucose tolerance was also observed in patients undergoing necrosectomy. Besides, it was observed that insulin requirement was significantly higher in necrosectomy group.
ANP is reported to be associated with a higher risk of subsequent endocrine insufficiency and DM (Winter Gasparoto et al., 2015; Umapathy et al., 2016; Tu et al., 2018). One study showed that the incidence of new-onset diabetes after ANP was as high as 45% (Umapathy et al., 2016). A study by Tu et al. (2017) showed that the development of DM correlated strongly with the extent of pancreatic necrosis. The ANP patients with necrosis over 50% of the pancreas had a much higher incidence of DM than those with necrosis area < 30% (57.7 vs. 19.4%), as well as worse control of glucose as measured by HbA1C% (P = 0.001). They also presented that necrosis in the tail of the pancreas had more risks for DM than that in the pancreatic head or body, as more islets are distributed in the tail of the pancreas. As a result, ANP is a risk factor for DM promotion, which could account for the higher incidence of DM in 37% compared with 11% in AP patients without necrosis. A likely cause of the greater incidence of DM after ANP is a decrease in numbers of functional islet β-cells and levels of secreted insulin due to tissue destruction (Gupta et al., 2009). Furthermore, a subset of ANP patients are subjected to open necrosectomy and partial pancreatectomy as gold-standard approaches for treating ANP-related complications (Freeman et al., 2012), which may cause pancreatogenic diabetes as reported before (Tsiotos et al., 1998; Boreham and Ammori, 2003; Bavare et al., 2004; Kahl and Malfertheiner, 2004; Connor et al., 2005; Busse and Ainsworth, 2015; Kapoor, 2016;Roeyen et al., 2016).
Along with ANP, SAP might be another accelerating factor for developing DM after AP. Compared to mild AP, SAP is linked to higher degree of pancreatic injury, which may promote endocrine insufficiency. However, data on the expediting impact of SAP on DM development is equivocal. Several studies reported no association between the severity of AP and the rate of subsequent DM (Ho et al., 2015; Nikkola et al., 2017), while others concluded that SAP led to increased occurrence of impaired glucose metabolism (Uomo et al., 2010; Garip et al., 2013; Vipperla et al., 2016). The severity of AP depends on both pancreatic necrosis (reflecting the pancreas local circumstance) and organ dysfunction, and surgical intervention is a common choice for pancreatic necrosis. Long-term outcomes in patients with SAP managed by surgical and non-surgical treatments were compared by Chandrasekaran et al. (2015). The authors found a higher incidence of endocrine dysfunction in AP patients undergoing necrosectomy. These considerations suggest it may be difficult to dissociate the effects of pancreatic necrosis vs. surgical intervention.
A greater rate of DM after alcoholic compared to biliary AP was discovered in our study, which is consistent with a nationwide population-based study by Ho et al. (2015). Alcohol abuse can damage the pancreas directly or via its metabolites. Studies demonstrate that alcohol causes pancreatitis via precipitation of secreted proteins (protein plug formation) within small pancreatic ductules leading to pancreas atrophy and fibrosis, and ultimately promotes premature intracellular digestive enzyme activation leading to autodigestive injury (Sarles, 1971, 1974; Guy et al., 1983; Apte et al., 1995). Moreover, alcohol and its metabolites, cytokines and growth factors released during alcohol-induced pancreatic necroinflammation can activate pancreatic stellate cells, which will be responsible for the ongoing inflammation and fibrosis of the pancreas (Apte et al., 2010). The sustained exocrine damage caused by pancreatic autodigestive injury and pancreatic fibrosis are both risk factors for DM development. Meanwhile, pancreatic endocrine dysfunction is considered to be associated with recurrent AP (Sand and Nordback, 2009; Ho et al., 2015; Nikkola et al., 2017). Nikkola et al. (2017) discovered that half of the patients with recurrent AP developed new pancreatogenic diabetes in a median of 4.3 years after the initial attack, and only the patients with recurrent AP episodes developed pancreatogenic diabetes. Alcoholic pancreatitis is the most likely form of AP to be recurrent, which suggests that patients with alcoholic AP are at a higher risk of developing diabetes associated with recurrent episodes of pancreatitis.
In terms of the trend of DM occurrence with time, there was a significant increase in the incidence of diabetes discovered in the present review, which is similar to findings in a previous study (Das et al., 2014). An observational study by Tu et al. (2017) showed that the value of HbA1C gradually increased over time after AP indicating that endocrine pancreatic function decreases over time after AP. However, due to the fact that T3cDM is a heterogeneous entity strongly overlapping with type 2 diabetes, it is difficult to establish conclusively whether it is caused by AP or is following its own natural course. On the other hand, individuals may suffer from further attacks of AP during 5 years, which apparently contribute to an increased incidence of DM with duration of follow-up. Several studies included in our review indeed reported that some patients experienced recurrent AP (Angelini et al., 1984; Eriksson et al., 1992; Appelros et al., 2001; Malecka-Panas et al., 2002; Halonen et al., 2003; Szentkereszty et al., 2004; Yasuda et al., 2008; Gupta et al., 2009; Pelli et al., 2009; Ho et al., 2015; Nikkola et al., 2017; Tu et al., 2017), which might increase the rate of DM with time.
Our analysis observed significant heterogeneity that could not be fully explained by the examined characteristics. Potential sources of heterogeneity were further investigated by arranging subgroups according to etiology (alcoholic, biliary vs. others), severity (MAP vs. SAP), and necrosis (ANP vs. non-ANP) and by meta-regression analysis. The subgroup analysis decreased the heterogeneity to a degree, especially in the biliary AP and MAP group. Meta-regressions were performed to examine the interaction between age, sex, year of publication, duration of follow-up and incidence of DM after AP, and none of these explained the heterogeneity. Considering the possibility that publication bias could be a cause for the high heterogeneity, we made funnel plots finding no evidence of funnel plot asymmetry for DM after excluding the study with 12284 subjects. When we included the study with 12284 samples, there was an obvious publication bias by Egger's test. However, when we removed the study with huge number of patients, neither of the heterogeneity or the incidence changed significantly.
Strengths of the present study include a large pool of identified studies drawn from 3 different databases (Medline, EMBASE and Web of science). This large number of studies enabled us to relate the diabetes outcome to subsets of patients with different severities and etiologies. The large pool of studies also afforded meta-regression with examination of important demographic variables as interacting factors. We were able to use high quality studies, excluding those of patients with pre-existing DM and others focused on pancreatic surgery. Thus, we were able to focus our work on patients with newly diagnosed DM after AP without the confounding factors related to the effect of surgical islet removal on DM development.
An observed heterogeneity that lacks sufficient explanatory factors is a significant limitation of our study that affects interpretation of the pooled estimate. Although some of our subgroup analyses involving patients in biliary AP and MAP groups would decrease heterogeneity to a low level, some other groups with high heterogeneity could not be explained by sensitivity analysis and meta-regression analysis. Such a high heterogeneity might be associated with several limitations of the study, such as differences in the number of AP attacks between the studies. Most of the studies did not indicate whether patients had multiple AP attacks. Only two studies reported that RAP was associated with the development of pancreatogenic diabetes, while another one found no correlation between the number of AP attacks and glucose tolerance abnormalities. Consequently, the effect of RAP on risk of developing DM remains unknown. Despite our exclusion of studies which only paid attention to pancreatic surgery, 15 of the studies we retained did report patients undergoing pancreatic surgical interventions including necrosectomy, peritoneal lavage, percutaneous drainage and pancreatectomy. The 4 studies which compared DM development between patients with and without pancreatic surgery found a much higher rate of DM after surgery. Hence, pancreatic surgery is a risk factor for DM and is another source of heterogeneity. Furthermore, the severity classifications of acute pancreatitis have changed over the years. Different criteria were used for the severity classification of AP in the included studies, which is particularly important to the high level of heterogeneity.
There are also some other limitations in the present study. Eleven studies included in the review focused on SAP, which broke the assumption that a conglomerate of all the studies is representation of all patients with acute pancreatitis. The fact that mild acute pancreatitis is under-represented inflated the figures for the incidence of diabetes mellitus. Even though subjects with chronic pancreatitis were excluded in the studies we chose, patients with RAP were not totally eliminated. RAP is recognized as an intermediary stage in the pathogenesis of chronic pancreatitis, and a subset of RAP patients undergo their natural course transition to chronic pancreatitis (Párniczky et al., 2016; Machicado and Yadav, 2017). Thus, potential mixture of chronic pancreatitis and RAP could influence the outcome. As reported, body mass index (BMI) highly influence the outcome of AP (Dobszai et al., 2019). The lack of data on the changes in body weight or BMI is a potential negative factor to find a causal relation between AP attacks and the rising risk of DM. Besides, most of the studies excluded patients who died from the attack of AP during the follow up, which represents a selection bias influencing the active incidence. Additionally, although the studies included in our meta-analysis claimed that they have ruled out subjects with pre-existing diabetes, measurement of HbA1C within the first 3 months after AP which could definitely exclude pre-existing DM was performed in only 4 studies. This actually impact the real incidence of DM and even the AP process.
The results of our analysis show that ~1 in 5 patients with an AP episode develops DM afterwards, and the rate increases over time. In addition, the occurrence of DM after alcoholic AP, SAP, and ANP was 2 to 3 times higher than that secondary to biliary AP, MAP, and AP without necrosis. Our findings strongly highlight the importance of regular long-term follow-up for endocrine function in patients after AP, especially in those with severe, alcoholic, and necrotizing pancreatitis. The early diagnosis and treatment of endocrine impairment can also help the population prevent deterioration of pancreatic exocrine function.
MZ, SP, and LL designed the study and wrote the paper. MZ and XZ performed the work and analyzed the data. AL and RW made technical and scientific contributions, and reviewed the manuscript. All the authors approved the final version.
This study was supported by the National Nature Science Foundation of China (No. 81570739, LL), Postgraduate Research & Practice Innovation Program of Jiangsu Province (No. KYCX17_0172) and the China Scholarship Council (No. 201706090197). U01 DK108314 was provided by the National Institutes of Health, US.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphys.2019.00637/full#supplementary-material
Andersson, B., Pendse, M. L., and Andersson, R. (2010). Pancreatic function, quality of life and costs at long-term follow-up after acute pancreatitis. World J. Gastroenterol. 16, 4944–4951. doi: 10.3748/wjg.v16.i39.4944
Angelini, G., Cavallini, G., Pederzoli, P., Bovo, P., Bassi, C., Di Francesco, V., et al. (1993). Long-term outcome of acute pancreatitis: a prospective study with 118 patients. Digestion 54, 143–147. doi: 10.1159/000201028
Angelini, G., Pederzoli, P., Caliari, S., Fratton, S., Brocco, G., Marzoli, G., et al. (1984). Long-term outcome of acute necrohemorrhagic pancreatitis. A 4-year follow-up. Digestion 30, 131–137. doi: 10.1159/000199097
Apte, M. V., Wilson, J. S., Korsten, M. A., McCaughan, G. W., Haber, P. S., and Pirola, R. C. (1995). Effects of ethanol and protein deficiency on pancreatic digestive and lysosomal enzymes. Gut 36, 287–293. doi: 10.1136/gut.36.2.287
Balzano, G., Dugnani, E., Pasquale, V., Capretti, G., Radaelli, M. G., Garito, T., et al. (2014). Clinical signature and pathogenetic factors of diabetes associated with pancreas disease (T3cDM): a prospective observational study in surgical patients. Acta Diabetol. 51, 801–811. doi: 10.1007/s00592-014-0614-y
Bavare, C., Prabhu, R., and Supe, A. (2004). Early morphological and functional changes in pancreas following necrosectomy for acute severe necrotizing pancreatitis. Indian J. Gastroenterol. 23, 203–205.
Boreham, B., and Ammori, B. J. (2003). A prospective evaluation of pancreatic exocrine function in patients with acute pancreatitis: correlation with extent of necrosis and pancreatic endocrine insufficiency. Pancreatology 3, 303–308. doi: 10.1159/000071768
Bradley, E. L. 3rd. (1993). A clinically based classification system for acute pancreatitis. Summary of the International Symposium on Acute Pancreatitis, Atlanta, Ga, September 11 through 13, 1992. Arch. Surg. 128, 586–590. doi: 10.1001/archsurg.1993.01420170122019
Büchler, M., Malfertheiner, P., Block, S., Maier, W., and Beger, H. G. (1985). Morphologic and functional changes in the pancreas following acute necrotizing pancreatitis. Z. Gastroenterol. 23, 79–83.
Buscher, H. C., Jacobs, M. L., Ong, G. L., van Goor, H., Weber, R. F., and Bruining, H. A. (1999). Beta-cell function of the pancreas after necrotizing pancreatitis. Dig. Surg. 16, 496–500. doi: 10.1159/000018775
Chandrasekaran, P., Gupta, R., Shenvi, S., Kang, M., Rana, S. S., Singh, R., et al. (2015). Prospective comparison of long term outcomes in patients with severe acute pancreatitis managed by operative and non operative measures. Pancreatology 15, 478–484. doi: 10.1016/j.pan.2015.08.006
Connor, S., Alexakis, N., Raraty, M. G., Ghaneh, P., Evans, J., Hughes, M., et al. (2005). Early and late complications after pancreatic necrosectomy. Surgery 137, 499–505. doi: 10.1016/j.surg.2005.01.003
Czakó, L., Hegyi, P., Rakonczay, Z. Jr., Wittmann, T., and Otsuki, M. (2009). Interactions between the endocrine and exocrine pancreas and their clinical relevance. Pancreatology 9, 351–359. doi: 10.1159/000181169
Das, S. L., Singh, P. P., Phillips, A. R., Murphy, R., Windsor, J. A., and Petrov, M. S. (2014). Newly diagnosed diabetes mellitus after acute pancreatitis: a systematic review and meta-analysis. Gut 63, 818–831. doi: 10.1136/gutjnl-2013-305062
Dobszai, D., Mátrai, P., Gyöngyi, Z., Csupor, D., Bajor, J., Eross, B., et al. (2019). Body-mass index correlates with severity and mortality in acute pancreatitis: a meta-analysis. World J. Gastroenterol. 25, 729–743. doi: 10.3748/wjg.v25.i6.729
Doepel, M., Eriksson, J., Halme, L., Kumpulainen, T., and Höckerstedt, K. (1993). Good long-term results in patients surviving severe acute pancreatitis. Br. J. Surg. 80, 1583–1586. doi: 10.1002/bjs.1800801229
Ebert, R., and Creutzfeldt, W. (1980). Reversal of impaired GIP and insulin secretion in patients with pancreatogenic steatorrhea following enzyme substitution. Diabetologia 19, 198–204. doi: 10.1007/BF00275269
Eriksson, J., Doepel, M., Widen, E., Halme, L., Ekstrand, A., Groop, L., et al. (1992). Pancreatic surgery, not pancreatitis, is the primary cause of diabetes after acute fulminant pancreatitis. Gut 33, 843–847. doi: 10.1136/gut.33.6.843
Expert Committee on the, D., and Classification of Diabetes, M. (2003). Report of the expert committee on the diagnosis and classification of diabetes mellitus. Diabetes Care 26(Suppl. 1), S5–20. doi: 10.2337/diacare.26.2007.S5
Freeman, M. L., Werner, J., van Santvoort, H. C., Baron, T. H., Besselink, M. G., Windsor, J. A., et al. (2012). Interventions for necrotizing pancreatitis: summary of a multidisciplinary consensus conference. Pancreas 41, 1176–1194. doi: 10.1097/MPA.0b013e318269c660
Garip, G., Sarandöl, E., and Kaya, E. (2013). Effects of disease severity and necrosis on pancreatic dysfunction after acute pancreatitis. World J. Gastroenterol. 19, 8065–8070. doi: 10.3748/wjg.v19.i44.8065
Guy, O., Robles-Diaz, G., Adrich, Z., Sahel, J., and Sarles, H. (1983). Protein content of precipitates present in pancreatic juice of alcoholic subjects and patients with chronic calcifying pancreatitis. Gastroenterology 84, 102–107.
Halonen, K. I., Pettilä, V., Leppäniemi, A. K., Kemppainen, E. A., Puolakkainen, P. A., and Haapiainen, R. K. (2003). Long-term health-related quality of life in survivors of severe acute pancreatitis. Intensive Care Med. 29, 782–786. doi: 10.1007/s00134-003-1700-8
Ho, T. W., Wu, J. M., Kuo, T. C., Yang, C. Y., Lai, H. S., Hsieh, S. H., et al. (2015). Change of both endocrine and exocrine insufficiencies after acute pancreatitis in non-diabetic patients: a nationwide population-based study. Medicine 94:e1123. doi: 10.1097/MD.0000000000001123
Ibars, E. P., Sánchez de Rojas, E. A., Quereda, L. A., Ramis, R. F., Sanjuan, V. M., and Peris, R. T. (2002). Pancreatic function after acute biliary pancreatitis: does it change? World J. Surg. 26, 479–486. doi: 10.1007/s00268-001-0253-7
Kaya, E., Dervisoglu, A., and Polat, C. (2007). Evaluation of diagnostic findings and scoring systems in outcome prediction in acute pancreatitis. World J. Gastroenterol. 13, 3090–3094. doi: 10.3748/wjg.v13.i22.3090
Lee, Y. K., Huang, M. Y., Hsu, C. Y., and Su, Y. C. (2016). Bidirectional Relationship Between Diabetes and Acute Pancreatitis: A Population-Based Cohort Study in Taiwan. Medicine 95:e2448. doi: 10.1097/MD.0000000000002448
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P., et al. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 6:e1000100. doi: 10.1371/journal.pmed.1000100
Mentula, P., Kylänpää, M. L., Kemppainen, E., and Puolakkainen, P. (2008). Obesity correlates with early hyperglycemia in patients with acute pancreatitis who developed organ failure. Pancreas 36, e21–25. doi: 10.1097/mpa.0b013e31814b22b5
Mitchell, C. J., Playforth, M. J., Kelleher, J., and McMahon, M. J. (1983). Functional recovery of the exocrine pancreas after acute pancreatitis. Scand. J. Gastroenterol. 18, 5–8. doi: 10.3109/00365528309181549
Munn, Z., Moola, S., Riitano, D., and Lisy, K. (2014). The development of a critical appraisal tool for use in systematic reviews addressing questions of prevalence. Int. J. Health Policy Manag. 3, 123–128. doi: 10.15171/ijhpm.2014.71
Newcombe, R. G. (1998). Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat. Med. 17, 857–872. doi: 10.1002/(SICI)1097-0258(19980430)17:8<857::AID-SIM777>3.0.CO;2-E
Nikkola, J., Laukkarinen, J., Lahtela, J., Seppänen, H., Järvinen, S., Nordback, I., et al. (2017). The long-term prospective follow-up of pancreatic function after the first episode of acute alcoholic pancreatitis: recurrence predisposes one to pancreatic dysfunction and pancreatogenic diabetes. J. Clin. Gastroenterol. 51, 183–190. doi: 10.1097/MCG.0000000000000564
Ogawa, M., Hirota, M., Hayakawa, T., Matsuno, S., Watanabe, S., Atomi, Y., et al. (2002). Development and use of a new staging system for severe acute pancreatitis based on a nationwide survey in Japan. Pancreas 25, 325–330. doi: 10.1097/00006676-200211000-00001
Olszewski, S., Kinalska, I., Długosz, J., Stasiewicz, J., and Gabryelewicz, A. (1978). The glucose tolerance, insulin response and pancreatic exocrine function in patients after acute pancreatitis. Endokrinologie 71, 183–191.
Párniczky, A., Kui, B., Szentesi, A., Balázs, A., Szucs, Á., Mosztbacher, D., et al. (2016). Prospective, multicentre, nationwide clinical data from 600 cases of acute pancreatitis. PLoS ONE. 11:e0165309. doi: 10.1371/journal.pone.0165309
Pelli, H., Lappalainen-Lehto, R., Piironen, A., Jarvinen, S., Sand, J., and Nordback, I. (2009). Pancreatic damage after the first episode of acute alcoholic pancreatitis and its association with the later recurrence rate Pancreatology 9, 245–251. doi: 10.1159/000212089
Pendharkar, S. A., Mathew, J., and Petrov, M. S. (2017). Age- and sex-specific prevalence of diabetes associated with diseases of the exocrine pancreas: A population-based study. Dig. Liver Dis. 49, 540–544. doi: 10.1016/j.dld.2016.12.010
Ranson, J. H., Rifkind, K. M., Roses, D. F., Fink, S. D., Eng, K., and Spencer, F. C. (1974). Prognostic signs and the role of operative management in acute pancreatitis. Surg. Gynecol. Obstet. 139, 69–81.
Roeyen, G., Jansen, M., Chapelle, T., Bracke, B., Hartman, V., Ysebaert, D., et al. (2016). Diabetes mellitus and pre-diabetes are frequently undiagnosed and underreported in patients referred for pancreatic surgery. A prospective observational study. Pancreatology 16, 671–676. doi: 10.1016/j.pan.2016.04.032
Sabater, L., Pareja, E., Aparisi, L., Calvete, J., Camps, B., Sastre, J., et al. (2004). Pancreatic function after severe acute biliary pancreatitis: the role of necrosectomy. Pancreas 28, 65–68. doi: 10.1097/00006676-200401000-00010
Shen, H. N., Yang, C. C., Chang, Y. H., Lu, C. L., and Li, C. Y. (2015). Risk of diabetes mellitus after first-attack acute pancreatitis: a national population-based study. Am. J. Gastroenterol. 110, 1698–1706. doi: 10.1038/ajg.2015.356
Sterne, J. A., Egger, M., and Smith, G. D. (2001). Systematic reviews in health care: investigating and dealing with publication and other biases in meta-analysis. BMJ 323, 101–105. doi: 10.1136/bmj.323.7304.101
Tu, J., Yang, Y., Zhang, J., Yang, Q., Lu, G., Li, B., et al. (2018). Effect of the disease severity on the risk of developing new-onset diabetes after acute pancreatitis. Medicine 97:e10713. doi: 10.1097/MD.0000000000010713
Tu, J., Zhang, J., Ke, L., Yang, Y., Yang, Q., Lu, G., et al. (2017). Endocrine and exocrine pancreatic insufficiency after acute pancreatitis: long-term follow-up study. BMC Gastroenterol. 17:114. doi: 10.1186/s12876-017-0663-0
Umapathy, C., Raina, A., Saligram, S., Tang, G., Papachristou, G. I., Rabinovitz, M., et al. (2016). Natural history after acute necrotizing pancreatitis: a large US Tertiary care experience. J. Gastrointest. Surg. 20, 1844–1853. doi: 10.1007/s11605-016-3264-2
Uomo, G., Gallucci, F., Madrid, E., Miraglia, S., Manes, G., and Rabitti, P. G. (2010). Pancreatic functional impairment following acute necrotizing pancreatitis: long-term outcome of a non-surgically treated series. Dig. Liver Dis. 42, 149–152. doi: 10.1016/j.dld.2009.08.007
Vipperla, K., Papachristou, G. I., Slivka, A., Whitcomb, D. C., and Yadav, D. (2016). Risk of new-onset diabetes is determined by severity of acute pancreatitis. Pancreas 45, e14–e15. doi: 10.1097/MPA.0000000000000536
Vujasinovic, M., Tepes, B., Makuc, J., Rudolf, S., Zaletel, J., Vidmar, T., et al. (2014). Pancreatic exocrine insufficiency, diabetes mellitus and serum nutritional markers after acute pancreatitis. World J. Gastroenterol. 20, 18432–18438. doi: 10.3748/wjg.v20.i48.18432
Winter Gasparoto, R. C. G., De Jorge Racy, M. C., and Campos, T. D. (2015). Long-term outcomes after acute necrotizing pancreatitis: what happens to the pancreas and to the patient? first episode. J. Pancreas 16, 159–166. doi: 10.6092/1590-8577/2958
Woodmansey, C., McGovern, A. P., McCullough, K. A., Whyte, M. B., Munro, N. M., Correa, A. C., et al. (2017). Incidence, demographics, and clinical characteristics of diabetes of the exocrine pancreas (Type 3c): a retrospective cohort study. Diabetes Care 40, 1486–1493. doi: 10.2337/dc17-0542
Wu, B. U., Johannes, R. S., Sun, X., Tabak, Y., Conwell, D. L., and Banks, P. A. (2008). The early prediction of mortality in acute pancreatitis: a large population-based study. Gut 57, 1698–1703. doi: 10.1136/gut.2008.152702
Yasuda, T., Ueda, T., Takeyama, Y., Shinzeki, M., Sawa, H., Nakajima, T., et al. (2008). Long-term outcome of severe acute pancreatitis. J. Hepatobiliary Pancreat. Surg. 15, 397–402. doi: 10.1007/s00534-007-1266-x
Yeo, C. J., Bastidas, J. A., Schmieg, R. E. Jr., Walfisch, S., Couse, N. F., Olson, J. L., et al. (1989). Pancreatic structure and glucose tolerance in a longitudinal study of experimental pancreatitis-induced diabetes. Ann. Surg. 210, 150–158. doi: 10.1097/00000658-198908000-00003
Keywords: diabetes mellitus, acute pancreatitis, severity, necrosis, etiology
Citation: Zhi M, Zhu X, Lugea A, Waldron RT, Pandol SJ and Li L (2019) Incidence of New Onset Diabetes Mellitus Secondary to Acute Pancreatitis: A Systematic Review and Meta-Analysis. Front. Physiol. 10:637. doi: 10.3389/fphys.2019.00637
Received: 14 February 2019; Accepted: 06 May 2019;
Published: 31 May 2019.
Edited by:Peter Hegyi, University of Szeged, Hungary
Reviewed by:Michael Chvanov, University of Liverpool, United Kingdom
Robert Sutton, University of Liverpool, United Kingdom
Copyright © 2019 Zhi, Zhu, Lugea, Waldron, Pandol and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.