Abstract
Neonatal sepsis is a major cause of morbidity and mortality in both preterm and term infants. Early-onset neonatal sepsis (EONS) presents within the first 72 h of life. Diagnosis is difficult as signs and symptoms are non-specific, and inflammatory markers are widely used to confirm or rule out neonatal sepsis. Interleukin-6 (IL-6) is part of the fetal inflammatory response syndrome (FIRS) and therefore an interesting early marker for neonatal sepsis. The main objective for this review was to assess the diagnostic potential of IL-6, alone and in combination, for diagnosis of early neonatal sepsis (EONS) in term and preterm infants, in cord and peripheral blood, and in dependence of timing of sample collection. IL-6 diagnostic accuracy studies for diagnosing EONS published between 1990 and 2020 were retrieved using the PubMed database. We included 31 out of 204 articles evaluating the potential of IL-6 for the diagnosis of EONS in a study population of newborns with culture-proven and/or clinically suspected sepsis. We excluded articles dealing with neonatal bacterial infections other than sepsis and biomarkers other than inflammatory markers, those written in languages other than English or German, studies that did not distinguish between EONS and late-onset sepsis, and animal and in vitro studies. Full-text articles were checked for other relevant studies according to the PRISMA criteria. We identified 31 studies on IL-6 diagnostic accuracy for EONS diagnosis between 1990 and 2020 including a total of 3,276 infants. Sensitivity and specificity were reported, and subgroup analysis was performed. A STARD checklist adapted for neonates with neonatal sepsis was used for quality assessment. The range of IL-6 sensitivity and specificity in neonatal samples was 42.1–100% and 43–100%; the median values were 83 and 83.3%, respectively. IL-6 accuracy was better in preterm infants than in mixed-study populations. Early sample collection at the time of sepsis suspicion had the highest sensitivity when compared to other time points. Cord blood IL-6 had higher diagnostic value compared to peripheral blood. The biomarker combination of IL-6 and CRP was found to be highly sensitive, but poorly specific. Limitations of this review include use of only one database and inclusion of a heterogeneous group of studies and a small number of studies looking at biomarker combinations; a strength of this review is its focus on early-onset sepsis, since type of sepsis was identified as a significant source of heterogeneity in IL-6 diagnostic accuracy studies. We concluded that IL-6 has a good performance as an early diagnostic marker of EONS within a study population of preterm infants, with best results for cord blood IL-6 using cutoff values above 30 pg/ml.
Introduction
Neonatal sepsis is still one of the leading causes of morbidity and mortality in the neonatal intensive care unit (NICU) (1). The symptoms are variable and non-specific (2). Diagnosis and treatment of neonatal sepsis remain challenging (3). Early and efficient treatment is crucial for a good neonatal outcome and prognosis in neonatal sepsis cases often necessitating empirically selected broad-spectrum antibiotics in high-risk infants (4, 5). Empirical treatment, however, increases the exposure to adverse drug effects and nosocomial complications and contributes to the development of resistant strains (6). For the United States, it has been shown that for every neonate with proven bacterial sepsis, 11–30 infants with negative sepsis status receive antibiotics (7). Withholding or delaying treatment in a potentially infected child, however, would be inacceptable given the rapid course and high fatality associated with neonatal sepsis (8). Biological markers that react rapidly after the onset of the inflammatory process are greatly needed in the diagnosis of neonatal sepsis (9).
Interleukin-6 (IL-6) is characterized by a short half-life due to binding to plasma proteins such as α2-macroglobulin, early storage in the liver, or inhibition by other cytokines (10). The cytokine IL-6 is a particularly early marker of neonatal sepsis. It is released within 2 h after the onset of bacteremia, peaks at approximately 6 h, and finally declines over the following 24 h (11). IL-6 levels are significantly elevated up to 48 h prior to the onset of clinical sepsis (12). While some investigators have found that the neonatal IL-6 response is comparable to that found in adults, others have reported a diminished IL-6 production (2, 13). Stress and tissue injury have the potential to provoke an IL-6 response (14, 15). Interpretation of IL-6 levels for diagnosis of neonatal sepsis might therefore be hampered by underlying illnesses and their severity. To improve the diagnostic capacity of this early marker, combinations with later and more specific biomarkers (e.g., CRP) have been suggested (16). A relatively large sample size is required since IL-6 circulates at rather low levels (17).
Chiesa et al. (18) studied the upper reference limits and dynamics of IL-6 over the first 48 h of life in 148 healthy babies (113 term, 35 near-term). Samples were obtained at three fixed neonatal ages (0, 24, and 48 h after birth). The geometric mean IL-6 concentrations in the healthy term babies were 1.69 at birth, 4.09 at 24 h, and 3.45 pg/ml at 48 h of life. Healthy near-term babies had corresponding IL-6 values of 10.9, 9.3, and 8.4 pg/ml (18).
IL-6 is one of the most studied cytokines in sepsis; its circulating levels rise rapidly in response to infection and are closely associated with sepsis prognosis and mortality in adults (2, 5). For septic neonates, divergent results have been published, ranging from diminished IL-6 production in term and even more pronounced in preterm infants to IL-6 concentrations comparable to that found in adults (2). In neonates, IL-6 is an early and highly sensitive marker (4, 19). Interestingly, IL-6 levels in cord blood correlate well with neonatal hematologic indices used to evaluate EONS (8). However, the specificity of IL-6 is often low (4), and increased IL-6 values were also found in infants with non-infectious conditions limiting its use in the differentiation of neonates having infections or not (14).
A crucial factor for the implementation of inflammatory markers for neonatal sepsis diagnosis seems to be the difficulty to formulate a definitive opinion on their clinical usefulness from the findings of current literature (15). Small sample sizes, inconsistent definitions of sepsis, heterogeneity of the study population, and differences between cutoff values led to inconclusive results in diagnostic accuracy studies (20). Mehr et al. (21) stated, back in 2000, that the heterogeneous methods of laboratory measurement and the wide variations in data analysis and in reporting results precluded the possibility of performing a meaningful meta-analysis—problems that remain an issue even today (20). Either reliable cutoff values are lacking or there is an abundance of different cutoffs proposed for the same marker, both rendering a potential diagnostic test wearisome to apply clinically (15). The aim of the study was to determine the actual role of IL-6 alone or in combination for the diagnosis of EONS by means of a meta-analysis including studies from 1990 to 2020, to identify factors that possibly affect the diagnostic potential of IL-6 and investigate them by means of a subgroup analysis.
Methods
Studies eligible for review inclusion were retrieved using the PubMed database including diagnostic accuracy studies of IL-6 in neonates published between 1990 and 2020. The combined search term used was (Interleukin-6 OR IL-6) AND (neonatal sepsis OR neonatal infection OR sepsis) AND (early-onset sepsis OR EOS OR EONS). No PubMed filters or language restrictions were used.
Reviewer (JE) conducted the database search and identified potential studies by screening titles and abstracts. For inclusion, the following criteria had to be fulfilled on an abstract level: the study population consisted of newborns, the subjects presented with culture-proven and/or clinically suspected sepsis, and the article evaluated the potential of IL-6 (alone or in combination with other inflammatory markers) for the diagnosis of early-onset neonatal sepsis. Excluded were articles dealing with other neonatal bacterial infections, those written in languages other than English or German, studies that did not distinguish between EONS and late-onset sepsis, animal and in vitro studies, and studies analyzing biomarkers other than inflammatory markers. Subsequently, full-text articles of shortlisted studies were assessed for eligibility (JE). Reference lists of obtained articles and relevant review articles were hand searched for other relevant studies according to the PRISMA criteria (see Figure 1). In cases of doubt, study eligibility was resolved with input from an independent reviewer (BR). Relevant data from the eligible studies were extracted by reviewer JE using a standardized data collection form. Data extraction included the following: first author, country, year of publication, sepsis definition, and number and specific characteristics of the newborns in the septic and non-septic groups (summarized under recruitment). Further data included reference standards employed, sample studied, time of sample collection, whether IL-6 was used alone or in combination with another inflammatory marker, and finally the test method used. The analyses were based on previously published studies. Therefore, no patient consent, ethical approval, and institutional review board were required.
FIGURE 1
Flowchart of the study selection process for diagnostic accuracy of interleukin-6 in early onset neonatal sepsis between 1990 and 2020.
Reviewer JE assessed the quality of reporting of the included studies using a data extraction form based on the STARD checklist and adapted for neonates with neonatal sepsis by Chiesa et al. (22). The key domains—descriptions of participant recruitment, reference standard and index test, and study population—are evaluated simply answering yes, if the item is present, or no if not (22).
Statistics included evaluation of studies regarding sensitivity and specificity of IL-6, the cutoff value, and the area under the curve (AUC) of IL-6 for sepsis diagnosis. The sensitivity indicates the percentage of patients with sepsis diagnosis who had a plasma cytokine level above the given cutoff, specifically the percentage of patients not meeting the criteria of sepsis who had cytokine levels below the cutoff value. Box-plot diagrams were used to show the distribution of cutoff levels used and sensitivity and specificity values reported, while forest plots show sensitivity and specificity values of the individual studies as well as pooled sensitivity and specificity. The 95% confidence intervals were calculated using Wilson’s method (23).
By performing extensive literature research, we identified factors that have been shown to influence IL-6 levels in neonates, namely, gestational age, type of sample, time of sample collection, and choice of cutoff value. Since those factors represent possible causes of heterogeneity in diagnostic accuracy studies of IL-6, we subsequently researched their influence on study results by subgroup analysis within our meta-analysis. Pooled sensitivities and specificities were calculated by grouping studies, coinciding with influencing factors together, and treating their infants as one big study population. To investigate the influence of gestational age, subgroups were formed by grouping all preterm infants and all infants from mixed (preterm and term) study populations together. To further evaluate the influence of a low vs. a high cutoff value, these subgroups were again divided by the median cutoff level present within the respective subgroup. The influence of type of sample was investigated by forming subgroups of cord versus peripheral blood samples. The peripheral blood sample subgroup was further divided into those studies reporting sample collection times earlier than 48 h of life (e.g., ≤ 6 h, ≤ 12 h) and studies allowing larger time intervals for sample collection (up to 1 week). Meta-analysis on a certain biomarker combinations was performed if at least 3 studies studied this combination.
Results
As shown in Figure 1, 204 records on IL-6 as a marker of EONS were identified from the PubMed database search and 21 additional records were identified by screening the reference lists of included articles and relevant review articles (22, 24–27). Following exclusion of studies by titles, 128 abstracts were screened. The full text of 58 articles was assessed, and finally 31 studies including 3,276 infants were eligible for meta-analysis.
Most studies agreed on the definition of EONS, as sepsis occurring before 72 h of life (4–6, 8, 19, 20, 28–32). Other definitions included sepsis ≤ 48 h (n = 5) (33–37), sepsis ≤ 1 week (n = 1) (38), sepsis ≤ 5 days (n = 1) (9), sepsis ≤ 4 days of life (n = 1) (39), and sepsis within the first days of life (n = 1) (40). Eleven studies did not specify their definition (2, 3, 7, 10, 14, 17, 41–45).
The range of IL-6 sensitivities and specificities was 42.1–100% and 43–100%, respectively; the median values were 83 and 83.3% (see boxplots in Figure 2). Pooled sensitivity was 76% (95% CI: 73–79%), pooled specificity 79% (77–81%) (see forest plots in Figure 3). The data extracted from the included IL-6 diagnostic accuracy studies is summarized in Table 1 for preterm infants, in Table 2 for mixed study populations, and in Table 3 for IL-6 in combination with other inflammatory markers.
FIGURE 2
Boxplots showing the distribution of IL-6 cutoff (A), sensitivity, and specificity values (B) of all diagnostic accuracy studies on EONS using neonatal samples.
FIGURE 3
Forest plots showing the individual and pooled sensitivities (A) and specificities (B) of IL-6 diagnostic accuracy studies for the diagnosis of EONS.
TABLE 1
| Author, year, country, (reference) | EONS definition | Recruitment | Reference standard in infected neonates | Reference standard in control neonates | Sample studied, time of sample collection | Test | IL-6 cutoff (pg/mL) | Sensitivity, % (95% CI) | Specificity, % (95% CI) | AUC (95% CI) | PPV (%) | NPV (%) |
| Ebenebe et al., Germany, (4) | ≤72 h | 182 preterm infants with a birth weight <2,000 g: 67 infected, 115 uninfected | (1) Positive blood culture or (2) CRP ≥ 5 mg/l and ≥ 3 clinical signs | Gestational age and birth-weight matched neonates that did not fulfill criteria of EONS | Neonatal blood, 0 h (PNA) | Electrochemi luminescence assay | 40 | 75 | 72.8 | 0.804 | 14 | 98 |
| Steinberger et al., Austria, (17) | NS | 218 NICU preterm infants with risk factors for EONS: 30 infected, 188 uninfected | (1) Positive blood culture or (2) ≥3 categories of clinical signs or (3) ≥1 categories of clinical signs, and ≥2 laboratory abnormalities (CRP, WBC, I:T ratio) | NA | Cord blood, 0 h (PNA) | ELISA | 15.85 (ROC, Youden) | 73.7 (51.2–88.2) | 84.2 (75.8–90) | 0.812 (0.675–0.948) | 46.7 (30.2–63.9) | 94.4 (87.6–97.6) |
| Cetin et al., Turkey, (41) | NS | 40 preterm infants born to mothers with pPROM: 10 infected, 30 uninfected | Positive blood or gastric washing culture and/or clinical findings | NA | Cord blood, 0 h (PNA) | ELISA | 11 (ROC, NS) | 90 (55–98) | 63.3 (43–80) | 0.767 (0.608–0.926) | 45 | 95 |
| Hofer et al., Austria, (28) | ≤72 h | 176 preterm infants at risk of bacterial infection: 32 EONS, 144 other | (1) Positive bacterial culture from umbilical cord blood, peripheral blood, or CSF or (2) negative culture, but ≥3 categories of clinical sepsis signs, with either ≥1 maternal risk factors or ≥2 abnormal laboratory markers (CRP, WBC, I:T ratio) | NA | Cord blood (UV), 0 h (PNA) | ELISA | 11.1 (ROC, Youden) | 81 | 75 | 0.795 (0.695–0.896) | NA | NA |
| Cobo et al., Czech Republic, (6) | ≤72 h | 176 preterm infants born to mothers with PPROM: 12 infected, 164 uninfected | (1) Positive blood culture or (2) clinical signs and ≥2 abnormal hematological laboratory results (WBC, PC, I:T ratio) | NA | Cord blood, 0 h (PNA) | ELISA | 38 (ROC, NS) | 83 | 82 | 0.908 (0.846–0.971) | 30 | 98.1 |
| Labenne et al., France, (7) | NS | 213 NICU preterm infants with a presumptive diagnosis of EONS: 31 infected, 182 uninfected | (1) Positive culture of blood or CSF, and clinical signs or (2) clinical signs, CRP >1 mg/dl, positive superficial or placental cultures, and no alternative diagnosis | (1) Positive superficial culture without abnormal CRP or (2) CRP > 1 mg/dl and an alternative diagnosis or (3) neither positive culture nor abnormal CRP | Venous blood, at sepsis evaluation (≤6 h PNA) | Cytometric bead array (a multiplexed system) | 300 (ROC, minimizing number of misclassified episodes) | 87.1 (71.1–94.9) | 82 | 0.895 (0.837–0.953) | NA | 97.3 |
| Canpolat et al., Turkey, (40) | Within the first days of life | 74 preterm infants born to mothers with pPROM: 32 infected, 42 uninfected | (1) Positive blood culture and clinical signs and/or abnormal laboratory findings or (2) negative blood culture, but clinical and/or laboratory findings | Negative blood culture and no clinical or laboratory findings | Cord blood (UV), 0 h (PNA) | ELISA | 7.6 (ROC, NS) | 93 | 96.7 | NA | NA | NA |
| Rego et al., Brazil, (42) | NS | 144 NICU preterm infants presenting RDS during the first 24 h of life: 44 infected, 100 infected | In addition to RDS, (1) ≥2 categories of clinical signs, or clinical chorioamnionitis, and positive blood or CSF culture or (2) ≥ 2 categories of clinical sepsis, or clinical chorioamnionitis, and a hematologic sepsis score > 3 or 3) radiographic evidence of pneumonia and a hematologic sepsis score > 3 | No clinical signs and a hematologic sepsis score <3 | Peripheral blood, 0 h (from suspicion of sepsis) | Chemilu minescence immunoassay | 36 (ROC, maximum sensitivity and specificity >50%) | 82 (67–93) | 44 (33–55) | 0.72 (0.62–0.83) | 40 (29–51) | 85 (71–94) |
| Gharehbaghi et al., Iran, (29) | ≤72 h | 45 NICU preterm infants born to mothers with PROM: 17 infected, 18 uninfected | (1) Positive blood culture or (2) negative blood culture, but ≥3 clinical signs of sepsis associated with laboratory findings (WBC, platelet count, I:T ratio) | NA | Cord blood, 0 h (PNA) | ELISA | 20 | 46 | 85 | NA | 88 | 39 |
| Hatzidaki et al., Greece, (43) | NS | 58 preterm neonates born to mothers with pPROM: 20 infected, 38 uninfected | (1) Positive blood culture within 4 days of life or (2) ≥3 categories of clinical signs and ≥2 abnormal laboratory findings | NA | Cord blood, 0 h (PNA) | ELISA | 108.5 (ROC, NS) | 95 | 100 | NA | 100 | 97.4 |
| Neonatal blood, on day 4 (PNA) | ELISA | 55 (ROC, NS) | 90 | 97.4 | NA | 94.7 | 94.9 | |||||
| Krueger et al., Germany, (34) | ≤48 h | Of the 136 infants, 77 were preterm: 40 infected, 37 uninfected | (1) Clinical signs and positive blood culture or (2) clinical signs and abnormal laboratory results (CRP, I:T ratio), biological fluids positive for bacteria, or signs of inflammation in placenta | Non-infectious clinical conditions | Cord blood, 0 h (PNA) | Fully automated chemil uminescence immunoassay | 80 (ROC, ULC) | 96 | 94 | NA | NA | NA |
| Døllner et al., Norway, (44) | NS | 24 NICU preterm infants: 11 infected, 13 uninfected | (1) Clinical signs, and a positive blood culture or (2) ≥3 categories of clinical signs, and CRP ≥ 3 mg/dl or (3) radiographic evidence of pneumonia, respiratory signs or symptoms, and CRP ≥ 3 mg/dl | Clinical conditions apparently non-infectious | Cord blood, 0 h (PNA) | ELISA (Quantikine) | 33 | 84 | 70 | 0.86 (0.66–0.96) | NA + L9:O12 | NA |
| Kashlan et al., United States, (3) | NS | 43 NICU singleton, very preterm infants (≤32 weeks GA): 21 infected, 22 uninfected | (1) Positive culture of blood and/or CSF or (2) ≥3 maternal/neonatal indicators for infection (risk factors, clinical signs, abnormal hematological findings) | Negative blood culture and <3 maternal/neonatal indicators for infection | Cord blood (UV), 0 h (PNA) | Enzyme-linked immunoassay (Endogen) | 100 (ROC, NS) | 80 | 90 | NA | 89 | 83 |
| Smulian et al., United States, (30) | ≤72 h | 28 preterm infants with either spontaneous preterm labor or PPROM: 14 infected, 14 uninfected | (1) Autopsy or positive CSF or blood culture or (2) clinical signs and ≥2 laboratory abnormalities (WBC, I:T ratio, PC, abnormal CSF analysis) | NA | Cord blood (UV), 0 h (PNA) | ELISA (Quantikine) | 25 (ROC, ULC) | 92.9 | 92.9 | NA | 92.9 | 92.9 |
Characteristics of IL-6 accuracy studies for diagnosing EONS in the preterm infant.
NS, bot specified; NA, bot available to NS, not specified; NA, not available; UV, umbilical vein; UA, umbilical artery; PNA, postnatal age; NICU, neonatal intensive care unit; CSF, cerebrospinal fluid; CRP, C-reactive protein; WBC, white blood count; PC, platelet count; ABC, absolute band count; EONS, early-onset neonatal sepsis; AUC, area under the curve; PPV, positive predictive value; NPV, negative predictive value; GA, gestational age.
TABLE 2
| Author, year, country, (reference) | EONS definition | Recruitment | Reference standard in infected neonates | Reference standard in control neonates | Sample studied, time of sample collection | Test | IL-6 cutoff (pg/mL) | Sensitivity, % (95% CI) | Specificity, % (95% CI) | AUC (95% CI) | PPV, % | NPV, % |
| Yang et al., China, (5) | ≤72 h | 152 preterm (>34 weeks) and term infants at risk for EONS: 76 infected, 76 uninfected | (1) Positive blood or CSF culture or (2) ≥3 categories of clinical signs | Negative blood culture and <3 categories of clinical signs | Venous blood, ≤72 h (PNA) | MILLIPLEX Map Human Th17 Magnetic Bead Panel and Sepsis Panel (Millipore) | 153 | 42.1 | 93.4 | 0.704 (0.622–0.786) | 84.6 | 61.4 |
| Ahmed et al., Egypt, (31) | ≤72 h | 60 NICU preterm and term infants: 30 high suspicion of EONS, 30 matched controls | Clinical findings supporting the suspicion of neonatal sepsis | Age- and weight-matched neonates without the criteria of sepsis suspicion | Venous blood, ≤72 h (PNA) | ELISA | 24 (ROC, Youden) | 94.4 | 52.4 | 0.751 (0.623–0.854) | 45.9 | 95.7 |
| He et al., China, (19) | ≤72 h | 151 preterm (>34 weeks) and term infants with suspected EONS: 68 infected, 83 uninfected | (1) Positive blood or CSF culture and any abnormal finding or (2) negative culture results but ≥3 abnormal findings | Negative culture results and <3 abnormal findings | Venous blood, ≤72 h (PNA) | MILLIPLEX Map Human Th17 Magnetic Bead Panel and Sepsis Panel (Millipore) | 75.43 | 64.71 | 69.88 | 0.706 (0.626–0.777) | 63.77 | 70.74 |
| Al-Zahrani et al., Saudi Arabia, (38) | <1 week | 100 NICU preterm and term infants with suspected sepsis: 71 infected, 29 uninfected | (1) Positive blood culture and/or positive PCR results for bacterial 16S rDNA or (2) negative blood culture and PCR, but clinical signs of sepsis and positive sepsis screen. | Neonates suspected of having sepsis with negative blood culture, PCR and sepsis screen | Blood sample, ≤24 h (after NICU admission), <1 week (PNA) | ELISA | 60 | 63.6 | 69 | NA | 75.6 | 55.5 |
| Cernada et al., Spain, (20) | ≤72 h | 128 preterm and term infants with prenatal risk factors for EONS (77% asymptomatic at birth): 10 infected, 118 uninfected | (1) Positive blood culture and clinical sings or (2) ≥3 categories of clinical signs | NA | Cord blood, 0 h (PNA) | Chemiluminescence enzyme immunoassay in solid phase | 255.87 (ROC, NS) | 90 | 87.4 | 0.88 (0.7–1.06) (sic) | 37.5 | 99 |
| Bender et al., Denmark, (32) | ≤72 h | 123 NICU preterm and term infants with at least 1 clinical sign suggesting EONS: 29 infected, 94 uninfected | (1) Positive blood culture or (2) clinical signs and CRP > 5 mg/dl | (1) Clinical signs and CRP ≤ 5 mg/dl and antibiotic therapy for 3 days or (2) clinical signs, but no antibiotic therapy | Peripheral blood, 0 h (after suspicion of sepsis) | Flow cytometry (LUMINEX) | 250 (ROC, specificity ∼95%) | 59 (41–75) | 94 (87–97) | 0.77 | 76 | 88 |
| 12 (ROC, sensitivity ∼ specificity) | 71 | 71 | 0.77 | 43 | 89 | |||||||
| Resch et al., Austria, (45) | NS | 68 NICU preterm and term infants with suspected sepsis: 41 infected, 27 uninfected | (1) Positive blood culture or (2) ≥3 categories of clinical signs, positive sepsis screen and/or risk factors, and antibiotic therapy ≥7 days | Negative blood culture, negative sepsis screen, and antibiotic therapy ≤3 days | Venous or arterial blood, ≤12 h (PNA) | ELISA | ≥10 (ROC, NS) | 71 (56–82) | 67 (48–81) | NA | 76 | 60 |
| ≥60 (ROC, Youden) | 54 (39–68) | 100 (88–100) | NA | 100 | 59 | |||||||
| ≥150 (ROC, NS) | 46 (32–61) | 100 (88–100) | NA | 100 | 55 | |||||||
| Chiesa et al., Italy, (35) | ≤48 h | 134 NICU preterm and term infants: 19 infected, 115 uninfected | (1) Positive blood culture and clinical signs or (2) ≥3 clinical signs prompting ≥5 days of antibiotic therapy, and historical and clinical risk factors for EONS | Symptomatic infants who had negative body fluid cultures, and were apparently well within 24–48 h and received antibiotic treatment ≤3 days | Cord blood, 0 h (PNA) | ELISA | 200 (ROC, Youden) | 74 (51–88) | 89 (82–93) | NA | NA | NA |
| Peripheral blood, 24 h (PNA) | 30 (ROC, Youden) | 63 (41–81) | 71 (62–78) | NA | NA | NA | ||||||
| Peripheral blood, 48 h (PNA) | 20 (ROC, Youden) | 53 (32–73) | 70 (63–79) | NA | NA | NA | ||||||
| Martin et al., Sweden, (36) | ≤48 h | 32 NICU preterm and term infants with suspected sepsis: 20 infected, 12 uninfected | (1) Positive blood or CSF culture or (2) abnormal CRP, WBC and ≥1 category of clinical signs (i.e., oliguria, metabolic acidosis, or hypoxemia) | Clinical conditions apparently non-infectious | Peripheral blood, at admission, ≤48 h (PNA) | Chemiluminescence immunoassay | 160 (ROC, Youden) | 100 | 70 | NA | 67 | 100 |
| Krueger et al., Germany, (34) | ≤48 h | 136 preterm and term infants: 68 infected, 68 uninfected | (1) Clinical signs and positive blood culture or (2) clinical signs and abnormal laboratory results (CRP, I:T ratio), biological fluids positive for bacteria, or signs of inflammation in placenta | Non-infectious clinical conditions | Cord blood, 0 h (PNA) | Fully automated chemiluminescence immunoassay | 80 (ROC, ULC) | 87 | 90 | NA | NA | NA |
| Santana et al., Spain, (14) | NS | 31 preterm and term infants: 10 infected, 11 uninfected, 10 healthy controls | ≥2 categories of clinical signs, ≥1 abnormal laboratory findings, and positive blood culture | (1) Clinical conditions apparently non-infectious or (2) GA-matched neonates with normal postnatal course through the first month of life | Cord blood, 0 h (PNA) | Chemiluminescence enzymoimmunoassay in the solid phase | 100.8 (ROC, NS) | 50 | 87 | ∼0.5 | 31 | 66 |
| Silveira and Procianoy, Brazil, (9) | ≤5 days | 117NICU infants with suspected sepsis: 66 infected, 51 uninfected | (1) Positive blood and/or CSF culture and ≥3 categories of clinical sepsis or (2) negative cultures and ≥3 categories of clinical sepsis | PROM, but no complete criteria for clinical sepsis, no antibiotic treatment up to discharge from hospital, no hospital readmission (<1 month) | Peripheral blood, 0 h (after suspicion of sepsis), 82.9% at ≤24 h (PNA) | Quantitative sandwich enzyme immunoassay technique (Quantikine) | 32 (ROC, NS) | 90 | 43 | NA | 67.4 | 78.6 |
| Berner et al., Germany, (46) | ≤4 days | 136 preterm and term infants, cord blood samples available in 93 infants: 16 infected, 43 uninfected, 35 healthy controls | (1) Positive blood culture or (2) ≥3 categories of clinical signs or laboratory markers | (1) Clinical suspicion but neither positive culture, nor ≥3 categories of clinical signs or | Cord blood, 0 h (PNA) | Double-sandwich enzyme immunoassay (Quantikine) | 100 (NA) | 87 | 93 | NA | 76 | 97 |
| Døllner et al., Norway, (2) | NS | 113 NICU preterm and term infants: 24 infected, 89 uninfected | (1) Positive blood/CSF culture and clinical signs for sepsis/meningitis or (2) negative blood culture, ≥3 categories of clinical signs and abnormal laboratory results (CRP, I:T ratio) or (3) negative blood culture, respiratory symptoms, X-ray consistent with pneumonia, and abnormal laboratory results | Initially suspected of having an infection (not confirmed) | Peripheral blood, at NICU admission or on the next day, >92% <4 days (PNA) | IL-6–dependent mouse hybridoma cell line B13.29 (clone B9), as described by Ng [(15) cite] | 20 (NA) | 78 | 71 | NA | 40 | 93 |
| 50 (NA) | 61 | 76 | NA | 38 | 89 | |||||||
| Panero et al., Italy, (33) | ≤48 h | 60 NICU preterm and term infants: 13 infected, 47 uninfected | Positive blood culture and clinical signs of sepsis | Infants with various types of distress and non-specific abnormal clinical signs who were well within 48–72 h | Venous blood, ≤ 24 h (PNA) | Solid-phase sandwich enzyme-amplified sensitivity immunoassay (Medgenix) | 70 (ROC, NS) | 69 | 36 | NA | 23 | 81 |
| Venous blood, ≤24 h (PNA) | 200 (ROC, NS) | 38 | 70 | NA | 26 | 80 | ||||||
| Venous blood, 24–48 h (PNA) | 50 (ROC, NS) | 92 | 96 | NA | 86 | 98 | ||||||
| Smulian et al., United States, (8) | ≤72 h | 23 preterm and term infants with suspected EONS: 8 infected, 15 uninfected | (1) Positive blood or CSF culture or (2) clinical signs and ≥laboratory abnormalities (WBC, I:T ratio, PC, ABC, or abnormal spinal tap) | NA | Cord blood (UA), 0 h (PNA) | ELISA (Quantikine) | 7 (NA) | 88.5 | 66.6 | NA | 58.8 | 91 |
| Cord blood (UV), 0 h (PNA) | ELISA (Quantikine) | 7 (NA) | 88.5 | 93.3 | NA | 88.5 | 93.3 | |||||
| Lehrnbecher et al., Germany, (37) | ≤48 h | 46 NICU preterm and term infants: 13 infected, 33 uninfected | (1) Positive blood culture and ≥3 categories of clinical signs or (2) negative blood culture, ≥3 categories of clinical signs and ≥2 abnormal laboratory results in the first 48 h of life | NA | Cord blood, 0 h (PNA) | Enzyme immunoassay (Dianova-Immunotech) | 150 (ROC, NS) | 69 | 91 | NA | NA | NA |
| Messer et al., France, (10) | NS | 288 NICU/obstetric unit preterm and term infants: 71 infected (36 infected or probably infected, 35 possibly infected, 217 uninfected | (1) Positive blood and/or CSF culture, clinical signs, and abnormal laboratory results (CRP, WBC) or (2) Negative culture results but ≥3 categories of clinical signs and abnormal laboratory results or (3) negative culture results, <3 categories of clinical signs, abnormal laboratory results that could have another reason, neither exclusion nor confirmation of sepsis possible | Neither clinical nor biological signs of infection | Cord or peripheral blood, NA | ELISA (Hoffmann-La Roche) | 100 (ROC, ULC) | 83.3 | 90.3 | NA | NA | NA |
| Of the 288 infants, 220 were inborn: 39 infected (18 infected or probably infected, 21 possibly infected), 181 uninfected | Cord or peripheral blood, ≤1 h (PNA) | 100 | 92.3 | NA | 58.8 | 97 | ||||||
| Of the 288 infants, 254 were sampled within the first 12 h of life: NA | Cord or peripheral blood, ≤12 h (PNA) | 100 | 89 | NA | NA | NA |
Characteristics of IL-6 accuracy studies for diagnosing EONS in a mixed population of preterm and term infants.
NA, not available; NS, not specified; UV, umbilical vein; UA, umbilical artery; PNA, postnatal age; NICU, neonatal intensive care unit; CSF, cerebrospinal fluid; CRP, C-reactive protein; WBC, white blood count; PC, platelet count; ABC, absolute band count; EONS, early-onset neonatal sepsis; AUC, area under the curve; PPV, positive predictive value; NPV, negative predictive value; GA, gestational age.
TABLE 3
| Author, Year, Country, (Reference) | EONS definition | Recruitment | Reference standard in infected neonates | Reference standard in control neonates | Sample studied, time of sample collection | Test | Biomarker combination | Criterion for positive test | Cutoffs: IL-6 (pg/mL), CRP (mg/L), PCT (ng/mL), TNF-α (pg/mL) | Sensitivity (95% CI), % | Specificity (95% CI), % | AUC | PPV, % | NPV, % |
| Ebenebe et al., Germany, (4) | ≤72 h | 1,202 preterm infants with a birth weight < 2,000 g: 67 infected, 115 uninfected | (1) Positive blood culture or (2) CRP ≥ 5 mg/l and ≥ 3 clinical signs | Gestational age and birth-weight matched neonates that did not fulfill criteria of EONS | IL-6: neonatal blood, 0 h (PNA) and maternal blood (CRP), <24 h (before delivery) | IL-6: electrochem iluminescence assay, CRP: particle enhanced immune-nephelometry | IL-6 + CRP | and | IL-6: 40, CRP: 10 | 49.0 | 82.4 | NA | 14.1 | 96.5 |
| IL-6 + CRP | Either/or | 90.2 | 43.1 | NA | 8.6 | 98.7 | ||||||||
| Neonatal blood, 0 h (PNA) | IL-6: electroch emiluminescence assay, CRP: particle enhanced immune-nephelometry | IL-6 + CRP | and | IL-6: 40, CRP: 10 | 23.4 | 100 | NA | 100.0 | 96.8 | |||||
| IL-6 + CRP | either/or | 75 | 71.7 | 13.6 | 98 | |||||||||
| Steinberger et al., Austria, (17) | NS | 218 NICU preterm infants with risk factors for EONS: 30 infected, 188 uninfected | (1) Positive blood culture or (2) ≥3 categories of clinical signs or (3) ≥1 categories of clinical signs, and ≥2 laboratory abnormalities (CRP, WBC, I:T ratio) | NA | Cord blood | IL-6: ELISA, PCT: LUMItest procalcitonin kit | IL-6 + PCT | and | IL-6: 10, PCT: 0.5 | 58.8 | 99.0 | 0.850 (0.731–0.968) | NA | NA |
| IL-6 + PCT | Either/or | IL-6: 15.85, PCT: 0.235 (ROC, Youden) | 91.7 (71.2–99.0) | 77.1 (67.4–85.0) | 0.915 (0.822–1.000) | 42.1 (26.3–59.2) | 98.7 (92.8–99.8) | |||||||
| Rego et al., Brazil, (42) | NS | 144 NICU preterm infants (130 VLBW) presenting RDS during the first 24 h of life: 44 infected, 100 infected | In addition to RDS, (1) ≥ 2 categories of clinical signs, or clinical chorioamnionitis, and positive blood or CSF culture or (2) ≥2 categories of clinical sepsis, or clinical chorioamnionitis, and a hematologic sepsis score >3 or 3) radiographic evidence of pneumonia and a hematologic sepsis score >3 | No clinical signs and a hematologic sepsis score <3 | Peripheral blood | Chemilum inescence immunoassay system | IL-6 + CRP | and/or | IL-6: 36, CRP: 60 (ROC, maximum sensitivity and specificity >50%) | 93 (80–98) | 37 (27–48) | NA | 41 (31–51) | 92 (78–98) |
| Bender et al., Denmark, (32) | EONS (=72 h) | 123 NICU preterm and term infants with at least 1 clinical sign suggesting EONS: 29 infected, 94 uninfected | (1) Positive blood culture or (2) clinical signs and CRP > 5 mg/dl | (1) Clinical signs and CRP ≤ 5 mg/dL and antibiotic therapy for 3 days or (2) clinical signs, but no antibiotic therapy | Blood, 0 h (after suspicion of sepsis) | IL-6: flow cytometry (LUMINEX), PCT: immunol uminometric assay (LUMItest R PCT; BRAHMS Diagnostica, Berlin, Germany) | IL-6 + PCT | Either/or | IL-6: 250, PCT: 25 (specificity of the single marker ∼95%) | 71 | 88 | NA | 65 | 91 |
| IL-6 + PCT | either/or | IL-6: 12, PCT: 5.75 (sensitivity and specificity of the single marker almost identical) | 93 | 46 | NA | 35 | 95 | |||||||
| Silveira and Procianoy, Brazil, (9) | EONS (≤5 days) | 117 NICU preterm and term infants with suspected sepsis: 66 infected, 51 uninfected | (1) Positive blood and/or CSF culture and ≥3 categories of clinical sepsis or (2) negative cultures and ≥3 categories of clinical sepsis | PROM, but no complete criteria for clinical sepsis, no antibiotic treatment up to discharge from hospital, no hospital readmission (<1 month) | Peripheral blood, 0 h (after suspicion of sepsis), 82.9% at ≤24 h PNA | Quantitative sandwich enzyme immunoassay technique (Quantikine) | IL-6 + TNF-α | and/or | IL-6: 32, TNF-α: 12 (ROC, NS) | 98.5 | NA | NA | 60.7 | 90 |
| Doellner et al., Norway, (2) | NS | 113 NICU preterm and term infants: 24 infected, 89 uninfected | (1) Positive blood/CSF culture and clinical signs for sepsis/meningitis or (2) negative blood culture, ≥3 categories of clinical signs and abnormal laboratory results (CRP, I:T ratio) or (3) negative blood culture, respiratory symptoms, X-ray consistent with pneumonia and abnormal laboratory results | Initially suspected of having an infection (not confirmed) | Peripheral blood, on admission to the NICU or on the next day, >92% <4 days (PNA) | IL-6–dependent mouse hybridoma cell line B13.29 (clone B9), as described by Ng [(15) cite] | IL-6 + CRP | and/or | IL-6: 50 pg/ml, CRP: 10 mg/L (NA) | 96 | 74 | NA | 49 | 99 |
Characteristics of IL-6 accuracy studies for diagnosing EONS using biomarker combinations.
NA, not available; NS, not specified; UV, umbilical vein; UA, umbilical artery; PNA, postnatal age; NICU, neonatal intensive care unit; CSF, cerebrospinal fluid; CRP, C-reactive protein; WBC, white blood count; PC, platelet count; ABC, absolute band count; EONS, early-onset neonatal sepsis; AUC, area under the curve; PPV, positive predictive value; NPV, negative predictive value; GA, gestational age.
Results of the subgroup analysis are shown in Table 4. Sensitivity was higher in the group of preterm infants (83 vs. 73%), while specificity did not vary among study populations (both 82%). Within the preterm group, a cutoff value ≥30 provided slightly improved sensitivity (84 vs. 80%) and specificity (82 vs. 81%) compared to a lower cutoff value. Within the group of preterm and term infants, a cutoff ≥80 pg/ml led to a drastic increase in specificity (90% vs. 71%) but not sensitivity (both 73%). The sensitivity and specificity in umbilical cord blood was higher than in neonatal peripheral blood, 83 vs. 71% and 85 vs. 77%, respectively. Six (7, 9, 33, 35, 36, 45) of the 12 studies (2, 5, 7, 9, 19, 31, 33, 35, 36, 38, 43, 45) using peripheral blood as sample reported sample collection times earlier than 48 h of life (e.g., ≤6 h, ≤12 h), and studies allowing larger time intervals for sample collection (e.g., <4 days) were grouped under <1 week. Early sample collection (≤48 h) improved the sensitivity of a peripheral blood sample (80 vs. 71% in the overall group), but not the specificity (both 77%). The lowest sensitivity was observed for late sampling (<1 week) of peripheral blood (64%); specificity, however, was not worse than in the early sampling group (77%).
TABLE 4
| Subgroup | No. Studies | Pooled sensitivity, % | Pooled specificity, % | ||
| Study population | Preterm | All | 13 | 83 | 82 |
| <30 pg/ml | 6 | 80 | 81 | ||
| ≥30 pg/ml | 7 | 84 | 82 | ||
| Preterm and term | All | 18 | 73 | 82 | |
| <80 pg/ml | 9 | 73 | 71 | ||
| ≥80 pg/ml | 9 | 73 | 90 | ||
| Sample and timing | Cord blood | All | 18 | 83 | 85 |
| UV | 5 | 87 | 83 | ||
| Peripheral blood | All | 12 | 71 | 77 | |
| <48 h | 6 | 80 | 77 | ||
| <1 week | 6 | 64 | 77 | ||
| Biomarker combinations | IL-6 + CRP | 3 | 84 | 61 |
Subgroup analysis of IL-6 diagnostic accuracy studies on EONS.
UV, umbilical vein.
Six studies reported results from IL-6 combined with either CRP (n = 3) or procalcitonin (PCT, n = 2) or tumor necrosis factor alpha (TNF-α, n = 1) (2, 4, 9, 17, 32, 42). In the three studies analyzing a combination of IL-6 and CRP, cutoff values ranged from 36 to 100 pg/ml and 10 to 60 mg/l, respectively, sensitivities between 75 and 100%, and specificities between 37 and 74% (2, 4, 42). The pooled sensitivity was comparable to that of cord blood IL-6 (3, 6, 8, 14, 17, 20, 28–30, 34, 35, 37, 40, 41, 43, 44, 46) as a single measure (84 vs. 83%), but the pooled specificity was markedly lower (61 vs. 85%).
The assessment of the overall quality of the included studies based on the STARD checklist is summarized in Table 5. All 31 articles included in the meta-analysis were studies of diagnostic accuracy of IL-6, and most resulted from single perinatal centers. Enrollment of patients was based on maternal and prenatal risk factors in seven studies (6, 20, 28, 29, 40, 41, 43) and on clinical signs in further nine studies (4, 7, 17, 19, 31, 32, 34, 38, 44). Three studies included neonates having already been diagnosed with sepsis (4, 38, 44). Almost all of the included IL-6 diagnostic accuracy studies used different reference standards to diagnose EONS and verify index test results leading to differential verification bias. Only three studies used a composite reference standard to exclude sepsis (7, 14, 46). In ten studies, CRP was used as comparator of the index test but also formed part of the reference standard (2, 4, 5, 10, 14, 17, 19, 38, 44, 45). Clinical and demographic data were reported in 22 studies (2–7, 9, 14, 19, 30–36, 38, 40–42, 44, 46). Most studies analyzed birth weight and gestational age as indicators of illness severity, but three studies relied on measures of illness severity that are more objective (7, 35, 42). About a third of the studies (11/31) stated how many neonates failed to undergo the index tests and/or the reference standard (6, 10, 29, 33–35, 38, 40, 42, 44, 45). In the majority of studies, cutoff values were defined post hoc. At least 7 studies (6, 8, 10, 19, 35, 41, 46) reported the number, training, and expertise of the persons executing and reading the index test and the reference standard, and 11 studies (2, 6, 8, 10, 19, 29, 31, 35, 42, 43, 46) provided information about masking. Measures of statistical uncertainty (i.e., 95% confidence intervals) and handling of indeterminate results, missing responses, and outliers of index tests were among the least commonly reported items from the STARD checklist (only 8 studies). Fourteen studies provided information regarding methods for calculating IL-6 test reproducibility (3, 7, 9, 10, 14, 20, 30, 34, 35, 41–44).
TABLE 5
| Quality of reporting of IL-6 accuracy studies for diagnosing early-onset neonatal infection | ||
| Category and item no. | YES | NO |
| Methods—participants | ||
| Describe the study population: | ||
| 1A. The inclusion and exclusion criteria | 22 | 9 |
| 1B. Setting, and locations where data were collected | 31 | 0 |
| Describe participant recruitment: | ||
| 2A. Was enrollment of patients based only on clinical signs suggesting infection? | 9 | 22 |
| 2B. Were such patients consecutively enrolled? | 2 | 7 |
| 2C. Was enrollment of patients based only on maternal risk factors for infection? | 7 | 24 |
| 2D. Were such patients consecutively enrolled? | 3 | 4 |
| 2E. Were patients identified by searching hospital records? | 2 | 29 |
| 2F. Did the study include both patients already diagnosed with sepsis and participants in whom sepsis had been excluded? | 3 | 28 |
| Describe data collection: | ||
| 3. Was data collection planned before the index test and reference standard were performed (prospective study)? | 15 | 16 |
| Test methods | ||
| Methods pertaining to the reference standard and the index test: | ||
| 4A. Was a composite reference standard used to identify all newborns with sepsis, and verify index test results in infected babies? | 29 | 2 |
| 4B. Was a reference standard used to exclude sepsis? | 14 | 17 |
| 4C. Was a composite reference standard used to identify all newborns without sepsis, and verify index test results in uninfected babies? | 3 | 11 |
| 4D. Did the index test or its comparator form part of the reference standard? | 10 | 21 |
| 5. Were categories of results of the index test (including cutoffs) and the reference standard defined after obtaining results? | 29 | 2 |
| 6. Did the study report the number, training, and expertise of the persons executing and reading the index tests and the reference standard? | 7 | 24 |
| 7. Was there blinding to results of the index test and the reference standard? | 11 | 20 |
| Statistical methods | ||
| 8. Describe the statistical methods used to quantify uncertainty (i.e., 95% confidence intervals)? | 5 | 26 |
| 9. Describe methods for calculating test reproducibility | 14 | 17 |
| Results—participants and test results | ||
| 10A. Describe when the study was done, including beginning and ending dates of recruitment | 28 | 3 |
| 10B. Did the study report clinical and demographic (postnatal hours or days, gestational age, birth weight, gender) features in those with and without sepsis? | 22 | 9 |
| 10C. Did the study report distribution of illness severity scores in those with and without sepsis? | 3 | 28 |
| 11. Report the number of participants satisfying the criteria for inclusion that did or did not undergo the index tests and/or or the reference standard; describe why participants failed to receive either test. | 11 | 20 |
| 12. Report a cross-tabulation of the results (including indeterminate and missing results) by the results of the reference standard; for continuous results report the distribution of the test results by the results of the reference standard | 23 | 8 |
| Results—estimates | ||
| 13. Report measures of statistical uncertainty (i.e., 95% confidence intervals) | 5 | 26 |
| 14. Report how indeterminate results, missing responses and outliers of index tests were handled | 8 | 23 |
| 15. Report estimates of test reproducibility | 14 | 17 |
Quality of IL-6 accuracy studies for diagnosing early-onset neonatal sepsis from 1990 to 2020 according to the STARD criteria (Standards of Reporting Diagnostic Accuracy Studies).
Discussion
Our meta-analysis including 31 studies with 3,276 infants resulted in a pooled sensitivity of IL-6 of 76% and pooled specificity of 79%. A recent review including 31 studies with 1,448 infants reported a global sensitivity and specificity of 82% (77–86%) and 88% (83–92%), respectively (47). Only 6 studies (7, 9, 32, 36, 40, 45) of this review (47) were also included in our review, partly due to the missing differentiation between early- and late-onset sepsis in their meta-analysis. Differences to our meta-analysis further included selection process, missing differentiation of cord vs. peripheral blood, preterm vs. term infants, influence of pPROM, time of sampling, and combination with other markers. Finally, we included twice as many infants.
We used subgroup analysis to analyze the influence of gestational age in the study population, the cutoff level used, the type of sample, and the time of sample collection. Three studies had to be excluded from the subgroup analysis (32, 33, 42). Reasons were a modification of the cutoff criteria, e.g., to favor a high specificity, so as not to introduce a bias in the subgroup analysis (32, 42), or data provided for illustrative purposes only [Panero et al. (33), data for postnatal day 1]. Some groups provided data for different scenarios, e.g., analyzing different samples or varying the cutoff level. For the subgroup analysis of preterm vs. preterm and term infants, each study was only included once, so as not to introduce the same study population multiple times within the same subgroup analysis. This was done by choosing the scenario yielding the best results, or, if subgroups were analyzed, the one including the whole study population. One study did not specify whether they used cord or peripheral blood and was excluded from the subgroup analysis regarding the type of sample (4). Subgroup analysis showed that sensitivity of IL-6 was higher in the group of preterm infants compared to the mixed group of preterm and term infants (83 vs. 73%), while specificity did not vary among study populations (both 82%). Even though a wide cutoff range of 11–300 pg/ml resulted from the included publications, we found that a cutoff value ≥30 provided only slightly improved sensitivity (84 vs. 80%) and specificity (82 vs. 81%) compared to a lower cutoff value in a group of preterm infants. These findings are in agreement with Qiu et al. (25). In the group of preterm and term infants, however, a cutoff of ≥80 pg/ml led to a drastic increase in specificity (90 vs. 71%) but not sensitivity (both 73%). In general, sensitivity and specificity values were found to vary greatly among different studies even for the same cutoff value, thus suggesting a different source of heterogeneity. We found a higher pooled sensitivity (83 vs. 71%) and specificity (85 vs. 77%) for umbilical cord blood compared to peripheral blood samples. In contrast, Qiu et al. (25) found a higher sensitivity and specificity of IL-6 in peripheral blood within a population of pPROM infants. Our results revealed improved sensitivity (80 vs. 71%) and constant specificity (77%) of early sampling within the first 48 h from peripheral blood.
EONS was more frequently observed in infants with pPROM than in premature infants with intact membranes (38 vs. 10%, p = 0.001) (29). Infants with pPROM had increased cord blood IL-6 levels, which were significantly higher in neonates who developed EONS and thus had a higher predictive value than clinical signs of chorioamnionitis (29). Another group found that cord blood IL-6 but not funisitis in women complicated with pPROM was an independent predictor for the occurrence of EONS (6). A meta-analysis investigating IL-6 as a diagnostic tool after pPROM included nine studies and reported a pooled sensitivity of 85% and specificity of 88% (25). The cutoff values ranged between 7.8 and 108.5 pg/ml correlating with sensitivities between 46 and 95% and specificities between 63.3 and 100%. Two-thirds of studies reported cord blood IL-6 values and mixed populations of preterm and term infants.
Six studies included analyzed biomarker combinations (2, 4, 9, 17, 32, 42). Messer et al. (10) stated that IL-6 appeared to be an ideal marker before the age of 12 h and in combination with CRP, thereafter leading to a sensitivity of 100%. However, this was hardly surprising since an elevated CRP level was one of the classification criteria. The combination of IL-6 > 36 pg/ml (0 h) and/or CRP > 60 mg/l (24 h) was able to increase sensitivity (93 vs. 82%). However, the specificity remained low (37%). Another study combined IL-6 > 250 pg/ml and PCT > 25 ng/ml resulting in a sensitivity of 71% and a specificity of 88% at the time of sepsis suspicion (32). Steinberger et al. (17) using cord blood cutoff values of IL-6 > 15.85 pg/ml and PCT > 0.235 ng/ml reported sensitivity and specificity of 91.7 and 77.1%, respectively, with an excellent AUC of 0.915. Silveira et al. (9) found that IL-6 > 32 pg/ml and TNF-α > 12 pg/ml had a sensitivity of 98.5%. Unfortunately, they did not report the specificity of their biomarker combination. Some studies suggested the use of three inflammatory markers (17, 31, 38). Using single-parameter analysis, Steinberger et al. (17) suggested a combined use of cord blood PCT and IL-6 with serial determinations of CRP over the first days of life to rule out infection (17). Other combinations like hs-CRP, PCT, and IL-6 (38) or presepsin, PCT, and one proinflammatory cytokine, either IL-6 or IL-8 (31), were found to be superior to the individual markers. Using an early and sensitive marker like IL-6 for screening, and confirming sepsis suspicion with a late and specific marker like CRP, measured a few hours later, is effective in diagnosing EONS (7). The potential of such combinations, however, might rather lie in their simultaneous measurement at sepsis suspicion (32). Their counteractive dynamics suggest using an either/or combination (4). Findings suggest that it is possible to define high cutoff values, increasing the specificity of the single markers, because a satisfactory sensitivity can be reached over the biomarker combination (2, 32, 42).
Chiesa et al. (22) described the quality of IL-6 diagnostic accuracy studies as suboptimal, with missing information on key elements like design, conduct, analysis, and interpretation of test accuracy. Study designs like non-consecutive sampling of patients, retrospective data collection, and identification of patients by searching hospital records are prone to spectrum bias (22). Reporting the actual dates of when the study was performed allows the reader to consider any technological advances that have taken place in the meantime. If more than one reference standard is used to verify results of the index test, incorrectly treating their results as equivalent will lead to differential verification bias (48). Reported estimates of diagnostic accuracy are on average 60% higher than those found in studies that used a single reference standard (49). However, reference standards are not interchangeable as they may not have the same degree of error and may not identify the same segment of the disease (22). Consequently, the decision to not use positive blood culture as sole standard for diagnosing EONS in diagnostic accuracy studies has been described as arguable (4) and small numbers of culture proven sepsis cases within the study population are usually reported as limitation of the study (5, 19, 20, 32). The use of a mixed study population of culture-positive and clinical sepsis cases, however, is supported by the fact that the positive culture rate is extremely low in patients with EONS (19). This holds especially true for infants born to mothers who received antenatal or intrapartum antibiotics (43). Many studies comparing the two diagnostic subgroups found that IL-6 levels did not differ significantly (2, 10, 35, 46, 50, 51). FIRS might be associated with neonatal sepsis (28) but also with a neonatal systemic inflammatory response, which manifests as clinically suspected neonatal sepsis with negative blood and cerebrospinal fluid cultures (52). Adding a group of sick neonates without infection, in which IL-6 was also significantly increased, to healthy controls lessened the diagnostic value of IL-6 (14).
Some studies reported data of a group of patients in whom the applied diagnostic criteria resulted non-conclusive, so that sepsis could neither be excluded nor confirmed (2, 10, 33–35). IL-6 levels in these neonates were found to be higher than in uninfected sick controls, but lower than in neonates with infection (2). Termed uncertain sepsis (33, 35), infection unlikely (34), or mixed group (2), those groups were mostly excluded from study analysis and the determination of cutoff values. While not all studies provided this information (34), it was generally assumed in this analysis.
In diagnostic accuracy studies, it is of utmost importance to describe the populations from which patients and patient controls originated as well as the severity of sepsis within the patient group (22). Illness severity may alter the diagnostic value of IL-6 (35), and the use of illness severity scores has been included into the STARD checklist for assessing the quality of IL-6 accuracy studies (22). Chiesa et al. (35) used the Score for Neonatal Acute Physiology (SNAP) and its Perinatal Extension (SNAP-PE) (53). High IL-6 values in infants with EONS were independent of illness severity in contrast to uninfected infants in which higher IL-6 levels correlated with higher SNAP scores. Similar results were reported by Labenne et al. (7). Messer et al. (10) found no correlation between the magnitude of IL-6 levels and the severity of infection. These findings indicate that illness severity does not influence IL-6 levels in infected infants but leads to increased levels in uninfected infants, affecting the specificity of a diagnostic test relying on IL-6.
If the result of the index test influences the decision to order the reference test, measures of diagnostic accuracy will be biased (54). Incorporation bias occurs if the index test or the comparator of the index test form part of the reference standard (54, 55). This gives the person interpreting the results of the index test or its comparator some knowledge of the results of the reference standard (22). CRP was part of the reference standard for sepsis diagnosis in most of the included studies. Not only does this fact distort the diagnostic abilities of CRP when used as a comparator of the index test, but also biomarker combinations including CRP and markers related to CRP are biased (32). Therefore, blinding to both the index test and the knowledge of its outcome should be performed to avoid test review and diagnostic review bias (22).
In the included studies, cutoffs were mostly defined post hoc using ROC analyses and Youden’s index. While Youden’s index has the advantage of being a single measure, it loses the distinction between the sensitivity and specificity of a test. So do other error-based measures like the area under the ROC curve, an estimator of the overall accuracy of a test (17). Defining the cutoffs after the results are obtained reduces the likelihood that another study will replicate the findings (22).
Strengths of the Study
The type of sepsis has been identified as a significant source of heterogeneity (p = 0.0351) through a subgroup analysis conducted by Qiu et al. (25). This was apparent even though their subgroups were formed by a group of early-onset sepsis cases and a mixed (i.e., early/late-onset) sepsis group. We eliminated this factor by including only cases of EONS in our meta-analysis.
Limitations of the Study
There are several important limitations to our systematic review and meta-analysis. First, we limited our database search to PubMed, which might have yielded a biased sample of primary studies and, thus, may influence the accuracy of summary effects. We did, however, check the reference lists of included studies and other important systematic reviews, to include other relevant studies. We did not include unpublished data and data reported in abstract form, which may result in publication bias. To investigate possible sources of heterogeneity within IL-6 diagnostic accuracy studies, we included a heterogeneous group of studies in this meta-analysis. While this gave us a sufficient number of studies (≥5 studies in each subgroup, with the exception of biomarker combinations) for meaningful subgroup analysis of multiple possible influencing factors, it might have compromised the precision of our study, due to remaining sources of heterogeneity within the subgroups. Exploration of a specific source of heterogeneity within an otherwise homogenous subgroup might be subject for future research. The small number of studies looking at biomarker combinations limited our attempt to give more information on their potential, as it did not allow for subgroup analysis. Finally, initial data selection and collection were performed by reviewer JE only; the final decision however was based on a discussion with reviewer BR and resolved by consensus.
Conclusion
We identified 31 studies on IL-6 diagnostic accuracy for EONS diagnosis between 1990 and 2020 including 3,276 infants. The range of IL-6 sensitivities and specificities in neonatal samples was 42.1–100% and 43–100% with median values of 83 and 83.3%, respectively. IL-6 accuracy was better in preterm infants than in mixed term and preterm infants. The sensitivity and specificity in umbilical cord blood were higher than in neonatal peripheral blood, 83 vs. 71% and 85 vs. 77%, respectively. Diagnostic accuracy in peripheral blood was higher if blood was drawn within the first 48 h. The combination of IL-6 and CRP had a sensitivity in the range of cord blood IL-6 as single measure (84 vs. 83%), but far lower specificity (61 vs. 85%). Finally, quality assessment by the STARD criteria revealed poor quality of the majority of studies; thus, we need better designed, prospective, multicenter investigations on IL-6 and its use for the prediction of EONS.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Statements
Data availability statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.
Author contributions
JE and BR contributed to conception and design of the study and wrote sections of the manuscript. JE performed the database search, study selection, data extraction, and statistical analysis and wrote the first draft of the manuscript. Both authors contributed to manuscript revision, read, and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1.
BakhuizenSEde HaanTRTeuneMJvan Wassenaer-LeemhuisAGvan der HeydenJLvan der HamDPet alMeta-analysis shows that infants who have suffered neonatal sepsis face an increased risk of mortality and severe complications.Acta Paediatr. (2014) 103:1211–8. 10.1111/apa.12764
2.
DoellnerHArntzenKJHaereidPEAagSAustgulenR. Interleukin-6 concentrations in neonates evaluated for sepsis.J Pediatr. (1998) 132:295–9. 10.1016/s0022-3476(98)70448-2
3.
KashlanFSmulianJShen-SchwarzSAnwarMHiattMHegyiT. Umbilical vein interleukin 6 and tumor necrosis factor alpha plasma concentrations in the very preterm infant.Pediatr Infect Dis J. (2000) 19:238–43. 10.1097/00006454-200003000-00013
4.
EbenebeCUHesseFBlohmMEJungRKunzmannSSingerD.Diagnostic accuracy of interleukin-6 for early-onset sepsis in preterm neonates.J Matern Fetal Neonatal Med. (2021) 34:253–8. 10.1080/14767058.2019.1606194
5.
YangKDHeYXiaoSAiQYuJL. Identification of progranulin as a novel diagnostic biomarker for early-onset sepsis in neonates.Eur J Clin Microbiol Infect Dis. (2020) 39:2405–14. 10.1007/s10096-020-03981-x
6.
CoboTKacerovskyMAndrysCDrahosovaMMusilovaIHornychovaHet alUmbilical cord blood IL-6 as predictor of early-onset neonatal sepsis in women with preterm prelabour rupture of membranes.PLoS One. (2013) 8:e69341. 10.1371/journal.pone.0069341
7.
LabenneMLizardGFerdynusCMontangeTIacobelliSBonsanteFet alA clinic-biological score for diagnosing early-onset neonatal infection in critically ill preterm infants.Pediatr Crit Care Med. (2011) 12:203–9. 10.1097/PCC.0b013e3181e2a53b
8.
SmulianJCBhandariVCampbellWARodisJFVintzileosAM. Value of umbilical artery and vein levels of interleukin-6 and soluble intracellular adhesion molecule-1 as predictors of neonatal hematologic indices and suspected early sepsis.J Mater Fetal Med. (1997) 6:254–9. 10.1002/(SICI)1520-6661(199709/10)6:5<254::AID-MFM2>3.0.CO;2-F
9.
SilveiraRCProcianoyRS. Evaluation of interleukin-6, tumour necrosis factor-alpha and interleukin-1beta for early diagnosis of neonatal sepsis.Acta Paediatr. (1999) 88:647–50. 10.1080/08035259950169314
10.
MesserJEyerDDonatoLGallatiHMatisJSimeoniU. Evaluation of interleukin-6 and soluble receptors of tumor necrosis factor for early diagnosis of neonatal infection.J Pediatr. (1996) 129:574–80. 10.1016/s0022-3476(96)70123-3
11.
GilfillanMBhandariV. Biomarkers for the diagnosis of neonatal sepsis and necrotizing enterocolitis: clinical practice guidelines.Early Hum Dev. (2017) 105:25–33. 10.1016/j.earlhumdev.2016.12.002
12.
KüsterHWeissMWilleitnerAEDetlefsenSJeremiasIZbojanJet alInterleukin-1 receptor antagonist and interleukin-6 for early diagnosis of neonatal sepsis 2 days before clinical manifestation.Lancet. (1998) 352:1271–7. 10.1016/S0140-6736(98)08148-3
13.
SchiblerKRLiechtyKWWhiteWLRothsteinGChristensenRD. Defective production of interleukin-6 by monocytes: a possible mechanism underlying several host defense deficiencies of neonates.Pediatr Res. (1992) 31:18–21. 10.1203/00006450-199201000-00003
14.
SantanaCGuindeoMCGonzálezGGarcÃa-MuñozFSaavedraPDoménechE. Cord blood levels of cytokines as predictors of early neonatal sepsis.Acta Paediatr. (2001) 90:1176–81. 10.1080/080352501317061602
15.
NgPC. Diagnostic markers of infection in neonates.Arch Dis Child Fetal Neonatal Edn. (2004) 89:F229–35.
16.
NgPCChengSHChuiKMFokTFWongMYWongWet alDiagnosis of late onset neonatal sepsis with cytokines, adhesion molecule, and C-reactive protein in preterm very low birthweight infants.Arch Dis Child Fetal Neonatal Edn. (1997) 77:F221–7. 10.1136/fn.77.3.f221
17.
SteinbergerEHoferNReschB. Cord blood procalcitonin and Interleukin-6 are highly sensitive and specific in the prediction of early-onset sepsis in preterm infants.Scand J Clin Lab Invest. (2014) 74:432–6. 10.3109/00365513.2014.900696
18.
ChiesaCSignoreFAssummaMBuffoneETramontozziPOsbornJFet alSerial measurements of C-reactive protein and interleukin-6 in the immediate postnatal period: reference intervals and analysis of maternal and perinatal confounders.Clin Chem. (2001) 47:1016–22.
19.
HeYDuWXJiangHYAiQFengJLiuZet alMultiplex cytokine profiling identifies interleukin-27 as a novel biomarker for neonatal early onset sepsis.Shock. (2017) 47:140–7. 10.1097/SHK.0000000000000753
20.
CernadaMBadÃaNModestoVAlonsoRMejÃasAGolombekSet alCord blood interleukin-6 as a predictor of early-onset neonatal sepsis.Acta Paediatr. (2012) 101:e203–7. 10.1111/j.1651-2227.2011.02577.x
21.
MehrSDoyleLW. Cytokines as markers of bacterial sepsis in newborn infants: a review.Pediatr Infect Dis J. (2000) 19:879–87. 10.1097/00006454-200009000-00014
22.
ChiesaCPacificoLNataleFHoferNOsbornJFReschB. Fetal and early neonatal interleukin-6 response.Cytokine. (2015) 76:1–12. 10.1016/j.cyto.2015.03.015
23.
NewcombeRGAD.Proportions and Their Differences. Statistics With Confidence.2nd ed. London: BMJ Books (2005). p. 45–56.
24.
DelangheJRSpeeckaertMM. Translational research and biomarkers in neonatal sepsis.Clin Chim Acta (2015) 451(Pt A):46–64. 10.1016/j.cca.2015.01.031
25.
QiuXZhangLTongYQuYWangHMuD. Interleukin-6 for early diagnosis of neonatal sepsis with premature rupture of the membranes: a meta-analysis.Medicine. (2018) 97:e13146. 10.1097/MD.0000000000013146
26.
FanYYuJL. Umbilical blood biomarkers for predicting early-onset neonatal sepsis.World J Pediatr. (2012) 8:101–8. 10.1007/s12519-012-0347-3
27.
SuHChangSSHanCMWuKYLiMCHuangCYet alInflammatory markers in cord blood or maternal serum for early detection of neonatal sepsis-a systemic review and meta-analysis.J Perinatol. (2014) 34:268–74. 10.1038/jp.2013.186
28.
HoferNKothariRMorrisNMüllerWReschB. The fetal inflammatory response syndrome is a risk factor for morbidity in preterm neonates.Am J Obstet Gynecol. (2013) 209:542.e1–11. 10.1016/j.ajog.2013.08.030
29.
GharehbaghiMMPeirovifarAGharehbaghiPM. Comparison of umbilical cord interleukin-6 in preterm infants with premature rupture of membranes and intact membranes.Saudi Med J. (2008) 29:224–8.
30.
SmulianJCVintzileosAMLaiYLSantiagoJShen-SchwarzSCampbellWA. Maternal chorioamnionitis and umbilical vein interleukin-6 levels for identifying early neonatal sepsis.J Mater Fetal Med. (1999) 8:88–94. 10.1002/(SICI)1520-6661(199905/06)8:3<88::AID-MFM4>3.0.CO;2-#
31.
AhmedAMMohammedATBastawySAttallaHAYousefAAAbdelrazekMSet alSerum biomarkers for the early detection of the early-onset neonatal sepsis: a single-center prospective study.Adv Neonatal Care. (2019) 19:E26–32. 10.1097/ANC.0000000000000631
32.
BenderLThaarupJVarmingKKrarupHEllermann-EriksenSEbbesenF. Early and late markers for the detection of early-onset neonatal sepsis.Danish Med Bull. (2008) 55:219–23.
33.
PaneroAPacificoLRossiNMancusoGStegagnoMChiesaC. Interleukin 6 in neonates with early and late onset infection.Pediatr Infect Dis J. (1997) 16:370–5.
34.
KruegerMNauckMSSangSHentschelRWielandHBernerR. Cord blood levels of interleukin-6 and interleukin-8 for the immediate diagnosis of early-onset infection in premature infants.Biol Neonate. (2001) 80:118–23. 10.1159/000047130
35.
ChiesaCPellegriniGPaneroAOsbornJFSignoreFAssummaMet alC-reactive protein, interleukin-6, and procalcitonin in the immediate postnatal period: influence of illness severity, risk status, antenatal and perinatal complications, and infection.Clin Chem. (2003) 49:60–8. 10.1373/49.1.60
36.
MartinHOlanderBNormanM. Reactive hyperemia and interleukin 6, interleukin 8, and tumor necrosis factor-alpha in the diagnosis of early-onset neonatal sepsis.Pediatrics. (2001) 108:E61. 10.1542/peds.108.4.e61
37.
LehrnbecherTSchrodLRutschPRoosTMartiusJvon StockhausenHB. Immunologic parameters in cord blood indicating early-onset sepsis.Biol Neonate. (1996) 70:206–12. 10.1159/000244366
38.
Al-ZahraniAGhonaimMMHusseinYMEedEMKhalifaASDorghamLS. Evaluation of recent methods versus conventional methods for diagnosis of early-onset neonatal sepsis.J Infect Dev Ctries. (2015) 9:388–93. 10.3855/jidc.5950
39.
BernerRFürllBStelterFDröseJMüllerHPSchüttC. Elevated levels of lipopolysaccharide-binding protein and soluble CD14 in plasma in neonatal early-onset sepsis.Clin Diagn Lab Immunol. (2002) 9:440–5. 10.1128/cdli.9.2.440-445.2002
40.
CanpolatFEYiðitSKorkmazAYurdakökMTekinalpG. Procalcitonin versus CRP as an early indicator of fetal infection in preterm premature rupture of membranes.Turk J Pediatr. (2011) 53:180–6.
41.
CetinODokurel CetinIUludagSSenCVeritFFGuralpO. Serial ultrasonographic examination of the fetal thymus in the prediction of early neonatal sepsis in preterm premature rupture of membranes.Gynecol Obstet Invest. (2014) 78:201–7. 10.1159/000364871
42.
RegoMAMartinezFEEliasJMussi-PinhataMM. Diagnostic value of interleukin-6 and C-reactive protein on early onset bacterial infection in preterm neonates with respiratory distress.J Perinat Med. (2010) 38:527–33. 10.1515/jpm.2010.071
43.
HatzidakiEGourgiotisDManouraAKorakakiEBossiosAGalanakisEet alInterleukin-6 in preterm premature rupture of membranes as an indicator of neonatal outcome.Acta Obstet Gynecol Scand. (2005) 84:632–8. 10.1111/j.0001-6349.2005.00747.x
44.
DøllnerHVattenLLinneboIZanussiGFLaerdalAAustgulenR. Inflammatory mediators in umbilical plasma from neonates who develop early-onset sepsis.Biol Neonate. (2001) 80:41–7. 10.1159/000047118
45.
ReschBGusenleitnerWMüllerWD. Procalcitonin and interleukin-6 in the diagnosis of early-onset sepsis of the neonate.Acta Paediatr. (2003) 92:243–5. 10.1111/j.1651-2227.2003.tb00534.x
46.
BernerRNiemeyerCMLeititisJUFunkeASchwabCRauUet alPlasma levels and gene expression of granulocyte colony-stimulating factor, tumor necrosis factor-alpha, interleukin (IL)-1beta, IL-6, IL-8, and soluble intercellular adhesion molecule-1 in neonatal early onset sepsis.Pediatr Res. (1998) 44:469–77. 10.1203/00006450-199810000-00002
47.
SunBLiangLFLiJYangDZhaoXBZhangKG. A meta-analysis of interleukin-6 as a valid and accurate index in diagnosing early neonatal sepsis.Int Wound J. (2019) 16:527–33. 10.1111/iwj.13079
48.
de GrootJADendukuriNJanssenKJReitsmaJBBossuytPMMoonsKG. Adjusting for differential-verification bias in diagnostic-accuracy studies: a Bayesian approach.Epidemiology. (2011) 22:234–41. 10.1097/EDE.0b013e318207fc5c
49.
RutjesAWReitsmaJBDi NisioMSmidtNvan RijnJCBossuytPM. Evidence of bias and variation in diagnostic accuracy studies.CMAJ. (2006) 174:469–76. 10.1503/cmaj.050090
50.
SarafidisKSoubasi-GrivaVPiretziKThomaidouAAgakidouETaparkouAet alDiagnostic utility of elevated serum soluble triggering receptor expressed on myeloid cells (sTREM)-1 in infected neonates.Intensive Care Med. (2010) 36:864–8. 10.1007/s00134-010-1819-3
51.
ArnonSLitmanovitzIRegevRBauerSLisMShainkin-KestenbaumRet alSerum amyloid A protein is a useful inflammatory marker during late-onset sepsis in preterm infants.Biol Neonate. (2005) 87:105–10. 10.1159/000081979
52.
JungERomeroRYeoLDiaz-PrimeraRMarin-ConchaJParaRet alThe fetal inflammatory response syndrome: the origins of a concept, pathophysiology, diagnosis, and obstetrical implications.Semin Fetal Neonatal Med. (2020) 25:101146. 10.1016/j.siny.2020.101146
53.
RichardsonDKGrayJEMcCormickMCWorkmanKGoldmannDA. Score for neonatal acute physiology: a physiologic severity index for neonatal intensive care.Pediatrics. (1993) 91:617–23.
54.
RansohoffDFFeinsteinAR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests.N Engl J Med. (1978) 299:926–30. 10.1056/NEJM197810262991705
55.
WorsterACarpenterC. Incorporation bias in studies of diagnostic tests: how to avoid being biased about bias.CJEM. (2008) 10:174–5. 10.1017/s1481803500009891
Summary
Keywords
interleukin-6 (IL-6), early onset neonatal sepsis, diagnostic accuracy, sensitivity and specificity, meta-analysis
Citation
Eichberger J and Resch B (2022) Reliability of Interleukin-6 Alone and in Combination for Diagnosis of Early Onset Neonatal Sepsis: Systematic Review. Front. Pediatr. 10:840778. doi: 10.3389/fped.2022.840778
Received
21 December 2021
Accepted
03 February 2022
Published
23 March 2022
Volume
10 - 2022
Edited by
Daniela De Souza, University of São Paulo, Brazil
Reviewed by
Gyuhong Shim, Inje University Sanggye Paik Hospital, South Korea; Ebru Ergenekon, Gazi University, Turkey
Updates
Copyright
© 2022 Eichberger and Resch.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Bernhard Resch, bernhard.resch@medunigraz.at
This article was submitted to Pediatric Critical Care, a section of the journal Frontiers in Pediatrics
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.