Management of Children With Fever at Risk for Pediatric Sepsis: A Prospective Study in Pediatric Emergency Care

Introduction

A majority of children with an acute infectious illness presenting to emergency care facilities will have a self-limiting illness (1). Still, an estimated 1,000 children with sepsis are being admitted to pediatric intensive care units in the United Kingdom annually, and sepsis accounts for more than 10% of childhood deaths in children aged <4 years (2). Typically, many children with sepsis will present with non-specific signs and symptoms early in their disease course, with the full severity of the illness becoming manifest only later (3, 4).

Worse outcomes in children with sepsis presenting to emergency departments are associated with the failure to recognize children with sepsis early, the absence of specialist supervision, and subsequent failure of escalating care to a more senior clinician (4), as well as delayed administration of parenteral antibiotics (5). Thus, clinical tools or decision support algorithms for aiding physicians in their decision making could benefit children with possible sepsis (6, 7).

Sepsis is traditionally defined by criteria such as those of the Systemic Inflammatory Response Syndrome (SIRS) or Sequential Organ Assessment Failure (SOFA) criteria (8–11), and typically include some clinical signs as well biochemical evidence of end-organ impairment. However, making a clinical diagnosis of sepsis continues to depend on recognizing clinical signs and symptoms. Most clinical algorithms are based on abnormal vital parameters, such as heart rate, respiratory rate, temperature, capillary refill time, and decreased level of consciousness. However, these abnormal vital parameters are also seen in a large proportion of children whose fever is due to self-limiting infectious disease (12). In addition, children are often able to maintain normal haemodynamic parameters in the early stages of sepsis, complicating the use of vital sign-based tools for the detection of sepsis.

The National Institute of Health Care Excellence (NICE) in the United Kingdom published guidelines to identify children at increased risk for sepsis in 2016 (13). The guideline recommendations specifically focus on the importance of early escalation of care in children at increased risk of sepsis, and on expediting clinical interventions, such as intravenous antibiotics and intravenous fluid bolus.

Understanding the routine management of children at increased risk for sepsis in emergency care will be important in estimating the potential impact of guidance advocating the early detection and management of sepsis. This prospective observational study aimed to study warning signs of serious infections in febrile children presenting to PED, ascertain their risk of having sepsis, and evaluate their management.

Methods

In this prospective observational study, we first described the characteristics of children with fever presenting to PED and their clinical outcomes. We then assessed the value of heart rate and respiratory rate for identifying children at risk for sepsis. Finally, we evaluated the clinical management of children with warning signs of sepsis, with a specific focus on those children admitted to PICU and a confirmed invasive bacterial infection.

Design, Setting, and Participants

This prospective observational study (Infections in Children in the Emergency Department (ICED)—study) was conducted at the PED at St. Mary's Hospital, Imperial College NHS Healthcare Trust, London, United Kingdom. The PED in this large teaching hospital in central London sees about 27,000 children a year, set in a hospital that is a tertiary referral center for pediatric hematology and infectious diseases, is a major trauma center and has a 10 bedded pediatric intensive care unit. The PED is staffed with resident medical officers; patients seen by junior trainees below registrar level are supervised by a senior registrar who completed a minimum of 3 years pediatrics or emergency medicine specialty training (ST3+ level). There is a supervising consultant with pediatric emergency specialization available daily on week days between 8 a.m. and 8 p.m., being non-resident on call at night the remaining hours. At weekends, there is a PED consultant resident for 3 h a day, the rest of the time being covered on call out of the department. A senior pediatric registrar is available to review PED patients 24 h a day and every day of the week. The nursing staff all specialize in pediatric emergency care, with initial triage being performed by a senior staff nurse from this team.

Prospective data were collected for all children aged 1 month to 16 years old presenting with fever, for the period of June 2014–March 2015. Fever was defined:

1. A tympanic or axillary fever ≥38.0 degrees Celsius measured at triage,

2. “Fever” as discriminator in the Manchester Triage System (14),

3. Fever as the reason for GP referral to PED,

4. Fever above 38 degrees Celsius measured at home in the 24 h prior to presentation.

Additional in-depth data on subsequent diagnostic investigations, clinical interventions, and final outcomes were coded for febrile children at increased risk of sepsis, defined as fever in the presence of one or more red or ambers signs as defined by the NICE guideline for the management of fever as identified by the triaging nurse (15). Clinical interventions of interest included those as described in the pediatric sepsis six (PS6) care bundle performed in the PED (13, 16) as per Table 1.

TABLE 1

Table 1. Clinical interventions as defined by the pediatric sepsis six care bundle.

Additionally, we reviewed the records of any child presenting to PED that was admitted to PICU or died, but whom presented without fever or was not eligible for inclusion in the final ICED cohort. Children with a complex medical history, defined as an underlying medical problem requiring >=2 annual visits to a pediatric specialist over a period >12 months, were excluded from the final cohort (17). Similarly, we excluded (1) children who did not wait to be seen, (2) children who were discharged to urgent care center without being seen in PED, (3) non-UK citizens, (4) children when all clinical data of the visit was missing, and (5) if the physician overruled the presenting problem of fever or the warning signs assigned to the patient at triage and actively deemed the patient not eligible for the study.

A waiver of patient informed consent was obtained from the local medical ethical committee as only routine clinical data were used (14/LO/0266). However, a biomarker discovery study was embedded into this study and for that study patient informed consent was required; hence, we excluded a small number of children from our cohort that did not consent to participation in the biomarker discovery study.

Outcome Measures

As a primary outcome, we determined the incidence of febrile children presenting to PED with warning signs of sepsis, how often these children fulfilled pediatric sepsis criteria, and how frequent invasive bacterial infections and PICU admissions occurred in this population. As a secondary outcome measure, we studied the expedience measures and resource utilization of children at risk of sepsis and the compliance with the proposed course of management according to the pediatric sepsis 6 care bundle (Table 1). We calculated expediency measures and resource utilization for each unique PED visit; we coded a single final diagnosis and the need for hospital admission for each disease episode, accounting for return visits with a similar illness within a five-day period.

Working Diagnosis and Diagnosis of Serious Bacterial Infection

A working diagnosis was determined by the treating physician and electronically coded at the time of discharge from the PED. In addition, a coded final diagnosis of serious bacterial infection (SBI) was based on a previously published reference standard, which included positive cultures from sterile sites [blood, urine, cerebrospinal fluid (CSF)], additional microbiology, virology and radiology data, and consensus diagnosis by members of the clinical research team (RN, RJ, JH) (18, 19). A diagnosis of bacterial pneumonia was based on radiographic evidence of consolidation or effusion as determined by a pediatric radiologist. Similarly, invasive bacterial infections (IBI) were defined as those with positive bacterial isolates in blood or CSF. The research team coded a single final outcome diagnosis for every disease episode, considering data from all PED visits within a 5-day window and, if admitted, data from the complete hospital admission duration.

Pediatric Sepsis Criteria and Different Thresholds of Vital Signs

We looked at the number of children having tachycardia or tachypnoea by using different thresholds as defined by (1) Advanced Pediatric Life Support (APLS) thresholds and (2) thresholds used in the NICE guidelines on the early detection and management of sepsis (13), which correspond with the 99th centiles for respiratory rate and heart rate described in the meta-analysis by Fleming et al. (20). We then looked at the number of children fulfilling sepsis criteria using several sepsis scores, namely (1) amber or red signs as described in the NICE guidelines on the early detection and management of sepsis; (2) the age adjusted SIRS and qSOFA scores as defined according to Goldstein et al. (10) and Schlapbach et al. (21) (Appendix A); (3) the Sepsis Trust UK trigger criteria as defined by >=2 of: temperature >38.5 degrees Celsius, inappropriate tachycardia (APLS thresholds), altered mental state, and prolonged capillary refill (22).

Expediency Measures and Resource Utilization

Expediency measures were the timeliness of interventions being undertaken, broken down into the following categories about the time to achieve the following: time to senior review, time to intravenous antibiotics, time to intravenous access and blood sampling, and time to inotropic support; these were measured in minutes from time of arrival to time of intervention. Resource utilization was based on the items of the PS6 care bundle (Table 1).

Data Collection

Standardized, electronic data on triage, vital signs, clinical signs and symptoms, diagnostic tests, working diagnosis and need for hospital admission were recorded prospectively for all febrile children in their digital file as part of routine clinical care. These data were collected using a predefined data collection form integrated into the electronic file of the patient using SYMPHONY software (23). For febrile children with one or more of the above warning signs, additional data were entered in an electronic data entry form by the research team, including data on time to interventions, which were based on real-time data registration in the patient's electronic file or written medical notes. All medical and nursing staff had undergone training in advanced life support for children, having attended relevant certified life support courses.

Statistical Analysis

Chi square analyses were used for categorical and dichotomous variables, and Fisher's exact test was used when <=5 cases present; non-parametric tests of Mann Whitney-U or Kruskall-Wallis were used for non-normally distributed continuous variables, and student's t-test was used for normally distributed continuous variables. Cohen's kappas were calculated for the level of agreement between definitions of abnormal heart rate and respiratory rate as defined by APLS and the NICE sepsis guidelines (either RED or AMBER). Diagnostic performance of the different thresholds of vital signs, sepsis criteria, and lactate to predict presence of SBI, IBI and PICU admission were calculated. In line with our study objectives, we used available data only without imputing missing data. SPSS version 25 IBM, Chicago Inc., and R statistical software, version 3.6.1, were used for statistical analyses.

Results

Study Population

Of 18,104 children aged 1 month to 16 years presenting to PED, 5,156 had fever (28%). Of these, 2,130 (41%) had one or more warning signs. A total of 1,628 unique visits for fever belonging to 1,551 disease episodes (considering all visits of an individual patient within a 5-day period) were ultimately included in the final cohort of febrile children with warning signs (Figure 1). In total, 255/1,551 (16%) children in this cohort had more than one visit to PED for any problem during a disease episode; of these children, a majority had two visits during the disease episode (218/255 children (85%), range 2–5 visits); 1,458/1,551 (94%) children were included during their first presentation to ED; the remaining 93/1,551 (6%) children had presented to ED previously without fever and/or warning signs. In total, 228/1,551 (15%) children were admitted following their first presentation to ED; a further 38/1,551 (2%) children were (re)admitted to hospital after a revisit, and 12 of these children (0.7%) had SBI. Overall, hundred and eleven children had an SBI (7%); 266/1,551 children (17%) were admitted, and 716/1,551 children (46%) were given any type of antibiotics at any stage during the disease episode (Tables 2, 3).

FIGURE 1

Figure 1. Flowchart of included population.

TABLE 2

Table 2. Description of study population.

TABLE 3

Table 3. Outcomes in study population.

Vital Signs and Sepsis Criteria

In our population of all febrile children, 1,606/4,730 (34%) children had tachypnoea and 1,907/4,897 (39%) children had tachycardia when using APLS threshold values (Table 2). Using the NICE sepsis guidelines thresholds resulted in 1,512/4,730 (32%) children having tachypnoea and 2,769 (57%) children having tachycardia (Figure 2, Appendix B). This reclassification meant that a higher proportion of children aged >5 years had AMBER or RED signs for tachypnoea, with fewer children aged under 5 years classifying as AMBER or RED; for tachycardia, children were classified more often as AMBER or RED across all ages, mostly because of lower thresholds to define tachycardia in the AMBER category. For respiratory rate, Cohen's kappa to define tachypnoea was 0.56 (“weak” level of agreement, standard error 0.01, p-value < 0.001) between APLS thresholds and NICE sepsis (RED or AMBER) thresholds; for tachycardia this was 0.66 (“moderate” level of agreement, standard error 0.01, p-value < 0.001).

FIGURE 2

Figure 2. Percentages of all febrile children with tachycardia and tachypnoea, categorized by age groups.

For the cohort of children with warning signs, 1,441/1,628 (89%) had one or more abnormal vital signs (Table 4). Of those children with warning signs and with normal vital signs, “decreased activity” (Amber sign, n = 16/187, 9%), “fever for more than or equal to 5 days” (Amber sign, n = 30/187, 16%), and “no smile” (Amber sign, n = 42/187, 22%) were the most frequent. A total of 545 (33%) children had >=2 positive SIRS items, and 1,317 children (81%) had one or more positive qSOFA items. A substantial number of children did not have data available for all required parameters, mostly owing to non-availability of systolic blood pressure, which was measured only in 120 children (7%), and white cell count, which was measured in 293 children (18%). Tachycardia was present in all 10 children with IBI or PICU admission; noticeable was the high rate of missing blood pressures as part of initial observations in this group of patients (Table 5). Overall, diagnostic performance of vital signs and sepsis criteria were insufficient to predict presence of SBI or IBI/PICU, with a large proportion of false positives (Appendix C).

TABLE 4

Table 4. Pediatric sepsis criteria and sepsis warning scores.

TABLE 5

Table 5. Febrile children with invasive bacterial infection or admitted to PICU and sepsis scores.

Management of Children at Risk of Serious Infections

A minority of febrile children with warning signs received any of the PS6 interventions in the PED (Table 6). Expediency of pediatric sepsis 6 interventions varied widely, with five children receiving all PS6 interventions in the first hour after arriving; one of those had inotrope drugs commenced after 60 min in PED. Thousand and sixty-two (65%) children had none of the PS6 interventions.

TABLE 6

Table 6. Pediatric Sepsis 6 interventions and timeliness of interventions in the PED.

Eighty-six of 149 (58%) children had lactate <2 mMol/L, 56 (38%) between 2 and 4 mMol/L, and 7 (5%) had a lactate level >= 4 mMol/L. This was not related to the decision of giving an IV fluid bolus (p = 0.19) or the presence of serious bacterial infections (p = 0.128) (Figure 3). There was a significant association between lactate levels and hospital admission (p = 0.002). A lactate level of >2 mMol/L had a sensitivity of 0.60 (95% CI 0.27–0.86), specificity of 0.64 (95% CI 0.55–0.72), positive LR 1.67 (95% CI 0.96–2.90), and negative LR 0.62 (95% 0.29–1.35) for IBI or PICU admission. For SBI, this was a sensitivity of 0.53 (95% CI 0.36–0.68), specificity of 0.68 (95% CI 0.58–0.76), positive LR 1.64 (95% CI 1.09–2.44), and negative LR 0.70 (95% 0.50–0.98). A high percentage (79%) of children who had a lactate value measured were admitted to hospital compared with the overall rate of admission (17%).

FIGURE 3

Figure 3. Associations between lactate values, age and outcomes. Scatter plot showing the associations between lactate values (mMol/L) (y-axis), age (years) (x-axis) and (a) intravenous fluid bolus (red inverse triangles) (p = 0.19) [left], (b) serious (red inverse triangles) and invasive (black plus sign) bacterial infections (p = 0.128) [middle], (c) hospital admission (red inverse triangles), PICU admission (black plus sign), and death (green diamond) (p = 0.002) [right].

Management of Children Admitted to PICU

Five children (0.3%) were admitted to PICU whilst one child (0.06%) died in ED (Tables 7a,b). One child was admitted to PICU with bronchiolitis after having been discharged from the pediatric ward the previous day (Table 8). One child admitted to PICU with intussusception had presented twice previously with vomiting, some 21 and 32 h beforehand, respectively. One child died of sepsis in the ED; this child had presented 8 h beforehand with fever and upper respiratory tract focus, and was discharged home following normalization of all vital signs during the first visit. This child received all the pediatric sepsis 6 interventions within 1 h of arriving on the second and final attendance. For the children admitted to PICU most PS6 interventions were delivered in the ED, but the time to the delivery of the PS6 interventions varied (Tables 6, 7a).

TABLE 7A

Table 7a. Management of children admitted to PICU (n = 5).

TABLE 7B

Table 7b. Management of children who died in the PED (n = 1).

TABLE 8

Table 8. Management of children (n = 4) on first presentation who were admitted to PICU or had IBI on revisit to PED.

An additional three children admitted to PICU (Appendix D) had fever and warning signs, but were excluded from final cohort. For one case most clinical data from the ED visit were missing, but review of microbiology yielded no positive bacteriology or virology. The other two children were excluded based on co-morbidity, one with status epilepticus and one with pneumonia.

In the total population, amongst children who were not eligible for inclusion in the final ICED cohort, there were an additional 21 PICU admissions (0.1%) and three deaths (0.01%) in the ED, with one more death in a child admitted to PICU via PED (Appendices D, E). Reasons for PICU admission were either a non-infectious illness (n = 14) or type I respiratory failure secondary to a respiratory tract infection without fever or hypothermia (n = 7), and not sepsis. These children mostly presented with high MTS urgency classification, and grossly abnormal vital signs; exceptions having a lower urgency classification included two children admitted to neonatal ITU for management of physiological neonatal jaundice, children with recurrence of seizures in PED, children with underlying comorbidity, clinical deterioration with reducing level of consciousness in diabetes, or worsening work of breathing in respiratory tract infections during stay in PED. Deaths were secondary to out of hospital cardiac arrest (n = 1), diabetic ketoacidosis (n = 1), cardiac arrest following major trauma (n = 1), and catastrophic injuries leading to death in PICU (n = 1), and not to sepsis.

Management of Children With Confirmed Invasive Bacterial Infection

Six children (0.4%) had confirmed IBI with a bacterial pathogen identified in blood or CSF (Table 9). Amongst these is the child that died of meningococcal sepsis. The remaining five children were admitted to the pediatric ward; all but one were admitted after their first presentation to PED (Table 8). The one exception being a 4 year old child with pneumococcal septicaemia who was discharged from the PED <24 h before representing, with an initial working diagnosis of gastritis and without prescribing of antibiotics. This child was managed with iv antibiotics and admitted to the ward at second visit, and no serious complications occurred. The triage urgency as well as the number and expediency of PS6 interventions varied for children with IBI. None of these five children had signs of peripheral hypoperfusion at presentation, with reportedly normal capillary refill and unaltered mental state. Incidence of IBI in our cohort of febrile children with ≧1 warning signs was 0.39% (95% CI 0.29–0.49%), resulting in 256 children needing to be treated according to sepsis guideline recommendations for each child with IBI; for any serious outcome (n = 11), number needed to treat was 1:141.

TABLE 9

Table 9. Management of children with invasive bacterial infection (n = 6).

Discussion

Principal Findings

This study describes the routine care of children with fever at increased risk of serious infections in a PED. A considerable proportion of febrile children presented with warning signs (41%). Serious infections were infrequent, and most children were managed conservatively without need for escalation of care and only limited use of resources.

Our cohort highlights the difficulties of introducing screening tools for sepsis in pediatric emergency care. In particular, any of the used thresholds for tachycardia and tachypnoea yielded considerable false positive results. Moreover, although hindered by missing values for blood pressure and WBC, the diagnostic performance of vital signs and sepsis criteria were insufficient (Appendix C). Lactate levels were not significantly associated with the decision to give iv fluid bolus or the presence of SBI or IBI/PICU.

Of the children with IBI or admitted to PICU, four children received all pediatric sepsis 6 interventions in the golden hour after arriving in PED, with expediency of PS6 interventions varying greatly in the others. As such, our data scope how the management of children with fever and warning signs in PED can be improved. Children with positive isolates in blood or CSF culture presented in a heterogeneous manner, with varying levels of triage urgency and severity of illness, consistent with findings of an earlier study (24), and showcasing the importance of careful clinical assessments of all febrile children with warning signs. For most of these children, expedited invasive interventions as recommended by the NICE sepsis guidelines were not merited in the clinical context. Our findings therefore align with the recent recommendations of the Surviving Sepsis group that advised on a 3 h window for observing and escalating care in children with warning signs of a serious infection but without evidence of shock (25).

Comparison With Existing Literature

Early recognition of children with sepsis and subsequent timely management have proven vital for reducing sepsis related morbidity and mortality (4, 26–29). In both adults and children it was found that antibiotic treatment within the first hour of presentation influenced overall mortality (5, 30, 31). Similarly, adherence to clinical guidelines for the management for pediatric sepsis was associated with improved outcomes (8). However, a national audit amongst children with sepsis admitted to pediatric intensive care units in the UK showed poor adherence to the pediatric advanced life support guidelines, with non-compliance to guidelines in 62% of the children (28). Initial studies have shown that tools for managing childhood sepsis increased adherence to guidelines in PEDs in the United States and Australia (5, 32–36). However, it appears these studies selected more unwell children with clear signs of sepsis, and the impact on a non-selected population of febrile children presenting to PEDs remains unclear.

Previous studies showed that a considerable proportion of febrile children in PED fulfilled criteria for pediatric sepsis, and that most of these children were safely managed with a conservative observational clinical approach (12). Recently, based on the sepsis consensus-3 a bedside clinical score was proposed, the so called qSOFA (11, 37). A qSOFA score, modified for a pediatric population, validated well in a PICU population (21). However, our data showed that blood pressure was only recorded in 7%, and was not routinely performed at the time of triage. Measuring blood pressure routinely in children at the time of triage comes with a number of practical difficulties in the PED.

The role of tachycardia as appropriate indicator for serious infections in secondary emergency care has been debated. One systematic review found limited diagnostic value of heart rate in detecting serious infections (38). Another review proposed altering normal values for both heart rate and respiratory rate (20). The new NICE sepsis guidelines used these updated thresholds, but our data didn't show an immediate clinical benefit. Similarly, one study found no advantage of using temperature dependent normal values of heart rate for detecting sepsis over APLS threshold values (39). On the other hand, temperature dependent threshold values for respiratory rate performed better in children with lower respiratory tract infections than APLS threshold values (40). Furthermore, several studies discussed limitations of the interrater variability and interpretation of a prolonged capillary refill, often used in clinical sepsis scores (41, 42). One study did not find an association between peripherally or centrally measured capillary refill and serious infections in the ED (43), contrasting with the often perceived usefulness of capillary refill as a reliable clinical sign of peripheral perfusion in the context of sepsis in high incidence clinical environments. Equally, altered mental state is a potential indicator of poor cerebral perfusion and this has been adopted as a warning sign in sepsis scores and guidelines. In children, however, it might be more difficult to detect early, more subtle, changes in mental state, such as irritability or lethargy, which can often also be explained by other contributing factors. In our cohort, only few children had prolonged capillary refill or an altered mental state; five out of six children with IBI had normal capillary refill (2 s or less) and unchanged mental state.

Finally, lactate levels play a central role in guiding resuscitation and administration of intravenous fluid bolus in sepsis (44–49). There is limited evidence base for this approach in pediatric emergency care (50). Our association between lactate levels, intravenous fluid bolus, and hospitalization is likely self-perpetuating. Our data also suggest that more clinical parameters are being taken into account, other than lactate level alone, when deciding on the need for intravenous fluid bolus: several children with high lactate levels did not receive a fluid bolus. Known confounding factors, such as use of bronchodilators or capillary sampling methods, need to be taken into consideration. Moreover, guidelines from the European Pediatric Advanced Life Support (EPALS) do not support the use of fluid in children without clinical evidence of septic shock (51). In addition, in children with suspected myocardial dysfunction fluids should be titrated particularly carefully, and congenital heart disease in young children and myocarditis can mimic sepsis presentations. Similarly, the recent recommendations by the Surviving Sepsis campaign did not identify a lactate threshold to suggest fluid bolus in children with sepsis, and urged mindful administration of fluids in the absence of intensive care facilities (25).

Clinical Implications and Future Research

Combined, the reported use of resources and expediency of interventions can be used as a surrogate to reflect the low overall severity of illness of the majority of children with fever and warning signs seen in PEDs. Our data provide an estimate of the required sensitivity and specificity of potential sepsis tools to improve current clinical pediatric emergency care. The introduction of tools for the early detection of sepsis might correctly improve recognition and time to interventions in some children. However, this will need to be positioned against the burden of false positives in a resource stretched environment, the hazards of overtreating and overdiagnosis of potentially serious conditions which aren't so, and the dilution of capacity of a department to deal with the true positive owing to the larger number of relatively well children. This is much in contrast to the hypothesized benefits of recognizing children with sepsis early, potentially resulting in improved mortality rates, shorter PICU admissions, and fewer requirements for interventions at a later stage of the admission. In particular, the risks of fluid overload in critically ill children are well recognized (51–54). Let alone risks of anaphylaxis and other adverse reactions from antibiotics, or extravasation injuries from intravenous access.

The senior decision maker plays a pivotal role in all this, as outlined in the NICE sepsis algorithms that state that any child triggering the sepsis pathway should be seen within an hour by a senior decision maker, defined as a pediatric or emergency care registrar ST3 or above. This senior decision maker has the ability to de-escalate care at any time, as was shown in a recent implementation study (55). It is unclear if senior decision makers would have influenced the potentially delayed management of the four children with IBI or PICU admission with previous ED visit (0.3%, Table 8).

More research on largescale datasets will be needed to validate the NICE sepsis guidelines and to better define early predictors of sepsis. Combinations of clinical predictors and biomarkers might improve the risk assessment and likelihood of children having sepsis at first assessment. Many biomarkers have been proposed for diagnosing sepsis, with best evidence available C-reactive protein and Procalcitonin (56). Procalcitonin appears to perform better in young infants and neonates, as well as in children with a short duration of fever (57), reflecting the shorter inflammatory response time of Procalcitonin compared to that of C-reactive protein (58). However, no biomarker is capable for diagnosing sepsis or SBI in isolation (59, 60). In our study, initial levels of C-reactive protein ranged widely for those with IBI or admitted to PICU. Also, extensive health economic analyses on the impact of sepsis tools in pediatric emergency care are yet to be undertaken. Finally, a review of all children admitted to PICU (Appendix D) showed that several children with infections did not present with fever, but other signs such as respiratory distress. Future studies should consider broader eligibility criteria.

Strengths and Limitations

This study is the first to describe a prospective cohort of febrile children targeted by the new NICE sepsis guidelines for improving the early detection of pediatric sepsis. All clinical data were collected in a standardized manner as part of routine clinical care, in a period preceding the release of these guidelines. Another strength is the near complete data available for eligible children, mostly as a result of introducing the study protocol within routine clinical care. Moreover, all medical staff were specialized in pediatric emergency care, including being certified in advanced pediatric life support ensuring high quality of collected data.

As a limitation, our data only reflect practice in a single center, and multicentre studies across multiple sites and countries are needed. At the time of data collection, other than local guidelines, no stringent guidance for following a pediatric sepsis protocol nor a sepsis trigger system were in place, partly explaining the low compliance with the PS6 care bundle. We didn't perform additional qualitative research to better understand compliance with the PS6 care bundle or the role of the senior decision maker, and this will need further research. We didn't collect biochemical data to show the incidence of children fulfilling definitions for severe sepsis; but we expect this to be very low in our population considering the low incidence of true sepsis and PICU admissions. Also, we did not evaluate the change in practice following the introduction of the NICE sepsis guideline (13). We included data from a 9-month period, meaning seasonal influence cannot be ruled out. Furthermore, the clinical warning signs for pediatric sepsis are liable to interrater variability. However, introducing tools with clinical signs and symptoms inherently mean this needs to be taken into account to ensure generalisability. We only considered data from initial triage, and not from any clinical deterioration in the emergency department. Finally, we looked solely in children with no significant prior medical history. Our population consisted for only a small proportion of children with significant co-morbidities (<5%). Children with a complex medical history are generally at increased risk of serious infections and more susceptible for complications of serious infections (61). The disease course and the signs and symptoms of serious infections can differ from otherwise healthy children, and they do not necessarily mount a fever. The validity of clinical warning signs and symptoms, and the role of sepsis screening tools, in children with a complex medical history will need to be studied in future studies.

Conclusion

Many febrile children have warning signs of possible sepsis on arrival to PED, and few requiring management for true sepsis. Introducing pathways for early escalation of care for children fulfilling criteria of suspected sepsis might have unwanted effects on the overall management of febrile children in the emergency department.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by Imperial College London. Written informed consent from the participants' legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements. Written informed consent was obtained from the minor(s)' legal guardian/next of kin for the publication of any potentially identifiable images or data included in this article.

Author Contributions

RN was guarantor of this paper, attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted, wrote the first draft of the manuscript, and was responsible for data analysis. RN, RJ, ML, JH, and IM were all responsible for designing this study and its implementation. JH, IM, and ML were responsible for obtaining funding. RN and RJ were mainly responsible for data collection. All authors had full access to the data, have contributed significantly to the writing of this manuscript, and have read the final version of this manuscript they have approved the manuscript as submitted.

Funding

This research was supported by the National Institute of Health Research Biomedical Research Center based at Imperial College London. RN was awarded an Early Career Research Grant by the Thrasher Fund (Award number 12830), as well as an academic clinical fellowship (ACF-2015-21-016) and lectureship by the National Institute of Health Research (CL-2018-21-007).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We would like to acknowledge and thank the staff of the pediatric emergency department at St. Mary's hospital for their contributions to this study. We would also like to thank the research nursing team, and in particular Ladan Ali, Sobia Mustafa, and Salina Persans, for their support with patient recruitment and data collection, and with their help with study protocol implementation.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2020.548154/full#supplementary-material

Abbreviations

BP, blood pressure; CI, confidence interval; CR, capillary refill; CSF, cerebrospinal fluid; GCS, Glasgow coma scale; HR, heart rate; IBI, invasive bacterial infection; IO, intra-osseous; IM, intramuscular; IV, intravenous; LR, likelihood ratio; LRTI, lower respiratory tract infection; MTS, Manchester Triage System; NPV, negative predictive value; Npa, nasopharyngeal aspirate; PED, pediatric emergency department; PICU, pediatric intensive care unit; PPV, positive predictive value; PS6, pediatric sepsis 6; qSOFA, quick Sequential Organ Assessment Failure; RR, respiratory rate; RSV, respiratory syncytial virus; SBI, serious bacterial infections; SIRS, Systemic Inflammatory Response Syndrome; WBC, white blood cell count.

References

1. Craig JC, Williams GJ, Jones M, Codarini M, Macaskill P, Hayen A, et al. The accuracy of clinical symptoms and signs for the diagnosis of serious bacterial infection in young febrile children: prospective cohort study of 15 781 febrile illnesses. BMJ. (2010) 340:1015. doi: 10.1136/bmj.c1594

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Bryce J, Boschi-Pinto C, Shibuya K, Black RE. WHO estimates of the causes of death in children. Lancet. (2005) 365:1147–52. doi: 10.1016/S0140-6736(05)71877-8

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Thompson MJ, Ninis N, Perera R, Mayon-White R, Phillips C, Bailey L, et al. Clinical recognition of meningococcal disease in children and adolescents. Lancet. (2006) 367:3s97–403. doi: 10.1016/S0140-6736(06)67932-4

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Ninis N, Phillips C, Bailey L, Pollock JI, Simon N, Britto J, et al. The role of healthcare delivery in the outcome of meningococcal disease in children: case-control study of fatal and non-fatal cases. Br Med J. (2005) 330:1475–8. doi: 10.1136/bmj.330.7506.1475

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Evans IVR, Phillips GS, Alpern ER, Angus DC, Friedrich ME, Kissoon N, et al. Association between theNew York sepsis care mandate and in-hospital mortality for pediatric sepsis. JAMA. (2018) 320:358–67. doi: 10.1001/jama.2018.9071

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Balamuth F, Alpern ER, Grundmeier RW, Chilutti M, Weiss SL, Fitzgerald JC, et al. Comparison of two sepsis recognition methods in a pediatric emergency department. Acad Emerg Med. (2015) 22:1298–306. doi: 10.1111/acem.12814

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat Med. (2018) 24:1716–20. doi: 10.1038/s41591-018-0213-5

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Oliveira CF, Nogueira De Sá FR, Oliveira DSF, Gottschald AFC, Moura JDG, Shibata ARO, et al. Time- and fluid-sensitive resuscitation for hemodynamic support of children in septic shock: barriers to the implementation of the American college of critical care medicine/pediatric advanced life support guidelines in a pediatric intensive care unit in. Pediatr Emerg Care. (2008) 24:810–5. doi: 10.1097/PEC.0b013e31818e9f3a

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Bone RC, Sibbald WJ, Sprung CL. The ACCP-SCCM consensus conference on sepsis and organ failure. Chest. (1992) 101:1481–3. doi: 10.1378/chest.101.6.1481

CrossRef Full Text | Google Scholar

10. Goldstein B, Giroir B, Randolph A. International consensus conference on pediatric sepsis. International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med. (2005) 6:2–8. doi: 10.1097/01.PCC.0000149131.72248.E6

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Singer M, Deutschman CS, Seymour C, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. (2016) 315:801–10. doi: 10.1001/jama.2016.0287

CrossRef Full Text | Google Scholar

12. Scott HF, Deakyne SJ, Woods JM, Bajaj L. The prevalence and diagnostic utility of systemic inflammatory response syndrome vital signs in a pediatric emergency department. Acad Emerg Med. (2015) 22:381–9. doi: 10.1111/acem.12610

PubMed Abstract | CrossRef Full Text | Google Scholar

13. NICE Clinical Guideline 51: Sepsis: Recognition Diagnosis and Early Management. National Institute of Health and Care Excellence (NICE) (2016).

14. Kevin JM, Mackway-Jones JW. Presentational flow chart index. 2nd ed. Emergency Triage. Blackwell Publishing Ltd. (2013). p. 62–3. doi: 10.1002/9781118299029.oth1

CrossRef Full Text

15. NICE Clinical Guideline 160: Fever in Under 5s: Assessment and Initial Management Clinical Guideline. National Institute of Health and Care Excellence (NICE) (2013).

16. Levy MM, Evans LE, Rhodes A. The surviving sepsis campaign bundle: 2018 update. Crit Care Med. (2018) 46:997–1000. doi: 10.1097/CCM.0000000000003119

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Simon TD, Cawthon ML, Stanford S, Popalisky J, Lyons D, Woodcox P, et al. Pediatric medical complexity algorithm: a new method to stratify children by medical complexity. Pediatrics. (2014) 133:e1647–54. doi: 10.1542/peds.2013-3875

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Nijman RG, Vergouwe Y, Thompson M, Veen M Van, Van Meurs AHJ, Van Der Lei J, et al. Clinical prediction model to aid emergency doctors managing febrile children at risk of serious bacterial infections: diagnostic study. BMJ. (2013) 346:1706. doi: 10.1136/bmj.f1706

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Nijman RG, Vergouwe Y, Moll HA, Smit FJ, Weerkamp F, Steyerberg EW, et al. Validation of the feverkidstool and procalcitonin for detecting serious bacterial infections in febrile children. Pediatr Res. (2018) 83:466–76. doi: 10.1038/pr.2017.216

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Fleming S, Thompson M, Stevens R, Heneghan C, Plüddemann A, MacOnochie I, et al. Normal ranges of heart rate and respiratory rate in children from birth to 18 years of age: a systematic review of observational studies. Lancet. (2011) 377:1011–8. doi: 10.1016/S0140-6736(10)62226-X

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Schlapbach LJ, Straney L, Bellomo R, MacLaren G, Pilcher D. Prognostic accuracy of age-adapted SOFA, SIRS, PELOD-2, and qSOFA for in-hospital mortality among children with suspected infection admitted to the intensive care unit. Intensive Care Med. (2018) 44:179–88. doi: 10.1007/s00134-017-5021-8

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Kissoon T, Roland D, Tong J, Plunkett A, Singh R. Clinical Toolkit 6: Emergency Department Management of Paediatric Sepsis. UK Sepsis Trust (2015).

23. EMIS Health. Symphony Software. Available online at: https://www.emishealth.com/products/symphony/ (accessed January 18, 2019).

24. Nijman RG, Zwinkels RLJ, Van Veen M, Steyerberg EW, Van Der Lei J, Moll HA, et al. Can urgency classification of the manchester triage system predict serious bacterial infections in febrile children? Arch Dis Child. (2011) 96:715–22. doi: 10.1136/adc.2010.207845

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Weiss SL, Peters MJ, Alhazzani W, Agus MSD, Flori HR, Inwald DP, et al. Surviving sepsis campaign international guidelines for the management of septic shock and sepsis-associated organ dysfunction in children. Pediatr Crit Care Med. (2020) 21:E52–106. doi: 10.1097/PCC.0000000000002198

CrossRef Full Text | Google Scholar

26. Hyslop AE, Han YY, Carcillo JA, Dragotta MA, Bills DM, Watson RS, et al. Early reversal of pediatric-neonatal septic shock by community physicians is associated with improved outcome [3] (multiple letters). Pediatrics. (2004) 114:323–4. doi: 10.1542/peds.114.1.323-a

CrossRef Full Text | Google Scholar

27. Carcillo JA, Kuch BA, Han YY, Day S, Greenwald BM, McCloskey KA, et al. Mortality and functional morbidity after use of PALS/APLS by community physicians. Pediatrics. (2009) 124:500–8. doi: 10.1542/peds.2008-1967

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Inwald DP, Tasker RC, Peters MJ, Nadel S. Emergency management of children with severe sepsis in the united kingdom: the results of the paediatric intensive care society sepsis audit. Arch Dis Child. (2009) 94:348–53. doi: 10.1136/adc.2008.153064

PubMed Abstract | CrossRef Full Text | Google Scholar

29. NICE Clinical Guideline 102: Bacterial Meningitis and Meningococcal Septicaemia. National Institute of Health and Care Excellence (NICE) (2010).

Google Scholar

30. Weiss SL, Fitzgerald JC, Balamuth F, Alpern ER, Lavelle J, Chilutti M, et al. Delayed antimicrobial therapy increases mortality and organ dysfunction duration in pediatric sepsis. Crit Care Med. (2014) 42:2409–17. doi: 10.1097/CCM.0000000000000509

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Ferrer R, Martin-Loeches I, Phillips G, Osborn TM, Townsend S, Dellinger RP, et al. Empiric antibiotic treatment reduces mortality in severe sepsis and septic shock from the first hour: results from a guideline-based performance improvement program. Crit Care Med. (2014) 42:1749–55. doi: 10.1097/CCM.0000000000000330

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Long E, Babl FE, Angley E, Duke T. A prospective quality improvement study in the emergency department targeting paediatric sepsis. Arch Dis Child. (2016) 101:945–50. doi: 10.1136/archdischild-2015-310234

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Paul R, Melendez E, Stack A, Capraro A, Monuteaux M, Neuman MI. Improving adherence to PALS septic shock guidelines. Pediatrics. (2014) 133:e1358–66. doi: 10.1542/peds.2013-3871

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Paul R, Neuman MI, Monuteaux MC, Melendez E. Adherence to PALS sepsis guidelines and hospital length of stay. Pediatrics. (2012) 130:e273–80. doi: 10.1542/peds.2012-0094

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Cruz AT, Perry AM, Williams EA, Graf JM, Wuestner ER, Patel B. Implementation of goal-directed therapy for children with suspected sepsis in the emergency department. Pediatrics. (2011) 127:e758–66. doi: 10.1542/peds.2010-2895

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Larsen GY, Mecham N, Greenberg R. An emergency department septic shock protocol and care guideline for children initiated at triage. Pediatrics. (2011) 127:e1585–92. doi: 10.1542/peds.2010-3513

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Angus DC, Seymour CW, Coopersmith CM, Deutschman CS, Klompas M, Levy MM, et al. A framework for the development and interpretation of different sepsis definitions and clinical criteria. Crit Care Med. (2016) 44:e113–21. doi: 10.1097/CCM.0000000000001730

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Van den Bruel A, Haj-Hassan T, Thompson M, Buntinx F, Mant D. Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet. (2010) 375:834–45. doi: 10.1016/S0140-6736(09)62000-6

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Brent AJ, Lakhanpaul M, Ninis N, Levin M, MacFaul R, Thompson M. Evaluation of temperature-pulse centile charts in identifying serious bacterial illness: observational cohort study. Arch Dis Child. (2011) 96:368–73. doi: 10.1136/adc.2010.183129

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Nijman RG, Thompson M, Van Veen M, Perera R, Moll HA, Oostenbrink R. Derivation and validation of age and temperature specific reference values and centile charts to predict lower respiratory tract infection in children with fever: prospective observational study. BMJ. (2012) 345:e4224. doi: 10.1136/bmj.e4224

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Fleming S, Gill P, Jones C, Taylor JA, Van Den Bruel A, Heneghan C, et al. Validity and reliability of measurement of capillary refill time in children: a systematic review. Arch Dis Child. (2015) 100:239–49. doi: 10.1136/archdischild-2014-307079

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Fleming S, Gill P, Jones C, Taylor JA, Van Den Bruel A, Heneghan C, et al. The diagnostic value of capillary refill time for detecting serious illness in children: a systematic review and meta-analysis. PLoS ONE. (2015) 10:e0138155. doi: 10.1371/journal.pone.0138155

PubMed Abstract | CrossRef Full Text | Google Scholar

43. De Vos-Kerkhof E, Krecinic T, Vergouwe Y, Moll HA, Nijman RG, Oostenbrink R. Comparison of peripheral and central capillary refill time in febrile children presenting to a paediatric emergency department and its utility in identifying children with serious bacterial infection. Arch Dis Child. (2017) 102:17–21. doi: 10.1136/archdischild-2015-308519

CrossRef Full Text | Google Scholar

44. Puskarich MA, Trzeciak S, Shapiro NI, Albers AB, Heffner AC, Kline JA, et al. Whole blood lactate kinetics in patients undergoing quantitative resuscitation for severe sepsis and septic shock. Chest. (2013) 143:1548–53. doi: 10.1378/chest.12-0878

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Nguyen HB, Rivers EP, Knoblich BP, Jacobsen G, Muzzin A, Ressler JA, et al. Early lactate clearance is associated with improved outcome in severe sepsis and septic shock. Crit Care Med. (2004) 32:1637–42. doi: 10.1097/01.CCM.0000132904.35713.A7

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Rosey AL, Abachin E, Quesnes G, Cadilhac C, Pejin Z, Glorion C, et al. Development of a broad-range 16S rDNA real-time PCR for the diagnosis of septic arthritis in children. J Microbiol Methods. (2007) 68:88–93. doi: 10.1016/j.mimet.2006.06.010

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Gorgis N, Asselin JM, Fontana C, Heidersbach RS, Flori HR, Ward SL. Evaluation of the association of early elevated lactate with outcomes in children with severe sepsis or septic shock. Pediatr Emerg Care. (2019) 35:661–5. doi: 10.1097/PEC.0000000000001021

CrossRef Full Text | Google Scholar

48. Miescier MJ, Lane RD, Sheng X, Larsen GY. Association between initial emergency department lactate and use of vasoactive medication in children with septic shock. Pediatr Emerg Care. (2019) 35:455–60. doi: 10.1097/PEC.0000000000000981

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Ryoo SM, Lee JB, Lee YS, Lee JH, Lim KS, Huh JW, et al. Lactate level versus lactate clearance for predicting mortality in patients with septic shock defined by sepsis-3. Crit Care Med. (2018) 46:e489–95. doi: 10.1097/CCM.0000000000003030

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Scott HF, Brou L, Deakyne SJ, Kempe A, Fairclough DL, Bajaj L. Association between early lactate levels and 30-day mortality in clinically suspected sepsis in children. JAMA Pediatr. (2017) 171:249–55. doi: 10.1001/jamapediatrics.2016.3681

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Jevon P. Paediatric Advanced Life Support: A Practical Guide for Nurses. 2nd ed. (2013). p. 134–56. doi: 10.1002/9781118702956.ch8

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Alobaidi R, Morgan C, Basu RK, Stenson E, Featherstone R, Majumdar SR, et al. Association between fluid balance and outcomes in critically ill children: a systematic review and meta-analysis. JAMA Pediatr. (2018) 172:257–68. doi: 10.1001/jamapediatrics.2017.4540

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Riste M, Ford S. Mortality after fluid bolus in African children with severe infection. J Intensive Care Soc. (2012) 13:356–7. doi: 10.1177/175114371201300420

CrossRef Full Text | Google Scholar

54. Levin M, Cunnington AJ, Wilson C, Nadel S, Lang HJ, Ninis N, et al. Effects of saline or albumin fluid bolus in resuscitation: evidence from re-analysis of the FEAST trial. Lancet Respir Med. (2019) 7:581–93. doi: 10.1016/S2213-2600(19)30114-6

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Carter MJ, Stilwell PA, Nijman RG, Eisen S. Identification and treatment of paediatric sepsis: getting the balance right. Arch Dis Child. (2018) 103:1185–6. doi: 10.1136/archdischild-2018-314865

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Pierrakos C, Velissaris D, Bisdorff M, Marshall JC, Vincent JL. Biomarkers of sepsis: time for a reappraisal. Crit Care. (2020) 24:287. doi: 10.1186/s13054-020-02993-5

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Stol K, Nijman RG, van Herk W, van Rossum AMC. Biomarkers for infection in children: current clinical practice and future perspectives. Pediatr Infect Dis J. (2019) 38:S7–13. doi: 10.1097/INF.0000000000002318

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Rossum AMCV, Wulkan RW, Oudesluys-Murphy AM. Procalcitonin as an early marker of infection in neonates and children. Lancet Infect Dis. (2004) 4:620–30. doi: 10.1016/S1473-3099(04)01146-6

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Van Den Bruel A, Thompson MJ, Haj-Hassan T, Stevens R, Moll H, Lakhanpaul M, et al. Diagnostic value of laboratory tests in identifying serious infections in febrile children: systematic review. BMJ. (2011) 342:d3082. doi: 10.1136/bmj.d3082

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Yo CH, Hsieh PS, Lee SH, Wu JY, Chang SS, Tasi KC, et al. Comparison of the test characteristics of procalcitonin to C-reactive protein and leukocytosis for the detection of serious bacterial infections in children presenting with fever without source: a systematic review and meta-analysis. Ann Emerg Med. (2012) 60:591–600. doi: 10.1016/j.annemergmed.2012.05.027

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Hartman ME, Linde-Zwirble WT, Angus DC, Watson RS. Trends in the epidemiology of pediatric severe sepsis. Pediatr Crit Care Med. (2013) 14:686–93. doi: 10.1097/PCC.0b013e3182917fad

PubMed Abstract | CrossRef Full Text | Google Scholar