Skip to main content

SYSTEMATIC REVIEW article

Front. Pediatr., 06 October 2022
Sec. Pediatric Hematology and Hematological Malignancies
Volume 10 - 2022 | https://doi.org/10.3389/fped.2022.921239

Exposure to heavy metals and red blood cell parameters in children: A systematic review of observational studies

  • 1Environmental Health Behaviour Lab, Instituto de Saúde Ambiental, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
  • 2Laboratório Associado TERRA, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
  • 3Unbreakable Idea Research, Cadaval, Portugal
  • 4Laboratório de Genética, Instituto de Saúde Ambiental, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal
  • 5Instituto Rocha Cabral, Lisbon, Portugal
  • 6National Public Health Center, Budapest, Hungary
  • 7State General Laboratory, Ministry of Health, Nicosia, Cyprus
  • 8Department of Environment and Health, Istituto Superiore di Sanità, Rome, Italy
  • 9Nofer Institute of Occupational Medicine, Lodz, Poland
  • 10Department of Public Health and Welfare, Finnish Institute for Health and Welfare (THL), Helsinki, Finland

Background: Mechanistic studies show that heavy metals interfere with the hematopoietic system by inhibiting key enzymes, which could lead to anemia. However, the link between children's exposure and red blood cell (RBC) parameters has been inconsistent. We aimed to summarize evidence on human studies exploring the association between exposure to lead, mercury, cadmium, arsenic, and chromium VI and RBC parameters in children.

Methods: Following the PRISMA guidelines, we searched PubMed, Scopus, and Web of Science databases for studies published between January 2010 and April 2022. Eligible papers included human observational studies that directly assessed exposure (internal dose) to the heavy metals under study and RBC parameters in participants aged ≤ 18 years. We excluded studies using hospital-based samples. Study quality was assessed using the National Institutes of Health's Quality Assessment Tools for Cohort and Cross-Sectional Studies. We synthesized the evidence using vote counting based on the direction of the relationship.

Results: Out of 6,652 retrieved papers, we included a total of 38 (33 assessing lead, four mercury, two cadmium, and two arsenic; chromium VI was not assessed in any included paper). More than half of the studies were conducted in Asia. We found evidence of a positive relationship between lead concentration and hemoglobin (proportion of studies reporting negative relationships = 0.750; 95% Confidence Interval (CI) 0.583, 0.874) and mean corpuscular hemoglobin (0.875; 95% CI 0.546, 0.986), and a positive relationship with red cell distribution width (0.000; 95%CI 0.000, 0.379). When considering only good-quality studies (24% of the Pb studies), only the relationship with hemoglobin levels remained (0.875; 95% CI: 0.546, 0.986).

Conclusion: We found evidence of a negative relationship between lead concentration and hemoglobin and mean corpuscular hemoglobin and of a positive relationship with red cell distribution width in children. We also identified a need to conduct more studies in European countries. Future studies should use standardized practices and make efforts to increase study quality, namely by conducting comprehensive longitudinal studies. Our findings support the need to take further actions to limit heavy metal exposure during childhood.

Introduction

Children are a high-risk group to heavy metals toxicity, due to increased susceptibility of their underdeveloped organ systems (1, 2). Children can be more exposed to heavy metals by spending more time outdoors compared to adults, frequent chewing of non-food items (1, 3), and higher consumption of food per kilogram of body weight (3). The main routes of exposure are the consumption of contaminated food and water, inhalation of contaminated air, and dermal absorption (1). Heavy metal toxicity in children has been associated with intellectual disability, neurocognitive, behavioral, and respiratory disorders, cancer, and cardiovascular diseases (1).

Human biomonitoring encompasses the measurement of the population's exposure to environmental pollutants and the assessment of their effects on health. The European Human Biomonitoring Initiative (HBM4EU) is a joint effort of 30 countries, the European Environment Agency, and the European Commission, co-funded under Horizon 2020. It aims to provide evidence of human exposure to chemicals and their links to health outcomes, supporting policy-making. This systematic review focuses on the five heavy metals prioritized by the HBM4EU initiative: lead (Pb), mercury (Hg), cadmium (Cd), arsenic (As), and chromium VI [Cr(VI)] (4). The prioritization process was based on the substances' hazardous properties, exposure characteristics (including environmental, consumer, and occupational exposure pathways), societal concerns, and policy needs (5).

The toxicity pathways of these heavy metals are similar, including inactivation of enzymes, generation of reactive oxygen species, weakening of antioxidant defense, and oxidative stress (6). Regarding damages to the hematopoietic system, heavy metals may induce toxicity directly to bone marrow precursors, inhibiting enzymes involved in cell division and maturation, impairment of red blood cell (RBC) transport, and immune-mediated cell destruction (7). Evidence from animal studies demonstrated that high concentrations of Pb, Hg, Cd, As, and Cr(VI) are associated with changes in some RBC parameters (812).

Globally, children (of both sexes) aged 0–9 years and female adolescents aged 15–19 years show the highest prevalence of anemia (13). The prevalence and years lived with disability attributed to anemia in children and adolescents are higher in countries with lower socio-demographic index (14). These countries, in turn, also show higher exposure to heavy metals (15).

To our knowledge, there are no systematic reviews of observational studies evaluating the relationship between these known pollutants and the hematopoietic system among children. Thus, this systematic review aims to summarize the available evidence of observational studies exploring the association between exposure (internal dose) to the HBM4EU prioritized heavy metals and RBC parameters in children.

Methods

We performed a systematic review with a quantitative synthesis using vote counting based on the direction of the relationship (16). We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (17). The protocol is provided in the Supplementary material.

Eligibility criteria

Inclusion criteria of original peer-reviewed studies were defined as follows: 1) community-based observational studies (cohort, case-control with hematological conditions, or cross-sectional studies); 2) participants aged 18 years or younger; 3) heavy metals [Pb, Hg, Cd, As, and/or Cr(VI)] internal dose assessment; 4) assessment of RBC parameters [RBC count, hematocrit, hemoglobin, mean corpuscular volume (MCV), mean corpuscular hemoglobin (MCH), mean corpuscular hemoglobin concentration (MCHC), and red cell distribution width (RDW)]; and 5) full papers published since 1 January 2010. This timeframe was applied to focus on the most up-to-date evidence available, with more standardized methods, to increase comparability between studies.

Exclusion criteria were: 1) studies not written in English or Portuguese; 2) studies including patients with pre-specified health conditions not related to the heavy metal exposure (namely cancer, renal diseases, inherited metabolic, or blood disorders); and 3) studies including participants taking pharmacological substances during the investigation.

Search strategy

We conducted a systematic review of the literature using PubMed, Scopus, and Web of Science electronic databases to identify studies regarding the relationship between Pb, Hg, Cd, As, and Cr(VI) and RBC parameters in children, published between 1 January 2010 and 12 April 2022.

The search was developed using a combination of key terms (MeSH, text word, and equivalents) related to the HBM4EU prioritized heavy metals and the RBC parameters considered relevant by the research team (Supplementary Table 1). Boolean operators (OR and AND), parentheses, quotation marks, and asterisks were used accordingly. Quotation marks were used to search for exact terms or expressions; parentheses were used to indicate a group of search terms or combine two or more groups of search terms enabling all possible combinations of sentences; asterisks (*) were used to search all words derived from the precedent inflected part. Publication date filters were applied. The full syntaxes used are presented in Supplementary Table 1. The searches were conducted in the online databases and the results were exported to a Microsoft Office Excel® document (Microsoft Corporation, Washington, USA).

Additionally, we manually checked the lists of references of all included papers to identify additional literature.

Selection process

After excluding duplicate records, all titles and abstracts of papers were screened independently by two authors (CC and RM) according to the inclusion/exclusion criteria. The screening process was performed using Microsoft Office Excel®. Full-text copies were retrieved and underwent an independent full-text review by the same two authors. Disagreements were resolved by consensus and, whenever consensus was not reached, by a third author (AV).

Data collection process

Data from each paper were extracted independently by two authors (CC and RM), using a Microsoft Office Excel® document, including the following information: title, author(s), year of publication, study design, study years, country, population, sex of participants, age (mean/median and range), type of biological sample, heavy metal/s, metal unit, metal concentration (mean/median and range), analytical method, source of exposure, RBC parameter/s, sample size (in the analysis), main findings, and adjustment variables/procedures. The two data extraction forms were compared, and disagreements were resolved by consensus.

Corresponding authors of each included paper were contacted to clarify and confirm the accuracy of the extracted data (response rate: 21%).

Study quality assessment

Study quality was assessed using the National Institutes of Health's Study Quality Assessment (NIH-QA) Tools for Observational Cohort and Cross-Sectional Studies (18). This tool guides the author to focus on key concepts to a study's internal validity and has 14 items: 1) research question; 2) study population; 3) participation rate; 4) groups recruited from the same population and uniform eligibility criteria; 5) sample size justification; 6) temporal precedence of exposure; 7) sufficient timeframe to see an effect; 8) different levels of the exposure; 9) exposure measures clearly defined, valid, reliable, and implemented consistently across all study participants; 10) exposure assessed more than once over time; 11) outcome measures clearly defined, valid, reliable, and implemented consistently across all study participants; 12) blinding of outcome assessors; 13) follow-up rate; 14) adjustment of statistical analyses. Each item was rated as “yes,” “no,” “cannot determine”, “not reported”, or “not applicable”. Considering the risk of potential for selection bias, information bias, measurement bias, or confounding, author's classified each study as having “good”, “fair”, or “poor” quality. High risk of bias translated to a rating of poor quality and low risk of bias translated to a rating of good quality (18).

The quality of all studies was independently assessed by two authors (CC and RM). Disagreements were discussed and resolved by consensus.

Synthesis methods

Results are organized by heavy metal and RBC parameters. Because of variation in study design, statistical analysis and outcome measures across studies, we synthesized the evidence using a vote counting approach based solely on the direction of effect (i.e., regardless of statistical significance or testing), as recommended by the Cochrane Foundation (16). A summary of each study's characteristics organized by heavy metal and RBC parameters is presented as Supplementary Tables.

When available data allowed, the direction of the relationship between heavy metal concentration and RBC parameter levels was defined for each study as “positive relationship”, “negative relationship”, or “conflicting results/no direction”. The categorization was done by assessing mean/median differences, correlation coefficients, odds ratios for having higher concentrations of heavy metals or RBC parameters, and/or linear regression coefficients. A “positive relationship” was reported when the heavy metal concentration was associated with higher levels of the RBC parameter (e.g., individuals with higher concentrations of a specific heavy metal presented a higher mean of an RBC parameter compared to individuals with lower concentrations, regardless of statistical significance). In contrast, a “negative relationship” was reported when the heavy metal concentration was associated with lower levels of the RBC parameter. “Conflicting results/no direction” was noted when studies reported relationships with opposite directions between subgroups (e.g., male/female, exposed/control group) or different biological samples (e.g., blood/erythrocyte), or when differences between means or correlation coefficients equal zero.

After categorizing each study, we compared the number of studies reporting negative relationships with the number of studies indicating positive relationships or conflicting results/no direction for each heavy metal and RBC parameter. An estimate of the proportion (p) of negative relationships was calculated as p = u/n, where u = number of negative relationships, and n = number of studies, along with a 95% confidence interval (CI), using Jeffrey's interval method. When the proportion is 0.5 (or the CI includes 0.5) the number of studies reporting negative and positive relationships is the same, meaning that there is no evidence of a specific relationship. A proportion higher than 0.5 means that there is evidence of a negative relationship between the two variables analyzed. Sensitivity analyses were conducted, in which we estimated the proportion of studies reporting negative relationships excluding the studies with conflicting results and excluding studies rated as having fair or poor quality. We presented the results from each study using effect direction plots.

Results

Study selection and description

Through our search, we identified 6,652 records. After excluding duplicates, we screened the title and abstract of 4,514 records and reviewed 51 full texts, of which, 35 papers met our eligibility criteria. By searching the citations of included studies (n = 1,662), we identified three additional papers meeting the inclusion criteria. Overall, we included 38 papers in this systematic review. The selection process and reasons for exclusion after full-text review are presented in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1. Study selection flow chart according to PRISMA 2020 guidelines (17).

Of the 38 included papers, 33 assessed Pb concentrations (1951), four Hg concentrations (5255), two Cd concentrations (28, 37), and two As concentrations (28, 56). We did not identify any study exploring the association between Cr(VI) and RBC parameters in children published since 2010 in the selected electronic databases and fitting with the inclusion criteria.

Study quality assessment

From the total, 11 studies were appraised as having good quality (23, 24, 30, 32, 35, 38, 41, 47, 5254), nine as fair quality (26, 27, 31, 33, 42, 45, 46, 51, 55), and 18 as poor quality (1922, 25, 28, 29, 34, 36, 37, 39, 40, 43, 44, 4850, 56). Since nearly all included studies had a cross-sectional design, the most frequent methodological limitations were the lack of temporal precedence, sufficient timeframe between exposure and outcome, and exposure being assessed only once. Another frequent limitation was the lack of sample size calculations and statistical power. The studies' quality assessment by item is presented in Figure 2. Supplementary Table 2 shows the quality assessment by study.

FIGURE 2
www.frontiersin.org

Figure 2. Quality assessment using national institutes of health's tool for observational cohort and cross-sectional studies (n = 38).

Lead

Overall, 33 papers published between 2010 and 2022 assessed the relationship between Pb concentration and RBC parameters in children (1951). More than half (n = 21) were performed in Asia (22, 23, 2527, 29, 3136, 40, 4347, 4951), five in South America (20, 21, 28, 39, 41), four in Africa (19, 24, 37, 48), two in Europe (30, 42), and one in North America (38). Regarding study design, 30 studies are cross-sectional (1923, 2533, 35, 3751), two are cross-sectional nested case-control (24, 34), and one is a cohort study (36). Regarding Pb exposure, 16 studies defined the source as environmental exposure (19, 20, 22, 25, 27, 30, 31, 33, 34, 40, 41, 43, 44, 48, 49, 51), with five related to e-waste recycling and disposal (27, 33, 40, 44, 51). Studies included a total of 36,205 participants (number of participants per study ranged between 43 and 17,486), aged between 0 and 18 years (mean/median age ranged between 1 and 12 years, among the studies reporting this data). Regarding biological samples, 26 studies reported blood Pb concentrations (1921, 2327, 2932, 35, 38, 4051), four reported both blood and erythrocyte Pb concentrations (22, 33, 36, 37), two studies reported capillary Pb concentrations (34, 39), and one study reported Pb concentration in hair (28). Pb concentrations were determined using graphite furnace atomic absorption spectrometry in 18 studies (2022, 24, 26, 3033, 36, 37, 41, 42, 44, 4649), anodic stripping voltammetry in seven (27, 34, 35, 39, 40, 43, 51), inductively coupled plasma mass spectrometry in four (25, 28, 29, 38), atomic absorption spectrometry (type not specified) in two (19, 23), flame atomic absorption spectrometry in one study (45), and one study did not specify (50).

Of the 33 studies, seven explored the relationship between Pb concentration and RBC count (Supplementary Table 3) (2022, 24, 29, 31, 40), eight studies with hematocrit (Supplementary Table 4) (2022, 24, 29, 33, 38, 40), all 33 studies with hemoglobin (Supplementary Table 5) (1951), nine studies with MCV (Supplementary Table 6) (2022, 24, 26, 29, 38, 40, 42), eight with MCH (Supplementary Table 7) (2022, 24, 26, 29, 31, 40), seven studies with MCHC (Supplementary Table 8) (2022, 24, 26, 29, 40), and five studies with RDW (Supplementary Table 9) (2022, 24, 40).

Vote counting based on the direction of the relationship between Pb concentration and RBC parameters by study and the proportion of studies reporting negative relationships between the two variables are presented in Table 1. We identified evidence of a relationship between Pb concentration and hemoglobin, MCH, and RDW. When only considering studies rated as having good quality, evidence regarding the relationship between Pb concentration and hemoglobin remained apparent.

TABLE 1
www.frontiersin.org

Table 1. Vote counting based on the direction of the relationship between lead concentration and red blood cell parameters.

Mercury

We identified four cross-sectional studies assessing the relationship between Hg concentration and RBC parameters, published between 2017 and 2021 (5255). Three studies were performed in South America (5254) and one in Asia (55). Studies included a total of 1 971 participants, with more than half (n = 1 096) from one single study (55). Participants' age ranged between 0 and 18 years (mean/median age ranged between 1 and 14 years). Participants from one study lived near industrial activities (53); from another study, participants lived near resource extractive activities (54). The other two studies did not define the source of exposure. In three studies, Hg was assessed in hair (5254), and in one study Hg was assessed in blood (55). Three studies determined Hg concentration using atomic absorption spectrometry (type not specified) (5355), while the other study used cold vapor atomic absorption spectrometry (52).

One study assessed the relationship between Hg concentration and RBC count (Supplementary Table 10) (53), two with hematocrit (Supplementary Table 11) (53, 55), three with hemoglobin (Supplementary Table 12) (5254), and one with MCHC (Supplementary Table 13) (53).

Vote counting based on the direction of the relationship between Hg concentration and RBC parameters by study and the proportion of studies reporting negative relationships between the two variables are presented in Table 2. Considering the proportion of studies reporting negative relationships, we did not identify evidence of a relationship with any RBC parameter.

TABLE 2
www.frontiersin.org

Table 2. Vote counting based on the direction of the relationship between mercury concentration and red blood cell parameters.

Cadmium

We identified two cross-sectional studies assessing the relationship between Cd -concentration and hemoglobin (Supplementary Table 14) (28, 37). Nassef et al. assessed 90 school children from Egypt with iron deficiency anemia aged between 6 and 12 years (37). Graphite furnace atomic absorption spectrometry was used to determine Cd in blood (37). Kordas et al. (28) assessed 222 preschool children from Uruguay aged between 0 and 3 years and assessed Cd concentration in hair using inductively coupled plasma mass spectrometry.

Considering the proportion of studies reporting a negative relationship between Cd concentration and hemoglobin, we did not find evidence of a relationship between the two variables (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Vote counting based on the direction of effect between cadmium concentration and red blood cell parameters.

Arsenic

Two cross-sectional studies assessed the relationship between As concentration and hemoglobin (Supplementary Table 15) (28, 56). The study performed by Kordas et al. (28) is described in the Cd section. Arsenic concentrations were assessed in hair using inductively coupled plasma mass spectrometry (28). López-Rodiguez et al. (56) assessed 40 children from Mexico aged between 6 and 12 years. Arsenic concentrations were assessed in blood using scanning electron microscopy/energy-dispersive X-ray spectrometry (56).

Similarly to Cd, we did not find evidence of a relationship between As concentration and hemoglobin (Table 4).

TABLE 4
www.frontiersin.org

Table 4. Vote counting based on the direction of effect between arsenic concentration and red blood cell parameters.

Discussion

In this systematic review, we summarize the available evidence assessing the relationship of exposure (internal dose) to heavy metals and RBC parameters in children. Understanding these relationships is essential to direct effective efforts aiming to decrease the burden associated with hematological conditions—namely anemia—in childhood. Assessment of RBC parameters is commonly available and allows clinicians to identify biochemical alterations before signs or symptoms are evident. When alterations are present, clinicians can discard heavy metal exposure as an influencing factor, especially in areas where there is an environmental concern. Also, if these parameters are defined as biomarkers of effect of heavy metal exposure, they would allow a more precise assessment of the effect on vulnerable populations, along with evaluating the impact of mitigation measures. In this systematic review, Pb is the most studied substance out of the five heavy metals prioritized by the HBM4EU initiative. The included studies had many methodological limitations, with only one-third having been rated as having good quality based on the NIH-QA Tools for Cohort and Cross-Sectional Studies. We found evidence of a relationship between Pb concentration and hemoglobin, MCV, and RDW, with only the first remaining when only considering studies rated as having good quality. Currently, the evidence between Hg, Cd, and As concentrations and RBC parameters is very scarce, which justifies the uncertainty of the estimated proportions of studies reporting negative relationships.

We did not identify any study regarding Cr(VI) published since 2010 in the selected databases, fitting the inclusion criteria. A possible explanation for this lack of studies is linked to the fact that Cr(VI) exposure is mainly occupational, with studies focusing on workers from chromium-related industries (57, 58). The RBC are a primary target for the exposure to Cr(VI) considering that this Cr-specie readily crosses the RBC membrane, whilst Cr(III) does not (59). Chromium exposure in chrome plating workers led to altered values of RBC count, Hb, and MCH (60), while in the general population hematological changes have been reported after ingestion of lethal or sublethal doses of Cr(VI) compounds (61, 62). However, because children may be exposed to Cr(VI)-polluted food, drinking water (61, 63), toys, or soils at uncontrolled hazardous waste sites (61), there is a need for studies assessing effect biomarkers of exposed children, including hematological ones.

More than half of the studies regarding Pb exposure were conducted in Asian countries. Lead toxicity is a public health concern in Asian countries (such as China and India) mainly due to the historical and current industrial pollution (64, 65), with children living near lead-contaminated industrial parks, public parks, kindergarten playgrounds, and commercial areas being at higher risk of exposure (65). Other sources of exposure are leaded paint, herbal products used in traditional medicines, jewelry, and native or traditional foods (65). Although heavy metal exposure is still a problem in Europe (65), we only identified two studies focusing on the investigation of the relationship between Pb concentration and RBC parameters in children.

The negative relationship between Pb concentration and hemoglobin found in the included observational studies is in line with the mechanistic evidence that Pb interferes with heme synthesis (66). Pb inhibits δ-aminolevulinic acid dehydratase enzyme, an enzyme that catalyzes the formation of porphobilinogen, a precursor of heme synthesis (66, 67). Pb also interferes with heme synthesis by inhibiting the enzyme ferrochelatase and, consequently, reducing the incorporation of iron into heme (66).

Lead has also been linked to other RBC parameters through other pathways, even though we did not find evidence of this relationship in children considering the included observational studies. These pathways include the pro-oxidative effect of δ-aminolevulinic acid that accumulates with the inhibition of the δ-aminolevulinic acid dehydratase enzyme and can be rapidly oxidized to generate free radicals (66). These free radicals, in turn, can cause oxidative damage to DNA fragments and membrane lipid peroxidation to RBC (66). Additionally, Pb can also promote hemolysis by inhibiting the two phosphoribosyl transferases in RBC (68).

The included studies were very heterogeneous with different aims, sample sizes, age ranges, sources of exposure, the biological sample analyzed, laboratory methods used, heavy metals concentrations, and data analysis methods, making comparisons between studies difficult. For this reason, other quantitative methods for data synthesis (e.g., meta-analysis) were not possible (16).

Most of the included studies have a cross-sectional design, not allowing to confirm the temporal precedence between the exposure and the outcome. Many studies also did not report or calculate the sample size or the statistical power of the sample, limiting the ability to extrapolate the results reported and assess the real meaning of the p-values reported. By using vote counting based on the direction of the relationship, we limited the impact that underpowered studies may have on the summarized results (16). However, our analysis provides no information on the magnitude of the relationships and does not account for differences in the relative sizes of the studies (16).

To ensure higher quality of the assessment, we included duplicate assessments at every stage, as recommended by PRISMA guidelines (17). However, additional studies could have been identified if additional databases were searched and papers in other languages were included. Yet, we mitigated this limitation by screening the references list of the included studies, by which we identified three additional studies. Since we only included published studies, publication bias cannot be ruled out. We only included papers published after 2010, to focus on the most up-to-date evidence available, which may already reflect (to a degree) the policies and regulations in place to mitigate environmental contamination by heavy metals such as efforts to reduce Hg (Minamata treaty) (3), the ban on leaded gasoline, the elimination of Pb solder from canned foods, and the ban on leaded paint (69, 70).

To date, several studies have explored the association between RBC parameters and heavy metals identified as HBM4EU priority substances in children, mainly regarding Pb exposure. However, studies were very heterogenous, most of them had a cross-sectional design, and only 11/38 studies were rated as having good quality. We found evidence of a negative relationship between Pb concentration and hemoglobin and MCH and a positive relationship with RDW. Only the relationship between Pb concentration and hemoglobin remained apparent when considering higher-quality studies. Efforts to standardize laboratory methods and biological samples used should be made to increase comparability between studies in future reviews. There is a need to conduct more studies in European countries, more comprehensive longitudinal studies (increasing study quality), as well as studies exploring the cumulative effect of different heavy metals. Our findings add to the body of evidence necessary to support the need to further limit environmental contamination by heavy metals through policies and regulations.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

CC, RM, OS, MB, HT, and AV conceptualized the manuscript. CC, RM, and AV wrote the review protocol and performed the literature search. CC and RM extracted and interpreted the data and wrote the first draft of the manuscript. All authors reviewed and made valuable contributions to the manuscript.

Funding

This work was developed under the HBM4EU initiative, funded by the European Union's Horizon 2020 Research and Innovation Programme under grant agreement no. 733032. The writing of the manuscript was also supported by funds from Fundação para a Ciência e a Tecnologia to ISAMB (ref. UIDB/04295/2020 and UIDP/04295/2020).

Acknowledgments

The authors want to express their gratitude to the authors of the included studies that validated the data extraction, increasing the accuracy of the results.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2022.921239/full#supplementary-material

References

1. Al Osman M, Yang F, Massey IY. Exposure routes and health effects of heavy metals on children. BioMetals. (2019) 32:563–73. doi: 10.1007/s10534-019-00193-5

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Landrigan PJ, Fuller R, Acosta NJR, Adeyi O, Arnold R, Basu N, et al. The lancet commission on pollution and health. Lancet. (2018) 391:462–512. doi: 10.1016/S0140-6736(17)32345-0

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Ruggieri F, Majorani C, Domanico F, Alimonti A. Mercury in children: current state on exposure through human biomonitoring studies. Int J Environ Res Public Health. (2017) 14:519. doi: 10.3390/ijerph14050519

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Ougier E, Ganzleben C, Lecoq P, Bessems J, David M, Schoeters G, et al. Chemical prioritisation strategy in the European human biomonitoring initiative (HBM4EU): development and results. Int J Hyg Environ Health. (2021) 236:113778. doi: 10.1016/j.ijheh.2021.113778

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Ougier E, Lecoq P, Rouseelle C, Ormsby J-N. Second list of HBM4EU priority substances and chemical substance group leaders for 2019–2021. Deliverable Report 45. (2018).

6. Balali-Mood M, Naseri K, Tahergorabi Z, Khazdair MR, Sadeghi M. Toxic mechanisms of five heavy metals: mercury, lead, chromium, cadmium, and arsenic. Front Pharmacol. (2021) 12:227. doi: 10.3389/fphar.2021.643972

PubMed Abstract | CrossRef Full Text

7. Ringenberg QS, Doll DC, Patterson WP, Perry MC, Yarbro JW. Hematologic effects of heavy metal poisoning. South Med J. (1988) 81:1132–9.

PubMed Abstract | Google Scholar

8. Nikolić R, Krstić N, Jovanović J, Kocić G, Cvetković TP, Radosavljević-Stevanović N. Monitoring the toxic effects of Pb, Cd and Cu on hematological parameters of Wistar rats and potential protective role of lipoic acid and glutathione. Toxicol Ind Health. (2015) 31:239–46. doi: 10.1177/0748233712469652

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Han JM, Park HJ, Kim JH, Jeong DS, Kang JC. Toxic effects of arsenic on growth, hematological parameters, and plasma components of starry flounder, Platichthys stellatus, at two water temperature conditions. Fish Aquat Sci. (2019) 22:3. doi: 10.1186/s41240-019-0116-5

CrossRef Full Text | Google Scholar

10. Massanyi P, Stawarz R, Halo M, Formicki G, Lukac N, Cupka P, et al. Blood concentration of copper, cadmium, zinc and lead in horses and its relation to hematological and biochemical parameters. J Environ Sci Health A. (2014) 49:973–9. doi: 10.1080/10934529.2014.894322

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Kovacik A, Arvay J, Tusimova E, Harangozo L, Tvrda E, Zbynovska K, et al. Seasonal variations in the blood concentration of selected heavy metals in sheep and their effects on the biochemical and hematological parameters. Chemosphere. (2017) 168:365–71. doi: 10.1016/j.chemosphere.2016.10.090

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Ali S, Bashir S, Mumtaz S, Shakir HA, Ara C, Ahmad F, et al. Evaluation of cadmium chloride-induced toxicity in chicks via hematological, biochemical parameters, and cadmium level in tissues. Biol Trace Elem Res. (2021) 199:3457–69. doi: 10.1007/s12011-020-02453-9

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Safiri S, Kolahi A-A, Noori M, Nejadghaderi SA, Karamzad N, Bragazzi NL, et al. Burden of anemia and its underlying causes in 204 countries and territories, 1990–2019: results from the global burden of disease study 2019. J Hematol Oncol. (2021) 14:185. doi: 10.1186/s13045-021-01202-2

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Kassebaum N, Kyu HH, Zoeckler L, Olsen HE, Thomas K, Pinho C, et al. Child and adolescent health from 1990 to 2015: findings from the global burden of diseases, injuries, and risk factors 2015 study. JAMA Pediatr. (2017) 171:573. doi: 10.1001/JAMAPEDIATRICS.2017.0250

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Ericson B, Hu H, Nash E, Ferraro G, Sinitsky J, Taylor MP. Blood lead levels in low-income and middle-income countries: a systematic review. Lancet Planet Health. (2021) 5:e145–53. doi: 10.1016/S2542-5196(20)30278-3

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Cochrane Handbook for Systematic Reviews of Interventions | Cochrane Training. Available online at: https://training.cochrane.org/handbook/current (accessed March 17, 2022).

17. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. (2021) 372:n71. doi: 10.1136/bmj.n71

PubMed Abstract | CrossRef Full Text

18. National Institutes of Health. Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies. (2014). Available online at: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools (accessed March 09, 2022).

19. Rasoul G, Al-Batanony M, Mahrous O, Abo-Salem M, Gabr H. Environmental lead exposure among primary school children in Shebin El-Kom District, Menoufiya Governorate, Egypt. Int J Occup Environ Med. (2012) 3:186–94.

PubMed Abstract | Google Scholar

20. Alvarez-Ortega N, Caballero-Gallardo K, Olivero-Verbel J. Low blood lead levels impair intellectual and hematological function in children from Cartagena, Caribbean coast of Colombia. J Trace Elements Med Biol. (2017) 44:233–40. doi: 10.1016/j.jtemb.2017.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Alvarez-Ortega N, Caballero-Gallardo K, Olivero-Verbel J. Toxicological effects in children exposed to lead: a cross-sectional study at the Colombian Caribbean coast. Environ Int. (2019) 130:104809. doi: 10.1016/j.envint.2019.05.003

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Dai Y, Huo X, Zhang Y, Yang T, Li M, Xu X. Elevated lead levels and changes in blood morphology and erythrocyte CR1 in preschool children from an e-waste area. Sci Total Environ. (2017) 592:51–9. doi: 10.1016/j.scitotenv.2017.03.080

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Guo Y, Deng Y-H, Ke H-J, Wu J-L. Iron status in relation to low-level lead exposure in a large population of children aged 0–5 years. Biol Trace Elem Res. (2021) 199:1253–8. doi: 10.1007/s12011-020-02253-1

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Hegazy AA, Zaher MM, Abd-El-Hafez MA, Morsy AA, Saleh RA. Relation between anemia and blood levels of lead, copper, zinc and iron among children. BMC Res Notes. (2010) 3:133. doi: 10.1186/1756-0500-3-133

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Hoang TG, Tran QP, Lo VT, Doan NH, Nguyen TH, Pham MK. Blood lead levels and associated sociodemographic factors among children aged 3–14 years living near zinc and lead mines in two provinces in vietnam. Biomed Res Int. (2021) 2021:5597867. doi: 10.1155/2021/5597867

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Keramati MR, Manavifar L, Badiee Z, Sadeghian MH, Farhangi H, Mood MB. Correlation between blood lead concentration and iron deficiency in Iranian children. Nigerian Med J. (2013) 54:325–8. doi: 10.4103/0300-1652.122353

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Khan DA, Qayyum S, Saleem S, Ansari WM, Khan FA. Lead exposure and its adverse health effects among occupational worker's children. Toxicol Ind Health. (2010) 26:497–504. doi: 10.1177/0748233710373085

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Kordas K, Queirolo EI, Ettinger AS, Wright RO, Stoltzfus RJ. Prevalence and predictors of exposure to multiple metals in preschool children from Montevideo, Uruguay. Sci Total Environ. (2010) 408:4488–94. doi: 10.1016/j.scitotenv.2010.06.041

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Kuang W, Chen Z, Shi K, Sun H, Li H, Huang L, et al. Adverse health effects of lead exposure on physical growth, erythrocyte parameters and school performances for school-aged children in eastern China. Environ Int. (2020) 145:106130. doi: 10.1016/j.envint.2020.106130

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Kutllovci-Zogaj D, Krasniqi S, Elezaj I, Ramadani N, Gjergji T, Zogaj D, et al. Correlation between blood lead level and hemoglobin level in mitrovica children. Med Arch. (2014) 68:324. doi: 10.5455/medarh.2014.68.324-328

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Li C, Ni Z, Ye L, Chen J, Wang Q, Zhou Y. Dose-response relationship between blood lead levels and hematological parameters in children from central China. Environ Res. (2018) 164:501–6. doi: 10.1016/j.envres.2018.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Liu J, McCauley L, Yan C, Shen X, Pinto-Martin J. Low blood lead levels and hemoglobin concentrations in preschool children in China. Toxicol Environ Chem. (2012) 94:423–6. doi: 10.1080/02772248.2011.628001

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Liu C, Huo X, Lin P, Zhang Y, Li W, Xu X. Association between blood erythrocyte lead concentrations and hemoglobin levels in preschool children. Environ Sci Pollut Res. (2015) 22:9233–40. doi: 10.1007/s11356-014-3992-3

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Mitchell T, Jentes E, Ortega L, Sucosky MS, Jefferies T, Bajcevic P, et al. Lead poisoning in United States-bound refugee children: Thailand-Burma border, 2009. Pediatrics. (2012) 129:e392–413. doi: 10.1542/peds.2011-1218

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Mitra AK, Ahua E, Sana PK. Prevalence of and risk factors for lead poisoning in young children in Bangladesh. J Health Popul Nutrit. (2012) 30:404–9. doi: 10.3329/jhpn.v30i4.13292

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Mohan VR, Sharma S, Ramanujam K, Babji S, Koshy B, Bondu JD, et al. Effects of elevated blood lead levels in preschool children in urban Vellore. Indian Pediatr. (2014) 51:621–5. doi: 10.1007/s13312-014-0464-2

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Nassef YE, Shady MA, Mansour M, Hamed MAA. Trace elements, heavy metals and vitamins in Egyptian school children with iron deficiency anemia. J Pediatr Biochem. (2014) 4:171–9. doi: 10.1055/s-0036-1586478

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Ngueta G. Assessing the influence of age and ethnicity on the association between iron status and lead concentration in blood: results from the Canadian health measures survey (2007–2011). Biol Trace Elem Res. (2016) 171:301–7. doi: 10.1007/s12011-015-0547-5

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Queirolo EI, Ettinger AS, Stoltzfus RJ, Kordas K. Association of anemia, child and family characteristics with elevated blood lead concentrations in preschool children from Montevideo, Uruguay. Arch Environ Occup Health. (2010) 65:94–100. doi: 10.1080/19338240903390313

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Rawat PS, Singh S, Zahid M, Mehrotra S. An integrated assessment of lead exposure in children: Correlation with biochemical and haematological indices. J Trace Elements Med Biol. (2021) 68:126835. doi: 10.1016/j.jtemb.2021.126835

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Rondó PHC, Conde A, Souza MC, Sakuma A. Iron deficiency anaemia and blood lead concentrations in Brazilian children. Trans R Soc Trop Med Hyg. (2011) 105:525–30. doi: 10.1016/j.trstmh.2011.05.012

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Ruiz-Tudela L, Vázquez-López MA, García-Escobar I, Cabrera-Sevilla JE, Gómez-Bueno S, Martín-Gonzalez M, et al. Blood lead level in a paediatric population of south-eastern Spain and associated risk factors. Int J Environ Res Public Health. (2021) 18:1825. doi: 10.3390/ijerph18041825

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Reddy YS, Pullakhandam R, Krishna KVR, Kumar PU, Kumar BD. Lead and essential trace element levels in school children: a cross-sectional study. Ann Hum Biol. (2011) 38:372–7. doi: 10.3109/03014460.2010.536166

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Wang H, Huang P, Zhang R, Feng X, Tang Q, Liu S, et al. Effect of lead exposure from electronic waste on haemoglobin synthesis in children. Int Arch Occup Environ Health. (2021) 94:911–8. doi: 10.1007/s00420-020-01619-1

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Wang H, Shi H, Chang L, Zhang X, Li J, Yang Y, et al. Association of blood lead with calcium, iron, zinc and hemoglobin in children aged 0–7 years: a large population-based study. Biol Trace Elem Res. (2012) 149:143–7. doi: 10.1007/s12011-012-9413-x

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Ye J, Du C, Wang L, Li Z, Huang S, Wang H, et al. Relationship of Blood Levels of Pb with Cu, Zn, Ca, Mg, Fe, and Hb in Children aged 0~6 Years from Wuhan, China. Biol Trace Elem Res. (2015) 164:18–24. doi: 10.1007/s12011-014-0200-8

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Zolaly MA, Hanafi MI, Shawky N, El-Harbi K, Mohamadin AM. Association between blood lead levels and environmental exposure among Saudi schoolchildren in certain districts of Al-Madinah. Int J Gen Med. (2012) 5:355–64. doi: 10.2147/IJGM.S28403

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Moawad EMI, Badawy NM, Manawill M. Environmental and occupational lead exposure among children in Cairo, Egypt: a community-based cross-sectional study. Medicine. (2016) 95:e2976. doi: 10.1097/MD.0000000000002976

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Shah F, Kazi TG, Afridi HI, Baig JA, Khan S, Kolachi NF, et al. Environmental exposure of lead and iron deficit anemia in children age ranged 1–5 years: a cross sectional study. Sci Total Environ. (2010) 408:5325–30. doi: 10.1016/j.scitotenv.2010.07.091

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Banga U, Sharma PK, Gupta J, Banga A, Agrawal P, Mehta A, et al. Paediatric blood lead levels and its correlation with anaemia: a study from central India. J Clin Diagn Res. (2021) 15:SC09–12. doi: 10.7860/JCDR/2021/48930.15297

CrossRef Full Text | Google Scholar

51. Irawati Y, Kusnoputranto H, Achmadi UF, Safrudin A, Sitorus A, Risandi R, et al. Blood lead levels and lead toxicity in children aged 1–5 years of Cinangka Village, Bogor Regency. PLoS ONE. (2022) 17:e0264209. doi: 10.1371/journal.pone.0264209

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Kempton JW, Périssé ARS, Hofer CB, Vasconcellos ACS, Viana PVS, Lima MO, et al. An assessment of health outcomes and methylmercury exposure in munduruku indigenous women of childbearing age and their children under 2 years old. Int J Environ Res Public Health. (2021) 18:10091. doi: 10.3390/ijerph181910091

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Manjarres-Suarez A, Olivero-Verbel J. Hematological parameters and hair mercury levels in adolescents from the Colombian Caribbean. Environ Sci Pollut Res. (2020) 27:14216–27. doi: 10.1007/s11356-020-07738-z

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Weinhouse C, Ortiz EJ, Berky AJ, Bullins P, Hare-Grogg J, Rogers L, et al. Hair mercury level is associated with anemia and micronutrient status in children living near artisanal and small-scale gold mining in the Peruvian Amazon. Am Jo Trop Med Hyg. (2017) 97:1886–97. doi: 10.4269/ajtmh.17-0269

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Cho KY. Association of blood mercury levels with the risks of overweight and high waist-to-height ratio in children and adolescents: data from the Korean national health and nutrition examination survey. Children. (2021) 8:1087. doi: 10.3390/children8121087

PubMed Abstract | CrossRef Full Text | Google Scholar

56. López-Rodríguez G, Galván M, González-Unzaga M, Hernández Ávila J, Pérez-Labra M. Blood toxic metals and hemoglobin levels in Mexican children. Environ Monit Assess. (2017) 189:179. doi: 10.1007/s10661-017-5886-6

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Tchounwou PB, Yedjou CG, Patlolla AK, Sutton DJ. Heavy metal toxicity and the environment. EXS. (2012) 101:133–64. doi: 10.1007/978-3-7643-8340-4_6

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Santonen T, Porras SP, Bocca B, Bousoumah R, Duca RC, Galea KS, et al. HBM4EU chromates study: overall results and recommendations for the biomonitoring of occupational exposure to hexavalent chromium. Environ Res. (2022) 204:111984. doi: 10.1016/J.ENVRES.2021.111984

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Santonen T, Alimonti A, Bocca B, Duca RC, Galea KS, Godderis L, et al. Setting up a collaborative European human biological monitoring study on occupational exposure to hexavalent chromium. Environ Res. (2019) 177:108583. doi: 10.1016/j.envres.2019.108583

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Ateeq M, Rehman HU, Zareen S, Khan FU, Rehman A, Zahoor B, et al. Effect of hexavalent chromium on hematological parameters in chrome plating workers. J Entomol Zool Stud. (2016) 4:247–8.

Google Scholar

61. Agency for Toxic Substances and Disease Registry. Toxicological Profile for Chromium. Atlanta, GA: Agency for Toxic Substances and Disease Registry (2012).

62. Ray RR. Adverse hematological effects of hexavalent chromium: an overview. Interdiscip Toxicol. (2016) 9:55–65. doi: 10.1515/intox-2016-0007

PubMed Abstract | CrossRef Full Text | Google Scholar

63. European Food Safety Authority. Scientific opinion on the risks to public health related to the presence of chromium in food and drinking water. EFSA J. (2014) 12:3595. doi: 10.2903/j.efsa.2014.3595

CrossRef Full Text | Google Scholar

64. Pryce O. Metallurgy in Southeast Asia. In: Selin H, , editor. Encyclopaedia of the History of Science, Technology, and Medicine in Non-Western Cultures. Dordrecht: Springer (2016). p. 3144–3159. doi: 10.1007/978-94-007-7747-7_10178

CrossRef Full Text | Google Scholar

65. Obeng-Gyasi E. Sources of lead exposure in various countries. Rev Environ Health. (2019) 34:25–34. doi: 10.1515/reveh-2018-0037

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Ahamed M, Siddiqui MKJ. Low level lead exposure and oxidative stress: current opinions. Clin Chim Acta. (2007) 383:57–64. doi: 10.1016/j.cca.2007.04.024

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Huang C-C, Yang C-C, Liu T-Y, Dai C-Y, Wang C-L, Chuang H-Y. Use of generalized additive model to detect the threshold of δ-aminolevulinic acid dehydratase activity reduced by lead exposure. Int J Environ Res Public Health. (2020) 17:5712. doi: 10.3390/ijerph17165712

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Baranowska-Bosiacka I, Dziedziejko V, Safranow K, Gutowska I, Marchlewicz M, Dołegowska B, et al. Inhibition of erythrocyte phosphoribosyltransferases (APRT and HPRT) by Pb2+: a potential mechanism of lead toxicity. Toxicology. (2009) 259:77–83. doi: 10.1016/j.tox.2009.02.005

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Lanphear BP, Dietrich KN, Berger O. Prevention of lead toxicity in US children. Ambul Pediatrics. (2003) 3:27–36. doi: 10.1367/1539-4409(2003)003<0027:POLTIU>2.0.CO;2

PubMed Abstract | CrossRef Full Text | Google Scholar

70. He K, Wang S, Zhang J. Blood lead levels of children and its trend in China. Sci Total Environ. (2009) 407:3986–93. doi: 10.1016/j.scitotenv.2009.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: HBM4EU, biomonitoring, hematology, erythrocyte indices, child

Citation: Capitão C, Martins R, Santos O, Bicho M, Szigeti T, Katsonouri A, Bocca B, Ruggieri F, Wasowicz W, Tolonen H and Virgolino A (2022) Exposure to heavy metals and red blood cell parameters in children: A systematic review of observational studies. Front. Pediatr. 10:921239. doi: 10.3389/fped.2022.921239

Received: 04 July 2022; Accepted: 12 September 2022;
Published: 06 October 2022.

Edited by:

Ozgur Karcioglu, Taksim Training and Research Hospital, Turkey

Reviewed by:

Anton Rets, The University of Utah, United States
Mariana Salgado-Bustamante, Autonomous University of San Luis Potosi, Mexico

Copyright © 2022 Capitão, Martins, Santos, Bicho, Szigeti, Katsonouri, Bocca, Ruggieri, Wasowicz, Tolonen and Virgolino. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Carolina Capitão, carolinacapitao@medicina.ulisboa.pt

Download