Skip to main content


Front. Psychiatry, 03 December 2020
Sec. Psychopathology
This article is part of the Research Topic Coronavirus Disease (COVID-19): Psychological, Behavioral, Interpersonal Effects, and Clinical Implications for Health Systems View all 204 articles

Psychological Symptoms and Behavioral Changes in Children and Adolescents During the Early Phase of COVID-19 Quarantine in Three European Countries

  • 1Católica Research Centre for Psychological - Family and Social Wellbeing, School of Human Sciences, Universidade Católica Portuguesa, Lisbon, Portugal
  • 2Department of Philosophy, Social Sciences and Education, Università degli Studi di Perugia, Perugia, Italy
  • 3Health Psychology Department, Universidad Miguel Hernández, Elche, Spain

The coronavirus disease (COVID-19) pandemic forced the home confinement of the majority of population around the world, including a significant number of children and adolescents, for several weeks in 2020. Negative psychological effects have been identified in adults, but research about the impact of this type of social distancing measure on children and adolescents is scarce. The present study aimed to describe and compare the immediate psychological and behavioral symptoms associated with COVID-19 quarantine in children and adolescents from three southern European countries with different levels of restrictions (Italy, Spain, and Portugal). Parents of 1,480 children and adolescents (52.8% boys) between 3 and 18 years old (M = 9.15, SD = 4.27) participated in the study. An online survey using snowball sampling techniques was conducted during 15 days between March and April 2020, representing the early phase of the quarantine associated with COVID-19 outbreak. Parents answered questionnaires about sociodemographic data, housing conditions, immediate psychological responses during quarantine (e.g., anxiety, mood, sleep, and behavioral alterations), patterns of use of screens, daily physical activity, and sleep hours before and during the quarantine. The results revealed an increase in children's psychological and behavioral symptoms, increased screen-time, reduced physical activity, and more sleep hours/night. Italian children presented less psychological and behavioral symptoms compared with Portuguese and Spanish children. In general, hierarchical multiple regressions revealed that having an outdoor exit in the house (e.g., garden, terrace) contributed to lower levels of psychological and behavioral symptomatology. Future studies are needed to identify family and individual variables that can better predict children and adolescents' well-being during and after quarantine. Recommendations for families and implications for practice are discussed.


Evidence regarding experiences from past outbreaks reveals that quarantine can create a substantial strain on the population and create mental health problems [e.g., (1, 2)]. However, most studies have been focused on adult populations and the psychological impact of quarantine on children remains unclear. The worldwide coronavirus disease (COVID-19) pandemic has caused several governments in Europe to determine quarantine and home confinement. However, restrictions have been quite diverse across different European countries, and the impact of these differences on young people's mental health remains unknown. This present public health crisis and the risk of second-wave outbreaks make it urgent to investigate the psychological effects of this type of social distancing measure on children and adolescents, taking into account the different levels of restrictions established in three European countries: Italy, Spain, and Portugal.

Quarantine is a public health measure that includes the restriction of activities or the separation of healthy individuals who may have been exposed to an infectious agent or disease with the aim of monitoring symptoms and ensuring the early identification of cases (3). Throughout Europe, the severity and timing of restriction measures has differed from country to country. The point at which social distancing was enforced occurred at different dates in each country based on the infection curve. Italy, the first European Union nation to put its entire population under quarantine, closed schools on 5 March (24 February in Lombardy), 16 days after the first 50 cases of COVID-19 were reported. On the other hand, Spain and Portugal closed schools on 13 March, 4 and 12 days after the first 50 cases, respectively.

Another important difference pertains the quarantine status. In general, compliance with quarantine may be voluntary or ensured by governmental orders. Italy and Spain ordered mandatory quarantine, whereas Portugal ordered voluntary quarantine (more specifically, a “general duty of home confinement”). More importantly, no studies to date have examined whether mandatory vs. voluntary quarantine has differential effects on psychological outcomes. However, it has been suggested, for example, that the perception that others may benefit from one's situation can help to endure stressful situations and this might be the case for home-based quarantine (2).

Although the employment of lockdown practices is highly necessary to control the spread of COVID-19, public health organizations worldwide have noted the importance of supporting mental and psychosocial well-being during social isolation and restriction of movements imposed to people during quarantine (4). Consistent with these recommendations, studies from previous epidemics and recent research on COVID-19 unequivocally demonstrate the negative psychological impact of quarantine and home confinement in the general population [e.g., (2, 58)]. A recent review of evidence indicates several negative psychological effects associated with quarantine, including posttraumatic stress, depression, anxiety, confusion, and anger (2). This review also suggests that quarantine and home confinement may also have long-lasting psychological effects. Other studies report emotional reactions to social distancing such as fear, isolation, loneliness, and insomnia, highlighting boredom as the greatest emotional disincentive to compliance with quarantine (1).

Experience with previous quarantine outbreaks highlights the results of prolonged quarantine periods in aspects that may indirectly influence mental health, including loss of income during quarantine, loss of job after quarantine, and disturbances in family relationships (1, 9). Some have argued that this type of disease-containment measures could cause tensions within households, inhibiting family rituals, norms, and values, that may contribute to regulate family functioning in times of crisis (1, 10).

Public health organizations and mental health experts have also acknowledged the potential adverse psychological effects of quarantine on children and adolescents [e.g., (1113)]. Children have unique and specific needs that are disturbed by COVID-19 quarantine that includes not only home confinement but the inability to go to school and interact with peers and teachers (14). However, significantly less evidence exists regarding the psychological impact of quarantine in children and adolescents. One of the few studies concerning this population (10) found that children who had been quarantined exhibited increased rates of posttraumatic stress symptoms compared with children who were not quarantined, indicating that home confinement can be traumatizing to a significant number of children. A recent study conducted in China in February 2020 with children aged 3–18 years concluded that the most frequent psychological and behavioral problems included clinginess, distraction, irritability, and fear of asking questions about the outbreak (12).

Some authors have suggested that stressors such as lengthy confinement, fear of infection, boredom, inadequate information, lack of contact with peers and significant others, and family economic stress, can have even more significant and enduring effects on young people. The lack of personal space at home and other housing conditions can also have a significant impact on the mental health of children and parents based on previous evidence (15). For example, housing conditions, such as small apartments with limited views and indoor qualities, were related to depressive symptoms in a recent original study that investigated the effects of housing environment characteristics on mental health during the COVID-19 lockdown using a large sample of Italian university students (16). In addition, psychosocial stress and lifestyle alterations caused by home confinement could exacerbate the negative consequences on a child's physical and mental health, which may create a vicious circle (12, 17). Children's particular vulnerabilities to trauma (18), adverse events (12), and environmental risks (17) make them an important group to study the negative psychological effects of COVID-19 quarantine. Despite its importance, this topic has been somehow neglected in the literature and young people's reactions during epidemics remains understudied. This is unfortunate given that understanding young people's behaviors and emotions is essential to (1) accurately address their needs and (2) develop contextually relevant material and preventive actions for children and adolescents that may help to protect their mental health during quarantine measures. The abovementioned research indicates that the psychological effect of quarantine can be long lasting (2), emphasizing the need to ensure that effective mitigation measures are developed as part of the quarantine planning process. Therefore, there is a global and urgent responsibility of parents and governments to guarantee that children and adolescents are protected from the psychological and physical impact of COVID-19 quarantine (17).

The Current Study

This study aims to compare immediate psychological effects of COVID-19 quarantine in children and adolescents from three southern European countries with different levels of restrictions: Italy, Spain, and Portugal. The specific objectives are (a) to identify differences in sociodemographic variables and housing conditions across countries; (b) to describe child immediate psychological and behavioral alterations (anxiety, mood, sleep, behavioral, feeding, and cognitive alterations) during COVID-19 quarantine and compare across countries; (c) to describe child habits (use of screens, daily physical activity, and hours of sleep) before and after quarantine and explore differences across countries; and (d) to identify explanatory factors for the psychological and behavioral alterations during quarantine by considering housing conditions.

Materials and Methods


Parents (M = 42.26 years, SD = 5.92) of a total of 1,480 children and adolescents between 3 and 18 years old (M = 9.15, SD = 4.27) from Italy (n = 712 from 94 cities), Spain (n = 431 from 84 cities), and Portugal (n = 335 from 94 cities) participated in the study. The majority of respondents were women (87.8%) and reported a monthly family income between 2,000 and 2,999 euros (31.8%). Table 1 presents the characteristics of the sample and its equivalence by country. No differences were observed across countries with regard to parents' gender and age, monthly family income, and children' gender. Spanish children are younger than Italian children (but with a small effect).


Table 1. Sample characteristics and equivalence by country.

Significant differences (large effect) on housing conditions were reported between participants from the three countries. Portuguese homes are larger (more square meters) than Italian or Spanish homes. Regarding exits to the outside, Italian houses more frequently have gardens than Spanish houses, and houses with a terrace are more frequently found in Spain compared with Portugal. Houses with only windows or a balcony are more frequently noted in Spain and Portugal compared with Italy. Greater than half of the participants (58.2%, n = 862) had an outdoor exit. In general, most of the Italian children live in houses with a garden (51.7%), and most Spanish and Portuguese children have a balcony (33.5 and 38.6%, respectively).

The number of people living at home during quarantine is significantly lower in Spain compared with Italy and to Portugal. The frequency of people who do not leave the house (unless they have to buy groceries or other allowed activities) or who still work outside the home is not different among the three countries.


A cross-sectional design was used to assess the psychological symptoms and behavioral changes in children and adolescents during the early phase of the quarantine associated with COVID-19 from parents' perspective. Participants were recruited via social networks, including social media platforms (Facebook, LinkedIn, Instagram) and researchers' acquaintances (e-mail), using a snowball sampling strategy. An online survey was created ad-hoc and distributed in each country (via Qualtrics or GoogleForms) and data were collected for 15 days between March and April 2020. Before completing the survey, information about the objectives of the study was provided, and informed consent was requested. Each participant took ~10 min to complete the survey, and no compensation was provided. The study was approved by the Ethics Committees of the authors' institutions.


The survey was constructed initially in English and ad-hoc for this study and included multiple choice and rating scale questions. The final version was pilot-tested by 10 families with children aged 3–18 years per country. Comprehension was adequate, and no changes were required in the survey.

A general questionnaire included sociodemographic questions (e.g., participant age and gender, marital status, family income, and number of children) and questions about housing conditions (e.g., square meters and outdoor exits) and specifics about the period of quarantine (e.g., number of people living in at home during quarantine).

The questionnaire about children's immediate psychological responses during quarantine (“During the past few days, compared to before quarantine, to what extent have you noticed that your child…”) included 10 items related to “anxiety” (e.g., “is worried” and “is afraid of COVID-19 infection”), 6 items related to “mood” (e.g., “is sad”), 5 items related to “sleep” (e.g., “is afraid to sleep alone”), 6 items related to “behavioral alterations” (e.g., “argues with the rest of the family”), 2 items related to “feeding” (e.g., “eats a lot”), and 2 items related to “cognitive alterations” (e.g., “has difficulty concentrating”). Each item had two possible responses (yes or no). Ordinal alpha in the current sample is excellent (α = 0.96). Evidences of validity were found between the subscales and measures of anxiety (SCAS-P) and depression (SMFQ-P). Moderate correlations were observed between depression (SMFQ-P) and mood (ρ = 0.39) as well as between anxiety (SCAS-P) and anxiety (ρ = 0.46).

The questionnaire about children' habits included items about the patterns of use of screens (e.g., “Before quarantine, how long did your child use screens such as iPads, TVs, mobiles, or computers daily?”) and daily physical activity (e.g., “During quarantine, how much time did your child spend daily on physical activity?”) before and during the quarantine with six answer options (from “<30 min” to “more than 180 min”). Parents were also asked about the number of hours their children sleep during the weekdays (before and during the quarantine).

Data Analyses

All calculations were performed using SPSS 26 for Mac. The Kolmogorov-Smirnov test was used to assess the normality of the data. Given the lack of normality in the continuous variables, non-parametric tests were used. Ordinal alpha, which is considered the most appropriate for ordinal items is calculated. Kruskal-Wallis tests were performed to compare continuous variables across countries (Italy, Spain, and Portugal) and Chi-squared tests were used to compare proportions across these groups. Differences were considered statistically significant when the p < 0.05. Bonferroni corrections applied to p-values were used to reduce the risk of type I errors post-hoc analysis of Chi-squared tests. In cross-tables, Chi-square post-hoc tests using adjusted residuals were calculated (19). Epsilon-squared (ε2) was used as an effect size, where small effect sizes ranged from 0.01 to <0.08, medium effect sizes ranged from 0.08 to <0.26, and large effect sizes ranged from ≥0.26. Cramer's V was calculated as a measure of association between multicategorical variables, and interpreted as follows: >0.25 very strong, >0.15 strong, >0.10 moderate, >0.05 weak, and > 0 none or very weak (20).

The Wilcoxon matched-pair signed rank test was used to evaluate change in patterns of use of screens, daily physical activity, and hours of sleep before and during the quarantine within a group. The effect size of the statistically significant differences was estimated using Rosenthal's r, which is interpreted as follows: 0.10 = small, 0.30 = medium, and 0.50 = large (21). Mann-Whitney U-test was performed to analyze the relationship between outdoor exit (yes/no) and main outcomes.

Spearman correlations were calculated to analyze the relationship between continuous variables included in the hierarchical regression analyses. To test the association between having more symptoms in these six areas (“anxiety,” “mood,” “sleep,” “behavioral alterations,” “feeding,” and “cognitive alterations”) during quarantine and housing conditions, six separate hierarchical regression analyses were run using anxiety, mood, sleep, behavioral alterations, feeding, and cognitive alterations as dependent variables. Children's sex and age were included in a first step as covariates. Outdoor exit (yes/no), number of people living at home during quarantine, and square meters home were included in the second step as independent variables. Having a garden or terrace was recoded as 1 (= outdoor exit). Options “only windows,” “balcony,” and “other exits” were coded as 0 (no outdoor exit). Interactions between variables were analyzed in step 3. Continuous variables were mean centered to avoid multicollinearity.


The present study aimed to compare immediate psychological and habit changes during COVID-19 quarantine in children and adolescents from Italy, Spain, and Portugal. We also intended to identify explanatory factors for the psychological and behavioral symptoms based on housing conditions.

Immediate Psychological and Behavioral Symptoms in Children During Quarantine Across Countries

Table 2 presents parents' perception of their children's anxiety, mood, sleep, behavioral, feeding, and cognitive alterations during quarantine and differences across countries. Post-hoc analysis revealed significant differences across countries in all dimensions in total scores (small effects) and in almost all specific items that contribute to each dimension (with small and medium effects), which are detailed in Table 2.


Table 2. Differences across countries in children's psychological and behavioral symptoms during quarantine (parents' perceptions).

In general, children from Italy had significantly lower levels of anxiety, sleep, feeding, and cognitive alterations compared with children from Spain and Portugal. Portuguese children presented significantly more mood alterations than Spanish children. Spanish children presented significantly more behavioral alterations than both Italian and Portuguese children.

Of note, approximately one-third of children are restless, nervous, worried, uneasy, and anxious. Additionally, 27.2% are afraid of COVID-19 infection, and Portuguese children are significantly more afraid of infection compared with the other children. Greater than half of the samples are bored (52.2%) and 1/3 feel lonely, especially Portuguese and Italian children. Considering behavioral alterations, >40% of children are irritable (especially the Portuguese and Spanish), and ~1/3 argues with the rest of the family more than before home confinement.

Children's Patterns of Use of Screens, Daily Physical Activity, and Hours of Sleep Before and During Quarantine

Significant differences were found before and during quarantine in all habits analyzed both in the total sample and in the samples of each country. Table 3 presents children's patterns of use of screens, daily physical activity, and hours of sleep during weekdays before and during quarantine and differences across countries.


Table 3. Children's patterns of use of screens, daily physical activity, and hours of sleep before and during the quarantine and differences across countries (parents' perceptions).

Daily use of screens noticeably increased during quarantine (z = −30.34, p < 0.001, r = 0.78). Before quarantine, most children used screens from 30 to 60 min/day (35.7%), whereas the majority of children had more than 3 h of screen time during quarantine (30.1%). This pattern is roughly the same in all countries (Italy: z = −20.33, p < 0.001, r = 0.76; Spain: z = −16.91, p < 0.001, r = 0.81; Portugal: z = −14.90, p < 0.001, r = 0.79). Differences across countries (medium effect) before quarantine were found only for the use of screens for <30 min; specifically, Spanish children more frequently used screens <30 min/day. However, during quarantine, more differences were noted across countries (see Table 3 for detailed post-hoc analyses); for example, Italian children use screens less (<30 min or between 30 and 60 min), whereas Spanish children significantly use screens more frequently (between 120 and 180 min).

Regarding patterns of physical activity, large effects were found when comparing changes before and during quarantine, for all the sample (z = −25.56, p < 0.001, r = 0.66) and for each country in particular (Italy: z = −16.08, p < 0.001, r = 0.60; Spain: z = −15.45, p < 0.001, r = 0.74; Portugal: z = −12.48, p < 0.001, r = 0.66). Before quarantine, most children practiced 30 to 60 min of physical activity daily (33.1%). However, in quarantine, most children experienced <30 min of physical activity (53%). Significant differences across countries (medium effects) were also found (see Table 3). For example, before quarantine, Spanish children more frequently practiced physical activity between 120 and 180 min. During quarantine, Portuguese children less frequently participated in <30 min of physical activity.

The mean number of hours of sleep during weekdays significantly increased during home confinement for the total sample (z = −11.75, p < 0.001, r = 0.30) and for each country (Italy: z = −8.78, p < 0.001, r = 0.32; Spain: z = −3.02, p < 0.001, r = 0.14; Portugal: z = −8.74, p < 0.001, r = 0.46). Additionally, significant differences (small effects) were found across the countries. Italian children slept significantly less than Spanish and Portuguese children both before and during quarantine. Before quarantine (but not during this period), Spanish children slept more than Portuguese children.

Housing Conditions and Children's Psychological and Behavioral Symptoms During Quarantine

Table 4 presents the descriptive statistics and correlations among children's age, housing conditions, and psychological and behavioral symptoms in study. The size of the home (square meters) was unrelated to the outcome variables. Fewer people at home during quarantine were significantly related to having more mood symptoms, and child's age was significantly related to less symptoms of sleep and behavioral alterations. Children who did not have an outdoor exit at home (garden or terrace) were significantly more likely to present anxiety (U = 249,292, z = −2.13, p < 0.05, r = 0.05), sleep (U = 234,875.50, z = −4.59, p < 0.001, r = 0.11), behavioral (U = 244,057, z = −2.85, p < 0.01, r = 0.07), feeding (U = 245,348, z = −3.28, p ≤ 0.001, r = 0.08), and cognitive alterations (U = 251,278.50, z = −2.35, p < 0.05, r = 0.06) during home confinement compared with those who had an outdoor exit. Compared with girls, boys presented significantly increased levels of anxiety (U = 97,292.50, z = −3.82, p < 0.001, r = 0.09), mood (U = 95,936.50, z = −4.11, p < 0.001, r = 0.10), sleep (U = 99,242, z = −4.02, p < 0.001, r = 0.10), behavioral (U = 98,791.50, z = −3.61, p < 0.001, r = 0.09), feeding (U = 108,639.50, z = −2.09, p < 0.05, r = 0.05), and cognitive alterations (U = 103,479, z = −3.30, p ≤ 0.001, r = 0.08).


Table 4. Means, standard deviations, and correlations with confidence intervals.

Hierarchical multiple regression was performed to examine whether housing conditions (outdoor exit and number of people at home) predicted children's psychological and behavioral symptoms during quarantine after controlling for the influence of children's age and sex. Because the square meters of the home did not have a significant correlation with psychological or behavior symptoms, it was not included in the models. As shown in Table 5, both the presence of an outdoor exit and the number of people at home were significant predictors of symptomatology. Specifically, having an outdoor exit at home (garden or terrace) was a significant predictor of lower levels of all symptoms, except mood alterations. This was the only significant predictor of lower levels of anxiety, sleep, and cognitive alterations. The number of people living at home was another housing condition with a significant contribution to children's symptoms, particularly mood alterations. These results indicate that the lesser the number of people at home the higher the levels of mood alterations. After controlling for the effects of child age and sex, housing conditions explained between 1.2 and 3.9% of variance. Finally, age and sex were also significant predictors of children's symptoms. To be male was a significant predictor of anxiety symptoms, feeding, and behavior alterations and to be younger was a significant predictor of behavior and sleep alterations.


Table 5. Results from hierarchical regression examining the association between psychological and behavioral symptoms during quarantine and housing conditions, controlling for children's sex and age.


Despite previous research demonstrating the psychological impact of the imposition of quarantine in past pandemics, few studies have investigated the negative effects on children's and adolescents' mental health. The present study aimed to identify and compare immediate psychological and behavioral effects of COVID-19 quarantine in children and adolescents from Italy, Spain, and Portugal.

Child Habits and Psychological and Behavioral Alterations During COVID-19 Quarantine

According to parents' perceptions, greater than half of the children feel bored, 40% were irritable, and approximately one-third feels more lonely, restless, nervous, worried, anxious, and uneasy, compared with the period before quarantine. This increase in symptomatology was expected based on past evidence regarding children and adults who experienced previous quarantine outbreaks (2) and recent studies on adults from China during the actual COVID-19 pandemics [e.g., (23)]. Parents also reported that their children argue more with the rest of the family during home confinement. Evidence shows that quarantine has adverse psychological effects on adults' mental health, causing depression, stress, anger, and boredom (e.g., 1,2) and that confinement of people at home can produce tensions within households (1, 10). Considering that parents in COVID-19 quarantine may be particularly distressed, these results might reflect less parental emotional availability to support children, increasing inadequate parenting practices, such as hostility or inconsistent discipline (24, 25). Consequently, children's and adolescents' symptomatology may increase, as well as the probability of arguing with family members. These findings seem to highlight the concerns from international health organizations regarding the impact of COVID-19 quarantine on children and adolescents' mental health and family relationships (4, 26, 27).

Children from the three countries have consistently changed their habits during home confinement, which can also explain the increase in children's psychological and behavioral symptoms. Most children before quarantine used screens (e.g., tablets, TVs, mobiles, computers) <1 h. During home confinement, children are using screens for more than 3 h, which is definitely higher than levels recommended by international health organizations. For example, the WHO (28) suggests limiting screen time to 1 h for children under 6 years, and diverse studies have revealed associations between screen time and lower psychological well-being among children and adolescents (e.g., 28). In addition, physical activity was reduced in children given that greater than half now practice <30 min. However, before quarantine, children practiced between 30 and 60 min. This level is clearly below the WHO recommendations (28, 29) for at least 180 min of moderate to vigorous physical activity for children under 5 years and at least 60 min for children aged 5–17 years.

On the other hand, the results showed a positive change in children habits during quarantine, indicating an increase in the amount of sleep on weekdays. On average, children are sleeping 9.51 h per night (0.40 h more than before quarantine), which is more in accordance to WHO (28) and American Academy of Sleep Medicine (30) guidelines (10–13 h of good quality sleep for children under 5 years; 9–12 h for children 5–12 years; 8–10 h for adolescents). However, if this increase in sleep hours is associated with delays in bedtime (frequently related to the use of screen-based activities) (31), it could be problematic. This notion should be explored in future studies.

Differences Across Italy, Spain, and Portugal

Considering differences of social distancing measures used in the three countries (i.e., mandatory quarantine in Italy and Spain vs. voluntary quarantine/duty of home confinement in Portugal), it was hypothesized that Italian and Spanish children would present higher psychological and behavioral symptoms associated with home confinement compared with Portuguese children. However, Italian children presented less symptoms of anxiety, as well as less sleep, feeding, and cognitive alterations compared with the other two groups of children. One possible explanation for this surprising result might be related to the fact that schools in Italy closed 8 days before schools in Spain and Portugal. Given that the data collection period occurred simultaneously in the three countries, the results may indicate that Italian children had more time to adjust to and accept the situation of home confinement and find strategies to cope with it (similar to a grief process) (32). Nevertheless, longitudinal studies are needed to explore this hypothesis. Another possible explanation might be associated with differences across countries in housing conditions and screen time. Greater than half of the Italian children live in homes with a garden, and these children spend less time on screens. On the other hand, although Portuguese children are living in larger houses, most Portuguese and Spanish children do not have outdoor exits, such as gardens or terraces, thus limiting available space for outdoor activities. Taken together, these results may suggest that Italian children are probably having more “quality play time” and engaging in activities that are healthier, screen free and in contact (although restricted) with nature compared with their counterparts, which can contribute to their reduced levels of psychological and behavioral symptoms during quarantine. These findings support studies showing children's positive outcomes associated with less screen time (33) and indicating that engagement in outdoor activities can play a protective role in terms of young people's mental health (34, 35).

Another important result pertains to Spanish children who presented more behavioral alterations. In particular, compared with Italians, Spanish children argue more with the rest of the family, have more behavioral problems, are angrier and are more dependent on their parents. These symptoms may be related to modifications in children's habits during quarantine given that this group exhibited a higher decrease of physical activity and higher levels of screen time. Previous studies have highlighted the consequences of oversedentary lifestyle and the use of screens by children and adolescents on their psychological well-being, including lower self-control, less emotional stability, more depressive and anxiety symptoms, and being more difficult to care for [e.g., (33, 36, 37)].

In turn, Portuguese children presented more mood alterations than Spanish children (e.g., feeling more lonely, sad, and frustrated) and are more children in this group feeling anxious and afraid of COVID-19 infection. This result is surprising considering that Portugal has adopted a less restrictive quarantine measure compared with the other countries in study. Some possible explanations may account for this finding. First, parental psychopathology (e.g., anxiety, depression) and offspring emotional disorders have been associated in the literature [e.g., (37, 38, 3840)]. Consistent with this evidence, Portuguese adults present higher levels of psychiatric disorders compared with Spanish and Italian adults (22.9 vs. 9.2 and 8.2%, respectively; (41), and results showed high parental low mood and preoccupation with COVID-19, which seem to suggest the transmission of anxiety and distress from parents to children and/or within family relationships, contaminating children's mood. Second, these differences might also be related to the Portuguese quarantine status. It is possible that the non-mandatory nature of Portuguese home confinement may be confusing to children and adolescents in the sense that it might expose them to inconsistent situations of social contact (e.g., they might see children playing on the street while are told by their parents that they cannot do it). Future studies should explore these and other possible explanations for these results.

Housing Conditions Predict Children's Psychological and Behavioral Symptoms During COVID-19 Quarantine

Our findings suggest that housing conditions, including having an outdoor exit such as a garden or terrace, and the number of people living at home, predicted children's psychological and behavioral symptomatology during COVID-19 quarantine. The results showed that having an outdoor exit in the house contributed to lower levels of all symptoms analyzed, except mood alterations. These findings are consistent with previous studies demonstrating that housing characteristics have a direct impact on people's well-being and mental health in general (42, 43), children's development and psychological health in particular [e.g., (44)], as well as young adults' mental health during COVID-19 lockdown (16). Evans et al. (15) argue that housing is not only a physical shelter but also a significant mental health and well-being resource. Having an outdoor exit might mean that children have more space to play freely in the house or direct contact with nature (in the case of houses with garden) and increases visual exposure and access to neighbors, thus elevating social contact (15). This feature is particularly important in a situation of home confinement and restriction of movements, promoting psychological well-being. In turn, not having these types of housing conditions may exacerbate the feeling of social isolation associated with being quarantined. This notion is consistent with evidence suggesting that families living in multiple-dwelling units experience more social isolation and lack of access to play spaces, thus keeping children inside apartment (15, 42). In accordance with previous evidence (15), the existence of possible underlying mechanisms that may account for the link between housing conditions and children's psychological symptoms but were not investigated in this study should be considered. Having more access to play space provided by outdoor exits may also promote more opportunities for parent-child positive interactions, facilitating more adequate parenting practices (less restrictive and less rigid control over children's activities) which is particularly important to foster children's psychological well-being in times of family stress such as COVID-19 quarantine.

Findings also showed that the number of people living at home contributed significantly to children's mood alterations. A possible explanation for this finding of the “the more the merrier” may be that in times of quarantine, where children have so few opportunities for social interaction and are deprived from contact with peers, interaction with siblings acquires an even greater importance in terms of psychological well-being. This relationship may act as a buffer against the stress caused by quarantine by providing playful interactions and a peer to whom to ask for help if needed, subsequently mitigating mood swings. This result adds to evidence demonstrating the importance of siblings relationships for children's and adolescents' well-being and mental health (45, 46).

Child sex and age also contributed significantly to children's psychological symptomatology. Being a boy predicted behavioral and feeding alterations, which is consistent with studies demonstrating that boys present higher levels of externalizing behaviors compared with girls (47). However, being a boy also predicted higher levels of anxiety symptoms, which is contrary to most of the studies that show higher prevalence of internalizing disorders among girls compared with boys (e.g., 46). Considering evidence demonstrating gender differences in physical activity levels, whereby boys are generally more physically active than girls (48, 49), these findings indicate that boys under quarantine are especially prone to develop diverse symptoms and behavioral alterations probably due to the restriction of movements and lack of opportunities to participate in physical activity that prevent boys from satisfying their developmental needs for physical activity. Actually, when compared with girls, boys presented higher levels of all studied symptoms. On the other hand, being younger also predicted behavior alterations as well as sleep changes, suggesting that younger children may be more vulnerable to the effects of home confinement. This finding is consistent with studies showing that young children are particularly vulnerable to stressful events (12) probably due to their needs of physical mobility and limited cognitive capability to understand the quarantine situation, as well as guidelines from international health organizations regarding young children responses to stress (50).

Limitations and Implications for Future Studies

Some limitations of the present study should be mentioned. First, the cross-sectional nature of the study does not allow conclusions on cause-effect relationships, and the recruitment conducted through social networks with snowball sampling may have caused bias. Longitudinal studies and with representative samples will be crucial to deeply understand the real consequences of home confinement during COVID-19 pandemics. Second, this study relies on parent's perceptions about their children's psychological and behavioral alterations during quarantine. Parents' own level of distress may interfere with their perceptive capacities regarding children's functioning. In this sense, future studies should be based as much as possible on the report of the children and adolescents themselves regarding their home confinement experience. Because this experience and its consequences on mental health and well-being should differ according to the level of maturity of the individuals, future studies also need to compare different age groups in children and adolescents. Furthermore, it is necessary to identify and study other variables that may explain the higher levels of psychological and behavioral symptoms of children and adolescents (e.g., coping strategies, amount and quality of information about COVID-19) (17) given that the variance explained by hierarchical multiple regression models was very small. Future studies should also explore possible mediating variables related to parents or family environment (e.g., parental stress, number of hours working from home) that may diminish parental availability and attention as well as parental capacity to manage offspring difficulties and needs.

Implications for Practice

It is essential that professionals and families are aware that being in home confinement is a hard, strange, and stressful situation for children and adolescents. It is expected that emotional and behavioral changes will occur as a way of expressing the difficulty in understanding, accepting, and adjusting to the situation. In addition, it is expected that most children return to their typical functioning provided that adequate routines and healthy habits are maintained during quarantine and children can receive consistent support from responsive caregivers (51, 52). However, some children may need psychological support after quarantine, especially those with previous psychological or development problems or those with parents struggling with mental problems or economic instability (51). To detect risk situations derived from the pandemic and home confinement (using validated multi-informant and multiproblem approaches), integrative intervention protocols are considered essential during and after home confinement (52).

Similarly, indicated preventive actions are absolutely crucial for the period after home confinement (e.g., at schools), which will allow the early detection of at-risk children, timely mitigation of the effects of a stressful situation for children and adolescents, and the reduction of mild symptoms before their aggravation (52).

Finally, because parents' and children's symptomatology are significantly related, specifically after pandemic disasters (10), and may have deleterious effects on parenting and family relationships, the identification of anxiety, depression, or posttraumatic stress disorder in children should lead clinicians to suggest screening parents' mental health.

Recommendations for Families With Children and Adolescents

Emotional and behavioral changes are expected reactions in response to completely new situations for children and adolescents, such as being bored, lonely, irritable, uneasy, and worried, or having nightmares. It is therefore essential to pay particular attention to parenting practices at this stage, including adopting an even more authoritative discipline, talking to children about the situation using reliable and appropriate information for the child's age, and showing empathy with regard to their emotions, concerns, and frustrations for the losses that the pandemic is causing in their lives (e.g., being with friends, school routine, sport activities). It is important to set aside time to play with children, especially the smallest ones, increasing physical activity at home, for example, carried out with the family.

Children need structure, so it is essential to maintain rules and routines but also to create new “quarantine routines.” It could be helpful create a flexible but consistent daily routine, including time for schoolwork and chores in which children could participate, a specific bedtime and wake-up time, and playtime with and without the family. It is important that children and adolescents can use their phone to connect with friends, compensating for the absence of face-to-face interactions. However, they should also have technology-free time.

To compensate for the lack of space for outdoor activities (especially for those who do not have houses with gardens or terraces), it is important to engage in family activities and games that increase positive parent-child interactions and physical activity and consequently avoid excessive screen-time increases. As stated by Wang et al. (17), “with the right parenting approaches, family bonds can be strengthened, and child psychological needs met.”

Finally, it is also important that parents also monitor their own behavior and adopt self-care behaviors given that children's and adolescent's adaptation and coping with this situation is largely mediated by the role of parents and other relevant social agents (52).


Our study contributes to an emergent body of literature regarding the adverse psychological outcomes associated with COVID-19 quarantine on children and adolescents, consequences that remain uncertain in a population still understudied in the field of pandemic research. The psychological stress as well as individual and family patterns' alterations imposed by home confinement interact with housing conditions, contributing to detrimental effects on children's and adolescents' physical and mental health. Primary and secondary prevention measures are urgently needed to mitigate these effects; otherwise, they can be long lasting and negatively influence youth development.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by Ethics Committee of Católica Research Centre for Psychological, Family and Social Wellbeing; Ethics Committee of Miguel Hernandez University; Ethics Committee of Università degli Studi di Perugia. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

RF designed the Portuguese survey, collected data, and wrote the draft of this article. MP collected data and wrote the draft of this article. ED designed the Italian survey and collected data. JE designed the study. AM managed and analyzed data. CM collected data. MO designed the study and the survey. All the authors reviewed the draft and contributed to the final version of the manuscript.


This work was supported by the Ministry of Science and Innovation of Spain and the European Regional Development Fund (PSI2017-85493-P).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.


1. DiGiovanni C, Conley J, Chiu D, Zaborski J. Factors influencing compliance with quarantine in Toronto during the 2003. SARS outbreak. Biosecur Bioterror. (2004) 2:265–72. doi: 10.1089/bsp.2004.2.265

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. (2020) 395:912–20. doi: 10.1016/S0140-6736(20)30460-8

PubMed Abstract | CrossRef Full Text | Google Scholar

3. World Health Organization [WHO]. Considerations for Quarantine of Individuals in the Context of Containment for Coronavirus Disease (COVID-19): Interim Guidance. (2020). Available online at: (accessed June 05, 2020).

Google Scholar

4. World Health Organization [WHO]. Mental Health and Psychosocial Considerations During COVID-19 Outbreak. (2020). Available online at: (accessed June 05, 2020).

Google Scholar

5. Hawryluck L, Gold WL, Robinson S, Pogorski S, Galea S, Styra R. SARS control and psychological effects of quarantine, Toronto, Canada. Emerg Infect Dis. (2004) 10:1206–12. doi: 10.3201/eid1007.030703

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Qiu J, Shen B, Zhao M, Wang Z, Xie B, Xu Y. A nationwide survey of psychological distress among Chinese people in the COVID-19 epidemic: implications and policy recommendations. Gen Psychiatry. (2020) 33:e100213. doi: 10.1136/gpsych-2020-100213

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Hossain MM, Sultana A, Purohit N. Mental health outcomes of quarantine and isolation for infection prevention: A systematic umbrella review of the global evidence. Epidemiol Health (2020) 42:1–11. doi: 10.4178/epih.e2020038

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Torales J, O'Higgins M, Castaldelli-Maia JM, Ventriglio A. The outbreak of COVID-19 coronavirus and its impact on global mental health. Int J Soc Psychiatry. (2020) 66:317–20. doi: 10.1177/0020764020915212

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Rothstein MA, Talbott MK. Encouraging compliance with quarantine: a proposal to provide job security and income replacement. Am J Public Health. (2007) 97(Suppl. 1):49–56. doi: 10.2105/AJPH.2006.097303

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Sprang G, Silman M. Posttraumatic stress disorder in parents and youth after health-related disasters. Disaster Med Public Health Prep. (2013) 7:105–10. doi: 10.1017/dmp.2013.22

PubMed Abstract | CrossRef Full Text | Google Scholar

11. National Child Traumatic Stress Network [NCTSN]. Supporting Children During Coronavirus (COVID19). (2020). Available online at: (accessed June 05, 2020).

12. Jiao WY, Wang LN, Liu J, Fang SF, Jiao FY, Pettoello-Mantovani M, et al. Behavioral and emotional disorders in children during the COVID-19 epidemic. J Pediatr. (2020) 221:264–6.e1. doi: 10.15690/pf.v17i3.2127

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Banerjee D. The COVID-19 outbreak: crucial role the psychiatrists can play. Asian J Psychiatr. (2020) 50:102014. doi: 10.1016/j.ajp.2020.102014

PubMed Abstract | CrossRef Full Text | Google Scholar

14. UNESCO. COVID-19 Educational Disruption Response. (2020). Available online at: doi: 10.18356/f19698af-en (accessed April 18, 2020).

CrossRef Full Text

15. Evans GW, Wells NM, Moch A. Housing and mental health: a review of the evidence and a methodological and conceptual critique. J Soc Issues. (2003) 59:475–500. doi: 10.1111/1540-4560.00074

CrossRef Full Text | Google Scholar

16. Amerio A, Brambilla A, Morganti A, Aguglia A, Bianchi D, Santi F, et al. COVID-19 lockdown: housing built environment's effects on mental health. Int J Environ Res Public Health. (2020) 17:5973. doi: 10.3390/ijerph17165973

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Wang G, Zhang Y, Zhao J, Zhang J, Jiang F. Mitigate the effects of home confinement on children during the COVID-19 outbreak. Lancet. (2020) 395:945–7. doi: 10.1016/S0140-6736(20)30547-X

PubMed Abstract | CrossRef Full Text | Google Scholar

18. UNICEF. Don't let Children be the Hidden Victims of COVID-19 Pandemic. (2020). Available online at: (accessed April 18, 2020).

19. Beasley TM, Schumacker RE. Multiple regression approach to analyzing contingency tables: Post hoc and planned comparison procedures. J Exp Educ. (1995) 64:79–93. doi: 10.1080/00220973.1995.9943797

CrossRef Full Text | Google Scholar

20. Akoglu H. User's guide to correlation coefficients. Turkish J Emerg Med. (2018) 18:91–3. doi: 10.1016/j.tjem.2018.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Rosenthal R. Parametric measures of effect size. In: Cooper H, Hedges LV, editors. The Handbook of Research Synthesis. New York, NY: Sage (1994). p. 239.

22. Cumming G. The new statistics why and how. Psychol Sci. (2014) 25:7–29. doi: 10.1177/0956797613504966

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Wang C, Pan R, Wan X, Tan Y, Xu L, Ho CS, et al. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. Int J Environ Res Public Health. (2020) 17:1729. doi: 10.3390/ijerph17051729

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Barry TD, Dunlap ST, Lochman JE, Wells KC. Inconsistent discipline as a mediator between maternal distress and aggression in boys. Child Fam Behav Ther. (2009) 31:1–19. doi: 10.1080/07317100802701186

CrossRef Full Text | Google Scholar

25. Pinderhughes EE, Dodge KA, Zelli A, Bates JE, Pettit GS. Discipline responses: influences of parents' socioeconomic status, ethnicity, beliefs about parenting, stress, and cognitive-emotional processes. J Fam Psychol. (2000) 14:380–400. doi: 10.1037/0893-3200.14.3.380

PubMed Abstract | CrossRef Full Text | Google Scholar

26. World Health Organization [WHO]. Family Harmony at Home COVID-19 PARENTING. (2020). Available online at: (accessed June 05, 2020).

PubMed Abstract

27. UNICEF. Coronavirus (COVID-19) Guide for Parents. (2020). Available online at:

28. World Health Organization [WHO]. Guidelines on Physical Activity, Sedentary Behaviour and Sleep for Children Under 5 Year of Age. Geneva: World Health Organization (2019).

PubMed Abstract | Google Scholar

29. World Health Organization [WHO]. Global Recommendations on Physical Activity for Health. Geneva: World Health Organization (2010).

Google Scholar

30. Paruthi S, Brooks LJ, D'Ambrosio C, Hall WA, Kotagal S, Lloyd RM, et al. Recommended amount of sleep for pediatric populations: a consensus statement of the American Academy of Sleep Medicine. J Clin Sleep Med. (2016) 12:1549–61. doi: 10.5664/jcsm.5866

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Hale L, Guan S. Screen time and sleep among school-aged children and adolescents: a systematic literature review. Sleep Med Rev. (2015) 21:50–8. doi: 10.1016/j.smrv.2014.07.007

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Kübler-Ross E. On Death and Dying. New York, NY: Macmillan Publishing (1969).

Google Scholar

33. Twenge JM, Campbell WK. Associations between screen time and lower psychological well-being among children and adolescents: evidence from a population-based study. Prev Med Rep. (2018) 12:271–83. doi: 10.1016/j.pmedr.2018.10.003

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Piccininni C, Michaelson V, Janssen I, Pickett W. Outdoor play and nature connectedness as potential correlates of internalized mental health symptoms among Canadian adolescents. Prev Med. (2018) 112:168–75. doi: 10.1016/j.ypmed.2018.04.020

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Muñoz S-A. Children in the Outdoors: A Literature Review. Broadford. (2009) Available online at: (accessed June 05, 2020).

Google Scholar

36. Kremer P, Elshaug C, Leslie E, Toumbourou JW, Patton GC, Williams J. Physical activity, leisure-time screen use and depression among children and young adolescents. J Sci Med Sport. (2014) 17:183–7. doi: 10.1016/j.jsams.2013.03.012

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Zink J, Belcher BR, Kechter A, Stone MD, Leventhal AM. Reciprocal associations between screen time and emotional disorder symptoms during adolescence. Prev Med Rep. (2019) 13:281–8. doi: 10.1016/j.pmedr.2019.01.014

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Beidel DC, Turner SM. At risk for anxiety: I. psychopathology in the offspring of anxious parents. J Am Acad Child Adolesc Psychiatry. (1997) 36:918–24. doi: 10.1097/00004583-199707000-00013

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Francis SE, Chorpita BF. Parental beliefs about child anxiety as a mediator of parent and child anxiety. Cognit Ther Res. (2011) 35:21–9. doi: 10.1007/s10608-009-9255-9

CrossRef Full Text | Google Scholar

40. Goodman SH, Rouse MH, Connell AM, Broth MR, Hall CM, Heyward D. Maternal depression and child psychopathology: a meta-analytic review. Clin Child Fam Psychol Rev. (2011) 14:1–27. doi: 10.1007/s10567-010-0080-1

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Portuguese National Health Council. Sem Mais Tempo a Perder. Saúde Mental em Portugal: Um Desafio Para a Próxima Década [No more time to waste. Mental Health in Portugal: A challenge for the next decade]. Lisboa: Portuguese National Health Council (2019).

42. Ma L-L. A brief analysis of the relationship between housing, mental health and wellbeing under the eco-city context. Adv Econ Bus Manag Res. (2018) 60:930–5. doi: 10.2991/icmesd-18.2018.159

CrossRef Full Text | Google Scholar

43. Gibson M, Petticrew M, Bambra C, Sowden AJ, Wright KE, Whitehead M. Housing and health inequalities: a synthesis of systematic reviews of interventions aimed at different pathways linking housing and health. Heal Place. (2011) 17:175–84. doi: 10.1016/j.healthplace.2010.09.011

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Leventhal T, Newman S. Housing and child development. Child Youth Serv Rev. (2010) 32:1165–74. doi: 10.1016/j.childyouth.2010.03.008

CrossRef Full Text | Google Scholar

45. Feinberg ME, Solmeyer AR, McHale SM. The third rail of family systems: sibling relationships, mental and behavioral health, and preventive intervention in childhood and adolescence. Clin Child Fam Psychol Rev. (2012) 15:43–57. doi: 10.1016/j.metabol.2011.10.005

PubMed Abstract | CrossRef Full Text | Google Scholar

46. McHale SM, Updegraff KA, Whiteman SD. Sibling relationships and influences in childhood and adolescence. J Marriage Fam. (2012) 74:913–30. doi: 10.1111/j.1741-3737.2012.01011.x

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Leadbeater BJ, Kuperminc GP, Blatt SJ, Hertzog C. A multivariate model of gender differences in adolescents' internalizing and externalizing problems. Dev Psychol. (1999) 35:1268–82. doi: 10.1037/0012-1649.35.5.1268

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Telford RM, Telford RD, Olive LS, Cochrane T, Davey R. Why are girls less physically active than boys? Findings from the LOOK longitudinal study. PLoS ONE. (2016) 11:e0150041. doi: 10.1371/journal.pone.0150041

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Nielsen G, Pfister G, Andersen LB. Gender differences in the daily physical activities of Danish school children. Eur Phys Educ Rev. (2011) 17:69–90. doi: 10.1177/1356336X11402267

CrossRef Full Text | Google Scholar

50. National Child Traumatic Stress Network [NCTSN]. Parent/Caregiver Guide to Helping Families Cope With the Coronavirus Disease 2019. (COVID-19) (2020). Available online at: (accessed June 05, 2020).

51. Barlett JD, Griffin J, Thomson D. Resources for Supporting Children's Emotional Well-Being During the COVID-19 Pandemic. (2020). Available online at: (accessed June 05, 2020).

Google Scholar

52. Espada JP, Orgilés M, Piqueras JA, Morales A. Las buenas prácticas en la atención psicológica infanto-juvenil ante el COVID-19. Clínica y Salud. (2020) 31:109–113. doi: 10.5093/clysa2020a14

CrossRef Full Text | Google Scholar

Keywords: COVID-19, quarantine, psychological symptoms, behavioral symptoms, child habits, housing conditions, children, adolescents

Citation: Francisco R, Pedro M, Delvecchio E, Espada JP, Morales A, Mazzeschi C and Orgilés M (2020) Psychological Symptoms and Behavioral Changes in Children and Adolescents During the Early Phase of COVID-19 Quarantine in Three European Countries. Front. Psychiatry 11:570164. doi: 10.3389/fpsyt.2020.570164

Received: 06 June 2020; Accepted: 02 November 2020;
Published: 03 December 2020.

Edited by:

Gianluca Castelnuovo, Catholic University of the Sacred Heart, Italy

Reviewed by:

Xueling Zhu, Central South University, China
Timo Partonen, National Institute for Health and Welfare, Finland

Copyright © 2020 Francisco, Pedro, Delvecchio, Espada, Morales, Mazzeschi and Orgilés. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Rita Francisco,

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.