Original Research ARTICLE
Hot and Cool Executive Functions in Adolescence: Development and Contributions to Important Developmental Outcomes
- Department of Special Education and Counselling, Education University of Hong Kong, Tai Po, Hong Kong
Despite significant theoretical advancement in the area of child neuropsychology, limited attention has been paid to the developmental features of adolescence. The present study intends to address this issue in relation to executive function (EF). EF refers to the psychological processes that underlie goal-directed behavior; recent studies separate cool EF (psychological process involves pure logic and critical analysis) and hot EF (psychological process driven by emotion). Although neurological findings suggest that adolescence is a sensitive period for EF development, data on comparing the developmental progression in hot or cool EFs is highly missing. Moreover, while evidence has confirmed the relationships between EF and day-to-day functioning, whether and how hot and cool EFs contribute to core developmental outcomes in adolescence is still remained unknown. The current study aims to enhance our understanding of the development and impacts of hot and cool EFs in adolescence. A total of 136 typically developing adolescents from age 12 to 17 completed four cool EF tasks including Backward digit span, Contingency naming test, Stockings of Cambridge, and Stroop Color and Word test, and one hot task on Cambridge gambling task. Data on academic performance and psychological adjustment was also collected. Results showed that cool and hot EF exhibited different patterns of age-related growth in adolescence. Specifically, cool EF ascended with age while hot EF showed a bell-shaped development. Moreover, there were correlations among cool EF measures but no association between cool and hot EFs. Further, cool EF was a better predictor of academic performance, while hot EF uniquely related to emotional problems. The results provide evidence for the association among cool EF tests and the differentiation of hot and cool EFs. The bell-shaped development of hot EF might suggest a period of heightened risk-taking propensity in middle adolescence. Given the plastic nature of EF, especially over adolescence, the current findings may have practical implications for future EF identification and training.
Executive function (EF) is commonly considered an umbrella term, involving the skills essential for conscious, goal-directed thought and behavior (Shallice, 1982; Stuss and Benson, 1986; Miyake et al., 2000; Best and Miller, 2010; Diamond and Lee, 2011; Prencipe et al., 2011; Blair and Raver, 2012). Historically, EF has been understood through a purely cognitive lens, meaning the role of motivation and emotion in EF has been ignored. EF has been seen as purely cognitive skills that are elicited under relatively abstract, decontextualized, non-affective conditions (Peterson and Welsh, 2014). Research in the last decade has suggested that EF may operate differently in different contexts (e.g., Bechara, 2004), suggesting the importance of emotion regulation and bringing to light the “hot” affective aspects of EF (Zelazo and Cunningham, 2007; Zelazo et al., 2010). This broader conceptualization of EF has important implications for developmental research because EF has been found to be a strong predictor of school readiness, academic achievement and social behavior (Brock et al., 2009; Jacobson et al., 2011).
Although the composition of EF is debatable, it is generally agreed that core EFs are cognitive flexibility, inhibition, and working memory. More complex EFs include planning and organizing (Miyake et al., 2000). This traditional EF construct has been categorized as “cool” EF. Cool components required large amount logic and critical analysis (Rubia, 2011), and usually involve conscious control of thoughts and actions without an affective component. For instance, in the Wisconsin Card Sorting Test (WCST; Grant and Berg, 1948), widely considered to be “the prototypical EF task” (Pennington and Ozonoff, 1996, p. 55), participants are provided test cards that had three different dimensions (shape, color, and number) and they had to figure out the rules behind the sorting mechanism. As no obvious rewards or punishments are involved, the WCST is broadly in line with the traditional construct of cool EF.
Hot EF on the other hand involves goal-directed, future-oriented cognitive processes elicited in contexts that generate emotion, motivation, and a tension between instant gratification and long-term rewards (e.g., Zelazo and Müller, 2002; Zelazo et al., 2005). Hot EF has been posited to include affective cognitive abilities, such as the ability to delay gratification and affective decision making (Zelazo and Müller, 2002; Zelazo and Carlson, 2012). One prominent example is the gambling task (e.g., Iowa Gambling Task; Bechara et al., 2001), which captures important components of hot EF, including reward sensitivity (likeliness of risk modulation when the probabilities of outcomes change) and delay discounting (tendency to choose a smaller, sooner reward over a larger, later reward).
Although current research does not make a convincing case for the distinction of the hot and cool forms, most research prone to agree that EF is relatively more unidimensional in early childhood and specializes into distinct functions with development (Zelazo and Carlson, 2012; Welsh and Peterson, 2014). Basic neural structures involving EF may be the same irrespective of developmental stage; however, important differences exist regarding their maturity. Physiological findings show ongoing nerve fibers' myelination and frontal lobe structures' maturation during adolescence (Klingberg et al., 1999), and speculate that adolescence may constitute a developmentally sensitive period for EF (Giedd, 2004; Blakemore and Choudhury, 2006). Furthermore, different EF components demonstrate various developmental trajectories: age-related improvements seem to occur later as well as more gradually for hot than for cold EF components (Prencipe et al., 2011; Smith et al., 2012). Speculation on the developing brain raises questions about the relationships between the ongoing progression of EF during adolescence and its impact throughout development. Additionally, language experience may cause significant impact to the age related changes in hot and cool EF. There is substantial converging evidence that bilingualism trains EF through its mechanism for language selection (e.g., Bialystok, 2001); and the management of two language systems implicating systematic changes in neural correlates (Bialystok et al., 2005). Moreover, some studies document that bilinguals develop comparatively more rapidly on EF domains such as inhibitory control, working memory, and executive attention than monolinguals (e.g., Hilchey and Klein, 2011; Bialystok, 2017). Nonetheless, most of the studies investigated these connections are either in children or adult populations. Hence, the study of bilingual adolescents may prove particularly valuable.
Aforementioned, empirical evidence suggests a link between EF and important developmental areas such as academic performance and psychological well-being. Indeed, most of these explanations are largely restricted to cool EF. An analysis of six large-scale datasets showed that abilities related to cool EF are an essential indicator of school readiness (Duncan et al., 2007). Other research studied preschoolers (McClelland et al., 2007), and kindergarteners (Blair and Razza, 2007) imply that cool EF along with growth in reading, writing, and mathematics are the major components of academic achievement. In primary school, EF is related to achievement in three subjects including language arts, mathematics, and science (St. Clair-Thompson and Gathercole, 2006). Taken together, research consistently demonstrates a pattern of relationship between children's cool EF and academic outcomes, yet findings in hot EF and especially in adolescence are scarce.
Apart from academic performance, the development of EF and its impact on emotional and behavioral difficulties also draws considerable research attention (e.g., Poon and Ho, 2014). For example, Morgan and Lilienfeld (2000) conducted an extensive meta-analysis on the relationships between cool EF and deviant behavior in adults. The study suggested that antisocial groups perform significantly worse on cool EF involving working memory, planning, and inhibition. For children, some studies have shown that young children with serious problem behaviors exhibit clear deficits in cool EF (e.g., Hughes et al., 2000; Poon and Ho, 2014), suggesting that deficits in cool EF may serve as an early marker of future problematic behaviors (Riggs et al., 2003). Although sparse, some research has examined the relation between hot EF and emotional problems. McIntyre et al. (2006) suggest that high hot EF such as the ability to resist temptation upon school entry predicts teacher-rated prosocial skills and positive relationships in kindergarten.
In sum, reviews emphasize that research on the development of EF has disproportionally focused on the preschool or adult population, leaving out the important developmental period of adolescence. Moreover, although hot and cool EFs can be dissociated in lesioned brains, they typically work together as part of a more general adaptive function. Most studies investigating the development of EF only measure cool component, and research integrating hot and cool EFs would provide a better picture on the interaction and maturation of EF in adolescence, and how they influence two important developmental outcomes: academic performance and psychological adjustment.
The Present Study
The present study examined the development of cool and hot EFs in adolescence. It also examined whether (and if so, how) these two aspects of EF are interrelated. Lastly, the relationships between the two facets of EF and academic and psychological adjustment were also examined. There were four hypotheses as follows:
1. Previous studies suggested that age-related improvements occur faster and sooner for cool than hot EF (e.g., Prencipe et al., 2011; Smith et al., 2012). It is hypothesized that age-related improvements will be found in all EF tasks, but improvements on cool EF will occur earlier whereas improvement on hot EF will be more gradual and at slower pace.
2. Neuropsychological evidence on lesioned brains demonstrates a functional dissociation on hot and cool EFs (Zelazo and Carlson, 2012; Welsh and Peterson, 2014). It is hypothesized that hot and cool EFs are separable domains, and measures on hot and cool EFs will not be correlated.
3. According to previous findings on cool EF and academic attainment (Blair and Razza, 2007; Brock et al., 2009; Lan et al., 2011), cool EF is found to be more predictive of academic performance which requires more cognitive processing. The current study expects that cool EF but not hot EF, would account for unique variance in academic performance in particular subject grades, when controlling for general intelligence.
4. Based on previous work on hot EF and emotional difficulties (Kim et al., 2013), it is confirmed that hot EF consistently associates with developmental outcomes that heavily regress on emotional regulation. The current study expects that hot EF but not cool EF, would account for unique variance in emotional problems, when controlling for general intelligence.
A total of 136 adolescents were randomly recruited from four secondary schools. Participants ranged from 12 to 17 years old (M = 14.45, SD = 1.614), with 65 (47.8%) males and 71 (52.2%) females. Participants were divided into six age groups (12.0–12.11, 13.0–13.11, 14.0–14.11, 15.0–15.11, 16.0–16.11, 17.0–17.11 years). Each age group had an approximately equal number of boys and girls. All participants had normal intelligence without suspected brain damage, sensory, psychiatric, or neurological problems, and their first language was Cantonese. In Hong Kong, 95% of its population is ethnically Chinese with Cantonese as the first language while English is the second language that is taught at school. Children with special educational needs were excluded from the study.
The study had two phases: screening and assessment. In the screening phase, participants were administered a standardized subtest used primarily to rule out intellectual disability. During the assessment phase, five EF tasks (four cool EF tasks and one gambling task) were administered individually in a random order. Participants then completed a self-reported questionnaire on demographic background and academic performance. Parents were also invited to complete a questionnaire on participants' psychological well-being.
All assessments were conducted in Cantonese and administered by well-trained research assistants. All parents and adolescents gave informed consent to participate in the study. All participants were informed that their anonymity would be protected and that they could withdraw at any time. A number was issued to each participant for research purposes. Information would be destroyed once the testing was completed. Ethical approval was obtained from the Human Research Ethics Committee at the Education University of Hong Kong.
General Intellectual Ability
Wechsler Intelligence Scale for Children—Fourth Edition (Hong Kong) (WISC-IV (HK); Wechsler, 2010)
General intellectual ability of the participants was estimated by the oral vocabulary subtest of the WISC-IV(HK) (Wechsler, 2010). The vocabulary subtest has the highest pattern/structure coefficient (b = 0.79) to general intelligence among all subtests (Watkins et al., 2006). The participants' vocabulary knowledge was used as a proxy to measure general verbal ability as in previous studies (e.g., McBride-Chang and Suk-Han Ho, 2005; Poon and Ho, 2015). The oral vocabulary subtest included 32 items. Participants were given the target words and required to explain the concepts of these words orally. The test was terminated if the participant scored 0 on five questions in a row. Participants with scaled score 7 or above (mean score = 10, 1 SD = 3) were included in the study. The inclusion criteria were to exclude those who might have poor EF merely because of poor intellectual abilities.
Measures of Cool Executive Function
Backward digit span
Backward digit span subtest from The Test of Specific Learning Difficulties in Reading and Writing for Primary School Students, Second Edition (HKT-P [II]; Chan et al., 2006; Ho et al., 2007) was used to measure working memory. Participants were asked to repeat 2–8 auditorily presented digits in backward order. In order to recall correctly, participants must inhibit current activity (the originally presented digit sequence) and choose relevant information to sustain in working memory.
Contingency Naming Test (CNT; Taylor et al., 1990)
The CNT measures attentional control and cognitive flexibility on four rules of increasing difficulty that are applied to a stimulus set of nine practice items and 27 test items. Each stimulus is composed by an outer shape (circle, triangle, or square) of different colors (blue, yellow, or red), and one smaller independent shape (circle, triangle, or square) embedded inside each outer shape. Some of the stimuli include a backwards arrow that appears directly above the outer shape. Participants were asked to name the stimuli according to the rule level under explicitly timed conditions. In level A (attentional control; CNT subtests 1+2), participants were required to name the color (Rule A1) or the shape (Rule A2) of each stimulus. In level B (cognitive flexibility; CNT subtests 3+4), participants were required to switch between naming the stimuli by color or by shape, depending on one attribute (Rule B1) or two attributes (Rule B2).
Unlike other existing measures of EF, the CNT does not demand suppression of automatic responses (Anderson et al., 2001). Instead, participants have to “choose” which of two equally salient responses is appropriate (Kirk et al., 2005). Although the interpretation of CNT scores varies, there is a general consensus that Level A is a test of attention and Level B is a test of cognitive flexibility, which assesses the “ability to consciously switching between responses depending on different attributes” (Dempster and Corkill, 1999, p. 397).
Stockings of Cambridge (SOC)
A computerized Stockings of Cambridge (SOC) test was administered to measure goal-setting and planning ability in the visual domain. This test is valid to measure planning ability which is one of the variables of EFs (Hill, 2004; Chiang and Gau, 2014; Palmer et al., 2015). It makes use of three colored balls that can be placed on pegs of three different heights. Participants were required to match the computer's ball pattern, presented on a screen, in a prescribed number of moves, while adhering to a number of specific rules. There are 12 problems, graded in difficulty, with the simplest problems requiring two moves and the most difficult items requiring five moves. Participants were presented two displays, each containing three colored balls arranged differently. The upper display functions as a guideline in which participants have to move the colored balls in the lower display to look exactly the same as the upper one. Three rules are given. First, balls located below another one cannot be moved unless the top ball is removed prior to the action. Second, participants can only move only one ball at a time. Third, the number of allowed moves is limited, and there is no option to reverse moves. Number of correct trials and latency of each trial were recorded.
Stroop Color and Word test (Stroop, 1935)
The Stroop Color and Word test is a popular test for measuring inhibition (e.g., Ellis et al., 2009; Dimoska-Di Marco et al., 2011). It involves the presentation of color words in incongruously colored ink (e.g., the word “red” printed in blue ink). Participants are asked to name, as quickly as possible, the ink color of each stimulus word, while attempting to ignore the meaning of the word. This attempt to suppress word meaning in order to name ink color has reliably been shown to result in longer response latencies than those that result from color-naming congruent stimuli (e.g., the word “red” printed in red ink), a phenomenon known as the Stroop effect (MacLeod, 1991). The dependent variable in the Stroop test is either response latency, which is the time in milliseconds between stimulus onset and the participant's response, or an interference score, usually measured as the difference in response latencies between incongruent and congruent stimuli, or between incongruent and colored non-lexical stimuli. Only the interference score was included in the current study to measure participants' inhibitory ability.
Measures of Hot Executive Function
A computerized Cambridge Gambling Task (CGT) was administered to capture both reward-related decision making and delay discounting in an authentic setting (Rogers et al., 1999a,b). In the CGT, participants first see 10 boxes colored either in red or blue on the top of the screen. The display of the boxes represents probability of winning. The participant must guess whether a yellow token is hidden in a red or a blue box. In each gambling stage, participants start with a number of points, displayed on the screen, and can select a proportion of these points, displayed in either ascending order (5, 25, 50, 75, up to 95%) or descending order to gamble on their confidence in this judgment. High-/low-pitched sounds prompt regarding a win or loss at the end of every round. When participants finish a trial, a final point total is presented. At the beginning of the first trial, all participants are informed that they are playing for a joint school competition and for those who scored on the top 10 would receive a souvenir as a reward in order to enhance the emotion component of the gambling test. The two outcome measures are risk adjustment and delay aversion. Risk adjustment is the degree to which a subject varies his/her risk-taking in response to the ratio of red to blue boxes on each trial; higher scores represent higher likelihood of response modulation when outcome probability changes. Delay aversion is measured by the difference in percentage bet in ascending verses descending conditions. If participants are unwilling or unable to wait to make a decision, they will be more likely to bet larger amounts when the possible bets are displayed in descending rather than ascending order; higher scores reflect higher impulsiveness.
Measures of Academic Achievement
A self-report questionnaire has been developed in Chinese to obtain background information about participants (e.g., gender, age, grade level) and their parents (e.g., parents' education and family income). Given that there were no culturally valid measures of academic attainment in the Hong Kong context, academic achievement was measured by students' self-report of their numerical grades in three core academic subjects (English, Chinese, and math) as shown on their printed report cards supplied to them during the questionnaire administration. Previous studies of Hong Kong students have also used self-reported grades in these academic subjects as indicators of student achievement (e.g., Chen, 2005, 2008). To minimize possible social desirability bias in participants' responses, participants were assured that their anonymity would be maintained and their participation was voluntary before the distribution of questionnaire.
Measures of Behavioral and Emotional Difficulties
The Strengths and Difficulties Questionnaire Parent Version (SDQ)
The Strengths and Difficulties Questionnaire (SDQ) Parent Version was used in this study. This is a 25-item measure assessing the potential of having mental health issues. Respondents rate the extent to which item descriptions fit their children well on 3-point Likert scale ranging from 1 (not true) to 3 (certainly true). Items are summed into five domains: emotional problems (e.g., “Many worries or often seems worried”), conduct problems (e.g., “Generally well behaved, usually does what adults request”), hyperactivity (e.g., “Restless, overactive, cannot stay still for long”), peer problems (e.g., “picked on or bullied by other youth”), and prosocial (e.g., “often offers to help others”) to obtain a composite score from 25 to 75. The parent-version SDQ was pre-distributed along with consent aimed to provide a more aggregated and reliable view of the above domains. The domain score is directly proportional to the probability that the participant suffers from psychological abnormalities. Reliability and validity of the SDQ are generally satisfactory (Goodman, 2001; Stone et al., 2010).
Initial analyses were performed to examine the demographic characteristics of the sample. One-way analysis of covariance (ANCOVA) with general intellectual ability as covariate were computed for main effect of Age on EF components. Bonferroni correction was also employed for group comparison within each cool and hot EF components with critical value set at p < 0.05. Pearson's correlation analysis controlling age, general intellectual ability, and socioeconomic status (SES) variables including family income and father's and mother's education level was conducted to examine correlations among and between cool and hot EF variables. In projecting major developmental outcomes, two hierarchical Regression analyses were computed to examine EF-components in predicting academic performance and psychological adjustment.
Data were analyzed with the SPSS version 21 for Windows, and were inspected for normality to ensure that the assumptions of parametric statistics were met before analyses were performed. Tables 1, 2 summarize the descriptive statistics for gender, age, general intellectual ability, educational level, average grades, and grades for specific subjects (Chinese, English, and Mathematics), parents' educational level, and family income. Group differences were found in education level [F(5, 179) = 140.29, p < 0.001, ηp2 = 0.90], Chinese grades [F(5, 137) = 2.64, p < 0.05, = 0.15], father's education level [F(5, 137) = 2.89, p < 0.05, ηp2 = 0.16], and mother's education level [F(5, 137) = 9.42, p = 0.00, ηp2 = 0.39]. No significant difference was found in general intellectual ability [F(5, 137) = 1.56, p = 0.18, ηp2 = 0.05], average grade [F(5, 137) = 0.46, p = 0.81, ηp2 = 0.03], English grades [F(5, 137) = 1.10, p = 0.37, ηp2 = 0.03], Mathematics grades [F(5, 137) = 0.58, p = 0.72, ηp2 = 0.04], or family income [F(5, 124) = 0.38, p = 0.86, ηp2 = 0.03). Preliminary analyses revealed no significant difference in gender [ = 1.96, p = 0.86] or parents' marital status [ = 22.12, p = 0.11; see Table 3 for parents' marital status]. Thus, data were combined across gender for purposes of subsequent analyses, and participants' general intellectual ability scores were entered as a covariate as EF is a cognitive factor relating to intellectual ability.
Relations among Executive Function Measures
The construct validity of hot and cool EFs was examined by partial Pearson's correlation analysis controlling age, general intellectual ability, socioeconomic status (SES) related variables including family incomes, father's and mother's educational levels (see Table 4). These correlations demonstrate the divergent relationships among hot and cool EF measures. Results revealed positive internal correlations among cool EF measures. Significant positive correlation was found between Backward Digit Span and CNT attentional control (r = 0.180, p < 0.05), followed by a strong correlation trend between Stroop and CNT attentional control (r = 0.166, p = 0.07) within cool EF domains. None of the hot EF measures were significantly or marginally inter-correlated or correlated.
Table 4. Correlations among cool and hot executive function variables after controlling age, IQ, family income, and family education level.
Cool Executive Function
In order to investigate the developmental trajectory of both hot and cool EFs, a one-way analysis of covariance (ANCOVA) was adopted to compare group differences among the six age groups (12.0–12.11, 13.0–13.11, 14.0–14.11, 15.0–15.11, 16.0–16.11, and 17.0–17.11 years) on each EF measure. Participants' general intellectual ability scores were entered as a covariate.
Backward Digit Span
Backward Digit Span was used to measure working memory. Significant age effects was identified [F(5, 135) = 6.26, p < 0.001, ηp2 = 0.19] with older adolescents demonstrating higher working memory capacity. Bonferroni post-hoc analysis showed that 17-year-olds showed significant higher capacity than the 12- to 14-year-old groups (12-year-old: mean differences = 3.63, 95% CI [1.22, 6.05], p < 0.01; 13-year-old: mean differences = 3.22, 95% CI [0.68, 5.75], p < 0.01; 14-year-old: mean differences = 3.63, 95% CI [0.60, 5.46] p < 0.01). Sixteen year-olds performed better than the12-year-olds (mean differences = 2.50, 95% CI [0.32, 4.69], p < 0.05), yet 15 year-olds showed a trend of outperforming the 12-year-olds (mean differences = 2.27, 95% CI [−0.050, 4.58], p = 0.06). These results might suggested a developmental spurt in working memory capacity at around age 15 (see Tables 5, 6, and Figure 1).
Table 5. Means, standard deviations according to cool and hot executive function tasks for age groups with IQ as covariance.
Figure 1. Mean of each age group on backward digit span test. Processing Speed improves across different ages with a spurt between age of 14 and 15.
Contingency Naming Test attentional control
Analysis of the basic processing component (subtests 1+2) of the CNT attentional control demonstrated a significant difference across the age range, [F(5, 134) = 5.79, p < 0.001, ηp2 = 0.18]. Post-hoc comparisons revealed significantly better results for the 17-year-olds compared with younger participants (15-year-old: mean difference = 2.06, 95% CI [−0.14, 4.26], p = 0.08; 14-year-old: mean differences = 3.01, 95% CI [0.80, 5.21]; 13-year-old: mean differences = 2.76, 95% CI [0.46, 5.06]; 12-year-old: mean differences = 3.34, 95% CI [1.15, 5.53], p < 0.01). Moreover, the 16-year-olds scored significant higher than 12-year-olds (mean differences = 2.11, 95% CI [0.11, 4.41], p = 0.03). Profile plot revealed a steep upward slope from age 14 onwards with significant improvement topped at age 17 suggesting sudden developmental growth in attentional control between 14 and 17 years old (see Tables 5, 7, and Figure 2).
Figure 2. Mean of each age group on CNT (attentional control: subtest 1+2). Attention control improved from age 14 suddenly with steady pattern.
Contingency Naming Test cognitive flexibility
Results from CNT cognitive flexibility (subtests 3+4) showed similar pattern as CNT attentional control. Significant age effects were identified [F(5, 133) = 4.03, p = 0.001, ηp2 = 0.13] with older adolescents demonstrated better flexibility. Post-hoc analysis showed that participants at age 16 and older performed significantly better than the 12-year-olds (17-year-old: mean differences = 1.16, 95% CI [0.12, 2.20], p < 0.05; 16-year-old: mean differences = 1.10, 95% CI [0.142, 2.06], p < 0.05). This pattern indicated that a steady growth in cognitive flexibility was observed from age 12 to 17 (see Tables 5, 8, and Figure 3).
Figure 3. Mean of each age group on CNT (cognitive flexibility: subtest 3+4). Cognitive flexibility shows steady growth throughout different ages.
Stockings of Cambridge
The SOC measures planning ability in the visual domain. A significant effect of age was identified [F(5, 136) = 3.45, p < 0.01, ηp2 = 0.11]. Specifically, the 17-year-old group showed significantly better planning ability. Post-hoc analysis showed that the 17-year-old group performed significantly better than 12- (mean differences = 2.46, 95% CI [0.55, 4.36], p < 0.01) and 14-year-olds (mean differences = 2.10, 95% CI [0.18, 4.02], p < 0.05) with marginal trend of improvement compared with 13- (mean differences = 1.87, 95% CI [−0.10, 3.83], p = 0.08) and 15-year-old (mean differences = 1.81, 95% CI [−0.11, 3.73], p = 0.08). However, there was no significant group difference between the 12- to 16-year-old groups (ps > 0.05). This pattern indicated flat development from age 12 to 16 and a developmental spurt at age 17 (see Tables 5, 9, and Figure 4).
Table 9. Result of Bonferroni correction of SOC problem solved in minimum moves according to age groups.
Figure 4. Mean of each age group on SOC Test. SOC shows flat development from age 12 to age 16 and developmental spurt at age 17.
The interference score was used to measure the ability to inhibit dominant or automatic responses. Analysis of Stroop interference demonstrated a significant growth of this ability across the age range, [F(5, 133) = 3.00, p < 0.05, ηp2 = 0.10], with older adolescents demonstrating better inhibition ability. Post-hoc analysis showed a steady development from 13-year-olds to 16-year-olds. No significant differences within all age groups (ps > 0.05) were observed. However, 16-year-old group preformed marginally better than 12 (mean differences = 2.15, 95% CI [−0.05, 4.35], p = 0.06) and 13-year-olds (mean differences = 2.30, 95% CI [−0.04, 4.63], p = 0.060). This pattern suggested a steady growth of response inhibition from age 13 to 16 (see Table 5, 10, and Figure 5).
Table 10. Result of Bonferroni correction of stroop-interference performance according to age groups.
Figure 5. Mean of each age group on Stroop Color and Word Test. Interference control (response inhibition) improved from age 13 to age 16 but shows a downward trend at age 17.
Hot Executive Function
Cambridge Gambling Task risk adjustment
CGT risk adjustment measures the degree to which a participant varies his/her risk-taking in response to the ratio of red to blue boxes on each trial. Different from the steady growth observed in cool EF tests, analysis of CGT risk adjustment showed a bell shape (see Table 11, Figure 6) across the age groups, [F(5, 135) = 3.87, p < 0.01, ηp2 = 0.13]. Profile plot showed a significant upward slope from age 12 and a peak at age 14 (mean differences = 0.76, 95% CI [0.06, 1.46], p < 0.05). A downward slope started from age 14 to 17, suggesting a significant decline in performance between ages 14 and 17 (mean differences = −0.91, 95% CI [−1.64, −0.18], p < 0.01). This pattern indicated that the 14-year-old group exhibited the highest risk taking tendency, and this propensity declined after age 14.
Figure 6. Mean of each age group on CGT Test: risk adjustment. Risk adjustment shows bell shape pattern reaching the top at age 14.
Cambridge Gambling Task delay aversion
CGT delay aversion measures the difference between the risk-taking score in descending and ascending conditions. The higher the score, the greater preference for smaller-immediate over larger-delayed rewards (choice impulsivity). Similar with CGT risk adjustment, there was a bell shape across the age groups, despite no significant age difference was identified [F(5, 135) = 1.30, p = 0.27, ηp2 = 0.05; see Table 12, Figure 7]. Data plotted from post-hoc analysis found that there was an ascending trend from the 12-year-old group and a peak at age 15 (ps > 0.05). A descending pattern started from age 15 to 17, although the downward slope was not significant (ps > 0.05). This pattern might imply a weaker preference for smaller-immediate over larger-delayed rewards after age 15.
Figure 7. Mean of each age group on CGT Test: Delay Aversion. Choice impulsivity shows bell shape pattern reaching the top at age 15. Significant developmental spurt and drops were found before age 14 and after age 15.
Predicting Major Developmental Outcomes
A hierarchical regression analysis controlling for general intellectual ability was conducted to examine which cool or hot EF measures best predict the two developmental outcomes: (1) academic performance and (2) psychological adjustment. Table 13 showed that Stroop (B = 0.26, t = 3.21, p < 0.05, R2 = 0.15) and CNT cognitive flexibility (B = −0.246, t = −2.995, p < 0.05, R2 = 0.15) accounted for an additional 15.2% of the variance in predicting average grade. In predicting Mathematics grade, Stroop (B = 0.231, t = 2.799, p < 0.05, R2 = 0.10) and CNT cognitive flexibility (B = −0.254, t = −3.084, p < 0.05, R2 = 0.10) were also significant predictors after controlling for general intellectual ability, and accounted for an additional variance of 10% of Maths grade (see Table 14). No hot EF variables associated with academic performance.
A hierarchical regression analysis controlling general intellectual ability was used to examine which cool or hot EF measures best predict the five psychological domains of the SDQ. Only CGT risk adjustment (B = −0.264, t = −3.053, p < 0.05, R2 = 0.10) accounted for an additional 10% variance in the emotional problems scale (see Table 15). This suggests that CGT risk adjustment was the only EF factor associated with emotional problems. No cool EF tests associated with any other psychological domains of SDQ.
Table 15. Hierarchical regressions predicting participants' parent-observed emotional problems from strengths and difficulties questionnaire.
Like many other subtopics of cognition that have been pulled “in from the cold,” EF research has flourished since embracing the goal of integrating motivational and emotional processes into the traditional EF framework in an effort to understand behavior and achievement in full context. Although there exist some findings on the relationships between EF and important developmental outcomes, a number of research gaps have remained. The present study examined the development of cool and hot EF in a group of Chinese adolescents and investigated how they are related to two major developmental outcomes: academic performance and psychological adjustment. The CNT, Stroop test, SOC, and Backward Digit Span were chosen to investigate the attentional control, cognitive flexibility, inhibition, planning, and working memory domains of cool EF. In contrast, CGT risk adjustment and CGT delay aversion, both of which require the flexible appraisal of motivationally significant stimuli, were chosen to measure hot EF. Four major results were found: (1) cool and hot EFs showed different patterns of age-related growth in adolescence, such that cool EF exhibited an ascending curve while hot EF showed a bell-shaped curve; (2) internal correlations were found among cool EF tests, but no correlation was identified between cool and hot EF; (3) CNT cognitive flexibility and the Stroop test among cool EF measures were better predictors of academic performance; and (4) CGT risk adjustment of hot EF was a better predictor of emotional problems.
Findings on Cool Executive Function
Consistent with our hypothesis and findings of past research (e.g., Adleman et al., 2002; Hooper et al., 2004; Prencipe et al., 2011), the present findings suggest an ascending trend in all cool EF tests with increased age. Despite showing incremental progress overall, different developmental trends were observed among cool EF measures. The findings suggest a progressive trend for increased working memory, attentional control, cognitive flexibility, and inhibition through adolescence. Post-hoc analysis indicated that the magnitude of these improvements was relatively small in early adolescence (i.e., from age 12 to 13), but with a growth spurt occurring around 14 years (see Figures 1, 2, 3, and 5). Conversely, the development of planning as measured by the SOC appeared to be gradual from early to middle adolescence, with a later developmental spurt observed around age 16. Together, these findings echo previous research suggesting that attentional control, cognitive flexibility, working memory, and inhibition, which are considered to be fundamental to other facets of EF, precede and facilitate development of other higher-order EF facets, might display an earlier developmental trajectory than higher-order EF, namely, planning (Barkley, 1997; Carlson and Moses, 2001).
Findings on Hot Executive Function
In comparison to the accelerated maturation that has been found in cool EF, hot EF showed a bell-shaped development curve, with an upward slope from early adolescence and a peak in middle adolescence (ages 14 and 15), and finally, a downward slope from middle to late adolescence (age 17). In other words, the sensitivity to reward magnitude and choice impulsivity were highest in middle adolescence, perhaps suggesting a period of heightened risk-taking propensity (e.g., Steinberg, 2004). This result is consistent with past studies showing that the limbic and paralimbic brain areas, which regulate processing of rewards, social information, and emotions, becomes more sensitive and more easily aroused around middle adolescence (Giedd, 2004; Blakemore and Choudhury, 2006).
Relationship between Cool and Hot Executive Function on Developmental Outcomes
Relations among Cool and Hot Executive Function Tests
Among all EF tests, borderline to significant correlations were found among CNT attentional control and other cool tests including Backward Digit Span, and Stroop. These results not only provide additional evidence for the associations among cool EF tests, but might also imply that attentional control is a cognitive ability shared across all cool EF facets. In fact, attentional control, also known as executive attention, refers to an individual's capacity to choose what they pay attention to (Astle and Scerif, 2009; Sarter and Paolone, 2011), is closely related to other EF facets, such as working memory and inhibition (Mangun, 2012). In addition, although there were correlations among cool EF measures, no significant correlation was found between hot and cool EF measures. In other words, while cool EF seemed to be a reasonably coherent functional construct, hot EF was not.
Executive Function in Predicting Developmental Outcomes
As previously mentioned, research consistently shows a link between EF and academic outcomes in children, but findings on adolescents are scant. The present study confirmed this association and showed that two cool EF facets, inhibition and cognitive flexibility, significantly predict overall academic performance as well as Mathematics grades. This finding was consistent with earlier research finding that inhibitory skills are highly predictive of academic performance in children (Brock et al., 2009; Kim et al., 2013). In fact, most researchers agree that inhibition and cognitive flexibility are important in any problem-solving activity that requires inhibiting irrelevant or overlearned responses when generating response options (Zelazo et al., 1997), and that they are key abilities in learning. Nonetheless, it is important to note that performance in English and Chinese did not appear to be related to any of the cool EF measures. This might suggest that EF is less involved in some academic skills such as reading and writing (Clark et al., 2002) than skills that require more problem solving. Furthermore, in line with our hypothesis, the findings provide additional support that hot EF (i.e., CGT risk adjustment) might be particularly connected to emotional difficulties. In other words, adolescents with impaired or poor hot EF tend to be more impulsive and sensitive to risky activities (Johnson et al., 2009), further increasing their vulnerability to emotional challenges.
Limitations and Future Directions
Although there were general agreement of the current findings with similar studies, a number of methodological limitations must be acknowledged. First, the sample size was relatively small, with around 136 participants. Future studies should include a larger sample size. Second, the current study assessed cool and hot EF using separate EF batteries. Future study should include a more comprehensive assessment battery that allows comparison between hot, affect-based vs. cool, deliberative-based EF in a single task. Examples such as the Columbia Card Task, which exists in two versions that separately trigger affective vs. deliberative decision-making processes in risky situations, might be ideal. Third, it is clear that bilingualism itself provides an advantage in EF through attention control (Bialystok, 2015). The current study examined a group of bilingual participants with Chinese as their native language and varying degree of proficiency in English. Generalization about the current data will be limited to this group of bilingual adolescents. Moreover, bilingual influence on EF has been extensively studied with children but is less studied with adolescents, future study should examine the associations between bilingual experiences and EF development in bilingual adolescents. Lastly, due to time constraints, a cross-sectional design was administered. The present study only made clear that specific cool and hot EF tests predict academic performance and emotional problems, and it could not demonstrate causal relationships. Future studies should adopt a longitudinal approach to provide valuable information on the relationships between lifespan development and cool and hot EF in adolescents. Nonetheless, the present study contributes several novel findings to the current literature. It is the first study to investigate the development of both hot and cool EF in the same sample of adolescents and to investigate whether and how these aspects of EF are related to important developmental outcomes. In addition, given the plastic nature of EF, especially in adolescence, the current findings may have practical implications for future EF identification and training.
The author confirms being the sole contributor of this work and approved it for publication.
The work described in this paper was partially supported by the Internal Research Grant 2014/2015 (RG 31/2014-2015) of the Education University of Hong Kong and the Research Support Scheme 2016/2017 of the Department of Special Education and Counselling at the Education University of Hong Kong.
Conflict of Interest Statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Adleman, N. E., Menon, V., Blasey, C. M., White, C. D., Warsofsky, I. S., Glover, G. H., et al. (2002). A developmental fMRI study of the Stroop color-word task. Neuroimage 16, 61–75. doi: 10.1006/nimg.2001.1046
Anderson, V. A., Anderson, P., Northam, E., Jacobs, R., and Catroppa, C. (2001). Development of executive functions through late childhood and adolescence in an Australian sample. Dev. Neuropsychol. 20, 385–406. doi: 10.1207/S15326942DN2001_5
Bechara, A., Dolan, S., Denburg, N., Hindes, A., Anderson, S. W., and Nathan, P. E. (2001). Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 39, 376–389. doi: 10.1016/S0028-3932(00)00136-6
Bialystok, E., Craik, F. I., Grady, C., Chau, W., Ishii, R., Gunji, A., et al. (2005). Effect of bilingualism on cognitive control and the Simon task: evidence from MEG. Neuroimage 24, 40–49. doi: 10.1016/j.neuroimage.2004.09.044
Blair, C., and Razza, R. P. (2007). Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. Child Dev. 78, 647–663. doi: 10.1111/j.1467-8624.2007.01019.x
Blakemore, S. J., and Choudhury, S. (2006). Development of the adolescent brain: implications for executive function and social cognition. J. Child Psychol. Psychiatry 47, 296–312. doi: 10.1111/j.1469-7610.2006.01611.x
Brock, L. L., Rimm-Kaufman, S. E., Nathanson, L., and Grimm, K. J. (2009). The contributions of ‘hot’ and ‘cool’ executive function to children's academic achievement, learning-related behaviors, and engagement in kindergarten. Early Childhood Res. Quar. 24, 337–349. doi: 10.1016/j.ecresq.2009.06.001
Chan, D. W., Ho, C. S. H., Tsang, S. M., Lee, S. H., and Chung, K. K. (2006). Exploring the reading–writing connection in Chinese children with dyslexia in Hong Kong. Read. Writ. 19, 543–561. doi: 10.1007/s11145-006-9008-z
Chen, J. J. (2005). Relation of academic support from parents, teachers, and peers to Hong Kong adolescents' academic achievement: the mediating role of academic engagement. Genet. Soc. Gen. Psychol. Monogr. 131, 77–127. doi: 10.3200/MONO.131.2.77-127
Chen, J. J. L. (2008). Grade-level differences: relations of parental, teacher and peer support to academic engagement and achievement among Hong Kong students. Sch. Psychol. Int. 29, 183–198. doi: 10.1177/0143034308090059
Clark, C., Prior, M., and Kinsella, G. (2002). The relationship between executive function abilities, adaptive behaviour, and academic achievement in children with externalising behaviour problems. J. Child Psychol. Psychiatry 43, 785–796. doi: 10.1111/1469-7610.00084
Dempster, F. N., and Corkill, A. J. (1999). Individual differences in susceptibility to interference and general cognitive ability. Acta Psychol. (Amst). 101, 395–416. doi: 10.1016/S0001-6918(99)00013-X
Dimoska-Di Marco, A., McDonald, S., Kelly, M., Tate, R., and Johnstone, S. (2011). A meta-analysis of response inhibition and Stroop interference control deficits in adults with traumatic brain injury (TBI). J. Clin. Exp. Neuropsychol. 33, 471–485. doi: 10.1080/13803395.2010.533158
Ellis, M. L., Weiss, B., and Lochman, J. E. (2009). Executive functions in children: associations with aggressive behavior and appraisal processing. J. Abnorm. Child Psychol. 37, 945–956. doi: 10.1007/s10802-009-9321-5
Grant, D. A., and Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. J. Exp. Psychol. 38, 404–411. doi: 10.1037/h0059831
Hilchey, M. D., and Klein, R. M. (2011). Are there bilingual advantages on nonlinguistic interference tasks? Implications for the plasticity of executive control processes. Psychon. Bull. Rev. 18, 625–658. doi: 10.3758/s13423-011-0116-7
Hooper, C. J., Luciana, M., Conklin, H. M., and Yarger, R. S. (2004). Adolescents' performance on the Iowa Gambling Task: implications for the development of decision making and ventromedial prefrontal cortex. Dev. Psychol. 40:1148. doi: 10.1037/0012-16188.8.131.528
Hughes, C., White, A., Sharpen, J., and Dunn, J. (2000). Antisocial, angry, and unsympathetic: “hard-to-manage” preschoolers' peer problems and possible cognitive influences. J. Child Psychol. Psychiatry 41, 169–179. doi: 10.1017/S0021963099005193
Jacobson, L. A., Williford, A. P., and Pianta, R. C. (2011). The role of executive function in children's competent adjustment to middle school. Child Neuropsychol. 17, 255–280. doi: 10.1080/09297049.2010.535654
Johnson, S. B., Blum, R. W., and Giedd, J. N. (2009). Adolescent maturity and the brain: the promise and pitfalls of neuroscience research in adolescent health policy. J. Adoles. Health 45, 216–221. doi: 10.1016/j.jadohealth.2009.05.016
Kim, S., Nordling, J. K., Yoon, J. E., Boldt, L. J., and Kochanska, G. (2013). Effortful control in “hot” and “cool” tasks differentially predicts children's behavior problems and academic performance. J. Abnorm. Child Psychol. 41, 43–56. doi: 10.1007/s10802-012-9661-4
Kirk, J. W., Mazzocco, M. M., and Kover, S. T. (2005). Assessing executive dysfunction in girls with fragile X or Turner syndrome using the Contingency Naming Test (CNT). Dev. Neuropsychol. 28, 755–777. doi: 10.1207/s15326942dn2803_2
Klingberg, T., Vaidya, C. J., Gabrieli, J. D., Moseley, M. E., and Hedehus, M. (1999). Myelination and organization of the frontal white matter in children: a diffusion tensor MRI study. Neuroreport 10, 2817–2821. doi: 10.1097/00001756-199909090-00022
Lan, X., Legare, C. H., Ponitz, C. C., Li, S., and Morrison, F. J. (2011). Investigating the links between the subcomponents of executive function and academic achievement: a cross-cultural analysis of Chinese and American preschoolers. J. Exp. Child Psychol. 108, 677–692. doi: 10.1016/j.jecp.2010.11.001
McBride-Chang, C., and Suk-Han Ho, C. (2005). Predictors of beginning reading in Chinese and English: a 2-year longitudinal study of Chinese kindergartners. Sci. Stud. Read. 9, 117–144. doi: 10.1207/s1532799xssr0902_2
McClelland, M. M., Cameron, C. E., Connor, C. M., Farris, C. L., Jewkes, A. M., and Morrison, F. J. (2007). Links between behavioral regulation and preschoolers' literacy, vocabulary, and math skills. Dev. Psychol. 43:947. doi: 10.1037/0012-16184.108.40.2067
McIntyre, L. L., Blacher, J., and Baker, B. L. (2006). The transition to school: adaptation in young children with and without intellectual disability. J. Intell. Disabil. Res. 50, 349–361. doi: 10.1111/j.1365-2788.2006.00783.x
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., and Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cogn. Psychol. 41, 49–100. doi: 10.1006/cogp.1999.0734
Morgan, A. B., and Lilienfeld, S. O. (2000). A meta-analytic review of the relation between antisocial behavior and neuropsychological measures of executive function. Clin. Psychol. Rev. 20, 113–136. doi: 10.1016/S0272-7358(98)00096-8
Peterson, E., and Welsh, M. C. (2014). “The development of hot and cool executive functions in childhood and adolescence: are we getting warmer?,” in Handbook of Executive Functioning, eds S. Goldstein and J. A. Naglieri (New York, NY: Springer), 45–65. doi: 10.1007/978-1-4614-8106-5_4
Poon, K., and Ho, C. S.-H. (2014). Contrasting deficits on executive functions in Chinese delinquent adolescents with attention deficit and hyperactivity disorder symptoms and/or reading disability. Res. Dev. Disabil. 35, 3046–3056. doi: 10.1016/j.ridd.2014.07.046
Poon, K., and Ho, C. S.-H. (2015). Contrasting deficits on psychosocial outcomes in Chinese delinquent adolescents with reading disability and/or attention deficit and hyperactivity disorder symptoms. J. Foren. Psychiatry Psychol. 35, 3046–3056. doi: 10.1080/14789949.2014.960439
Prencipe, A., Kesek, A., Cohen, J., Lamm, C., Lewis, M. D., and Zelazo, P. D. (2011). Development of hot and cool executive function during the transition to adolescence. J. Exp. Child Psychol. 108, 621–637. doi: 10.1016/j.jecp.2010.09.008
Riggs, N. R., Blair, C. B., and Greenberg, M. T. (2003). Concurrent and 2-Year longitudinal relations between executive function and the behavior of 1st and 2nd grade children. Child Neuropsychol. 9, 267–276. doi: 10.1076/chin.9.4.267.23513
Rogers, R. D., Everitt, B. J., Baldacchino, A., Blackshaw, A. J., Swainson, R., Wynne, K., et al. (1999a). Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: evidence for monoaminergic mechanisms. Neuropsychopharmacology 20, 322–339 doi: 10.1017/CBO9780511605963
Rogers, R. D., Owen, A. M., Middleton, H. C., Williams, E. J., Pickard, J. D., Sahakian, B. J., et al. (1999b). Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. J. Neurosci. 19, 9029–9038.
Rubia, K. (2011). “Cool” inferior frontostriatal dysfunction in attention-deficit/hyperactivity disorder versus “hot” ventromedial orbitofrontal-limbic dysfunction in conduct disorder: a review. Biol. Psychiatry, 69, e69–e87. doi: 10.1016/j.biopsych.2010.09.023
Smith, D. G., Xiao, L., and Bechara, A. (2012). Decision making in children and adolescents: impaired Iowa Gambling Task performance in early adolescence. Dev. Psychol. 48, 1180–1187. doi: 10.1037/a0026342
St. Clair-Thompson, H. L., and Gathercole, S. E. (2006). Executive functions and achievements in school: shifting, updating, inhibition, and working memory. Q. J. Exp. Psychol. 59, 745–759. doi: 10.1080/17470210500162854
Stone, L. L., Otten, R., Engels, R. C., Vermulst, A. A., and Janssens, J. M. (2010). Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4-to 12-year-olds: a review. Clin. Child Fam. Psychol. Rev. 13, 254–274. doi: 10.1007/s10567-010-0071-2
Taylor, H. G., Mills, E. L., Ciampi, A., du Berger, R., Watters, G. V., Gold, R., et al. (1990). The sequelae of Haemophilus influenzae meningitis in school-age children. N. Engl. J. Med. 323, 1657–1663. doi: 10.1056/NEJM199012133232403
Watkins, M. W., Wilson, S. M., Kotz, K. M., Carbone, M. C., and Babula, T. (2006). Factor structure of the Wechsler Intelligence Scale for Children–Fourth Edition among referred students. Educ. Psychol. Meas. 66, 975–983. doi: 10.1177/0013164406288168
Zelazo, P. D., and Carlson, S. M. (2012). Hot and cool executive function in childhood and adolescence: development and plasticity. Child Dev. Perspect. 6, 354–360. doi: 10.1111/j.1750-8606.2012.00246.x
Zelazo, P. D., and Müller, U. (2002). “Executive function in typical and atypical development,” in Blackwell Handbook of Childhood Cognitive Development, ed U. Goswami (Malden, MA: Blackwell Publishers Ltd.), 445–469.
Zelazo, P. D., Qu, L., and Kesek, A. C. (2010). Hot executive function: emotion and the development of cognitive control,” in Child Development at the Intersection of Emotion and Cognition, eds S. D. Calkins and M. Ann Bell (Washington, DC: American Psychological Association), 97–111.
Zelazo, P. D., Qu, L., Müller, U., Schneider, W., Schumann-Hengsteler, R., and Sodian, B. (2005). “Hot and cool aspects of executive function: relations in early development,” in Young Children's Cognitive Development: Interrelationships among Executive Functioning, Working Memory, Verbal Ability, and Theory Of Mind, eds W. Schneider, R. Schumann-Hengsteler, and B. Sodian (Mahwah, NJ: Erlbaum), 71–93.
Keywords: adolescence, executive functions, academic performance, psychological adjustment
Citation: Poon K (2018) Hot and Cool Executive Functions in Adolescence: Development and Contributions to Important Developmental Outcomes. Front. Psychol. 8:2311. doi: 10.3389/fpsyg.2017.02311
Received: 28 August 2017; Accepted: 19 December 2017;
Published: 10 January 2018.
Edited by:Emily Mather, University of Hull, United Kingdom
Reviewed by:Vrinda Kalia, Miami University, United States
Sabine Heim, Rutgers University, The State University of New Jersey, United States
Copyright © 2018 Poon. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kean Poon, email@example.com