Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 29 April 2019
Sec. Addictive Disorders
This article is part of the Research Topic Problematic Gaming, Personality and Psychiatric Disorders View all 9 articles

The Role of Cognitive Emotion Regulation Strategies in Problem Gaming Among Adolescents: A Nationally Representative Survey Study

  • 1 Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
  • 2SE-NAP2 Genetic Brain Imaging Migraine Research Group, Hungarian Academy of Sciences, Semmelweis University, Budapest, Hungary
  • 3Department of Pharmacodynamics, Faculty of Pharmacy, Semmelweis University, Budapest, Hungary
  • 4Doctoral School of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
  • 5Psychology Department, Nottingham Trent University, Nottingham, United Kingdom
  • 6Institute of Education, ELTE Eötvös Loránd University, Budapest, Hungary

Explanatory theoretical models have proposed an association between problematic online gaming and abilities or strategies in alleviating distress or negative emotions in times of stress as proximal non-gaming-related personality factors. However, there is little research that has targeted how emotion regulation relates to problematic online gaming—especially during adolescence when gaming behavior is most prevalent. In emotion regulation research, there has been a particular emphasis on rumination because it is strongly associated with overall psychopathology. However, it is unknown whether this putatively maladaptive strategy relates to problematic online gaming and whether it is a gender-dependent association. Consequently, the present study examined how emotion regulation strategies, and particularly rumination, related to problem gaming and tested whether gender moderated this relationship in adolescents. In a national representative adolescent sample, 46.9% of the participants (N = 1,646) reported online gaming in the past 12 months and provided information on problematic gaming, and it was these data that were used for further analysis. Their data concerning problematic online gaming and emotion regulation strategies were analyzed, including rumination along with other putatively maladaptive (e.g., catastrophizing) and adaptive (e.g., positive reappraisal) strategies, while controlling for age, gender, and game genre preference. Results of linear regression analyses showed that all the putatively maladaptive emotion regulation strategies (including self-blame, other blame, catastrophizing, and rumination) were positively related to problematic online gaming. Positive reappraisal proved to be a protective factor; it was inversely related to problematic online gaming. In addition, the relationship between rumination and online gaming was moderated by gender (i.e., the relationship was stronger among boys). Based on the results, it is argued that emotion regulation is a useful framework to study problematic online gaming. The present study highlighted that the relative predictive value of rumination for problematic online gaming varied for boys and girls, suggesting that trait rumination might be a gender-specific vulnerability factor for problematic online gaming, but this requires further investigation and replication.

Introduction

Online gaming is a widespread phenomenon in adolescence and many teenagers are involved in this leisure activity on a regular basis. Recent data from the European School Survey Project on Alcohol and Other Drugs that used representative samples (1) indicated that more than 20% of adolescents (aged 16 years old) engaged in frequent online gaming (defined as at least four times in the past 7 days). Most teenagers engage in gaming simply for fun, enjoyment (2), social reasons [e.g., friendship (3, 4)], mastery, and/or competition-related motives [see Ref. (5)], and often moderated by game genre (game type) (6, 7). Playing videogames has both beneficial effects (8) and costs (9), and for a small minority of individuals, it can become problematic, negatively affecting everyday life.

Although there is a debate on how problematic online gaming—or internet gaming disorder (IGD) as introduced into Section 3 of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5)—should be conceptualized (10, 11), there is some consensus. Gaming is perhaps best characterized as a continuum ranging from non-problem gaming (non-regularly, regularly, and even excessively) to problem and addictive gaming at the other end (12, 13). The accurate assessment and prevalence of problem gaming is challenging due to the overpathologizing nature of the screening instruments [see Ref. (14)]. However, it still affects a considerable number of adolescents. According to studies involving representative samples, the prevalence is estimated to be between 1% (1518) and 9% (19).

Problem gaming is associated with psychiatric symptoms (20, 21), psychosomatic complaints (22), and poorer academic achievements (23). In addition, it appears to be relatively stable over time among fourth- and fifth-grade students (24) and adolescents aged 13 years and above (20, 23). These data strongly suggest that identifying both distal and proximal gaming and non-gaming-related factors (e.g., personality, family, peer, genetic factors, etc). that are associated with problem gaming—concurrently or longitudinally—should be a high priority, along with demonstrating those factors that separate non-problem gamers from problem and/or addicted gamers.

High engagement indexed by preoccupation and tolerance, for instance, might not be a sufficient criterion in distinguishing pathological and recreational gaming (25, 26). Similarly, intense gaming indexed by gaming time has been questioned as being a reliable predictor of problem gaming (25, 27). These findings are not surprising given that gamers have very different explicit (28) and implicit (29) motives to play that may vary as a function of their mood (30), emotions (5), and psychological needs (31, 32). These empirical findings suggest that online gaming may serve regulatory goals and highlight that identification of underlying reasons why a specific individual in a specific context engages in online gaming is warranted (33). For example, Kardefelt-Winther (34) proposed investigating compensatory functions of online space use to elucidate factors that distinguish between healthy and problematic online gaming. Indeed, studies suggest that gaming motivations to escape from real-life problems and difficulties act as mediators between psychiatric symptoms and problem gaming (21). It is worth noting that temporary distraction from real-life problems itself should not be considered as maladaptive. Avoidance is a risk factor for psychopathologies only if it becomes a habitual strategy to handle negative emotions (35, 36).

Explanatory theoretical models other than compensatory internet use, such as the Interaction of Person–Affect–Cognition–Execution (I-PACE) model by Brand et al. (37) and the cognitive–behavioral model by Dong and Potenza (38), also emphasize that alleviating negative emotions or boosting positive ones as potential experienced consequences of gaming (i.e., positive and negative reinforcements) has the potential to contribute to the development and maintenance of problem gaming. Paulus and colleagues (39) in their review on IGD in children and adolescents also list difficulties in coping with negative emotions among personal factors that may contribute to problem gaming. Therefore, it appears reasonable to assume that those who struggle with regulating their emotions or use putatively maladaptive emotion regulation (ER) strategies in times of stress are more at risk for developing problem gaming use. Indeed, among youth aged between 13 and 21 years, ER difficulties—namely, lack of emotional clarity and lack of impulse control in face of negative emotions—have been associated with problem gaming (40). Studies targeting adolescents show that problem gamers use avoidance-related emotion-focused strategies, such as denial, behavioral disengagement, and media use to cope with stress (22, 41).

It is worth noting that ER difficulties or coping strategies that alter emotional responses have been related to not only problem gaming but also studies examining problematic internet use (22, 40), gambling, and substance use particularly (40). These findings support the contention that dysregulated negative emotions are non-specific risk factors across several psychopathologies. Clinical utility and the transdiagnostic nature of ER have been proposed in many studies and reviews (4244). Furthermore, gambling disorder (as a behavioral addiction) has been theorized within an ER framework (45), using the extended process model of ER (46).

ER refers to any implicit or explicit processes or strategies (47, 48) that act during emotion generation to alter the timing, intensity, duration, and/or valence of emotional experience or expression (49, 50). This definition implies that ER can be operationalized and studied in many ways. For example, many studies have examined how self-reported ER strategies (51, 52) and experimentally induced strategies (53, 54)—often grouped into adaptive or maladaptive ones—account for emotional or behavioral functioning. Self-reported use of putatively maladaptive ER strategies, including rumination, suppression, and avoidance, has been shown to be reliably associated with psychopathological symptoms (42, 51). Findings concerning the protective role of putatively adaptive strategies including positive reappraisal or acceptance suggest that the relationship between these strategies and psychopathology is relatively smaller (42, 51). However, in a recent meta-analysis, Schäfer et al. (52) found comparable effects of adaptive strategies to maladaptive ones in relation to depression and anxiety among adolescents.

In ER research, there has been a particular emphasis on rumination [defined as a stable tendency to focus passively and repetitively on distress-related feelings, their causes and consequences (55)], given that it is strongly associated with overall psychopathology (51). Maladaptive ruminative thoughts are usually distressing and can contain many overgeneralized, abstract (56), and self-critical thoughts (57) that are difficult to control. Therefore, it has been proposed that rumination may induce maladaptive behaviors (e.g., psychoactive substance use) that provide disengagement or escape from these thoughts (58). Based on this, it appears plausible to hypothesize that adolescents who are more prone to ruminate are at greater risk of developing problem gaming. In addition, for adolescent boys who are more likely to be engaged in problem gaming (59), the association between rumination and problem gaming may be much stronger than for adolescent girls who are less likely to be at risk for problem gaming.

Given this contextual empirical evidence, the present study i) examined whether ER strategies (particularly, rumination) were related to problem gaming and ii) tested whether gender moderates the relationship between rumination and problem gaming in adolescents. Recently, Aldao and colleagues (60) argued that the majority of the studies that targeted rumination only assessed this specific strategy instead of testing other ER strategies simultaneously. This narrow scope leaves open the question of how other ER strategies may relate to any psychological problems. Therefore, the present study assessed not just rumination but other ER strategies as well, especially putatively adaptive ones (such as positive reappraisal and acceptance) to test their potential protective effect on problem gaming. Since some studies suggest that specific game genres are more likely to relate to online problem gaming (6, 61, 62), the present study included game genre preference into the analyses to control for the effect of this variable.

Methods

Participants and Procedure

Survey data were collected as part of a nationwide cross-sectional study including 7th- to 14th-grade Hungarian students (altogether 27,728 classes and 654,921 students). In order to ensure the representativeness of the sample, a homogeneous stratified random sampling method was applied, based on regional characteristics (capital city and countryside), class type (primary general, secondary general, secondary vocational, and vocational classes), and grade (7th–14th), where the sampling unit was the class. The participants were asked to complete the surveys in the classroom within one class session. The sample characteristics therefore reflect the composition of participating classes. The data collection was supervised by trained research assistants, and no teaching staff were present. Participation in the study was voluntary and anonymous. No incentives were offered. All parents and students were issued with written informed consent letters.

The data were successfully collected in 200 classes (out of the selected 253), among 3,509 students (1,657 boys and 1,852 girls). The rate of missing data was 20%, which derived from the refusal of parents and/or participants, and pupil absences during the data collection period. In our representative study (N = 3,509), 14.6% reported no gaming activity in their lifetime, while another 4.7% of the sample did not provide an answer to online gaming use question. A total of 29.4% participants indicated lifetime use, but did not play in the past 12 months, while 51.3% reported online gaming in the previous 12 months (N = 1,799). Some participants (N = 153) who reported online gaming in the previous 12 months did not answer Problematic Online Gaming Questionnaire Short-Form (POGQ-SF) items; therefore, we excluded them from further analyses. Consequently, the final sample that was used in the further analyses comprised 1,646 students (mean age = 15.40 years, SD = 2.19 years; 62.9% boys).

The study was ethically approved by the Institution Review Board of ELTE Eötvös Loránd University, and the research was carried out in accordance with the Declaration of Helsinki.

Measures

The short form of the Cognitive Emotion Regulation Questionnaire (CERQ-short) (63) was used to assess the set of cognitive ER strategies that individuals apply in response to stressful life events. The CERQ-short is a self-report 18-item instrument that quantifies ER via nine dimensions (each consisting of two items): i) self-blame, ii) other-blame, iii) rumination, iv) catastrophizing, v) putting into perspective, vi) positive refocusing, vii) positive reappraisal, viii) acceptance, and ix) planning. Theoretically, the nine strategies can be grouped into adaptive (putting into perspective, positive refocusing, positive reappraisal, acceptance and planning) or maladaptive (self-blame, other-blame, rumination, catastrophizing) ER strategies. Participants were asked to score the items (e.g., “I think I can learn something from the situation”) on a five-point Likert scale (1 = Almost never to 5 = Almost always). The sum of the scores belonging to each subscale was calculated and used in the analyses where higher scores indicated more usage of the specific strategy. The Hungarian adaptation of the long-version CERQ (64) showed good internal consistency (Cronbach’s α ranged from 0.68 to 0.88) and strong test–retest reliability (Pearson’s r = 0.58–0.88). In the present sample, the nine subscales had acceptable or good reliability (see Table 2).

Self-reported problem gaming was assessed using the POGQ-SF (59, 65). The original 18-item instrument (66) was shortened to 12 items (e.g., “When you are not gaming, how often do you think about playing a game or think about how would it feel to play at that moment?”; “How often do you feel depressed or irritable when not gaming only for these feelings to disappear when you start playing?”), maintaining the original six-factor structure (preoccupation, overuse, immersion, social isolation, interpersonal conflicts, and withdrawal). Participants were asked to indicate on a five-point Likert scale how often the items apply to themselves (1 = Never to 5 = Always), where higher scores reflected higher risk for online problem gaming. No reverse coded items were applied. The sum of the scores was calculated and used in the analyses. The POGQ-SF showed configural, metric, and scalar level gender invariance (59). In the study sample, the total score had excellent reliability (see Table 2).

In addition to the CERQ and the POGQ-SF, basic sociodemographic data (e.g., age and gender), gaming in the past 12 months, and game genre preference were collected. Game genre preference was collected by asking participants what type of online game they played primarily [i.e., strategy games, role-playing games, casual games, shooter games, MOBA (multiplayer online battle arena) games, other game types].

Statistical Analysis

SPSS 25.0 (IBM) and MPlus 7.4 (67) statistical software were used for the analyses. First, the factor structure of the CERQ-Short Form was tested on the whole sample, since the psychometric properties of the short version had not previously been tested on a Hungarian adolescent sample. The original nine-factor structure was tested and the second-order factor structure (with adaptive and maladaptive strategies) with confirmatory factor analysis (CFA) was utilized. In CFA, maximum likelihood estimation robust to non-normality (MLR) was used. To evaluate the overall model fit, the present study used the conventional χ2 test and the more liberal indices such as comparative fit index (CFI), Tucker–Lewis Fit Index (TLI), and root mean square error approximation (RMSEA). CFI and TLI—which reflect the total variance accounted for by the model and indicate a fit relative to a null model—are expected to be above 0.9 to indicate acceptable fit of the model. Values below .05 for RMSEA, reflecting the variance of residuals, signify an excellent fit. Non-significant probability (p > .05) values of closeness of model fit using the RMSEA (Cfit of RMSEA) indicate acceptable model fit, although some statisticians argue for larger values, such as p > .5 (68). To compare the two alternative nested models, the Satorra–Bentler scaled χ2 difference test was also applied (69). Cronbach’s α values were calculated as indices of reliability of the subscales of the CERQ-Short and the POGQ-SF. To test the relationship between online gaming and ER strategies, linear regression analysis was used. Gender, age, and game genre preference were controlled for in this model. Additionally, the present study tested whether gender moderated the relationship between ER strategies, especially rumination and problem gaming. For exploratory purposes, we ran a series of analyses to test whether gender moderated the effect of other ER strategies on online problem gaming. Similarly, we also ran a series of exploratory analyses to test whether preferred game genre moderated the effect of ER strategies on online problem gaming (see Supplementary Tables 1 and 2). We used the adjusted R2 and AIC (Akaike’s Information Criteria) values to decide about the inclusion of any other interaction terms in our regression analysis. Adjusted R2 adjusts the R2 for the number of independent variables (predictors) in the model. AIC as a model performance metric penalizes the inclusion of additional variables to a model. A smaller value of AIC indicates a better model fit.

Results

Factor Structure of the Cognitive Emotion Regulation Questionnaire–Short

The original nine first-order factor model and the second-order factor structure (with adaptive and maladaptive strategies) on the whole sample were tested. The nine first-order factor measurement model fitted the data well (χ2 = 766.215, df = 99, p < 0.001; RMSEA = 0.046 [0.043–0.049], cfit = 0.984, CFI = 0.954, TLI = 0.929), while the second-order factor model had a considerably worse fit to the data (χ2 = 1674.641, df = 125, p < 0.001; RMSEA = 0.062 [0.062–0.065], cfit < 0.001, CFI = 0.893, TLI = 0.869). The original nine-factor structure model yielded a superior fit compared to the second-order factor model (Satorra–Bentler Δχ2 = 871.945, df = 26, p < 0.0001). In the nine-factor model, all the factor loadings were above 0.66. Based on the CFA results, the nine ER strategies were used in the subsequent analyses; we did not group them into adaptive and maladaptive clusters.

Descriptive Data

Participants reported the most involvement in shooter games (23.3%), with approximately equal proportions of the participants preferring strategy (14.3%), casual (14.7%), and online role-playing games (14.0%). The remaining gamers indicated a preference for MOBA games (10.4%) and other game genres (14.7%), with a further 8.5% not providing an answer. Significant gender differences were found in game genre preference (⶘χ2[6] = 364.401, p < 0.001). Among those who primarily played shooter or MOBA games, there were more boys, while casual games were preferred by girls (Table 1).

TABLE 1
www.frontiersin.org

Table 1 Online problem gaming score as a function of game genre preference.

A one-way ANOVA was performed to examine the effect of game genre preference on the online problem gaming score. Results showed that the game genre preference had a significant effect on the POGQ-SF score (F6,1639 = 20.735, p < 0.001). Those who preferred casual games or strategy games had significantly lower online problem gaming scores compared to those who preferred shooter, role-playing, or MOBA games (see Table 1). Given these differences, a binary variable was created for game genre preference, which included those who preferred shooter, role-playing, or MOBA games and those who preferred strategy, casual, or other game genres. This binary variable was used in the subsequent analyses.

Means and standard deviations of the psychological scales are presented in Table 2. Males and females differed from each other on all scales except positive refocusing and acceptance. Males had higher score on online problem gaming and reported more frequent use of other blaming in times of stress, while females reported more use of self-blame, rumination, catastrophizing, putting into perspective, planning, and positive reappraisal. The effect size for gender differences in online problem gaming was moderate in magnitude (Cohen’s d above 0.5); in self-blame and in rumination, it was small (Cohen’s d above 0.2); and for other ER strategies, the gender differences were negligible (Cohen’s d below 0.2). Age did not correlate with online problem gaming scores (r = 0.003, p = 0.92) or with ER strategies (r values were between −0.04 and 0.05; p > 0.05). ER strategies were correlated with each other positively, and the correlation coefficients ranged between 0.05 and 0.54 (Table 3), with most of them being moderate (between 0.30 and 0.50).

TABLE 2
www.frontiersin.org

Table 2 Means, standard deviations, and effect sizes (Cohen’s d) by gender with Cronbach’s α.

TABLE 3
www.frontiersin.org

Table 3 Correlations between problem gaming and cognitive emotion regulation strategies.

Relationship Between Emotion Regulation Strategies and Online Problem Gaming

First, linear regression analysis was applied to examine whether ER strategies explained the variance in online problem gaming total score. Gender, age, and game genre were controlled for in the analysis. Game genre was based on both theoretical consideration and the empirical data (see above). More specifically, a variable with two values was created (0 indicated preference for either shooter, role-playing, or MOBA games; 1 indicated preference for any other games). As expected, the results showed that maladaptive strategies, namely, self-blame, rumination, catastrophizing, and other blame, were positively related to online problem gaming. For the adaptive strategies, higher scores on positive reappraisal were associated with lower online problem gaming score, while positive refocusing and planning were positively related to online problem gaming (see Table 4). The final model (F12,1267 = 27.26, p < 0.001) explained 20.5% of the total variance of the POGQ-SF total score.

TABLE 4
www.frontiersin.org

Table 4 Standardized regression weights between online problem gaming and emotion regulation strategies after controlling for age, gender, and game preference.

Relationship Between Rumination and Online Problem Gaming Is Moderated by Gender

Finally, to understand gender differences in explaining online problem gaming, a moderation analysis was performed. The analysis added the interaction term (gender × rumination) to the previous linear regression analysis, and it yielded to be a significant independent variable (standardized β = −0.240, p = 0.005) and was associated with significant R2 change (F change = 7.882, p = 0.005). However, the explained variance did not change substantially (0.5%). The moderation effect is shown in Figure 1. It can be seen that as rumination scores increased, the online problem gaming score also increased but primarily among males. A simple correlational analysis between rumination and online problem gaming by gender also supported this result (rboys = 0.25, p < 0.001; rgirls = 0.08, p = 0.049).

FIGURE 1
www.frontiersin.org

Figure 1 The relationship between rumination and online problem gaming by gender.

For exploratory purposes, we ran a series of analyses to test whether gender moderated the effect of other ER strategies on online problem gaming, first including only one interaction term in the regression model each time. We found that gender × catastrophizing interaction contributed to the variance of online problem gaming significantly (standardized β = −0.150, p = 0.023). Similarly, we also ran a series of analyses to test whether preferred game genre moderated the effect of ER strategies on online problem gaming, first including only one interaction term in the regression model each time. Four interaction terms proved to be significant: the catastrophizing × game genre (standardized β = −0.214, p = 0.001), other blame × game genre (standardized β = −0.243, p < 0.001), rumination × game genre (standardized β = −0.178, p = 0.028), and self-blame × game genre (standardized β = −0.150, p = 0.048) interaction terms (see Supplementary Table 1).

In the next step, we added these interaction terms to our model to test whether adjusted R2 and AIC would change. Based on these additional analyses (see Supplementary Table 2), our third model also includes the interaction between game genre and other blame ER strategy (Table 4). The inclusion of this interaction was associated with significant R2 change (F change = 12.846, p < 0.001). The effects of other blame were stronger among those who preferred shooter, role-playing, or MOBA games than among those who preferred strategy, casual, or other game genres. A simple correlational analysis between self-blame and online problem gaming by game genre also supported this result (r = 0.32, p < 0.001 and r = 0.14 p < 0.001, respectively). The moderation effect is shown in Figure 2.

FIGURE 2
www.frontiersin.org

Figure 2 The relationship between other blame and online problem gaming by game genre.

Discussion

Hemenover and Bowman (70) recently proposed extending the scope of research on gaming to include the emotion and ER field. Now—and based on the results of the present study—the present authors also argue that ER is a useful framework to study online problem gaming. It was particularly expected that rumination would be associated with online problem gaming, but our aim was to test the potential effect of other putatively maladaptive and adaptive strategies as well. In line with the present conceptualization, online problem gaming was treated as a continuum and found—as logically expected—that it was positively associated not just with rumination but with the other maladaptive cognitive ER strategies. The results also support the contention that the use of positive reappraisal has a beneficial effect on functioning given that it was inversely related to online problem gaming when other strategies were controlled for in the analysis. In addition, the present study highlighted that the relative predictive value of rumination for online problem gaming varied for boys and girls.

Studies elsewhere have demonstrated that the use of cognitive reappraisal assessed by self-reports (71) or induced by experimental manipulations (72) is associated with higher levels of psychosocial well-being. Additionally, prospective studies carried out with adolescents have shown that cognitive reappraisal can act as a buffer against the negative impacts of adverse life events (73, 74). The results of the present study extend these previous findings and suggest that trait reappraisal could also be a protective factor against online problem gaming among adolescents. A previous study using a small sample comprising young adults with IGD showed that the IGD group reported less use of positive reappraisal compared to controls (75).

During reappraisal, individuals transform the meaning of situations by changing the way they think about them (76). Although there are different tactics concerning how to do it (77, 78), reinterpreting the emotional stimulus or the event in more positive terms (e.g., “I think I can learn something from the situation”)—as the CERQ subscale defines this cognitive change strategy (79)—appears to be effective in modulating experiential (self-reported emotional experience) and behavioral (observer-reported emotional expression) aspects of negative emotions (78), therefore contributing to better psychological health. Moreover, neuroimaging studies have found that individuals with higher tendency to use reappraisal utilize frontal regions to a higher extent and amygdala to a lesser extent when they are instructed to reappraise negative stimuli (80) or when just simply processing them (81). Results on the downregulation of amygdala activity highlight that a decrease in negative emotions after positive reappraisal can be detected not just at a subjective level but also at a neural level.

It is also worth noting that findings of experimental studies suggest that the timing of reappraisal (82) or emotional intensity (83) may determine whether such a strategy is an adaptive and/or effective one in modulating emotions. For example, it is much easier to reinterpret a low arousing stimulus/event than a high arousing one (84), and reappraising a negative stimulus is more effective if this strategy initiated early in the emotion generating process (e.g., 82, 85). In addition, the characteristics of a specific situation (stressor) may also shape the costs or benefits of this strategy (86, 87). For example, in case of uncontrollable stressors, reappraising can weaken the negative impact of the stressor (73, 88). Conversely, when the stress is controllable, higher use of reappraisal may contribute to poorer psychological health (88). Further studies need to understand how positive reappraisal and its variants/tactics such as reinterpretation or psychological distancing (89) are associated with online problem gaming prospectively, especially during childhood and adolescence when maturation of brain areas involved in ER is still ongoing (90).

Interestingly, the putatively adaptive ER strategies (i.e., positive refocusing and planning) were positively related to online problem gaming. It appears logic that planning itself—defined as thinking about what to do and how to solve the problem (91)—without any action does not guarantee the success of ER. Indeed, studies using the CERQ among adolescents did not find any relationship between planning and internalizing or externalizing symptoms (92) or between planning and anxiety symptoms when depression was controlled for (93).

The adaptive or maladaptive nature of positive refocusing—thinking about positive things instead of thinking about the actual negative event—is still questionable. Positive refocusing is an event-avoiding (92) active strategy (78). For instance, in adolescents, it has been found to be a unique predictor of externalizing symptoms (92). Active distraction from negative events or distress via positive refocusing can downregulate negative emotions in the short term (78) and has been negatively associated with depressive mood among children and adolescents in cross-sectional studies (9395). However, if refocusing serves as an avoidance of private events such as emotional experiences, thoughts, and memories (termed experiential avoidance) (96), then it may just exacerbate or prolong negative emotions in the long term (97), thus contributing to elevated levels of psychopathological symptoms (35, 36). These results strongly suggest that ER goals are likely to determine whether any distraction-like strategies contribute to better or poorer functioning. Regarding online gaming, it is tempting to hypothesize that gaming motives may moderate the relationship between positive refocusing and online problem gaming. However, since gaming motives were not assessed in the present study, future research should include such variables.

Acceptance—treated frequently as the opposite of experiential avoidance (98) or as a component of mindfulness (99, 100)—has been proved to be positively associated with psychological health in both adult (101) and adolescent samples (102, 103). However, in the present study, there was no relationship between this strategy and online problem gaming. This might be because the CERQ-Short uses items relating to accepting situations rather than accepting emotions. For instance, in a recent study by Ford and colleagues (104), habitual use of acceptance was related to better psychological health if it referred to accepting mental experiences. Accepting the stressful situations showed no relationship with psychological well-being, life satisfaction, or depressive symptoms in Ford et al.’s study (104).

All the putatively maladaptive ER strategies—rumination, self-blame, other blame, and catastrophizing—had a positive association with online problem gaming in the present study. This supported previous findings on the relationship between maladaptive strategies and poorer psychological functioning in adolescents (52). It was particularly expected that rumination would relate to online problem gaming because its habitual use has been strongly associated with overall psychopathology (51). The main effect of rumination is supported by the data in the present study, but our findings also pointed out that other strategies could be relevant in the context of online problem gaming. Our results specifically suggest that handling stress-related negative feelings and emotions with using any putatively maladaptive cognitive ER strategies is a risk factor for online problem gaming.

It was also found that gender moderated the relationship between rumination and online problem gaming. Adolescent boys had higher score on the scale measuring online problem gaming compared to girls confirming prior research (4, 59). In addition, rumination was related to online problem gaming among boys, but the association was weak among girls. It has been well documented—and the results here are in line with this—that rumination is higher among women and that this gender difference is already present in adolescence (105). The predominance of females with depression and anxiety disorders has therefore been (partially) explained by more ruminative tendencies among females compared to males (55, 106). Based on the results of the present study, it is tempting to suggest that high ruminative tendency in men creates a vulnerability factor for pathologies that are associated with behaviors offering an escape from (thinking about) real-life problems. However, it is important to note that more boys reported online gaming in the study than girls, and this difference in the number of users may have influenced the findings regarding rumination. Thus, it would be interesting to replicate the study among female gamers to see whether ruminative tendencies are related to online problem gaming among them.

Further studies are also needed to address whether escapism moderates the relationship between rumination and online problem gaming and whether such moderation is invariant across gender. Of interest, the present authors treated rumination as a maladaptive ER strategy, but rumination is a multidimensional construct. It is likely that brooding, defined as a tendency to passively dwell on negative emotions (107), would be more strongly related to problem gaming than reflective pondering, defined as a more purposeful self-reflective response to understanding and solving problems (107).

The present study found that those adolescents who reported a preference for shooter, role-playing, and MOBA games had higher scores on the POGQ-SF, while those who preferred casual or strategy games had lower POGQ-SF scores. This finding is in line with previous studies and supports the finding that some gaming genres appear to be more problem-inducing than others. Massively multiplayer online role-playing games (MMORPGs) offer the possibilities for role-playing, progression, action, and social interaction in a persistent virtual world (108), and may relate to motivations such as escapism (which has associations with problem gaming). Online shooter games (109) and MOBA games (110) have also been associated with gaming-related problems, and this may be due to structural and situational factors such as being fast-paced, action-oriented, and socially interactive (111). However, it should also be noted that motivations underlying gaming (62, 112, 113) and personality factors (112) may influence these relationships with problem gaming. In addition, our exploratory analyses yielded an interesting result. We found that the effect of other blame on online problem gaming was moderated by the game genre preference. The effects of other blame were stronger among those who preferred shooter, role-playing, or MOBA games than among those who preferred strategy, casual, or other game genres. In certain game genres, especially in MOBA games, shooters, and role-playing games [in PvE (person vs. environment) type quests], team performance is highly dependent on the personal performance of team members. Therefore, blaming others within one’s own team in the case of lost matches/quests/raids is characteristic of these game genres, especially MOBA games (114, 115). This might explain why other blame ER strategy has a stronger effect among players who preferred these game genres. There were students, however, who did not report their preferred game genre; thus, they were not included in these interaction analyses and this might distort the results.

The results presented here support the theoretical structure of CERQ-Short in an adolescent representative sample and is the same as the original length CERQ, thus confirming the original nine-factor structure of the instrument. However, the nine strategies were not grouped into the proposed higher-order (i.e., maladaptive and adaptive) factors. Taking into account that context strongly determines whether a specific strategy is an adaptive one or not (86), these results appear to be unsurprising. In addition, individuals may use different strategies in different contexts (e.g., rumination after peer rejection but positive reappraisal after minor failure). Consequently, a positive relationship between the use of adaptive and maladaptive strategies would be expected. Indeed, there were significant moderate and positive relationships between the adaptive and maladaptive ER strategies, which also prevented the identification of the proposed two-factor higher-order solution.

Limitations and Future Research

The use of a cross-sectional design did not allow any inference that ER plays a pivotal role in the development of problem gaming. However, it is worth mentioning that in a 2-year prospective study in the United States, the ability to deal with stress predicted who developed pathological gaming among adolescents (24). More longitudinal studies are needed to evaluate whether regulation of negative (or even positive) emotions predicts the development of online problem gaming. Further studies should also assess other gaming-related constructs associated with problem gaming such as beliefs or metacognitions about gaming (116), gaming use expectations (117), as well as motives for gaming (21) to estimate the contribution of ER more precisely. Similarly, including other individual risk factors for problem gaming such as impulsivity (118), sensation seeking (119), peer influence (117), and/or parental factors (120) would also be beneficial.

However, time spent gaming itself is not considered to be a reliable predictor of problem gaming (25, 27), although inclusion of this variable may have improved the analysis. Similarly, other variables were not assessed including depressive symptoms, anxiety, and/or other psychopathological problems, and such variables are reliably related to both ruminative tendencies (107, 121) and online problem gaming (21). It is plausible to hypothesize that the relationship between psychopathological symptoms and online problem gaming is mediated or even moderated by ruminative tendencies or by other strategies. For instance, catastrophizing has been demonstrated to relate to anxiety symptoms (93). Based on this finding, it is also tempting to hypothesize that different putatively maladaptive strategies have different “pathways” into online problem gaming.

ER was assessed with self-reports (and are subject to well-known biases), but application of other methods such as a daily diary or an experience sampling method would be useful to demonstrate that everyday ER, negative affect, motives, and gaming are interrelated, providing more ecologically valid data. It would also be worth testing how the interaction between adaptive and maladaptive ER strategies affects psychological health. For instance, in a daily diary study, it was shown that reappraisal moderated the relationship between rumination and depressive and social anxiety symptoms (122). Consequently, it appears plausible to hypothesize that patterns of rumination and positive reappraisal may relate to online problem gaming differently. Latent profile analysis would be a good candidate to answer this question. Finally, it is worth mentioning that ER strategies were assessed generally and did not take into account how specific emotions—for example, anger, sadness, fear, or positive emotions such as joy or pride—are regulated (123).

Conclusion

The results of the present study draw attention to ER, namely, habitual ER strategies used in times of stress in online problem gaming. It appears to be important given that ER can be targeted and improved during development, and can even be altered in adulthood via different interventions and psychotherapies. Our findings entail important implications for mental health prevention. Prevention programs that promote positive reappraisal and help to understand negative consequences of frequent use of maladaptive ER strategies such as rumination or catastrophizing could be useful in developing healthier ways of handling everyday negative emotions in adolescence. It is also worth noting that negative emotions are frequently elicited by recalling personally relevant negative events that happened in the past or in the near past. Cognitive and emotional responses to these thoughts will influence the intensity and duration of negative affect. Thus, prevention efforts that focus on adaptive ways of elaborating (processing) negative events can prevent unproductive rumination and the development of psychopathologies, including IGD as well.

At the same time, the relationship between online gaming and ER can be thought of the other way around. Recently, in their systematic review of videogames for ER, Villani et al. (124) came to the conclusion that (specific types of) videogames may be promising tools for improving the ER skills of gamers. Taking this a step further, Dore et al. (125) proposed a personalized investigation of ER via understanding how the individual, the situation, and strategies interact with each other and thus contribute to successful or unsuccessful regulation of emotion.

The understanding of gender-related behavioral and neural factors in online gaming is considered to be an important public health issue (126). The findings of the present study suggest that trait rumination among boys might be such a vulnerability factor for online problem gaming. Understanding gender-specific trajectories in online gaming, if any, requires longitudinal studies. These studies may then shed light on whether common or distinct factors predict the problematic use of different online activities (e.g., gaming, social networking, and watching porn) and whether these factors are gender specific.

Author Contributions

ZD and BP conceived and designed the study. AM was responsible for data collection. Data analysis was performed by GK with special assistance from NK, AG, and OK. GK, NK, MG, OK, and ZD contributed to the interpretation of the data. GK, NK, and OK wrote the first draft of the manuscript, and all authors provided critical revision to its further development. MG oversaw the final manuscript editing. All authors read and approved the final manuscript.

Funding

This study was supported by the Hungarian National Research, Development and Innovation Office (Grant No. K111938, KKP126835). This work was completed in the ELTE Institutional Excellence Program (783-3/2018/FEKUTSRAT) supported by the Hungarian Ministry of Human Capacities. Financial support was received from the Szerencsejáték Plc, which is the 100% state-owned national gambling provider in Hungary. The funding institutions had no role in the study design; the collection, analysis, and interpretation of the data; the writing of the manuscript; or the decision to submit the paper for publication. The preparation of this article for GK, NK, and AG was supported by the MTA-SE-NAP B Genetic Brain Imaging Migraine Research Group, Hungarian Academy of Sciences, Semmelweis University (Grant No. KTIA_NAP_13-2-2015-0001); by the Hungarian Brain Research Program (Grant No. 2017-1.2.1-NKP-2017-00002); and by the Hungarian National Research, Development and Innovation Office (Grant No. FK128614). NK was supported by the ÚNKP-18-3-III-ELTE-495 New National Excellence Program of the Ministry of Human Capacities.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2019.00273/full#supplementary-material

References

1. Kraus L, Guttormsson U, Leifman H, Arpa S, Molinaro S, Monshouwer K, ESPAD report 2015. Results from the European School Survey Project on Alcohol and Other Drugs. Luxembourg: Publications Office of the European Union (2016). p. 99. doi: 10.2810/86718

CrossRef Full Text | Google Scholar

2. Wong IL, Lam MP. Gaming behavior and addiction among Hong Kong adolescents. Asian J Gambl Issues Public Health (2016) 6(1):6. doi: 10.1186/s40405-016-0016-x

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Cole H, Griffiths MD. Social interactions in massively multiplayer online role-playing gamers. Cyberpsychol Behav (2007) 10(4):575–83. doi: 10.1089/cpb.2007.9988

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Ko CH, Yen JY, Chen CC, Chen SH, Yen CF. Gender differences and related factors affecting online gaming addiction among Taiwanese adolescents. J Nerv Ment Dis (2005) 193(4):273–7. doi: 10.1097/01.nmd.0000158373.85150.57

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Olson CK. Children’s motivations for video game play in the context of normal development. Rev Gen Psychol (2010) 14(2):180–7. doi: 10.1037/a0018984

CrossRef Full Text | Google Scholar

6. Ghuman D, Griffiths M. A cross-genre study of online gaming: player demographics, motivation for play, and social interactions among players. Int J Cyber Behav Psychol Learn (2012) 2(1):13–29. doi: 10.4018/ijcbpl.2012010102

CrossRef Full Text | Google Scholar

7. Smyth JM. Beyond self-selection in video game play: an experimental examination of the consequences of massively multiplayer online role-playing game play. Cyberpsychol Behav (2007) 10(5):717–21. doi: 10.1089/cpb.2007.9963

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Granic I, Lobel A, Engels RC. The benefits of playing video games. Am Psychol (2014) 69(1):66–78. doi: 10.1037/a0034857

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Prot S, McDonald KA, Anderson CA, Gentile DA. Video games: good, bad, or other? Pediatr Clin N Am (2012) 59(3):647–58. doi: 10.1016/j.pcl.2012.03.016

CrossRef Full Text | Google Scholar

10. Kiraly O, Demetrovics Z. Inclusion of gaming disorder in ICD has more advantages than disadvantages. Commentary on: Scholars’ open debate paper on the World Health Organization ICD-11 Gaming Disorder proposal (Aarseth et al.). J Behav Addict (2017) 6(3):280–4. doi: 10.1556/2006.6.2017.046

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Kiraly O, Sleczka P, Pontes HM, Urban R, Griffiths MD, Demetrovics Z. Validation of the Ten-Item Internet Gaming Disorder Test (IGDT-10) and evaluation of the nine DSM-5 Internet Gaming Disorder criteria. Addict Behav (2017) 64:253–60. doi: 10.1016/j.addbeh.2015.11.005

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Kuss DJ, Griffiths MD. Internet gaming addiction: a systematic review of empirical research. Int J Ment Health Addict (2012) 10(2):278–96. doi: 10.1007/s11469-011-9318-5

CrossRef Full Text | Google Scholar

13. Griffiths MD, Kuss DJ, Lopez-Fernandez O, Pontes HM. Problematic gaming exists and is an example of disordered gaming. Commentary on: Scholars’ open debate paper on the World Health Organization ICD-11 Gaming Disorder proposal (Aarseth et al.). J Behav Addict (2017) 6(3):296–301. doi: 10.1556/2006.6.2017.037

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Maraz A, Kiraly O, Demetrovics Z. Commentary on: are we overpathologizing everyday life? A tenable blueprint for behavioral addiction research. The diagnostic pitfalls of surveys: if you score positive on a test of addiction, you still have a good chance not to be addicted. J Behav Addict (2015) 4(3):151–4. doi: 10.1556/2006.4.2015.026

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Rehbein F, Kliem S, Baier D, Mossle T, Petry NM. Prevalence of internet gaming disorder in German adolescents: diagnostic contribution of the nine DSM-5 criteria in a state-wide representative sample. Addiction (2015) 110(5):842–51. doi: 10.1111/add.12849

PubMed Abstract | CrossRef Full Text | Google Scholar

16. van Rooij AJ, Schoenmakers TM, Vermulst AA, van den Eijnden R, de Mheen D. Online video game addiction: identification of addicted adolescent gamers. Addiction (2011) 106(1):205–12. doi: 10.1111/j.1360-0443.2010.03104.x

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Wittek CT, Finseras TR, Pallesen S, Mentzoni RA, Hanss D, Griffiths MD, et al. Prevalence and predictors of video game addiction: a study based on a national representative sample of gamers. Int J Ment Health Addict (2016) 14(5):672–86. doi: 10.1007/s11469-015-9592-8

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Muller KW, Janikian M, Dreier M, Wolfling K, Beutel ME, Tzavara C, et al. Regular gaming behavior and internet gaming disorder in European adolescents: results from a cross-national representative survey of prevalence, predictors, and psychopathological correlates. Eur Child Adolesc Psychiatry (2015) 24(5):565–74. doi: 10.1007/s00787-014-0611-2

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Gentile D. Pathological video-game use among youth ages 8 to 18: a national study. Psychol Sci (2009) 20(5):592–602. doi: 10.1111/j.1467-9280.2009.02382.x

CrossRef Full Text | Google Scholar

20. Vadlin S, Aslund C, Hellstrom C, Nilsson KW. Associations between problematic gaming and psychiatric symptoms among adolescents in two samples. Addict Behav (2016) 61:8–15. doi: 10.1016/j.addbeh.2016.05.001

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Kiraly O, Urban R, Griffiths MD, Agoston C, Nagygyorgy K, Kokonyei G, et al. The mediating effect of gaming motivation between psychiatric symptoms and problematic online gaming: an online survey. J Med Internet Res (2015) 17(4):e88. doi: 10.2196/jmir.3515

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Rosenkranz T, Muller KW, Dreier M, Beutel ME, Wolfling K. Addictive potential of internet applications and differential correlates of problematic use in internet gamers versus generalized internet users in a representative sample of adolescents. Eur Addict Res (2017) 23(3):148–56. doi: 10.1159/000475984

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Brunborg GS, Mentzoni RA, Froyland LR. Is video gaming, or video game addiction, associated with depression, academic achievement, heavy episodic drinking, or conduct problems? J Behav Addict (2014) 3(1):27–32. doi: 10.1556/JBA.3.2014.002

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Gentile DA, Choo H, Liau A, Sim T, Li DD, Fung D, et al. Pathological video game use among youths: a two-year longitudinal study. Pediatrics (2011) 127(2):E319–E329. doi: 10.1542/peds.2010-1353

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Griffiths MD. The role of context in online gaming excess and addiction: some case study evidence. Int J Ment Health Addict (2010) 8(1):119–25. doi: 10.1007/s11469-009-9229-x

CrossRef Full Text | Google Scholar

26. Deleuze J, Nuyens F, Rochat L, Rothen S, Maurage P, Billieux J. Established risk factors for addiction fail to discriminate between healthy gamers and gamers endorsing DSM-5 Internet gaming disorder. J Behav Addict (2017) 6(4):516–24. doi: 10.1556/2006.6.2017.074

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Kiraly O, Toth D, Urban R, Demetrovics Z, Maraz A. Intense video gaming is not essentially problematic. Psychol Addict Behav (2017) 31(7):807–17. doi: 10.1037/adb0000316

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Demetrovics Z, Urban R, Nagygyorgy K, Farkas J, Zilahy D, Mervo B, et al. Why do you play? The development of the motives for online gaming questionnaire (MOGQ). Behav Res Methods (2011) 43(3):814–25. doi: 10.3758/s13428-011-0091-y

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Hou SM, Fang XY. The explicit and implicit outcome expectancies of Internet games and their relationships with Internet gaming behaviors among college students. Comput Hum Behav (2014) 39:346–55. doi: 10.1016/j.chb.2014.07.028

CrossRef Full Text | Google Scholar

30. Bowman ND, Tamborini R. Task demand and mood repair: the intervention potential of computer games. New Media Soc (2012) 14(8):1339–57. doi: 10.1177/1461444812450426

CrossRef Full Text | Google Scholar

31. Reinecke L, Tamborini R, Grizzard M, Lewis R, Eden A, Bowman ND. Characterizing mood management as need satisfaction: the effects of intrinsic needs on selective exposure and mood repair. J Commun (2012) 62(3):437–53. doi: 10.1111/j.1460-2466.2012.01649.x

CrossRef Full Text | Google Scholar

32. Ryan RM, Rigby CS, Przybylski A. The motivational pull of video games: a self-determination theory approach. Motiv Emot (2006) 30(4):347–63. doi: 10.1007/s11031-006-9051-8

CrossRef Full Text | Google Scholar

33. Kardefelt-Winther D. Conceptualizing Internet use disorders: addiction or coping process? Psychiatry Clin Neurosci (2017) 71(7):459–66. doi: 10.1111/pcn.12413

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Kardefelt-Winther D. A conceptual and methodological critique of internet addiction research: towards a model of compensatory internet use. Comput Hum Behav (2014) 31:351–4. doi: 10.1016/j.chb.2013.10.059

CrossRef Full Text | Google Scholar

35. Hayes SC, Levin ME, Plumb-Vilardaga J, Villatte JL, Pistorello J. Acceptance and commitment therapy and contextual behavioral science: examining the progress of a distinctive model of behavioral and cognitive therapy. Behav Ther (2013) 44(2):180–98. doi: 10.1016/j.beth.2009.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Kashdan TB, Barrios V, Forsyth JP, Steger MF. Experiential avoidance as a generalized psychological vulnerability: comparisons with coping and emotion regulation strategies. Behav Res Ther (2006) 44(9):1301–20. doi: 10.1016/j.brat.2005.10.003

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Brand M, Young KS, Laier C, Wolfling K, Potenza MN. Integrating psychological and neurobiological considerations regarding the development and maintenance of specific Internet-use disorders: an Interaction of Person-Affect-Cognition-Execution (I-PACE) model. Neurosci Biobehav Rev (2016) 71:252–66. doi: 10.1016/j.neubiorev.2016.08.033

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Dong GH, Potenza MN. A cognitive–behavioral model of Internet gaming disorder: theoretical underpinnings and clinical implications. J Psychiatr Res (2014) 58:7–11. doi: 10.1016/j.jpsychires.2014.07.005

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Paulus FW, Ohmann S, Von Gontard A, Popow C. Internet gaming disorder in children and adolescents: a systematic review. Dev Med Child Neurol (2018) 60(7):645–59. doi: 10.1111/dmcn.13754

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Estevez A, Jauregui P, Sanchez-Marcos I, Lopez-Gonzalez H, Griffiths MD. Attachment and emotion regulation in substance addictions and behavioral addictions. J Behav Addict (2017) 6(4):534–44. doi: 10.1556/2006.6.2017.086

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Dreier M, Wolfling K, Duven E, Giralt S, Beutel ME, Muller KW. Free-to-play: about addicted whales, at risk dolphins and healthy minnows. Addict Behav (2017) 64:328–33. doi: 10.1016/j.addbeh.2016.03.008

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Aldao A, Nolen-Hoeksema S, Schweizer S. Emotion-regulation strategies across psychopathology: a meta-analytic review. Clin Psychol Rev (2010) 30(2):217–37. doi: 10.1016/j.cpr.2009.11.004

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Sloan E, Hall K, Moulding R, Bryce S, Mildred H, Staiger PK. Emotion regulation as a transdiagnostic treatment construct across anxiety, depression, substance, eating and borderline personality disorders: a Systematic Review. Clin Psychol Rev (2017) 57:141–63. doi: 10.1016/j.cpr.2017.09.002

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Fernandez KC, Jazaieri H, Gross JJ. Emotion regulation: a transdiagnostic perspective on a new RDoC domain. Cognit Ther Res (2016) 40(3): 426–40. doi: 10.1007/s10608-016-9772-2

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Rogier G, Velotti P. Conceptualizing gambling disorder with the process model of emotion regulation. J Behav Addict (2018) 7(2):239–51. doi: 10.1556/2006.7.2018.52

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Gross JJ. The extended process model of emotion regulation: elaborations, applications, and future directions. Psychol Inq (2015) 26(1):130–7. doi: 10.1080/1047840X.2015.989751

CrossRef Full Text | Google Scholar

47. Braunstein LM, Gross JJ, Ochsner KN. Explicit and implicit emotion regulation: a multi-level framework. Soc Cogn Affect Neurosci (2017) 12(10):1545–57. doi: 10.1093/scan/nsx096

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Gyurak A, Gross JJ, Etkin A. Explicit and implicit emotion regulation: a dual-process framework. Cogn Emot (2011) 25(3):400–12. doi: 10.1080/02699931.2010.544160

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Gross JJ. The emerging field of emotion regulation: an integrative review. Rev Gen Psychol (1998) 2(3):271–99. doi: 10.1037/1089-2680.2.3.271

CrossRef Full Text | Google Scholar

50. Thompson RA. Emotion regulation: a theme in search of definition. Monogr Soc Res Child Dev (1994) 59(2–3):25–52. doi: 10.2307/1166137

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Aldao A, Nolen-Hoeksema S. Specificity of cognitive emotion regulation strategies: a transdiagnostic examination. Behav Res Ther (2010) 48(10):974–83. doi: 10.1016/j.brat.2010.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Schäfer JO, Naumann E, Holmes EA, Tuschen-Caffier B, Samson AC. Emotion regulation strategies in depressive and anxiety symptoms in youth: a meta-analytic review. J Youth Adolesc (2017) 46(2):261–76. doi: 10.1007/s10964-016-0585-0

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Sheppes G, Catran E, Meiran N. Reappraisal (but not distraction) is going to make you sweat: physiological evidence for self-control effort. Int J Psychophysiol (2009) 71(2):91–6. doi: 10.1016/j.ijpsycho.2008.06.006

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Ochsner KN, Ray RD, Cooper JC, Robertson ER, Chopra S, Gabrieli JDE, et al. For better or for worse: neural systems supporting the cognitive down- and up-regulation of negative emotion. Neuroimage (2004) 23(2):483–99. doi: 10.1016/j.neuroimage.2004.06.030

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Nolen-Hoeksema S, Wisco BE, Lyubomirsky S. Rethinking rumination. Pers Psychol Sci (2008) 3(5):400–24. doi: 10.1111/j.1745-6924.2008.00088.x

CrossRef Full Text | Google Scholar

56. Watkins ER. Constructive and unconstructive repetitive thought. Psychol Bull (2008) 134(2):163–206. doi: 10.1037/0033-2909.134.2.163

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Smart LM, Peters JR, Baer RA. Development and validation of a measure of self-critical rumination. Assessment (2016) 23(3):321–32. doi: 10.1177/1073191115573300

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Nolen-Hoeksema S, Watkins ER. A heuristic for developing transdiagnostic models of psychopathology: explaining multifinality and divergent trajectories. Pers Psychol Sci (2011) 6(6):589–609. doi: 10.1177/1745691611419672

CrossRef Full Text | Google Scholar

59. Papay O, Urban R, Griffiths MD, Nagygyoergy K, Farkas J, Koekoenyei G, et al. Psychometric properties of the Problematic Online Gaming Questionnaire Short-Form and prevalence of problematic online gaming in a national sample of adolescents. Cyberpsychol Behav Soc Netw (2013) 16(5):340–8. doi: 10.1089/cyber.2012.0484

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Aldao A, Gee DG, De Los Reyes A, Seager I. Emotion regulation as a transdiagnostic factor in the development of internalizing and externalizing psychopathology: current and future directions. Dev Psychopathol (2016) 28(4):927–46. doi: 10.1017/S0954579416000638

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Elliott L, Golub A, Ream G, Dunlap E. Video game genre as a predictor of problem use. Cyberpsychol Behav Soc Netw (2012) 15(3):155–61. doi: 10.1089/cyber.2011.0387

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Kuss DJ, Louws J, Wiers RW. Online gaming addiction? Motives predict addictive play behavior in massively multiplayer online role-playing games. Cyberpsychol Behav Soc Netw (2012) 15(9):480–5. doi: 10.1089/cyber.2012.0034

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Garnefski N, Kraaij V. Cognitive emotion regulation questionnaire—development of a short 18-item version (CERQ-short). Pers Individ Dif (2006) 41(6):1045–53. doi: 10.1016/j.paid.2006.04.010

CrossRef Full Text | Google Scholar

64. Miklosi M, Martos T, Kocsis-Bogar K, Perczel Forintos D. Psychometric properties of the Hungarian version of the Cognitive Emotion Regulation Questionnaire. Psychiatr Hung (2011) 26(2):102–11.

PubMed Abstract | Google Scholar

65. Papay O, Urban R, Nagygyoergy K, Griffiths M, Agoston C, Farkas J, et al. The development and application of the Problematic Online Gaming Questionnaire (POGQ) and its short form (POGQ-SF). J Behav Addict (2013) 2:27. doi: 10.1089/cyber.2012.0484

CrossRef Full Text | Google Scholar

66. Demetrovics Z, Urban R, Nagygyoergy K, Farkas J, Griffiths MD, Papay O, et al. The development of the Problematic Online Gaming Questionnaire (POGQ). PloS One (2012) 7(5):e36417. doi: 10.1371/journal.pone.0036417

CrossRef Full Text | Google Scholar

67. Muthén LK, Muthén BO. Mplus user guide. 5th ed. Los Angeles, CA: Muthén & Muthén (1998–2007).

Google Scholar

68. Brown T. Confirmatory factor analysis for applied research. New York, NY: Guilford Press (2006).

Google Scholar

69. Satorra A, Bentler P. Corrections to test statistics and standard errors in covariance structure analysis. In: von Eye A, Clogg C, editors. Latent variables analysis: applications for developmental research. Thousand Oaks, CA: Sage (1994).

Google Scholar

70. Hemenover SH, Bowman ND. Video games, emotion, and emotion regulation: Expanding the scope. Ann Int Commun (2018) 42(2):125–43. doi: 10.1080/23808985.2018.1442239

CrossRef Full Text | Google Scholar

71. Verzeletti C, Zammuner VL, Galli C, Agnoli S. Emotion regulation strategies and psychosocial well-being in adolescence. Cogent Psychol (2016) 3:1199294. doi: 10.1080/23311908.2016.1199294

CrossRef Full Text | Google Scholar

72. Butler EA, Egloff B, Wilhelm FH, Smith NC, Erickson EA, Gross JJ. The social consequences of expressive suppression. Emotion (2003) 3(1):48–67. doi: 10.1037/1528-3542.3.1.48

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Tu KM, Erath SA, El-Sheikh M. Coping responses moderate prospective associations between marital conflict and youth adjustment. J Fam Psychol (2016) 30(5):523–32. doi: 10.1037/fam0000169

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Boyes ME, Hasking PA, Martin G. Adverse life experience and psychological distress in adolescence: moderating and mediating effects of emotion regulation and rumination. Stress Health (2016) 32(4):402–10. doi: 10.1002/smi.2635

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Yen JY, Yeh YC, Wang PW, Liu TL, Chen YY, Ko CH. Emotional regulation in young adults with internet gaming disorder. Int J Environ Res Public Health (2017) 15(1):30. doi: 10.3390/ijerph15010030

CrossRef Full Text | Google Scholar

76. Gross JJ, John OP. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. J Pers Soc Psychol (2003) 85(2):348–62. doi: 10.1037/0022-3514.85.2.348

PubMed Abstract | CrossRef Full Text | Google Scholar

77. McRae K, Ciesielski B, Gross JJ. Unpacking cognitive reappraisal: goals, tactics, and outcomes. Emotion (2012) 12(2):250–5. doi: 10.1037/a0026351

PubMed Abstract | CrossRef Full Text | Google Scholar

78. Webb TL, Miles E, Sheeran P. Dealing with feeling: a meta-analysis of the effectiveness of strategies derived from the process model of emotion regulation. Psychol Bull (2012) 138(4):775–808. doi: 10.1037/a0027600

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Garnefski N, Kraaij V, Spinhoven P. Negative life events, cognitive emotion regulation and emotional problems. Pers Individ Dif (2001) 30(8):1311–27. doi: 10.1016/S0191-8869(00)00113-6

CrossRef Full Text | Google Scholar

80. Vanderhasselt MA, Kuhn S, De Raedt R. ‘Put on your poker face’: neural systems supporting the anticipation for expressive suppression and cognitive reappraisal. Soc Cogn Affect Neurosci (2013) 8(8):903–10. doi: 10.1093/scan/nss090

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Drabant EM, McRae K, Manuck SB, Hariri AR, Gross JJ. Individual differences in typical reappraisal use predict amygdala and prefrontal responses. Biol Psychiatry (2009) 65(5):367–73. doi: 10.1016/j.biopsych.2008.09.007

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Sheppes G, Meiran N. Divergent cognitive costs for online forms of reappraisal and distraction. Emotion (2008) 8(6):870–4. doi: 10.1037/a0013711

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Sheppes G, Meiran N. Better late than never? On the dynamics of online regulation of sadness using distraction and cognitive reappraisal. Pers Soc Psychol Bull (2007) 33(11):1518–32. doi: 10.1177/0146167207305537

PubMed Abstract | CrossRef Full Text | Google Scholar

84. Langeslag SJE, Surti K. The effect of arousal on regulation of negative emotions using cognitive reappraisal: an ERP study. Int J Psychophysiol (2017) 118:18–26. doi: 10.1016/j.ijpsycho.2017.05.012

PubMed Abstract | CrossRef Full Text | Google Scholar

85. Yan CP, Lin N, Cui LX, Zhang Q. Is reappraisal always effective in modifying emotional reactions in females? The role of regulatory timing and goals. Brain Behav (2018) 8(2):e00911. doi: 10.1002/brb3.911

CrossRef Full Text | Google Scholar

86. Aldao A. The future of emotion regulation research: capturing context. Pers Psychol Sci (2013) 8(2):155–72. doi: 10.1177/1745691612459518

CrossRef Full Text | Google Scholar

87. van’t Wout M, Chang LJ, Sanfey AG. The influence of emotion regulation on social interactive decision-making. Emotion (2010) 10(6):815–21. doi: 10.1037/a0020069

PubMed Abstract | CrossRef Full Text | Google Scholar

88. Troy AS, Shallcross AJ, Mauss IB. A person-by-situation approach to emotion regulation: cognitive reappraisal can either help or hurt, depending on the context. Psychol Sci (2013) 24(12):2505–14. doi: 10.1177/0956797613496434

PubMed Abstract | CrossRef Full Text | Google Scholar

89. Denny BT, Ochsner KN. Behavioral effects of longitudinal training in cognitive reappraisal. Emotion (2014) 14(2):425–33. doi: 10.1037/a0035276

PubMed Abstract | CrossRef Full Text | Google Scholar

90. Wessing I, Rehbein MA, Romer G, Achtergarde S, Dobel C, Zwitserlood P, et al. Cognitive emotion regulation in children: reappraisal of emotional faces modulates neural source activity in a frontoparietal network. Dev Cogn Neurosci (2015) 13:1–10. doi: 10.1016/j.dcn.2015.01.012

PubMed Abstract | CrossRef Full Text | Google Scholar

91. Garnefski N, Legerstee J, Kraaij V, Van Den Kommer T, Teerds J. Cognitive coping strategies and symptoms of depression and anxiety: a comparison between adolescents and adults. J Adolesc (2002) 25(6):603–11. doi: 10.1006/jado.0507

PubMed Abstract | CrossRef Full Text | Google Scholar

92. Garnefski N, Kraaij V, van Etten M. Specificity of relations between adolescents’ cognitive emotion regulation strategies and internalizing and externalizing psychopathology. J Adolesc (2005) 28(5):619–31. doi: 10.1016/j.adolescence.2004.12.009

PubMed Abstract | CrossRef Full Text | Google Scholar

93. Garnefski N, Kraaij V. Specificity of relations between adolescents’ cognitive emotion regulation strategies and symptoms of depression and anxiety. Cogn Emot (2016) 32(7):1–8. doi: 10.1080/02699931.2016.1232698

CrossRef Full Text | Google Scholar

94. Orgiles M, Morales A, Fernandez-Martinez I, Ortigosa-Quiles JM, Espada JP. Spanish adaptation and psychometric properties of the child version of the Cognitive Emotion Regulation Questionnaire. PloS One (2018) 13(8):e0201656. doi: 10.1371/journal.pone.0201656

CrossRef Full Text | Google Scholar

95. Van Beveren ML, Harding K, Beyers W, Braet C. Don’t worry, be happy: the role of positive emotionality and adaptive emotion regulation strategies for youth depressive symptoms. Br J Clin Psychol (2018) 57(1):18–41. doi: 10.1111/bjc.12151

PubMed Abstract | CrossRef Full Text | Google Scholar

96. Hayes SC, Wilson KG, Gifford EV, Follette VM, Strosahl K. Experiential avoidance and behavioral disorders: a functional dimensional approach to diagnosis and treatment. J Consul Clin Psychol (1996) 64(6):1152–68. doi: 10.1037/0022-006X.64.6.1152

CrossRef Full Text | Google Scholar

97. Blackledge JT, Hayes SC. Emotion regulation in acceptance and commitment therapy. J Clin Psychol (2001) 57(2):243–55. doi: 10.1002/1097-4679(200102)57:2<243::aid-jclp9>3.0.co;2-x

PubMed Abstract | CrossRef Full Text | Google Scholar

98. Ciarrochi J, Kashdan TB, Leeson P, Heaven P, Jordan C. On being aware and accepting: a one-year longitudinal study into adolescent well-being. J Adolesc (2011) 34(4):695–703. doi: 10.1016/j.adolescence.2010.09.003

PubMed Abstract | CrossRef Full Text | Google Scholar

99. Bishop SR, Lau M, Shapiro S, Carlson L, Anderson ND, Carmody J, et al. Mindfulness: a proposed operational definition. Clin Psychol Sci Pract (2004) 11(3):230–41. doi: 10.1093/clipsy/bph077

CrossRef Full Text | Google Scholar

100. Kabat-Zinn J. Mindfulness-based interventions in context: past, present, and future. Clin Psychol Sci Pract (2003) 10(2):144–56. doi: 10.1093/clipsy/bpg016

CrossRef Full Text | Google Scholar

101. Baer RA, Smith GT, Allen KB. Assessment of mindfulness by self-report: the Kentucky inventory of mindfulness skills. Assessment (2004) 11(3):191–206. doi: 10.1177/1073191104268029

PubMed Abstract | CrossRef Full Text | Google Scholar

102. Mathews BL, Kerns KA, Ciesla JA. Specificity of emotion regulation difficulties related to anxiety in early adolescence. J Adolesc (2014) 37(7):1089–97. doi: 10.1016/j.adolescence.2014.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

103. Schneider RL, Arch JJ, Landy LN, Hankin BL. The longitudinal effect of emotion regulation strategies on anxiety levels in children and adolescents. J Clin Child Adolesc Psychol (2016) 47(6):1–14. doi: 10.1080/15374416.2016.1157757

CrossRef Full Text | Google Scholar

104. Ford BQ, Lam P, John OP, Mauss IB. The psychological health benefits of accepting negative emotions and thoughts: laboratory, diary, and longitudinal evidence. J Pers Soc Psychol (2017) 115(6):1075–92. doi: 10.1037/pspp0000157

PubMed Abstract | CrossRef Full Text | Google Scholar

105. Jose PE, Brown I. When does the gender difference in rumination begin? Gender and age differences in the use of rumination by adolescents. J Youth Adolesc (2008) 37(2):180–92. doi: 10.1007/s10964-006-9166-y

CrossRef Full Text | Google Scholar

106. Hankin BL. Rumination and depression in adolescence: investigating symptom specificity in a multiwave prospective study. J Clin Child Adolesc Psychol (2008) 37(4):701–13. doi: 10.1080/15374410802359627

PubMed Abstract | CrossRef Full Text | Google Scholar

107. Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: a psychometric analysis. Cogn Ther Res (2003) 27(3):247–59. doi: 10.1023/A:1023910315561

CrossRef Full Text | Google Scholar

108. Männikkö N, Billieux J, Koivisto K, Kääriäinen M. Problematic gaming behaviour in Finnish adolescents and young adults: relation to game genres, gaming motives and self-awareness of problematic use. Int J Ment Health Addict (2017) 15(2):324–38. doi: 10.1007/s11469-016-9726-7

CrossRef Full Text | Google Scholar

109. Lemmens JS, Hendriks SJ. Addictive online games: examining the relationship between game genres and internet gaming disorder. Cyberpsychol Behav Soc Netw (2016) 19(4):270–6. doi: 10.1089/cyber.2015.0415

PubMed Abstract | CrossRef Full Text | Google Scholar

110. Nuyens F, Deleuze J, Maurage P, Griffiths MD, Kuss DJ, Billieux J. Impulsivity in multiplayer online battle arena gamers: preliminary results on experimental and self-report measures. J Behav Addict (2016) 5(2):351–6. doi: 10.1556/2006.5.2016.028

PubMed Abstract | CrossRef Full Text | Google Scholar

111. Griffiths MD, Nuyens F. An overview of structural characteristics in problematic video game playing. Curr Addict Rep (2017) 4(3):272–83. doi: 10.1007/s40429-017-0162-y

PubMed Abstract | CrossRef Full Text | Google Scholar

112. Billieux J, Chanal J, Khazaal Y, Rochat L, Gay P, Zullino D, et al. Psychological predictors of problematic involvement in massively multiplayer online role-playing games: illustration in a sample of male cybercafe players. Psychopathology (2011) 44(3):165–71. doi: 10.1159/000322525

PubMed Abstract | CrossRef Full Text | Google Scholar

113. Zanetta Dauriat F, Zermatten A, Billieux J, Thorens G, Bondolfi G, Zullino D, et al. Motivations to play specifically predict excessive involvement in massively multiplayer online role-playing games: evidence from an online survey. Eur Addict Res (2011) 17(4):185–9. doi: 10.1159/000326070

PubMed Abstract | CrossRef Full Text | Google Scholar

114. Märtens M, Shen S, Iosup A, Kuipers F. Toxicity detection in multiplayer online games. Paper presented at the 2015 International Workshop on Network and Systems Support for Games NetGames (2015). doi: 10.1109/NetGames.2015.7382991

CrossRef Full Text | Google Scholar

115. Tyack A, Wyeth P, Johnson D. The appeal of moba games: what makes people start, stay, and stop. Paper presented at the Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (2016). doi: 10.1145/2967934.2968098

CrossRef Full Text | Google Scholar

116. Spada MM, Caselli G. The metacognitions about online gaming scale: development and psychometric properties. Addict Behav (2017) 64:281–6. doi: 10.1016/j.addbeh.2015.07.007

PubMed Abstract | CrossRef Full Text | Google Scholar

117. Wu JYW, Ko HC, Wong TY, Wu LA, Oei TP. Positive outcome expectancy mediates the relationship between peer influence and internet gaming addiction among adolescents in Taiwan. Cyberpsychol Behav Soc Netw (2016) 19(1):49–55. doi: 10.1089/cyber.2015.0345

PubMed Abstract | CrossRef Full Text | Google Scholar

118. Blinka L, Skarupova K, Mitterova K. Dysfunctional impulsivity in online gaming addiction and engagement. Cyberpsychology (2016) 10(3). doi: 10.5817/CP2016-3-5

CrossRef Full Text | Google Scholar

119. Hu JP, Zhen SJ, Yu CF, Zhang QY, Zhang W. Sensation seeking and online gaming addiction in adolescents: a moderated mediation model of positive affective associations and impulsivity. Front Psychol (2017) 8:699. doi: 10.3389/fpsyg.2017.00699

PubMed Abstract | CrossRef Full Text | Google Scholar

120. Schneider LA, King DL, Delfabbro PH. Family factors in adolescent problematic Internet gaming: a systematic review. J Behav Addict (2017) 6(3):321–33. doi: 10.1556/2006.6.2017.035

PubMed Abstract | CrossRef Full Text | Google Scholar

121. Jose PE, Weir KF. How is anxiety involved in the longitudinal relationship between brooding rumination and depressive symptoms in adolescents? J Youth Adolesc (2013) 42(8):1210–22. doi: 10.1007/s10964-012-9891-3

PubMed Abstract | CrossRef Full Text | Google Scholar

122. McMahon TP, Naragon-Gainey K. The moderating effect of maladaptive emotion regulation strategies on reappraisal: a daily diary study. Cogn Ther Res (2018) 42(5):552–64. doi: 10.1007/s10608-018-9913-x

CrossRef Full Text | Google Scholar

123. Zimmermann P, Iwanski A. Emotion regulation from early adolescence to emerging adulthood and middle adulthood age differences, gender differences, and emotion-specific developmental variations. Int J Behav Dev (2014) 38(2):182–94. doi: 10.1177/0165025413515405

CrossRef Full Text | Google Scholar

124. Villani D, Carissoli C, Triberti S, Marchetti A, Gilli G, Riva G. Videogames for emotion regulation: a systematic review. Games Health J (2018) 7(2):85–99. doi: 10.1089/g4h.2017.0108

PubMed Abstract | CrossRef Full Text | Google Scholar

125. Dore BP, Silvers JA, Ochsner KN. Toward a personalized science of emotion regulation. Soc Pers Psychol Compass (2016) 10(4):171–87. doi: 10.1111/spc3.12240

CrossRef Full Text | Google Scholar

126. Dong G, Wang L, Du X, Potenza MN. Gender-related differences in neural responses to gaming cues before and after gaming: implications for gender-specific vulnerabilities to Internet gaming disorder. Soc Cogn Affect Neurosci (2018) 13(11):1203–14. doi: 10.1093/scan/nsy084

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: online gaming, rumination, positive reappraisal, emotion regulation, adolescent gaming, gender differences

Citation: Kökönyei G, Kocsel N, Király O, Griffiths MD, Galambos A, Magi A, Paksi B and Demetrovics Z (2019) The Role of Cognitive Emotion Regulation Strategies in Problem Gaming Among Adolescents: A Nationally Representative Survey Study. Front. Psychiatry 10:273. doi: 10.3389/fpsyt.2019.00273

Received: 13 October 2018; Accepted: 10 April 2019;
Published: 29 April 2019.

Edited by:

Yasser Khazaal, Centre Hospitalier Universitaire Vaudois, Switzerland

Reviewed by:

Nan Li, RIKEN, Japan
Susana Jiménez-Murcia, Hospital Universitario de Bellvitge, Spain

Copyright © 2019 Kökönyei, Kocsel, Király, Griffiths, Galambos, Magi, Paksi and Demetrovics. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Gyöngyi Kökönyei, kokonyei.gyongyi@ppk.elte.hu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.