Original Research ARTICLE
Perceived Effort in Football Athletes: The Role of Achievement Goal Theory and Self-Determination Theory
- 1Centro de Investigação de Desporto, Saúde e Desenvolvimento Humano – CIDESD, Vila Real, Portugal
- 2Sport Science School of Rio Maior, Polytechnic Institute of Santarém, Rio Maior, Portugal
- 3Faculty of Physical Education and Sport, Universidade Lusófona de Humanidades e Tecnologias, Lisbon, Portugal
- 4Department of Sport Sciences, University of Beira Interior, Covilhã, Portugal
- 5Department of Sport and Well Being, Polytechnic Institute of Castelo Branco, Castelo Branco, Portugal
- 6Sport, Health and Exercise Research Unit, Polytechnic Institute of Castelo Branco, Castelo Branco, Portugal
- 7Laboratory of Physical Activity Neuroscience, Physical Activity Sciences Post-Graduate Program, Salgado de Oliveira University, Niterói, Brazil
- 8Laboratory of Panic and Respiration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil
- 9Intercontinental Neuroscience Research Group, Rio de Janeiro, Brazil
This study examined the motivational determinants of athletes perceived effort in football considering the four-stage motivational sequence at the contextual level proposed by Hierarchical Model of Intrinsic and Extrinsic Motivation: task-involving climate, basic psychological needs, self-determined motivation (SDM), and perceived effort. Additionally, SEM multi-group analysis across different age-groups (U15, U17, U19, and U21 years) and serial mediation of basic psychological needs (BPNs) and SDM on the task-involving motivational climate and the perceived effort were also analyzed. Two independent samples of male football athletes (N = 403, N = 403), aged 13–20 years were enrolled in this study. The results support the adequacy of the structural model in explaining the perceived effort of football atheltes in all samples under analysis, and was invariant across U17, U19, and U21. However, it was not invariant across U15 and U17, U19 and U21. Furthermore, results from the serial mediation showed significant indirect effects in all samples, supporting self-determination theoretical assumptions, reinforcing the importance of BPNs satisfaction and behavioral regulation in the relation in analysis. The results show that when coaches promote a task-involving climate, the BPNs satisfaction of athletes improves. This climate will facilitate the regulation of their behaviors toward more autonomous forms of motivation, with positive outcomes in the athletes perceived effort.
Motivation in sports context is one of the most studied cognitive variables (Roberts, 2012), and has been highlighted in the last years as a determinant of performance in football (e.g., Álvarez et al., 2009, 2012; Quested et al., 2013). In this field, the self-determination theory (SDT; Deci and Ryan, 2000) and achievement goal theory (AGT; Nicholls, 1984) were considered the most comprehensive theoretical frameworks for understanding cognitive, behavioral, and emotional patterns associated with practitioners goals in sport contexts (Duda, 2013).
Self-determination theory explains all of the determinants of intrinsic and extrinsic motivation, considering one’s personal factors and his involvement in a social context as causes of self-determined behavior (Deci and Ryan, 2008a). According to Deci and Ryan (2000), the quality of motivation is influenced by the satisfaction of the three basic psychological needs (BPNs): autonomy (feeling of independence in which the individual regulates his own actions), competence (successful interactions with the environment), and relatedness (social connection with others). These BPNs are considered to be innate and universal, indicating that they are part of all human being’s heritage. The satisfaction of these three BPNs explain individuals’ behavior along a motivational continuum, that goes from amotivation (no intention of behavior regulation or lack of willingness to act) at one end, passing through the controlled forms of motivation (external and introjected regulation), until the most self-determined forms of motivation (identified and integrated regulation and intrinsic motivation).
Several researches in the sport context have shown that athletes who perceive that their BPNs have been met, are able to better regulate their behavior in a more self-determined motivation (SDM), thereby achieving more positive consequences, such as lower dropout rates (Sarrazin et al., 2002) and increased well-being (Jowett et al., 2017). In contrast, those who perceive that their needs have not been met or frustrated tend to regulate their behavior in a less SDM way (Duda, 2013).
Additionally, self-determined or autonomous motivation has been positively associated with cognitive, emotional, and behavioral outcomes such as enjoyment, well-being, effort, among others (e.g., Guzmán and Kingston, 2012; Pope and Wilson, 2012; Jowett et al., 2017). In SDT framework, perceived effort refers to the subject’s investment of his/her abilities in what he/she is doing and reflects the level of involvement and effort put in a given activity (McAuley et al., 1989; Pope and Wilson, 2012). This may pose as a particularly important factor when considering some of the general sport demanding characteristics, like learning processes, in-task participation, and several consequential adaptive outcomes (e.g., physiological).
Still in line with this particular behavioral outcome, higher levels of SDM have shown positive associations with perceived effort, particularly when considering the influence of intrinsic motivation (Pelletier et al., 1995; Pope and Wilson, 2012). Moreover, perceptions of BPNs have been associated with higher ratings of perceived effort, both through direct and indirect effects (Standage et al., 2005; Hein et al., 2018) and, regarding environmental characteristics, autonomy-supportive behaviors by the teacher/coach have been associated with greater effort in several sport-related contexts and intentions to maintain future sports practice (Pelletier et al., 1995; Reeve et al., 2002; Standage et al., 2006).
Another important aspect that should be considered in sport context is the motivational climate created by the coach and perceived by athletes. It refers to the environment created by the coach, based on what he or she says and does, both in training and competition (Keegan et al., 2010; Harwood et al., 2015). The coach behavior is one of the most important characteristic that influence the quality of athletes motivation, considering that they (coaches) play a key role in the promotion of a more adjusted psychological climate, recognized in literature as a particular important in the promotion of enjoyment (Quested et al., 2013), persistence in sports (Sarrazin et al., 2002), prevention of dropout (Pelletier et al., 2001), as well as perceived effort (Pope and Wilson, 2012).
Thus, AGT proposes two type of climates: (a) task-involving, where learning and personal progress are emphasized, task effort is rewarded and mistakes are part of the learning process; (b) ego-involving, where the comparison between subjects and demonstration of competence is highlighted, the result is rewarded and the mistake emphasized, giving rise to punishments (Duda, 2001; Keegan et al., 2010; Harwood et al., 2015). Previous research has revealed that a coach intervention based on a task-involving climate, comparatively to an ego-involving climate, allows the development of more challenging tasks with practitioners, encouraging harder and better motivated work, in order to achieve individual and collective goals, and with a corresponding decrease in practitioners’ dropouts rates (Keegan et al., 2010; Roberts, 2012; Harwood et al., 2015).
Taking into account the relevance with which each of these theories (SDT and AGT) has been applied to the sport context (Sarrazin et al., 2002; Duda, 2013; Appleton et al., 2016; Smith et al., 2016), researchers have integrated both theories to provide a multi-theoretical framework of sport behavior (Duda, 2013). The key element that reflects the integration of the two theories is that the motivational climate might affect the regulation of athletes’ motivations because it can facilitate/inhibit the satisfaction of their BPNs (Sarrazin et al., 2007).
According to Duda (2013), the literature that integrates SDT and AGT has been concerned with the identification of key dimensions associated with the environment created by the coach (in which coach behaviors influence motivation) as well as the motivational mechanisms through which these coach behavioral dimensions influence the way athletes think, feel, and act in the sporting context. This conceptualization (Duda, 2013) presupposes that coach-created motivational climate is multidimensional and can be more or less empowering (task-involving, autonomy supportive, and socially supportive) or dis-empowering (ego-involving and controlling). The links between these two constructs (task-involving motivational climate and autonomy supportive climate) were put in evidence in the study conducted by Appleton et al. (2016). Therefore, a more empowering climate should lead to BPN’s satisfaction, while a more dis-empowering climate should lead to the thwarting of BPNs (Duda, 2013).
Therefore, from a contextual point of view, the AGT addresses the coach-created a motivational climate and its relation to cognitions, affects, and behaviors, while SDT explains how the contextual factors influence the motivation of the subject through BPN’s satisfaction (Duda, 2013). The Hierarchical Model of Intrinsic and Extrinsic Motivation (HMIEM), was proposed by Vallerand (1997) based in SDT principles (Deci and Ryan, 1985), explaining the function of the three levels of generality: global (personality), contextual (domains of life), and situational (state). According to Vallerand (1997), the sequence starts with: social factors (where the climate created by the coach was included), followed by BPNs (autonomy, competence, and relatedness) until the types of motivation (self-determined and non-self-determined forms or autonomous and controlled forms) and consequences (perceived effort).
In line with that, the key element to combine both theories is to consider that the motivational climate might affect the athletes’ motivational regulation because it can facilitate/inhibit their BPNs satisfaction (Adie et al., 2008; Duda, 2013; Appleton et al., 2016). In fact, the literature that integrates both theories in the sport context has shown that a task-involving motivational climate positively allow BPNs (Álvarez et al., 2009, 2012; Appleton et al., 2016), while an ego-involving motivational climate had the opposite result and could lead to BPN frustration achievements (Duda, 2013; Appleton et al., 2016).
Some authors (Álvarez et al., 2012) demonstrated that satisfaction of needs is predicted by a task involving climate in football context, showing higher levels of intrinsic motivation in athletes, revealing greater intentions to remain involved in the practice, and higher levels of subjective vitality. Reinboth and Duda (2006) also show similar results, emphasizing that a climate that promotes autonomy, exhibiting the involvement for a task (Duda, 2013), has a positive and significant influence in psychological needs satisfaction during a sporting season in university athletes. Some studies have empirically tested the full-sequence postulated by Vallerand (1997). For example, Sarrazin et al. (2002) demonstrated that each of the BPN and non-SDM forms were predicted significantly and positively, being associated with higher intentions to dropout. However, according to Pope and Wilson (2012), the HMIEM needs to be analyzed in other sports and consider different competitive levels. To our knowledge, no study has analyzed the impact of the motivational climate created by the coach in satisfying BPNs, regulation motivation, and possible consequences in perceiving athletes’ effort. Thus, the main goals of this study were: (i) to test the motivational determinants of athletes perceived effort in football considering the four-stage motivational sequence at the contextual level proposed by HMIEM (Vallerand, 1997): motivational climate (task-involving climate) → BPNs → types of motivation (SDM) → consequences (perceived effort); (ii) to test the structural equation modeling (SEM) multi-groups analysis across samples and age groups (under 15 years; under 17 years; under 19 years, and under 21 years); and (iii) to analyze the mediation role of BPNs and SDM on the task-involving climate and the perceived effort.
Materials and Methods
Two independent samples of athletes of several football clubs from Portugal were enrolled in this study. The first sample comprised 403 football players and reflected the model calibration sample (CS); the second sample comprised 403 football players and reflected the model validation sample (VS). For multi-group analysis, the total sample was divided into different age groups (under 15 years; U15), (under 17 years; U17), (under 19 years; U19), and (Under 21 years; U21). Samples characteristics are presented in Table 1.
Motivational Climate Sport Youth Scale (Smith et al., 2008) – Portuguese version (MCSYSp: Monteiro et al., 2018a) was used. This questionnaire comprises eight items with a five-point Likert scale, which varied between 1 (“Strongly Disagree”) and 5 (“Strongly Agree”). The items are grouped into two factors (with four items each), which reflected the two dimensions underlying AGT framework (Nicholls, 1984). However, in this study, only the four items of the task-involving climate subscale were used.
Basic Psychological Needs Exercise Scale (Vlachoupoulos and Michailidou, 2006). The Portuguese version adapted to sports contex by Monteiro et al. (2016) was used in present study. This questionnaire encompassed 12 items with a five-point Likert scale, which varied between 1 (“Strongly Disagree”) and 5 (“Strongly Agree”). The items are grouped into three factors (with four items each), which reflected BPN’s underlying SDT (Deci and Ryan, 2000). For the purpose of this study, a second-order factor underlying the three BPNs was used (i.e., representing the composite factor of BPNs). Previous studies supported the use of second-order factor (e.g., Quested et al., 2013; Monteiro et al., 2016).
Behavioral Regulation Sport Scale (Lonsdale et al., 2008) – Portuguese version (Monteiro et al., 2018b) was used. This questionnaire included 24 items with a seven-point Likert scale, which varies between 1 (“Nothing True for Me”) and 7 (“Totally True for Me”). The items are grouped into six factors (with four items each), which reflect the motivational continuum of SDT (Deci and Ryan, 2000). For the purpose of this study, one construct was created, thus representing SDM (intrinsic motivation, integrated, and identified regulations) as suggested by Pelletier and Sarrazin (2007). Previous studies supported this methodological procedure (Álvarez et al., 2009; Clancy et al., 2017; Keshtidar and Behzadnia, 2017).
Intrinsic motivation inventory (IMI; McAuley et al., 1989) – Portuguese version (Fonseca and Brito, 2001) was used. However, for the purpose of this study, only the subscale of “Perceived Effort” was used. This sub-scale comprise five items (2, 6, 10, 14, 17) with a five-point Likert scale, which varied between 1 (“strongly disagree”) and 5 (“strongly agree”), noting that the score of 14 and 17 items was previously reversed because of its semantic formulation its semantic formulation1.
After obtaining authorization from the clubs executive board to conduct the research, all parents/legal guardians of athletes under 18 years old were contacted by the first researcher so that written informed consent was obtained, authorizing their children/athletes to participate in the research. However, for the athletes greater than or equal to 18 years old, only written informed consent was obtained. To promote honesty in the answers and guarantee the confidentiality of data, all information was collected anonymously. Before data collection, ethical approval was obtained from the committee of the Research Center in Sports Sciences, Health Sciences and Human Development (CIDESD), unit that is registered in the Portuguese National Science Foundation (FCT) under the reference UID/DTP/04045/2013. The data from the questionnaires were collected at the beginning of the training sessions in about 25 min. Twelve months after collecting data from the CS group, we collected information from VS group. This is the reason why individuals were not randomly assigned to the sample groups.
Descriptive statistics (means and standard deviations) as well as bivariate correlations were calculated for all variables in the two samples (CS and VS).
Although there is no consensus in the literature regarding the minimum number of subjects to perform the SEM (Barret, 2007; Hair et al., 2014), several authors suggest as a recommendation, between number of subjects and number of model parameters to be estimated, a ratio of 10:1 (advisable) or 5:1 (minimum) (Bentler and Chou, 1987; Worthington and Whittaker, 2006; Kline, 2016). Thus, in the present study, the model under analysis has 29 parameters to be estimated, therefore the recommended ratio (i.e., 10:1) was not fulfilled only in the subgroup model analysis (U15, U17, U19, and U21). In order to avoid this possible limitation, we proceeded to calculate the required sample size, according to the model under analysis (i.e., number of predictors), using GPower 3.1 software (Faul et al., 2009) with the results pointing (effect size f2 = 0.1; α = 0.05; statistical power = 0.95) that the minimum required size would be 176 subjects, which was respected in the present study.
For analyzing relationships between constructs, structural equation with maximum likelihood (ML) estimated method was performed. SEM analysis was performed according to the recommendations of several authors (Byrne, 2010; Hair et al., 2014), namely: chi-squared (χ2), degrees of freedom (df), and the level of significance (p), as well as, the traditionally goodness-of-fit indexes: standardized root mean square residual (SRMR), comparative fit index (CFI), root mean square error of approximation (RMSEA), and the respective confidence interval (90% CI). For these goodness-of-fit-indexes the following cut-off values suggested by several authors (Marsh et al., 2004; Byrne, 2010; Hair et al., 2014) were used: SRMR ≤ 0.08, CFI ≥ 0.90, and RMSEA ≤ 0.08; and the Cronbach’s alpha (α) to assess the reliability of the factors, considering α ≥ 0.70 as cutting values (Nunnally, 1978). Finally, confidence interval 90% and p-value for all structural weights were also analyzed (Hair et al., 2014). The analyses were undertaken using SPSS 20.0 and AMOS 20.0.
Cross-Validation and SEM Multigroup Analysis
Cross-validation and SEM multigroup analysis were performed, in order to demonstrate that this model can be replicated in different groups, as suggested by Byrne (2010). These analysis were undertaken in line with previous research (Cheung and Rensvold, 2002; Byrne, 2010): (1) the structural model should be adjusted to each group; (2) a multigroup analysis was performed examining the following invariance types: unconstrained model; measurement weights; structural weights; measurement intercepts, structural residuals, and measurement residuals. Invariance assumptions were verified through the differences of the CFI with ΔCFI ≤ 0.01 (Cheung and Rensvold, 2002; Byrne, 2010). The analysis was undertaken using AMOS 20.0.
Considering theoretical and practical implications, serial mediation procedures were used to access mediation effects in the proposed causal model. Preacher and Hayes (2008) PROCESS macro for SPSS used grounded in the model 6 path analysis. With this procedure, the direct and indirect effects of X on Y, while modeling a process in which X causes M1, and, in turn, causes M2, concluding with the outcome Y, can be studied (Preacher and Hayes, 2008; Hayes, 2013). The proposed model (i.e., model 6) ensures the control of the indirect effects for other estimated variables, allowing also independent mediator effect analysis and regression coefficients for each causal steps of the indirect effects. Bias-corrected bootstrapped point estimates for the indirect effects of the independent variable on the dependent variable were estimated, considering standard errors and 95% confidence intervals. Significant indirect effects were considered (at alfa = 0.05) if its 95% confidence intervals does not include zero. Bias corrected and accelerated intervals supported by a 5000 samples bootstrapping were used to make inferences. Bootstrapping procedures have been recommended by MacKinnon et al. (2004) as more efficient than the normal theory approach and more powerful detecting indirect effects in smaller samples.
No missing values were registered, while six cases (CS) and eight cases (VS) emerged either as univariate outliers (z > 3.00) and multivariate outliers (D2= p1 < 0.001, p2 < 0.001). These participants were removed to conduct further analysis. Skewness and Kurtosis values (between -2 and +2 and -7 and +7, respectively) revealed no deviations from univariate normality (Hair et al., 2014). However, the multivariate kurtosis of Mardia’s coefficient was greater than to 5.0 in all samples under analysis. Consequently, bootstrap Bollen–Stine (2000 samples) was performed (Nevitt and Hancock, 2001).
Analysis of differences between groups was also performed for the variables under analysis (i.e., task-involving climate, BPNs, SDM, and perceived effort). The one-way ANOVA revealed no differences (p > 0.05) between age groups (U15, U17, U19, and U21). Descriptive statistics, internal reliability scores, and bivariate correlation for all variables under analysis are presented in Table 2. Participants demonstrated high mean scores for all the constructs (i.e., above the midpoint).
TABLE 2. Descriptive statistics including means, standard deviations, correlations, and composite reliability for calibration and validation samples.
As we can see, Table 3 shows that all structural models adjusted to the data according to cut-off values adopted in the methodology, except for the SRMR in the U17 and U19 samples.
As we can observe in Figures 1 (CS), 2 (VS), there are a positive and significant effects among all constructs. For CS it was observed that: task-involving – BPNs (β = 0.46; 90% CI 0.333–0.594, p = 0.001); BPNs – SDM (β = 0.58; 90% CI 0.469–0.683, p = 0.001); SDM-perceived effort (β = 0.44; 90% CI 0.344–0.540, p = 0.001). Standardized indirect effects also showed a positive and significant effect between task-involving climate and SDM (β = 0.27; 90% CI 0.166–0.392, p = 0.001) through BPNs. Also, task-involving predicted perceived effort (β = 0.12; 90% CI 0.070–0.197, p = 0.001), through SDM, and BPNs predicted perceived effort (β = 0.28; 90% CI 0.178–0.346, p = 0.001) through SDM. For VS it was observed that: task-involving – BPNs (β = 0.67; 90% CI 0.576–0.764, p = 0.001); BPNs – SDM (β = 0.68; 90% CI 0.589–0.762, p = 0.002); SDM – perceived effort (β = 0.43; 90% CI 0.321–0.529, p = 0.001). Standardized indirect effects also showed a positive and significant effect between task-involving climate and SDM (β = 0.46; 90% CI 0.321–0.529, p = 0.001), through BPNs, as well as between task-involving climate and perceived effort (β = 0.19; 90% CI 0.129–0.281, p = 0.001) through SDM, and BPNs predicted perceived effort (β = 0.30; 90% CI 0.203–0.390, p = 0.001) through SDM.
FIGURE 1. Individual standardized parameters of the initial hypothetical model (validation sample). MCSYS from 2 to 9 representing the items of the scale. COM, competence; AUT, autonomy; REL, relatedness; IDR, identified regulation; IGR, integrated regulation; IM, intrinsic motivation; perceived effort, from 1 to 3 representing the items of the scale; E, measurement errors of each of the items and factor.
FIGURE 2. Individual standardized parameters of the initial hypothetical model (calibration sample). MCSYS from 2 to 9 representing the items of the scale. COM, competence; AUT, autonomy; REL, relatedness; IDR, identified regulation; IGR, integrated regulation; IM, intrinsic motivation; perceived effort, from 1 to 3 representing the items of the scale; E, measurement errors of each of the items and factor.
The direct and indirect effects among all constructs in samples under analysis are provided in Table 4. In general, results revealed a positive and significant effect from both direct and indirect paths, except for the U21 sample (i.e., SDM–PE). In the U15 sample, due to a BPNs – self-determined motivation relation superior to 0.84 (Hair et al., 2014) (i.e., β = 0.91), a possible multicollinearity issue could be present. For this matter, and accordingly with some authors recommendations (Hair et al., 2014), the variance inflation factor (VIF) was calculated, assuming < 3.00 as cut-off value, in order to discard multicollinearity issues. The VIF for these variables was 1, rejecting that possibility (Hair et al., 2014).
With respect to structural model invariance (Tables 5, 6), the results support the structural equivalence across samples (calibration and validation) and across U17, U19, and U21 age groups. Therefore, all factor loadings, structural paths, factor covariances, factor residual variances, and measurement error variances are operating equivalently across samples, as well as across age groups (ΔCFI < 0.01). However, the results did not show evidence of invariance across U15 and remaining groups (ΔCFI > 0.01).
TABLE 5. Goodness-of-fit indexes for the invariance of the structural model across samples and age-groups.
In Figure 3 presented are the mediating effects of BPNs and SDM in the relationship between task-involving climate and perceived effort in the four samples. Analysis shows that in all samples there are significant indirect effects, supporting SDT theoretical assumptions in the context of this study.
FIGURE 3. Serial mediation models for task involvement, basic psychological needs, autonomous regulations, and perceived effort. Attached file “Mediation_Models.” ∗p < 0.05; ∗∗p < 0.01; ∗∗∗p < 0.001; ¥ = 90% CI of the bias and corrected and accelerated estimate indicate a significant indirect effect; significant effect → ; non-significant effect → ; BPN, basic psychological needs; SDM, self-determined motivation.
Task-involving climate presented in all mediation models revealed positive significant associations with BPN and SDM. BPN sustained in all groups a positive association with perceived effort, while SDM was only positively associated with perceived effort in the U15 and U19 samples. In direct effect analysis, the U17 and U21 samples showed that the task involvement was, respectively, positively (0.34, p < 0.001) and negatively (-0.18, p = 0.04) associated with perceived effort. Models predictions also seem to decrease across age: 16% (p < 0.001) in the U15; 14% (p < 0.001) in the U17; 3% (p < 0.05) in the U19; and no statistical significance in the U21 (1%, p = 0.41).
The aim of this study was to examine the motivational determinants of athletes perceived effort in football considering the four-stage motivational sequence at the contextual level proposed by HMIEM: task-involving climate, BPNs, SDM, and perceived effort. Additionally, SEM multi-group analysis across different age groups (U15, U17, U19, and U21 years) and the serial mediation of BPNs and SDM on the task-involving climate and the perceived effort were also analyzed.
Results of the present study show that the subjects value all the constructs underlying the hypothesized model. This is in line with previous studies, not only in football (Álvarez et al., 2012), but also in other sports (Pelletier et al., 2001; Sarrazin et al., 2002; Guzmán and Kingston, 2012; Pope and Wilson, 2012), which reveals the importance of the theoretical constructs underlying the AGT (task-involving) and SDT (BPNs and behavioral regulation) in the sports context.
It is possible yet to see that there are positive and significant bivariate correlations among all constructs under analysis (i.e., task-involving motivational climate, BPNs, SDM, and perceived effort). These evidences corroborate several studies that have been carried out with these theoretical models in several sports, such as: swimming (Pelletier et al., 2001), football (Álvarez et al., 2012), rugby (Pope and Wilson, 2012), as well as across different individual and team sports (Guzmán and Kingston, 2012).
As expected, the findings of the present study provided overall support for this model. The results show that it was adjusted to the data, in all age groups under analysis (Marsh et al., 2004; Byrne, 2010; Hair et al., 2014). In general the results show that a task-involving motivational climate is a positive and significant predictor of BPNs in all age groups. In turn, BPNs are a positive and significant predictor of SDM, and SDM is a positive and significant predictor of perceived effort. These results are justified both from a theoretical (Deci and Ryan, 2000) and an empirical point of view (Sarrazin et al., 2002; Álvarez et al., 2012; Pope and Wilson, 2012).
From a theoretical point of view, motivation is not directly related to the social factors, but through the satisfaction of the three BPNs (responsible for continuous growth, integrity, and well-being), that are the main promoters of how subjects will regulate their behavior (Deci and Ryan, 2008b). According to Duda (2013), AGT and SDT conceptualize key aspects of motivation at the contextual level, because both theories suggest that atmosphere that are less evaluative, give more support to the intrinsic desire to learn, and promote the basis to increase achievement. This reinforces the issue pointed by Duda and Appleton (2016), where the task-involving motivational climate is a climate that is autonomy supportive, that promotes empowering environment. Thus, a motivational climate, created by the coach, that promotes task involving, favors BPN’s satisfaction, being the basis of SDM (Ryan and Deci, 2007), which can be particularly important in the sport’s field, since the SDM (or autonomous motivation) is among the most important factors in behavior maintenance over time (Jõseaar et al., 2011, 2012). From an empirical point of view, these results corroborate several studies carried out in last years (Pelletier et al., 2001; Sarrazin et al., 2002; Álvarez et al., 2009, 2012; Guzmán and Kingston, 2012; Pope and Wilson, 2012; Duda, 2013), who have shown that athletes who perceive a task-involving climate feel their BPNs more satisfied, and in turn, promote high levels of SDM or autonomous motivation. The results of the present study also reinforce that task-involving motivational climate could be supportive of autonomy. According to Duda (2013) conceptualization, the coach-created a motivational climate is multidimensional and can be empowering (task-involving, autonomy supportive), since both promote BPN’s satisfaction, and also positive outcomes (e.g., enjoyment or self-worth) (Appleton and Duda, 2016). This issue could be particularly important because task-involving motivational climate can also be influenced by the ratio of autonomy and controlling coaching emphasis, since both of them can coexist in sport domain (Appleton et al., 2016).
For example, across-cultural study conducted by Jowett et al. (2017), the authors demonstrated not only the relations between a positive motivational climate, BPNs, behavior regulation, and well-being, but also that relationships remain the same in different cultures (British, Chinese, Greek, Spanish, and Swedish), which empirically demonstrates the universality of these constructs. This means that SDT constructs are universal in their importance and their effects (Deci and Ryan, 2008a).
Finally, regarding the associations between SDM and perceived effort of athletes, results demonstrate a positive and significant association in all age groups, except, in the U21. This result corroborates the evidence found by Pope and Wilson (2012), which demonstrates that autonomous motivation was a positive and significant predictor of perceived effort, which was explained by 21% (similar to our results in both samples). Thus, these results demonstrate that with the development of the sports career, the impact of autonomous motivation on perceived effort seems to lose importance.
As said above, the effect of SDM and perceived effort in U21 sample was not significant. This result reveals that SDM in this age group may not be an important predictor of perceived effort. This result contradicts some studies (e.g., Pope and Wilson, 2012), where the authors demonstrated positive and significant relationships between the SDM and perceived effort. In this sense, the perceived effort in this age group seems to be explained by other factors than those analyzed in the present study.
According to the long-term development model, the U21 group is designed as the stage – training to win. It means players at that moment of career development are focused on individual and team performance (Balyi et al., 2013). Due to the constant competition to improve their capabilities, as well as to ensure a position on the team, we can speculate that players need to maintain their focus on the efforts to train and compete, rather than on the issues related with the SDM. More than that, it is well reported that this is a critical moment of career development of players (i.e., transition from junior to senior players) and the expectations to ensure a position on the team or a contract on the club (Stambulova, 2016) could change the motivational regulation of players, emphasizing the perceived effort to improve performance. Also, the analysis of athlete–coach relationships across the career stages of players revealed that the friendliness and the emotional relations developed at the beginning of players’ career decreased to more neutral relationships, focused on results and on the work developed (Sandström et al., 2016).
Further studies should be developed to evaluate the association between BPNs, SDM, and perceived effort in different levels of career development and in different levels of performance in order to substantiate these findings.
With regard to the structural invariance tests, our results showed that the model was structurally invariant across samples and age groups (U17, U19, and U21), thereby confirming the equivalence of the model across different groups of players. This fact reveals the importance of these relationships in the perceived effort of the athletes, thus demonstrating the suitability of this model in the specific context of football.
Referring to U15, structural invariance assumptions were not verified (ΔCFI > 0.01), which shows that neither the effects observed between the variables, nor the respective theoretical assumptions under analysis, can be interpreted between U15 and the remaining age groups (Byrne, 2010). According to Chen (2008) and Sass (2011), it is not legitimate to compare results between U15 and other age groups, since any result obtained may be biased since the model did not reveal invariance criteria. This seems to be linked to the specific characteristic of this age group. According to Sandström et al. (2016), there is an increase in friendliness between the initiation and the following levels of sport/practice development, and a decrease in more advanced stages, showing a more neutral emotional relationship. Coaches’ involvement was higher on the development stages, and changed gradually on later stages, according to athletes’ perceptions.
As for the mediation effects, in addition to the theoretical postulates advocated by Deci and Ryan (2000, 2008a) and Ryan and Deci (2007) in SDT, as well as for HMIEM proposed by Vallerand (1997) and empirically confirmed in several studies in the sports context (e.g., Álvarez et al., 2012; Jowett et al., 2017), there are also relevant issues from a statistical point of view, since the observed indirect effects between the variables are significant, which according to Hair et al. (2014), is suggestive of mediation, which reinforces the pertinence of the analysis made.
The mediation analysis provided additional information that partially supports previous interpretations. In all samples there were significant indirect effects, supporting theoretical SDT (Deci and Ryan, 2000, 2008a) and HMIEM (Vallerand, 1997) assumptions, reinforcing the importance of BPN’s satisfaction and behavioral regulation in the relation between task-involving climate and perceived effort in football. In the present sample, the mediating effects, direct effects (except in U17), and prediction values seem to decrease across age (i.e., more specifically, sport age groups), showing a tendency that anticipates a shift of the influence of the task-involving climate on the perceived effort in this sport activity across age groups. This may reflect that across age groups, and with a sport specialization associated with each phase of the athlete development, the climate perception is changed.
Considering that in the latter two age samples (U19 and U21) there is a phase of transition to a more specialized and, in some degree, more professional approach to the training and competition processes, classified as “advanced training” by FIFA (n.d.). It is possible to assume that the inevitable search and inter-individual competition for the performance and results in this advanced training phase may lead to a secondary position in the team play and/or draft, which in turn could possibly be interpreted by the athletes as a form of punishment by the coach (Keegan et al., 2010, 2014).
In fact, the task-involving climate and its characteristics were learning and personal progress are accepted, effort is rewarded and mistakes are considered as a normal part of the learning process, are very similar to the sports pedagogy approaches commonly used in youths training (e.g., Cassidy et al., 2004), and a shift in some coaching process are expected through more specialized approaches.
Additionally, SDT mediators presented a similar tendency as previous causal steps analysis. The BPN’s satisfaction and SDM influence are particularly evident in the U15 and U17 age groups, being in line with some similar studies (e.g., Álvarez et al., 2009; Almargo et al., 2015), with the exception of the SDM in the U17 sample. In the serial mediation analysis, BPNs stand out as particularly important in the understating of these relations, because of the (i) positive association with the task-involving climate, (ii) positive association with perceived effort (and expectedly, with many other behavioral, cognitive, and affective outcomes that are not the main focus of this study, but reflect important aspects in physical activity/sports contexts; for review Ng et al., 2012; Teixeira et al., 2012), and (iii) positive association with autonomic regulations, that, despite not significant with perceived effort in the U17 and U21 samples, are reported in the literature as important to obtain better behavioral outcomes (Deci and Ryan, 2008a,b; Almargo et al., 2015).
These results tend to increasingly support the importance of BPN in sport context and particularly in youths football. Despite being in an early phase of study about possible interactions of all these variables (task-involving climate, BPN, behavioral regulation, and perceived effort interactions across age groups, and levels of participation/competition), the present study contributed to the dissemination of knowledge in the context of football, and corroborates the assumptions of Ryan (1995), which states that the research carried out with SDT should be done in a specific context.
However, although the present study demonstrates contextual and motivational determinants of perceived effort in football, some limitations should be accounted, in order to better understand the possible implications of present findings. Therefore, it should be considered that (i) the present study is of a cross-sectional nature, so we advised that future studies should analyze the same variables and methodology in a longitudinal/experimental way; (ii) future studies are encouraged to complement the measure of perceived effort with other observable physiological indicators (e.g., heart rate variability, lactate and cortisol measures) that may unveil theoretically expected relations between psychological perceived effort (i.e., behavioral consequence; reported levels of effort in the activity) and physiological adaptations; (iii) future studies should make an effort to analyze the effect of each BPN and needs frustration, in this particular context, because youth football athletes may perceive the characteristics of each level of practice differently, due to the inherent characteristic of training/competition process. Additionally, motivational regulation analysis (consequences of BPN’s satisfaction/frustration and motivational climate) in athletes performance should also be addressed in future studies; (iv) taking into account the multidimensional approach to the coach-created a motivational climate (Duda, 2013; Appleton and Duda, 2016; Duda and Appleton, 2016), that integrates the major social environmental dimensions emphasized within AGT and SDT, future studies should analyze the combined effect of the task-involving climate and autonomy supportive climate (i.e., empowering motivational climate), on the BPNs, motivational regulation, and different behavioral, emotional, and cognitive outcomes, in the context of football, as in other sports contexts; (v) ability heterogeneity in groups may influence competence perceptions, and may justify future ability profile analysis; (vi) taking into account the assumptions of HMIEM, the present study was conducted at the contextual level. However, situational motivation is also important to self-regulatory processes such as goal confidence, goal setting, and affect, which may operate in a cyclical manner. For that reason, future studies may address these issues to further understand the aforementioned relations.
Nevertheless, from the results of the present study we can draw some implications for the practice: (i) coaches that promote a task-involving-climate and improve the BPN’s satisfaction of athletes. This climate will facilitate the regulation of their behaviors toward more autonomous forms of motivation, with positive results in athletes’ perceived effort. Moreover, when coach-created a task-involving motivational climate, he is also implicitly promoting an autonomy supportive climate (i.e., empowering motivational climate), and more positive outcomes from his athletes can be expected (e.g., more enjoyment); (ii) training planning should promote more BPN’s satisfaction, creating training dynamics that promotes the feeling of autonomy and competence and strengthen the relationship among teammates; (iii) promote evaluation of the way that athletes regulate their motivation at the beginning of the season. The quality of motivation identification will allow coaches to promote more adapted tasks and roles to each player, helping them to achieve higher levels of perceived effort.
LC, DM, JM, PD-M, BT, and DT participated in study design, data collection, and writing of the first draft manuscript. LC, DM, DT, PD-M, and SM participated in data analysis and writing of the methodology and results. DT, DM, JM, PD-M, and BT participated in data collection and in final revisions of the manuscript. All authors have read and approved the final version of the manuscript, and agree with the order of presentation of the authors.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- ^ The measurement model with five items presented problems with its validity, because of that in the present study was used only three items. Previous studies (e.g., Monteiro et al., 2014) founded similar problems. In Pope and Wilson (2012) study, the authors used four items, since one item: “It is important to me to do well at this task”) was removed from the original IMI item pool because the item content represented personal importance as opposed to perceived effort expended in the activity under scrutiny” (p. 96)
Adie, A., Duda, J., and Ntoumanis, N. (2008). Autonomy support, basic need satisfaction and the optimal functioning of adult male and female sport participants: a test of basic needs theory. Motiv. Emot. 32, 189–199. doi: 10.1007/s11031-008-9095-z
Almargo, B., Bunuel, P., Moreno-Murcia, J., and Spray, C. (2015). Motivational factors in young spanish athletes: a qualitative focus drawing from self-determination theory and achivemente goal perspectives. Sport Psychol. 29, 15–28. doi: 10.1123/tsp.2013-0045
Álvarez, M., Balaguer, I., Castillo, I., and Duda, J. (2009). Coach autonomy support and quality of sport engagement in young soccer players. Span. J. Psycol. 12, 138–148. doi: 10.1017/S1138741600001554
Álvarez, M., Balaguer, I., Castillo, I., and Duda, J. (2012). The coach-created motivational climate, young athletes’ well-being, and intentions to continue participation. J. Clin. Sport Psychol. 6, 166–179. doi: 10.1123/jcsp.6.2.166
Appleton, P., and Duda, J. (2016). Examining the interactive effects of coach-created empowering and disempowering climate dimensions on athletes’ health and functioning. Psychol. Sport Exerc. 26, 61–70. doi: 10.1016/j.psychsport.2016.06.007
Appleton, P., Ntoumanis, N., Quested, E., Viladrich, C., and Duda, J. (2016). Initial validation of the coach-created Empowering and Disempowering Motivational Climate Questionnaire (EDMCQ-C). Psychol. Sport Exerc. 22, 53–65. doi: 10.1016/j.psychsport.2015.05.008
Chen, F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. J. Pers. Soc. Psychol. 95, 1005–1018. doi: 10.1037/a0013193
Duda, J. (2001). “Achievement goal research in sport: pushing the boundaries and clarifying some misunderstandings,” in Advances in Motivation in Sport and Exercise, ed. G. Roberts (Champaign, IL: Human Kinetics), 129–182.
Duda, J. (2013). The conceptual and empirical foundations of empowering coachingTM: setting the stage for the PAPA project. Int. J. Sport Exerc. Psychol. 11, 311–318. doi: 10.1080/1612197X.2013.839414
Duda, J., and Appleton, P. R. (2016). “Empowering and disempowering coaching climates: conceptualization, measurement considerations, and intervention implications,” in Sport and Exercise Psychology Research From Theory to Practice, eds M. Raab, P. Wylleman, R. Seiler, A. M. Elbe, and A. Hatzigeorgiadis (London: Academic press and Elsevier), 373–388. doi: 10.1016/B978-0-12-803634-1.00017-0
Faul, F., Erdfelder, E., Buchner, A., and Lang, A. G. (2009). Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160. doi: 10.3758/BRM.41.4.1149
Fonseca, A., and Brito, A. (2001). Propriedades psicométricas da versão portuguesa do Intrinsic Motivation Inventory (IMIp) em contextos de actividade física e desportiva. Análise Psicológica 19, 59–76. doi: 10.14417/ap.344
Harwood, C., Keegan, R., Smith, J., and Raine, A. (2015). A systematic review of the intrapersonal correlates of motivational climate perceptions in sport and physical activity. Psychol. Sport Exerc. 18, 9–25. doi: 10.1016/j.psychsport.2014.11.005
Hein, V., Emeljanovas, A., Ries, F., Valantine, I., Ekler, J., and Lópes, G. (2018). The perception of the autonomy supportive behaviour as a predictor of perceived effort and physical self-esteem among school students from four nations. Monten. J. Sports Sci. Med. 7, 1–10. doi: 10.26773/mjssm.180303
Jõseaar, H., Hein, V., and Hagger, M. (2011). Peer influence on younh athletes need satisfaction, intrinsic motivation and persistence in sport: a 12-month prospective study. Psychol. Sport Exerc. 12, 500–508. doi: 10.1016/j.psychsport.2011.04.005
Jõseaar, H., Hein, V., and Hagger, M. (2012). Youth athletes perception of autonomy support from the coach, peer motivational climate and intrinsic motivation in sport setting: one-year effects. Psychol. Sport Exerc. 12, 257–262. doi: 10.1016/j.psychsport.2011.12.001
Jowett, S., Adie, J., Bartholomew, K., Yang, S., Gustafsson, H., and Lopez-Jiménez, A. (2017). Motivational processes in the coach-athlete relationship: a multi-cultural self-determination approach. Psychol. Sport Exerc. 37, 143–152. doi: 10.1016/j.psychsport.2017.06.004
Keegan, R., Harwood, C., Spray, C., and Lavallee, D. (2014). A qualitative investigation of the motivational climate in elite sport. Psychol. Sport Exerc. 15, 97–107. doi: 10.1016/j.psychsport.2013.10.006
Keegan, R., Spray, C., Harwood, C., and Lavallee, D. (2010). “From ‘motivational climate’ to ‘motivational atmosphere’: a review of research examining the social and environmental influences on athlete motivation,” in Sport in Sport Psychology, eds R. Keegan, C. Spray, C. Harwood, and D. Lavalle (New York, NY: NovaScience Publications), 1–55.
Lonsdale, C., Hodge, K., and Rose, E. (2008). The Behavioral Regulation in Sport Questionnaire (BRSQ): instrument development and initial validity evidence. J. Sport Exerc. Psychol. 30, 323–355. doi: 10.1123/jsep.30.3.323
MacKinnon, D., Lockwood, C., and Williams, J. (2004). Confidence limits for the indirect effect: distribution of the product and resampling methods. Multi. Behav. Res. 39, 99–128. doi: 10.1207/s15327906mbr3901-4
Marsh, H., Hau, K., and Wen, Z. (2004). In search of golden rules: comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Struct. Equ. Model. 11, 320–341. doi: 10.1207/s15328007sem1103-2
McAuley, E., Duncan, T., and Tammen, V. (1989). Psychometric properties of the intrinsic motivation inventory in a competitive sports settings. Res. Q. Exerc. Sport 60, 48–58. doi: 10.1080/02701367.1989.10607413
Monteiro, D., Borrego, C., Silva, C., Moutão, J., Marinho, D., and Cid, L. (2018a). Motivational climate sport youth scale: measurement invariance across gender and five different sports. J. Hum. Kinetics 61, 235–243. doi: 10.1515/hukin-2017-0124
Monteiro, D., Marinho, D., Moutão, J., Couto, N., Antunes, R., and Cid, L. (2016). Adaptation and validation of the Basic psychological needs exercise scale to the sport domain and invariance across soccer and swimming. Motricidade 12, 51–61. doi: 10.6063/motricidade.9372
Monteiro, D., Moutão, J., Baptista, P., and Cid, L. (2014). Clima motivacional, regulação da motivação e perceção de esforço dos atletas no futebol. Motricidade 10, 94–104. doi: 10.6063/motricidade.10(4).3453
Nevitt, J., and Hancock, G. (2001). Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Struct. Equ. Model. 8, 353–377. doi: 10.1207/S15328007SEM0803-2
Ng, J. Y., Ntoumanis, N., Thogersen-Ntoumani, C., Deci, E. L., Ryan, R., Duda, J., et al. (2012). Self-determination theory applied to health contexts: a meta-analysis. Perspect. Psychol. Sci. 7, 325–340. doi: 10.1177/1745691612447309
Pelletier, L., Fortier, M., Vallerand, R., and Brière, N. (2001). Association among perceived autonomy support, forms of self-regulation, and persistence: a prospective study. Motiv. Emot. 25, 279–306. doi: 10.1023/A:1014805132406
Pelletier, L., Fortier, M., Vallerand, R., Tuson, K., Briere, N., and Blais, M. (1995). Toward a new measure of intrinsic motivation, extrinsic motivation, and amotivation in sports: the Sports Motivation Scale (SMS). J. Sport Exerc. Psychol. 17, 35–53. doi: 10.1123/jsep.17.1.35
Pelletier, L., and Sarrazin, P. (2007). “Measurement Issues in self-determination theory and sport,” in Intrinsic Motivation and Self-Determination in Exercise and Sport, eds M. Hagger and N. Chatzisarantis (Champaign, IL: Human Kinetics), 143–152.
Pope, P., and Wilson, P. (2012). Understanding motivational processes in university rugby players: 5 a preliminary test of the hierarchical model of intrinsic and extrinsic motivation at the contextual 6 level. Int. J. Sport Sci. Coach. 7, 89–107. doi: 10.1260/1747-95184.108.40.206
Preacher, K., and Hayes, A. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behav. Res. Methods 40, 879–891. doi: 10.3758/BRM.40.3.879
Quested, E., Ntoumanis, N., Viladrich, C., Haug, E., Ommundsen, Y., Van Hoye, A., et al. (2013). Intentions to drop-out of youth soccer: a test of the basic needs theory among European youth five countries. Int. J. Sport Exerc. Psychol. 11, 395–407. doi: 10.1080/1612197X.2013.830431
Reeve, J., Jang, H., Hardre, P., and Omura, M. (2002). Providing a rationale in an autonomy-supportive way as a strategy to motivate others during an uninteresting activity. Motiv. Emot. 26, 183–207. doi: 10.1023/A:1021711629417
Reinboth, M., and Duda, J. (2006). Perceived motivacional climate, need satisfaction and indices of well-being in team sports: a longitudinal perspective. Psychol. Sport Exerc. 7, 269–286. doi: 10.1016/j.psychsport.2005.06.002
Roberts, G. (2012). “Motivation in sport and exercise from an achievement goal theory. Goal theory and perspective: after 30 years, Where are you?,” in Advances in Motivation in Sport and Exercise, 3rd Edn, eds G. Roberts and D. Treasure (Champaign, IL: Human Kinetics), 7–58.
Ryan, R., and Deci, E. (2007). “Active human nature: self-determination theory and the promotion and maintenance of sport, exercise and health,” in Intrinsic Motivation and Self-Determination in Exercise and Sport, eds M. Hagger and N. Chatzisarantis (Champaign, IL: Human Kinetics),3–16.
Sandström, E., Linnér, L., and Stambulova, N. (2016). Career profiles of athlete–coach relationships: descriptions and interpretations. Int. J. Sport Sci. Coach. 1, 395–409. doi: 10.1177/1747954116645012
Sarrazin, P., Vallerand, R., Guillet, E., Pelletier, L., and Cury, F. (2002). Motivation and dropout in female handballers: a 21-month prospective study. Eur. J. Soc. Psychol. 32, 395–418. doi: 10.1002/ejsp.98
Sarrazin, P., Boiché, J., and Pelletier, L. (2007). “A self-determination theory approach to dropout in athletes,” in Intrinsic Motivation and Self-Determination in Exercise and Sport, eds M. Hagger and N. Chatzisarantis (Illinois: Human Kinetics), 229–241.
Smith, N., Tessier, D., Tzioumakis, Y., Fabra, P., Quested, E., Appleton, P., et al. (2016). The relationship between observed and perceived assessments of the coach-created motivational environment and links to athlete motivation. Psychol. Sport. Exer. 23, 51–63. doi: 10.1016/j.psychsport.2015.11.001
Stambulova, N. (2016). “Athletes’ transitions in sport and life: positioning new research trends within existing system of athlete career knowledge,” in The Routledge International Handbook of Sport Psychology, eds R. Schinke, K. McGannon, and B. Smith (New York, NY: Routledge), 519–535.
Standage, M., Duda, J. L., and Ntoumanis, N. (2006). Students’ motivational processes and their relationship to teacher ratings in school physical education: a self-determination theory approach. Res. Q. Exerc. Sport 77, 100–110. doi: 10.1080/02701367.2006.10599336
Teixeira, P., Carraça, E., Markland, D., Silva, M., and Ryan, R. (2012). Exercise, physical activity, and self-determination theory: a systematic review. Int. J. Behav. Nutr. Phys. Act. 9, 78. doi: 10.1186/1479-5868-9-78
Vlachoupoulos, S., and Michailidou, S. (2006). Development and initial validation of a measure of autonomy, competence and relatedness in exercise: the basic psychological needs in exercise scale. Meas. Phys. Educ. Exerc. Sci. 10, 179–201. doi: 10.1207/s15327841mpee1003_4
Keywords: self-determination theory, achievement goal theory, motivational climate, basic psychological needs, perceived effort, football, multi-group analysis, serial mediation
Citation: Monteiro D, Teixeira DS, Travassos B, Duarte-Mendes P, Moutão J, Machado S and Cid L (2018) Perceived Effort in Football Athletes: The Role of Achievement Goal Theory and Self-Determination Theory. Front. Psychol. 9:1575. doi: 10.3389/fpsyg.2018.01575
Received: 03 May 2018; Accepted: 07 August 2018;
Published: 28 August 2018.
Edited by:Guy Cheron, Free University of Brussels, Belgium
Reviewed by:Emmanouil Georgiadis, University of Suffolk, United Kingdom
Donatella Di Corrado, Kore University of Enna, Italy
Copyright © 2018 Monteiro, Teixeira, Travassos, Duarte-Mendes, Moutão, Machado and Cid. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sérgio Machado, firstname.lastname@example.org