Original Research ARTICLE
Learning Climate Perceptions as a Determinant of Employability: An Empirical Study Among European ICT Professionals
- 1University of Amsterdam, Amsterdam, Netherlands
- 2Institute for Management Research, Radboud University, Nijmegen, Netherlands
- 3Open University of the Netherlands, Heerlen, Netherlands
- 4Kingston University, London, United Kingdom
- 5University of Strathclyde, Glasgow, United Kingdom
- 6EM Lyon Business School, Écully, France
- 7University of Stavanger, Stavanger, Norway
- 8Durham University, Durham, United Kingdom
- 9University of Economics in Katowice, Katowice, Poland
- 10Gdynia Maritime University, Gdańsk, Poland
- 11University of Twente, Enschede, Netherlands
This study investigated the role of age in the relationship between perceptions of learning climate and self- and supervisor-rated employability among European Information and Communication Technology (ICT) professionals. The psychological climate for learning was operationalized by three indicators, namely the perceptions that employees have of the learning value of their job, supervisor support for learning, and the organizational support for learning. As hypothesized, a Structural Equation Model demonstrated that the relationship between age and perceptions of learning climate was negative. The model also showed a strong positive relationship between learning climate and self-reported and supervisor-rated employability. Furthermore, learning climate perceptions appeared important for employability irrespective of life or career stage. An explorative bootstrapping-based test suggested that older workers with managerial responsibilities profit less from psychological learning climate for self-reported and supervisor-rated employability than older workers at non-managerial levels. These findings have important implications for human resource practices that aim to increase lifelong employability.
As a result of aging and dejuvenization of the working population, the competitiveness of developed countries in the next few decades is forecasted to depend increasingly on the contribution of older workers (Shultz and Adams, 2007; Van der Heijden et al., 2009b). Constant change in the work environment and in job content also means that, increasingly, both older and younger workers are required to continuously develop and maintain their work-related skills and employability (Semeijn et al., 2015; De Vos and Van der Heijden, 2017). This paper addresses the potential positive effects for worker employability when organizations actively promote a climate of learning across various employee career stages.
Stimulating workers' employability appears to be advantageous for both employee and organizational outcomes (Fugate et al., 2004; Van Dam, 2004; Van der Heijde and Van der Heijden, 2006; Rothwell and Arnold, 2007; Crook et al., 2011; Van der Heijden et al., 2018). Van der Heijde and Van der Heijden's (2006) competence-based approach to employability is an elaboration of the resource-based view of the firm (Nordhaug and Grønhaug, 1994; Wright et al., 1994). According to this view, competences are one category of possible resources that enable firms to achieve performance and (sustained) competitiveness. Highly employable workers (Van Dam, 2004) are necessary for organizations to meet fluctuating demands for numerical and functional flexibility (Valverde et al., 2000). When an organization encourages individual development and change its employees are better able to meet new or anticipated demands (see for instance: Argyris and Schön, 1978; Senge, 1990; Fugate et al., 2004; Rothwell and Arnold, 2007).
For the individual worker, employability is defined as the ability to obtain a job and to keep employed, within or outside one's current organization, for one's present or new customer(s), and with regard to future prospects (Van der Heijde and Van der Heijden, 2006) (see also Forrier and Sels, 2003; Fugate et al., 2004; Rothwell and Arnold, 2007). Increasingly, domain-specific occupational expertise is insufficient to guarantee positive work outcomes during the course of one's entire career. Rather, a broad competence package or a high level of employability that enables workers to cope with fast changing job requirements is needed. For an organization to be attractive to employees, it should provide lifelong and challenging learning opportunities: that is, chances to improve existing knowledge and skills and to develop new ones. Fortunately, several organizational policies and practices can be utilized to promote growth and learning behavior and to prevent obsolescence (e.g., Borghans et al., 2006; Bartram and Roe, 2008; Fouarge et al., 2009; Nikolova et al., 2016), herewith introducing the concept of learning climate.
Besides a possible direct effect on competence development, the way that employees perceive learning climate also potentially influences competence development indirectly via outcomes, such as job satisfaction, learning motivation (De Lange et al., 2005), and feelings of job security. Kooij's (2010) research also suggested that formal development practices are equally important for older and younger workers, in the light of the enhancement of positive employee outcomes, such as affective commitment, job satisfaction, and motivation to continue to work. For older workers, specifically, several studies (e.g., Boerlijst et al., 1993; Rhebergen and Wognum, 1997; Tikkanen et al., 2002; Borghans et al., 2006; Maurer, 2007) have already indicated that organizations generally expend less energy optimizing psychological learning climate. Notwithstanding the considerable amount of literature stressing the importance of learning climate, there is limited empirical research on the predictive validity of learning climate for employability development throughout the life span.
In this paper, we elaborate a theoretical framework focused on the age-learning climate–employability relationship and a life span perspective, and develop three hypotheses to test if learning climate perceptions really decrease with age. We then present a study of European Information and Technology (ICT) professionals designed to examine these hypotheses.
Theoretical Background and Formulation of Hypotheses
Psychological Learning Climate and Employability at Different Career Stages
Derived from the concept of psychological climate (indicating perception, e.g., Parker et al., 2003), and adapted from Nikolova et al. (2016, p. 259) we use the following definition of psychological learning climate: The individual perception of an employee of organizational policies and practices aimed at supporting employees' learning behaviors. In this empirical study, we will use a conceptualization of psychological climate that acknowledges situational constraints (Parker et al., 2003 after Jones and James, 1979), based on several work domains. This approach has the potential to provide organizations with practical starting points for stimulating learning climate experiences. In this section, we consider three themes associated with learning climate with respect to employee age, for which so called situational constraints for learning might occur: the learning value of the job, supervisor support for learning, and organizational support for learning (see also D'Amato and Zijlstra, 2008).
Learning Value of the Job
A job can be interpreted as a learning environment (e.g., Sims, 1983), and is the best preventive measure against obsolescence or plateauing (Rothman and Perrucci, 1970). The extent to which the job contributes to professional advancement is labeled the learning value of the job for the worker (Boerlijst et al., 1993, p. 57). This learning value depends on key features of the work, such as high quality job assignments and the degree of challenge and growth potential, especially with regard to the ability to utilize one's knowledge and skills. Supervisors fulfill a crucial role with regard to the assignment of challenging tasks and activities (Van Vianen et al., 2011). However, Maurer (2007) found that older workers more often receive routine tasks rather than complex and challenging job assignments that stimulate development (p. 168), herewith endangering their future employability (Van der Heijden et al., 2009a). Job content does not grow automatically with the expertise of older workers.
Boerlijst et al. (1993) found that the relatively low learning value conveyed by many jobs, especially among employees over 50, is a considerable problem. The percentage of employees in jobs offering too few opportunities for new learning experiences and, more specifically, for acquiring new expertise, was very high (reaching 45% and higher for jobs of medium and higher levels of education: ISCED level 3 and higher, see OECD). Furthermore, jobs with high work pressure, often do not leave room for new and challenging assignments. Thus, a contemporary challenge for organizations is to design jobs which facilitate continuous learning for all employees, while safeguarding efficiency and value for the employing organization or department (Van der Heijden, 2001, 2002). Furthermore, jobs should to a certain extent offer the space for workers to select their own tasks and challenging assignments (De Pater et al., 2009) in the context of their career development.
Supervisor Support for Learning
Supervisors can endanger the mobility and employability of their employees (Boerlijst et al., 1993; Boerlijst, 1994) by focusing on short-term goals to the exclusion of employees' long-term career goals. However, organizational policies and practices can enable supervisors to promote the development of occupational expertise. Concretely, supervisors can be empowered to stimulate employees to participate in training and development programmes, to exchange information, and to think about their future career steps. A basic requirement for growth is the formulation of a realistic and attainable individual career development plan by the employee, together with the supervisor and the HR department, where present (Stickland, 1996).
Maurer (2001), however, concluded that there was a systematic decrease of supervisory support for learning and development with employee age, for example, by withholding older workers from difficult job assignments, positions, and training experiences (for similar findings see also Rhebergen and Wognum, 1997). Maurer also showed that this decline in support negatively affects older workers' mastery experiences and their perceived self-efficacy for development. Van Vianen et al. (2011) demonstrated how such reluctance was perceived by employees. These authors found a negative relationship between employee age and willingness for further development among employees that perceived little developmental support from their supervisors, and whose supervisors perceived them to have a learning avoidance orientation.
Overall, studies examining the use of HRM practices for mature workers have found that few employers seem to encourage age awareness for their managers (Armstrong-Stassen, 2008). Such findings reinforce the importance of age awareness training which aims to promote managers' recognition of age bias, awareness of the needs of mature workers, and a change in attitude toward mature workers (Griffiths, 1997; Goldberg, 2005; Hedge et al., 2006).
Organizational Support for Learning
Organizational support for learning extends beyond the immediate job content of the worker, and his/her immediate supervisor. Unfavorable working conditions, situational constraints, and too little time to practice beyond the scope of “normal” work are problems confronting many employees (Peters and O'Connor, 1980; Paoli, 1997; Paoli and Merllié, 2001; Tikkanen, 2006). An increase in work intensification does not allow time or opportunities for experimentation or work outside one's immediate domain (Parent-Thirion et al., 2007). Concretely, important organizational support for learning comprises time (considering present high work pressures), support from the team wherein one is employed, and the experience of ample opportunities to develop (see Bartram et al., 1993).
Time enables workers to do their job properly and to learn effectively. Having time to think, practice, keep up with changes, and having time to talk things through with colleagues and line managers is important for employees' development. Time for self-regulation in learning is necessary to set learning goals, develop action plans for learning and seek feedback, and to evaluate learning results. Taris and Kompier (2004) argued that workers under time pressure tend to fall back on routine chores with no learning as a result. Availability of time might even be of higher importance for older workers' learning new knowledge and skills, due to the relative deterioration of fluid intellectual capabilities (Kanfer and Ackerman, 2004; Ng and Feldman, 2008, p. 400 and p. 403; cf. Baruch and Bozionelos, 2011).
A learning-provoking team style comprises a working environment with ample opportunities to learn from colleagues with expertise, who are supportive, caring and willing to help each other, and who are willing to share information and work. Under these circumstances, team members are seen as knowing their own limitations and as being willing to admit them. The importance of co-worker support for development has been underlined (Noe and Wilk, 1993; see for instance Maurer and Tarulli, 1994). Access to new information is critical, and much of the technical information needed by professionals comes from interactions with colleagues, for example by participation in social networks (e.g., Škerlavaj et al., 2010). For this reason, organizations should pay closer attention to information dissemination systems, and to the structure of these systems.
The fact that older workers are likely to perceive less support from their team-mates might be a result of their tenure and years of experience: older workers are more likely to be moved up in the hierarchy to be leaders or managers, and perceive less support from their boss or co-workers (Kawakami and Fujigaki, 1996). Another hindering factor for older workers concerns the difficulty of adapting to workplace changes, such as the requirement to adequately function within the setting of work teams (Yeatts et al., 2000), while being used to working individually. Moreover, older workers may experience problems in their collaboration with younger counterparts.
Employees reporting more opportunities to develop, perceive their workplace as providing opportunities to learn new skills and to do a variety of work. They see scope for creativity and opportunities for being a novice outside their own work domain. They have an awareness of what learning materials and options exist, and are involved in the discussion of plans and policies for change (both with regard to their work as well as the organization, in a broader sense). However, previous research has indicated that older workers in technology-intensive environments rarely described that they encountered totally new situations (Tikkanen, 2002). Based on the foregoing, we formulated our first hypothesis on the relation between employee age and all three discussed dimensions of learning climate.
H1: There exists a negative relationship between employee age and employees' perceptions of learning climate.
H2: There exists a positive relationship between employees' perceptions of learning climate and self-reported and supervisor-rated employability.
Different Operationalizations of Age: Different Life and Career Stages
According to Kanfer and Ackerman (2004), the assumption of a general decline with age is simplistic, misleading and based on stereotyping (Pazy, 1996; Baruch and Bozionelos, 2011; see also Arnold and Clark, 2016). The authors presented a life-span perspective with regard to adult development and work motivation, including changes with regard to cognitive abilities, personality, affect, interests, and values with aging. “Work motivation in midlife and later years follows the same basic principles as work motivation in young adulthood—namely, the allocation of personal resources to work behaviors that build on competencies, promote a sense of self-efficacy and self-concept, and offer opportunities for the attainment of desired outcomes” (p. 455). Older workers can contribute in a different way and continue to be motivated for work and development. On top of that, there is more variability in work performance within age groups than between age groups (e.g., Ilmarinen, 2001 with regard to physical work capacity).
The meta-analysis of Ng and Feldman (2008) demonstrated that age was largely unrelated to core task performance, creativity, and performance in training programs. The weak negative relationship between age and motivation for training and career development activities found by Ng and Feldman (2012) in their follow-up meta-analysis, might be attributable to: (a) greater resistance and fear of failure because of deterioration of fluid intellectual capabilities; (b) lower perceived incentive with regard to return of investment; or (c) a self-fulfilling prophecy with regard to being offered less developmental activities. Since motivation to learn on the job does not appear to decrease with age (De Lange et al., 2005), learning climate is interpreted as an important predictor, both for older and younger workers. Although different age groups are expected to flourish with different learning climate profiles and are likely to demonstrate different patterns of competences throughout the life-span, age is approached as a continuous variable, since employees' development is variegated and does not occur at the same pace.
To examine the influence of age on the learning climate-employability relationship it is important to include different operationalizations of age, since calendar age serves only as a proxy for age-related processes (Kanfer and Ackerman, 2004; De Lange et al., 2010). Individuals may be at a different life- and career-stage, despite being the same calendar age. Approaches to the operationalization of age include: (a) performance-based or functional approaches (e.g., work ability or health measures); (b) psychosocial or subjective approaches (e.g., age norms applied to an individual with respect to an occupation, company, or society; cf. Kaliterna et al. (2002); (c) organizational approaches (e.g., job tenure, career stage); and (d) life-span approaches (e.g., family status or life stage measures) (De Lange et al., 2010, p. 943). This is also in line with Super's (1990) concept of recycling through the stages of adult career development, implying that career and life phases do not have a strict relation with chronological age and are flexible.
Working life nowadays consists of repeated cycles of learning (Hall and Mirvis, 1995; Baruch and Bozionelos, 2011). By including different career and life stage characteristics, herewith our model represents a broader conceptualization of the concept of age. As such, our approach is expected to lead to a better understanding of the age-learning climate-employability relationship. Specifically, we hypothesize that learning climate perceptions will be important for employability irrespective of life or career stage. This implies that including different career and life stage characteristics into the model, besides age, will not alter the previously hypothesized relationship between learning climate and employability.
H3: Learning climate perceptions will be important for employability irrespective of life- or career-stage.
Participants and Procedure
This study was carried out among pairs of ICT professionals and their immediate supervisors working in small- and medium-sized enterprises (SMEs) in seven countries (Germany, Greece, Italy, the Netherlands, Norway, Poland, and the United Kingdom). ICT professionals were defined as employees involved in the conception, development, implementation, and maintenance of software products and services (Van der Heijden et al., 2005). ICT professionals were estimated to be an eligible research population with regard to learning climate, since developments are very fast in the ICT industry (Scholarios et al., 2008; Marzec et al., 2009). The selection of employees excluded persons with low levels of education (not having attained ISCED level 3, see OECD), to be able to produce useful and comperative data with respect to future potential organizational change. This was a prerequisite to enable comparison of current and future workers, especially with regard to older workers (after ~20 years) in light of growing complexity and increasing level of difficulty of future jobs and concomitant rising required educational levels (see also Van der Heijde and Van der Heijden, 2006, p. 457).
We used two data collection methods: (1) an online questionnaire with immediate personalized feedback; and (2) a paper-and-pencil questionnaire, to increase the response rate in case a permanent internet connection in companies was less common. Informed consent was obtained by virtue of survey completion. Nevertheless, all employees received extensive information about the study before deciding to participate and received personalized confidential feedback after completion. They could also withdraw from the study at any time. The immediate supervisors were asked to respond to a shorter questionnaire, and were instructed to indicate how employable their subordinates were on a respective scale. The advantage of the use of multi-rater (or multi-source) performance ratings is that different evaluation perspectives add incremental validity to the assessment of individual performance (see for instance Borman, 1997). In line with the work by (Facteau and Craig (2001), p. 215) on performance appraisals, we expected an equivalent factor structure of the employability construct among the rater groups (employees and supervisors) (see also Van der Heijde and Van der Heijden, 2006; Van der Heijden et al., 2009b).
It was accepted that achieving a sufficient sample size would depend on elements of convenience sampling, utilizing personal contacts and networks. An examination of the final respondent characteristics indicated that we did, indeed, achieve a representative sample of ICT professionals in most countries, comparing the obtained data in each country with the three sampling criteria in the defined sampling frame: (1) the geographical regions in each country where most ICT activity occurs; (2) the ICT industry subsector in which ICT professionals are employed, including both ICT suppliers and ICT users; and (3) the size of the organizations in which they were employed, taking into account that the majority of the population of ICT organizations comprises SMEs (Van der Heijden et al., 2005).
Our final sample consisted of 967 pairs (response rate was 69% for employees, and 63% for supervisors across countries for the web-based survey and around 25% for the paper-and-pencil versions). The employees' sample included 694 men (71.8%) and 273 women (28.2%). Mean age was 34.50 years (sd = 8.29), with an average of 9.82 years (sd = 8.07) on the labor market, of which 7.21 (sd = 5.80) was as an ICT professional, and average length of service for the organization was 4.72 years (sd = 4.45). In total, 728 of the supervisors were men (75.3%) and 239 were women (24.7%). Their mean age was 41.53 years (sd = 7.82).
The questionnaire was used in a large European study during which several precautions were undertaken to increase the measurement equivalence of the factors included across the participating countries (e.g., Van de Vijver and Leung, 1980): (1) extensive testing concerning the item formulation of all instruments among five employees, five supervisors, and two communication specialists in the Netherlands; (2) instructions regarding cross-checking of the self-ratings with the ratings of the supervisor (on employability) as well as guaranteeing anonymity (see also Mabe and West, 1982); (3) extensive pre-testing of the questionnaire in a pilot following the translation back-translation methodology, herewith solving possible language and linguistic problems, and aimed at enhancing user-friendliness; (4) a needs analysis amongst ICT employers was used as a cross-validation for the rationale of incorporating the study's variables, with societal and labor market needs.
Employability was assessed with Van der Heijde and Van der Heijden's (2006) domain-independent (or generic) instrument that contains five dimensions: (1) occupational expertise (15 items); (2) anticipation and optimization (8 items); (3) personal flexibility (8 items); (4) corporate sense (7 items); and (5) balance (9 items). Construct validity for the employability instrument, including the second-order structure of the concept, equivalent factor structure over the different rater groups (employees and supervisors), and predictive validity were demonstrated using structural equation modeling and multi-trait-multimethod analysis (Van der Heijde and Van der Heijden, 2006; Bozionelos et al., 2016). Examples were: “By virtue of my experience with him/her, I consider him/her … competent to be of practical assistance to colleagues with questions about the approach to work” (ranging from “not at all” to “extremely”) (occupational expertise), “(S)he is … focused on continuously developing him/herself” (ranging from “not at all” to “a considerable degree”) (anticipation and optimization), “(S)he adapts to developments within the organization …” (ranging from “very badly” to “very well”) (personal flexibility), “(S)he manages to exercise … influence within the organization” (ranging from “very little” to “a very great deal”) (corporate sense), and “The time (s)he spends on his/her work and career development on the one hand, and his/her personal development and relaxation on the other are…evenly balanced” (ranging from “not at all” to “a considerable degree”) (balance). The item sets for the employees and the supervisors are nominally identical and all scored on a six-point rating scale.
Learning climate was assessed on the individual (psychological) level using three scales: (1) learning value of the job; (2) supervisor support for learning; and (3) organizational support for learning. Learning value of the job was assessed with Van der Heijden's instrument (Van der Heijden et al., 2005; Van der Heijden and Bakker, 2011). A sample item was: “My job enables me to further develop my talents.” The item sets for the employees are all scored on a six-point rating scale (ranging from “strongly disagree” to “strongly agree”). Supervisor support for learning was assessed by means of a thoroughly validated, five-item instrument (Van der Heijden et al., 2005, 2010) An example item was: “My supervisor has taken into account my age and capacity when assigning me new tasks and responsibilities during the last year.” The item sets for the employees are all scored on a six-point rating scale (ranging from “strongly disagree” to “strongly agree”).
Organizational support for learning was measured with the multivariate learning climate questionnaire (LCQ) of Bartram et al. (1993) that provides measures of three aspects of learning opportunity: time (seven items, sample item “in some parts of the job there is not enough time to keep up with changes,” team style (nine items, sample item “if we ask for help it is given”) and opportunity to develop (six items, sample item “our ideas for changes are welcomed by management.” Response format was five-point (“never true” to “always true”).
Since in the literature on the subject there is no agreement how different indicators of career stage and life phase representing age should be operationalized (Lynn et al., 1996; De Lange et al., 2010; Kooij and Boon, 2018), we decided to apply multiple indicators (Super, 1990; Lam et al., 2012). General perceived health, representing a functional approach of age, was measured with a 5-item general health scale of the SF-36 Health Survey (Ware and Sherbourne, 1992). A sample item was “My health is excellent.” All items, except the first one, are scored on a five-point rating scale ranging from: (1) definitely false, to (5) definitely true. Work role [measured as managerial responsibilities (yes/no)] was included as an important indicator with regard to career stage of ICT professionals (see also Kappelman et al., 2016) thereby representing a subjective approach to age (age norms). Furthermore, we included ICT professional tenure (in years) (Lam et al., 2012), and length of supervisory relationship (in months), as operationalizations of an organizational approach of age. Family status (number of children) represented a life-span operationalization of age.
Highest educational qualification of the employee and age of the supervisor were used as control variables. Highest educational qualification was measured with one item and the following scale anchors: High school or equivalent; College (some university); Bachelor's degree (or recognized equivalent); Master's degree (or recognized equivalent); and Doctorate (PhD). According to Ostroff and Atwater (2003), gender of the supervisor affects compensation levels but not performance ratings. Therefore, we did not control for supervisor gender.
As regards ethical guidelines, full review and approval by the Ethical Committee was not required, according to national legislation, since there was no impairment of medical integrity and no interventions were performed (Wet Bescherming persoonsgegevens, 2000). Standards from the American Psychological Association and the British Psychological Society were followed as well as standards from the European Commission (within the Fifth Framework) and NWO: The Netherlands Organization for Scientific Research. Furthermore, the study was led by a psychologist (Beatrice I.J.M. van der Heijden), registered at the NIP: The Dutch Association of Psychologists, who initiated and coordinated the study.
Cronbach's α coefficients of all employability dimensions were in the acceptable range; the self-ratings ranged from 0.78 to 0.93, and the supervisor ratings from 0.80 to 0.95, see Table 1. The supervisor-rated employability dimensions correlated highly (r ≥ 0.66), while the self-rated employability dimensions correlated somewhat lower (r ≥ 0.37). The consistency between supervisor-ratings and self-ratings for the same employability dimensions ranged from 0.21 to 0.53. All learning climate perception measures demonstrated good internal consistencies, with Cronbach alphas ranging from 0.77 to 0.85.
Table 1. Means, standard deviations, reliability coefficients (Cronbach's α on the diagonal), and correlations between the model variables, N = 967.
Besides chronological age, we explored different operationalizations of age in the model to do full justice to the earlier formulated life-span perspective (Kanfer and Ackerman, 2004; De Lange et al., 2010): perceived health, organizational tenure, ICT professional tenure, length of supervision, work role (i.e., managerial responsibilities), and family status (number of children). Regression analyses of these variables on each of the employability dimensions separately (both supervisor and employee version), showed that perceived health, ICT professional tenure, length of supervision (in months), and work role (i.e., managerial responsibilities) were significantly related to both employability supervisor ratings and self-ratings (see Table 2). Only factors that appeared to be significantly related to the outcome measures were subsequently included in further analyses.
Test of the Age–Learning Climate Perceptions–Employability Relationship
We tested our first and second hypotheses by means of Structural Equation Modeling (SEM) using the maximum likelihood method with the AMOS computer program (Arbuckle, 2003). Both learning climate perceptions and self-reported and supervisor-rated employability were included as latent endogenous factors (see Figure 1). The SEM analysis was conducted with the mean scores of the scales, instead of the scale items. Previous results of Confirmatory Factor Analysis (Van der Heijde and Van der Heijden, 2006; Van der Heijden et al., 2009b; Bozionelos et al., 2016) supported the suggested factor structure of employability. The measurement errors of the parallel dimensions (supervisor and employee version) were allowed to correlate.
To test the fit between the proposed model and the data, the traditional χ2-value, the Comparative Fit Index (CFI), the Normed Fit Index (NFI) and the Root Mean Square Error of Approximation (RMSEA) were calculated. A CFI ≥ 0.90, NFI ≥ 0.90, and a RMSEA ≤ 0.08 indicate a reasonable fit between the model and the data. The model for the total sample appeared to have a reasonable fit (χ2 = 723.89, df = 116, CFI = 0.93, NFI = 0.91, RMSEA = 0.07, see Model 1, Table 3).
The significant structural path showed that age was negatively related to learning climate perceptions (β = −0.13, p < 0.001), providing support for Hypothesis 1. Furthermore, learning climate perceptions were positively related to both supervisor-rated employability and self-reported employability (β = 0.43, p < 0.001 and β = 0.75, p < 0.001), providing support for Hypothesis 2 (for the supervisor ratings not as strongly positive as for the self-ratings). The proportion of explained variance in this model was 23% for supervisor-rated employability and 58% for self-rated employability.
Test of the Age–Learning Climate Perceptions-Employability Relationship, Including Different Career-and Life-Stage Characteristics Into the Model
When testing Hypothesis 3, we performed a SEM analysis testing our model of the age—learning climate perceptions—employability relationship, adding perceived health, ICT professional tenure, length of supervision (in months), and work role (i.e., managerial responsibilities) into the model (see Model 2, Table 3, and Figure 2). The model had a satisfactory fit to the data, χ2 = 1408.88, df = 351, CFI = 0.89, NFI = 0.86, RMSEA = 0.06, given the large number of items we used (Patterson et al., 2005).
Figure 2. A model of employability, enhanced by learning climate perceptions related to different career and life stage characteristics.
More specifically, for the category without managerial responsibilities we found that age was no longer significantly related to learning climate perceptions and employability (self-ratings). Age was related positively and significantly to supervisor-ratings of employability (β = 0.14, p < 0.01). The learning climate—employability relationships remained unaltered (H3). Learning climate perceptions were significantly and positively related to both supervisor-ratings and self-ratings of employability (β = 0.34, p < 0.001 and β = 0.67, p < 0.001 respectively).
For the category with managerial responsibilities we found comparable results: age was no longer significantly related to learning climate perceptions or employability (both supervisor and self-ratings). The learning climate—employability relationships remained unaltered (H3). Learning climate perceptions were significantly and positively related to both supervisor-ratings and self-ratings of employability (β = 0.47, p < 0.001 and β = 0.70, p < 0.001, respectively). These findings imply support for Hypothesis 3 that learning climate perceptions will be important for employability irrespective of life or career stage.
The proportion of explained variance in this model was 28% for supervisor-rated employability and 59% for self-rated employability for the category without managerial responsibilities, while it was 0.35 for supervisor-rated employability and 0.65 for self-rated employability for the category with managerial responsibilities. On an explorative basis we found significant indirect effects (with a 90% confidence interval) of age and all age/career-and life-stage variables via learning climate on supervisor and self-rated employability, using the bootstrapping-based test (MacKinnon et al., 2004) with 2000 bootstrap resamples (see Model 3 and Tables 3, 4).
Table 4. Exploration of indirect effects of age/ different career and life stage characteristics and learning climate perceptions on employability: standardized indirect effects and the associated 90% confidence intervals.
The results in this study justify taking a life-span perspective (Kanfer and Ackerman, 2004) on learning in organizations and stress the importance of approaching each worker as an individual in that respect. Learning climate ratings appeared to decline with age unless different career- and life-stage characteristics were taken into account. Moreover, adding these factors into our model led to a larger proportion of explained variance in the supervisor ratings and self-ratings of employability, especially for workers with managerial responsibilities. Furthermore, we found a stable positive relationship between learning climate perceptions and employability (supervisor ratings and self-ratings of employees).
Older employees without managerial responsibilities seem to profit from higher supervisor employability ratings. Another finding was that employees without managerial responsibilities with longer ICT professional tenure were given less positive employability ratings by their supervisors. A potential explanation for this finding is higher expectations of supervisors caused by a higher level of workers' experience. These effects were less pronounced for employees with managerial responsibilities (herewith indicating a so-called trend). In all instances, health was positively related to a better perceived learning climate and employability experience. Workers without managerial responsibilities with shorter ICT professional tenure and/or working longer with the same supervisor seem to experience better learning climates. That was not the case for workers with managerial responsibilities.
When exploring for indirect effects with the bootstrapping method, we found both age and the other career and life stage characteristics to be significant moderators of the psychological learning climate—employability relationship (Table 4). When trying to interpret these results, it seems as though older workers with managerial responsibilities profit less from the learning climate in the light of their employability contrary to older workers without managerial responsibilities. Adding to that, workers with longer ICT professional tenure also profit less from the learning climate for their employability (both with and without managerial responsibilities). Workers without managerial responsibilities who were supervised longer by their manager profit more from the learning climate for their employability contrary to workers with managerial responsibilities. All workers with higher perceived health profit more from the learning climate for their employability.
These findings underscore the importance of incorporating life phase factors when deciding about optimization of learning experiences within the organization. One possible explanation for the fact that workers with longer ICT professional tenure profit less from the learning climate for their employability could also be their lowered motivation for learning in that job environment, necessitating some form of internal or external stimulation (i.e., switch of tasks, roles, organization and/or sector).
Furthermore, additional research is necessary to understand the differences in learning climate experience for workers with or without managerial responsibilities. Workers with managerial responsibilities appeared to be a distinct group of workers that, at first view, seems to be less strongly influenced by life stage factors regarding their perceived learning climate and employability ratings. At second glance though, they seem to profit less from the perceived learning climate for their employability with increasing age (including the different life stage factors), implying that they may have specific needs for development. On a functional level, work content of workers with managerial responsibilities can differ substantially from workers without managerial responsibilities and they might need different stimuli to develop their careers. For instance, in the case of developing their transactional leadership styles into more transformational styles, factors such as personality and maturity come into play. Furthermore, older managers who have reached career plateaus can have different career orientations, being motivated more by subjective career success as opposed to younger managers that strive for more objective career success, such as upward career moves and salary increases (Bown-Wilson and Parry, 2013), The reason that older managers are less able to benefit from the psychological learning climate of the company for increasing their employability could be a reflection of their underlying work motivations.
We do not advocate a position-based approach that is prone to positive and negative discrimination; for instance, fostering a more positive learning climate for employees with a higher ranking in the organization, or for younger employees. We rather advocate a resource-based approach that is focused on equally developing competences of both younger and older workers (see also Tikkanen et al., 2002). Likewise, Maurer and Rafuse (2001), in their study on preventing age discrimination when managing the organization's development process, stressed the need for policies that imply allocation of developmental opportunities on an age-neutral, and individual-by-individual basis. This follows knowledge about large individual variability with regard to developmental potential, performance and career orientation among (older) workers (Ilmarinen, 2001; Kanfer and Ackerman, 2004; Bown-Wilson and Parry, 2013).
Organizations should invest energy into career development for all age and life phase groups, for instance, (older) managers and workers starting their retirement process. Such processes could include both formal and informal learning climate, such as training, job experiences, job rotation, supervisor support, supervisor support for learning, mentoring programs, and career and role change, including career coaching (e.g., Bown-Wilson and Parry, 2013). Parallel to that, organizations should remove constraints (e.g., time constraints) that have potential detrimental effects on the employee's motivation to learn and on learning self-efficacy. These would also include flexible working and flexible retirement policies for workers that want to slow down (Bown-Wilson and Parry, 2013). LePine et al. (2004) demonstrated relationships of challenge and hindrance stress on learning performance via motivation to learn (see also Mathieu and Martineau, 1997).
Improving the learning climate is also important in order to reduce job stress and to promote occupational health (Mikkelsen et al., 1998). A mismatch between individual learning climate perceptions and the averaged evaluation of learning climate in the rest of the working group was found to be an important source of stress. Mikkelsen et al. (1999) found that decision authority and learning opportunities appeared to have a specific and independent impact on subjective health, psychological functioning, coping style and organizational outcome variables. Finally, excluding older workers from learning climate optimization policies makes them vulnerable for skills obsolescence and job termination: it appears that there is a relationship between unemployment and mental health for this age group, and not for younger workers (Breslin and Mustard, 2003).
Limitations and Recommendations for Further Research
First, our survey research design allows for response set consistencies to occur. Secondly, in order to increase certainty that the relationships we found occur in the sequence as hypothesized, longitudinal research is needed. Thirdly, research into the generalizability of our findings to other occupational settings is recommended. Not including country as a variable in the model was justified by our preliminary analyses. This result is also plausible considering that the first dominating culture of this sample is the ICT culture. Fourthly, including measures of learning self-efficacy and learning motivation (see e.g., Maurer et al., 2003) might contribute to our understanding of the relationships between age, learning climate perceptions and employability.
Enhancing learning climate experience in the firm (and department) is an essential component of investing in human competence through suitable HR policies and practices (Boxall, 1999; Van der Heijde and Van der Heijden, 2006). Secondly, improving the learning climate experience in organizations is important to keep aging workers in the labor force, thereby utilizing their carefully built-up expertise, as long as possible. Older workers who are less motivated and report low self-efficacy have already left the labor market instead of adapting to workplace changes (see for instance, Yeatts et al., 2000).
Companies can collect information on different aspects of the learning climate from their workers, both young and old, and on a group by group basis (both at organization and department level) thereby taking into account different life-span factors. Follow-up is possible on several levels. First, at management level, outcomes for different types of workers (e.g., younger/older, those with longer/shorter sectoral experience, those with managerial/no managerial responsibilities, those who are healthy/unhealthier) can be discussed within the management team, offering starting points for improvement of the learning climate experience. Secondly, at an individual level, workers can be encouraged to undertake action(s) to enhance their learning climate experience and to remove hindrances to learning. In order to be able to do this, they need some form of personalized confidential feedback, including some means they can use for action; for instance, writing a personal development plan and discussing it with their superior, putting their personal hiatus on the agenda of the weekly meeting, or discussing their personal learning climate issue with a colleague. The valid and reliable measurement instrument developed for this study is suitable for providing a thorough insight of a company's learning climate, and that of different sections, as well as for use as an HR tool to develop the individual worker.
All authors of this study were involved in all stages of the research process: conception and design, data collection and processing, analysis and interpretation of the data, and writing substantial sections of the paper.
This research was partly supported by a grant from NWO ASPASIA Program, Project No. 015.000.114 and the European Commission within the Fifth Framework, Project ID: IST-2000-31070. Indic@tor: A cross-cultural study on the measurement and enhancement of employability among ICT professionals working in small and medium-sized enterprise, both awarded to BVdH.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We thank all respondents that participated in this study. We also want to thank the reviewers for their useful comments to improve the article.
Arnold, J., and Clark, M. (2016). Running the penultimate lap of the race: a multimethod analysis of growth, generativity, career orientation, and personality amongst men in mid/late career. J. Occup. Organ. Psychol. 89, 308–329. doi: 10.1111/joop.12125
Bartram, D., Foster, J., Lindley, P. A., Brown, A.J., and Nixon, S. (1993). Learning Climate Questionnaire (LCQ): Background and Technical Information. Oxford: Employment Service and Newland Park Associates Limited.
Bartram, D., and Roe, R. (2008). “Individual and organisational factors in competence acquisition,” in The Learning Potential of the Workplace, eds W. Nijhof and L. Nieuwenhuis (Rotterdam: Sense Publishers), 71–96.
Baruch, Y., and Bozionelos, N. (2011). “Career issues,” in APA Handbook of Industrial and Organizational Psychology, Volume 2: Selecting and Developing Members of the Organization, ed S. Zedeck (Washington DC: American Psychological Association), 67–113. doi: 10.1037/12170-003
Boerlijst, J. G. (1994). “The neglect of growth and development of employees over 40 in organizations: a managerial and training problem,” in Work and Aging, eds J. Snel and R. Cremer (London: Taylor and Francis Ltd.), 251–271.
Boxall, P. (1999). “The strategic HRM debate and the resource- based view of the firm,” in Strategic Human Resource Management, eds R. S. Schuler and S. E. Jackson (Oxford, UK: Blackwell Business), 73–89.
Bozionelos, N., Kostopoulos, K., Van der Heijden, B., Rousseau, D. M., Bozionelos, G., and Hoyland, T. (2016). Employability and job performance as links in the relationship between mentoring receipt and career success: a study in SMEs. Group Organ. Manage. 41, 135–171. doi: 10.1177/1059601115617086
Breslin, F. C., and Mustard, C. (2003). Factors influencing the impact of unemployment on mental health among young and older adults in a longitudinal, population-based survey. Scand. J. Work Environ Health 29, 5–14. doi: 10.5271/sjweh.698
Crook, T. R., Todd, S. Y., Combs, J. G., Woehr, D. J., and Ketchen, D. J. (2011). Does human capital matter? A meta-analysis of the relationship between human capital and firm performance. J. Appl. Psychol. 96, 443–456. doi: 10.1037/a0022147
De Lange, A. H., Taris, T. W., Jansen, P. G. W., Kompier, M.A.J., and Houtman, I. (2005). Werk en motivatie om te leren: Zijn er verschillen tussen jongere en oudere werknemers? [Work and motivation to learn: Are there differences between younger and older workers?]. Gedrag en Organisatie, 18, 309–325.
De Lange, A. H., Taris, T. W., Jansen, P. G. W., Kompier, M. A. J., Houtman, I. L. D., and Bongers, P. M. (2010). On the relationships among work characteristics and learning-related behavior: does age matter? J. Organ. Behav. 31, 925–950. doi: 10.1002/job.649
De Pater, I. E., Van Vianen, A. E. M., Bechtoldt, M. N., and Klehe, U. (2009). Employees' job challenge and supervisors' evaluations of promotability. Pers. Psychol. 62, 297–325. doi: 10.1111/j.1744-6570.2009.01139.x
De Vos, A., and Van der Heijden, B. I. J. M. (2017). Current thinking on contemporary careers: the key roles of sustainable HRM and sustainability of careers. Curr. Opin. Environ. Sustainabil. 28, 41–50. doi: 10.1016/j.cosust.2017.07.003
Goldberg, B. (2005). “How to become employer of choice for the working retired,” in Thriving on an aging Workforce: Strategies for Organizational and Systemic Change, eds P. T. Beatty and R. M. S. Visser (New York, NY: Krieger Publishing Company), 170–178.
Hedge, J. W., Borman, W. C., and Lammlein, S. E. (2006). The Aging Workforce: Realities, Myths, and Implications for Organizations. Washington DC: American Psychological Association. doi: 10.1037/11325-000
Jones, A. P., and James, L. R. (1979). Psychological climate: Dimensions and relationships of Individual and aggregated work environment perceptions. Organ. Behav. Hum. Perform. 23, 201–250. doi: 10.1016/0030-5073(79)90056-4
Kaliterna, L., Larsen, Z. P., and Brkljacic, T. (2002). Chronological and subjective age in relation to work demands: survey of Croatian workers. Exp. Aging Res. 28, 39–49. doi: 10.1080/036107302753365531
Kawakami, N., and Fujigaki, Y. (1996). Reliability and validity of the Japanese version of job content questionnaire: replication and extension in computer company employees. Indus. Health 34, 295–306. doi: 10.2486/indhealth.34.295
Kooij, D. T. A. M., and Boon, C. (2018). Perceptions of HR practices, person–organization fit, and affective commitment: the moderating role of career stage. Hum. Resour. Manage. J. 28, 61–75. doi: 10.1111/1748-8583.12164
Lam, S. S. K., Ng, T. W. H., and Feldman, D. C. (2012). The relationship between external job mobility and salary attainment across career stages. J. Voc. Behav. 80, 129–136. doi: 10.1016/j.jvb.2011.05.002
LePine, J. A., LePine, M. A., and Jackson, C. L. (2004). Challenge and hindrance stress: relationships with exhaustion, motivation to learn, and learning performance. J. Appl. Psychol. 89, 883–891. doi: 10.1037/0021-9010.89.5.883
MacKinnon, D. P., Lockwood, C. M., and Williams, J. (2004). Confidence limits for the indirect effect: distribution of the product and resampling methods. Multivariate Behav. Res. 39, 99–128. doi: 10.1207/s15327906mbr3901_4
Marzec, I., Van der Heijden, B. I. J. M., Scholarios, D., Van der Schoot, E., Jedrzejowicz, P., Bozionelos, N., et al. (2009). Employability management practices in the Polish ICT sector. Hum. Resour. Dev. Int. 12, 471–492. doi: 10.1080/13678860903274539
Mathieu, J. E., and Martineau, J. W. (1997). “Individual and situational influences on training motivation,” in Improving Training Effectiveness in Work Organizations, eds J. K. Ford, S. W. Kozlowski, K. Kraiger, E. Salas, and M. S. Teachout (Mahweh, NJ: Lawrence Erlbaum Associates), 193–221.
Maurer, T. J. (2007). “Employee development and training issues related to the aging workforce,” in Aging and Work in the 21st Century, eds K. S. Shultz and G. A. Ames (Mahwah, NJ: Lawrence Erlbaum Associates), 163–178.
Maurer, T. J., and Rafuse, N. E. (2001). Learning not litigating: Managing employee development and avoiding claims of age discrimination. Acad. Manage. Exec. 15, 110–121. doi: 10.5465/ame.2001.5898395
Maurer, T. J., and Tarulli, B. A. (1994). Investigation of perceived environment, perceived outcome and person variables in relationship to voluntary development activity by employees. J. Appl. Psychol. 79, 3–14. doi: 10.1037/0021-9010.79.1.3
Maurer, T. J., Weiss, M., and Barbeite, F. (2003). A model of involvement in work-related learning and development activity: The effects of individual, situational, motivational, and age variables. J. Appl. Psychol. 88, 707–724. doi: 10.1037/0021-9010.88.4.707
Mikkelsen, A., Saksvik, P. O., Eriksen, H., and Ursin, H. (1999). The impact of learning opportunities and decision authority on occupational health. Work Stress 13, 20–31. doi: 10.1080/026783799296165
Nikolova, I., Van Ruysseveldt, J., van Dam, K., and De Witte, H. (2016). Learning climate and workplace learning: does work restructuring make a difference? J. Pers. Psychol. 15, 66–75. doi: 10.1027/1866-5888/a000151
Ostroff, C., and Atwater, L. E. (2003). Does whom you work with matter? Effects of referent group gender and age composition on manager's compensation. J. Appl. Psychol. 88, 725–740. doi: 10.1037/0021-9010.88.4.725
Parent-Thirion, A., Fernández Macías, E., Hurley, J., and Vermeylen, G. (2007). Fourth European Working Conditions Survey. Dublin: European Foundation for the Improvement of Living and Working Conditions.
Parker, C. P., Baltes, B., Young, S., Altmann, R., LaCost, H., Huff, J., et al. (2003). Relationships between psychological climate perceptions and work outcomes: a meta-analytic review. J. Organ. Behav. 24, 389–416. doi: 10.1002/job.198
Patterson, M. G., West, M. A., Shackleton, V. J., Dawson, J. F., Lawthom, R., Maitlis, S., et al. (2005). Validating the organizational climate measure: links to managerial practices, productivity and innovation. J. Organ. Behav. 26, 379–408. doi: 10.1002/job.312
Scholarios, D., Van der Heijden, B. I. J. M., Van der Schoot, E., Bozionelos, N., Epitropaki, O., Jedrzejowicz, P., et al. (2008). Employability and the psychological contract in European ICT sector SMEs. Int. J. Hum. Res. Manage. 19, 1035–1055. doi: 10.1080/09585190802051337
Semeijn, J. H., Van Dam, K., Van Vuuren, T., and Van der Heijden, B. I. (2015). “Sustainable labour participation and sustainable careers,” in Handbook of Research on Sustainable Careers, eds A. De Vos and B. I. J. M. Van der Heijden (Cheltenham: Edward Elgar Publishing), 146–160. doi: 10.4337/9781782547037.00015
Shultz, K. S., and Adams, G. A. (2007). “In search of a unifying paradigm for understanding aging and work in the 21st century,” in Aging and Work in the 21st Century, eds K. S. Shultz and G. A. Adams (Mahwah, NJ: Lawrence Erlbaum Associates, Inc.), 303–319.
Škerlavaj, M., Dimovski, V., Mrvar, A., and Pahor, M. (2010). Intra-organizational learning networks within knowledge-intensive learning Environments. Interact. Learn. Environ. 18, 39–63. doi: 10.1080/10494820802190374
Taris, T., and Kompier, M. (2004). “Job characteristics and learning behavior: review and psychological mechanisms,” in Research in Occupational Stress and Well-being: Exploring Interpersonal Dynamics, Vol. 4, eds P. L. Perrewe and D. C. Ganster (Amsterdam: JAI Press), 127–166. doi: 10.1016/S1479-3555(04)04004-1
Tikkanen, T. (2006). “The lifelong learning debate and older workers,” in Promoting Lifelong Learning for Older Workers – An International Overview, eds T. Tikkanen, and B. Nyhan (Luxembourg: Office for Official Publications of the European Communities), 18–47.
Tikkanen, T., Lahn, L., Withnall, A., Ward, P., and Lyng, K. (2002). Working Life Changes and Training of Older Workers. Final report to the WORKTOW project. TSER, DGXII/EU. Trondheim: VOX and European Commission.
Van de Vijver, F., and Leung, K. (1980). “Methods and data analysis of comparative research,” in Handbook of Cross-Cultural Psychology, Vol. 1, eds J. W. Berry, Y. H. Poortinga, and J. Pandey (Boston, MA: Allyn and Bacon), 257–300.
Van der Heijde, C. M., and Van der Heijden, B. I. J. M. (2006). A competence-based and multi-dimensional operationalization and measurement of employability. Hum. Resour. Manage. 45, 449–476. doi: 10.1002/hrm.20119
Van der Heijden, B. I. J. M. (2001). Encouraging professional development in small and medium-sized firms. The influence of career history and job content. Career Dev. Int. 6, 156–168. doi: 10.1108/13620430110389748
Van der Heijden, B. I. J. M., and Bakker, A. B. (2011). Towards a mediation model of employability enhancement: a study among employee-supervisor pairs in the building sector. Career Dev. Q. 59, 232–248. doi: 10.1002/j.2161-0045.2011.tb00066.x
Van der Heijden, B. I. J. M., Boon, J., Van der Klink, M., and Meijs, E. (2009a). Employability enhancement through formal and informal learning: an empirical study among Dutch non-academic university staff members. Int. J. Train. Dev. 13, 19–37. doi: 10.1111/j.1468-2419.2008.00313.x
Van der Heijden, B. I. J. M., De Lange, A.H., Demerouti, E., and Van der Heijde, C. M. (2009b). Age effects on the employability career success relationship. J. Voc. Behav. 74, 156–164. doi: 10.1016/j.jvb.2008.12.009
Van der Heijden, B. I. J. M., Notelaers, G., Peters, P., De Lange, A. H., Froehlich, D. E., Stoffers, J. M. M., et al. (2018). Development and validation of the shortened employability measure. J. Voc. Behav. 106, 236–248. doi: 10.1016/j.jvb.2018.02.003
Van der Heijden, B. I. J. M., Scholarios, D., Bozionelos, N., Van der Heijde, C. M., Epitropaki, O., and the Indic@tor Consortium (2005). Report on Final Results. Indic@tor Report: A Cross-Cultural Study on the Measurement and Enhancement of Employability in Small and Medium-Sized ICT-Companies. Brussels: European Commission.
Van der Heijden, B. I. J. M., Scholarios, D., Van der Schoot, E., Jedrzejowicz, P., Bozionelos, N., Epitropaki, O., et al. (2010). Supervisor-subordinate age dissimilarity and performance ratings: the buffering effects of supervisory relationship and practice. Int. J. Aging Hum. Dev. 71, 231–258. doi: 10.2190/AG.71.3.d
Van Vianen, A. E. M., Dalhoeven, A. G. W., and De Pater, I. E. (2011). Aging and training and development willingness: employee and supervisor mindsets. J. Organ. Behav. 32, 226–247. doi: 10.1002/job.685
Wet Bescherming persoonsgegevens (2000). [Law for the Protection of Personal Information 2000]. Available online at: http://wetten.overheid.nl/BWBR0011468/2017-03-10 (Accessed May 17, 2017).
Wright, P. M., McMahan, G. C., and McWilliams, A. (1994). Human resources as a source of sustained competitive advantage: a resource-based perspective. Int. J. Hum. Resour. Manage. 5, 301–326. doi: 10.1080/09585199400000020
Keywords: learning climate, psychological climate, employability, older workers, career stages, life-span perspective, multi-source ratings, ICT professionals
Citation: Van der Heijde CM, Van der Heijden BIJM, Scholarios D, Bozionelos N, Mikkelsen A, Epitropaki O, Marzec I, Jędrzejowicz P, Looise JC and the Indic@tor Study Group (2018) Learning Climate Perceptions as a Determinant of Employability: An Empirical Study Among European ICT Professionals. Front. Psychol. 9:2471. doi: 10.3389/fpsyg.2018.02471
Received: 28 June 2018; Accepted: 21 November 2018;
Published: 20 December 2018.
Edited by:Gabriele Giorgi, Università Europea Di Roma, Italy
Reviewed by:Joan Torrent-Sellens, Universitat Oberta De Catalunya, Spain
Leonidas A. Zampetakis, Technical University of Crete, Greece
Copyright © 2018 Van der Heijde, Van der Heijden, Scholarios, Bozionelos, Mikkelsen, Epitropaki, Marzec, Jędrzejowicz, Looise and the Indic@tor Study Group. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Claudia M. Van der Heijde, firstname.lastname@example.org