Abstract
The present study validated the general extended technology acceptance model for e-learning (GETAMEL) with the survey data from the English as a foreign language (EFL) online class during the novel coronavirus lockdown period. A total of 678 undergraduates participated in the survey. Structural equation modeling was employed to analyze the data. The results showed that the influence of perceived usefulness of students on their intentional behavior to use the online learning system was not mediated by their attitude, indicating a very limited role of attitude toward technology in the model. Enjoyment and self-efficacy had no significant effects on the internal constructs, raising theoretical concerns on the applicability of this general model into specific contexts. In addition, we found that experience might be a moderator rather than an antecedent of the internal constructs in the model.
Introduction
Technology acceptance is a critical perspective in an educational context to understand the acceptability of new technology. This is not only because the development of educational technology has never ceased, but also because some social events may generate new demands. On March 11, 2020, the WHO declared COVID-19 a pandemic (World Health Organization., 2020), which created a huge demand for online learning. In response, school education at all levels worldwide began shifting from offline classrooms to fully online instruction. Consequently, teachers were “forced” to become network anchors and livestream their lectures, and students had to complete all the courses online. In China, although online education has been carried out for years (e.g., Xie et al., 2001; Liu et al., ), many students have never had any experience of formal online learning in school education. Under the influence of the COVID-19 pandemic, maintaining an acceptable standard of learning in a fully online context for the student population has become a major concern for teachers and educational institutions.
The past three decades have witnessed the emergence of some theoretical models to investigate technology acceptance and use, among which the technology acceptance model (TAM) is one of the most widely applied models (Agudo-Peregrina et al., ). Based on the TAM, several studies have attempted to integrate constructs from competing models (Venkatesh et al., 2003) that can influence users' perception of new technologies, and thus extending the TAM models (e.g., Liu, ; Teo and Noyes, 2011; Hung et al., ; Huang et al., ). To synthesize the studies concerning extended TAM models, Abdullah and Ward () conducted a review study on the selection of the external variables and theorized the general extended TAM for e-learning (GETAMEL). However, there are few studies conducted to validate this model and verify whether the model can function as a rationale for follow-up research. Moreover, as pinpointed by the authors, the scope of their review is limited to the studies that “do not specify error values and only state significance levels” (Abdullah and Ward, , p. 253), and therefore, the validity of the GETAMEL model and the conclusions reached based on this model may be problematic if the model per se is not sufficiently validated.
Due to the COVID-19 pandemic, college students in China had to proceed with their English as a foreign language (EFL) learning through various online learning systems developed by domestic textbook publishers. However, little is known about the technology acceptance of Chinese EFL learners faced with such an abrupt change toward the “new normal” of learning fully online (Herath and Herath, ). Therefore, the present study aims to validate the GETAMEL model by conducting a survey among EFL learners and examine the validity and reliability of the adapted instrument for the GETAMEL model.
In this study, there are two reasons for targeting foreign language learning as our research context: first, the nature of language learning is highly interactive (Canale and Swain, ) and peer interaction in foreign language classrooms is an indispensable way for learners to learn the target language (McCabe, ; Jiang et al., ). A complete shift of the learning mode due to COVID-19 may change the way language learners used to interact with one another in class and may further influence how students perceive the technology use in their online language learning. Second, the GETAMEL model is a general extended TAM model, and its applicability in a discipline-specific context needs to be validated. Testing the hypotheses formulated in a general model against the data obtained from a discipline-specific context is not only essential for a robust model but also may result in potential adjustments to revise the model for its better and broader use.
Theory and Hypotheses
Internal Constructs of the GETAMEL Model
The GETAMEL model was proposed as an extended TAM model and comprises two components: the internal constructs and five specified external factors. The internal constructs were known as the TAM model that was first proposed by Davis () and has been verified and validated by enormous empirical studies ever since. In practice, the TAM model has evolved to become a core model in understanding the predictors of human behavior toward the potential acceptance or rejection of technology (Granić and Marangunić, ). Over the years, as it is considered as a robust, powerful, and parsimonious model, the TAM model has been widely used as a research framework to explain the technology acceptance of users in many studies under various contexts (Ursavaş, 2013). It is made up of two sorts of variables: (1) core variables of user motivation, including perceived ease of use (PEU), perceived usefulness (PU), and attitude toward technology (ATT) and (2) outcome variables such as behavioral intention (BI) to use the technology and actual use (AU).
The internal TAM constructs were established following the idea from the theory of reasoned action (TRA) (Ajzen and Fishbein, ), which holds that the salient perceptions of people determine their attitude toward a stimulus object, and their attitude determines their intention to perform a certain behavior, and the intention will ultimately determine their actual behaviors (Agudo-Peregrina et al., ). Adapting the idea of TRA into the context of technology acceptance and use, Davis () formulated the hypotheses that the acceptance or rejection of a specific technology by users, i.e., the AU of a specific technology, is fundamentally determined by PU and PEU (Marangunić and Granić, ), and this effect is mediated by the ATT of users and their BI to use the technology (as shown in Figure 1). The TAM constructs created a basis for understanding how external factors might influence the beliefs of people (i.e., PU and PEU), their attitude toward a given technology, their behavioral intention to use and their actual use of that technology (Park, ). Through the internal TAM constructs, researchers tend to understand and interpret how the perception of users on a new technology determines their intention to adopt or reject the technology and their actual technology use. By modeling this process, researchers and teachers can identify the potential adjustments that must be brought about by a new technology or system to make it more acceptable to users. For the past three decades, a range of issues were raised concerning the internal constructs, such as the debate over whether ATT is a necessary construct in the TAM model (e.g., Teo, ; Nistor and Heymann, ; López-Bonilla and López-Bonilla, ; Ursavaş, 2013).
Figure 1
As illustrated in Figure 1, AU is one outcome variable of observable behavior, whereas BI of users to use the technology is another outcome variable of intended behavior. It is, therefore, hypothesized that users' BI to use the technology is a direct determinant of their AU of the technology. Even though there is research pointing out that the direction of this relation is not deterministic as positive user experience may also predict future BI (Straub,
H1: Students' BI to use the online EFL learning system is positively related to their AU of the system.
Attitude is defined as “the degree of evaluative affect that an individual associates with using the target system in his or her job” (Fishbein and Ajzen,
H2a: Students' ATT is positively related to their BI to use the online EFL learning system.
H2b: Students' PU of the online EFL learning system is positively related to their BI to use the system.
Apart from PU, PEU, which is defined as “the degree to which a person believes that using a particular system would be free of effort” (Davis,
H3a: Students' PU of the online EFL learning system is positively related to their ATT.
H3b: Students' PEU of the online EFL learning system is positively related to their ATT.
H4a: Students' PEU of the online EFL learning system is positively related to their PU of the system.
External Factors of the GETAMEL Model
The TAM model has gained great momentum in the field of educational technology in the past 30 years. However, it was found that the percentage variance explained in primary studies was merely around 40% (McFarland and Hamilton,
In extant studies with respect to the extended TAM models, some external variables (e.g., information and communication technology (ICT) self-efficacy, ICT anxiety, and prior experience of technology use) that directly influence PU and PEU are often investigated to further interpret the technology acceptance or rejection of users (e.g., Teo et al., 2008; Park,
To provide valuable insights into the relations between external factors and the internal constructs, some review studies and meta-analyses (e.g., Abdullah and Ward,
Experience
Several studies concluded that prior experience played a vital role in explaining the e-learning adoption and facilitating the adoption process (e.g., Gurung and Daniel,
H4b: Students' experience of online learning is positively related to their PU of the online EFL learning system.
H5a: Students' experience of online learning is positively related to their PEU of the online EFL learning system.
Subjective Norm
Subjective norm refers to the degree to which an individual perceives that people who are important to him or her think he or she should (or should not) perform a behavior in question (Fishbein and Ajzen,
H4c: Students' subjective norm is positively related to their PU of the online EFL learning system.
H5b: Students' subjective norm is positively related to their PEU of the online EFL learning system.
Enjoyment
Enjoyment in learning is an important indicator of intrinsic motivation (Krapp and Prenzel,
H4d: Students' enjoyment in online learning is positively related to their PU of the online EFL learning system.
H5c: Students' enjoyment in online learning is positively related to their PEU of the online EFL learning system.
ICT Anxiety
The term ICT anxiety is derived from previous studies on computer or technology anxiety. Computer anxiety refers to fears or concerns about the implications of computer use such as the loss of important data or other possible mistakes (Thatcher and Perrewé, 2002). Several empirical studies have concluded that computer or technology anxiety is associated with the avoidance or less use of computers and technology (e.g., Cazan et al.,
H5d: Students' ICT anxiety is negatively related to their PEU of the online EFL learning system.
ICT Self-Efficacy
Similar to ICT anxiety, the term ICT self-efficacy is also derived from previous studies on computer self-efficacy and due to the same reason mentioned above, we used the broader term ICT self-efficacy instead. ICT self-efficacy refers to the confidence of students in their computer- and internet-related ability to carry out specific tasks and it has been concluded in many reviews and empirical studies that ICT self-efficacy plays an integral role in a computer-mediated learning environment (e.g., Moos and Azevedo,
H4e: Students' ICT self-efficacy is positively related to their PU of the online EFL learning system.
H5e: Students' ICT self-efficacy is positively related to their PEU of the online EFL learning system.
Based on their review, Abdullah and Ward (
Table 1
| GETAMEL components | Hypothesis | Path |
|---|---|---|
| Internal constructs | H1 | BI → AU |
| H2a | ATT → BI | |
| H2b | PU → BI | |
| H3a | PU → ATT | |
| H3b | PEU → ATT | |
| H4a | PEU → PU | |
| External factors | H4b | EXP → PU |
| H4c | SN → PU | |
| H4d | ENJ → PU | |
| H4e | ICTSE → PU | |
| H5a | EXP → PEU | |
| H5b | SN → PEU | |
| H5c | ENJ → PEU | |
| H5d | ICTA → PEU | |
| H5e | ICTSE → PEU |
A summary of the hypotheses.
BI, behavioral intention; AU, actual use; ATT, attitude toward technology; PU, perceived usefulness; PEU, perceived ease of use; EXP, experience; SN, subjective norm; ENJ, enjoyment; ICTSE, ICT self-efficacy; ICTA, ICT anxiety.
Methods
Context and Participants
In China, the earliest regional citywide lockdown policy took effect only one day before the Eve of Spring Festival (aka. the Chinese New Year), which is the biggest and most significant festival of the year for Chinese families. Therefore, millions of people could not return to their hometown to have their family reunion. In the whole 2020 Spring semester, most Chinese students at all levels (except for some students in their final year) were still observing the stay-at-home policy and learning completely online for the sake of health and safety considerations. Many teachers and students have been “forced” to conduct online teaching and learning for their first time in life. While online education has been growing in China in the past decade or so, it is the first time that the teachers and students in the whole nation completely replace traditional classroom with internet-based instructions.
A total of 678 undergraduate students majored in a range of subjects (i.e., Chinese literature and arts, education, mathematics, chemistry, biology, and computer science) from a university in China participated in the online questionnaire survey. Their average age was 18.3 years old; 42.1% of them were male and 57.9% were female. The study was approved by the university, and the students were well-informed of the purpose of the survey and gave their consent as participants before responding to the questionnaire formally. The participants were either in their first year or in their second year at the time of the survey and all registered “College English,” a compulsory EFL course for the students in Year 1 and Year 2. They reported an average score of 77.6 (out of 100) for their last term EFL course final exam, indicating that they had mostly met the course requirements and were eligible to continue with the course. According to their responses in the survey (after removing the invalid cases), 72.3% of the students had “never” or “seldom” participated in online English learning, and none of them had any experience of fully online English learning in their school education.
Measures
The questionnaire consisted of eight major sections that assessed the external and internal variables. To ensure full understanding of the questionnaire by participants, all the 36 items were translated from English into Chinese. Backward translation was then used to make sure that each translated item was semantically equivalent to those of the original English version. With that, some items were revised in response to the current online EFL learning context. Two professors in the field of learning sciences were consulted for validating the items. Based on their advice adjustments in language expression were then made.
Perceived usefulness (four items), PEU (three items), and ATT (three items) were measured on a six-point Likert scale ranging from “1 = strongly disagree” to “6 = strongly agree.” These three subquestionnaires were adapted from the work of Tsai et al. (2020). After removing invalid data records, the Cronbach's α-values of the three subquestionnaires were 0.941, 0.760, and 0.919, respectively.
Subjective norm (six items), ICT anxiety (four items), and BI (three items) were also measured on a six-point Likert scale ranging from “1 = completely not true of me” to “6 = completely true of me.” The measure for subjective norm was adapted from the work of Huang et al. (
The measures for ICT self-efficacy (six items) and enjoyment (seven items) were both derived from Fraillon et al. (
The experience was measured on one item, which is “Before the outbreak of this pandemic, what is your experience of having a fully online English course like the one we are having this semester?” This question was scored on a four-point Likert scale ranging from “1 = I have never had any experience of online English learning” to “4 = I always participate in online English learning.”
Actual use of the online EFL learning system was measured in terms of time spent by the students every day on the learning system for self-learning. They were required to estimate how much time they spent on the online learning system and choose among the seven options of time interval estimate. The options vary from “1 = Never” to “2 = 1–15 min every day” to “7 = More than 90 min every day” with an interval of 15 minutes each.
To minimize potential data contamination caused by careless respondents, we added three additional “filtering items” to the questionnaire. Three original items from the questionnaire were selected and paraphrased into three semantically identical statements. Then, they were paired up with the three original items. Thus, the six items constituted three semantic dyads, and each dyad possessed equivalence in meaning. Two professors in Chinese language and arts were consulted to ensure the semantic equivalence of each dyad. With that, the six items were placed back into the questionnaire. During the data screening process, if the response of a participant was deemed inconsistent (as shown in Section Data screening for specific filtering criteria) on the three dyads, we would remove it from the data set.
Methods for Hypothesis Testing
The exploratory factor analysis (EFA) was first conducted with SPSS 25.0 to examine the construct validity of the external factors. Using Mplus 7, the confirmatory factor analysis (CFA) was then conducted to ensure the validity of the measurement model, and then the structural equation modeling (SEM) was performed to estimate all path coefficients (Asparouhov and Muthén,
Typically, Chi-square (χ2), degree of freedom (df) together with the corresponding significance values (p), and other model fit information such as the comparative fit index (CFI), the Tucker-Lewis index (TLI), the root mean square error of approximation (RMSEA), and the standardized root mean square residual (SRMR) should be used to evaluate the model fit. Model fit is good when χ2/df is less than 3 and sometimes permissible when it is less than 5. Moreover, CFI and TLI should be no less than 0.95 for an excellent model fit and no less than 0.90 for an acceptable model fit (Huang et al.,
Data Analysis and Results
Data Screening
During the preprocessing of the data, the responses of each participant on the three filtering dyads were calculated and compared, based on the results of which the decisions were made regarding whether a data record should be retained for analysis. The filtering criteria were: if the sum of the absolute value of the averaged difference between all dyads was >1 unit per dyad, then the responding performance of the participant was deemed inconsistent, and thus the corresponding data record was considered invalid for further analysis and should be excluded; otherwise, if the sum was ≤3, then the data record was retained for further analysis. By doing so, a total of 67 participants (9.88%) were removed from the sample, leaving 611 cases for further analysis. Because the questionnaire was administered online, the input checking mechanism of the system was set up automatically to verify each input, and thus there was no missing data or data in inappropriate format.
Factor Analysis Results
The EFA was first performed to determine whether the items were properly loaded on four of the external factors (i.e., subjective norm, enjoyment, ICT anxiety, and ICT self-efficacy). The extraction method was principal axis factoring, and the rotation method was varimax. The EFA results showed that all the items were well-loaded on their corresponding constructs except for ICT anxiety. The factor loading of item 14 was 0.431, <0.5 (Hair et al.,
The CFA was then conducted to validate the constructs of the four external factors. The results showed that there seemed to exist some items with factor loadings <0.5 (Hair et al.,
Table 2
| External factors | Items | Factor loading | Cronbach's α | CR | AVE |
|---|---|---|---|---|---|
| SN | 15. My instructor thinks that the Internet is valuable for online English learning. | 0.73 | 0.835 | 0.831 | 0.453 |
| 16. My instructor's opinions are important to me. | 0.67 | ||||
| 17. My classmates think that using the Internet is valuable for online English learning. | 0.77 | ||||
| 18. My classmates' opinions are important to me. | 0.64 | ||||
| 19. My school is committed to supporting my efforts to use the Internet for learning. | 0.60 | ||||
| 20. The use of online learning is important in my university. | 0.62 | ||||
| ENJ | 7. It is very important to me to work with a computer. | 0.61 | 0.868 | 0.867 | 0.484 |
| 8. I think using a computer is fun. | 0.69 | ||||
| 9. It is more fun to do my work using a computer than without a computer. | 0.61 | ||||
| 10. I use a computer because I am very interested in the technology. | 0.66 | ||||
| 11. I like learning how to do new things using a computer. | 0.80 | ||||
| 12. I often look for new ways to do things using a computer. | 0.80 | ||||
| 13. I enjoy using the Internet to find out information. | 0.68 | ||||
| ICTA | 21. I feel apprehensive about using the online learning system. | 0.57 | 0.670 | 0.703 | 0.553 |
| 22. I hesitate to use the online learning system for fear of making mistakes that I cannot correct. | 0.89 | ||||
| ICTSE | How well can you do each of these tasks on a computer? | ||||
| 1. Search for and find a file on your computer; | 0.63 | 0.857 | 0.861 | 0.510 | |
| 2. Edit digital photographs or other graphic images | 0.62 | ||||
| 3. Create or edit documents (e.g., assignments for school); | 0.77 | ||||
| 4. Search for and find information you need on the Internet; | 0.75 | ||||
| 5. Create a multimedia presentation (with sound, pictures, or video) | 0.72 | ||||
| 6. Upload text, images, or video to an online profile. | 0.77 |
CFA results of external factors and construct validity and reliability.
SN, subjective norm; ENJ, enjoyment; ICTA, ICT anxiety; ICTSE, ICT self-efficacy.
For the internal constructs, CFA was also conducted to examine the measurement model. It was found that the model fit indices were acceptable (χ2 = 278.381, df = 59, p < 0.001, CFI = 0.969, TLI = 0.959, RMSEA = 0.078, and SRMR = 0.028), but the modification indices showed that two pairs of error terms need to be covaried. Then, the model fit became even better (χ2 = 209.115, df = 57, p < 0.001, CFI = 0.979, TLI = 0.971, RMSEA = 0.066, and SRMR = 0.022) (as shown in Table 3).
Table 3
| Internal constructs | Items | Factor loading | Cronbach's α | CR | AVE |
|---|---|---|---|---|---|
| PU | 27. Using online learning system will improve my English learning. | 0.87 | 0.941 | 0.936 | 0.785 |
| 28. Using online learning system will make my English learning more convenient. | 0.84 | ||||
| 29. Using online learning system will make me more effective in English learning. | 0.90 | ||||
| 30. Overall, I find the online learning system to be useful in English learning. | 0.94 | ||||
| PEU | 31. I find the online learning system to be clear and understandable. | 0.90 | 0.760 | 0.743 | 0.503 |
| 32. I find that the online learning system does not require a lot of mental effort. | 0.50 | ||||
| 33. I find the online learning system to be easy to use. | 0.67 | ||||
| ATT | 34. I think that using the online learning system is a good idea. | 0.88 | 0.919 | 0.918 | 0.788 |
| 35. I think that using the online learning system is beneficial to me. | 0.93 | ||||
| 36. I have positive perception of using the online learning system. | 0.85 | ||||
| BI | 24. If possible, I intend to use online learning system as a supplementary way to learn English. | 0.78 | 0.847 | 0.846 | 0.648 |
| 25. I will always try to use online learning system in my daily English learning. | 0.77 | ||||
| 26. If university continues to provide online English courses, I plan to use the online learning system frequently. | 0.86 |
CFA results of internal constructs and construct validity and reliability.
PU, perceived usefulness; PEU, perceived ease of use; ATT, attitude toward technology; BI, behavioral intention.
Descriptive statistics showed that the means of all the variables showed no floor or ceiling effect (Table 4). Additionally, their magnitude of the skewness fell between 0.02 and 0.86, less than the generally accepted threshold of 1. Moreover, except for subjective norm whose kurtosis value (i.e., 2.24) was marginally higher than the threshold of 2.20 (Sposito et al.,
Table 4
| Variables | Mean | SD | Skewness | Kurtosis |
|---|---|---|---|---|
| SN | 4.38 | 0.74 | −0.84 | 2.24 |
| ENJ | 4.41 | 0.67 | 0.15 | 2.09 |
| ICTA | 3.10 | 1.04 | 0.37 | 0.15 |
| ICTSE | 4.94 | 0.92 | −0.59 | −0.27 |
| PU | 4.20 | 0.99 | −0.84 | 1.06 |
| PEU | 3.91 | 0.92 | −0.49 | 0.80 |
| ATT | 4.22 | 0.99 | −0.86 | 1.14 |
| BI | 4.07 | 0.99 | −0.57 | 0.50 |
| EXP | 2.25 | 0.90 | 0.56 | −0.38 |
| AU | 3.61 | 1.60 | −0.02 | −0.60 |
Descriptive statistics.
n = 611; SN, subjective norm; ENJ, enjoyment; ICTA, ICT anxiety; ICTSE, ICT self-efficacy; PU, perceived usefulness; PEU, perceived ease of use; ATT, attitude toward technology; BI, behavioral intention; EXP, experience; AU, actual use.
Convergent and Divergent Validity
Furthermore, convergent validity and divergent validity were assessed to further validate the measurement models of external factors and the internal TAM constructs. Convergent validity and divergent validity are commonly regarded as the subsets of construct validity. Convergent validity tests that the possibly related constructs are, in fact, related, whereas divergent validity or discriminant validity tests that the constructs that are theorized to have no relationship do, in fact, not have any relationship.
According to Fornell and Larcher (
Divergent validity is established when the measured constructs are, in fact, different. It can also be assessed at the item level and the construct level. Divergent validity is considered adequate when an item is correlated with the items that are loaded on the same construct more strongly than with those loaded on other constructs (Barclay et al.,
At the construct level, according to Hair et al. (
Table 5
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | |
|---|---|---|---|---|---|---|---|---|
| 1. SN | (0.673) | |||||||
| 2. ENJ | 0.13* | (0.696) | ||||||
| 3. ICTA | 0.11* | −0.03 | (0.744) | |||||
| 4. ICTSE | 0.05* | 0.05* | −0.06* | (0.714) | ||||
| 5. PU | 0.43* | 0.15* | −0.03 | 0.07* | (0.886) | |||
| 6. PEU | 0.39* | 0.15* | −0.10 | 0.08* | 0.82* | (0.783) | ||
| 7. ATT | 0.41* | 0.16* | −0.09 | 0.08* | 0.83* | 0.82* | (0.888) | |
| 8. BI | 0.41* | 0.15* | −0.02 | 0.04 | 0.72* | 0.70* | 0.69* | (0.805) |
Inter-construct correlation matrix of the external factors and the internal constructs.
The square roots of AVE values are in parentheses on the diagonal; SN, subjective norm; ENJ, enjoyment; ICTA, ICT anxiety; ICTSE, ICT self-efficacy; PU, perceived usefulness; PEU, perceived ease of use; ATT, attitude toward technology; BI, behavioral intention;
p < 0.001.
SEM Results
The SEM was conducted to test the model fit between the GETAMEL model and the data collected in the present study. Figure 2 reports the standardized path coefficients of the GETAMEL model and the squared multiple correlations (R2) of the endogenous variables. The model fit was found to be acceptable (χ2 = 1,664.658, df = 571, p < 0.001, CFI = 0.916, TLI = 0.908, RMSEA = 0.056, and SRMR = 0.053). The variance explained among the endogenous variables, i.e., the R2-values were of moderate to high magnitude (ranging from 0.46 to 0.88), except for AU, which was only 0.07, indicating that the relationship tested (BI → AU) might not be very meaningful because BI did not explain a sufficient variance in AU.
Figure 2

SEM results of the general extended technology acceptance model for e-learning. The numbers on each path were the standardized estimates of the path coefficients. All significant paths (significant at 0.001) are presented as solid lines and the non-significant paths are presented as dotted lines. The R2-values (variances explained) are labeled in bold to the top right of the internal constructs.
As shown in Figure 2, the hypotheses with regard to the internal constructs were all supported by our data except for ATT → BI. First, PEU had a significantly strong and positive influence on PU (β = 0.81, p < 0.001) and ATT (β = 0.37, p < 0.001), and PU was significantly related to ATT (β = 0.59, p < 0.001). Thus, H4a, H3b, and H3a were all supported. Second, PU had a significantly strong and positive influence on BI (β = 0.91, p < 0.001) while ATT was not significantly related to BI (β = −0.03, n.s.). Thus, H2b was supported but H2a was not. Third, BI is significantly and positively related to AU (β = 0.27, p < 0.001), and therefore, H1 was also supported.
For the external factors, only three out of the nine hypotheses were supported in our research context, and the other six were not. First, subjective norm was significantly and positively related to both PU (β = 0.20, p < 0.001) and PEU (β = 0.59, p < 0.001). Thus, H4c and H5b were both supported. ICT anxiety was found to be significantly but negatively related to PEU (β = −0.26, p < 0.001), and thus, H5d was also supported. Second, the association between experience and PU was non-significant and hardly present (β = −0.01, n.s.), and thus, H4b was not supported. Experience was found to be positively related to PEU (β = 0.12, p = 0.002) on the significant level of 0.01, but on a 0.001 level, it is not significantly related to PEU. Thus, H5a was not supported. Third, enjoyment was not found to have a significant influence on either PU (β = 0.02, n.s.) or PEU (β = 0.08, n.s.). Likewise, ICT self-efficacy was not significantly related to either PU (β = −0.04, n.s.) or PEU (β = 0.02, n.s.). Thus, none of the H4d, H5c, H4e, and H5e were supported in our context. A summary of the hypothesis testing results is shown in Table 6.
Table 6
| GETAMEL components | Hypothesis | Path | β-value | Result |
|---|---|---|---|---|
| Internal constructs | H1 | BI → AU | 0.27** | Supported |
| H2a | ATT → BI | −0.03 | Not supported | |
| H2b | PU → BI | 0.91** | Supported | |
| H3a | PU → ATT | 0.59** | Supported | |
| H3b | PEU → ATT | 0.37** | Supported | |
| H4a | PEU → PU | 0.81** | Supported | |
| External factors | H4b | EXP → PU | −0.01 | Not supported |
| H4c | SN → PU | 0.20** | Supported | |
| H4d | ENJ → PU | 0.02 | Not supported | |
| H4e | ICTSE → PU | −0.04 | Not supported | |
| H5a | EXP → PEU | 0.12 | Not supported | |
| H5b | SN → PEU | 0.59** | Supported | |
| H5c | ENJ → PEU | 0.08 | Not supported | |
| H5d | ICTA → PEU | −0.26** | Supported | |
| H5e | ICTSE → PEU | 0.02 | Not supported |
Hypothesis testing results.
p < 0.001; n = 611; SN, subjective norm; ENJ, enjoyment; ICTA, ICT anxiety; ICTSE, ICT self-efficacy; PU, perceived usefulness; PEU, perceived ease of use; ATT, attitude toward technology; BI, behavioral intention; EXP, experience; AU, actual use.
Discussion
Using the data collected from a fully online EFL course, the present study validated the GETAMEL model proposed by Abdullah and Ward (
Limited Role of Attitude Towards Technology
Inconsistent with most studies demonstrating a significant effect of ATT on the impact of users' PU on their BI to use the system (e.g., Teo et al., 2008; Huang et al.,
Davis et al. (
A General Model in a Specific Context
Abdullah and Ward (
The local Chinese culture may also explain the limited role of enjoyment in the GETAMEL model. Peer interaction was considered a major source of enjoyment by EFL learners (Jiang and Dewaele,
The two external factors (i.e., enjoyment and ICT self-efficacy) did not have significant effects on the internal constructs, which may be attributed to the “general” orientation of the model. Evidently, the GETAMEL model was a broad model that did not take into account the characteristics of specific pedagogical contexts. Different classroom learning contexts may require different external factors to explain learners' technology acceptance and use. For example, students may still do well in lecture-based virtual mathematics classrooms, but foreign language classes must provide students with as many opportunities for interaction as possible (Peterson,
Experience as an Antecedent or a Moderator?
In the GETAMEL model, the experience was the fifth commonly investigated variable selected as an external factor and its averaged effect size was small to medium (Abdullah and Ward,
In the present study, most of the students surveyed had little experience of formal online learning, and therefore, more evidence is needed to confirm whether experience should be integrated as an antecedent or a moderator. However, from the perspective of a system developer, this may be a desirable result, “as it suggests that the use of a well-designed e-learning system does not depend on previous internet experience or self-efficacy” (Pituch and Lee,
Conclusion, Limitations, and Implications
Using the data collected from an online EFL course during the COVID-19 lockdown, the present study validated the GETAMEL model proposed by Abdullah and Ward (
One major limitation of the present study is the representativeness of the sample. The participants were only enrolled in one university in China. Therefore, more studies in different tertiary online EFL settings are needed to explore students' technology acceptance during the COVID-19 outbreak. Another limitation is the assessment of students' AU of online learning system. Because the survey was administered anonymously, the data gathered could not be matched with their behavioral data from the online learning system. Therefore, this study could only use self-reported data to evaluate participants' AU of the system, which might have resulted in systematic errors in assessment. As far as the analysis result was concerned, the R2-value of AU was only 0.07, indicating that over 90% of the variance in AU was not properly explained by the data. Third, the measure of ICT anxiety was only comprised of two items, and future studies may need to consider revising the item expressions or adapting a different instrument to measure it adequately.
A theoretical implication of the present study is that the external factors integrated into the GETAMEL model were found to fit the specific learning context poorly, indicating that a model modification is needed for the external factors in the GETAMEL model. External factors such as experience may be integrated as a moderator rather than as an antecedent. As mentioned before, it would be controversial and problematic when the inclusion criterion of the external factors was simply based on how many studies had investigated a particular variable. To enhance the robustness of the GETAMEL model, future studies need to include domain- or discipline-specific variables into this model to surface the impact of disciplinary characteristics on users' technology acceptance. On the other hand, the present study found that the role of ATT might not be a mediating variable under the influence of the COVID-19 lockdown. Accordingly, in practice, students' ATT may be revisited under such a circumstance when EFL teachers design online course activities. A proper understanding of students' attitude toward the technologies employed in a fully online classroom under the influence of COVID-19 may improve the learning performance of students. Moreover, future studies may need to consider more demographic information of the participants such as socioeconomic status and relevant cultural factors in understanding the relationships between the external factors and the internal constructs.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Statements
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Local Ethics Committee of The Chinese University of Hong Kong. The patients/participants provided their written informed consent to participate in this study.
Author contributions
MJ made contributions to the conception or design of the work, analysis or interpretation of data for the work, and drafting the work. MC made comments on the content and also proofread the manuscript. C-sC agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. Y-lM collected the data. MJ and WL revised the manuscript critically. MJ also provided approval for publication of the content. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AbdullahF.WardR. (2016). Developing a General Extended Technology Acceptance Model for E-Learning (GETAMEL) by analysing commonly used external factors. Comput. Human Behav. 56, 238–256. 10.1016/j.chb.2015.11.036
2
Agudo-PeregrinaÁ. F.Hernández-GarcíaÁ.Pascual-MiguelF. J. (2014). Behavioral intention, use behavior and the acceptance of electronic learning systems: differences between higher education and lifelong learning. Comput. Human Behav. 34, 301–314. 10.1016/j.chb.2013.10.035
3
AjzenI.FishbeinM. (1980). Understanding Attitudes and Predicting Social Behavior. Englewood Cliffs, NJ: Prentice-Hall.
4
Al-alakB. A.AlnawasI. A. (2011). Measuring the acceptance and adoption of e-learning by academic staff. Know. Manage. E-Learn. Int. J. 3, 201–221. 10.34105/j.kmel.2011.03.016
5
AlfaddaH. A.MahdiH. S. (2021). Measuring students' use of Zoom application in language course based on the technology acceptance model (TAM). J. Psycholinguist. Res. 50, 883–900. 10.1007/s10936-020-09752-1
6
Al-QaysiN.Mohamad-NordinN.Al-EmranM. (2020). Employing the technology acceptance model in social media: a systematic review. Educ. Inf. Technol. 25, 4961–5002. 10.1007/s10639-020-10197-1
7
AmoahS.YeboahJ. (2021). The speaking difficulties of Chinese EFL learners and their motivation towards speaking the English language. J. Lang. Linguist. Stud. 17, 56–69. 10.52462/jlls.4
8
AsparouhovT.MuthénB. (2010). Resampling methods in Mplus for complex survey data. Struct. Equat. Model. 14, 535–569. Available online at: https://www.statmodel.com/download/Resampling_Methods5.pdf
9
BarclayD.HigginsC.ThompsonR. (1995). The Partial Least Squares (PLS) approach to causal modeling: personal computer adoption and use as an illustration. Technol. Stud. 2, 285–309.
10
BrownI. T.StothersR. J.ThorpS. R.IngramL. T. (2006). The role of learning styles in the acceptance of web-based learning tools, in 36th Annual Conference of the Southern African Computer Lecturers Association, SACLA2006 (Somersett West), 189–200.
11
CanaleM.SwainM. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Appl. Linguist. 1, 1–47. 10.1093/applin/I.1.1
12
CastañedaJ. A.Muñoz-LeivaF.LuqueT. (2007). Web Acceptance Model (WAM): moderating effects of user experience. Inform. Manage. 44, 384–396. 10.1016/j.im.2007.02.003
13
CazanA. M.Cocorad?E.MaicanC. I. (2016). Computer anxiety and attitudes towards the computer and the internet with Romanian high-school and university students. Comput. Human Behav. 55, 258–267. 10.1016/j.chb.2015.09.001
14
CloughG.JonesA. C.McAndrewP.ScanlonE. (2008). Informal learning with PDAs and smartphones. J. Comput. Assist. Learn. 24, 359–371. 10.1111/j.1365-2729.2007.00268.x
15
CohenJ. (1988). Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. Hillsdale, NJ: Lawrence Erlbaum.
16
DavisF. D. (1985). A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results. Cambridge, MA: Massachusetts Institute of Technology. Available online at: https://dspace.mit.edu/bitstream/handle/1721.1/15192/14927137-MIT.pdf?sequence=2 (accessed Jun 16, 2020).
17
DavisF. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quar. 13, 319–340. 10.2307/249008
18
DavisF. D.BagozziD.RichardP.WarshawP. R. (1989). User acceptance of computer technology: a comparison of two theoretical models. Manage. Sci. 35, 982–1003. 10.1287/mnsc.35.8.982
19
FishbeinM.AjzenI. (1975). Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research. Reading, MA: Addison-Wesley.
20
FornellC.LarcherD. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. J. Market. Res. 48, 39–50. 10.1177/002224378101800104
21
FraillonJ.AinleyJ.SchulzW.FriedmanT.GebhardtE. (2014). Preparing for Life in a Digital Age. The IEA International Computer and Information Literacy Study International Report. Springer. 10.1007/978-3-319-14222-7
22
GranićA.MarangunićN. (2019). Technology acceptance model in educational context: a systematic literature review. Brit. J. Educ. Technol. 50, 2572–2593. 10.1111/bjet.12864
23
GurungR. A.DanielD. (2005). Do text-based pedagogical features enhance student learning?, in Best Practices for Teaching Introduction to Psychology, eds DunnD. S.ChewS. L. (Hillsdale, NJ: Lawrence Erlbaum), 41–55.
24
HairJ.BlackW.BabinB.AndersonR. (2010). Multivariate Data Analysis, 7th Edn. Englewood Cliffs, NJ: Prentice-Hall, Inc.
25
HerathT.HerathH. S. B. (2020). Coping with the new normal imposed by the COVID-19 pandemic: lessons for technology management and governance. Inform. Syst. Manage. 37, 277–283. 10.1080/10580530.2020.1818902
26
HsiehJ. Y.LiaoP. W. (2011). Antecedents and moderators of online shopping behavior in undergraduate students. Soc. Behav. Pers. 39, 1271–1280. 10.2224/sbp.2011.39.9.1271
27
HuangF.TeoT.ZhouM. M. (2020). Chinese students' intentions to use the Internet based technology for learning. Educ. Technol. Res. Dev. 68, 575–591. 10.1007/s11423-019-09695-y
28
HuangS. H.JiangY. C.YinH. B.JongS. Y. M. (2021). Does ICT use matter? The relationships between students' ICT use, motivation, and science achievement in East Asia. Learn. Indiv. Diff. 86, 101957. 10.1016/j.lindif.2020.101957
29
HungW. H.HsiehP. H.HuangY. D. (2018). Critical factors of the adoption of e-textbooks: a comparison between experienced and inexperienced users. Int. Rev. Res. Open Distrib. Learn. 19, 171–190. 10.19173/irrodl.v19i4.3854
30
JiangM. Y. C.JongM. S. Y.LauW. W. F.ChaiC. S.LiuK. S. X.ParkM. (2020). A scoping review on flipped classroom approach in language education: challenges, implications and an interaction model. Comp. Assist. Lang. Learn. 10.1080/09588221.2020.1789171
31
JiangY.DewaeleJ. (2019). How unique is the foreign language classroom enjoyment and anxiety of Chinese EFL learners?System82, 13–25. 10.1016/j.system.2019.02.017
32
KamalS. A.ShafiqM.KakriaP. (2020). Investigating acceptance of telemedicine services through an extended technology acceptance model (TAM). Technol. Soc. 60, 101212. 10.1016/j.techsoc.2019.101212
33
KimY. J.ChunJ. U.SongJ. (2009). Investigating the role of attitude in technology acceptance from an attitude strength perspective. Int. J. Inf. Manage. 29, 67–77. 10.1016/j.ijinfomgt.2008.01.011
34
KrappA.PrenzelM. (2011). Research on interest in science: theories, methods, and findings. Int. J. Sci. Educ. 33, 27–50. 10.1080/09500693.2010.518645
35
KuH. Y.LohrL. L. (2003). A case study of Chinese students' attitudes toward their first online learning experience. Educ. Technol. Res. Dev. 51, 95–102. 10.1007/bf02504557
36
KumarJ. A.BervellB.AnnamalaiN.OsmanS. (2020). Behavioral intention to use mobile learning: evaluating the role of self-efficacy, subjective norm, and WhatsApp use habit. IEEE Access8, 208058–208074. 10.1109/ACCESS.2020.3037925
37
LeeJ. C. K.YinH. B. (2011). Teachers' emotions and professional identity in curriculum reform: a Chinese perspective. J. Educ. Change12, 25–46. 10.1007/s10833-010-9149-3
38
LegrisP.InghamJ.ColleretteP. (2003). Why do people use information technology? A critical review of the technology acceptance model. Inform. Manage. 40, 191–204. 10.1016/S0378-7206(01)00143-4
39
LiuH. X.WangL. N.KoehlerM. (2019). Exploring the intention-behavior gap in the technology acceptance model: a mixed-methods study in the context of foreign-language teaching in China. Brit. J. Educ. Technol. 50, 2536–2556. 10.1111/bjet.12824
40
LiuX. (2010). Empirical testing of a theoretical extension of the technology acceptance model: an exploratory study of educational wikis. Commun. Educ. 59, 52–69. 10.1080/03634520903431745
41
LiuY.LinF. Z.WangX. (2003). Education practice and analysing behaviour of students in a Web-based learning environment: an exploratory study from China. Online Inform. Rev. 27, 110–119. 10.1108/14684520310471725
42
López-BonillaL. M.López-BonillaJ. M. (2011). The role of attitudes in the TAM: a theoretically unnecessary construct?Brit. J. Educ. Technol. 42, E160–E162. 10.1111/j.1467-8535.2011.01232.x
43
MalhotraN. K.DashS. (2011). Marketing Research: An Applied Orientation. London: Pearson Publishing.
44
MarangunićN.GranićA. (2015). Technology acceptance model: a literature review from 1986 to 2013. Univ. Access Inform. Soc. 14, 81–95. 10.1007/s10209-014-0348-1
45
McCabeA. (2017). Knowledge and interaction in on-line discussions in Spanish by advanced language learners. Comput. Assist. Lang. Learn. 30, 409–431. 10.1080/09588221.2017.1312461
46
McFarlandD. J.HamiltonD. (2006). Adding contextual specificity to the technology acceptance model. Comput. Human Behav. 22, 427–447. 10.1016/j.chb.2004.09.009
47
MoosD.AzevedoR. (2009). Learning with computer-based learning environments: a literature review of computer self-efficacy. Rev. Educ. Res. 79, 576–600. 10.3102/0034654308326083
48
NistorN.HeymannJ. O. (2010). Reconsidering the role of attitude in the TAM: an answer to Teo (2009). Brit. J. Educ. Technol. 41, E142–E145. 10.1111/j.1467-8535.2010.01109.x
49
NistorN.StanciuD.LercheT.KielE. (2019). “I am fine with any technology, as long as it doesn't make trouble, so that I can concentrate on my study”: a case study of university students' attitude strength related to educational technology acceptance. Brit. J. Educ. Technol. 50, 2557–2571. 10.1111/bjet.12832
50
PanX. (2020). Technology acceptance, technological self-efficacy, and attitude toward technology-based self-directed learning: learning motivation as a mediator. Front. Psychol. 11, 564294. 10.3389/fpsyg.2020.564294
51
ParkS. Y. (2009). An analysis of the technology acceptance model in understanding university students' behavioral intention to use e-learning. Educ. Technol. Soc. 12, 150–162. Available online at: https://drive.google.com/open?id=1bgLrPGI06s5y88jleULS2-Jpu0xGU3Db
52
ParkY.SonH.KimC. (2012). Investigating the determinants of construction professionals' acceptance of web-based training: an extension of the technology acceptance model. Automat. Construct. 22, 377–386. 10.1016/j.autcon.2011.09.016
53
PekrunR.GoetzT.TitzW.PerryR. P. (2002). Academic emotions in students' self-regulated learning and achievement: a program of qualitative and quantitative research. Educ. Psychol. 37, 91–105. 10.1207/S15326985EP3702_4
54
PetersonM. (2009). Learner interaction in synchronous CMC: a sociocultural perspective. Comput. Assist. Lang. Learn. 22, 303–321. 10.1080/09588220903184690
55
PituchK. A.LeeY. K. (2006). The influence of system characteristics on e-learning use. Comput. Educ. 47, 222–244. 10.1016/j.compedu.2004.10.007
56
RazaS. A.QaziW.KhanK. A.SalamJ. (2021). Social isolation and acceptance of the learning management system (LMS) in the time of COVID-19 pandemic: an expansion of the UTAUT model. J. Educ. Comput. Res. 59, 183–208. 10.1177/0735633120960421
57
SchererR.SiddiqF.TondeurJ. (2019). The technology acceptance model (TAM): a meta-analytic structural equation modeling approach to explaining teachers' adoption of digital technology in education. Comput. Educ. 128, 13–35. 10.1016/j.compedu.2018.09.009
58
SchreiberJ. B.NoraA.StageF. K.BarlowE. A.KingJ. (2006). Reporting structural equation modeling and confirmatory factor analysis results: a review. J. Educ. Res. 99, 323–338. 10.3200/JOER.99.6.323-338
59
SpositoV. A.HandM. L.BradleyS. (1983). On the efficiency of using the sample kurtosis in selecting optimal lp estimators. Commun. Stat. Simul. Comput. 12, 265–272. 10.1080/03610918308812318
60
StraubE. (2009). Understanding technology adoption: theory and future directions for informal learning. Rev. Educ. Res. 79, 625–649. 10.3102/0034654308325896
61
TeoT. (2009). Is there an attitude problem? Reconsidering the role of attitude in the TAM. Brit. J. Educ. Technol. 40, 1139–1141. 10.1111/j.1467-8535.2008.00913.x
62
TeoT. (2018). Students and teachers' intention to use technology: assessing their measurement equivalence and structural invariance. J. Educ. Comput. Res. 57, 201–225. 10.1177/0735633117749430
63
TeoT.NoyesJ. (2011). An assessment of the influence of perceived enjoyment and attitude on the intention to use technology among pre-service teachers: a structural equation modeling approach. Comput. Educ. 57, 1645–1653. 10.1016/j.compedu.2011.03.002
64
TeoT.WongS. L.ChaiC. S. (2008). A cross-cultural examination of the intention to use technology between Singaporean and Malaysian pre-service teachers: an application of the Technology Acceptance Model (TAM). Educ. Technol. Soc. 11, 265–280. Available online at: https://drive.google.com/open?id=185e7OFtP_adIlUSkqS9c34cUPnDy-MJl
65
ThatcherJ. B.PerrewéP. L. (2002). An empirical examination of individual traits as antecedents to computer anxiety and computer self-efficacy. MIS Quar. 26, 381–396. 10.2307/4132314
66
TsaiT. H.LinW. Y.ChangY. S.ChangP. C.LeeY. M. (2020). Technology anxiety and resistance to change behavioral study of a wearable cardiac warming system using an extended TAM for older adults. PLoS ONE15, e0227270. 10.1371/journal.pone.0227270
67
UrsavaşF. Ö. (2013). Reconsidering the role of attitude in the TAM: an answer to Teo (2009) and Nistor and Heymann (2010), and Lopez-Bonilla and Lopez-Bonilla (2011). Brit. J. Educ. Technol. 44, E22–E25. 10.1111/j.1467-8535.2012.01327.x
68
VenkateshV. (2000). Determinants of perceived ease of use: integrating control, intrinsic motivation, and emotion into the technology acceptance model. Inform. Syst. Res. 11, 342–365. 10.1287/isre.11.4.342.11872
69
VenkateshV.MorrisM. G.DavisG. B.DavisF. D. (2003). User acceptance of information technology: toward a unified view. MIS Quarterly. 27, 425–478. 10.2307/30036540
70
VladovaG.UllrichA.BenderB.GronauN. (2021). Students' acceptance of technology-mediated teaching – how it was influenced during the COVID-19 pandemic in 2020: a study from Germany. Front. Psychol. 10.3389/fpsyg.2021.636086
71
World Health Organization. (2020). Rolling Updates on Coronavirus Disease (COVID-19). Available online at: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/events-as-they-happen (accessed May 25th, 2020).
72
XieX. Y.LinF. Z.ZhangT. (2001). Comparison between on- and off-campus behaviour and adaptability in online learning: a case from China. Behav. Inform. Technol. 20, 281–291. 10.1080/01449290110083594
73
YanC. M.HeC. J. (2020). Chinese student teachers' reticence in teacher education courses. ELT J. 74, 287–296. 10.1093/elt/ccaa014
74
ZhengJ.LiS. (2020). What drives students' intention to use tablet computers: an extended technology acceptance model. Int. J. Educ. Res. 102, 101612. 10.1016/j.ijer.2020.101612
Summary
Keywords
technology acceptance model, GETAMEL, validation, online EFL course, extended technology acceptance model
Citation
Jiang MY, Jong MS, Lau WW, Meng Y, Chai C and Chen M (2021) Validating the General Extended Technology Acceptance Model for E-Learning: Evidence From an Online English as a Foreign Language Course Amid COVID-19. Front. Psychol. 12:671615. doi: 10.3389/fpsyg.2021.671615
Received
24 February 2021
Accepted
24 August 2021
Published
01 October 2021
Volume
12 - 2021
Edited by
Claudio Longobardi, University of Turin, Italy
Reviewed by
Jesús-Nicasio García-Sánchez, Universidad de León, Spain; Junfeng Zhang, Nanjing University, China
Updates

Check for updates
Copyright
© 2021 Jiang, Jong, Lau, Meng, Chai and Chen.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yan-li Meng yanlimeng@synu.edu.cn
This article was submitted to Educational Psychology, a section of the journal Frontiers in Psychology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.