Original Research ARTICLE
Predicting self-reported research misconduct and questionable research practices in university students using an augmented Theory of Planned Behavior
- School of Psychology and Speech Pathology, Curtin University, Perth, WA, Australia
This study examined the utility of the Theory of Planned Behavior model, augmented by descriptive norms and justifications, for predicting self-reported research misconduct and questionable research practices in university students. A convenience sample of 205 research active Western Australian university students (47 male, 158 female, ages 18–53 years, M = 22, SD = 4.78) completed an online survey. There was a low level of engagement in research misconduct, with approximately one in seven students reporting data fabrication and one in eight data falsification. Path analysis and model testing in LISREL supported a parsimonious two step mediation model, providing good fit to the data. After controlling for social desirability, the effect of attitudes, subjective norms, descriptive norms and perceived behavioral control on student engagement in research misconduct and questionable research practices was mediated by justifications and then intention. This revised augmented model accounted for a substantial 40.8% of the variance in student engagement in research misconduct and questionable research practices, demonstrating its predictive utility. The model can be used to target interventions aimed at reducing student engagement in research misconduct and questionable research practices.
Academic integrity is vital to the foundation of the academic community and its credibility (McCabe and Trevino, 1993; McCabe et al., 2008). There are two types of dishonest misconduct that threaten academic integrity: academic misconduct (cheating, deception, and corruption; Mavrinac et al., 2010) and research misconduct (fabrication, falsification, and plagiarism in proposing and conducting research or reporting results; National Health and Medical Research Council and Australian Research Council, 2007). The US Department of Health and Human Services Office of Research Integrity (2000, p. 1) further define fabrication as making up data or results and reporting them, and falsification as “manipulating research materials, processes or changing or omitting data." Questionable research practices, consisting of failing to obtain approval, not obtaining consent before conducting research, ignoring outliers, publishing post hoc analyses without explanation, and publishing articles using data that have not been collected legitimately or that have been reported elsewhere (Pimple, 2002; Gilbert and Denison, 2003; Martinson et al., 2005; Kumar, 2008; Rose, 2008; Bedian et al., 2010), also fall within the umbrella of research misconduct. While data fabrication and falsification are the more serious forms of research misconduct, questionable research practices potentially have a larger impact on research integrity as they are more widespread (Anderson et al., 2013).
A growing body of research has examined research misconduct in academic settings. The most common form of research misconduct, plagiarism, is the area of research misconduct that has received the most attention (e.g., Park, 2003; Bennett, 2005; Marsden et al., 2005; Pickard, 2006; Mavrinac et al., 2010; Ogilvie and Stewart, 2010). In comparison, limited research has addressed fabrication, falsification, and questionable research practices in academic settings, and these areas are the focus of this research.
Estimates of the prevalence of research misconduct and questionable research practices among researchers and academics range widely, depending upon the measure used. Only 20–30 cases are reported to the US National Science Foundation and Department of Health and Human Service each year, representing a rate of 1 case per 100,000 researchers (Steneck, 2006). Estimates based on journal articles retracted for fabrication or falsification provide higher prevalence rates, but vary according to the years and databases covered. Based on analysis of article retractions in journals indexed by PubMed, Claxton (2005) estimated research misconduct was detected in less than one case per 5,000 papers (0.02%). Working on the assumption that for every case detected up to 10 cases may go undetected, Claxton estimated that the actual rate of fraudulent papers may be as high as 0.2%. Across databases, Grieneisen and Zhang (2012) identified 4449 articles retracted between 1928 and 2011, reporting that 20% were retracted for research misconduct, with a further 42% retracted for questionable data or interpretation. In contrast, using only articles indexed in PubMed, Fang et al. (2012) reported that 43% of the 2,047 articles retracted were retracted for fraud or suspected fraud. Articles retracted for data fabrication and/or falsification, in comparison to articles retracted for error, are clustered in high impact journals, have more authors and the first author is more likely to have previous retractions (Steen, 2010). Across retraction studies, the incidence of retracted papers is consistently reported to be increasing over time (Steen, 2011; Fang et al., 2012; Grieneisen and Zhang, 2012).
Higher prevalence estimates again are obtained when using self-report methodologies. In a recent meta-analysis, Fanelli (2009) reported that ~2% of scientists admitted to fabrication, falsification or modification of data at least once, whereas approximately a third admitted to questionable research practices. Interestingly, participants reported higher rates of awareness of at least one other researcher engaging in the fabrication of data (14%) and questionable research practices (72%). Further, self-reports may underestimate the actual prevalence of research misconduct and questionable research practices. John et al. (2012) provided incentives for honest reporting combined with anonymous reporting, with US academic psychologist respondents self-admitted questionable research practices ranging from 4.5% (claiming results unaffected by demographic variables when unsure/know false) to 66.5% (failing to report all of a study’s dependent variables).
Research misconduct and questionable research practices by researchers and academics may have roots in practices developed while students, and may reach back as far as the undergraduate years. Studies that have explored fabrication, falsification or questionable research practices in student populations have generally used student samples from degrees in ‘hard sciences,’ such as biomedical science, where the ‘correct’ answers to laboratory experiments are already known, making results more likely to be falsified (Davidson et al., 2001). Davidson et al. (2001) reported that 40–75% of undergraduate students admitted to ‘almost always’ manipulating data in science labs. Similar figures have been reported for other samples of science undergraduates (Franklyn-Stokes and Newstead, 1995; Lawson et al., 1999/2000). In contrast, figures are much lower (approximately one in five) when sampling undergraduates more broadly across disciplines outside of the sciences (Brimble and Stevenson-Clarke, 2005; McCabe, 2005). Of particular concern, one in ten Ph.D. students report falsification and fabrication of data is acceptable (Hofman et al., 2013).
Students who engage in academically dishonest behavior at university are likely to engage in dishonest behavior in the workforce (Nonis and Swift, 2001; Graves, 2008), highlighting the importance of understanding and addressing research misconduct at the time it first emerges, in the undergraduate years.
In attempting to understand dishonest behavior a range of competing economic, criminological and psychological theories have been used. In summarizing the factors shaping dishonest behavior across contexts, Ariely (2012, Figure 6) highlights the role of rationalizations, conflicts of interest, creativity, engaging in the first dishonest act, ego-depletion, benefit to others, observing the dishonest behavior of others and culture. Within academic settings, a range of theoretical frameworks, such as the General Theory of Crime (Gottfredson and Hirshci, 1990), Social Learning Theory (Bandura, 1978), Techniques of Neutralization (Sykes and Matza, 1957), Multidimensional Ethics Theory (Yang, 2012b) and the Theory of Planned Behavior (Ajzen, 1985) have been successfully applied in understanding academic dishonesty, but little research has focused on predicting fabrication, falsification and questionable research practices in university students. Of these theories, the Theory of Planned Behavior has consistently had good explanatory power, explaining 33–48% of the variance in health, social, and economic behavior (Armitage and Conner, 2001) and may be usefully applied to predicting engagement in research misconduct and questionable research practices.
Theory of Planned Behavior
The Theory of Planned Behavior posits that intention drives behavior, with attitudes toward the behavior and subjective norms influencing behavior through intention, and perceived behavioral control impacting behavior both directly and mediated through intention (Ajzen, 1991). Attitudes represent positive or negative beliefs about behavior and its consequences. If a behavior is judged positively, attitude increases intention to engage in that behavior. Subjective norms represent perceived pressure from others to engage in behavior, and increase intention to engage in the behavior. Perceived behavioral control represents the perceived difficulty in performing the behavior, with greater difficulty reducing both intention to engage in behavior and actual behavior. Attitudes, subjective norms and perceived behavioral control form intention to perform a behavior, which if strong enough, will result in engagement (Ajzen, 1991). Ideally behavior is measured at a later point in time than intention, however, previous research has indicated that past behavior can be used as a proxy for future behavior (Rise et al., 2010).
Whilst not previously used to predict engagement in research misconduct and questionable research practices, the Theory of Planned Behavior has been used to predict cheating by undergraduate students. An early study by Beck and Ajzen (1991) used the Theory of Planned Behavior to predict a range of dishonest actions, including cheating on a test or exam. The Theory of Planned Behavior explained 67% of the variance in cheating intention and 55% of the variance in cheating behavior. However, subjective norms was not a significant predictor of intention and perceived behavioral control was not a significant predictor of behavior. Stone et al. (2009, 2010) examined cheating by undergraduate business students. The Theory of Planned Behavior explained 21% and 36% of the variance in cheating intention and cheating behavior respectively (Stone et al., 2010). Alleyne and Phillips (2011) examined undergraduate students’ intention to cheat and lie, reporting that Theory of Planned Behavior variables accounted for 48% of intention to cheat and 29% of intention to lie (actual behavior was not measured). Harding et al. (2007) found general support for the Theory of Planned Behavior model in predicting undergraduate cheating, but perceived behavioral control was not a significant predictor of behavior. In a further study, Mayhew et al. (2009) reported that neither attitudes nor perceived behavioral control were significant predictors of intention or behavior when moral obligation was added to the Theory of Planned Behavior model.
Extending the Theory of Planned Behavior Model
A major strength of the Theory of Planned Behavior is that variables can be added to the model to increase its explanatory power (Ajzen, 1985). Two variables of interest in predicting engagement in research misconduct and questionable research practices are descriptive norms and justifications.
Descriptive norms relate to what others actually do (Rivis and Sheeran, 2003). As such, they represent the individual’s perception of behavior by others, in contrast to the traditional injunctive conceptualization of subjective norms where the focus is on the individual’s perception of perceived pressure from others to engage in a particular behavior (Ajzen, 1991). The distinction has been described in terms of ‘what is’ (descriptive norms) versus ‘what ought’ (subjective norms; also known as injunctive norms, Cialdini et al., 1990) to be done (Forward, 2009). Behavior is influenced by whether injunctive or descriptive norms are salient within a particular setting (Cialdini et al., 1990; Kallgren et al., 2000). Behavior by in-group members invokes descriptive norms, while behavior by out-group members invokes injunctive norms (Gino et al., 2009). Behavior is also influenced by the extent to which actions violate the salient norm and the personal norms of the individual (Kallgren et al., 2000). While injunctive norms may influence behavior across settings, descriptive norms influence behavior only in settings where they are salient (Reno et al., 1993). In more recent reconceptualizations of the structure of the Theory of Planned Behavior predictor variables, Fishbein and colleagues (Fishbein, 2000; Fishbein and Yzer, 2003; Ajzen and Fishbein, 2005) have noted the need to include both injunctive and descriptive norms “in order to obtain a complete measure of subjective norm” (Ajzen and Fishbein, 2005, p. 199). However, this practice does not appear to have been routinely adopted, with some research indicating injunctive and subjective norms are conceptually distinct and differentially predict intention and behavior (Forward, 2009; Manning, 2009).
Meta-analytic findings provide further support for the addition of descriptive norms to the Theory of Planned Behavior model. Descriptive norms and intention are medium-to-strongly correlated (r = 0.44) and account for an additional 5% of the variance in intention across a range of behaviors, after controlling for attitudes, subjective norms and perceived behavioral control (Rivis and Sheeran, 2003). However, descriptive norms were not predictive of intention for all behaviors, with moderator analyses indicating descriptive norms are of most importance in predicting intention to engage in risk behaviors and with younger samples (Rivis and Sheeran, 2003). Research predicting student engagement in research misconduct and questionable research practices meets both these criteria. A further meta-analysis by Manning (2009) indicated that the relationship between descriptive norms and behavior is stronger than the relationship between subjective norms and behavior, and that in modeling the Theory of Planned Behavior there is a direct path from descriptive norms to behavior, but only a mediated path from subjective norms to behavior. Descriptive norms have previously been demonstrated to be significantly correlated with both intention to engage in academic misconduct (r = 0.37) and actual academic misconduct (r = 0.49; Stone et al., 20101), further justifying their addition to the Theory of Planned Behavior model.
As behaviors such as engaging in academic and research misconduct are not based on honest errors of judgment, individuals need to justify their engagement in the behavior (Stone et al., 2009). The mismatch between beliefs and behavior creates cognitive dissonance (Festinger, 1957), a psychological state that creates discomfort to the individual and motivates change to reduce the dissonance. More specifically, the term ‘ethical dissonance’ is used to describe cognitive dissonance resulting from behaviors deviating from accepted social norms (Barkan et al., 2012; Shalvi et al., 2015). Dissonance can be resolved through changing beliefs, changing behavior, adding new attitudes consistent with the behavior, or devaluing the importance of the dissonance (Festinger, 1957). Justifications may act to reduce dissonance through devaluating the importance of the dissonance (Stone et al., 2009). Self-serving justifications may reduce ethical dissonance through redefining and excusing questionable behaviors prior to engagement, or through compensatory mechanisms following engagement. Whether pre- or post-behavior, justifications attenuate the threat to the moral self (Shalvi et al., 2015).
Possible justifications for engaging in academic misconduct and questionable research practices include perceptions of others engaging in academic misconduct, helping a friend, peer pressure, extenuating circumstances and fear of failure (Stone et al., 2009). Stone et al. (2009) argue that justifications are used by those who have already engaged in academic misconduct, and play a potentially mediating role between the Theory of Planned Behavior predictor variables of attitudes, subjective norms and perceived behavioral control and the outcome variable of academic misconduct. In their study examining students’ cheating behavior, Stone et al. (2009) reported that attitudes, subjective norms and perceived behavioral control accounted for 28% of the variance in justifications, which in turn was a significant predictor of cheating behavior. Justifications were strongly correlated with both intention (r = 0.60) and behavior (r = 0.54). As academic and research misconduct are related constructs, this study provides strong support for the augmentation of the Theory of Planned Behavior model with justifications in predicting student engagement in research misconduct and questionable research practices.
Demographic factors may also be important in understanding student engagement in research misconduct and questionable research practices. Factors that have been explored in relation to this type of dishonest behavior are age, gender, and year of study. Negative correlations between age and academic misconduct have been reported (Brimble and Stevenson-Clarke, 2005), but inconsistent results found in relation to gender (Davidson et al., 2001; Yang, 2012a). A higher prevalence of research misconduct has been observed in lower year students (Yang, 2012b). Additionally, social desirability is an important construct to measure in self-report studies exploring research misconduct (Jann et al., 2012) as research misconduct is widely considered to be an unethical practice (Arvidson, 2004) and may elicit socially desirable responses.
In summary, there is limited research examining the predictors of student engagement in research misconduct and questionable research practices. The Theory of Planned Behavior is one model that may have utility in understanding these behaviors. Previous research that has examined the Theory of Planned Behavior in relation to academic integrity has mainly focused on cheating, but has demonstrated good explanatory power in some studies (Stone et al., 2009; Alleyne and Phillips, 2011). Drawing together previous disparate research on predictors of dishonest behavior into an integrated model applied to academic integrity, this study will examine the predictive utility of the Theory of Planned Behavior model augmented by descriptive norms and justifications (see Figure 1) in describing student engagement in research misconduct and questionable research practices. It is hypothesized that after controlling for demographic variables (age, gender, years of study) and social desirability, intention and justification will mediate the relationships between attitudes, subjective norms and descriptive norms with behavior (engaging in research misconduct and questionable research practices), and partially mediate the relationship between perceived behavioral control with behavior.
Materials and Methods
This study used a self-report, correlational design to examine whether intention and justification (mediator variables) mediate the relationship between attitudes, subjective norms, descriptive norms, and perceived behavioral control (predictor variables) and student engagement in research misconduct and questionable research practices (criterion variable) while controlling for age, gender, years of study, and social desirability.
A non-probability, convenience sample of Western Australian university students aged 18 years and older who had collected data or conducted research for an assignment or dissertation were recruited. The final sample consisted of 205 participants from five Western Australian universities (47 male, 158 female), aged between 18 and 53 years (M = 22, SD = 4.78). The majority of students sampled had a major or minor in Psychology (71.7%) and were from one university (84.8%). Years of completed study in university ranged from half a year to 9 years (M = 2.54, SD = 1.46). An a-priori power analysis (power 0.80, alpha 0.05) indicated that based on partial correlations of previous analyses (Stone et al., 2009), a sample size of 200 participants would be required to detect a ‘moderate’ mediation effect (Soper, 2013). The sample obtained exceeded this estimate and was deemed sufficient for testing mediation (Tabachnick and Fidell, 2007).
An online questionnaire consisting of eight scales was developed using Qualtrics software. Table 1 provides a summary of the measures, number of items, example items, response formats and Cronbach’s alpha for each measure. At the beginning of the survey, and at the top of most pages of the survey, the following definition of research misconduct was provided:
Research Misconduct includes:
Fabrication – making up data or results and reporting them
Falsification – manipulating research materials or processes, or changing or omitting data
Questionable research practices – failing to obtain approval, not obtaining consent before conducting research, ignoring outliers, publishing post hoc analyses without reporting it, or publishing articles using data that has not been collected legitimately or that has been reported elsewhere.
Ethics approval was received from Curtin University Human Research Ethics Committee. Participants were recruited on campus, from a psychology student participant pool and online through social networking sites. The recruiting materials directed potential participants to a Participant Information Sheet hosted on a university website and then linked to the online questionnaire. Consent was assumed upon submitting the questionnaire. Students recruited through the student participant pool were awarded points for participations and other students were provided with the opportunity to enter a draw to win a $50 Amazon.com gift voucher.
Data for 248 cases was downloaded from curtin.qualtrics.com into SPSS (version 21) for data preparation, and cleaning. Duplicate cases and cases with patterned responses or substantial missing data were removed, leaving 205 cases for analysis. A Missing Values Analysis indicated 0.38% missing data across the questionnaire. Little’s MCAR test indicated the data was not missing completely at random: χ2 (1053, N = 205) = 1173.68, p = 0.006. Expectation Maximization was used to replace missing values. Items were checked for outliers and unusual cases, and scale items were reverse coded where required. Descriptive norms item 3, “In the past year how many students do you think have engaged in research misconduct and have not been caught,” was excluded from further analyses due to wide variability in the types of responses yielded, including precise quantitative estimates (76.55%), vague qualitative estimates, such as “a few” (18.53%) and missing data (4.87%).
Confirmatory Factor Analysis was conducted in EQS 6.1to confirm the factor structure of scales in the augmented Theory of Planned Behavior model. Comparative fit indices, with recommended cut-offs from Kline (2011) were used to evaluate the fit of each scale. Based on poor fit statistics and identification of items with low loadings, the attitudes scale was reduced from six-items to five items and the behavior scale was reduced from nine-items to seven items. Goodness of fit statistics could not be computed for the Subjective norms and Descriptive norms scales, and for these measures Principal Axis Factoring supported one-factor solutions. A low Cronbach’s alpha of 0.16 and small positive correlations between items indicated the descriptive norms scale was unsuitable for use. Instead, the single item, “Approximately what percentage of students do you think engage in some kind of research misconduct?” was used to represent descriptive norms. Cronbach’s alpha was calculated for each of the measures (see Table 1). The 12-item original social desirability scale yielded a Cronbach’s alpha of 0.69. An examination of the questionnaire item-total statistics indicated an improved alpha of 0.71 if the item, “If you say you will do something, do you always keep your promise no matter how inconvenient it might be?” was deleted. This item was deleted, leaving an 11-item scale.
There was a low level of engagement in the more serious forms of research misconduct. Analysis at the item level (Table 2) indicates that approximately one in seven students reported engaging in fabrication and one in eight students in falsification. The proportion of students engaging in questionable research practices varied by type of practice. In total, 39.5% of students admitting to engaging in at least one form of research misconduct (including questionable research practices) at least once.
A summary of descriptive statistics for each measure is presented in Table 1. Descriptive norms, intention, justifications, social desirability, and behavior were positively skewed and subjective norms negatively skewed. Analyses were conducted with and without transformations of variables, however, as the results were approximately equivalent the results of the untransformed data are presented for ease of interpretation.
Age, gender, and years of study were not significantly associated with research misconduct behavior and were dropped as control variables. Only social desirability was significantly related to behavior and was retained as the sole control variable for further analyses.
Testing the Augmented Theory of Planned Behavior Model
Prior to commencing analysis, assumptions underlying mediation (Baron and Kenny, 1986) were tested in the correlation matrix (Table 3). The criterion variable (behavior), mediators (intention and justification) and predictors (attitude, subjective norms, descriptive norms, perceived behavioral control) were significantly correlated, meeting the requirements for mediation testing. A partial correlation matrix was computed, to control for the effects of social desirability. Path analysis was conducted using LISREL software to enable the simultaneous assessment of all pathways in the model. The testing was conducted in stages. Fit statistics for each stage of testing are presented in Table 4.
In the first stage, a partial mediation model was tested. The direct pathways between attitudes and behavior and subjective norms and behavior were non-significant, consistent with the fully mediated relationship in the posited model. However, in contrast to the posited model, the direct pathway between perceived behavioral control and behavior was non-significant, indicating perceived behavioral control is fully mediated by intention and justifications. Also in contrast to the posited model, there was a significant direct pathway between descriptive norms and behavior, indicating a partially, rather than fully mediated relationship.
In the second stage, the model was rerun with the non-significant pathways between attitudes and behavior and subjective norms and behavior removed. All remaining pathways were significant. The predictor variables (attitudes, subjective norms, descriptive norms, and perceived behavioral control) accounted with 23.5% of the variance in intention and 25.6% of the variance in justifications. Intention, justifications and descriptive norms accounted for 38.7% of the variance in behavior. Modification indices indicated a pathway from justification to intent would improve model fit. This pathway is plausible as it is likely that viewing research misconduct behaviors as justifiable would precede the formation of intent to engage in those behaviors.
In the third stage, the pathway from justification to intent was added and the model rerun. With the pathway added, the four other predictors of intent (attitudes, subjective norms, descriptive norms and perceived behavioral control) were no longer significant, suggesting that a simplified model was required, with the relationship between the four predictors and intent fully mediated by justifications.
In the fourth stage, this revised model (Figure 2) with the relationships between predictor variables and justification mediated by intent, was tested. This model accounted for 25.6% of the variance in justifications, 50.7% of the variance in intent and 40.8% of the variance in behavior. The Chi Square test was non-significant and fit statistics indicated good model fit to the data. While some fit statistics are superior for the model in the third stage of testing, the final revised model is preferred as it presents a more parsimonious model with good fit statistics and no non-significant pathways.
FIGURE 2. Revised model of theory of planned behavior augmented by descriptive norms and justifications.
This research examined the Theory of Planned Behavior model, augmented by descriptive norms and justification, in predicting student engagement in research misconduct and questionable research practices. Model testing identified a parsimonious two step mediation model provided good fit to the data. The effect of predictor variables (attitudes, subjective norms, descriptive norms, and perceived behavioral control) on behavior was mediated by justifications, with justifications in turn mediated by intention. This revised augmented model accounted for a substantial 40.8% of the variance in student engagement in research misconduct and questionable research practices.
Examination of individual pathways indicates that attitudes, subjective norms, descriptive norms, and perceived behavioral control combined influence intent to engage in research misconduct and questionable research practices through informing the development of justifications (accounting for just over a quarter of the variance in justifications). Justifications accounted for more than half the variance in intent, highlighting the important role of justifications in intent to engage in research misconduct. This is consistent with previous research findings of the important role of justifications/rationalizations/neutralizations in shaping academic dishonesty (e.g., Haines et al., 1986; Labeff et al., 1990; Rettinger and Kramer, 2009; Meng et al., 2014).
As hypothesized, the effect of attitudes and subjective norms on behavior was fully mediated by justification and intention, although the effect of descriptive norms on behavior was only partially mediated. Contrary to the hypothesized partial mediation relationship, the effect of perceived behavioral control on behavior was fully mediated by justification and intention.
These results demonstrate the utility of the augmented Theory of Planned Behavior model in predicting student engagement in research misconduct and questionable research practices. The addition of justifications to the model helps explain the relationship between predictor variables and intent when predicting these dishonest behaviors. The results indicate that viewing research misconduct and questionable research practices positively, believing significant others to also view these positively, perceiving other students to be engaged in these dishonest behaviors and perceiving engaging in these behaviors as easy are associated with justifying engagement in research misconduct and questionable research practices, leading to greater intent and extent of involvement in research misconduct and questionable research practices. However, as this study is cross-sectional it is not possible to establish the causal direction of these findings. It is possible that, as proposed by Stone et al. (2009) in relation to academic misconduct, cognitive dissonance resulting from engagement in research misconduct and questionable research practices has resulted in individuals trivializing or amending their cognitions in order to reduce dissonance. The addition of descriptive norms increased the predictive ability of the Theory of Planned Behavior model, contributing directly to the prediction of student engagement in research misconduct and questionable research practices and indirectly through justifications. These findings are consistent with previous research findings indicating the importance of observing others’ dishonest behavior (Rettinger and Kramer, 2009) and support the utility of adding descriptive norms (Rivis and Sheeran, 2003; Forward, 2009; Stone et al., 2009, 2010; White et al., 2009) and justifications (Stone et al., 2009) to the Theory of Planned Behavior model.
Subjective and descriptive norms were differentially associated with intention, justifications and behavior. Subjective norms were more strongly associated with intention (r = -0.34) and justifications (r = -0.37) than behavior (r = -0.23), while descriptive norms were more strongly associated with behavior (r = 0.30) than intention (r = 0.25) or justifications (r = 0.24). While both types of norms were predictors of intention, only descriptive norms was predictive of behavior once other variables were controlled. These findings support Fishbein and colleagues’ recommendation to model both injunctive and descriptive norms within studies (Fishbein, 2000; Fishbein and Yzer, 2003; Ajzen and Fishbein, 2005), and are consistent with meta-analytic results indicating the relationship between descriptive norms and behavior is stronger than the relationship between subjective norms and behavior (Manning, 2009).
In this study ~40% of students admitting to engaging in at least one form of research misconduct at least once, with one in seven reporting engaging in data fabrication and one in seven engaging in falsifying results. Falling within the lower range of previous estimates of the prevalence of student research misconduct (Franklyn-Stokes and Newstead, 1995; Lawson et al., 1999/2000; Davidson et al., 2001; Brimble and Stevenson-Clarke, 2005; McCabe, 2005), these results confirm that engagement in research misconduct is not restricted to the ‘hard sciences,’ but is also present to some degree in other disciplines such as psychology.
The consistently reported student engagement in research misconduct and questionable research practices across studies highlights the need to address this type of dishonest behavior in undergraduate and postgraduate programs. The revised augmented Theory of Planned Behavior model increases our understanding of the routes to student engagement in research misconduct and questionable research practices and can be used to identify potential strategies to address these behaviors in universities. Attitudes were a significant predictor of justifications for engaging in research misconduct and questionable research practices. Explicit teaching in research methods courses about resultant harms from these behaviors may help foster a climate where research misconduct is viewed as unacceptable. For example, Boskovic et al. (2013) trialed discussion groups on research misconduct with Ph.D. students. The role of research mentors (Wocial, 1995; Wright et al., 2008; Kornfield, 2012) and supervisors (Mitchell and Carroll, 2008) in educating students about research integrity has also been stressed. However, it has been noted that mentors can exert both positive and negative influence in relation to research misconduct and questionable research practices (Anderson et al., 2007). Fostering a climate that values research integrity may also change subjective and descriptive norms over time.
A further avenue for reducing student engagement in research misconduct and questionable research practices is to directly address the justifications used to reduce ethical dissonance prior to engaging in these behaviors. Removing justifications for dishonest behavior reduces the likelihood of engaging in the behavior (Shalvi et al., 2012). Justifications may be addressed through increasing ethical salience and reducing ambiguity (Shalvi et al., 2015). Ethical salience can be increased through reference to moral codes and standards (Mazar et al., 2008). Further, previous research has indicated that signing a statement of honesty before self-reporting increases ethical salience and reduces dishonest reporting, in comparison to signing after self-reporting. Applying these findings to student research, students could be asked to sign a statement agreeing to engage in ethical research practices as outlined in relevant research ethics codes and guidelines prior to collecting or analyzing data. While completion and signing of ethics applications may serve this function for dissertation students, many lower level student research exercises do not have a requirement to complete and submit an ethics application. As part of the process of removing justifications, any ambiguity surrounding the acceptance of research misconduct and questionable research practices needs to be addressed. In particular, clarity is required on the body of behaviors referred to as ‘questionable research practices,’ with even the term itself suggesting ambiguity in whether or not these research practices are ethically acceptable. Teaching staff and research supervisors need to provide clear guidance to students on what is, and is not, acceptable research practice, providing applied disciplinary examples.
Perceived behavioral control was also a significant predictor of justifications, indicating that measures could be put in place to make it more difficult to engage in research misconduct and questionable research practices, or at least increase the perception that this type of dishonest behavior is likely to be identified. Procedures have already been developed to detect fabrication of data (Blasius and Thiessen, 2012), and these procedures have now been applied to detecting fabrication in honors dissertations (Allen et al., 2015). In the same way that students are currently required to submit work for plagiarism detection, it is possible in the future that students could be required to submit data-sets for fabrication detection.
Limitations and Future Research
There are a number of limitations of this research that mean caution is required in the interpretation of these results. First, the descriptive norms measure had poor internal reliability, and an individual item providing ratio data was used in its place. This item was predictive of both justifications and behavior, indicating its importance and warranting further development of a descriptive norms measure for use in future research. Second, some variables exhibited non-normality and heteroscedasticity, violating assumptions underlying the analyses. However, analyses using transformed and untransformed data produced similar results, providing confidence in our findings. Third, self-report measures of past research misconduct and questionable research practices were used as a proxy for future behavior. While this is a common practice in Theory of Planned Behavior research (Armitage and Conner, 2001), future research separating the time of measurement of intention and behavior is recommended. This is particularly important when justifications are included in the model, as it has been argued that justifications may be made based on previous engagement in misconduct (Stone et al., 2009). Fourth, the reliance on self-report methods for all variables introduces the risk of common method variance/bias. However, recent post hoc research examining the effect of common method variance on Theory of Planned Behavior studies has indicated that common method variance is not a concern within this domain (Schaller et al., 2015). The reliance on self-report measures is also likely to have resulted in under-reporting of behavior (see John et al., 2012 for comparison of prevalence rates of questionable research practices with and without incentives for honesty in responding). Despite this, self-reports of engaging in research misconduct and questionable research practices provide a useful indicator of these behaviors. Previous research has demonstrated associations between self-reports of dishonest behavior and actual engagement in dishonest behaviors (Halevy et al., 2014), increasing our confidence in their use as proxies for actual behaviors. Finally, the majority of students in this study were psychology students from one university, limiting the generalizability of these findings to other academic settings. We recommend future research is based on larger samples across disciplines and universities, enabling a stronger test of the hypotheses. The actual and perceived seriousness and consequences of research misconduct and questionable research practices may vary according to student level and type of research project (e.g., assignment versus dissertation) and larger samples will enable an assessment of both the prevalence of these behaviors and the validity of the model by year group.
In this research the Theory of Planned Behavior model, augmented by descriptive norms and justification, was used to predict student engagement in research misconduct and questionable research practices. The results support a two-step mediation model, where the effect of attitudes, subjective norms, descriptive norms and perceived behavioral control on behavior is mediated first by justifications, and then intention. The model has good utility, able to account for 40% of the variance of student engagement in research misconduct and questionable research practices.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- ^Stone et al. (2010) labeled their normative measure ‘Subjective norm,’ but the items all reflect descriptive norms.
Alleyne, P., and Phillips, K. (2011). Exploring academic dishonesty among university students in Barbados: an extension to the theory of planned behaviour. J. Acad. Ethics 9, 323–338. doi: 10.1007/s10805-011-9144-1
Anderson, M. S., Horn, A. S., Risbey, K. R., Ronning, E. A., De Vries, R., and Martinson, B. C. (2007). What do mentoring and training in the responsible conduct of research have to do with scientists’ misbehavior? Findings from a national survey of NIH-funded scientists. Acad. Med. 82, 853–860. doi: 10.1097/ACM.0b013e31812f764c
Anderson, M. S., Shaw, M. A., Steneck, N. H., Konkle, E., and Kamata, T. (2013). “Research integrity and misconduct in the academic profession,” in Higher Education: Handbook of Theory and Research, Vol. 28, ed. M. Paulsen (Berlin: Springer), 217–261. doi: 10.1007/978-94-007-5836-0_5
Arvidson, C. J. (2004). The Anatomy of Academic Sishonesty: Cognitive Sevelopment, Self-Concept, Neutralization Techniques, and Attitude Toward Cheating. (Doctoral Dissertation). Available at: http://www.researchgate.net/publication/34492252
Baron, R. M., and Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J. Pers. Soc. Psychol. 51, 1173–1182. doi: 10.1037/0022-35220.127.116.113
Bedian, A. G., Taylor, S. G., and Miller, A. N. (2010). Management science on the credibility bubble: cardinal sins and various misdemeanors. Acad. Manage. Educ. 9, 715–725. doi: 10.5465/AMLE.2010.56659889
Benet-Martínez, V., and Karakitapoglu-Aygün, Z. (2003). The interplay of cultural syndromes and personality in predicting life satisfaction: comparing Asian Americans and European Americans. J. Cross Cult. Psychol. 34, 38–61. doi: 10.1177/0022022102239154
Boskovic, M., Djokovic, J., Grubor, I., Guzvic, V., Jakovljevic, B., Juresivic, M., et al. (2013). PhD students’ awareness of research misconduct. J. Empir. Res. Hum. Res. Ethics 8, 163–164. doi: 10.1525/jer.2013.8.2.163
Brimble, M., and Stevenson-Clarke, P. (2005). Perceptions of the prevalence and seriousness of academic dishonesty in Australian universities. Aust. Educ. Res. 32, 19–44. doi: 10.3200/JRLP.138.2.101-114
Cialdini, R. B., Reno, R. R., and Kallgren, C. A. (1990). A focus theory of normative conduct: recycling the concept of norms to reduce littering in public places. J. Pers. Soc. Psychol. 58, 1015–1026. doi: 10.1037/0022-3518.104.22.1685
Davidson, E. W., Cate, H. E., Lewis, C. M., and Hunter, M. (2001). “Data manipulation in the undergraduate laboratory: what are we teaching?” in Proceedings of the First ORI Research Conference of Research Integrity, Bethesda, MD: Office of Research Integrity, 209–213.
Fang, F. C., Steen, R. G., and Casadevell, A. (2012). Misconduct accounts for the majority of retracted scientific publications. Proc. Natl. Acad. Sci. U.S.A. 109, 17028–17033. doi: 10.1073/pnas.1212247109
Forward, S. E. (2009). The theory of planned behaviour: the role of descriptive norms and past behaviour in the prediction of drivers’ intention to violate. Transp. Res. Part F Traffic Psychol. Behav. 12, 198–207. doi: 10.1016/j.trf.2008.12.002
Francis, L. J., Brown, L. B., and Philipchalk, R. (1992). The development of an abbreviated form of the revised Eysenck personality questionnaire (EPQR-A): it’s use among students in England, Canada, the U.S.A. and Australia. Pers. Individ. Dif. 13, 443–449. doi: 10.1016/0191-8869(92)90073-X
Gino, F., Ayal, S., and Ariely, D. (2009). Contagion and differentiation in unethical behavior the effect of one bad apple on the barrel. Psychol. Sci. 20, 393–398. doi: 10.1111/j.1467-9280.2009.02306.x
Haines, V. J., Diekhoff, G. M., LaBeff, E. E., and Clark, R. E. (1986). College cheating: immaturity, lack of commitment, and the neutralizing attitude. Res. High. Educ. 25, 342–354. doi: 10.1007/BF00992130
Harding, T. S., Mayhew, M. J., Finelli, C. J., and Carpenter, D. D. (2007). The theory of planned behaviour as a model of academic dishonesty in engineering and humanities undergraduates. Ethics. Behav. 17, 255–279. doi: 10.1080/10508420701519239
John, L. K., Loewenstein, G., and Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychol. Sci. 23, 524–532. doi: 10.1177/0956797611430953
Kallgren, C. A., Reno, R. R., and Cialdini, R. B. (2000). A focus theory of normative conduct: when norms do and do not affect behavior. Pers. Soc. Psychol. B. 26, 1002–1012. doi: 10.1177/01461672002610009
Marsden, H., Carroll, M., and Neill, J. T. (2005). Who cheats at university? A self-report study of dishonest academic behaviours in a sample of Australian university students. Aust. J. Psychol. 57, 1–10. doi: 10.1080/00049530412331283426
Marsh, H. W., Hau, K.-T. and Wen, Z. (2004). In search of golden rules: comments on hypothesis-testing approaches to setting cuitoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Struct. Eq. Modeling 11, 320–341. doi:10.1207/s15328007sem1103_2
Mavrinac, M., Brumini, G., Bilic-Zulle, L., and Petrovecki, M. (2010). Construction and validation of attitudes toward plagiarism questionnaire. Croat. Med.J. 51, 195–201. doi: 10.3325/cmj.2010.51.195
Mayhew, M. J., Hubbard, S. M., Finelli, C. J., Harding, T. S., and Carpenter, D. D. (2009). Using structural equation modeling to validate the theory of planned behavior as a model for predicting student cheating. Rev. High. Educ. 32, 441–468. doi: 10.1353/rhe.0.0080
National Health and Medical Research Council and Australian Research Council. (2007). Australian Code for the Responsible Conduct of Research. Information Report, Commonwealth of Australia, Canberra, ACT. doi: 10.1016/j.nedt.2007.04.003
Nonis, S., and Swift, C. (2001). An examination of the relationship between academic dishonesty and workplace dishonesty: a multi-campus investigation. J. Educ. Bus. 77, 69–77. doi: 10.1080/08832320109599052
Ogilvie, J., and Stewart, A. (2010). The integration of rational choice and self-efficacy theories: a situational analysis of student misconduct. Aust. N. Z. J. Criminol. 43, 130–155. doi: 10.1375/acri.43.1.130
Rise, J., Sheeran, P., and Hukkelberg, S. (2010). The role of self-identity in the theory of planned behavior: a meta-analysis. J. Appl. Soc. Psychol. 40, 1085–1105. doi: 10.1111/j.1559-1816.2010.00611.x
Rose, L. L. (2008). Scientific Misconduct: Perceptions, Beliefs, Working Environments, and Reporting Practices in the Clinical Research Associate Population. (Doctoral Dissertation). Available at: http://books.google.com.au/
Schaller, T. K., Patil, A., and Malhotra, N. K. (2015). Alternative techniques for assessing common method variance an analysis of the theory of planned behavior research. Organ. Res. Methods 18, 177–206. doi: 10.1177/1094428114554398
Soper, D. S. (2013). A-priori Sample Size Calculator for Hierarchical Multiple Regression. Available at: http://www.danielsoper.com/statcalc3/calc.aspx?id=16
Stone, T. H., Jawahar, I. M., and Kisamore, J. L. (2009). Using the theory of planned behavior and cheating justifications to predict academic misconduct. Career Dev. Int. 14, 221–241. doi: 10.11.08/13620430910966415
Stone, T. H., Kisamore, J. L., and Jawahar, I. M. (2010). Predicting academic misconduct intentions and behavior using the theory of planned behavior and personality. Basic Appl. Soc. Psych. 32, 35–45. doi: 10.1080/01973530903539895
US Department of Health and Human Services Office of Research Integrity. (2000). Federal Research Misconduct Policy (Information Report 2000). Washington, DC: Office of Science and Technology Policy. doi: 10.2307/2089195
White, K. M., Smith, J. R., Terry, D. J., Greenslade, J. H., and McKimmie, B. M. (2009). Social influence in the theory of planned behaviour: the role of descriptive, injunctive and in-group norms. Brit. J. Soc. Psychol. 48, 135–158.
Wright, D. E., Titus, S. L., and Cornelison, J. B. (2008). Mentoring and research misconuct: an analysis of research mentoring in closed ORI cases. Sci. Eng. Ethics 14, 323–336. doi: 10.1007/s11948-008-9074-5
Keywords: research misconduct, data fabrication, data falsification, academic integrity, Theory of Planned Behavior, descriptive norms, justifications, questionable research practices
Citation: Rajah-Kanagasabai CJ and Roberts LD (2015) Predicting self-reported research misconduct and questionable research practices in university students using an augmented Theory of Planned Behavior. Front. Psychol. 6:535. doi: 10.3389/fpsyg.2015.00535
Received: 04 November 2014; Accepted: 14 April 2015;
Published online: 30 April 2015.
Edited by:Guy Hochman, Duke University, USA
Copyright © 2015 Rajah-Kanagasabai and Roberts. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Lynne D. Roberts, School of Psychology and Speech Pathology, Curtin University, GPO Box U1987, Perth, WA 6845, Australia, firstname.lastname@example.org