<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="discussion">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2018.02709</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Opinion</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A Call for the Inclusion of Mixed Methods Research in the Undergraduate Psychology Curriculum</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Roberts</surname> <given-names>Lynne D.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/180184/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Allen</surname> <given-names>Peter J.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/193760/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Psychology, Curtin University</institution>, <addr-line>Perth, WA</addr-line>, <country>Australia</country></aff>
<aff id="aff2"><sup>2</sup><institution>School of Psychological Science, University of Bristol</institution>, <addr-line>Bristol</addr-line>, <country>United Kingdom</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: M. Teresa Anguera, University of Barcelona, Spain</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Conrad Izquierdo, Autonomous University of Barcelona, Spain; Angel Blanco-Villase&#x000F1;or, University of Barcelona, Spain; Lisa Zimmerman, University of South Africa, South Africa</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Lynne D. Roberts <email>lynne.roberts&#x00040;curtin.edu.au</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Quantitative Psychology and Measurement, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>08</day>
<month>01</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>9</volume>
<elocation-id>2709</elocation-id>
<history>
<date date-type="received">
<day>01</day>
<month>10</month>
<year>2018</year>
</date>
<date date-type="accepted">
<day>17</day>
<month>12</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2019 Roberts and Allen.</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>Roberts and Allen</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions> 
<kwd-group>
<kwd>mixed methods research</kwd>
<kwd>undergraduate psychology</kwd>
<kwd>research methods</kwd>
<kwd>pedagogy</kwd>
<kwd>undergraduate students</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="35"/>
<page-count count="4"/>
<word-count count="3057"/>
</counts>
</article-meta>
</front>
<body>
<p>For mixed methods research in psychology to expand, a body of psychologists, and psychology academics who have the knowledge and expertise to conduct and review mixed methods research is required. Reviews of mixed methods articles in psychology (e.g., Bartholomew and Brown, <xref ref-type="bibr" rid="B5">2012</xref>; Bartholomew and Lockard, <xref ref-type="bibr" rid="B6">2018</xref>) have highlighted issues related to the lack of clarity of methods used in published mixed methods psychological research. These include the failures to identify the type of mixed method design, the mixed methods research question, the qualitative analysis methodology, and to explicitly state the process for integrating data. These findings highlight the lack of training for psychologists in both conducting and reviewing mixed methods research. Whilst the new American Psychological Association reporting standards for mixed methods research (Levitt et al., <xref ref-type="bibr" rid="B24">2018</xref>) are helpful for authors and reviewers with some mixed methods expertise, they must be complemented by at least foundational training in mixed methods research to ensure the quality and rigor of mixed methods research published in psychology journals.</p>
<p>In order to develop a body of psychologists and psychology academics who have the knowledge and expertise to conduct and review mixed methods studies, we need to teach current and future generations of psychology students about mixed methods research. At present, mixed methods research training, where offered at all, is typically provided at the doctoral level and across disciplines (Christ, <xref ref-type="bibr" rid="B9">2009</xref>; Baran, <xref ref-type="bibr" rid="B4">2010</xref>; Poth, <xref ref-type="bibr" rid="B32">2014</xref>). Whilst Onwuegbuzie et al. (<xref ref-type="bibr" rid="B30">2011</xref>) argued that we can expect mixed methods to be routinely taught in the majority of higher degree by research programs in the future, Poth (<xref ref-type="bibr" rid="B32">2014</xref>) viewed one-off mixed methods courses as inadequate preparation, calling instead for the teaching of mixed methods research to begin earlier, positioned alongside the teaching of qualitative and quantitative research. Similarly, while not specific to psychology, the Mixed Methods Task Force report on the future of mixed methods (Mertens et al., <xref ref-type="bibr" rid="B26">2016a</xref>) has recommended the inclusion of mixed methods approaches in the undergraduate curriculum, describing this as &#x0201C;the natural starting point&#x0201D; (p. 19).</p>
<p>We echo the sentiment of the Task Force by calling for the inclusion of mixed methods research in the undergraduate psychology curriculum, beginning with teaching an appreciation of mixed methods research. The last decade has seen an increase in the number of psychology undergraduate programs in the United Kingdom, United States of America and Canada<xref ref-type="fn" rid="fn0001"><sup>1</sup></xref> teaching both quantitative and qualitative research methods (Gibson and Sullivan, <xref ref-type="bibr" rid="B17">2018</xref>; McMullen and Winston-Proctor, <xref ref-type="bibr" rid="B25">2018</xref>). Although these methods are often poorly integrated, and many educators tend to focus excessively on differences between qualitative and quantitative paradigms (Fielden et al., <xref ref-type="bibr" rid="B14">2012</xref>), this teaching does provide a foundation for the introduction of mixed methods research. As exposure to quantitative and qualitative research increases, psychology students&#x00027; perceptions of the incompatibility of qualitative and quantitative research methods decrease (Roberts and Povee, <xref ref-type="bibr" rid="B35">2014</xref>). While the teaching of both quantitative and qualitative research methods equips students for multimethods research (the use of multiple methodologies to address different goals within a research project), mixed methods research varies from multimethods research in the focus on integration, as both qualitative and quantitative components are addressing the same objective (Anguera et al., <xref ref-type="bibr" rid="B2">2018</xref>). Integration can occur during design, methods, interpretation or reporting (Fetters et al., <xref ref-type="bibr" rid="B13">2013</xref>) and can result in additional insights and understanding. When moving from teaching qualitative and quantitative research methods separately to teaching mixed methods research, it is this mixing and integration that needs to be taught. Previous research has demonstrated that undergraduate psychology students are receptive to mixed methods, despite some misconceptions about mixed methods research and skepticism about the motivation and practices of mixed methods researchers (Povee and Roberts, <xref ref-type="bibr" rid="B33">2015</xref>) that may stem from their unfamiliarity with this type of research.</p>
<p>Burgeoning literature on mixed methods research pedagogy at the postgraduate level (e.g., Earley, <xref ref-type="bibr" rid="B12">2007</xref>; Christ, <xref ref-type="bibr" rid="B9">2009</xref>; Baran, <xref ref-type="bibr" rid="B4">2010</xref>; Onwuegbuzie et al., <xref ref-type="bibr" rid="B30">2011</xref>; Frels et al., <xref ref-type="bibr" rid="B15">2012</xref>, <xref ref-type="bibr" rid="B16">2014</xref>; Poth, <xref ref-type="bibr" rid="B32">2014</xref>) can be used to inform the development of mixed methods research courses at the undergraduate level. Frels et al. (<xref ref-type="bibr" rid="B16">2014</xref>) reported that leading mixed methodologists emphasized application and integration as learning goals when teaching mixed methods research. However, there is no &#x0201C;one size fits all&#x0201D; in terms of how mixed methods training can be delivered. Research conducted with experienced mixed methods teachers (Onwuegbuzie et al., <xref ref-type="bibr" rid="B30">2011</xref>) indicates that courses vary in their orientation (importance placed on coverage of quantitative and qualitative methodologies before covering mixed methods), application (from conceptual to applied), and structure (from highly structured to exploratory/experiential), highlighting the possible range of teacher positions for mixed methods courses. This diversity of teaching approaches reflects the diversity of mixed methods research designs. Regardless of the teaching approach selected, Mertens et al. (<xref ref-type="bibr" rid="B26">2016a</xref>) highlight the role of educators to support students in aligning mixed methods research choices with philosophical assumptions.</p>
<p>A limited number of example models (e.g., Onwuegbuzie et al., <xref ref-type="bibr" rid="B29">2013</xref>; Ivankova and Plano Clark, <xref ref-type="bibr" rid="B22">2018</xref>) and syllabi (e.g., Earley, <xref ref-type="bibr" rid="B12">2007</xref>; Christ, <xref ref-type="bibr" rid="B9">2009</xref>) for mixed methods research courses are available. We encourage academics who teach mixed methods to undergraduates to share their syllabi, resources and experiences. We note that there are currently no materials that relate to teaching mixed methods research in the &#x0201C;statistics and research methods&#x0201D; teaching resources and &#x0201C;research methods&#x0201D; project syllabi sections of the <italic>Society for the Teaching of Psychology</italic> website (<ext-link ext-link-type="uri" xlink:href="http://teachpsych.org/">http://teachpsych.org/</ext-link>)<xref ref-type="fn" rid="fn0002"><sup>2</sup></xref>. The recently published <italic>Oxford Handbook of Undergraduate Psychology Education</italic> (Dunn, <xref ref-type="bibr" rid="B11">2015</xref>) is similarly silent with regard to teaching mixed methods.</p>
<p>Whilst the availability of teaching resources, example syllabi and authoritative guides will no doubt encourage some instructors to introduce mixed methods into undergraduate research methods classes, the inclusion of mixed methods in our accreditation guidelines and textbooks will have a much larger and more immediate impact. In Australia, where the first author works, the Australian Psychology Accreditation Council (<xref ref-type="bibr" rid="B3">2018</xref>) require that research methods be taught to all undergraduate psychology students, but are not prescriptive about the range of methods students should be exposed to. In the United Kingdom (home of the second author), the British Psychological Society (<xref ref-type="bibr" rid="B7">2017a</xref>,<xref ref-type="bibr" rid="B8">b</xref>) specify that undergraduates should learn how to conduct quantitative and qualitative research, but make no mention of mixed methods research. The regulatory landscape in the United States is similar (American Psychological Association, <xref ref-type="bibr" rid="B1">2016</xref>). Furthermore, the current<xref ref-type="fn" rid="fn0003"><sup>3</sup></xref> bestselling psychology research methods textbook on Amazon.com (Morling, <xref ref-type="bibr" rid="B28">2018</xref>) does not include any coverage of qualitative, let alone mixed methods research. Coolican (<xref ref-type="bibr" rid="B10">2014</xref>), the current best seller on Amazon.co.uk, does provide coverage of both, although mixed methods is relegated to a handful of brief mentions in chapters on measurement and qualitative methods.</p>
<p>The positioning of mixed methods teaching within the undergraduate psychology curriculum needs careful consideration. Ideally, the way we teach research methods will change, integrating the teaching of qualitative and quantitative methods from the beginning, rather than teaching each separately and in opposition to each other (for an illustration of this approach, see Onwuegbuzie et al., <xref ref-type="bibr" rid="B31">2010</xref>). This will overcome two key challenges currently faced in teaching mixed methods: the preconceived bias and misperceptions of students about quantitative and qualitative methods and the diversity of competence in qualitative and quantitative research of students entering postgraduate mixed methods research courses (Frels et al., <xref ref-type="bibr" rid="B15">2012</xref>).</p>
<p>Where this restructuring of the research methods curriculum is not possible, there are a number of alternatives. First, it is possible to teach quantitative, qualitative and mixed methods courses sequentially throughout the undergraduate curriculum, such as is currently done at the first author&#x00027;s institution. A potential consequence of this sequential approach is that quantitative research is set up as the main research methodology for psychology, with qualitative research then seen as an alternative approach (Roberts and Castell, <xref ref-type="bibr" rid="B34">2016</xref>). Mertens et al. (<xref ref-type="bibr" rid="B26">2016a</xref>) note that where either quantitative or qualitative approaches are priveliged in teaching, a cultural shift will be required to support mixed methods approaches. The priveliging of quantaitive research methods over qualitative research methods in order of teaching potentially leads to a misperception that the qualitative component of mixed methods research is tokenistic (Povee and Roberts, <xref ref-type="bibr" rid="B33">2015</xref>).</p>
<p>Beyond this, decisions on how to incorporate the teaching of mixed methods research in the undergraduate psychology curriculum can be informed by the three components of a student-centered pedagogy for research methods identified by Kilburn et al. (<xref ref-type="bibr" rid="B23">2014</xref>): making the research process visible, engaging students in conducting research, and reflecting on the research process. Examples of activities that fit within this framework might include embedding mixed methods assignments and presenting and discussing relevant mixed methods research findings within subject courses. Greene (<xref ref-type="bibr" rid="B19">2010</xref>) asks students to select a mixed methods article and lead a class discussion on the quality of the study. The first author has individual and group assessments that require students to take the perspective of a journal article reviewer and critically review mixed methods articles. These tasks explicitly ask students to reflect on how well the qualitative and quantitative components of the research haved been integrated.</p>
<p>Regardless of the way in which mixed methods research is implemented within the undergraduate psychology curriculum, evaluation will be essential in order to determine &#x0201C;what works.&#x0201D; Guetterman et al. (<xref ref-type="bibr" rid="B20">2017</xref>) have developed a reliable and validated self-rated measure of mixed methods skills that can be used to track students&#x00027; self-ratings of skill development, and may be used by course coordinators to improve curricula in areas where students report they have limited skills.</p>
<p>We are not suggesting that introducing mixed methods to the undergraduate psychology curriculum will be an easy task. A key challenge facing mixed methods research educators is the time required to cover key quantitative and qualitative methods in addition to the mixing of methods (Onwuegbuzie et al., <xref ref-type="bibr" rid="B30">2011</xref>; Frels et al., <xref ref-type="bibr" rid="B15">2012</xref>). Students in graduate courses report finding mixed methods terminology and the concept of mixing paradigms challenging (Hesse-Biber, <xref ref-type="bibr" rid="B21">2015</xref>; Gilmartin and Esterhuizen, <xref ref-type="bibr" rid="B18">2017</xref>). This is not surprising given the &#x0201C;kaleidoscope&#x0201D; of mixed methods approaches and terminology (Mertens et al., <xref ref-type="bibr" rid="B27">2016b</xref>) and questions over the relevant content and skills to be taught (Mertens et al., <xref ref-type="bibr" rid="B27">2016b</xref>). Teachers of mixed methods courses often have not been formally taught mixed methods themselves, and may have strengths in only qualitative or quantitative research, indicating that a team-teaching approach may in some cases be required (Hesse-Biber, <xref ref-type="bibr" rid="B21">2015</xref>). Further, in our experience, not all students are interested in learning mixed methods research, with some undergraduate students already expressing a clear preference for either quantitative or qualitative research methodologies by their final undergraduate year. Despite these challenges, we envisage there will be benefits to the discipline and employers in future years in terms of producing psychology graduates who are able to select from the full range of research designs: quantitative, qualitative and mixed methods.</p>
<sec id="s1">
<title>Author Contributions</title>
<p>LR was responsible for leading the writing of the paper. PA contributed to the design, ideas and writing.</p>
<sec>
<title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><collab>American Psychological Association</collab></person-group> (<year>2016</year>). <article-title>Guidelines for the undergraduate psychology major: version 2.0</article-title>. <source>Am. Psychol.</source> <volume>71</volume>, <fpage>102</fpage>&#x02013;<lpage>111</lpage>. <pub-id pub-id-type="doi">10.1037/a0037562</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anguera</surname> <given-names>M. T.</given-names></name> <name><surname>Blanco-Villase&#x000F1;or</surname> <given-names>A.</given-names></name> <name><surname>Losada</surname> <given-names>J. L.</given-names></name> <name><surname>S&#x000E1;nchez-Algarra</surname> <given-names>P.</given-names></name> <name><surname>Onwuegbuzie</surname> <given-names>A. J.</given-names></name></person-group> (<year>2018</year>). <article-title>Revisiting the difference between mixed methods and multimethods: Is it all in the name?</article-title> <source>Qual. Quant</source>. <volume>52</volume>, <fpage>2757</fpage>&#x02013;<lpage>2770</lpage>. <pub-id pub-id-type="doi">10.1007/s11135-018-0700-2</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="book"><person-group person-group-type="author"><collab>Australian Psychology Accreditation Council</collab></person-group> (<year>2018</year>). <source>Accreditation Standards for Psychology Programs</source>. <publisher-loc>Melbourne, VIC</publisher-loc>: <publisher-name>Author</publisher-name>.</citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baran</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Teaching multi-methodology research courses to doctoral students</article-title>. <source>Int. J. Mult. Res. Appro.</source> <volume>4</volume>, <fpage>19</fpage>&#x02013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.5172/mra.2010.4.1.019</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bartholomew</surname> <given-names>T. T.</given-names></name> <name><surname>Brown</surname> <given-names>J. R.</given-names></name></person-group> (<year>2012</year>). <article-title>Mixed methods, culture, and psychology: a review of mixed methods in culture-specific psychological research</article-title>. <source>Int. Perspect. Psychol.</source> <volume>1</volume>, <fpage>177</fpage>&#x02013;<lpage>190</lpage>. <pub-id pub-id-type="doi">10.1037/a0029219</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bartholomew</surname> <given-names>T. T.</given-names></name> <name><surname>Lockard</surname> <given-names>A. J.</given-names></name></person-group> (<year>2018</year>). <article-title>Mixed methods in psychotherapy research: A review of method (ology) integration in psychotherapy science</article-title>. <source>J. Clin. Psychol</source>. <volume>74</volume>, <fpage>1687</fpage>-<lpage>1709</lpage>. <pub-id pub-id-type="doi">10.1002/jclp.22653</pub-id><pub-id pub-id-type="pmid">29900532</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="book"><person-group person-group-type="author"><collab>British Psychological Society</collab></person-group> (<year>2017a</year>). <source>Standards for the accreditation of undergraduate, conversion and integrated masters programmes in psychology</source>. <publisher-loc>Leicester, UK</publisher-loc>: <publisher-name>Author</publisher-name>.</citation></ref>
<ref id="B8">
<citation citation-type="book"><person-group person-group-type="author"><collab>British Psychological Society</collab></person-group> (<year>2017b</year>). <source>Supplementary Guidance for Research and Research Methods on Society Accredited Undergraduate and Conversion Programmes</source>. <publisher-loc>Leicester</publisher-loc>: <publisher-name>Author</publisher-name>.</citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Christ</surname> <given-names>T. W.</given-names></name></person-group> (<year>2009</year>). <article-title>Designing, teaching, and evaluating two complementary mixed methods research courses</article-title>. <source>J. Mix. Methods Res.</source> <volume>3</volume>, <fpage>292</fpage>&#x02013;<lpage>325</lpage>. <pub-id pub-id-type="doi">10.1177/1558689809341796</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Coolican</surname> <given-names>H.</given-names></name></person-group> (<year>2014</year>). <source>Research Methods and Statistics in Psychology</source>, <edition>6th ed</edition>. <publisher-loc>Hove</publisher-loc>: <publisher-name>Psychology Press</publisher-name>.</citation></ref>
<ref id="B11">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dunn</surname> <given-names>D. S.</given-names></name></person-group> (<year>2015</year>). (Ed.). <source>Oxford Handbook of Undergraduate Psychology Education.</source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. <pub-id pub-id-type="doi">10.1093/oxfordhb/9780199933815.001.0001</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Earley</surname> <given-names>M. A.</given-names></name></person-group> (<year>2007</year>). <article-title>Developing a syllabus for a mixed-methods research course</article-title>. <source>Int. J. Soc. Res. Methodol.</source> <volume>10</volume>, <fpage>145</fpage>&#x02013;<lpage>162</lpage>. <pub-id pub-id-type="doi">10.1080/13645570701334118</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fetters</surname> <given-names>M. D.</given-names></name> <name><surname>Curry</surname> <given-names>L. A.</given-names></name> <name><surname>Creswell</surname> <given-names>J. W.</given-names></name></person-group> (<year>2013</year>). <article-title>Achieving integration in mixed methods designs&#x02014;principles and practices</article-title>. <source>Health Serv. Res.</source> <volume>48</volume>(<issue>6 pt 2</issue>), <fpage>2134</fpage>&#x02013;<lpage>2156</lpage>. <pub-id pub-id-type="doi">10.1111/1475-6773.12117</pub-id><pub-id pub-id-type="pmid">24279835</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fielden</surname> <given-names>A. L.</given-names></name> <name><surname>Goldie</surname> <given-names>S.</given-names></name> <name><surname>Sillence</surname> <given-names>E.</given-names></name></person-group> (<year>2012</year>). <article-title>Taking another look: developing a sustainable and expandable programme of qualitative research methods in psychology</article-title>. <source>Psychol. Learn. Teach.</source> <volume>11</volume>, <fpage>46</fpage>&#x02013;<lpage>51</lpage>. <pub-id pub-id-type="doi">10.2304/plat.2012.11.1.46</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Frels</surname> <given-names>R. K.</given-names></name> <name><surname>Onwuegbuzie</surname> <given-names>A. J.</given-names></name> <name><surname>Leech</surname> <given-names>N. L.</given-names></name> <name><surname>Collins</surname> <given-names>K. M.</given-names></name></person-group> (<year>2012</year>). <article-title>Challenges to teaching mixed research courses</article-title>. <source>J. Effect. Teach.</source> <volume>12</volume>, <fpage>23</fpage>&#x02013;<lpage>44</lpage>.</citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Frels</surname> <given-names>R. K.</given-names></name> <name><surname>Onwuegbuzie</surname> <given-names>A. J.</given-names></name> <name><surname>Leech</surname> <given-names>N. L.</given-names></name> <name><surname>Collins</surname> <given-names>K. M.</given-names></name></person-group> (<year>2014</year>). <article-title>Pedagogical strategies used by selected leading mixed methodologists in mixed research courses</article-title>. <source>J. Effect. Teach.</source> <volume>14</volume>, <fpage>5</fpage>&#x02013;<lpage>34</lpage>.</citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gibson</surname> <given-names>S.</given-names></name> <name><surname>Sullivan</surname> <given-names>C.</given-names></name></person-group> (<year>2018</year>). <article-title>A changing culture? Qualitative methods teaching in U.K. psychology</article-title>. <source>Qual. Psychol.</source> <volume>5</volume>, <fpage>197</fpage>&#x02013;<lpage>206</lpage>. <pub-id pub-id-type="doi">10.1037/qup0000100</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gilmartin</surname> <given-names>J.</given-names></name> <name><surname>Esterhuizen</surname> <given-names>P.</given-names></name></person-group> (<year>2017</year>). <article-title>Shifting pedagogical priorities in facilitating mixed methods research including postgraduate student&#x00027;s reflections</article-title>. <source>GSTF J. Nurs. Health Care</source> <volume>5</volume>, <fpage>1</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.5176/2345-718X_5.1.154</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Greene</surname> <given-names>J. C.</given-names></name></person-group> (<year>2010</year>). <article-title>Foreword: beginning the conversation</article-title>. <source>Int. J. Mult. Res. Appro.</source> <volume>4</volume>, <fpage>2</fpage>&#x02013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.5172/mra.2010.4.1.002</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guetterman</surname> <given-names>T. C.</given-names></name> <name><surname>Creswell</surname> <given-names>J. W.</given-names></name> <name><surname>Wittink</surname> <given-names>M.</given-names></name> <name><surname>Barg</surname> <given-names>F. K.</given-names></name> <name><surname>Castro</surname> <given-names>F. G.</given-names></name> <name><surname>Dahlberg</surname> <given-names>B.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Development of a self-rated mixed methods skills assessment: The NIH mixed methods research training program for the health sciences</article-title>. <source>J. Continu. Educ. Health Profess.</source> <volume>37</volume>, <fpage>76</fpage>&#x02013;<lpage>82</lpage>. <pub-id pub-id-type="doi">10.1097/CEH.0000000000000152</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hesse-Biber</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <article-title>The problems and prospects in the teaching of mixed methods research</article-title>. <source>Int. J. Soc. Res. Methodol.</source> <volume>18</volume>, <fpage>463</fpage>&#x02013;<lpage>477</lpage>. <pub-id pub-id-type="doi">10.1080/13645579.2015.1062622</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ivankova</surname> <given-names>N. V.</given-names></name> <name><surname>Plano Clark</surname> <given-names>V. L.</given-names></name></person-group> (<year>2018</year>). <article-title>Teaching mixed methods research: using a socio-ecological framework as a pedagogical approach for addressing the complexity of the field</article-title>. <source>International J. Soc. Res. Methodol</source>. <volume>21</volume>, <fpage>409</fpage>&#x02013;<lpage>424</lpage>. <pub-id pub-id-type="doi">10.1080/13645579.2018.1427604</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kilburn</surname> <given-names>D.</given-names></name> <name><surname>Nind</surname> <given-names>M.</given-names></name> <name><surname>Wiles</surname> <given-names>R.</given-names></name></person-group> (<year>2014</year>). <article-title>Learning as researchers and teachers: The development of a pedagogical culture for social science research methods?</article-title> <source>Br. J. Educ. Stud.</source> <volume>62</volume>, <fpage>191</fpage>&#x02013;<lpage>207</lpage>. <pub-id pub-id-type="doi">10.1080/00071005.2014.918576</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Levitt</surname> <given-names>H. M.</given-names></name> <name><surname>Bamberg</surname> <given-names>M.</given-names></name> <name><surname>Creswell</surname> <given-names>J. W.</given-names></name> <name><surname>Frost</surname> <given-names>D. M.</given-names></name> <name><surname>Josselson</surname> <given-names>R.</given-names></name> <name><surname>Su&#x000E1;rez-Orozco</surname> <given-names>C.</given-names></name></person-group> (<year>2018</year>). <article-title>Journal article reporting standards for qualitative primary, qualitative meta-analytic, and mixed methods research in psychology: the APA Publications and Communications Board task force report</article-title>. <source>Am. Psychol.</source> <volume>73</volume>, <fpage>26</fpage>&#x02013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1037/amp0000151</pub-id><pub-id pub-id-type="pmid">29345485</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McMullen</surname> <given-names>L. M.</given-names></name> <name><surname>Winston-Proctor</surname> <given-names>C. E.</given-names></name></person-group> (<year>2018</year>). <article-title>Qualitative inquiry in undergraduate psychology curricula and research training: Contexts and practices for transforming the optional into the obligatory</article-title>. <source>Qual. Psychol.</source> <volume>5</volume>, <fpage>191</fpage>&#x02013;<lpage>196</lpage>. <pub-id pub-id-type="doi">10.1037/qup0000123</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Mertens</surname> <given-names>D. M.</given-names></name> <name><surname>Bazeley</surname> <given-names>P.</given-names></name> <name><surname>Bowleg</surname> <given-names>L.</given-names></name> <name><surname>Fielding</surname> <given-names>N.</given-names></name> <name><surname>Maxwell</surname> <given-names>J.</given-names></name> <name><surname>Molina-Azor&#x000ED;n</surname> <given-names>J. F.</given-names></name> <etal/></person-group>. (<year>2016a</year>). <source>The Future of Mixed Methods: A Five Year Projection to 2020</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://mmira.wildapricot.org/resources/Documents/MMIRA%20task%20force%20report%20Jan2016%20final.pdf">https://mmira.wildapricot.org/resources/Documents/MMIRA%20task%20force%20report%20Jan2016%20final.pdf</ext-link></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mertens</surname> <given-names>D. M.</given-names></name> <name><surname>Bazeley</surname> <given-names>P.</given-names></name> <name><surname>Bowleg</surname> <given-names>L.</given-names></name> <name><surname>Fielding</surname> <given-names>N.</given-names></name> <name><surname>Maxwell</surname> <given-names>J.</given-names></name> <name><surname>Molina-Azorin</surname> <given-names>J. F.</given-names></name> <etal/></person-group>. (<year>2016b</year>). <article-title>Expanding thinking through a kaleidoscopic look into the future: implications of the mixed methods international research association&#x00027;s task force report on the future of mixed methods</article-title>. <source>J. Mix. Methods Res.</source> <volume>10</volume>, <fpage>221</fpage>&#x02013;<lpage>227</lpage>. <pub-id pub-id-type="doi">10.1177/1558689816649719</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Morling</surname> <given-names>B.</given-names></name></person-group> (<year>2018</year>). <source>Research Methods in Psychology: Evaluating a World of Information</source>, <edition>3rd ed</edition>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>W.W. Norton</publisher-name>.</citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Onwuegbuzie</surname> <given-names>A. J.</given-names></name> <name><surname>Frels</surname> <given-names>R. K.</given-names></name> <name><surname>Collins</surname> <given-names>K. M.</given-names></name> <name><surname>Leech</surname> <given-names>N. L.</given-names></name></person-group> (<year>2013</year>). <article-title>Conclusion: a four-phase model for teaching and learning mixed research</article-title>. <source>Int. J. Mult. Res. Appro.</source> <volume>7</volume>, <fpage>133</fpage>&#x02013;<lpage>156</lpage>. <pub-id pub-id-type="doi">10.5172/mra.2013.7.1.133</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Onwuegbuzie</surname> <given-names>A. J.</given-names></name> <name><surname>Frels</surname> <given-names>R. K.</given-names></name> <name><surname>Leech</surname> <given-names>N. L.</given-names></name> <name><surname>Collins</surname> <given-names>K. M.</given-names></name></person-group> (<year>2011</year>). <article-title>A mixed research study of pedagogical approaches and student learning in doctoral-level mixed research courses</article-title>. <source>Int. J. Mult. Res. Appro.</source> <volume>5</volume>, <fpage>169</fpage>&#x02013;<lpage>199</lpage>. <pub-id pub-id-type="doi">10.5172/mra.2011.5.2.169</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Onwuegbuzie</surname> <given-names>A. J.</given-names></name> <name><surname>Leech</surname> <given-names>N. L.</given-names></name> <name><surname>Murtonen</surname> <given-names>M.</given-names></name> <name><surname>T&#x000E4;htinen</surname> <given-names>J.</given-names></name></person-group> (<year>2010</year>). <article-title>Utilizing mixed methods in teaching environments to reduce statistics anxiety</article-title>. <source>Int. J. Mult. Res. Appro.</source> <volume>4</volume>, <fpage>28</fpage>&#x02013;<lpage>39</lpage>. <pub-id pub-id-type="doi">10.5172/mra.2010.4.1.028</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Poth</surname> <given-names>C.</given-names></name></person-group> (<year>2014</year>). <article-title>What constitutes effective learning experiences in a mixed methods research course? An examination from the student perspective</article-title>. <source>Int. J. Mul. Res. Appro.</source> <volume>8</volume>, <fpage>74</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.5172/mra.2014.8.1.74</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Povee</surname> <given-names>K.</given-names></name> <name><surname>Roberts</surname> <given-names>L. D.</given-names></name></person-group> (<year>2015</year>). <article-title>Attitudes toward mixed methods research in psychology: the best of both worlds?</article-title> <source>Int. J. Soc. Res. Methodol.</source> <volume>18</volume>, <fpage>41</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1080/13645579.2013.872399</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roberts</surname> <given-names>L. D.</given-names></name> <name><surname>Castell</surname> <given-names>E.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x0201C;Having to shift everything we&#x00027;ve learned to the side&#x0201D;: expanding research methods taught in psychology to incorporate qualitative methods</article-title>. <source>Front. Psychol.</source> <volume>7</volume>:<fpage>688</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.00688</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roberts</surname> <given-names>L. D.</given-names></name> <name><surname>Povee</surname> <given-names>K.</given-names></name></person-group> (<year>2014</year>). <article-title>A brief measure of attitudes toward mixed methods research in psychology</article-title>. <source>Front. Psychol.</source> <volume>5</volume>:<fpage>1312</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2014.01312</pub-id><pub-id pub-id-type="pmid">25429281</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn0001"><p><sup>1</sup>The teaching of qualitative research methods in undergraduate psychology in other countries has not been documented in the academic literature. We acknowledge that there are likely to be large variations in the amount of qualitative research methods taught across countires, and this will impact on the feasibility of introducing mixed methods research.</p></fn>
<fn id="fn0002"><p><sup>2</sup>We note that the only graduate level research methods project syllabus listed also neglects mixed methods research.</p></fn>
<fn id="fn0003"><p><sup>3</sup>At 28 September 2018.</p></fn>
</fn-group>
</back>
</article>