Abstract
Educators in medical image interpretation have difficulty finding scientific evidence as to how they should design their instruction. We review and comment on 81 papers that investigated instructional design in medical image interpretation. We distinguish between studies that evaluated complete offline courses and curricula, studies that evaluated e-learning modules, and studies that evaluated specific educational interventions. Twenty-three percent of all studies evaluated the implementation of complete courses or curricula, and 44% of the studies evaluated the implementation of e-learning modules. We argue that these studies have encouraging results but provide little information for educators: too many differences exist between conditions to unambiguously attribute the learning effects to specific instructional techniques. Moreover, concepts are not uniformly defined and methodological weaknesses further limit the usefulness of evidence provided by these studies. Thirty-two percent of the studies evaluated a specific interventional technique. We discuss three theoretical frameworks that informed these studies: diagnostic reasoning, cognitive schemas and study strategies. Research on diagnostic reasoning suggests teaching students to start with non-analytic reasoning and subsequently applying analytic reasoning, but little is known on how to train non-analytic reasoning. Research on cognitive schemas investigated activities that help the development of appropriate cognitive schemas. Finally, research on study strategies supports the effectiveness of practice testing, but more study strategies could be applicable to learning medical image interpretation. Our commentary highlights the value of evaluating specific instructional techniques, but further evidence is required to optimally inform educators in medical image interpretation.
Introduction
How to teach medical image interpretation? For an educator in radiology, dermatology, pathology or cardiology, this might be the question in mind. Since ‘evidence-based medicine’ is held in high regard by clinicians, medical educators might aim to search the literature for evidence on how to design their instruction. Instructional design is the science and practical field of creating educational experiences (Merrill et al., 1996). This can be as broad as a curriculum or as narrow as a lesson, or even a single instructive animation. Unfortunately, evidence regarding how to teach medical image interpretation is hard to come by. Research on instructional design in medical image interpretation suffers from being scattered all over the literature, from a lack of cross-references and a lack of theoretical background. A lot of commentaries are published (e.g., Fenderson, 2005; Gunderman and Ballenger, 2014), which might serve as an inspiration, but should not be considered ‘evidence.’ This makes it challenging for medical educators to find and apply the relevant literature to their educational practice. The aim of this paper is twofold. On the one hand we synthesize existing literature about instructional design in medical image interpretation. On the other hand we identify gaps in the literature and propose research inspired by psychological theories as a solution. While we used an extensive literature search to inform our argument, the aim of this paper is not to be systematic and exhaustive, but to provide a commentary that is informed by a literature search.
Methods
We searched Web of Science for papers related to instructional design, using the keywords (teach∗ OR education OR instruct∗ OR curric∗) AND [(Radiology OR Radiography) OR (pathology AND image) OR dermatology OR (electrocardiogra∗ OR ECG)]. We focused on papers less than 15 years old (2001- July 2016) to include recent papers only. This search yielded 4785 papers. Titles were scanned by EMK for relevance and subsequently the abstracts were scanned by KvG. 120 papers were selected for complete reading. EMK and KvG each checked half of these papers against the inclusion criteria. If doubt arose regarding the inclusion, both readers read the paper and discrepancy was resolved through discussion. We included only papers that implemented an educational experience and measured the effects of this intervention (against a control condition and/or against a pretest). We do not go into a discussion about what ‘effects’ of education are and should be, but consider ‘effective’ to be ‘yielding a higher score on a test,’ or ‘being evaluated more positively.’ We excluded papers where medical image interpretation was not the outcome measure (e.g., procedural knowledge), or that treated medical images as tools for teaching something else (e.g., use of radiographs as an illustration in anatomy classes). Table 1 in the Supplementary Materials provides an overview of the 81 selected papers, and they are marked with an asterisk in the reference list. We identified two broad categories of studies: (1) evaluations of curricula and courses (we discuss offline courses and e-learning courses separately) and (2) evaluations of specific instructional techniques. Three theoretical frameworks that form the basis of specific instructional techniques arose from the review: diagnostic reasoning, cognitive schemas, and study strategies. The curricula and courses in the first category commonly implement the specific instructional techniques in the second category of studies. However, studies in the first category rarely discuss specific instructional techniques, and, critically, these instructional techniques are not separately tested. We argue below that only evaluations of specific instructional techniques provide information that educators can use to design their education. In this paper, we discuss respectively evaluations of offline curricula and courses, evaluations of e-learning courses and evaluations of specific instructional techniques. For the purpose of the argument, we discuss representative papers in the rest of the manuscript and refer the reader to the Supplementary Materials for a complete overview of the reviewed papers.
Review
Evaluation of Offline Curricula and Courses
Twenty-three percent of the reviewed studies evaluated a course or curriculum. These are often a combination of lectures, workshops and self-study. The outcome of these studies might seem straight-forward and reassuring: the score on the post-test is typically higher than the score on the pretest, and the ‘new’ curriculum is more effective and more positively evaluated than the ‘old’ curriculum. However, appraisal of these results is problematic, for a variety of reasons. Firstly, numerous differences exist between the ‘new’ curriculum and the ‘old’ curriculum (or other control conditions). This makes the outcome ambiguous: it is impossible to know what makes a new curriculum more effective than the old curriculum. Possibly, the instructional techniques used in the new curriculum are more effective (but, if so, which of the techniques?). But the difference might just as well be caused by other factors, such as enthusiasm of the staff or students for the new curriculum. In line with Norman (2003), we argue that the evaluation of complete courses yields trivial findings that provide no insights for educators, unless the course is carefully compared with another course that only differs on specific, well-defined aspects. If seemingly more specific techniques are compared, such as case-based learning or self-directed learning, the findings provide hardly more insights. The techniques still differ in too many aspects, and often they are very broadly and not uniformly defined. This makes it even more difficult to compare the results over studies. On top of the problem that learning effects cannot be unambiguously attributed to specific instructional techniques, in many of the studies the methodology had apparent weaknesses, e.g., no control conditions and/or the use of inappropriate randomization.
Evaluation of E-learning Modules
E-learning and blended learning are also widely investigated in medical image interpretation (44% of all papers). E-learning refers to learning activities that interactively use a computer to enhance learning (Ruiz et al., 2006). Blended learning refers to a mix of online with traditional (lecture-based) learning activities (Spanjers et al., 2015). E-learning and blended learning environments often provide participants with the opportunity to work through patient cases or provide content information in an interactive manner.
E-learning is a popular way to promote active learning: it allows for large groups of learners to engage in learning at a time and place convenient for them, has the potential to be tailored to learners’ needs, and allows for instructional designs that cannot be implemented in other formats (Cook et al., 2008). Certainly, e-learning is widely found to be more effective or non-inferior to traditional forms of teaching, in both medical education in general (Cook et al., 2008), and medical image interpretation (Zafar et al., 2014). Indeed, the lion’s share of the studies that we reviewed conform to this. Once again, the differences between the e-learning curriculum and the control condition (often a traditional, lecture-based curriculum) are often too large to unequivocally attribute effects to instructional techniques. This issue is even more pressing when it comes to e-learning. Not only do conditions differ from each other in terms of instructional techniques, the differences in the technology used for implementation further confound the comparison.
When an online or offline curriculum is implemented, it aims to maximize learning instead of isolating the contribution of specific educational techniques, even though a curriculum applies a set of instructional techniques. This means that studies resulting from this type of implementations are not optimized for providing specific information on how instruction should be designed. Indeed, many of the methodological weaknesses in this type of studies result from practical and ethical considerations (e.g., it is often impossible to randomly assign students to conditions). However, for an educator in medical image interpretation, it is important to know what specific techniques yield more effective learning, and therefore researchers need to design studies that answer this question. In the next section, we review studies that zoom in on specific instructional techniques. We argue that these specific studies are more informative for educators, not only because they provide more detailed information about ‘what works,’ but also because they are often theory-driven.
Evaluation of Specific Instructional Techniques
Thirty-two percent of the studies that we reviewed evaluated a specific instructional technique. Most of these studies are (implicitly or explicitly) rooted in psychological theories. We discuss three psychological theories that together form the basis of most of these studies. We discuss respectively theories of diagnostic reasoning (Eva, 2004), cognitive schema theory (Charlin et al., 2007) and study strategies (Dunlosky et al., 2013).
Diagnostic Reasoning
Research in cognitive psychology proposes two modes of reasoning: analytic and non-analytic reasoning. Analytic reasoning refers to deliberate, effortful reasoning while non-analytic reasoning refers to automatic, rapid reasoning, also referred to as pattern recognition (Eva, 2004). Several studies use this framework to investigate specific educational techniques in medical image interpretation. For example, Ark et al. (2007) stimulated students to “carefully identify all features [of an ECG] while trusting guidance provided by feelings of familiarity,” i.e., balancing an analytical approach (carefully identifying features) and a non-analytical approach (trusting feelings of familiarity). This was more effective then not providing students with instructions on how to approach this task. Likewise, Baghdady et al. (2014a) found that students who were directed to diagnose a radiograph first and only then identify radiographic features outperformed participants who identified features first and then diagnosed the radiograph.
The claim that students should be instructed to diagnose a case first, based on feelings of familiarity (non-analytic reasoning) and only then collect and analyze all information (analytic reasoning) contrasts with the claim that it is crucial to systematically collect all relevant information in a medical image before making a diagnosis, which is the assumption underlying the idea of teaching a search pattern (Auffermann et al., 2015, 2016). While these studies provide evidence for a benefit of a search pattern training in radiology over no training, the benefit of systematic viewing training over a non-systematic search pattern training could not be established in radiology (Kok et al., 2016) or in ECG interpretation (Varvaroussis et al., 2014).
To sum up, these studies suggest teaching a balanced reasoning strategy, starting with non-analytic reasoning and subsequently applying analytic reasoning. Patel et al. (2015) suggest mapping and microanalysis as two tools to understand a learners’ reasoning process and provide focused feedback to train students in balancing reasoning strategies. Another option is to present students with high numbers of cases under time pressure, as a way to counteract the relatively high emphasis on analytical reasoning in medical education (Patel et al., 2015). These instructional techniques have not been investigated in medical image interpretation yet.
Cognitive Schemas
Diagnostic reasoning requires extensive knowledge that is structured into meaningful patterns, so-called cognitive schemas or illness scripts (Charlin et al., 2007). These contain information about pathophysiological processes underlying diseases, patients’ characteristics and signs and symptoms (Boshuizen and Schmidt, 1992; Van De Wiel et al., 2000). The acquisition of high-quality scripts is central to learning in medicine (Charlin et al., 2007) and thus several studies have explicitly or implicitly focused on helping students to develop high-quality scripts, often with a focus on either pathophysiological processes underlying diseases, patients characteristics or signs and symptoms.
Boshuizen and Schmidt (Boshuizen and Schmidt, 1992; Van De Wiel et al., 2000) argue that basic science knowledge (i.e., the understanding of pathophysiological processes underlying diseases) is fundamental to these illness scripts. However, with increased expertise, basic science knowledge is encapsulated and only used for difficult, atypical cases. Baghdady et al. (2009) argue that basic science knowledge helps diagnosis through creating a coherent mental representation of diseases and their (visual) features. Participants that were provided with causal explanations of radiological features learned more than students who were presented with feature lists or a structured algorithm. A second study, however, found that the negative effect of the structured algorithm (without basic science explanations) was mitigated by the previously discussed instruction to provide a diagnosis before summing up all features (Baghdady et al., 2014a).
The prevalence of a disease is included in illness scripts. Building solid information about actual prevalence of diseases into illness scripts can avoid the ‘prevalence bias’ in decision making (Croskerry, 2003). Pusic et al. (2012) found that the prevalence of normal and abnormal cases in a training set impacted the sensitivity-specificity trade-off, and should thus be considered when developing training sets.
Many studies have aimed to help students develop appropriate cognitive schemas that include the signs and symptoms of diseases. Blissett et al. (2015) suggest that expert-generated (well-structured) schemas can help students to understand the organization of knowledge. Indeed, they found improved learning (in the task of ECG interpretation) from expert-generated schemas as compared to learner-generated schemas. Dong et al. (2015) found that making concept maps (to explicitly structure knowledge) was more effective for learning ECG interpretation then traditional teaching. Other studies have found learning by comparison to be an effective way to teach signs and symptoms in radiology (Kok et al., 2013, 2015) and ECG interpretation (Ark et al., 2007). Medical image interpretation is also unique in that readers are often presented with two-dimensional representations of the three-dimensional body (van der Gijp et al., 2015). Two studies used 3D renderings and models to help participants understand the relationship between the signs and symptoms as seen in 2D and in 3D, in dermatology (Garg et al., 2010) and radiology (Lee et al., 2010).
Appropriate cognitive schemas are crucial for analytical and non-analytical reasoning. The development of appropriate cognitive schemas should thus be a key goal of instructional design. Further research into the optimal combination of these techniques, in order to connect pathophysiological processes underlying diseases, patients’ characteristics and signs and symptoms, is required. In particular, establishing a relationship between visual signs and symptoms, and verbal information about pathophysiological processes requires further research.
Study Strategies
Dunlosky et al. (2013) reviewed the effectiveness of 10 study strategies. Only two of those have been investigated in medical image interpretation: practice testing and mixed practice. Baghdady et al. (2014b) found practice testing to be a more effective way of studying dental radiology than engaging in additional study. Mixed practice (alternating practice on different kinds of problems) has been investigated by Hatala et al. (2003) and Shah et al. (2016). They compared blocked practice (practicing categories of abnormalities one by one) and mixed practice (practicing the items of the categories in mixed order). Shah et al. (2016) did not find differences in performance, while Hatala et al. (2003) did. While Dunlosky’s review considered the utility of the study strategies in diverse situations, many of those strategies are not applied to visual tasks, so the application of findings about effective study strategies in medical image interpretation requires further research.
Conclusion
Instructional design in medical image interpretation has surpassed teacher-centered, lecture-based education and many examples of active, student-centered learning have successfully been implemented in medical image interpretation. However, the evaluation of those complete courses, curricula or e-learning modules provides few insights into specific techniques that lead to optimized learning. It is still unclear which techniques makes complete programs effective, and our educator is left with only a shallow understanding of what makes a specific instructional technique effective.
Take-Home Messages for Educators
Our review of specific interventions provides more detailed recommendations, informed by theories about diagnostic reasoning, schema development and study strategies. It is suggested that educators should teach a balanced reasoning strategy, starting with non-analytic reasoning and subsequently applying analytic reasoning, although further research is required on how this should be taught. Building appropriate cognitive schemas is critical to teaching medical image interpretation, and several designs are proposed that support this. Concept-maps, learning through comparison and expert-generated schemas are found to be useful ways of supporting schema building. Finally, research on study strategies supports the effectiveness of practice testing, but more strategies could be applicable to medical image interpretation.
Limitations
A limitation of this commentary is that we did not formally assess the quality of the reviewed studies. In general, randomized controlled trials are scarce and few studies included appropriate control conditions, although this problem was less prevalent in studies of specific interventions. A systematic assessment of study quality was beyond the scope of this literature-informed commentary but could be a relevant venue for further research. Furthermore, while this commentary discusses what conclusions cannot be drawn from the reviewed literature, there are many topics of which, as Rumsfeld said, ‘we do not know that we do not know them.’ Finally, we focused on outcome measures that reflect medical image interpretation. This excludes research on other important topics such as indications for imaging and professionalism.
Research on expertise in medical image interpretation states that experts have superior perceptual and cognitive abilities (Krupinski, 2010; Manning, 2010; Nodine and Mello-Thoms, 2010; Reingold and Sheridan, 2011; van der Gijp et al., 2014). Interestingly, few studies on education explicitly relate to research about visual expertise. Another remarkable gap in the literature is the lack of studies that focus on individualized and self-regulated learning, two important topics in instructional design nowadays (Van Merrienboer and Kirschner, 2013). In other visual domains, such as air traffic control (Salden et al., 2006), it was found that adapting training to the learners’ needs makes learning more efficient, so this finding is promising for medical image interpretation. Research on self-regulated learning in non-visual diagnostic reasoning provides a possible starting point for fostering self-regulated learning (Cleary et al., 2016). However, visual metacognition is found to be rather low (e.g., Võ et al., 2016), so it is important to understand how visual metacognition can be fostered in order to optimize learning medical image interpretation. In conclusion, we discussed findings relevant for teaching medical image interpretation, but many open questions remain, and further evidence is required to optimally inform educators in medical image interpretation.
Statements
Author contributions
The authors conceptualized the work together. EK and KvG conducted the review, EK wrote a first draft, all authors revised the work critically for important intellectual content. All authors approved the final version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The reviewer JS and the handling Editor declared their shared affiliation, and the handling Editor states that the process nevertheless met the standards of a fair and objective review.
Supplementary material
The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fpsyg.2017.00309/full#supplementary-material
Footnotes
*.^References marked with an asterisk indicate studies included in the review.
References
1
1Al-RawiW. T.JacobsR.HassanB. A.SanderinkG.ScarfeW. C. (2007). Evaluation of web-based instruction for anatomical interpretation in maxillofacial cone beam computed tomography.Dentomaxillofac. Radiol.36459–464. 10.1259/dmfr/25560514
2
1ArkT. K.BrooksL. R.EvaK. W. (2006). Giving learners the best of both worlds: Do clinical teachers need to guard against teaching pattern recognition to novices?.Acad. Med.81405–409. 10.1097/00001888-200604000-00017
3
ArkT. K.BrooksL. R.EvaK. W. (2007). The benefits of flexibility: the pedagogical value of instructions to adopt multifaceted diagnostic reasoning strategies.Med. Educ.41281–287. 10.1111/j.1365-2929.2007.02688.x
4
1AuffermannW. F.HenryT. S.LittleB. P.TiggesS.TridandapaniS. (2015). Simulation for teaching and assessment of nodule perception on chest radiography in nonradiology health care trainees.J. Am. Coll. Radiol.121215–1222. 10.1016/j.jacr.2015.07.014
5
1AuffermannW. F.LittleB. P.TridandapaniS. (2016). Teaching search patterns to medical trainees in an educational laboratory to improve perception of pulmonary nodules.J. Med. Imaging3:011006. 10.1117/1.JMI.3.1.011006
6
1BaghdadyM.CarnahanH.LamE. W. N.WoodsN. N. (2014a). Dental and dental hygiene students’ diagnostic accuracy in oral radiology: effect of diagnostic strategy and instructional method.J. Dent. Educ.781279–1285.
7
1BaghdadyM.CarnahanH.LamE. W. N.WoodsN. N. (2014b). Test-enhanced learning and its effect on comprehension and diagnostic accuracy.Med. Educ.48181–188. 10.1111/medu.12302
8
1BaghdadyM.PharoahM. J.RegehrG.LamE. W. N.WoodsN. N. (2009). The role of basic sciences in diagnostic oral radiology.J. Dent. Educ.731187–1193.
9
1BaileyJ. H.RothT. D.KohliM. D.HeitkampD. E. (2014). Real view radiology – impact on search patterns and confidence in radiology education.Acad. Radiol.21859–868. 10.1016/j.acra.2013.11.022
10
1BlissettS.CavalcantiR.SibbaldM. (2015). ECG rhythm analysis with expert and learner-generated schemas in novice learners.Adv. Health Sci. Educ.20915–933. 10.1007/s10459-014-9572-y
11
1BoespflugA.GuerraJ.DalleS.ThomasL. (2015). Enhancement of customary dermoscopy education with spaced education e-learning a prospective controlled trial.JAMA Dermatol.151847–853. 10.1001/jamadermatol.2015.0214
12
1BojsenS. R.RaderS.HolstA. G.KayserL.RingstedC.SvendsenJ. H.et al (2015). The acquisition and retention of ECG interpretation skills after a standardized web-based ECG tutorial-a randomised study.BMC Med. Educ.15:36. 10.1186/s12909-015-0319-0
13
BoshuizenH. P.SchmidtH. G. (1992). On the role of biomedical knowledge in clinical reasoning by experts, intermediates and novices.Cogn. Sci.16153–184. 10.1207/s15516709cog1602_1
14
1BreenC.ZhuT. T.BondR.FinlayD.CliffordG. (2016). The evaluation of an open source online training system for teaching 12 lead electrocardiographic interpretation.J. Electrocardiol.49454–461. 10.1016/j.jelectrocard.2016.02.003
15
1BurbridgeB.KalraN.MalinG.TrinderK.PinelleD. (2015). University of saskatchewan radiology courseware (USRC): an assessment of its utility for teaching diagnostic imaging in the medical school curriculum.Teach. Learn. Med.2791–98. 10.1080/10401334.2014.979180
16
1CeresnakS. R.AxelrodD. M.MotonagaK. S.JohnsonE. R.KrawczeskiC. D. (2016). Pediatric cardiology boot camp: description and evaluation of a novel intensive training program for pediatric cardiology trainees.Pediatr. Cardiol.37834–844. 10.1007/s00246-016-1357-z
17
CharlinB.BoshuizenH.CustersE. J.FeltovichP. J. (2007). Scripts and clinical reasoning.Med. Educ.411178–1184. 10.1111/j.1365-2923.2007.02924.x
18
1ChudakoffJ. H.ObuchowskiN. A.MehtaN.ReidJ. R. (2013). Worldwide utilization of a web-based learning tool for pediatric radiology.AJR Am. J. Roentgenol.200974–979. 10.2214/ajr.12.10443
19
1ChudgarS. M.EngleD. L.GrochowskiC. O.GagliardiJ. P. (2016). Teaching crucial skills: an electrocardiogram teaching module for medical students.J. Electrocardiol.49490–495. 10.1016/j.jelectrocard.2016.03.021
20
ClearyT. J.DurningS. J.ArtinoA. R.Jr. (2016). Microanalytic assessment of self-regulated learning during clinical reasoning tasks: recent developments and next steps.Acad. Med.911516–1521. 10.1097/ACM.0000000000001228
21
1CliffS.BedlowA. J.MeliaJ.MossS.HarlandC. C. (2003). Impact of skin cancer education on medical students’ diagnostic skills.Clin. Exp. Dermatol.28214–217. 10.1046/j.1365-2230.2003.01237.x
22
CookD. A.LevinsonA. J.GarsideS.DuprasD. M.ErwinP. J.MontoriV. M. (2008). Internet-based learning in the health professions: a meta-analysis.J. Am. Med. Assoc.3001181–1196. 10.1001/jama.300.10.1181
23
CroskerryP. (2003). The importance of cognitive errors in diagnosis and strategies to minimize them.Acad. Med.78775–780. 10.1097/00001888-200308000-00003
24
1DarrasK. E.WorthingtonA.RussellD.HouD. J.ForsterB. B.HagueC. J.et al (2016). Implementation of a longitudinal introduction to radiology course during internship year improves diagnostic radiology residents’ academic and clinical skills: a Canadian experience.Acad. Radiol.23848–860. 10.1016/j.acra.2016.03.007
25
1DeBonisK.BlairT. R.PayneS. T.WiganK.KimS. (2015). Viability of a web-based module for teaching electrocardiogram reading skills to psychiatry residents: learning outcomes and trainee interest.Acad. Psychiatry39645–648. 10.1007/s40596-014-0249-x
26
1DongR. M.YangX. Y.XingB. R.ZouZ. H.ZhengZ. D.XieX. J.et al (2015). Use of concept maps to promote electrocardiogram diagnosis learning in undergraduate medical students.Int. J. Clin. Exp. Med.87794–7801.
27
DunloskyJ.RawsonK. A.MarshE. J.NathanM. J.WillinghamD. T. (2013). Improving students’ learning with effective learning techniques promising directions from cognitive and educational psychology.Psychol. Sci.144–58. 10.1177/1529100612453266
28
EvaK. W. (2004). What every teacher needs to know about clinical reasoning.Med. Educ.3998–106. 10.1111/j.1365-2929.2004.01972.x
29
1EvaK. W.HatalaR. M.LeBlancV. R.BrooksL. R. (2007). Teaching from the clinical reasoning literature: combined reasoning strategies help novice diagnosticians overcome misleading information.Med. Educ.411152–1158. 10.1111/j.1365-2923.2007.02923.x
30
1FawcettR. S.WidmaierE. J.CavanaughS. H. (2004). Digital technology enhances dermatology teaching in a family medicine residency.Fam. Med.3689–91.
31
FendersonB. A. (2005). Strategies for teaching pathology to graduate students and allied health professionals.Hum. Pathol.36146–153. 10.1016/j.humpath.2004.09.022
32
1GargA.HaleyH. L.HatemD. (2010). Modern moulage evaluating the use of 3-dimensional prosthetic mimics in a dermatology teaching program for second-year medical students.Arch. Dermatol.146143–146. 10.1001/archdermatol.2009.355
33
1GiuntaA.Di StefaniA.ChimentiS. (2011). Mobile phones: a role in teaching dermatology?Dermatology22222–23. 10.1159/000317074
34
GundermanR. B.BallengerZ. (2014). The golden rule of education.Acad. Radiol.211078–1079. 10.1016/j.acra.2014.01.026
35
1HatalaR. M.BrooksL. R.NormanG. R. (2003). Practice makes perfect: the critical role of mixed practice in the acquisition of ECG interpretation skills.Adv. Health Sci. Educ.817–26. 10.1023/a:1022687404380
36
1HechtS.AdamsW. H.CunninghamM. A.LaneI. F.HowellN. E. (2013). Student performance and course evaluations before and after use of the classroom performance system (tm) in a third-year veterinary radiology course.Vet. Radiol. Ultrasound54114–121. 10.1111/vru.12001
37
1JenkinsS.GoelR.MorrellD. S. (2008). Computer-assisted instruction versus traditional lecture for medical student teaching of dermatology morphology: a randomized control trial.J. Am. Acad. Dermatol.59255–259. 10.1016/j.jaad.2008.04.026
38
1KaliyadanF.AmriM.DhufiriM.AminT. T.KhanM. A. (2012). Effectiveness of a modified tutorless problem-based learning method in dermatology - a pilot study.J. Eur. Acad. Dermatol. Venereol.26111–113. 10.1111/j.1468-3083.2011.04016.x
39
1KavadellaA.TsiklakisK.VougiouklakisG.LionarakisA. (2012). Evaluation of a blended learning course for teaching oral radiology to undergraduate dental students.Eur. J. Dent. Educ.16E88–E95. 10.1111/j.1600-0579.2011.00680.x
40
1KetelsenD.SchrodlF.KnickenbergI.HeckemannR. A.HothornT.NeuhuberW. L.et al (2007). Modes of information delivery in radiologic anatomy education: impact on student performance.Acad. Radiol.1493–99. 10.1016/j.acra.2006.10.013
41
1KohlwesR. J.ShankR. (2005). An electrocardiogram curriculum for resident doctors.Med. Educ.391163–1164. 10.1111/j.1365-2929.2005.02284.x
42
1KokE. M.de BruinA. B. H.LeppinkJ.van MerrienboerJ. J. G.RobbenS. G. F. (2015). Case comparisons: an efficient way of learning radiology.Acad. Radiol.221226–1235. 10.1016/j.acra.2015.04.012
43
1KokE. M.de BruinA. B. H.RobbenS. C. F.van MerrienboerJ. J. G. (2013). Learning radiological appearances of diseases: Does comparison help?Learn. Instr.2390–97. 10.1016/j.learninstruc.2012.07.004
44
1KokE. M.JarodzkaH.de BruinA. B. H.BinAmirH. A. N.RobbenS. G. F.van MerrienboerJ. J. G. (2016). Systematic viewing in radiology: seeing more, missing less?Adv. Health Sci. Educ.21189–205. 10.1007/s10459-015-9624-y
45
KrupinskiE. A. (2010). “Perceptual factors in reading medical images,” inThe Handbook of Medical Image Perception and Techniques, edsSameiE.KrupinskiE. (Cambridge: Cambridge University Press), 81–90.
46
1LavranosG.KoliakiC.BriasoulisA.NikolaouA.StefanadisC. (2013). Effectiveness of current teaching methods in Cardiology: the SKILLS (medical Students knowledge integration of lower level clinical skills) study.Hippokratia1734–37.
47
1LeeB. F.ChiuN. T.LiC. Y. (2013). Value of case-based learning in a nuclear medicine clerkship.J. Am. Coll. Radiol.10135–141. 10.1016/j.jacr.2012.07.015
48
1LeeH.KimJ.ChoY.KimM.KimN.LeeK. (2010). Three-dimensional computed tomographic volume rendering imaging as a teaching tool in veterinary radiology instruction.Vet. Med.55603–609.
49
1LiJ.LiQ. L.LiJ.ChenM. L.XieH. F.LiY. P.et al (2013). Comparison of three problem-based learning conditions (real patients, digital and paper) with lecture-based learning in a dermatology course: a prospective randomized study from China.Med. Teach.35E963–E970. 10.3109/0142159x.2012.719651
50
1LiebermanG.AbramsonR.VolkanK.McArdleP. J. (2002). Tutor versus computer: a prospective comparison of interactive tutorial and computer-assisted instruction in radiology education.Acad. Radiol.940–49. 10.1016/s1076-6332(03)80295-7
51
1LiebmanT. N.GoulartJ. M.SorianoR.DuszaS. W.HalpernA. C.LeeK. K.et al (2012). Effect of dermoscopy education on the ability of medical students to detect skin cancer.Arch. Dermatol.1481016–1022. 10.1001/archdermatol.2012.509
52
1Lim-DunhamJ. E.EnsmingerD. C.McNultyJ. A.HoytA. E.ChandrasekharA. J. (2016). A vertically integrated online radiology curriculum developed as a cognitive apprenticeship: impact on student performance and learning.Acad. Radiol.23252–261. 10.1016/j.acra.2015.09.018
53
1MahlerS. A.WolcottC. J.SwobodaT. K.WangH.ArnoldT. C. (2011). Techniques for teaching electrocardiogram interpretation: self-directed learning is less effective than a workshop or lecture.Med. Educ.45347–353. 10.1111/j.1365-2923.2010.03891.x
54
1MahnkenA. H.BaumannM.MeisterM.SchmittV.FischerM. R. (2011). Blended learning in radiology: Is self-determined learning really more effective?Eur. J. Radiol.78384–387. 10.1016/j.ejrad.2010.12.059
55
1MaleckM.FischerM. R.KammerB.ZeilerC.MangelE.SchenkF.et al (2001). Do computers teach better? A media comparison study for case-based teaching in radiology.Radiographics211025–1032. 10.1148/radiographics.21.4.g01jl091025
56
1MaloneyE.HippeD. S.PaladinA.ChewF. S.HaA. S. (2016). Musculoskeletal ultrasound training for radiology residents: lecture versus interactive learning module.Acad. Radiol.23789–796. 10.1016/j.acra.2015.11.018
57
ManningD. J. (2010). “Cognitive factors in reading medical images,” inThe Handbook of Medical Image Perception and Techniques, edsSameiE.KrupinskiE. (Cambridge: Cambridge University Press), 91–106.
58
1MarschA. F.EspirituB.GrothJ.HutchensK. A. (2014). The effectiveness of annotated (vs. non-annotated) digital pathology slides as a teaching tool during dermatology and pathology residencies.J. Cutan. Pathol.41513–518. 10.1111/cup.12328
59
1MeckfesselS.StuhmerC.BormannK. H.KupkaT.BehrendsM.MatthiesH.et al (2011). Introduction of e-learning in dental radiology reveals significantly improved results in final examination.J. Cranio Maxillofac. Surg.3940–48. 10.1016/j.jcms.2010.03.008
60
MerrillM. D.DrakeL.LacyM. J.PrattJ.GroupI. R. (1996). Reclaiming instructional design.Educ. Technol.365–7.
61
1MilemanP. A.van den HoutW. B.SanderinkG. C. H. (2003). Randomized controlled trial of a computer-assisted learning program to improve caries detection from bitewing radiographs.Dentomaxillofac. Radiol.32116–123. 10.1259/dmfr/58225203
62
1MontassierE.HardouinJ. B.SegardJ.BatardE.PotelG.PlanchonB.et al (2016). e-Learning versus lecture-based courses in ECG interpretation for undergraduate medical students: a randomized noninferiority study.Eur. J. Emerg. Med.23108–113. 10.1097/mej.0000000000000215
63
1NilssonM.BolinderG.HeldC.JohanssonB. L.ForsU.OstergrenJ. (2008). Evaluation of a web-based ECG-interpretation programme for undergraduate medical students.BMC Med. Educ.8:25. 10.1186/1472-6920-8-25
64
NodineC.Mello-ThomsC. (2010). “The role of expertise in radiologic image interpretation,” inThe Handbook of Medical Image Perception and Techniques, edsSameiE.KrupinskiE. (Cambridge: Cambridge University Press), 139–156.
65
NormanG. (2003). RCT = results confounded and trivial: the perils of grand educational experiments.Med. Educ.37582–584. 10.1046/j.1365-2923.2003.01586.x
66
1OchsendorfF. R.BoehnckeW. H.BoerA.KaufmannR. (2004). Prospective randomised comparison of traditional, personal bedside and problem-oriented practical dermatology courses.Med. Educ.38652–658. 10.1111/j.1365-2929.2004.01838.x
67
1OchsendorfF. R.BoehnckeW. H.SommerladM.KaufmannR. (2006). Interactive large-group teaching in a dermatology course.Med. Teach.28697–701. 10.1080/01421590601034241
68
1O’ConnorE. E.FriedJ.McNultyN.ShahP.HoggJ. P.LewisP.et al (2016). Flipping radiology education right side up.Acad. Radiol.23810–822. 10.1016/j.acra.2016.02.011
69
1PagnanelliG.SoyerH. P.ArgenzianoG.TalaminiR.BarbatiR.BianchiL.et al (2003). Diagnosis of pigmented skin lesions by dermoscopy: web-based training improves diagnostic performance of non-experts.Br. J. Dermatol.148698–702. 10.1046/j.1365-2133.2003.05168.x
70
PatelR.SandarsJ.CarrS. (2015). Clinical diagnostic decision-making in real life contexts: a trans-theoretical approach for teaching: AMEE Guide No. 95.Med. Teach.37211–227. 10.3109/0142159X.2014.975195
71
1PorrasL.DreznerJ.DotsonA.StaffordH.BerkoffD.AgnihotriK.et al (2016). Novice interpretation of screening electrocardiograms and impact of online training.J. Electrocardiol.49462–466. 10.1016/j.jelectrocard.2016.02.004
72
1PorterK. K.BaileyP. D.WoodsR.ScottW. W.JohnsonP. T. (2015). Retained surgical item identification on imaging studies: a training module for radiology residents.Int. J. Comput. Assist. Radiol. Surg.101803–1809. 10.1007/s11548-015-1154-9
73
1PusicM. V.AndrewsJ. S.KesslerD. O.TengD. C.PecaricM. R.Ruzal-ShapiroC.et al (2012). Prevalence of abnormal cases in an image bank affects the learning of radiograph interpretation.Med. Educ.46289–298. 10.1111/j.1365-2923.2011.04165.x
74
1PusicM. V.LeBlancV. R.MillerS. Z. (2007). Linear versus web-style layout of computer tutorials for medical student learning of radiograph interpretation.Acad. Radiol.14877–889. 10.1016/j.acra.2007.04.013
75
1RaupachT.BrownJ.AndersS.HasenfussG.HarendzaS. (2013). Summative assessments are more powerful drivers of student learning than resource intensive teaching formats.BMC Med.11:10. 10.1186/1741-7015-11-61
76
1RaupachT.HanneforthN.AndersS.PukropT.ten CateO. T. J.HarendzaS. (2010). Impact of teaching and assessment format on electrocardiogram interpretation skills.Med. Educ.44731–740. 10.1111/j.1365-2923.2010.03687.x
77
1RaupachT.HarendzaS.AndersS.SchuelperN.BrownJ. (2016). How can we improve teaching of ECG interpretation skills? Findings from a prospective randomised trial.J. Electrocardiol.497–12. 10.1016/j.jelectrocard.2015.10.004
78
ReingoldE. M.SheridanH. (2011). “Eye movements and visual expertise in chess and medicine,” inThe Oxford Handbook of Eye Movements, edsLeversedgeS. P.GilchristI. D.EverlingS. (Oxford: Oxford University Press), 528–550. 10.1093/oxfordhb/9780199539789.013.0029
79
1RengierF.HafnerM. F.UnterhinninghofenR.NawrotzkiR.KirschJ.KauczorH. U.et al (2013). Integration of interactive three-dimensional image post-processing software into undergraduate radiology education effectively improves diagnostic skills and visual-spatial ability.Eur. J. Radiol.821366–1371. 10.1016/j.ejrad.2013.01.010
80
1RoeschA.GruberH.HawelkaB.HammH.ArnoldN.PopalH.et al (2003). Computer assisted learning in medicine: a long-term evaluation of the ‘Practical Training Programme Dermatology 2000’.Med. Inform. Internet Med.28147–159. 10.1080/14639230310001613430
81
1RubinsteinJ.DhobleA.FerenchickG. (2009). Puzzle based teaching versus traditional instruction in electrocardiogram interpretation for medical students - a pilot study.BMC Med. Educ.9:4. 10.1186/1472-6920-9-4
82
RuizJ. G.MintzerM. J.LeipzigR. M. (2006). The impact of e-learning in medical education.Acad. Med.81207–212. 10.1097/00001888-200603000-00002
83
1SalajeghehA.JahangiriA.Dolan-EvansE.PakneshanS. (2016). A combination of traditional learning and e-learning can be more effective on radiological interpretation skills in medical students: a pre- and post-intervention study.BMC Med. Educ.16:46. 10.1186/s12909-016-0569-5
84
SaldenR. J. C. M.PaasF.van MerriënboerJ. J. G. (2006). Personalised adaptive task selection in air traffic control: effects on training efficiency and transfer.Learn. Instr.16350–362. 10.1016/j.learninstruc.2006.07.007
85
1SchultzK. K.BrackbillM. L. (2009). Teaching electrocardiogram basics using dance and movement.Am. J. Pharm. Educ.73:70. 10.5688/aj730470
86
1Sendra-PorteroF.Torales-ChaparroO. E.Ruiz-GomezM. J. (2012). Medical students’ skills in image interpretation before and after training: a comparison between 3rd-year and 6th-year students from two different medical curricula.Eur. J. Radiol.813931–3935. 10.1016/j.ejrad.2012.05.003
87
1Sendra-PorteroF.Torales-ChaparroO. E.Ruiz-GomezM. J.Martinez-MorilloM. (2013). A pilot study to evaluate the use of virtual lectures for undergraduate radiology teaching.Eur. J. Radiol.82888–893. 10.1016/j.ejrad.2013.01.027
88
1ShahR.SibbaldM.JafferN.ProbynL.CavalcantiR. B. (2016). Online self-study of chest X-rays shows no difference between blocked and mixed practice.Med. Educ.50540–549. 10.1111/medu.12991
89
1SilvaC. S.SouzaM. B.SilvaR. S.de MedeirosL. M.CriadoP. R. (2011). E-learning program for medical students in dermatology.Clinics66619–622. 10.1590/s1807-59322011000400016
90
1SinghD. G.BoudvilleN.CorderoyR.RalstonS.TaitC. P. (2011). Impact on the dermatology educational experience of medical students with the introduction of online teaching support modules to help address the reduction in clinical teaching.Aust. J. Dermatol.52264–269. 10.1111/j.1440-0960.2011.00804.x
91
1SkinnerA. A.FreemanR. V.SheehanF. H. (2016). Quantitative feedback facilitates acquisition of skills in focused cardiac ultrasound.Simul. Healthc.11134–138. 10.1097/sih.0000000000000132
92
SpanjersI. A.KöningsK. D.LeppinkJ.VerstegenD. M.de JongN.CzabanowskaK.et al (2015). The promised land of blended learning: quizzes as a moderator.Educ. Res. Rev.1559–74. 10.1016/j.edurev.2015.05.001
93
1TiggesS.LewisP. J.McNultyN. J.MullinsM. E. (2016). Medical student performance after a vertically integrated radiology clerkship.J. Am. Coll. Radiol.1367–71. 10.1016/j.jacr.2015.07.019
94
Van De WielM. W.BoshuizenH. P.SchmidtH. G. (2000). Knowledge restructuring in expertise development: evidence from pathophysiological representations of clinical cases by students and physicians.Eur. J. Cogn. Psychol.12323–356. 10.1080/09541440050114543
95
1van den BergeK.van GogT.MamedeS.SchmidtH. G.van SaaseJ.RikersR. (2013). Acquisition of visual perceptual skills from worked examples: learning to interpret electrocardiograms (ECGs).Interact. Learn. Environ.21263–272. 10.1080/10494820.2011.554422
96
van der GijpA.RaveslootC. J.van der SchaafM. F.van der SchaafI. C.HuigeJ. C.VinckenK. L.et al (2015). Volumetric and two-dimensional image interpretation show different cognitive processes in learners.Acad. Radiol.22632–639. 10.1016/j.acra.2015.01.001
97
van der GijpA.SchaafM. F.SchaafI. C.HuigeJ. C. B. M.RaveslootC. J.SchaikJ. P. J.et al (2014). Interpretation of radiological images: towards a framework of knowledge and skills.Adv. Health Sci. Educ.19565–580. 10.1007/s10459-013-9488-y
98
1Van EsS. L.KumarR. K.PryorW. M.SalisburyE. L.VelanG. M. (2015). Cytopathology whole slide images and adaptive tutorials for postgraduate pathology trainees: a randomized crossover tirial.Hum. Pathol.461297–1305. 10.1016/j.humpath.2015.05.009
99
1Van EsS. L.KumarR. K.PryorW. M.SalisburyE. L.VelanG. M. (2016). Cytopathology whole slide images and adaptive tutorials for senior medical students: a randomized crossover trial.Diagn. Pathol.111. 10.1186/s13000-016-0452-z
100
Van MerrienboerJ. J. G.KirschnerP. A. (2013). Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design, 2nd Edn. New York, NY: Routledge.
101
1VarvaroussisD. P.KalafatiM.PliatsikaP.CastrenM.LottC.XanthosT. (2014). Comparison of two teaching methods for cardiac arrhythmia interpretation among nursing students.Resuscitation85260–265. 10.1016/j.resuscitation.2013.09.023
102
VõM. L. H.AizenmanA. M.WolfeJ. M. (2016). You think you know where you looked? You better look again.J. Exp. Psychol. Hum. Percept. Perform.421477–1481. 10.1037/xhp0000264
103
1WebbA. L.ChoiS. (2014). Interactive radiological anatomy eLearning solution for first year medical students: development, integration, and impact on learning.Anatomical Sciences Education7350–360. 10.1002/ase.1428
104
1WilliamsJ.SatoT. S.PoliceniB. (2013). Pulmonary embolism teaching file: a simple pilot study for rapidly increasing pulmonary embolism recognition among new residents using interactive cross-sectional imaging.Acad. Radiol.201048–1051. 10.1016/j.acra.2012.12.020
105
ZafarS.SafdarS.ZafarA. N. (2014). Evaluation of use of e-Learning in undergraduate radiology education: a review.Eur. J. Radiol.832277–2287. 10.1016/j.ejrad.2014.08.017
106
1ZengR.YueR. Z.TanC. Y.WangQ.KuangP.TianP. W.et al (2015). New ideas for teaching electrocardiogram interpretation and improving classroom teaching content.Adv. Med. Educ. Pract.699–104. 10.2147/amep.s75316
107
1ZhangH. J.HsuL. L. (2013). The effectiveness of an education program on nurses’ knowledge of electrocardiogram interpretation.Int. Emerg. Nurs.21247–251. 10.1016/j.ienj.2012.11.001
Summary
Keywords
medical image interpretation, education, instructional design, e-learning, curriculum design, diagnostic reasoning, cognitive schemas, study strategies
Citation
Kok EM, van Geel K, van Merriënboer JJG and Robben SGF (2017) What We Do and Do Not Know about Teaching Medical Image Interpretation. Front. Psychol. 8:309. doi: 10.3389/fpsyg.2017.00309
Received
27 October 2016
Accepted
20 February 2017
Published
03 March 2017
Volume
8 - 2017
Edited by
Damien Litchfield, Edge Hill University, UK
Reviewed by
Elizabeth Krupinski, Emory University, USA; John Sandars, Edge Hill University, UK
Updates
Copyright
© 2017 Kok, van Geel, van Merriënboer and Robben.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ellen M. Kok, e.kok@maastrichtuniversity.nl
This article was submitted to Perception Science, a section of the journal Frontiers in Psychology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.