Abstract
Training studies, in which the structural or functional neurophysiology is compared before and after expertise is acquired, are increasingly being used as models for understanding the human brain’s potential for reorganization. It is proving difficult to use these results to answer basic and important questions like how task training leads to both specific and general changes in behavior and how these changes correspond with modifications in the brain. The main culprit is the diversity of paradigms used as complex task models. An assortment of activities ranging from juggling to deciphering Morse code has been reported. Even when working in the same general domain, few researchers use similar training models. New ways to meaningfully compare complex tasks are needed. We propose a method for characterizing and deconstructing the task requirements of complex training paradigms, which is suitable for application to both structural and functional neuroimaging studies. We believe this approach will aid brain plasticity research by making it easier to compare training paradigms, identify “missing puzzle pieces,” and encourage researchers to design training protocols to bridge these gaps.
INTRODUCTION
The idea that the structure and function of the human brain remains somewhat open to alteration by experience over the lifespan is now well established (Wan and Schlaug, 2010; Zatorre et al., 2012), although researchers have not yet formed a comprehensive view of how – and under which conditions – this occurs.
In this paper, we focus on the research looking at training-related plasticity in human subjects that uses complex skills as models, such as juggling (e.g., ; ; ), golfing (e.g., ), or various aspects of making music (e.g., ; ). Work using such skills complements earlier and ongoing research on more basic aspects of brain–behavior relationships, such as learning a simple finger-tapping task (e.g., ).
Complex tasks offer several advantages over simpler tasks, as models: they involve more ecologically valid learning experiences; they offer an opportunity to study higher-order and domain-general aspects of learning; they are often inherently interesting to subjects, which offers benefits particularly for longitudinal studies in motivation and compliance; and most significantly, recent evidence suggests that the multisensory and sensorimotor nature of such tasks is particularly effective in inducing plasticity both in sensory and association cortical areas (; ).
The complex nature of the tasks also introduces major challenges for the comparison and integration of results across training studies. These studies usually produce complex results, including changes in activity or structure in many different brain regions. Strictly speaking, only a direct comparison can demonstrate specificity of plastic changes. Rarely are these available, though; the majority of training studies have used either control groups without training, or comparison with a within-subject baseline to assess the possibility of developmental or other non-specific changes. In a recent review of 20 studies on the structural effects of a range of cognitive and multisensory training paradigms, for example, only three compared the task of interest with a second task (). Since few direct comparisons are available, inferences regarding the specificity of task effects rest on arguments about the relevance of the brain structure to apparently related tasks, or on correlational evidence in the form of relationships with behavioral change. Typically, this works well when outcomes can be predicted beforehand, and indeed training studies report changes in brain areas (or other physiological measurements) that are known from previous work to be involved in related activities (e.g., in auditory and motor areas for musical training; ). Findings which are not predicted, for example because relationships of higher-order cognitive systems to training are yet unknown, can pose greater interpretation problems. This is due to the dissimilarity of the studies available for comparison – studies using unalike paradigms offer only very weak and caveated support for one another.
As well as for explaining unexpected results, the diversity of complex task paradigms makes it hard for researchers to draw general bigger-picture conclusions about brain plasticity from the aggregate results. As notes, “it is difficult to retrieve much homogeneity in the outcomes from such a heterogeneous set of studies and primary aims.” There are basic questions about brain plasticity which remain unresolved. For example, why does acquiring some skills lead to increases in measures of brain structure or activity (generally interpreted as strengthening existing capacity or recruiting additional machinery), whereas others lead to decreases (generally interpreted as improved efficiency and requiring less processing effort)? What determines whether a skill is transferable to other behaviors or results in a highly specific behavioral gain? It will be difficult to piece together answers from such a heterogeneous group of studies.
In sum, complex tasks are problematic because their study design space is vast. Because neuroimaging studies such as these are resource-intensive, particularly longitudinal studies which allow us to test causal hypotheses directly, systematically varying each aspect of the training paradigms is an impractical solution. The wide and sparse coverage of potential complex tasks that is already represented in literature implicates nearly every cognitive system, and in various combinations. Even when studies ostensibly use similar tasks, they may differ on tens of potentially important training design parameters, among them the control condition used (i.e., none, between subjects, or within subjects), the sample size, population characteristics, the duration and intensity of training, and the subjects’attained proficiency. Concurrently, rapid evolution of neuroimaging and analysis methods further reduce the comparability of studies.
One might argue for a return to simpler training paradigms until basic mechanisms of plasticity are more fully understood, were it not for the fact that a better understanding of complex task training-related plasticity and its underlying mechanisms is needed now. Important motivations fuelling the observed increase in research comes from promising yet early attempts to improve neurological rehabilitation after injury or stroke (), to prevent of cognitive decline in old age (Wan and Schlaug, 2010), to develop auditory training tools that target the brain to treat auditory processing disorder (; ), and possibly to transform the way the effectiveness of therapeutics and training techniques is evaluated ().
We must find new ways in which to integrate knowledge generated using many models. In the remainder of this paper, we propose one such approach.
A FRAMEWORK TO CHARACTERIZE TRAINING TASKS
In professional environments in which training of personnel must be both effective and efficient, instructional designers have refined the art of training; i.e., producing trainees with specific skills and knowledge. Briefly, one such instructional design process known as the Dick and Carey Systems Approach Model () begins with the definition of a set of concrete goals called “performance objectives” (POs). Flow charts are then used to illustrate the analysis of complex activities into smaller activities or functions. The POs and task breakdown serve as a reference when designers create evaluation measures, define an appropriate instructional strategy, develop and select instructional materials, and finally, evaluate the effectiveness of the training.
Whereas the goal of instructional designers is the successful and measurable transmission of skills and knowledge, the goals of researchers are usually either to design a training paradigm which provokes change in a certain brain structure or function, or to better understand what changes might have been caused by an existing training paradigm or naturalistic learning experience. In either case, two ideas can be borrowed from instructional design; the use of POs, and the task analysis. These are useful both when designing studies and when evaluating existing designs for comparability.
PERFORMANCE OBJECTIVES
A PO consists of a description of the desired outcome behavior; the circumstances under which the outcome should be met including any equipment, instructions, environmental variables like condition of the subjects and availability of feedback or coaching; and the criteria used to judge the learner’s performance. It is worthwhile to create POs for a training study because they help researchers to maintain coherence between the performed task, the subjects’instructions, and the behavioral-dependent variables, and to consider addressing possible alternative explanations with additional controls or measures. In Figure 1A, we include some suggestions for writing and using POs.
FIGURE 1
The POs for some training studies are relatively straightforward and can be easily deduced from the methods description. For example, a recent study () investigated structural changes associated with motor adaptation. The PO for this task could have been written as follows:
• Objective: Minimize the average target–cursor distance over the session.
• Circumstances: Controlling a joystick using the thumb and index fingers of the right hand to follow a moving target, while a complex perturbation is applied.
• Criteria of performance: The distance between target and cursor averaged for each block and expressed as a percentage of the baseline.
Extracting POs from other training studies, particularly ones involving naturalistic designs on leisure activities, is sometimes less straightforward because the tasks are not always comprehensively described. This might be because a detailed account of a very popular activity seems unnecessary, because the training is not strictly under the experimenter’s control, or because the aim of a study might be only to show that any change was caused by doing some activity.
In the study reports, conclusions are nevertheless almost always drawn about the relationships between many specific physiological findings and possible task-relevant cognitive activity. The details of how real-life complex tasks are taught and learned may be relevant for this interpretation. For example, a novice violinist who is encouraged to play entirely by ear will exercise a different set of cognitive skills than one who is learning by reading musical notation, which could explain differences in activity in visual and auditory areas. Making a clear statement about the intended focus of the training early in the study design phase makes it easier to identify supplementary measures and controls that might have explanatory value (e.g., a post-practice questionnaire to provide insight into the instructor’s strategy).
TASK DECOMPOSITION
Task analysis has a long tradition in cognitive psychology and behaviorism where it has been applied to develop models for behavioral contingencies (e.g., ), to create computational models (), to analyze individual differences in reasoning (), and to build computer models of cognitive architecture (, ; ).
Unlike previous work in which creating models of behavior and cognition was the goal, our motivation is to be able to compare the neuroplasticity results from multifaceted tasks and from researchers of different theoretical persuasions. We must therefore target a level of generality that can be linked to the functional networks and modules accessible to neuroimaging methods, rather than on finer-grained analyses, such as specific thought processes. We must also prioritize training-related changes, and we must try to remain as theoretically neutral as possible, such that two researchers studying complex tasks need not first agree on cognitive and mechanistic models for each of many task components.
We propose a “task decomposition” in which a complex task is broken down into elements that are necessary to achieve the PO (see Figure 1B for suggested steps). To facilitate agreement and limit inherent theoretical assumptions, we suggest that the elements be formulated as potentially measurable behaviors (e.g., hold a sequence of notes in mind) rather than as cognitive constructs (e.g., auditory working memory). Choices must be made as to the generality of the elements, for example, whether a hand movement is broken down into finger movements. This will depend on the ability of the experimental design to resolve smaller elements, but if modeled hierarchically, elements could be expanded or collapsed to different levels of detail to accommodate different comparative goals. A common taxonomy of behavioral elements would aid task comparison. To the best of our knowledge a suitable taxonomy does not exist, but one readily observes multiple reoccurring elements when working through several decompositions. Enumerating and standardizing the wording of these would be a necessary step for any meta-analysis.
We relate the elements temporally, which is straightforward and does not introduce many cognitive assumptions. Elements may occur in sequence or concurrently, and series of events may occur as a discrete unit or as a loop. We have included behaviors normally considered both lower and higher-order cognition as elements (e.g., visual observation vs. evaluating the success of an action). Metacognitive elements like the selection of different strategies could also be included, but this would add a level of complexity, for example, if one evaluation element switched between two possible structures. It should first be considered if the component is a focus of neuroplasticity; i.e., likely to have changed with the training in a way that was measurable.
For some tasks, the selection of elements and their arrangement may lead to several competing structures which represent neurophysiologically relevant differences. In the case of a longitudinal study in which transient effects are observed over several measurement points (e.g., ), different structures could usefully be related to expertise acquisition. Different structures could be caused by incorrect assumptions or inter-individual differences; we believe that even in these cases it will be valuable to document the task as a basis for discussion – problems can then be resolved empirically.
In the following section, we illustrate how task decomposition might be used to compare two tasks. We focus on multisensory training tasks in this paper, but this approach might also be applied to more purely cognitive training (see for example reviews by ; ).
AN EXAMPLE OF USING TASK DECOMPOSITION
Using this approach, we start to explore how changes in gray matter concentration as measured by voxel-based morphometry are related to two training tasks; visuomotor tracking described previously () and 40 h of amateur-level golf practice as an uncontrolled leisure activity (). The conclusions we can draw from this two-task analysis might seem trivial as it is not difficult to compare two studies without decomposition. However, our goal here is to offer examples of task decomposition diagrams (TDDs) and a simple illustration of the principle of using them to compare tasks.
We have prepared a possible task decomposition for each study (see Figure 2) and highlighted the elements that differ between the tasks (bold font). We expect to find similar neurophysiological changes in tasks that share a component, and no change in this area with other tasks that do not have this component or do not stress adaptation and learning of this component.
FIGURE 2
The PO of the visuomotor tracking task was to minimize the average target–cursor distance over the session, whereas the PO of the golf practice was presumably to execute a golf swing so as to move ball to target location. The TDDs show overlap of task requirements relating to motor planning and execution. These can account for the convergent findings of changes in motor areas in the dorsal stream encompassing primary motor cortex (M1) contra-lateral to the (most) trained hand in both studies. In contrast, the divergence of the tasks in some aspects, in particular visuomotor control in two vs. three dimensions, hand vs. full body action including balance, and a tight coupling of action and outcome vs. integration of several separate movements into a larger sequence that involves more planning, could account for a discrepancy in findings in the frontal and parietal association areas, as these areas have been shown to be related to planning action sequences and visuomotor integration (; ) and the representation of one’s own body in spatial reference frames () – elements that are important parts of golf, but not visuomotor tracking.
This sort of analysis could then be used to investigate explanatory hypotheses. For example, based on a previous functional magnetic resonance imaging (fMRI) study using the same task (), had expected changes in a network including M1, posterior parietal cortex (PPC), and cerebellum, but found only the M1 result. Cerebellum and PPC are relevant functionally for online error correction, but the lack of structural changes might be due to the similarity of the manual tracking task to everyday tasks in these respects. The more novel kinds of whole-body and multisensory error corrections that are necessary for learning golf swings might stimulate greater neurophysiological adaptation. Next steps might be to compare these results with those from other manual tasks with these error correction requirements, or to design one.
OTHER APPLICATIONS AND CAUTIONS
Beyond uncovering patterns of task demands and neurophysiological effect across training studies, task decomposition could be used in other ways in plasticity research. Characterizing tasks used in human and animal research could facilitate cross-field comparisons from systems to circuit level (e.g., ). Hypotheses as to the cause for divergent empirical findings can be tested by designing tasks in which only those sub-components suspected of causing the change are manipulated. It would also be possible to start with a brain region of interest, identify common characteristics or components of trainings that lead to enhancements, and design rehabilitative tasks emphasizing those elements.
There are several possible pitfalls to this approach: post hoc models could be biased toward task components that have known neural correlates that are in line with the results of the study; omitting crucial task components due to oversight or bias might result in incorrect assignment of neuroimaging results to task components that are included in the model; and since most brain regions are involved in multiple, different cognitive processes, changes in the same brain region may be due to different task components depending on context. These challenges parallel challenges interpreting neuroimaging data in general (e.g., Vul et al., 2009; ), and can be partially addressed by a priori model setup and awareness of these limitations during interpretation.
CONCLUSION
In the rapidly evolving field of training-related plasticity, integration of results across studies will be crucial. For this, an approach like task decomposition could be useful to disentangle the respective influences of task demands on neuroplasticity, and increase the informational value and impact of each resource-intensive training study. By integrating across studies, we will be able to reveal specific and general mechanisms of plasticity within and across modalities such as the motor, visual, and auditory systems, and enhance our understanding of the role of higher-order functions and association areas in cortical plasticity. We argue that if researchers systematically consider what sub-tasks participants must perform in order to achieve training goals, and communicate them in the literature along with other aspects of their study design, it may turn the diversity in training studies into an advantage rather than an impediment by allowing us to extract meaning from aggregate results and to target future studies efficiently.
Statements
Acknowledgments
We would like to acknowledge the support of the Canadian Institutes of Health Research (Vanier Canada Graduate Scholarship; Emily B. J. Coffey) and the Deutsche Forschungsgemeinschaft (HE6067/1-1 and 3-1; Sibylle C. Herholz).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
REFERENCES
1
AltenmüllerE.Marco-PallaresJ.MünteT. F.SchneiderS. (2009). Neural reorganization underlies improvement in stroke-induced motor dysfunction by music-supported therapy.Ann. N. Y. Acad. Sci.1169395–405. 10.1111/j.1749-6632.2009.04580.x
2
AndersenR. A.BuneoC. A. (2002). Intentional maps in posterior parietal cortex.Annu. Rev. Neurosci.25189–220. 10.1146/annurev.neuro.25.112701.142922
3
AndersonJ. R.AndersonJ. F.FerrisJ. L.FinchamJ. M.JungK. J. (2009). Lateral inferior prefrontal cortex and anterior cingulate cortex are engaged at different stages in the solution of insight problems.Proc. Natl. Acad. Sci. U.S.A.10610799–10804. 10.1073/pnas.0903953106
4
AndersonJ. R.QinY.SohnM. H.StengerV. A.CarterC. S. (2003). An information-processing model of the BOLD response in symbol manipulation tasks.Psychon. Bull. Rev.10241–261. 10.3758/BF03196490
5
BezzolaL.MerillatS.GaserC.JanckeL. (2011). Training-induced neural plasticity in golf novices.J. Neurosci.3112444–12448. 10.1523/JNEUROSCI.1996-11.2011
6
BoykeJ.DriemeyerJ.GaserC.BuchelC.MayA. (2008). Training-induced brain structure changes in the elderly.J. Neurosci.287031–7035. 10.1523/JNEUROSCI.0742-08.2008
7
BuschkuehlM.JaeggiS. M.JonidesJ. (2012). Neuronal effects following working memory training.Dev. Cogn. Neurosci.2(Suppl. 1)S167–S179. 10.1016/j.dcn.2011.10.001
8
Della-MaggioreV.McIntoshA. R. (2005). Time course of changes in brain activity and functional connectivity associated with long-term adaptation to a rotational transformation.J. Neurophysiol.932254–2262. 10.1152/jn.00984.2004
9
DickW.CareyL.CareyJ. O. (2004). The Systematic Design of Instruction.Boston, MA: Allyn & Bacon.
10
DraganskiB.GaserC.BuschV.SchuiererG.BogdahnU.MayA. (2004). Neuroplasticity: changes in grey matter induced by training.Nature427311–312. 10.1038/427311a
11
EricksonK. I. (2012). Evidence for structural plasticity in humans: comment on Thomas and Baker (2012).Neuroimage73237–238discussion 265–267. 10.1016/j.neuroimage.2012.07.003
12
GuidaA.GobetF.TardieuH.NicolasS. (2012). How chunks, long-term working memory and templates offer a cognitive explanation for neuroimaging data on expertise acquisition: a two-stage framework.Brain Cogn.79221–244. 10.1016/j.bandc.2012.01.010
13
HydeK. L.LerchJ.NortonA.ForgeardM.WinnerE.EvansA. C.et al (2009). Musical training shapes structural brain development.J. Neurosci.293019–3025. 10.1523/JNEUROSCI.5118-08.2009
14
LandiS. M.BaguearF.Della-MaggioreV. (2011). One week of motor adaption induces structural changes in primary motor cortex that predict long-term memory one year later.J. Neurosci.3111808–11813. 10.1523/JNEUROSCI.2253-11.2011
15
LappeC.HerholzS. C.TrainorL. J.PantevC. (2008). Cortical plasticity induced by short-term unimodal and multimodal musical training.J. Neurosci.289632–9639. 10.1523/JNEUROSCI.2254-08.2008
16
LooJ. H.BamiouD. E.CampbellN.LuxonL. M. (2010). Computer-based auditory training (CBAT): benefits for children with language- and reading-related learning difficulties.Dev. Med. Child Neurol.52708–717. 10.1111/j.1469-8749.2010.03654.x
17
Molnar-SzakacsI.KaplanJ.GreenfieldP. M.IacoboniM. (2006). Observing complex action sequences: the role of the fronto-parietal mirror neuron system.Neuroimage33923–935. 10.1016/j.neuroimage.2006.07.035
18
MusiekF. E.ShinnJ.HareC. (2002). Plasticity, auditory training, and auditory processing disorders.Semin. Hear.23263–276. 10.1055/s-2002-35862
19
NewellA.SimonH. A. (1972). Human Problem Solving.Englewood Cliffs, NJ: Prentice-Hall.
20
ParaskevopoulosE.KuchenbuchA.HerholzS. C.PantevC. (2012). Evidence for training-induced plasticity in multisensory brain structures: an MEG study.PLoS ONE7:e36534. 10.1371/journal.pone.0036534
21
QinY.SohnM. H.AndersonJ. R.StengerV. A.FissellK.GoodeA.et al (2003). Predicting the practice effects on the blood oxygenation level-dependent (BOLD) function of fMRI in a symbolic manipulation task.Proc. Natl. Acad. Sci. U.S.A.1004951–4956. 10.1073/pnas.0431053100
22
SagiY.TavorI.HofstetterS.Tzur-MoryosefS.Blumenfeld-KatzirT.AssafY. (2012). Learning in the fast lane: new insights into neuroplasticity.Neuron731195–1203. 10.1016/j.neuron.2012.01.025
23
ScholzJ.KleinM. C.BehrensT. E.Johansen-BergH. (2009). Training induces changes in white-matter architecture.Nat. Neurosci.121370–1371. 10.1038/nn.2412
24
SimmonsJ. P.NelsonL. D.SimonsohnU. (2011). False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.Psychol. Sci.221359–1366. 10.1177/0956797611417632
25
SkinnerB. F. (1954). The science of learning and the art of teaching.Harv. Educ. Rev.2486–97.
26
SternbergR. J. (1977). Component processes in analogical reasoning.Psychol. Rev.84353–378. 10.1037/0033-295X.84.4.353
27
TaubertM.DraganskiB.AnwanderA.MullerK.HorstmannA.VillringerA.et al (2010). Dynamic properties of human brain structure: learning-related changes in cortical areas and associated fiber connections.J. Neurosci.3011670–11677. 10.1523/JNEUROSCI.2567-10.2010
28
ThomasC.BakerC. I. (2013). Teaching an adult brain new tricks: a critical review of evidence for training-dependent structural plasticity in humans.Neuroimage73225–236. 10.1016/j.neuroimage.2012.03.069
29
UngerleiderL. G.DoyonJ.KarniA. (2002). Imaging brain plasticity during motor skill learning.Neurobiol. Learn. Mem.78553–564. 10.1006/nlme.2002.4091
30
VallarG.LobelE.GalatiG.BerthozA.PizzamiglioLLe BihanD. (1999). A fronto-parietal system for computing the egocentric spatial frame of reference in humans.Exp. Brain Res.124281–286. 10.1007/s002210050624
31
VulE.HarrisC.WinkielmanP.PashlerH. (2009). Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition.Perspect. Psychol. Sci.4274–290. 10.1111/j.1745-6924.2009.01125.x
32
WanC. Y.SchlaugG. (2010). Music making as a tool for promoting brain plasticity across the life span.Neuroscientist16566–577. 10.1177/1073858410377805
33
ZatorreR. J.FieldsR. D.Johansen-BergH. (2012). Plasticity in gray and white: neuroimaging changes in brain structure during learning.Nat. Neurosci.15528–536. 10.1038/nn.3045
Summary
Keywords
expertise, plasticity, training, MRI, multisensory learning
Citation
Coffey EBJ and Herholz SC (2013) Task decomposition: a framework for comparing diverse training models in human brain plasticity studies. Front. Hum. Neurosci. 7:640. doi: 10.3389/fnhum.2013.00640
Received
25 July 2013
Accepted
16 September 2013
Published
08 October 2013
Volume
7 - 2013
Edited by
Merim Bilalic, University Clinic, University of Tübingen, Germany
Reviewed by
Luca Turella, University of Trento, Italy; Alessandro Guida, University of Rennes 2, France
Copyright
© Coffey and Herholz.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sibylle C. Herholz, Deutsches Zentrum für Neurodegenerative Erkrankungen, Holbeinstr. 13-15, 53175 Bonn, Germany e-mail: sibylle.herholz@dzne.de; sibylle.herholz@gmail.com
This article was submitted to the journal Frontiers in Human Neuroscience
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.