Stuck in the mud: time for change in the implementation of cognitive training research in ageing?
- Healthy Brain Ageing Program, Brain and Mind Research Institute, University of Sydney, Sydney, NSW, Australia
Over the past two decades, within the field of healthy ageing and dementia prevention there has been a substantial growth of interest in the potential of cognitive training (CT) interventions (see Figure 1). Whilst various studies have employed different methodologies, generally the term refers to programs which provide theoretically driven skills and strategies, involving guided practice on tasks reflecting specific cognitive functions (Mowszowski et al., 2010). The focus of such interventions is to improve functioning of particular cognitive skills such as memory, working memory, attention, and executive functions, as decline in these or other cognitive domains may lead to functional impairment in day-to-day activities as well as contribute to reduced quality of life and disability (Salthouse, 2004). Improvements in these cognitive abilities may lead to more effective or independent functioning and may be instigated through various CT approaches including repetitive computerized exercise, pen and paper tasks, and clinically-driven strategy learning.
Figure 1. Number of publications per year over the last 2 decades containing the terms “Cognitive Training,” “Cognitive Remediation,” or “Cognitive Rehabilitation” in the title, abstract, or key-words. Data was extracted from the Scopus Database on 14/02/2014.
The importance of further exploring this method for preventing or delaying decline is clear, with the growth of the world's older adult population in the first half of this century anticipated to be staggering. With this comes a significant increase in the incidence of dementia and age-related cognitive decline. Indeed, it has been predicted that by 2050 in the United States alone, there will be 13.8 million people suffering from Alzheimer's disease (Hebert et al., 2013). In response, severe consequences for health service costs in addition to lowered quality of life in sufferers and their family members or carers will become key issues for our society (Comas-Herrera et al., 2007).
Ultimately, it has been proposed that CT should be used as a preventative technique for delaying, reducing or preventing cognitive decline, or as a method of restoring function and coping with deficits (Naismith et al., 2009; Mowszowski et al., 2010). CT has numerous strengths due to its relatively easy implementation, as compared to pharmacological means, and high potential for at-home personalized use or clinical facilitation. As such, in addition to other methods, investigating this potential means of dementia prevention and delayed decline should be of utmost importance in current thinking and should represent an international health-related research priority. However, despite the clear need for thorough, effective research, CT trials to date have been relatively mixed in regards to fulfilling the rigorous scientific standards required to warrant implementation and investment in such health interventions.
Despite this, the research has undoubtedly grown in a positive direction from early beginnings. Numerous well conducted trials have been able to show benefits in CT that can translate to non-practiced neuropsychological tasks, that are still evident at follow-up testing, and carry over onto non-cognitive functional measures (for reviews see: Zelinski, 2009; Gates et al., 2011; Kueider et al., 2012; Jak et al., 2013). Anecdotally, many clinicians observe that participants, carers, and family-members often report a subjective sense of improvement to functioning in addition to objective improvements on formal outcome measures. Such subjective improvements have been empirically demonstrated, for example in knowledge and use of memory strategies (Kinsella et al., 2009; Naismith et al., 2013), perceptions of cognitive abilities (Smith et al., 2009) and well-being (Belleville et al., 2006).
Furthermore, our understanding of the theory underlying the effectiveness of CT is growing. Evidence for the role of neuroplasticity resulting from multiple types of training and how it can be used is now more clearly apparent (Cramer et al., 2011; Park and Bischof, 2013; Patel et al., 2013). Additionally, our understanding of the relevance and applicability of cognitively demanding experience as a contributor to protection against dementia (i.e., cognitive reserve) is expanding (Stern, 2002; Valenzuela et al., 2007; Valenzuela and Sachdev, 2009). However, there still remains no gold standard of evidence to confirm how best CT can be effective. It is clear that many researchers believe that the lack of a consistently strong finding across studies may likely reflect methodological differences, given the relatively robust underlying neurobiological theory and the many positive research findings that have been found.
A number of recent reviews which have extensively analyzed the literature clearly show that the heterogeneity in methodology and content of CT studies in addition to low quality trials is leading to exceedingly difficult synthesis of data and interpretation of findings. For example, recent work which analyzed the evidence for CT in Alzheimer's disease was unable to make reliable conclusions of the literature based primarily on the low quality of current studies (Bahar-Fuchs et al., 2013). Such a finding may relate specifically to the particular patient group under investigation, yet other reviews of differing populations such as healthy older adults and those with mild cognitive impairment which have indeed suggested more positive results, still conclude that there is much work to be done in terms of methodological heterogeneity across studies (e.g., Mowszowski et al., 2010; Gates et al., 2011; Kueider et al., 2012; Rabipour and Raz, 2012; Huckans et al., 2013; Jak et al., 2013; Reijnders et al., 2013).
Various issues regarding CT research can be provided as possible reasons for the common lack of consensus across studies. Briefly, in terms of experimental design, such issues arise from a lack of double-blinded, randomized active-controlled trials. Such methodology should ideally be required for publication of findings, in accordance with appropriate reporting standards (Moher et al., 2001). Trials should contain sham training whereby clinician interaction and participant expectation effects can be reliably matched. While a push toward the use of active controls in trials is apparent, often the active element is not sufficient, with patients engaging in activities possibly too simple to match for clinical interaction and expectancy effects (Boot et al., 2013). For example, sham training may involve low-level non-adaptive training in very simple CT tasks that would not be expected to elicit any meaningful change, yet more accurately represent a behavioral placebo (Brehmer et al., 2012). In addition, studies often lack sufficiently powered samples, complete training over too short a time period, and do not allow for a significant follow up period of testing.
Communication of such methodology must also be improved, as inappropriate or unclear terminology reported for remediation techniques is common, in addition to inadequate details of training procedures. Indeed, this problem may be evident in much of the non-pharmacological literature (Hoffmann et al., 2013). For example, cognitive outcome measures should entail standardized neuropsychological tasks, which can be interpreted by trained clinicians and be compared to a plethora of literature for review and meta-analytic techniques. Additionally, more informative and sensitive measures of functional change need to be developed and implemented. The construction of further standardized questionnaires relating to self-assessed functional and cognitive changes may be valuable for cross-study comparison and is thus worthy of increased research interest.
Although a number of these criticisms are regularly reported as limitations in many research articles and reviews, insufficient changes have been made to address these problems. In this way, it would appear that we are moving further from discovering what is most effective by diluting the literature with often incomparable studies. Thus, we are blocking our progression toward consistently solid evidence for CT efficacy and uncovering what is hoped are tangible and very real benefits for the ageing population. In addition to the abovementioned limitations, we suggest the following areas of research may enhance future study quality and translational ability.
Further areas of interest in improving the validity of findings include understanding the time-course and sustainability of CT-related improvements, and work is currently being conducted to explore this in more detail (Lampit et al., 2013). Many studies have been able to show sustained results at follow-up testing (Mahncke et al., 2006; Li et al., 2008; Brehmer et al., 2012; Rebok et al., 2014), but the processes underlying the duration of effects are not well understood. Another area of importance yet to be fully explored is the role of individual differences in training gains. Factors including cognitive reserve and ability (e.g., education, IQ, employment), relevant personality traits (e.g., locus of control, self-efficacy), pre-training cognitive performance, diet, smoking and alcohol intake, or sub-threshold depressive and anxious symptoms are likely to play an important role in how different participants respond to training. Early exploration of this area appears to support the notion that such factors should be included as possible mediating variables, as they may impact on individual levels of training efficacy. Moreover, recent work has suggested that such individual differences may be helpful in predicting which patients may benefit most from CT, thus enabling a more targeted approach (Jaeggi et al., 2013; Rebok et al., 2013; Willis and Caskie, 2013).
A key issue in ageing research in particular is developing stronger longitudinal evidence for protective benefits in “at-risk” groups such as patients with mild cognitive impairment and late-life depression (Gates et al., 2011; Naismith et al., 2011). For example, future studies should aim to clearly investigate any differences in the trajectory of cognitive decline between “at-risk” groups who undergo CT programs, compared to those who do not receive such interventions.
Further interest involves understanding the most appropriate delivery of CT interventions. While many researchers and clinicians favor a strictly computerized “drill-like” program, some studies suggest that the implementation of concurrent psycho-education or similar programs may enhance CT-related gains, either by improving understanding (i.e., education: cognition, modifiable risk factors for healthy brain ageing) or by boosting program engagement (Norrie et al., 2011). Crucially, such a format may improve the acceptance and tolerance of intensive training in participants leading to better outcomes. Concomitant strategy training may also booster the observed effects of standard computerized CT (Sohlberg and Mateer, 2001; Wilson, 2008; Naismith et al., 2011, 2013). Such methodology is especially relevant in heterogeneous clinical populations as compared with healthy populations, and has important implications for effective clinical practice.
Ultimately, the goal of CT research should be to implement such programs within the community or clinical setting. Understanding how best to make such programs accessible and feasible in clinical, disadvantaged or hard-to-reach populations is complex, and may require involvement of local healthcare or public health services to facilitate translation. One area of growth may be the use of e-health platforms and implementation in aged-care facilities. To this note, the literature lacks substantial detailed evidence for the cost-effectiveness of these programs, and such research would be advantageous.
In order to progress the field of CT to the methodological caliber of biomedical and pharmacological interventions, systematic, structured guidelines for the implementation of CT programs are warranted. We suggest that the field would benefit from an international meeting of CT researchers and clinicians, to discuss how best to resolve some of these issues, as has been implemented in other fields of research (e.g., Green et al., 2004). Primary importance should be directed to work-shopping collaboratively, with the common goal of formulating a set of systematic concrete guidelines, to facilitate consistency across studies leading to better synthesis of findings. This would inform future research as to how most effectively assess the efficacy of CT, and lead to more rapid transfer of research knowledge into clinical and community settings. Such a meeting could also involve training forums, so that clinicians are appropriately trained and are utilizing the available evidence. Whilst it may take some time to establish and implement such guidelines, it appears the time has arrived for more active engagement in addressing what have been described as limitations in the literature for too long. It is our hope that the scientific community involved in CT research can work together to confront this issue, so that this important and worthwhile field can grow upwards rather than outwards.
Courtney C. Walton prepared the original manuscript. Loren Mowszowski, Simon J. G. Lewis, and Sharon L. Naismith edited and gave final approval for publication. All authors are accountable for this work.
Courtney C. Walton is supported by an Australian Postgraduate Award at the University of Sydney. Sharon L. Naismith is supported by an NHMRC Career Development Award No. 1008117. Simon J. G. Lewis is supported by an NHMRC Practitioner Fellowship No. 1003007. Loren Mowszowski has no financial disclosures.
Bahar-Fuchs, A., Clare, L., and Woods, B. (2013). Cognitive training and cognitive rehabilitation for persons with mild to moderate dementia of the Alzheimer's or vascular type: a review. Alzheimers. Res. Ther. 5, 35. doi: 10.1186/alzrt189
Belleville, S., Gilbert, B., Fontaine, F., Gagnon, L., Menard, E., and Gauthier, S. (2006). Improvement of episodic memory in persons with mild cognitive impairment and healthy older adults: evidence from a cognitive intervention program. Dement. Geriatr. Cogn. Disord. 22, 486–499. doi: 10.1159/000096316
Boot, W. R., Simons, D. J., Stothart, C., and Stutts, C. (2013). The pervasive problem with placebos in psychology: why active control groups are not sufficient to rule out placebo effects. Perspect. Psychol. Sci. 8, 445–454. doi: 10.1177/1745691613491271
Brehmer, Y., Westerberg, H., and Backman, L. (2012). Working-memory training in younger and older adults: training gains, transfer, and maintenance. Front. Hum. Neurosci. 6. doi: 10.3389/fnhum.2012.00063
Comas-Herrera, A., Wittenberg, R., Pickard, L., and Knapp, M. (2007). Cognitive impairment in older people: future demand for long-term care services and the associated costs. Int. J. Geriatr. Psychiatry 22, 1037–1045. doi: 10.1002/gps.1830
Cramer, S. C., Sur, M., Dobkin, B. H., O'Brien, C., Sanger, T. D., Trojanowski, J. Q., et al. (2011). Harnessing neuroplasticity for clinical applications. Brain 134, 1591–1609. doi: 10.1093/brain/awr039
Gates, N. J., Sachdev, P. S., Fiatarone Singh, M. A., and Valenzuela, M. (2011). Cognitive and memory training in adults at risk of dementia: a systematic review. BMC Geriatr. 11:55. doi: 10.1186/1471-2318-11-55
Green, M. F., Nuechterlein, K. H., Gold, J. M., Barch, D. M., Cohen, J., Essock, S., et al. (2004). Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biol. Psychiatry 56, 301–307. doi: 10.1016/j.biopsych.2004.06.023
Hebert, L. E., Weuve, J., Scherr, P. A., and Evans, D. A. (2013). Alzheimer disease in the United States (2010-2050) estimated using the 2010 census. Neurology 80, 1778–1783. doi: 10.1212/WNL.0b013e31828726f5
Hoffmann, T. C., Erueti, C., and Glasziou, P. P. (2013). Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ 347, f3755. doi: 10.1136/bmj.f3755
Huckans, M., Hutson, L., Twamley, E., Jak, A., Kaye, J., and Storzbach, D. (2013). Efficacy of cognitive rehabilitation therapies for mild cognitive impairment (MCI) in older adults: working toward a theoretical model and evidence-based interventions. Neuropsychol. Rev. 23, 63–80. doi: 10.1007/s11065-013-9230-9
Jaeggi, S. M., Buschkuehl, M., Shah, P., and Jonides, J. (2013). The role of individual differences in cognitive training and transfer. Mem. Cognit. doi: 10.3758/s13421-013-0364-z. [Epub ahead of print].
Jak, A. J., Seelye, A. M., and Jurick, S. M. (2013). Crosswords to computers: a critical review of popular approaches to cognitive enhancement. Neuropsychol. Rev. 23, 13–26. doi: 10.1007/s11065-013-9226-5
Kinsella, G. J., Mullaly, E., Rand, E., Ong, B., Burton, C., Price, S., et al. (2009). Early intervention for mild cognitive impairment: a randomised controlled trial. J. Neurol. Neurosurg. Psychiatr. 80, 730–736. doi: 10.1136/jnnp.2008.148346
Lampit, A., Hallock, H., Moss, R., Kwok, S., Rosser, M., Lukjaneko, M., et al. (2013). “A dose-response relationship between computerised cognitive training and global cognition in older adults,” in 6th Conference Clinical Trials on Alzheimer's Disease, Abstracts (San Diego, CA), 803–804.
Li, S. C., Schmiedek, F., Huxhold, O., Rocke, C., Smith, J., and Lindenberger, U. (2008). Working memory plasticity in old age: practice gain, transfer, and maintenance. Psychol. Aging 23, 731–742. doi: 10.1037/a0014343
Mahncke, H. W., Connor, B. B., Appelman, J., Ahsanuddin, O. N., Hardy, J. L., Wood, R. A., et al. (2006). Memory enhancement in healthy older adults using a brain plasticity-based training program: a randomized, controlled study. Proc. Natl. Acad. Sci. U.S.A. 103, 12523–12528. doi: 10.1073/pnas.0605194103
Moher, D., Schulz, K. F., and Altman, D. G. (2001). The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 357, 1191–1194. doi: 10.1016/S0140-6736(00)04337-3
Mowszowski, L., Batchelor, J., and Naismith, S. L. (2010). Early intervention for cognitive decline: can cognitive training be used as a selective prevention technique? Int. Psychogeriatr. 22, 537–548. doi: 10.1017/S1041610209991748
Naismith, S. L., Diamond, K., Carter, P. E., Norrie, L. M., Redoblado-Hodge, M. A., Lewis, S. J., et al. (2011). Enhancing memory in late-life depression: the effects of a combined psychoeducation and cognitive training program. Am. J. Geriatr. Psychiatry 19, 240–248. doi: 10.1097/JGP.0b013e3181dba587
Naismith, S. L., Glozier, N., Burke, D., Carter, P. E., Scott, E., and Hickie, I. B. (2009). Early intervention for cognitive decline: is there a role for multiple medical or behavioural interventions? Early Interv. Psychiatry 3, 19–27. doi: 10.1111/j.1751-7893.2008.00102.x
Naismith, S. L., Mowszowski, L., Diamond, K., and Lewis, S. J. (2013). Improving memory in Parkinson's disease: a healthy brain ageing cognitive training program. Mov. Disord. 28, 1097–1103. doi: 10.1002/mds.25457
Norrie, L. M., Diamond, K., Hickie, I. B., Rogers, N. L., Fearns, S., and Naismith, S. L. (2011). Can older “at risk” adults benefit from psychoeducation targeting healthy brain aging? Int. Psychogeriatr. 23, 413–424. doi: 10.1017/s1041610210001109
Patel, R., Spreng, R. N., and Turner, G. R. (2013). Functional brain changes following cognitive and motor skills training: a quantitative meta-analysis. Neurorehabil. Neural Repair 27, 187–199. doi: 10.1177/1545968312461718
Rebok, G. W., Ball, K., Guey, L. T., Jones, R. N., Kim, H. Y., King, J. W., et al. (2014). Ten-year effects of the advanced cognitive training for independent and vital elderly cognitive training trial on cognition and everyday functioning in older adults. J. Am. Geriatr. Soc. doi: 10.1111/jgs.12607. [Epub ahead of print].
Rebok, G. W., Langbaum, J. B., Jones, R. N., Gross, A. L., Parisi, J. M., Spira, A. P., et al. (2013). Memory training in the ACTIVE study: How much is needed and who benefits? J. Aging Health 25, 21S–42S. doi: 10.1177/0898264312461937
Reijnders, J., Van Heugten, C., and Van Boxtel, M. (2013). Cognitive interventions in healthy older adults and people with mild cognitive impairment: a systematic review. Ageing Res. Rev. 12, 263–275. doi: 10.1016/j.arr.2012.07.003
Smith, G. E., Housen, P., Yaffe, K., Ruff, R., Kennison, R. F., Mahncke, H. W., et al. (2009). A cognitive training program based on principles of brain plasticity: results from the Improvement in Memory with Plasticity-based Adaptive Cognitive Training (IMPACT) Study. J. Am. Geriatr. Soc. 57, 594–603. doi: 10.1111/j.1532-5415.2008.02167.x
Valenzuela, M. J., Breakspear, M., and Sachdev, P. (2007). Complex mental activity and the aging brain: molecular, cellular and cortical network mechanisms. Brain Res. Rev. 56, 198–213. doi: 10.1016/j.brainresrev.2007.07.007
Valenzuela, M., and Sachdev, P. (2009). Can cognitive exercise prevent the onset of dementia? Systematic review of randomized clinical trials with longitudinal follow-up. Am. J. Geriatr. Psychiatry 17, 179–187. doi: 10.1097/JGP.0b013e3181953b57
Keywords: cognitive training, cognitive remediation, healthy brain ageing, dementia, research methodology
Citation: Walton CC, Mowszowski L, Lewis SJG and Naismith SL (2014) Stuck in the mud: time for change in the implementation of cognitive training research in ageing? Front. Aging Neurosci. 6:43. doi: 10.3389/fnagi.2014.00043
Received: 16 January 2014; Paper pending published: 10 February 2014;
Accepted: 27 February 2014; Published online: 17 March 2014.
Edited by:Rodrigo Orlando Kuljiš, Zdrav Mozak Limitada, Chile
Reviewed by:Stefano F. Cappa, Vita-Salute San Raffaele University, Italy
Bert Jonsson, Umeå University, Sweden
Kristin Flegal, University of California, Davis, USA
George Rebok, Johns Hopkins University, USA
Copyright © 2014 Walton, Mowszowski, Lewis and Naismith. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.