Digital Biomarkers for the Early Detection of Mild Cognitive Impairment: Artificial Intelligence Meets Virtual Reality
- 1Applied Technology for Neuro-Psychology Lab, Istituto Auxologico Italiano, Milan, Italy
- 2Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy
- 3Faculty of Psychology, eCampus University, Novedrate, Italy
Elderly people affected by Mild Cognitive Impairment (MCI) usually report a perceived decline in cognitive functions that deeply impacts their quality of life. This subtle waning, although it cannot be diagnosable as dementia, is noted by caregivers on the basis of their relative’s behaviors. Crucially, if this condition is also not detected in time by clinicians, it can easily turn into dementia. Thus, early detection of MCI is strongly needed. Classical neuropsychological measures – underlying a categorical model of diagnosis - could be integrated with a dimensional assessment approach involving Virtual Reality (VR) and Artificial Intelligence (AI). VR can be used to create highly ecologically controlled simulations resembling the daily life contexts in which patients’ daily instrumental activities (IADL) usually take place. Clinicians can record patients’ kinematics, particularly gait, while performing IADL (Digital Biomarkers). Then, Artificial Intelligence employs Machine Learning (ML) to analyze them in combination with clinical and neuropsychological data. This integrated computational approach would enable the creation of a predictive model to identify specific patterns of cognitive and motor impairment in MCI. Therefore, this new dimensional cognitive-behavioral assessment would reveal elderly people’s neural alterations and impaired cognitive functions, typical of MCI and dementia, even in early stages for more time-sensitive interventions.
A categorical approach to diagnosing dementia struggles to capture subclinical conditions, such as Mild Cognitive Impairment (MCI). Crucially, MCI can either revert to normal cognition, stabilize, or slowly evolve toward other forms of dementia (Chiu, 2005; Walters, 2011; Morris, 2012; Díaz-Mardomingo et al., 2017; Vanacore et al., 2017). This construct indicates people affected by an in-between condition between normal aging and early dementia (Petersen, 2004; Albert et al., 2011; Mckhann et al., 2011; Seo et al., 2017) and is usually segmented into single- or multiple-domain amnestic (aMCI) and non-amnestic (naMCI) subtypes, depending on whether impairments concern only memory or other cognitive functions, e.g., executive and visuo-spatial abilities (Petersen, 2004; Apostolova and Cummings, 2008; Albert et al., 2011; Hughes et al., 2011; Michaud et al., 2017; Facal et al., 2019). Both patients and their caregivers can observe and report clear signals of this subtle waning, undiagnosable as dementia. Frequently, elderly people express concern over their perceived worsening in one or more cognitive domains, such as memory or language (Petersen et al., 1999, 2018). This waning has a great impact on their quality of life, reducing their ability to autonomously carry out activities. A key aspect concerns the possibility of detecting an initial cognitive decline at the behavioral level with a slowdown in execution of the instrumental activities of daily life (IADL), such as grocery shopping and medication and financial management (Kim and Kim, 2009; Gold and Gold, 2012).
Changes associated with subclinical forms of dementia manifest themselves through behavioral alterations. Usually, caregivers are the first ones to notice these altered behaviors, as shown by Van Vliet et al. (2011). The authors explored the barriers hindering a timely diagnosis of dementia, focusing on interviews conducted with caregivers of relatives that were later diagnosed with early-onset dementia (EOD). Caregivers frequently reported behavioral changes in relatives with EOD, either alone or associated with neuropsychiatric symptoms (NPS), such as apathy or depression, and personality changes. Behavioral impairment then evolved toward a decline in IADL and involved cognitive impairment, particularly memory loss (Van Vliet et al., 2011). The broader detrimental impact of behavioral changes generated familial/marital conflicts and reduced job productivity, leading to a decreased income or even dismissal (Van Vliet et al., 2011). Though valuable, this anecdotal information rarely becomes part of a (categorical) diagnosis based on medical and neuropsychological assessment. Over time, caregivers have been considered a source of information that is not always reliable, given their tendency to over- or under-estimate elderly people’s deficits, possibly due to knowledge gaps (Akl et al., 2015; Jekel et al., 2015). Caregivers might be absent or suffer from physical or psychological conditions exacerbated by their relative’s worsening (Okonkwo et al., 2008; Van Vliet et al., 2011; Pfeifer et al., 2013; Akl et al., 2015; Jekel et al., 2015). They might explain the elderly person’s decline and behavioral, cognitive, and personality changes rather as a result of aging. Sometimes, caregivers are not aware of the symptoms because of their relative’s ability to cover them up, denying their impairments or developing subsequent compensatory strategies to disguise the difficulties. This, in turn, delays the consultation of a practitioner and the diagnostic process as well (Okonkwo et al., 2008; Van Vliet et al., 2011; Roehr et al., 2019). Early detection of MCI, resulting in time-sensitive interventions, is still an open issue.
In this regard, two components appear relevant. Firstly, there is a need to rely more on rigorous and systematic behavioral analysis for early detection of MCI. Secondly, there is a need to integrate this new practice into current ones, i.e., neuropsychological evaluation. Including these data jointly in MCI assessment can allow a more sensitive measurement of the deficit by placing it on a continuum, reflecting a dimensional approach accounting for several other subclinical conditions, including Subjective Cognitive Decline (SCD; Roehr et al., 2019) or Pre-Mild Cognitive Impairment (Pre-MCI; Crocco et al., 2018; Grassi et al., 2018).
This is far more crucial when considering that MCI can turn into dementia if the elderly person does not receive a timely diagnosis (Chiu, 2005), which should be built upon finer discrimination among the early stages of MCI and the collection of behavioral data, moving beyond a categorical, dichotomous approach rooted in previous diagnostic models, such as DSM-IV-TR or ICD-10 (American Psychiatric Association, 2000; World Health Organization, 2007; Negu et al., 2016), and the distinction between aMCI and naMCI.
The exclusive implementation of neuropsychological assessment tools cannot provide information on the finer behavioral aspects of the early stages of MCI and, despite their widespread use and efficacy, they fail to predict an individual’s behavior in real life, and there is a need to improve their ecological validity, sensitivity, and specificity (Rizzo et al., 2004; Negu et al., 2016; Plancher and Piolino, 2017; Kim et al., 2019). The available objective methods for assessing MCI are frequently based on informant-reports or conducted in isolated and artificial situations, thus opening the possibility for evaluation biases. A resounding change might be fostered by a novel approach assembling in new ways existing technologies and data analysis methodologies that allow a refined assessment and the creation of a continuum for MCI following a dimensional approach. These technologies aim to integrate rather than replace existing neuropsychological evaluation or caregiver/informant reports in order to obtain a more complete and dynamic picture of the strengths and critical aspects of the elderly person as they evolve over time.
This perspective aims to propose the development of a new integrated, multimethod, dimensional approach for early detection of MCI on the basis of behavioral data that incorporates existing, consolidated technologies, such as gait kinematic analysis, Virtual Reality (VR), and Machine Learning (ML), in the conventional assessment of MCI. The outcome would be a finer, continuous, time-sensitive assessment of MCI, in line with a dimensional approach compliant with new DSM-5 guidelines (American Psychiatric Association, 2013). Moreover, it would draw on recent empirical evidence and scientific groundwork, helping the clinician to tailor the rehabilitation to the needs of the individual. This positive contribution would improve their quality of life, decreasing both health care assistance costs and hospitalization rates, thus opening up new possibilities for primary and secondary prevention. Moreover, it would facilitate the communication between practitioners and researchers, providing a solid foundation and fostering mutual exchange.
A New Integrated Approach to MCI Assessment
We suggest that Virtual Reality would provide the most suitable context (i.e., answering the question Where?) for the assessment of key behavioral variables indicating MCI onset (i.e., What?), which can be analyzed in a systematic and accurate way in relation to neuropsychological and clinical data by means of Machine Learning (ML) (i.e., How?). We expand on all of these aspects in the following sections.
“Where” Does the Assessment Take Place? Virtual Reality
Usually, the assessment of cognitive functions does not take place in daily-life contexts, potentially hindering an ecological evaluation of the individual’s impairment (Rizzo et al., 2004; de los Reyes-Guzmán et al., 2014). A promising integration of conventional practices could rely on novel dimensional assessment techniques, based on realistic immersive simulations of daily situations, e.g., Virtual Reality (VR) – a 3D computer-generated environment with some degree of immersion and interactivity, along with a sense of being really present in it (Riva and Mantovani, 2014; Riva et al., 2018, 2019a; Moreno et al., 2019). VR has developed into a key technology that is able to resemble even complex daily situations and interactions in a safe and controlled setting, due to the feeling of immersion (i.e., the number of senses stimulated within the environment, together with the closeness of the stimuli employed in simulations to reality) (Slater, 2009; Plancher and Piolino, 2017; Cipresso, 2018), the sense of presence within the environment (i.e., the feeling of being really “there” in the simulated environment, along with the ability to realize our intentions within it), and the possibility to interact with objects (Biocca, 1997; Heeter, 2000; Bailenson et al., 2006; Sundar et al., 2010; Negu et al., 2016; Plancher and Piolino, 2017; Cipresso, 2018; Kim et al., 2019). Depending on the degree of immersion of the system employed, VR allows a realistic experience through the use of multi-sensorial displays (i.e., visual, auditory) along with tracking devices that detect any movement of the individual and deliver the recorded data to the visualization system for a real-time update of the virtual environment (Chirico et al., 2016; Plancher and Piolino, 2017; Cipresso, 2018). The most immersive 3D VR environments can provide a high sense of presence also by isolating individuals, facilitating natural interactions and exchanges that resemble equivalent ones in daily life (Gold and Gold, 2012; Allain et al., 2014; Riva and Mantovani, 2014; Chirico et al., 2016; Riva et al., 2018).
The main features of VR allow the creation of ecological, safe, standardized settings and exert a strict experimental control over stimulus delivery and measurement (Rizzo et al., 2004; Gold and Gold, 2012; Allain et al., 2014; Negu et al., 2016; Plancher and Piolino, 2017). This, in turn, has supported its deployment for both clinical and non-clinical samples of elderly people and young adults (García-Betances et al., 2015; De Tommaso et al., 2016; Plancher and Piolino, 2017). Within medical and neuropsychological settings, VR has been extensively applied as an assessment and a rehabilitation tool for elderly people suffering from consequences of a traumatic brain injury (Aida et al., 2018; Alashram et al., 2019; Maggio et al., 2019), for post-stroke patients (Henderson et al., 2007; Saposnik and Levin, 2011; Laver et al., 2017), and for spatial memory and balance (Allain et al., 2014; Serino et al., 2017; Gerber et al., 2018; Soares et al., 2018), among other applications (see Plancher and Piolino, 2017; Moreno et al., 2019). Crucially, VR allows the therapy to be tailored in a controlled way, according to each disease starting from a continuous assessment of the individual’s behaviors. Only recently, VR has been employed to assess IADL in MCI patients while including kinematic measures that integrate a neuropsychological evaluation (Seo et al., 2017). As previously mentioned, an initial cognitive decline can be behaviorally manifested by a slowdown in the execution of IADL (Kim and Kim, 2009; Millán-Calenti et al., 2010; Gold and Gold, 2012), which implies a neurological and cognitive alteration that is partially reflected in indexes such as bodily movements or gait. Previous studies have examined these behavioral alterations of IADL in order to refine MCI assessment and have already delivered promising results (Schröter et al., 2003; Montero-Odasso et al., 2009; de los Reyes-Guzmán et al., 2014). Motion detectors, applied to the elderly person’s leg joints allow gait kinematics and their impairments to be tracked during the performance of IADL within a VR environment. This could consolidate preliminary findings of specific motor alterations that integrate neuropsychological and cognitive evaluation to identify MCI. In this perspective, the preliminary work of Seo et al. (2017) is the closest application of the technologies proposed to refine MCI assessment, although gait analysis was not included. The recording of kinematic measures from the performance of IADL within an immersive VR environment potentially adds more discriminative value in distinguishing MCI individuals from the healthy control group (Seo et al., 2017). Including an evaluation where the elderly person him/herself performs IADL might be essential for establishing more precise criteria (Díaz-Mardomingo et al., 2017; Seo et al., 2017). Several authors have tried to refine early MCI detection by combining two out of the three variables considered in this paper: either behavioral alteration (IADL, gait) within a VR environment (Lee et al., 2003; Seo et al., 2017; Kim et al., 2019; Eraslan Boz et al., 2019), gait kinematics extracted and analyzed by means of ML, which will be discussed further (Begg and Kamruzzaman, 2005; Pogorelc et al., 2012; Zhang and Wang, 2012; Eskofier et al., 2013; Akl et al., 2015; Costa et al., 2016; Mannini et al., 2016; Caldas et al., 2017; Farah et al., 2017; Ur Rehman et al., 2019), or ML techniques for predicting MCI evolution (Filipovych and Davatzikos, 2011; Williams and Weakley, 2013; Moradi et al., 2014, 2015; Bratić et al., 2018; Grassi et al., 2018, 2019; Graham et al., 2020). Thus, to our best knowledge, this is the first paper proposing an integration of VR, gait kinematics, and ML in order to refine early detection of MCI following a dimensional approach in line with the most recent diagnostic systems and possibly providing information on disease progression. However relevant, traditional neuropsychological assessment does not provide this extent of information and could serve as a starting point that should be integrated with further information in order to detect a subclinical condition otherwise undiagnosable following a categorical approach. Crucially, some anecdotal evidence and more systematic but scattered evidence from kinematic analysis of specific movements (i.e., What?) suggest the feasibility and the relevance of an approach based on assessment of behavioral variables for early detection of MCI. We present preliminary evidence in this regard in the following.
“What” Variables Are Included in the Assessment? Gait Kinematics
Is it possible to give relevance to behavioral data reported by the caregivers, relying on the anecdotal description of the elderly person’s daily functioning and their IADL performance, in a scientific and rigorous manner?
A potential solution is to analyze the elderly individual’s movements (kinematics) while performing IADL. Kinematic analysis automatically records movements in a controlled setting and assesses the underlying cognitive impairment. Preliminary studies proved the feasibility of tracking the elderly person’s head, dominant hand, or gait during the performance of IADL to refine the assessment of MCI and other cognitive conditions (Schröter et al., 2003; de los Reyes-Guzmán et al., 2014; Akl et al., 2015; Seo et al., 2017). Among these indexes, gait kinematic analysis has progressively received more attention, despite the paucity of MCI-focused studies. The work of Martín-Gonzalo et al. (2019) thoroughly explains the contribution of considering gait alterations, beginning in early cognitive decline, to an improved understanding of neurocognitive disorders. In fact, gait kinematics are strongly related to neurophysiological alterations (Persad et al., 2008; Maquet et al., 2010; Martín-Gonzalo et al., 2019), brain volume changes in specific areas (Tian et al., 2017; Allali et al., 2019; Martín-Gonzalo et al., 2019), and subsequent cognitive decline, predicting future risks of impairment (Martín-Gonzalo et al., 2019). Kinematics assesses the sequential configuration of the leg joints required to maintain the body’s center of gravity above the stance base while a person is moving forward. Compared to healthy subjects, the gait of a person suffering from MCI shows decreased velocity, longer stride time, increased stride-to-stride variability (Hausdorff, 2007; Bahureksa et al., 2017; Byun et al., 2018; Martín-Gonzalo et al., 2019), and spatiotemporal complexity (Ihlen et al., 2016; Martín-Gonzalo et al., 2019).
A gait cycle is defined by ongoing changes in the sequential configurations of the joints allowed by muscle activation, which is controlled by neural mechanisms depending on the integrity of somatosensory, motor, and cognitive integration cerebral networks (Perry and Burnfield, 2010; Caldas et al., 2017; Costilla-Reyes et al., 2020). Successful locomotion is indeed a dual task requiring the ability to simultaneously perform a cognitive task that could interfere with gait performance, particularly in elderly people (Pedroli et al., 2018; Costilla-Reyes et al., 2020). A decrease in attentional and executive functioning is physiological in aging and could impact this simultaneous execution (Hsu et al., 2012; Montero-Odasso et al., 2012; Wang et al., 2015; Gwak et al., 2018; Pedroli et al., 2018). In order to maintain walking capacity, damage to cerebral networks involved in gait leads to an adaptation of the nervous system, generating new signals reflecting the damage. Brain signals to the muscles controlling joint movement may become discontinuous and uncoordinated: this generates noise that could be consequent to the failure of some neuronal networks and produces configurations that respond to intentional cognitive directives, such as changing gait pace, little or not at all (Martín-Gonzalo et al., 2019). Indeed, kinematic data provide additional, crucial information that increases the sensitivity and specificity of MCI assessment. Paper-and-pencil neuropsychological tests are not suitable for the detection of gait features and its alterations, which appear relevant for more precise identification of MCI individuals.
To date, gait analysis has been studied within a context with little ecological validity: the walking task is generally an end in itself and is not recorded while the subject is completing a complex activity. Even the extraction of gait kinematics from videos or home-based motion sensors could provide only partial, bi-dimensional information or could be less sensitive in detecting real-time movement adjustment (Akl et al., 2015; Prakash et al., 2015; Neverova, 2016). The use of VR enables continuous, tridimensional tracking of the ongoing events within a highly immersive, safe, and standardized environment, enhancing the methodological strength of the procedure as well.
This introduces the need for a highly ecological and immersive context that allows the elderly person’s kinematics while performing IADL to be observed and detected. A plausible solution comes from the implementation of Virtual Reality (VR), as shown in Figure 1 (Pedroli et al., 2018). The technological equipment illustrated in Figure 1 is a four-walled Cave Automated Virtual Environment (CAVE), available at Istituto Auxologico Italiano, which is routinely used for cognitive and motor rehabilitation of elderly people. This highly immersive technology is equipped with eight (4 × 2) Vicon Bonita 10 cameras (Opti-Tracking system, 1MP) and different Hi-res Hi-FOV head-tracked 3D HMDs and also with a wide range of physiological and motion measures for quantifying embodiment in VR and movements within the environment. A virtual representation of, e.g., a city or a supermarket can be projected on the four walls, and subjects can actively navigate and interact with the environment. This setting was used by Seo et al. (2017), which, as previously mentioned, is the most similar procedure to the one that we propose.
Figure 1. Subject’s kinematic measures (gait) detected within a VR environment (CAVE) while performing instrumental activities of daily life (IADL) in order to refine MCI assessment by following a dimensional approach.
For the aims of this perspective, the most important feature of VR is its ability to detect both real-time behaviors (e.g., specific bodily movements such as those of the head and upper limbs and gait) and physiological indexes (e.g., skin conductance, heart rate). The great amount of data collected with VR and kinematics implies the need for a computational method of analysis that is able to extract meaning from a large amount of data. Thus, Machine Learning appears to be a viable solution, as shown by previous research employing this technique to discriminate between normal and pathological gait alteration and for diagnostic purposes as well (Pogorelc et al., 2012; Zhang and Wang, 2012; Eskofier et al., 2013; Costa et al., 2016; Mannini et al., 2016; Caldas et al., 2017; Farah et al., 2017; Ur Rehman et al., 2019).
“How” to Analyze Them? Machine Learning
The massive amount of kinematic information extrapolated from motion detectors, complemented by neuropsychological and neuropsychiatric symptoms and signs, needs a similarly powerful technology in order to process it and convert it into an output intelligible for both clinicians and patients. The employment of kinematic measures and VR within a healthcare setting, i.e., a hospital, inevitably involves the use of a large amount of electronic health records (EHR) of patients’ evolution over time. Despite the challenges related to the use of EHRs, several prediction algorithms and models have been developed from their use (Häyrinen et al., 2008; Miotto et al., 2016, 2017; Goldstein et al., 2017; Graham et al., 2020). Among other advantages, EHR-based predictors consider various metrics of multiple individuals, observed at different time points: this makes use of a higher frequency of data recording, facilitating the prediction of possible near-term evolution; they also reflect real life more closely than cohort studies (Goldstein et al., 2017).
The most suitable technique capable of administering a volume of complex and extensive information may be Machine Learning (ML). This scientific discipline stems from Artificial Intelligence (AI), i.e., a computer science field performing tasks capable of emulating human performance, generally learning to understand complex data, an endeavor that requires human intelligence (Bawack, 2019; Wang, 2019; Graham et al., 2020). ML algorithms have progressively gained popularity for several reasons, including their ability to automatically learn the inherent structure of a dataset (Kononenko, 2001; Abu-Mostafa et al., 2012; Facal et al., 2019) without requiring a priori hypotheses about relationships between variables (Miotto et al., 2017; Vieira et al., 2017; Graham et al., 2019, 2020). Conversely, ML algorithms can discover and predict data trends and patterns by building on existing information and highlight unexpected relationships between variables (Vieira et al., 2017; Graham et al., 2019, 2020). This “learning by processing” approach generates increasingly accurate predictive models and, so far, has demonstrated enormous potential for supporting individual prognosis, risk estimation, and classification learning for diagnosis (Lehmann et al., 2007; Patel et al., 2015; Vieira et al., 2017; Dwyer et al., 2018; Facal et al., 2019). Inevitably, ML techniques work with high-dimensional data, which require a pre-processing step to remove redundant information, reduce data dimensionality, and improve learning accuracy and data comprehensibility (Khalid et al., 2014). This can be achieved by means of (i) feature selection (i.e., the selection of the best and most optimal features from a larger set of those useful for discriminating between classes to increase accuracy and generalizability); and (ii) feature extraction or dimensionality reduction (i.e., the transformation of original features to generate other, more significant features and reduce complexity) by means of Principal Component Analysis (PCA) or Independent Component Analysis (ICA), among other approaches (Khalid et al., 2014; Dwyer et al., 2018). The application of ML for healthcare purposes has been further developed into two main sub-classes, supervised (SL) and unsupervised (UL) techniques. SL jointly employs pre-labeled data, e.g., MCI versus healthy subjects, and additional features derived from clinical or neuroimaging sources to determine which feature predicts the pre-labeled data the most (Dwyer et al., 2018; Graham et al., 2020). SL operates with probabilistic and non-probabilistic classifiers (Naïve Bayes and Support Vector Machine, respectively), as well as with decision tree, linear, and logistic regression (Dhall and Kaur, 2020). UL techniques, instead, sets unlabeled and unstructured data, e.g., clinical notes, as a starting point to seek relationships or patterns and to learn general representations that enable the automatic extraction of information when building predictors (Miotto et al., 2017; Dwyer et al., 2018; Graham et al., 2020). The algorithms employed by UL include K-means clustering, PCA, and Artificial Neural Networks (ANN) (Dhall and Kaur, 2020).
However, at the time of data collection, it is unclear whether MCI subjects will progress toward other forms of dementia (e.g., AD) or convert back to normal cognition, and this evolution could become more evident over the years. This challenges data labeling: thus, researchers tackling MCI detection have employed semi-supervised learning (SSL) techniques capable of combining labeled and unlabeled data to improve the classification procedure (Zhu, 2008; Filipovych and Davatzikos, 2011; Moradi et al., 2015; Dwyer et al., 2018; Van Engelen and Hoos, 2020). A semi-supervised approach, therefore, allows cases to be managed by providing only partial data labels (Filipovych and Davatzikos, 2011). Several studies have employed MCI data as unlabeled data and have shown an improvement in the predictive performance of the model (Batmanghelich et al., 2011; Filipovych and Davatzikos, 2011; Ye et al., 2011; Moradi et al., 2015): this approach could be particularly feasible for the purpose of the integrated dimensional approach offered in the present perspective.
The ability to process raw data, the need for manual engineering of features, and the extensive expertise needed to perform the analyses represent the main limitations of conventional (shallow) ML techniques (Lecun et al., 2015; Vieira et al., 2017; Zhang et al., 2020). This has led to the dissemination of deep learning (DL) algorithms, including Deep Neural Networks (DNN), Convolutional Neural Networks (CNN), and Recurrent Neural Networks (RNN) (Dhall and Kaur, 2020). DL outperforms ML in many ways, showing best-in-class performance and increased complexity in the computed function and addressing problems in multiple domains such as language and speech (Zhang et al., 2020). Moreover, it eliminates the need for manual feature engineering, reducing possible human biases and removing the need for advanced expertise (Zhang et al., 2020). DL is capable of learning data representation in an unprocessed or raw form, and its high performance and expressive power in one specific domain can be transferred to other contexts, providing a flexible adaptation to problems (Bengio, 2009; Lecun et al., 2015; Miotto et al., 2017; Vieira et al., 2017; Chauhan et al., 2019; Esteva et al., 2019; Costilla-Reyes et al., 2020; Zhang et al., 2020). Despite all the advantages, it is crucial to consider that DL techniques require very large datasets to perform, which may be too hard to achieve, expensive, or time-consuming to obtain; thus, ML may be more feasible and efficient (Zhang et al., 2020).
To date, advanced statistical ML and pattern recognition techniques have proved their usefulness in outlining neurodegenerative patterns of mild symptoms manifesting during the early stages of diseases, and MCI is no exception (Davatzikos et al., 2008, 2010; Vemuri et al., 2009; Wee et al., 2014). ML has been repeatedly applied to diagnostic transitions from MCI to other forms of dementia, e.g., AD, employing different types of information: mostly neuroimaging data (e.g., MRI, PET scan, Diffusion Tensor Imaging) (Batmanghelich et al., 2011; Filipovych and Davatzikos, 2011; Ye et al., 2011; Zhang and Shen, 2011, 2012; O’Dwyer et al., 2012; Shaffer et al., 2013; Moradi et al., 2015; Bratić et al., 2018), cerebrospinal fluid biomarkers (Davatzikos et al., 2010; Fjell et al., 2010; Zhang and Shen, 2011; Shaffer et al., 2013; Bratić et al., 2018), demographic and cognitive data (Moradi et al., 2015; Bratić et al., 2018), and gait kinematics (Mannini et al., 2016; Farah et al., 2017; Gwak et al., 2018). Broad variations in studies’ results have been reported, as has the lack of a gold-standard ML algorithm to predict disease progression (Grassi et al., 2018, 2019; Chiu et al., 2019; Facal et al., 2019; Mallo et al., 2019). Specifically, Grassi and colleagues (Grassi et al., 2018, 2019) have recently developed clinically translatable ML algorithms to identify which subjects with pre-MCI and MCI will convert to AD (Grassi et al., 2018, 2019). ML likewise appears promising for precision medicine: given the patients’ extreme heterogeneity of symptoms, medication response, and prognosis, the implementation of ML to create computational models of disease development tackles patients’ diverseness (Fisher et al., 2019). Over the years, researchers have devised a number of disease progression models for both MCI and AD, relying on clinical and imaging data (Mueller et al., 2005; Ito et al., 2011; Rogers et al., 2012; Moradi et al., 2015; Miotto et al., 2017; Samper-Gonzalez et al., 2017; Fisher et al., 2019). Previous applications of ML to clinical data have proven useful in predicting a single outcome (e.g., the likelihood of conversion from MCI to AD) (Fisher et al., 2019). From a clinical point of view, however, it would be important to predict the disease progression and trajectory for everyone, which is difficult with current data-driven modeling approaches.
In their latest work, Graham et al. (2020) support the employment of AI and ML for ranking those variables crucial for MCI assessment and cognitive impairment. The authors show that clinical and psychometric assessments appear promising for identifying individuals at high risk for cognitive impairment (Lins et al., 2017; Senanayake et al., 2017; Moreira and Namen, 2018), which could be better identified by means of brain imaging and neuropsychological data as well (Fan et al., 2018; Iizuka et al., 2019). Even more importantly, Graham et al. (2020) report on several studies employing novel techniques to detect cognitive impairment in MCI subjects as well, such as home-installed motion sensors (Akl et al., 2015) and multi-modal wearable activity devices (Gwak et al., 2018), therefore including behavioral data in ML analysis (Graham et al., 2020). However useful, for providing real-world behavioral data in an ecological context, the employment of motion sensors alone has shown substantial heterogeneity (Graham et al., 2020); therefore, VR appears a promising integrative solution achieved by simulating a supervised and controlled real-life-like environment.
Although both elderly people and caregivers notice and report their concerns regarding behavioral, personality, and cognitive changes, MCI is a subclinical condition that remains undiagnosed by an official categorical system while progressively compromising the independent functioning of the elderly person. Although a possible regression to normal cognition is desirable, more often, MCI evolves toward other forms of dementia. A delayed diagnosis entails the worsening of the individual’s conditions, greatly reducing the extent of possible interventions and making primary and secondary prevention essential (Van Vliet et al., 2011; Jekel et al., 2015; Roehr et al., 2019). However, MCI assessment should necessarily move beyond a stringent categorical approach in favor of a dimensional one able to include finer discrimination among early stages of MCI, thus reflecting the complexity of this construct. So far, its assessment has followed a dichotomous view, relying on neuropsychological instruments to test MCI’s presence or absence. Despite their proven efficacy, a dimensional approach would integrate them by implementing existing technologies and data analysis methodologies, placing MCI on a continuum. With this in mind, this perspective aimed primarily to move forward, proposing a novel assessment that could enable a more accurate prevision of the trajectory of MCI decline, employing Virtual Reality (VR) for a continuous dimensional assessment of MCI behaviors in ecological and realistic tailored, safe, and controlled simulated contexts.
Since the individual’s altered behavior reflects impaired cognition (Martín-Gonzalo et al., 2019), this proposal would allow early detection of MCI, enabling timely rehabilitative interventions. Specifically, gait kinematics is a behavioral index whose analysis has proved sensitive to cerebral and cognitive alterations capable of discerning patients with cognitive decline from healthy individuals (Martín-Gonzalo et al., 2019). Nevertheless, few studies have specifically employed gait measurement as a possible marker to refine MCI assessment, and even then mainly in unfamiliar contexts, thus hindering ecological validity (Jekel et al., 2015; Seo et al., 2017). So far, MCI assessment has relied on neuropsychological measures rather than behavioral ones, despite the importance of the latter in revealing initial cognitive decline. When available, these behavioral data are generally based on informant-report questionnaires or reported as anecdotal information lacking scientific rigor (Van Vliet et al., 2011; de los Reyes-Guzmán et al., 2014; Kim et al., 2019). Behavioral data appear to provide a relevant contribution to MCI assessment: further research should deepen and consolidate the preliminary, promising evidence reported (Seo et al., 2017; Martín-Gonzalo et al., 2019).
It appears evident that a mere conventional neuropsychological assessment, however relevant, cannot provide such a high degree of information, giving rise to the necessity of integrating paper-and-pencil instruments and anecdotal evidence with behavioral alterations evaluated within a highly ecological and standardized setting, such as VR. A plausible, practical implementation of the approach could be structured as follows. During a first brief clinical interview, the practitioner could collect anamnestic and quantitative information from (i) the elderly person, relying on neuropsychological/neuropsychiatric and cognitive measures as well; and (ii) the caregiver, which could fill in informant-report IADL measures. A second appointment would be dedicated to VR-based assessment: the elderly person could perform IADL (e.g., money withdrawal, grocery shopping) within the CAVE virtual environment, while kinematic information of their performance would be simultaneously collected. These data could be provided by kinematics motion detectors placed on the individual’s joints, as illustrated in Figure 1. The entire VR-kinematic assessment would last a maximum of 20 min to possibly avoid cybersickness, i.e., a form of motion sickness that includes nausea, headaches, and disorientation, among other symptoms (Laviola, 2000; Davis et al., 2014). Cybersickness is a common side effect of VR and could interfere with the completion of quantitative measures: thus, whenever it is necessary to complete paper-and-pencil assessment in the second appointment, this should be done before the VR procedure starts. VR would allow the clinician to closely observe the real life-like behavior of the individual and employ motion detectors, which extrapolate a large amount of data computed by means of Artificial Intelligence (AI) and, specifically, Machine Learning (ML). As mentioned in the ML section, recently developed, clinically translatable ML algorithms could help to identify MCI subjects who will convert to AD (Grassi et al., 2018, 2019). Thus, these algorithms could be tested and implemented in the assessment procedure illustrated in the previous section after collecting data from both the quantitative evaluation and the VR procedure within the CAVE. This could generate an accurate, predictive model proposing a gradient of behavioral and cognitive decline: a subclinical condition such as MCI could not be detected promptly by a categorical approach. A schematic illustration of this model is depicted in Figure 2.
The first and foremost added value of this approach lies in moving one step forward toward refined MCI early detection by integrating (i) behavioral (gait kinematics, IADL), neuropsychological/neuropsychiatric and cognitive information; (ii) a highly ecological and standardized setting, such as VR; and (iii) a powerful method capable of analyzing an extensive amount of data and predicting MCI progression over time. This is the first dimensional approach jointly considering all of the mentioned sources of information, whether previous studies considered only two out of three variables at the same time. The main focus is the relevance of building an innovative assessment procedure that is data-fusion-based and capable of identifying a subclinical condition that is otherwise undetected. Many ML and DL algorithms exist to analyze the extensive amount of data collected and, except for some that were recently tested (Grassi et al., 2018, 2019), there is no consensus regarding a gold-standard algorithm to predicting MCI diagnostic transition. Moreover, several open-source libraries for ML can provide information regarding the most feasible programming language (e.g., Python) and algorithms to use (Rathi, 2019).
We are aware that the integration of kinematic analysis, VR, and ML, could be very expensive and may not be available in a clinical setting, such as in a hospital. In addition, there may be risk of initial acceptance resistance by elderly individuals and healthcare providers due to the novelty of the equipment. However, the implementation of this approach would offer a crucial benefit by enabling the dimensional assessment of a subclinical condition otherwise undiagnosable, and the trained models, enriched by data of numerous patients, would easily overcome the initial expense. Moreover, a hospital would be the only setting where biological and neuroimaging data (e.g., MRI, PET scan, cerebrospinal fluid biomarkers) can be collected. Although the method proposed, so far, does not include them, these types of information could eventually be added to ML analyses, since they have been previously indicated as plausible contributors to MCI assessment (Fjell et al., 2010; Batmanghelich et al., 2011; Filipovych and Davatzikos, 2011; Ye et al., 2011; Zhang and Shen, 2011, 2012; O’Dwyer et al., 2012; Shaffer et al., 2013; Moradi et al., 2015; Bratić et al., 2018; Chiu et al., 2019). The employment of ML and DL methods usually requires a large sample size, which may not always be feasible in the healthcare setting. However, this limitation could be settled by developing multi-centric studies, providing an adequate sample size of patients and sharing data (Vieira et al., 2017). The dimensional approach also needs to be applied carefully in order to avoid hypervigilance for the slightest cognitive and behavioral age-related alteration, which might lead to excessive diagnosis and false-positives (Vanacore et al., 2017). Diagnosis communication must be carefully handled, given the potential harm of anxiety about a condition that may not progress (Chiu, 2005; Díaz-Mardomingo et al., 2017; Vanacore et al., 2017) prognostic possibilities can be discussed and planned accordingly. Strengthening or rehabilitative interventions could foster regression to normal cognition or decelerate the progression toward other clinical conditions.
In summary, while the majority of the literature has studied the application of several combinations of VR, gait kinematic analysis, and ML, this is the first paper to integrate all of these three methods and techniques in order to refine early detection of MCI and possibly predict its evolution over time. VR allows the collection of “Digital Biomarkers” – physiological/behavioral data - by means of digital technologies, used as an indicator of biologic processes or responses to therapeutic interventions (Coravos et al., 2019) directly connected to brain functioning. On the other side, AI, by applying ML techniques to the individual’s digital biomarkers, allows the creation of a predictive model – following a dimensional approach to MCI – able to identify specific behavioral cognitive patterns within an ecological and safe environment, for accurate early detection of MCI and its potential evolutionary trajectory (Riva et al., 2019b).
SC, AC, and PC developed the new model integrating gait kinematics, Virtual Reality, and Machine Learning. PC and GR supervised the sections of Virtual Reality and Machine Learning. EP supervised the section regarding MCI. SC wrote the manuscript under the final supervision of AC, EP, GR, and PC. All authors have approved the final version of the manuscript.
This research was funded by “Future Home for Future Communities” (“Accordo Quadro di Collaborazione tra Regione Lombardia e Consiglio Nazionale delle Ricerche” – Convenzione Operativa n 19365/RCC) and by the Italian Ministry of Health research project “High-End and Low-End Virtual Reality Systems for the Rehabilitation of Frailty in the Elderly” (PE-2013-0235594).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Alashram, A. R., Annino, G., Padua, E., Romagnoli, C., and Mercuri, N. B. (2019). Cognitive rehabilitation post traumatic brain injury: a systematic review for emerging use of virtual reality technology. J. Clin. Neurosci. 66, 209–219. doi: 10.1016/j.jocn.2019.04.026
Albert, M. S., DeKosky, S. T., Dickson, D., Dubois, B., Feldman, H. H., Fox, N. C., et al. (2011). The diagnosis of mild cognitive impairment due to Alzheimer ’s disease: Recommendations from the National Institute on Aging-Alzheimer ’s Association workgroups on diagnostic guidelines for Alzheimer ’s disease. Alzheimers Dement 7, 270–279. doi: 10.1016/j.jalz.2011.03.008
Allain, P., Foloppe, D. A., Besnard, J., Yamaguchi, T., Etcharry-Bouyx, F., Le Gall, D., et al. (2014). Detecting everyday action deficits in Alzheimer’s disease using a nonimmersive virtual reality kitchen. J. Int. Neuropsychol. Soc. 20, 468–477. doi: 10.1017/S1355617714000344
Allali, G., Montembeault, M., Saj, A., Wong, C. H., Cooper-Brown, L. A., Bherer, L., et al. (2019). Structural brain volume covariance associated with gait speed in patients with amnestic and non-amnestic mild cognitive impairment: a double dissociation. J. Alzheimers Dis. 71, S29–S39. doi: 10.3233/JAD-190038
Apostolova, L. G., and Cummings, L. (2008). Neuropsychiatric manifestations in mild cognitive impairment: a systematic review of the literature. Dement Geriatr. Cogn. Disord. 25, 115–126. doi: 10.1159/000112509
Bahureksa, L., Najafi, B., Saleh, A., Sabbagh, M., Coon, D., Mohler, M. J., et al. (2017). The impact of Mild Cognitive Impairment on gait and balance: a systematic review and meta-analysis of studies using instrumented assessment. Gerontology 63, 67–83. doi: 10.1159/000445831
Bailenson, J. N., Yee, N., Merget, D., and Schroeder, R. (2006). The effect of behavioral realism and form realism of real-time avatar faces on verbal disclosure, nonverbal disclosure, emotion recognition, and copresence in dyadic interaction. Presence 15, 359–372. doi: 10.1162/pres.15.4.359
Batmanghelich, K. N., Ye, D. H., Pohl, K. M., Taskar, B., and Davatzikos, C. (2011). “Disease classification and prediction via semi-supervised dimensionality reduction,” in Proceedings of the International Symposium on Biomedical Imaging, Chicago, IL, doi: 10.1109/ISBI.2011.5872590
Begg, R., and Kamruzzaman, J. (2005). A machine learning approach for automated recognition of movement patterns using basic, kinetic and kinematic gait data. J. Biomech. 38, 401–408. doi: 10.1016/j.jbiomech.2004.05.002
Bratić, B., Kurbalija, V., Ivanović, M., Oder, I., and Bosnić, Z. (2018). Machine learning for predicting cognitive diseases: methods, data sources and risk factors. J. Med. Syst. 42:243. doi: 10.1007/s10916-018-1071-x
Byun, S., Han, J. W., Kim, T. H., Kim, K., Kim, T. H., Park, J. Y., et al. (2018). Variability can predict the risk of cognitive decline in cognitively normal older people. Dement. Geriatr. Cogn. Disord. 45, 251–261. doi: 10.1159/000489927
Caldas, R., Mundt, M., Potthast, W., Buarque de Lima, N. F., and Markert, B. (2017). A systematic review of gait analysis methods based on inertial sensors and adaptive algorithms. Gait Posture 57, 204–210. doi: 10.1016/j.gaitpost.2017.06.019
Chauhan, S., Vig, L., De Filippo De Grazia, M., Corbetta, M., Ahmad, S., and Zorzi, M. (2019). A comparison of shallow and deep learning methods for predicting cognitive performance of stroke patients from mri lesion images. Front. Neuroinform. 13:53. doi: 10.3389/fninf.2019.00053
Chiu, P., Tang, H., Wei, C., Zhang, C., and Hung, G. (2019). NMD-12: a new machine-learning derived screening instrument to detect mild cognitive impairment and dementia. PLoS One 14:e0213430. doi: 10.1371/journal.pone.0213430
Costa, L., Gago, M. F., Yelshyna, D., Ferreira, F., Silva, H. D., Rocha, L. A., et al. (2016). Application of machine learning in postural control kinematics for the diagnosis of Alzheimer’s Disease. Comput. Intell. Neurosci. 2016, 1–2. doi: 10.1155/2016/3891253
Costilla-Reyes, O., Vera-Rodriguez, R., Alharthi, A. S., Yunas, S. U., and Ozanyan, K. B. (2020). “Deep learning in gait analysis for security and healthcare,” in Deep Learning: Algorithms and Applications. Studies in Computational Intelligence, eds W. Pedrycz and S. M. Chen (Cham: Springer), 865. doi: 10.1007/978-3-030-31760-7_10
Crocco, E. A., Loewenstein, D. A., Curiel, R. E., Alperin, N., Czaja, S. J., and Harvey, P. D. (2018). A novel cognitive assessment paradigm to detect Pre-mild cognitive impairment (PreMCI) and the relationship to biological markers of Alzheimer’s disease. J. Psychiatr. Res. 96, 33–38. doi: 10.1016/j.jpsychires.2017.08.015.A
Davatzikos, C., Bhatt, P., Shaw, L. M., Batmanghelich, K. N., and Trojanowski, J. Q. (2010). Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification. Neurobiol. Aging 32, e19–e27. doi: 10.1016/j.neurobiolaging.2010.05.023
Davatzikos, C., Fan, Y., Wu, X., Shen, D., and Resnick, S. M. (2008). Detection of prodromal Alzheimer’s disease via pattern classification of magnetic resonance imaging. Neurobiol. Aging 29, 514–523. doi: 10.1016/j.neurobiolaging.2006.11.010
de los Reyes-Guzmán, A., Dimbwadyo-Terrer, I., Trincado-Alonso, F., Monasterio-Huelin, F., Torricelli, D., and Gil-Agudo, A. (2014). Quantitative assessment based on kinematic measures of functional impairments during upper extremity movements: a review. Clin. Biomech. 29, 719–727. doi: 10.1016/j.clinbiomech.2014.06.013
De Tommaso, M., Ricci, K., Delussi, M., Montemurno, A., Vecchio, E., Brunetti, A., et al. (2016). Testing a novel method for improving wayfinding by means of a P3b virtual reality visual paradigm in normal aging. Springerplus 5:1297. doi: 10.1186/s40064-016-2978-7
Dhall, D., and Kaur, R. J. M. (2020). “Machine learning: a review of the algorithms and its application,” in Proceedings of the ICRIC 2019. Lecture Notes in Electrical Engineering, Vol. 597, eds P. Singh, A. Kar, Y. Singh, and M. T. S. Kolekar (Cham: Springer), doi: 10.1007/978-3-030-29407-6_5
Díaz-Mardomingo, M., García-Herranz, S., Rodríguez-Fernández, R., Venero, C., and Peraita, H. (2017). Problems in classifying mild cognitive impairment (mci): one or multiple syndromes? Brain Sci. 7:111. doi: 10.3390/brainsci7090111
Dwyer, D. B., Falkai, P., and Koutsouleris, N. (2018). Machine learning approaches for clinical psychology and psychiatry. Annu. Rev. Clin. Psychol. 14, 91–118. doi: 10.1146/annurev-clinpsy-032816-045037
Eraslan Boz, H., Limoncu, H., Zygouris, S., Tsolaki, M., Giakoumis, D., Votis, K., et al. (2019). A new tool to assess amnestic mild cognitive impairment in Turkish older adults: virtual supermarket (VSM). Neuropsychol. Dev. Cogn. B Aging Neuropsychol. Cogn. 1–15. doi: 10.1080/13825585.2019.1663146
Eskofier, B. M., Federolf, P., Kugler, P. F., and Nigg, B. M. (2013). Marker-based classification of young-elderly gait pattern differences via direct PCA feature extraction and SVMs. Comput. Methods Biomech. Biomed. Engin. 16, 435–442. doi: 10.1080/10255842.2011.624515
Facal, D., Valladares−Rodriguez, S., Lojo−Seoane, C., Pereiro, A. X., Anido−Rifon, L., Juncos−Rabadán, O., et al. (2019). Machine learning approaches to studying the role of cognitive reserve in conversion from mild cognitive impairment to dementia. Int. J. Geriatr. Psychiatry 34, 941–949. doi: 10.1002/gps.5090
Fan, M., Yang, A. C., Fuh, J. L., and Chou, C. A. (2018). Topological pattern recognition of severe Alzheimer’s disease via regularized supervised learning of EEG complexity. Front. Neurosci. 12:685. doi: 10.3389/fnins.2018.00685
Farah, J. D., Baddour, N., and Lemaire, E. D. (2017). “Gait phase detection from thigh kinematics using machine learning techniques,” in Proceedings of the 2017 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Rochester, MN, 263–268. doi: 10.1109/MeMeA.2017.7985886
Filipovych, R., and Davatzikos, C. (2011). Semi-supervised pattern classification of medical images: Application to mild cognitive impairment (MCI). Neuroimage 1109–1119. doi: 10.1016/j.neuroimage.2010.12.066
Fisher, C. K., Smith, A. M., Walsh, J. R., Against, C., and Diseases, M. (2019). Machine learning for comprehensive forecasting of Alzheimer ’s Disease progression. Sci. Rep. 9:13622. doi: 10.1038/s41598-019-49656-2
Fjell, A. M., Walhovd, K. B., Fennema-Notestine, C., McEvoy, L. K., Hagler, D. J., Holland, D., et al. (2010). CSF biomarkers in prediction of cerebral and clinical change in Mild Cognitive Impairment and Alzheimer’s Disease. J. Neurosci. 30, 2088–2101. doi: 10.1523/JNEUROSCI.3785-09.2010
García-Betances, R. I., Jiménez-Mixco, V., Arredondo, M. T., and Cabrera-Umpiérrez, M. F. (2015). Using virtual reality for cognitive training of the elderly. Am. J. Alzheimers Dis. Dement. 30, 49–54. doi: 10.1177/1533317514545866
Gerber, S., Müri, R., Mosimann, U., Nef, T., and Urwyler, P. (2018). “Virtual reality for activities of daily living training in neurorehabilitation: a usability and feasibility study in healthy participants,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine 446 and Biology Society. IEEE Engineering in Medicine and Biology Society Conference, Piscataway, NJ: IEEE, 1–4. doi: 10.1109/EMBC.2018.8513003
Gold, D. A., and Gold, D. A. (2012). An examination of instrumental activities of daily living assessment in older adults and mild cognitive impairment. J. Clin. Exp. Neuropsychol. 34, 37–41. doi: 10.1080/13803395.2011.614598
Goldstein, B. A., Navar, A. M., Pencina, M. J., and Ioannidis, J. P. A. (2017). Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J. Am. Med. Informatics Assoc. 24, 198–208. doi: 10.1093/jamia/ocw042
Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H.-C., et al. (2019). Artificial intelligence for mental health and mental illnesses: an overview. Curr. Psychiatry Rep. 21:116. doi: 10.1007/s11920-019-1094-0
Graham, S. A., Leeabcd, E. E., Jesteabce, D. V., Pattenabc, R. V., Twamleyabcd, E. W., Nebekerbcf, C., et al. (2020). Artificial intlligence approaches to predicting and detecting cognitive decline in older adults: a conceptual review. Psychiatry Res. 284:112732. doi: 10.1016/j.psychres.2019.112732
Grassi, M., Perna, G., Caldirola, D., Schruers, K., Duara, R., and Loewenstein, D. A. (2018). A clinically-translatable machine learning algorithm for the prediction of Alzheimer’s disease conversion in individuals with mild and premild cognitive impairment. J. Alzheimers Dis. 61, 1555–1573. doi: 10.3233/JAD-170547
Grassi, M., Rouleaux, N., Caldirola, D., Loewenstein, D., Schruers, K., Perna, G., et al. (2019). A novel ensemble-based machine learning algorithm to predict the conversion from mild cognitive impairment to Alzheimer’s disease using socio-demographic characteristics, clinical information, and neuropsychological measures. Front. Neurol. 10:756. doi: 10.3389/fneur.2019.00756
Gwak, M., Sarrafzadeh, M., and Woo, E. (2018). Support for a clinical diagnosis of mild cognitive impairment using photoplethysmography and gait sensors. Proc. APSIPA Annu. Summit Conf. 2018, 671–678.
Häyrinen, K., Saranto, K., and Nykänen, P. (2008). Definition, structure, content, use and impacts of electronic health records: a review of the research literature. Int. J. Med. Inform. 77, 291–304. doi: 10.1016/j.ijmedinf.2007.09.001
Henderson, A., Korner-Bitensky, N., and Levin, M. (2007). Virtual reality in stroke rehabilitation: a systematic review of its effectiveness for upper limb motor recovery. Top. Stroke Rehabilit. 14, 52–56. doi: 10.1310/tsr1402-52
Hsu, C. L., Nagamatsu, L. S., Davis, J. C., and Liu-Ambrose, T. (2012). Examining the relationship between specific cognitive processes and falls risk in older adults: a systematic review. Osteoporos. Int. 23, 2409–2424. doi: 10.1007/s00198-012-1992-z
Ihlen, E. A., Weiss, A., Bourke, A., Helbostad, J. L., and Hausdorff, J. M. (2016). The complexity of daily life walking in older adult community-dwelling fallers and non-fallers. J. Biomech. 49, 1420–1428. doi: 10.1016/j.jbiomech.2016.02.055
Iizuka, T., Fukasawa, M., and Kameyama, M. (2019). Deep-learning-based imaging-classification identified cingulate island sign in dementia with Lewy bodies. Sci. Rep. 9:8944. doi: 10.1038/s41598-019-45415-5
Ito, K., Corrigan, B., Zhao, Q., French, J., Miller, R., Soares, H., et al. (2011). Disease progression model for cognitive deterioration from Alzheimer’s Disease Neuroimaging Initiative database. Alzheimers Dement 7, 151–160. doi: 10.1016/j.jalz.2010.03.018
Jekel, K., Damian, M., Wattmo, C., Hausner, L., Bullock, R., Connelly, P. J., et al. (2015). Mild cognitive impairment and deficits in instrumental activities of daily living: a systematic review. Alzheimers Res. Ther. 18:17. doi: 10.1186/s13195-015-0099-0
Khalid, S., Khalil, T., and Nasreen, S. (2014). “A survey of feature selection and feature extraction techniques in machine learning,” in Proceedings of the 2014 Science and Information Conference, SAI 2014, London, doi: 10.1109/SAI.2014.6918213
Kim, O., Pang, Y., and Kim, J. (2019). The effectiveness of virtual reality for people with mild cognitive impairment or dementia: a meta-analysis. BMC Psychiatry 19:219. doi: 10.1186/s12888-019-2180-x
Laver, K. E., Lange, B., George, S., Deutsch, J. E., Saposnik, G., Crotty, M., et al. (2017). Virtual reality for stroke rehabilitation. Cochr. Database Syst. Rev. 11:CD008349. doi: 10.1002/14651858.CD008349.pub4
Lee, J. H., Ku, J., Cho, W., Hahn, W. Y., Kim, Y., Lee, S.-M., et al. (2003). A virtual reality system for the assessment and rehabilitation of the activities of daily living. Cyberpsychol. Behav. 6, 383–388. doi: 10.1089/109493103322278763
Lehmann, C., Koenig, T., Jelic, V., Prichep, L., John, R. E., Wahlund, L. O., et al. (2007). Application and comparison of classification algorithms for recognition of Alzheimer’s disease in electrical brain activity (EEG). J. Neurosci. Methods 161, 342–350. doi: 10.1016/j.jneumeth.2006.10.023
Lins, A. J. C. C., Muniz, M. T. C., Garcia, A. N. M., Gomes, A. V., Cabral, R. M., and Bastos-Filho, C. J. A. (2017). Using artificial neural networks to select the parameters for the prognostic of mild cognitive impairment and dementia in elderly individuals. Comp. Methods Progr. Biomed. 2, 93–104. doi: 10.1016/j.cmpb.2017.09.013
Maggio, M. G., De Luca, R., Molonia, F., Porcari, B., Destro, M., Casella, C., et al. (2019). Cognitive rehabilitation in patients with traumatic brain injury: a narrative review on the emerging use of virtual reality. J. Clin. Neurosci. 61, 1–4. doi: 10.1016/j.jocn.2018.12.020
Mallo, S. C., Valladares-Rodriguez, S., Facal, D., Lojo-Seoane, C., Fernández-Iglesias, M. J., Pereiro, A. X., et al. (2019). Neuropsychiatric symptoms as predictors of conversion from MCI to dementia: a machine learning approach. Int. Psychogeriatr. 32, 381–392. doi: 10.1017/S1041610219001030
Mannini, A., Trojaniello, D., Cereatti, A., and Sabatini, A. M. (2016). A machine learning framework for gait classification using inertial sensors: application to elderly, post-stroke and huntington’s disease patients. Sens. (Switzerland) 16:134. doi: 10.3390/s16010134
Maquet, D., Lekeu, F., Warzee, E., Gillain, S., Wojtasik, V., Salmon, E., et al. (2010). Gait analysis in elderly adult patients with Mild Cognitive Impairment and patients with Mild Alzheimer’s disease: simple versus dual task: a preliminary report. Clin. Physiol. Funct. Imaging 30, 51–56. doi: 10.1111/j.1475-097X.2009.00903.x
Martín-Gonzalo, J. A., Pulido-Valdeolivas, I., Wang, Y., Wang, T., Chiclana-Actis, T., Algarra-Lucas, M. D. A., et al. (2019). Permutation entropy and irreversibility in gait kinematic time series from patients with mild cognitive decline and early Alzheimer’s dementia. Entropy 21:868. doi: 10.3390/e21090868
Mckhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R. Jr., Kawas, C. H., et al. (2011). The diagnosis of dementia due to Alzheimer ’s disease: recommendations from the National Institute on Aging-Alzheimer ’s Association workgroups on diagnostic guidelines for Alzheimer ’s disease. Alzheimers Dement 7, 263–269. doi: 10.1016/j.jalz.2011.03.005
Michaud, T. L., Su, D., Siahpush, M., and Murman, D. L. (2017). The risk of incident mild cognitive impairment and progression to dementia considering mild cognitive impairment subtypes. Dement. Geriatr. Cogn. Dis. Extra 7, 15–29. doi: 10.1159/000452486
Millán-Calenti, J. C., Tubío, J., Pita-Fernández, S., González-Abraldes, I., Lorenzo, T., Fernández-Arruty, T., et al. (2010). Prevalence of functional disability in activities of daily living (ADL), instrumental activities of daily living (IADL) and associated factors, as predictors of morbidity and mortality. Arch. Gerontol. Geriatr. 50, 306–310. doi: 10.1016/j.archger.2009.04.017
Miotto, R., Li, L., Kidd, B. A., and Dudley, J. T. (2016). Deep patient: an unsupervised representation to predict the future of patients from the electronic health records. Sci. Rep. 6:26094. doi: 10.1038/srep26094
Montero-Odasso, M., Casas, A., Hansen, K. T., Bilski, P., Gutmanis, I., Wells, J. L., et al. (2009). Quantitative gait analysis under dual-task in older people with mild cognitive impairment: a reliability study. J. Neuroeng. Rehabil. 6, 35. doi: 10.1186/1743-0003-6-35
Montero-Odasso, M., Verghese, J., Beauchet, O., and Hausdorff, J. M. (2012). Gait and cognition: a complementary approach to understanding brain function and the risk of falling. J. Am. Geriatr. Soc. 60, 2127–2136. doi: 10.1111/j.1532-5415.2012.04209.x
Moradi, E., Pepe, A., Gaser, C., Huttunen, H., and Tohka, J. (2015). Machine learning framework for early MRI-based Alzheimer’s conversion prediction in MCI subjects. Neuroimage 104, 398–412. doi: 10.1016/j.neuroimage.2014.10.002
Moradi, E., Tohka, J., and Gaser, C. (2014). “Semi-supervised learning in MCI-to-ad conversion prediction - When is unlabeled data useful?,” in Proceedings of the 2014 International Workshop on Pattern Recognition in Neuroimaging, Tubingen, doi: 10.1109/PRNI.2014.6858535
Moreira, L. B., and Namen, A. A. (2018). A hybrid data mining model for diagnosis of patients with clinical suspicion of dementia. Comput. Methods Programs Biomed. 165, 139–149. doi: 10.1016/j.cmpb.2018.08.016
Moreno, A., Wall, K. J., Thangavelu, K., Craven, L., Ward, E., and Dissanayaka, N. N. (2019). A systematic review of the use of virtual reality and its effects on cognition in individuals with neurocognitive disorders. Alzheimers Dement. Transl. Res. Clin. Interv. 5, 834–850. doi: 10.1016/j.trci.2019.09.016
Mueller, S. G., Weiner, M. W., Thal, L. J., Petersen, R. C., Jack, C. R., Jagust, W., et al. (2005). Ways toward an early diagnosis in Alzheimer ’s disease: The Alzheimer ’s Disease Neuroimaging Initiative (ADNI). Alzheimers Dement 1, 55–66. doi: 10.1016/j.jalz.2005.06.003
Negu, A., Matu, S. A., Sava, F. A., and David, D. (2016). Virtual reality measures in neuropsychological assessment: a meta-analytic review. Clin. Neuropsychol. 30, 165–184. doi: 10.1080/13854046.2016.1144793
O’Dwyer, L., Lamberton, F., Bokde, A. L. W., Ewers, M., Faluyi, Y. O., Tanner, C., et al. (2012). Using support vector machines with multiple indices of diffusion for automated classification of mild cognitive impairment. PLoS One 7:e32441. doi: 10.1371/journal.pone.0032441
Okonkwo, O. C., Wadley, V. G., Griffith, H. R., Belue, K., Lanza, S., Zamrini, E. Y., et al. (2008). Awareness of deficits in financial abilities in patients with Mild Cognitive Impairment: going beyond self-informant discrepancy. Am. J. Geriatr. Psychiatry 16, 650–659. doi: 10.1097/JGP.0b013e31817e8a9d
Patel, M. J., Andreescu, C., Price, J. C., Edelman, K. L., Reynolds, C. F., and Aizenstein, H. J. (2015). Machine learning approaches for integrating clinical and imaging features in late-life depression classification and response prediction. Int. J. Geriatr. Psychiatry 30, 1056–1067. doi: 10.1002/gps.4262
Pedroli, E., Greci, L., Colombo, D., Serino, S., Cipresso, P., Arlati, S., et al. (2018). Characteristics, usability, and users experience of a system combining cognitive and physical therapy in a virtual environment: positive bike. Sensors 18:2343. doi: 10.3390/s18072343
Persad, C. C., Jones, J. L., Ashton-Miller, J. A., Alexander, N. B., and Giordani, B. (2008). Executive function and gait in older adults with cognitive impairment. J. Gerontol. A. Biol. Sci. Med. Sci. 63, 1350–1355. doi: 10.1093/gerona/63.12.1350
Petersen, R. C., Lopez, O., Armstrong, M. J., and Getchius, T. S. D. (2018). Practice guideline update summary: mild cognitive impairment report of the guideline development, dissemination, and implementation. Neurology 90, 126–135. doi: 10.1212/WNL.0000000000004826
Petersen, R. C., Smith, G. E., Waring, S. C., Ivnik, R. J., Tangalos, E. G., and Kokmen, E. (1999). Mild Cognitive Impairment: clinical characterization and outcome. Arch. Neurol. 56, 303–308. doi: 10.1001/archneur.56.3.303
Pfeifer, L., Drobetz, R., Fankhauser, S., Mortby, M. E., Maercker, A., and Forstmeier, S. (2013). Caregiver rating bias in mild cognitive impairment and mild Alzheimer’s disease: Impact of caregiver burden and depression on dyadic rating discrepancy across domains. Int. Psychogeriatrics 25, 1345–1355. doi: 10.1017/S1041610213000562
Plancher, G., and Piolino, P. (2017). “Virtual Reality for assessment of episodic memory in normal and pathological aging,” in The Role of Technology in Clinical Neuropsychology, eds R. L. Kane and T. D. Parsons (Oxford: Oxford University Press).
Pogorelc, B., Bosnić, Z., and Gams, M. (2012). Automatic recognition of gait-related health problems in the elderly using machine learning. Multimed. Tools Appl. 58, 333–354. doi: 10.1007/s11042-011-0786-1
Prakash, C., Gupta, K., Mittal, A., Kumar, R., and Laxmi, V. (2015). Passive marker based optical system for gait kinematics for lower extremity. Proc. Comput. Sci. 45:116. doi: 10.1016/j.procs.2015.03.116
Rathi, S. (2019). Top 8 Python Libraries for Machine Learning & Artificial Intelligence. Available online at: https://hackernoon.com/top-8-python-libraries-for-machine-learning-and-artificial-intelligence-y08id3031 (accessed May 22, 2020).
Riva, G., and Mantovani, F. (2014). “Extending the self through the tools and the others: a general framework for presence and social presence in mediated interactions,” in Interacting with Presence: HCI and the Sense of Presence in Computer-Mediated Environments, eds G. Riva and J. Waterworth (Berlin: DeGruyter Open Ltd), 9–31 doi: 10.2478/9783110409697.1
Riva, G., Wiederhold, B. K., Chirico, A., Di Lernia, D., Mantovani, F., and Gaggioli, A. (2018). Brain and virtual reality: what do they have in common and how to exploit their potential. Annu. Rev. CyberTherapy Telemed. 16, 3–7.
Riva, G., Wiederhold, B. K., Di Lernia, D., Chirico, A., Riva, E. F. M., Mantovani, F., et al. (2019a). Virtual reality meets artificial intelligence: the emergence of advanced digital therapeutics and digital biomarkers. Annu. Rev. CyberTherapy Telemed. 18, 3–7.
Riva, G., Wiederhold, B. K., and Mantovani, F. (2019b). Neuroscience of virtual reality: from virtual exposure to embodied medicine. Cyberpsychol. Behav. Soc. Netw. 22, 82–96. doi: 10.1089/cyber.2017.29099.gri
Rizzo, A. A., Schultheis, M., Kerns, K. A., and Mateer, C. (2004). Analysis of assets for virtual reality applications in neuropsychology. Neuropsychol. Rehabil. 14, 207–239. doi: 10.1080/09602010343000183
Roehr, S., Riedel-Heller, S. G., Kaduszkiewicz, H., Wagner, M., Fuchs, A., van der Leeden, C., et al. (2019). Is function in instrumental activities of daily living a useful feature in predicting Alzheimer’s disease dementia in subjective cognitive decline? Int. J. Geriatr. Psychiatry 34, 193–203. doi: 10.1002/gps.5010
Rogers, J. A., Polhamus, D., Gillespie, W. R., Ito, K., Romero, K., Qiu, R., et al. (2012). Combining patient-level and summary-level data for Alzheimer’s disease modeling and simulation: a beta regression meta-analysis. J. Pharmacokinet. Pharmacodyn. 39, 479–498. doi: 10.1007/s10928-012-9263-3
Samper-Gonzalez, J., Burgos, N., Fontanella, S., Bertin, H., Habert, M.-O., Durrleman, S., et al. (2017). “Yet another ADNI machine learning paper? Paving the Way towards fully- reproducible research on classification of alzheimer’s disease,” in Machine Learning in Medical Imaging. MLMI 2017. Lecture Notes in Computer Science, Vol. 10541, eds Q. Wang, Y. Shi, and H. I. Suk (Cham: Springer), doi: 10.1007/978-3-319-67389-9_7
Schröter, A., Mergl, R., Bürger, K., Hampel, H., Möller, H. J., and Hegerl, U. (2003). Kinematic analysis of handwriting movements in patients with Alzheimer’s disease, mild cognitive impairment, depression and healthy subjects. Dement. Geriatr. Cogn. Disord. 15, 132–142. doi: 10.1159/000068484
Senanayake, U., Sowmya, A., Dawes, L., Kochan, N., Wen, W., and Sachdev, P. (2017). “Deep learning approach for classification of mild cognitive impairment subtypes,” in Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods, (Valletta, MA: ICPRAM), doi: 10.5220/0006246306550662
Seo, K., Kim, J., kwan Oh, D. H., Ryu, H., and Choi, H. (2017). Virtual daily living test to screen for mild cognitive impairment using kinematic movement analysis. PLoS One 12:e0181883. doi: 10.1371/journal.pone.0181883
Serino, S., Pedroli, E., Tuena, C., De Leo, G., Stramba-Badiale, M., Goulene, K., et al. (2017). Novel Virtual reality-based training protocol for the enhancement of the ‘mental frame syncing’ in individuals with alzheimer’s disease: a development-of-concept trial. Front. Aging Neurosci. 9:240. doi: 10.3389/fnagi.2017.00240
Shaffer, J. L., Petrella, J. R., Sheldon, F. C., Choudhury, K. R., Calhoun, V. D., Coleman, R. E., et al. (2013). Predicting cognitive decline in subjects at risk for Alzheimer disease by using combined cerebrospinal fluid, MR imaging, and PET biomarkers. Radiology 266, 583–591. doi: 10.1148/radiol.12120010
Soares, J., Amorim, C., De Leite, R. C., Brizola, R., and Yonamine, C. Y. (2018). Virtual reality therapy for rehabilitation of balance in the elderly: a systematic review and META-analysis. Adv. Rheumatol. 18, 1–10. doi: 10.1186/s42358-018-0013-0
Sundar, S. S., Xu, Q., and Bellur, S. (2010). “Designing interactivity in media interfaces: a communications perspective,” in Proceedings of the 28th International Conference on Human Factors in Computing Systems, Atlanta, GE, doi: 10.1145/1753326.1753666
Tian, Q., Chastan, N., Bair, W. N., Resnick, S. M., Ferrucci, L., and Studenski, S. A. (2017). The brain map of gait variability in aging, cognitive impairment and dementia: a systematic review. Neurosci. Biobehav. Rev. 74, 149–162. doi: 10.1016/j.neubiorev.2017.01.020
Ur Rehman, R. Z., Del Din, S., Shi, J. Q., Galna, B., Lord, S., Yarnall, A. J., et al. (2019). Comparison of walking protocols and gait assessment systems for machine learning-based classification of parkinson’s disease. Sensors (Switzerland) 19:5363. doi: 10.3390/s19245363
Van Vliet, D., De Vugt, M. E., Bakker, C., Koopmans, R. T., Pijnenburg, Y. A., Vernooij-Dassen, M. J., et al. (2011). Caregivers’ perspectives on the pre-diagnostic period in early onset dementia: a long and winding road. Int. Psychogeriatrics 23, 1393–1404. doi: 10.1017/S1041610211001013
Vanacore, N., Di Pucchio, A., Lacorte, E., Bacigalupo, I., Mayer, F., Grande, G., et al. (2017). Dal mild cognitive impairment alla demenza: qual è il ruolo della sanità pubblica? Recenti Prog Med 208, 211–215.
Vemuri, P., Wiste, H. J., Weigand, S. D., Shaw, L. M., Trojanowski, J. Q., Weiner, M. W., et al. (2009). MRI and CSF biomarkers in normal, MCI, and AD subjects: predicting future clinical change. Neurology 73, 294–301. doi: 10.1212/WNL.0b013e3181af79fb
Vieira, S., Pinaya, W. H. L., and Mechelli, A. (2017). Using deep learning to investigate the neuroimaging correlates of psychiatric and neurological disorders: Methods and applications. Neurosci. Biobehav. Rev. 74(Pt A), 58–75. doi: 10.1016/j.neubiorev.2017.01.002
Wang, X., Pi, Y., Chen, P., Liu, Y., Wang, R., and Chan, C. (2015). Cognitive motor interference for preventing falls in older adults: a systematic review and meta-analysis of randomized controlled trials. Age Ageing 44, 205–212. doi: 10.1093/ageing/afu175
Wee, C., Zhang, D., Zhou, L., and Yap, P. (2014). “Machine learning techniques for AD / MCI diagnosis and prognosis,” in Machine Learning in Healthcare Informatics. Intelligent Systems Reference Library, Vol. 56, eds S. Dua, U. Acharya, and P. Dua (Berlin: Springer).
Williams, J., and Weakley, A. (2013). [THIS SPACE MUST BE KEPT BLANK] Machine Learning Techniques for Diagnostic Differentiation of Mild Cogni- Tive Impairment and Dementia. Pullman, WA: Washington State University.
Ye, D. H., Pohl, K. M., and Davatzikos, C. (2011). “Semi-supervised pattern classification: application to structural MRI of Alzheimer’s disease,” in Proceedings of the International Workshop on Pattern Recognition in NeuroImaging, PRNI 2011, Seoul, doi: 10.1109/PRNI.2011.12
Zhang, D., and Shen, D. (2011). “Semi-supervised multimodal classification of Alzheimer’s disease,” in Proceedings of the International Symposium on Biomedical Imaging, Chicago, IL, doi: 10.1109/ISBI.2011.5872715
Zhang, S., Zhang, S., Wang, B., and Habetler, T. G. (2020). Deep learning algorithms for bearing fault diagnosticsx–a comprehensive review. IEEE Access 8, 29857–29881. doi: 10.1109/ACCESS.2020.2972859
Zhang, Y., and Wang, Z. (2012). “Gait recognition using principal curves and neural networks,” in Advances in Neural Networks - ISNN 2006. ISNN 2006. Lecture Notes in Computer Science, Vol. 3972, eds J. Wang, Z. Yi, J. M. Zurada, B. L. Lu, and H. Yin (Berlin: Springer), doi: 10.4156/ijact.vol4.issue22.68
Keywords: gait analysis, kinematic, Mild Cognitive Impairment, Virtual Reality, Machine Learning, elderly, digital biomarkers, Artificial Intelligence
Citation: Cavedoni S, Chirico A, Pedroli E, Cipresso P and Riva G (2020) Digital Biomarkers for the Early Detection of Mild Cognitive Impairment: Artificial Intelligence Meets Virtual Reality. Front. Hum. Neurosci. 14:245. doi: 10.3389/fnhum.2020.00245
Received: 14 April 2020; Accepted: 02 June 2020;
Published: 24 July 2020.
Edited by:Soledad Ballesteros, National University of Distance Education (UNED), Spain
Reviewed by:Vitoantonio Bevilacqua, Politecnico di Bari, Italy
Junichi Chikazoe, National Institute for Physiological Sciences, Japan
Copyright © 2020 Cavedoni, Chirico, Pedroli, Cipresso and Riva. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Silvia Cavedoni, firstname.lastname@example.org