Front. Neurosci.Frontiers in NeuroscienceFront. Neurosci.1662-453XFrontiers Media S.A.10.3389/fnins.2019.01439NeuroscienceOpinionThe Current Research of Spatial Cognitive Evaluation and Training With Brain–Computer Interface and Virtual RealityZhouYanhong12†WenDong13†LuHuibin14*YaoWang13LiuYijun5QianWenbo14YuanJingpeng131School of Information Science and Engineering, Yanshan University, Qinhuangdao, China2School of Mathematics and Information Science and Technology, Hebei Normal University of Science and Technology, Qinhuangdao, China3The Key Laboratory for Computer Virtual Technology and System Integration of Hebei Province, Yanshan University, Qinhuangdao, China4The Key Laboratory of Information Transmission and Signal Processing of Hebei Province, Yanshan University, Qinhuangdao, China5School of Science, Yanshan University, Qinhuangdao, China
Edited by: Jaroslaw Jerzy Barski, Medical University of Silesia, Poland
Reviewed by: Minpeng Xu, Tianjin University, China; Xiaogang Chen, Institute of Biomedical Engineering (CAMS), China; Yu Sun, Zhejiang University, China
*Correspondence: Huibin Lu hblu168@163.com
This article was submitted to Perception Science, a section of the journal Frontiers in Neuroscience
†These authors have contributed equally to this work
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spatial cognitiontrainingevaluationbrain–computer interfacevirtual reality61503326618761652015M581317National Natural Science Foundation of China10.13039/501100001809China Postdoctoral Science Foundation10.13039/501100002858Introduction
Spatial cognitive evaluation and training (SCET) is a rapidly growing research field (Chunyin et al., 2011) in cognitive study. SCET is also greatly significant in the diagnosis and rehabilitation of mild cognitive impairment (MCI), mainly because patients with MCI show symptoms of spatial cognitive impairment at an early stage (Allison et al., 2016; Laczó et al., 2016). For SCET, real-time and accurate quantification is the ultimate goal in evaluation (Lin et al., 2015); it is expected to have a strong sense of participation for the subjects in training, and the training content is closely related to their daily life (Bormans et al., 2016).
Virtual reality (VR) (Tu et al., 2017) and brain–computer interface (BCI) (Xu et al., 2013) are popular technologies in SCET. Training with VR meets experience and social needs of subjects and can be used as the main way of spatial cognitive training (SCT) (Serino et al., 2015; Bormans et al., 2016; Davis and Ohman, 2016; Migo et al., 2016; Tu et al., 2017; Zygouris et al., 2017). However, in these studies, it is difficult to understand the training effect in real time to the subjects and trainers, although they are very eager to observe the training effect timely so as to adjust the training state or program. BCI based on electroencephalogram (EEG) signals (Xu et al., 2018) is often used for real-time SCET and can be applied to real-time monitoring of brain activity on the premise of high temporal resolution (Lin et al., 2015; Han et al., 2017; Chen et al., 2018; Guevara et al., 2018; Pergher et al., 2018). Therefore, it is a good choice to combine BCI and VR (Lechner et al., 2014; Koo et al., 2015; De Tommaso et al., 2016; Donati et al., 2016; Vourvopoulos and I Badia, 2016) for SCET, and there are preliminarily applied studies (Bischof and Boulanger, 2003; Jaiswal et al., 2010; Kober and Neuper, 2011; Tarnanas et al., 2015), which suggested that BCI-VR was a recommendable method of SCET. However, this combination is still in its infancy, and more work needs to be done before conclusions can be confidently drawn.
This study will review the literature related to SCET with VR, BCI, and BCI-VR; discuss the potential advantages of BCI-VR in SCET and future problems to be solved; and put forward our opinions. It is expected that this analysis may provide valuable suggestions for the field of information technology in SCET.
This study used the Web of Science–Science Citation Index/Social Sciences Citation Index (WOS–SCI/SSCI) database, focused on the studies of BCI, VR, and BCI-VR in SCET. The following search keywords were used: “spatial cognitive evaluation (SCE)” or “spatial cognitive training (SCT)” in combination with “brain–computer interface (BCI)” or “virtual reality (VR).” The most recent search was conducted on March 21, 2019.
Research Status of SCET With VR
It is a relatively independent cognitive factor for spatial cognitive ability (SCA), which can be improved by reasonable training (Chunyin et al., 2011). The water maze with VR, which has become the most classical experimental method in the field of SCET, was used to measure the SCA of rats (Morris, 1984). This method can be used to train the SCA of rats (Chunyin et al., 2011) and distinguish male and female participants (Astur et al., 1998). Currently, VR opens up a new way for the research of SCET and had been applied to some researches of SCET (Bormans et al., 2016; Tu et al., 2017), in which VR could help subjects to experience a strong sense of participation in training process, and the training environment with VR was not limited by the area.
In terms of SCE, VR is widely used in the evaluation of AD and MCI (Weniger et al., 2011). For AD patients, virtual hospital (Jiang and Li, 2007), virtual auditorium (Lange et al., 2007), virtual city (Zakzanis et al., 2009), virtual building (Cushman et al., 2008), and virtual environment of apartment (Davis and Ohman, 2016) can be used to evaluate the path finding and navigation ability. When implementing a virtual path learning task, preclinical AD showed disorder (Allison et al., 2016), and there are correlations between regional neurodegeneration of AD and ability of spatial terrain memory (Pengas et al., 2012). In addition, relocation tasks with VR can be used to assess the spatial memory of early AD (Shamsuddin et al., 2011, 2012; Caffo et al., 2012). For MCI patients, the missing ability to orientation in virtual space (Morganti et al., 2013) and virtual supermarket (Tu et al., 2015; Zygouris et al., 2017) can help us to screen them from all subjects (Zygouris et al., 2017). In addition, the virtual path navigation can be used to evaluate their visual spatial memory (Lesk et al., 2014), and virtual room location search can be used to detect their obstacles in spatial navigation (Serino et al., 2015).
In terms of SCT, there existed several VR games widely used by cognitive impairment patients. Virtual memory palaces game can be used to improve the quality of life and memory of AD (Bormans et al., 2016), virtual buildings navigation game can be applied to improve the driving skills and daily cognitive ability of AD patients (White and Moussavi, 2016), and the large virtual outdoor parks game can be used to train the navigation ability of patients with dementia (Flynn et al., 2003). In addition, other VR games can also be used to improve the spatial attention of cognitive impairment patients (Manera et al., 2016).
Research State of SCET With the Change of BCI Signals
Previous studies have shown that spatial memory, spatial orientation, and navigation dominated by the hippocampus were important components of spatial cognition (Olton et al., 1979). They also have shown that the dynamic characteristics of EEG signals from the parietal lobe were directly related to the ability of spatial memory and navigation (Chiu et al., 2012). Therefore, it is feasible to explore the changes of SCA from the perspective of EEG signal analysis.
From the perspective of SCE, BCI signals are widely used in the evaluation of spatial navigation and memory. For spatial navigation, dynamic features of the EEG signal can respond to the change of spatial navigation (Lin et al., 2009, 2015). The navigation performance was related to the power modulation in theta or gamma frequency band (Bell, 2002; White et al., 2012; Chen et al., 2018), Especially, the phase reset of theta rhythm during spatial navigation caused the NT170 latency effect (Baker and Holroyd, 2013). Interestingly, female participants showed stronger theta oscillations during spatial navigation (Nishiyama et al., 2002). For spatial memory, the perception and action in the memory task are different by EEG network analysis (Protopapa et al., 2011). The power of EEG signals from AD patients on alpha and theta frequency bands was significantly higher relative to normal control when performing object-location memory tasks (Han et al., 2017). In addition, when the delay, peak amplitude, and root mean square of P300 act as the features in visual spatial memory paradigm, the classification accuracy could achieve up to 91.76% (Li et al., 2013).
From the perspective of SCT, almost all of the studies focused on the training of spatial memory, which can enhance the connection between nervous activity and the brain network in frontal, parietal, and occipital lobes of MCI patients (Hampstead et al., 2011). In addition, the Pearson correlation coefficient between the right prefrontal lobe regions decreased after spatial memory task, which indicated that the region had a higher participation in memory task (Plank et al., 2010; Guevara et al., 2018), Surprisingly, old people showed higher amplitude of P300 in the parietal lobe than the young on spatial memory training (Pergher et al., 2018),
Based on the above researches, BCI can provide support for objective data analysis in SCET and can effectively improve the scientific quantification performance of this research field, as well as the operability and repeatability of experiments.
Research Status of SCET With BCI-VRResearch Value of BCI-VR
In recent years, the combination of BCI and VR has provided practical benefits for training and evaluation (Achanccaray et al., 2017). In VR training, BCI can be used to analyze brain activity synchronously in real time (Martišius and Damaševičius, 2016). Meanwhile, VR can provide a situation similar to the daily life, in which the brain activity could be evaluated by EEG analysis (Alchalcabi et al., 2017). Therefore, the fusion of VR and BCI can solve the subjective and nonreal-time evaluation of training effect in the training process. Recently, BCI-VR has been successfully used in some application fields, including steady-state visual evoked potential (Lechner et al., 2014) and motor imagery (I Badia et al., 2012; Vourvopoulos and I Badia, 2016) for stroke rehabilitation, which can overcome the limitation of traditional monitor refresh frequency (Calore et al., 2014; Koo et al., 2015) and increase the engagement of subjects (Koo and Choi, 2015). In addition, it has other applications, such as motion imaging for paraplegic rehabilitation (Donati et al., 2016), P300 for cognitive training of normal control (De Tommaso et al., 2016), autism training (Amaral et al., 2017), and hyperactivity training (Rohani and Puthusserypady, 2015).
Research Analysis of SCET With BCI-VR
At present, there are several studies that combine BCI and VR to exert their respective advantages in the field of SCET. For the spatial navigation, Bischof and Boulanger (2003) found that theta oscillation of EEG signals was related to the encoding and retrieval of spatial information when performing VR maze navigation tasks, and Silvia et al. compared the differences of EEG signals from male and female adults on theta frequency band with VR spatial navigation tasks (Kober and Neuper, 2011). For the spatial memory, Jaiswal et al. (2010) combined BCI with VR to observe differences in EEG activity during the coding and retrieval stages of spatial memory tasks. For other spatial task, Tarnanas et al. (2014a,b); Tarnanas et al. (2015) used VR day-out task to evaluate its predictive value of MCI. All of these studies have verified the rationality of the combination of BCI and VR in SCET research. Figure 1 showed the schematic diagram for the system description of the SCET with BCI-VR.
The schematic diagram for the system description of the SCET with BCI-VR.
Discussion
Many studies suggested that VR can be used to the SCET (Bormans et al., 2016; Manera et al., 2016; Tu et al., 2017; Zygouris et al., 2017) and changed the old way of SCE with neuropsychological scales, subjective judgments, qualitative description, and so on (Manera et al., 2016). VR technology has obvious advantages in immersive space experience and internal space visualization in the field of architectural design. However, VR is still unable to evaluate the effects of SCT in real time like BCI. Many studies also suggested that the change of BCI signals can be used to the SCET (Han et al., 2017; Chen et al., 2018; Guevara et al., 2018; Pergher et al., 2018). BCI can be used to analyze EEG signals in SCET effectively and improve the operability and repeatability of evaluation and training. However, BCI cannot supply an abundant environment for SCET compared to VR. Several studies in the field of SCET combined BCI and VR to exert their respective advantages (Jaiswal et al., 2010; Kober and Neuper, 2011; Tarnanas et al., 2015). Compared with BCI and VR used in SCET, BCI-VR not only can improve the effect of spatial cognition training but also can overcome the limitation of spatial cognition evaluation.
However, various challenges to be broken through currently exist in BCI-VR used in SCET. Firstly, effective interaction remains to be achieved in VR, so a new interaction model, which combines natural interaction in VR with BCI, needs to be studied. Secondly, wearing the wet electrode in BCI increases the experimental preparation time compared with the dry electrode in BCI. Currently, there is a lack of the dry electrode with high signal quality and good comfort. Therefore, the design and development of electrode in the future need to be strengthened. Thirdly, the SCT in the real environment requires a large space, but the range of activity scenes covered by existing VR equipment cannot meet this demand. Hence, the algorithm that can scale up or down the VR game scenes at will is very important.
Conclusions
In conclusion, this study reviewed the recent literature of VR, BCI, and BCI-VR used in SCET. Although these studies obtained promising results, more work needs to be done before conclusions can be confidently drawn. It is suggested that BCI and VR should be deeply integrated in order to give full play to their respective technical advantages. The current technical bottlenecks of BCI and VR should be broken through to provide personalized, comfortable, and real-time technical support for creating an effective environment for SCET. Therefore, in the future, for the SCET, it will be necessary to not only solve the technical problems of BCI-VR but also to take patients as important subjects, design personalized and adaptive BCI-VR games, and train the patients. In addition, the training effect had better be evaluated and fed back in real time in order to meet the individual needs of patients.
Author Contributions
HL, YZ, WY, and YL designed the work. YZ, DW, and HL wrote this manuscript. YZ, DW, WY, YL, WQ, and JY collected and analyzed the literatures. DW, WQ, and JY revised the manuscript before firstly submitted. HL, WY, and YL revised important intellectual content, added one figure, approved the final version to be published, and revised English grammar and sentences.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
ReferencesAchanccarayD.AcunaK.CarranzaE.Andreu-PerezJ. (2017). A virtual reality and brain computer interface system for upper limb rehabilitation of post stroke patients, in (Naples), 1–5. 10.1109/FUZZ-IEEE.2017.8015726AlchalcabiA. E.EddinA. N.ShirmohammadiS. (2017). More attention, less deficit: wearable EEG-based serious game for focus improvement, in (Perth: IEEE), 1–8. 10.1109/SeGAH.2017.7939288AllisonS. L.FaganA. M.MorrisJ. C.HeadD. (2016). Spatial navigation in preclinical Alzheimer's disease. 52, 77–90. 10.3233/JAD-15085526967209AmaralC. P.SimõesM. A.MougaS.AndradeJ.Castelo-BrancoM. (2017). A novel Brain Computer Interface for classification of social joint attention in autism and comparison of 3 experimental setups: a feasibility study. 290, 105–115. 10.1016/j.jneumeth.2017.07.02928760486AsturR. S.OrtizM. L.SutherlandR. J. (1998). A characterization of performance by men and women in a virtual Morris water task: a large and reliable sex difference. 93, 185–190. 10.1016/S0166-4328(98)00019-99659999BakerT. E.HolroydC. B. (2013). The topographical N170: electrophysiological evidence of a neural mechanism for human spatial navigation. 94, 90–105. 10.1016/j.biopsycho.2013.05.00423669533BellM. A. (2002). Power changes in infant EEG frequency bands during a spatial working memory task. 39, 450–458. 10.1111/1469-8986.394045012212637BischofW. F.BoulangerP. (2003). Spatial navigation in virtual reality environments: an EEG analysis. 6, 487–495. 10.1089/10949310376971051414583124BormansK.RoeK.De WachterD. (2016). Virtual memory palaces to improve quality of life in Alzheimer's disease. 14, 227–232.CaffoA. O.De CaroM. F.PicucciL.NotarnicolaA.SettanniA.LivreaP.. (2012). Reorientation deficits are associated with amnestic mild cognitive impairment. 27, 321–330. 10.1177/153331751245203522815081CaloreE.GadiaD.MariniD. (2014). Eliciting steady-state visual evoked potentials by means of stereoscopic displays, in (San Francisco, CA), 901126. 10.1117/12.2036936ChenD.KunzL.WangW.ZhangH.WangW.-X.Schulze-BonhageA.. (2018). Hexadirectional modulation of theta power in human entorhinal cortex during spatial navigation. 28, 3310–3315.e3314. 10.1016/j.cub.2018.08.02930318350ChiuT. C.GramannK.KoL. W.DuannJ. R.JungT. P.LinC. T. (2012). Alpha modulation in parietal and retrosplenial cortex correlates with navigation performance. 49, 43–55. 10.1111/j.1469-8986.2011.01270.x21824156ChunyinS.ZhihongH.KaifengL.XiaominL.WenjingL. (2011). The effect of training style to spatial learning and memory of rat. 42, 539–541.CushmanL. A.SteinK.DuffyC. J. (2008). Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. 71, 888–895. 10.1212/01.wnl.0000326262.67613.fe18794491DavisR.OhmanJ. (2016). Wayfinding in ageing and Alzheimer's disease within a virtual senior residence: study protocol. 72, 1677–1688. 10.1111/jan.1294526915997De TommasoM.RicciK.DelussiM.MontemurnoA.VecchioE.BrunettiA.. (2016). Testing a novel method for improving wayfinding by means of a P3b Virtual Reality Visual Paradigm in normal aging. 5:1297. 10.1186/s40064-016-2978-727547671DonatiA. R.ShokurS.MoryaE.CamposD. S.MoioliR. C.GittiC. M.. (2016). Long-term training with a brain-machine interface-based gait protocol induces partial neurological recovery in paraplegic patients. 6:30383. 10.1038/srep3038327513629FlynnD.Van SchaikP.BlackmanT.FemcottC.HobbsB.CalderonC. (2003). Developing a virtual reality–based methodology for people with dementia: a feasibility study. 6, 591–611. 10.1089/10949310332272537914756925GuevaraM. A.PaniaguaE. I. C.GonzálezM. H.CarrilloI. K. S.SepúlvedaM. L. A.OrozcoJ. C. H.. (2018). EEG activity during the spatial span task in young men: differences between short-term and working memory. 1683, 86–94. 10.1016/j.brainres.2018.02.00429425909HampsteadB. M.StringerA. Y.StillaR. F.DeshpandeG.HuX.MooreA. B.. (2011). Activation and effective connectivity changes following explicit-memory training for face–name pairs in patients with mild cognitive impairment: a pilot study. 25, 210–222. 10.1177/154596831038242420935339HanY.WangK.JiaJ.WuW. (2017). Changes of EEG spectra and functional connectivity during an object-location memory task in Alzheimer's disease. 11:107. 10.3389/fnbeh.2017.0010728620287I BadiaS. B.MorgadeA. G.SamahaH.VerschureP. (2012). Using a hybrid brain computer interface and virtual reality system to monitor and promote cortical reorganization through motor activity and motor imagery training. 21, 174–181. 10.1109/TNSRE.2012.2229295JaiswalN.RayW.SlobounovS. (2010). Encoding of visual–spatial information in working memory requires more cerebral efforts than retrieval: evidence from an EEG and virtual reality study. 1347, 80–89. 10.1016/j.brainres.2010.05.08620570660JiangC.-F.LiY.-S. (2007). Virtual hospital-a computer-aided platform to evaluate the sense of direction, in (Lyon: IEEE), 2361–2364. 10.1109/IEMBS.2007.4352801KoberS. E.NeuperC. (2011). Sex differences in human EEG theta oscillations during spatial navigation in virtual reality. 79, 347–355. 10.1016/j.ijpsycho.2010.12.00221146566KooB.ChoiS. (2015). SSVEP response on oculus rift in brain-computer interface (BCI), in (Sabuk: IEEE), 1–4. 10.1109/IWW-BCI.2015.7073028KooB.LeeH.-G.NamY.ChoiS. (2015). Immersive BCI with SSVEP in VR head-mounted display, in (Milan: IEEE), 1103–1106. 10.1109/EMBC.2015.7318558LaczóJ.ParizkovaM.MoffatS. D.VyhnalekM.AndelR.HortJ. (2016). The effect of early-stage Alzheimer's disease on spatial navigation strategies: a pilot study. 12, 565–566. 10.1016/j.jalz.2016.06.1106LangeB. S.RizzoA.AsturR.ParsonsT. (2007). Virtual reality visuospatial and wayfinding assessment for mild dementia of the Alzheimer's type. 3:S135. 10.1016/j.jalz.2007.04.178LechnerA.OrtnerR.GugerC. (2014). Feedback strategies for BCI based stroke rehabilitation: evaluation of different approaches, in (Aalborg: Springer), 507–512. 10.1007/978-3-319-08072-7_75LeskV. E.ShamsuddinS. N. W.WaltersE. R.UgailH. (2014). Using a virtual environment to assess cognition in the elderly. 18, 271–279. 10.1007/s10055-014-0252-2LiX.YanY.WeiW. (2013). Identifying patients with poststroke mild cognitive impairment by pattern recognition of working memory load-related ERP. 2013:658501. 10.1155/2013/65850124233152LinC.-T.ChiuT.-C.GramannK. (2015). EEG correlates of spatial orientation in the human retrosplenial complex. 120, 123–132. 10.1016/j.neuroimage.2015.07.00926163801LinC.-T.YangF.-S.ChiouT.-C.KoL.-W.DuannJ.-R.GramannK. (2009). EEG-based spatial navigation estimation in a virtual reality driving environment, in (Taichung: IEEE), 435–438. 10.1109/BIBE.2009.65ManeraV.ChapoulieE.BourgeoisJ.GuerchoucheR.DavidR.OndrejJ.. (2016). A feasibility study with image-based rendered virtual reality in patients with mild cognitive impairment and dementia. 11:e0151487. 10.1371/journal.pone.015148726990298MartišiusI.DamaševičiusR. (2016). A prototype SSVEP based real time BCI gaming system. 2016:3861425. 10.1155/2016/386142527051414MigoE.O'dalyO.MitterschiffthalerM.AntonovaE.DawsonG.DourishC.. (2016). Investigating virtual reality navigation in amnestic mild cognitive impairment using fMRI. 23, 196–217. 10.1080/13825585.2015.107321826234803MorgantiF.StefaniniS.RivaG. (2013). From allo-to egocentric spatial ability in early Alzheimer's disease: a study with virtual reality spatial tasks. 4, 171–180. 10.1080/17588928.2013.85476224251605MorrisR. (1984). Developments of a water-maze procedure for studying spatial learning in the rat. 11, 47–60. 10.1016/0165-0270(84)90007-46471907NishiyamaN.MizuharaH.MiwakeichiF.YamaguchiY. (2002). Theta episodes observed in human scalp EEG during virtual navigation-spatial distribution and task dependence, in (Singapore: IEEE), 428–432.OltonD. S.BeckerJ. T.HandelmannG. E. (1979). Hippocampus, space, and memory. 2, 313–322. 10.1017/S0140525X00062713PengasG.WilliamsG.Acosta-CabroneroJ.AshT.HongY.Izquierdo-GarciaD.. (2012). The relationship of topographical memory performance to regional neurodegeneration in Alzheimer's disease. 4:17. 10.3389/fnagi.2012.0001722783190PergherV.WittevrongelB.TournoyJ.SchoenmakersB.Van HulleM. M. (2018). N-back training and transfer effects revealed by behavioral responses and EEG. 8:e01136. 10.1002/brb3.113630350357PlankM.MüllerH. J.OntonJ.MakeigS.GramannK. (2010). Human EEG correlates of spatial navigation within egocentric and allocentric reference frames, in (Portland, OR: Springer), 191–206. 10.1007/978-3-642-14749-4_18ProtopapaF.MylonasD.SpiliotisK.SiettosC.SmyrnisN.EvdokimidisI. (2011). Dynamic analysis of EEG signals during spatial working memory used for either perception discrimination or planning of action, in (Boston, MA: IEEE), 5896–5899. 10.1109/IEMBS.2011.6091458RohaniD. A.PuthusserypadyS. (2015). BCI inside a virtual reality classroom: a potential training tool for attention. 3:12. 10.1140/epjnbp/s40366-015-0027-zSerinoS.MorgantiF.Di StefanoF.RivaG. (2015). Detecting early egocentric and allocentric impairments deficits in Alzheimer's disease: an experimental study with virtual reality. 7:88. 10.3389/fnagi.2015.0008826042034ShamsuddinS. N. W.UgailH.LeskV.WaltersE. (2012). VREAD: a virtual simulation to investigate cognitive function in the elderly, in (Darmstadt: IEEE), 215–220. 10.1109/CW.2012.37ShamsuddinS. W.LeskV.UgailH. (2011). Virtual environment design guidelines for elderly people in early detection of dementia, in (Sanya: Citeseer), 751–755.TarnanasI.LaskarisN.TsolakiM.MuriR.NefT.MosimannU. P. (2015). On the comparison of a novel serious game and electroencephalography biomarkers for early dementia screening. 821, 63–77. 10.1007/978-3-319-08939-3_1125416111TarnanasI.TsolakiM.NefT.MüriR. M.MosimannU. P. (2014a). Can a novel computerized cognitive screening test provide additional information for early detection of Alzheimer's disease?10, 790–798. 10.1016/j.jalz.2014.01.00224656838TarnanasI.TsolakisA.TsolakiM. (2014b). Assessing virtual reality environments as cognitive stimulation method for patients with MCI, in , eds BrooksA. L.BrahnamS.JainL. C. (Berlin; Heidelberg: Springer), 39–74. 10.1007/978-3-642-45432-5_4TuS.SpiersH. J.HodgesJ. R.PiguetO.HornbergerM. (2017). Egocentric versus allocentric spatial memory in behavioral variant frontotemporal dementia and Alzheimer's disease. 59, 883–892. 10.3233/JAD-16059228697554TuS.WongS.HodgesJ. R.IrishM.PiguetO.HornbergerM. (2015). Lost in spatial translation–A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia. 67, 83–94. 10.1016/j.cortex.2015.03.01625913063VourvopoulosA.I BadiaS. B. (2016). Motor priming in virtual reality can augment motor-imagery training efficacy in restorative brain-computer interaction: a within-subject analysis. 13:69. 10.1186/s12984-016-0173-227503007WenigerG.RuhlederM.LangeC.WolfS.IrleE. (2011). Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. 49, 518–527. 10.1016/j.neuropsychologia.2010.12.03121185847WhiteD. J.CongedoM.CiorciariJ.SilbersteinR. B. (2012). Brain oscillatory activity during spatial navigation: theta and gamma activity link medial temporal and parietal regions. 24, 686–697. 10.1162/jocn_a_0009821812639WhiteP. J.MoussaviZ. (2016). Neurocognitive treatment for a patient with Alzheimer's disease using a virtual reality navigational environment. 10, 129–135. 10.4137/JEN.S4082727840579XuM.QiH.WanB.YinT.LiuZ.MingD. (2013). A hybrid BCI speller paradigm combining P300 potential and the SSVEP blocking feature. 10:026001. 10.1088/1741-2560/10/2/02600123369924XuM.XiaoX.WangY.QiH.JungT.-P.MingD. (2018). A brain computer interface based on miniature event-related potentials induced by very small lateral visual stimuli. 65, 1166–1175. 10.1109/TBME.2018.279966129683431ZakzanisK. K.QuintinG.GrahamS. J.MrazR. (2009). Age and dementia related differences in spatial navigation within an immersive virtual environment. 15, CR140–CR150.19333197ZygourisS.NtovasK.GiakoumisD.VotisK.DoumpoulakisS.SegkouliS.. (2017). A preliminary study on the feasibility of using a virtual reality cognitive training application for remote detection of mild cognitive impairment. 56, 619–627. 10.3233/JAD-16051828035922
Funding. This research was funded by the National Natural Science Foundation of China (61876165, 61503326), Natural Science Foundation of Hebei Province in China (F2016203343), China Postdoctoral Science Foundation (2015M581317), and the Research and Development Plan of Qinhuangdao Science and Technology of China (201602A038, 201703A072).