Toward a new cognitive neuroscience: modeling natural brain dynamics
Klaus Gramann
Tzyy-Ping Jung
Daniel P. Ferris
Chin-Teng Lin
Scott Makeig- 1Psychology and Ergonomics, Biological Psychology and Neuroergonomics, Berlin Institute of Technology, Berlin, Germany
- 2Center for Advanced Neurological Engineering, University of California San Diego, San Diego, CA, USA
- 3Institute for Neural Computation, University of California San Diego, San Diego, CA, USA
- 4Institute of Engineering in Medicine, University of California San Diego, San Diego, CA, USA
- 5Department of Computer Science, National Chiao-Tung University, Hsinchu, Taiwan
- 6Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
- 7School of Kinesiology, University of Michigan, Ann Arbor, MI, USA
- 8Electrical and Computer Engineering, National Chiao-Tung University, Hsinchu, Taiwan
- 9Brain Research Center, National Chiao-Tung University, Hsinchu, Taiwan
- 10Swartz Center for Computational Neuroscience, University of California San Diego, San Diego, CA, USA
Decades of brain imaging experiments have revealed important insights into the architecture of the human brain and the detailed anatomic basis for the neural dynamics supporting human cognition. However, technical restrictions of traditional brain imaging approaches including functional magnetic resonance tomography (fMRI), positron emission tomography (PET), and magnetoencephalography (MEG) severely limit participants' movements during experiments (Makeig et al., 2009). As a consequence, our knowledge of the neural basis of human cognition is rooted in a dissociation of human cognition from what is arguably its foremost, and certainly its most evolutionarily determinant function—organizing our behavior so as to optimize its consequences in our complex, multi-scale, and ever-changing environment. The concept of natural cognition, therefore, should not be separated from our fundamental experience and role as an embodied agent acting in a complex, partly unpredictable world.
To gain new insights into the brain dynamics supporting natural cognition requires overcoming restrictions of traditional brain imaging technologies (Gramann et al., 2011). First, the sensors must be lightweight and untethered to allow monitoring of brain activity during free movements. Fortunately, new electroencephalography (EEG) and near infrared spectroscopy (NIRS) sensors and sensing devices allow recording both electrical and hemodynamic brain and body activity while participants are freely moving (Lin et al., 2011; Liao et al., 2012; Ayaz et al., 2013). New data-driven analysis approaches must allow separation of signals arriving at the sensors from the brain as well as non-brain sources like neck muscles, eyes, heart, and the electrical environment (Makeig et al., 2004). Independent component analysis (ICA) and related blind source separation methods have proven effective for separating brain from non-brain activities from electrophysiological data recorded during experimental paradigms that stimulate natural cognition (Gramann et al., 2014). ICA has also proven valuable for separating other multi-channel signals including electromyographic (EMG) and electrocardiographic (ECG) activities (Gramann et al., 2010; Gwin et al., 2010; Kline et al., 2014).
Adequate study of natural cognition also requires synchronous recording of participants' motor actions as well as the physical environment and external events influencing cognition. Recording what the brain does (via EEG and fNIRS brain imaging), what it senses (via scene and event recording), and what it organizes (via motor, ocular, and autonomic activity recording) may be termed mobile brain/body imaging (“MoBI”). Technically, recording MoBI data is now possible at reasonable cost and convenience. However, joint multi-stream analysis of the data recorded in MoBI paradigms presents major conceptual, mathematical, and data processing challenges (Ojeda et al., 2014).
To overcome restrictions of established brain imaging methods and to facilitate further development of mobile brain/body imaging, a group of researchers from all over the world gathered in the beautiful scientific retreat of the Hanse-Wissenschaftskolleg in Delmenhorst, Germany in September 2013 for the first international meeting on Mobile Brain/Body Imaging. During a stimulating and intense workshop, attendees presented and discussed newest developments in mobile brain imaging technologies, novel software architectures for recording and analyzing multidimensional data streams, and other topics relevant to MoBI. Most attendees at the Delmenhorst meeting contributed to this Research Topic; other research groups have added contributions sharing related ideas. The present Research Topic thus provides an excellent overview of the current state of the art in mobile brain/body imaging. The topics cover the three main pillars of MoBI research, i.e., hardware for imaging mobile brain and body dynamics, software to record and analyze complex multi-dimensional data streams, and applications of MoBI to such diverse fields as neuroergonomics, gait rehabilitation, spatial cognition, and dance.
Starting with the technical aspects of MoBI, Reis et al. (2014), provide an overview on existing hardware and software solutions for MoBI recordings. Focusing on new sensor technology and analysis approaches, Lin et al. report a test of a new mobile EEG headgear using steady-state visual-evoked potentials in participants during treadmill walking (Lin et al., 2014). With the aim to include gaze tracking as an important information channel for investigations of natural cognition and associated brain dynamics Browatzki and colleagues describe and compare two different approaches to measuring eye movements in mobile participants (Browatzki et al., 2014).
The second pillar of MoBI, software frameworks for recording and analyses of multi-modal imaging data is addressed by Ojeda and colleagues providing a description of a new open source toolbox (Ojeda et al., 2014). MoBILAB interoperates with EEGLAB (Delorme and Makeig, 2004) and allows for analysis and visualization of multidimensional mobile brain/body imaging data. Zao et al. (2014) introduce an exciting new perspective on distributed computing describing a novel network system approach to remote monitoring of brain/body activity of one or many mobile participants.
The majority of contributions to this Research Topic can be summarized under the pillar of MoBI applications. The review by Mehta and Parasuraman (2013) provides an overview of the advantages and disadvantages of existing imaging modalities in the area of neuroergonomics, describing differing temporal and spatial resolutions and the degree of immobility that brain imaging method imposes on participants. Ayaz et al. (2013) describe the development and application of a mobile fNIRS device for investigating changes in workload in real operating environments providing an example of mobile recordings of hemodynamics. The first investigation of kinesthetic and vestibular information processing in actively navigating participants is given by Ehinger et al. (2014). The authors dissociate the brain dynamics underlying different proprioceptive senses during movements. Wagner et al. (2014) use MoBI to describe the cortical networks activated during robot-assisted walking and investigate the potential impact of movement-related feedback for gait rehabilitation. Cruz-Garza and colleagues investigate professional dancers during different whole body movements and derive distinct expressive qualities of movement from surface EEG (Cruz-Garza et al., 2014). While the previous studies used whole body movement, Amengual and colleagues describe the brain dynamics associated with the preparation and execution of multi-joint self-paced arm movements (Amengual et al., 2014). Finally, in their paper Derix et al. elucidate the neuronal basis of mental processes during natural communication based on electrocorticography in pre-neurosurgical patients (Derix et al., 2014).
All contributions in this Research Topic go beyond the state of the art in brain imaging and provide new approaches to recording and analyzing multi-modal data. The authors describe new insights into the neural basis of cognitive processes beyond traditional laboratory research. We hope this Research Topic may inspire new research that uses the MoBI paradigm to investigate natural cognition by recording and analyzing brain dynamics and behavior of participants performing a wide range of naturally motivated actions and interactions.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Amengual, J. L., Marco-Pallares, J., Grau, C., Munte, T. F., and Rodriguez-Fornells, A. (2014). Linking motor-related brain potentials and velocity profiles in multi-joint arm reaching movements. Front. Hum. Neurosci. 8:271. doi: 10.3389/fnhum.2014.00271
Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P. A., McKendrick, R., and Parasuraman, R. (2013). Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7:871. doi: 10.3389/fnhum.2013.00871
Browatzki, B., Bulthoff, H. H., and Chuang, L. L. (2014). A comparison of geometric-and regression-based mobile gaze-tracking. Front. Hum. Neurosci. 8:200. doi: 10.3389/fnhum.2014.00200
Cruz-Garza, J. G., Hernandez, Z. R., Nepaul, S., Bradley, K. K., and Contreras-Vidal, J. L. (2014). Neural decoding of expressive human movement from scalp electroencephalography (EEG). Front. Hum. Neurosci. 8:188. doi: 10.3389/fnhum.2014.00188
Delorme, A., and Makeig, S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009
Derix, J., Iljina, O., Weiske, J., Schulze-Bonhage, A., Aertsen, A., and Ball, T. (2014). Towards elucidating the neuronal basis of cognitive units in non-experimental, real-life communication using ECoG. Front. Hum. Neurosci. 8:383. doi: 10.3389/fnhum.2014.00383
Ehinger, B. V., Fischer, P., Gert, A. L., Kaufhold, L., Weber, F., Pipa, G., et al. (2014). Kinesthetic and vestibular information modulate alpha activity during spatial navigation: a mobile EEG study. Front. Hum. Neurosci. 8:71. doi: 10.3389/fnhum.2014.00071
Gramann, K., Ferris, D. P., Gwin, J., and Makeig, S. (2014). Imaging natural cognition in action. Int. J. Psychophysiol. 91, 22–29. doi: 10.1016/j.ijpsycho.2013.09.003
Gramann, K., Gwin, J. T., Bigdely-Shamlo, N., Ferris, D. P., and Makeig, S. (2010). Visual evoked responses during standing and walking. Front. Hum. Neurosci. 4:202. doi: 10.3389/fnhum.2010.00202
Gramann, K., Gwin, J. T., Ferris, D. P., Oie, K., Jung, T. P., Lin, C. T., et al. (2011). Cognition in action: imaging brain/body dynamics in mobile humans. Rev. Neurosci. 22, 593–608. doi: 10.1515/RNS.2011.047
Gwin, J. T., Gramann, K., Makeig, S., and Ferris, D. P. (2010). Removal of movement artifact from high-density EEG recorded during walking and running. J. Neurophysiol. 103, 3526–3534. doi: 10.1152/jn.00105.2010
Kline, J. E., Poggensee, K., and Ferris, D. P. (2014). Your brain on speed: cognitive performance of a spatial working memory task is not affected by walking speed. Front. Hum. Neurosci. 8:288. doi: 10.3389/fnhum.2014.00288
Liao, L. D., Lin, C. T., McDowell, K., Wickenden, A. E., Gramann, K., Jung, T. P., et al. (2012). Biosensor technologies for augmented brain-computer interfaces in the next decades. Proc. IEEE 100, 1553–1566. doi: 10.1109/JPROC.2012.2184829
Lin, C. T., Liao, L. D., Liu, Y. H., Wang, I. J., Lin, B. S., and Chang, J. Y. (2011). Novel dry polymer foam electrodes for long-term EEG measurement. IEEE Trans. Biomed. Eng. 58, 1200–1207. doi: 10.1109/TBME.2010.2102353
Lin, Y. P., Wang, Y. J., Wei, C. S., and Jung, T. P. (2014). Assessing the quality of steady-state visual-evoked potentials for moving humans using a mobile electroencephalogram headset. Front. Hum. Neurosci. 8:182. doi: 10.3389/fnhum.2014.00182
Makeig, S., Debener, S., Onton, J., and Delorme, A. (2004). Mining event-related brain dynamics. Trends Cogn. Sci. 8, 204–210. doi: 10.1016/j.tics.2004.03.008
Makeig, S., Gramann, K., Jung, T. P., Sejnowski, T. J., and Poizner, H. (2009). Linking brain, mind and behavior. Int. J. Psychophysiol. 73, 95–100. doi: 10.1016/j.ijpsycho.2008.11.008
Mehta, R. K., and Parasuraman, R. (2013). Neuroergonomics: a review of applications to physical and cognitive work. Front. Hum. Neurosci. 7:889. doi: 10.3389/fnhum.2013.00889
Ojeda, A., Bigdely-Shamlo, N., and Makeig, S. (2014). MoBILAB: an open source toolbox for analysis and visualization of mobile brain/body imaging data. Front. Hum. Neurosci. 8:121. doi: 10.3389/fnhum.2014.00121
Reis, P. M., Hebenstreit, F., Gabsteiger, F., von Tscharner, V., and Lochmann, M. (2014). Methodological aspects of EEG and body dynamics measurements during motion. Front. Hum. Neurosci. 8:156. doi: 10.3389/fnhum.2014.00156
Wagner, J., Solis-Escalante, T., Scherer, R., Neuper, C., and Muller-Putz, G. (2014). It's how you get there: walking down a virtual alley activates premotor and parietal areas. Front. Hum. Neurosci. 8:93. doi: 10.3389/fnhum.2014.00093
Keywords: mobile brain/body imaging, EEG, fNIRS, brain mapping, embodied cognition, natural cognition, wireless EEG sensors, computational neurosciences
Citation: Gramann K, Jung T-P, Ferris DP, Lin C-T and Makeig S (2014) Toward a new cognitive neuroscience: modeling natural brain dynamics. Front. Hum. Neurosci. 8:444. doi: 10.3389/fnhum.2014.00444
Received: 30 May 2014; Accepted: 02 June 2014;
Published online: 19 June 2014.
Edited and reviewed by: John J. Foxe, Albert Einstein College of Medicine, USA
Copyright © 2014 Gramann, Jung, Ferris, Lin and Makeig. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: klaus.gramann@tu-berlin.de