Introduction
The understanding of the brain functioning in the real world is the next frontier: discovering its operational principles, architectural design, and internal mechanisms are attributed as a significant opportunity to advance human civilization (National Academy of Engineering, 2008). How low-level brain processes translate into cognition is one of the greatest unsolved questions. Although science and engineering enabled our understanding of subatomic particles, the formation of solar systems, and the molecular building blocks of nerve cells, it has yet to explain how consciousness and natural intelligence emerge from the electrical and chemical activity of neurons. We need new technologies and novel approaches to study and understand the brain in the wild.
Driven by the national and international grand funding programs such as the BRAIN initiative and Europe's Human Brain Project, it is expected that our understanding of the human brain function and the tools to record and alter brain activity and treat brain diseases will be revolutionized in the upcoming decades (National Institutes of Health, 2014). Existing studies with traditional approaches have accumulated overwhelming knowledge but are limited in scope, i.e., only in artificial lab settings and with simplified tasks. Hence, accurate measurement and precise modulation of the brain activity in a diverse array of everyday tasks is an urgent and needed capability to move neuroengineering and neuroscience to the next level: that is to enable practical clinical and translational research that will form the basis of an entirely new industry of neurotechnologies.
As an interdisciplinary new field, neuroergonomics aims to fill this gap: Understanding the brain in the wild, its activity during unrestricted real-world tasks in everyday life contexts, and its relationship to action, behavior, body, and environment. Neuroergonomics is at the intersection of neuroscience, engineering, psychology, philosophy, and human factors. Originating from the use of scientific thinking in the design of tools, technology and of working environments, neuroergonomics represent the next frontier and builds on the research innovation and applications of human performance, cognitive engineering and cognitive neuroscience (Parasuraman, 2003; Karwowski, 2005; Posner, 2012). By utilizing combined approaches, hybrid methods, and domain expertise/knowledgebase, to investigate uncharted scientific territories, neuroergonomics is posed to contribute to each of these fields. Neuroergonomics has the potential to advance our overall understanding of brain with practical implications in diverse sectors such as healthcare, education, transportation, manufacturing, entertainment, communication and everyday life at large (Parasuraman, 2003, 2011; Parasuraman and Rizzo, 2007; Parasuraman et al., 2012; McKendrick et al., 2015; Ayaz and Dehais, 2019).
New Emerging Field: Neuroergonomics
The efforts to understand the nature of the brain in human performance originated with Hippocrates (c.469–370 BC) (Finger, 2000). Today, neuroscience applies various levels of analysis in investigating human brain activity, including molecular neuroscience, cellular neuroscience, systems neuroscience, behavioral neuroscience, and cognitive neuroscience, with an overall premise that the activity of the brain creates what is known as the human mind (Bear et al., 2020). The understanding that knowledge of human brain functioning is essential and critical for advancing the study and human-systems at work and in everyday life led to the emergence of neuroergonomics as a separate scientific discipline.
Neuroergonomics, as a field of research, has emerged at the very end of the 20th century with the aim to “study the brain at work and in everyday life.” The term was initially proposed by Raja Parasuraman and this new discipline was progressively matured and formalized during the following decade (Hancock and Szalma, 2003; Karwowski et al., 2003; Parasuraman, 2003; Sarter and Sarter, 2003). The birth of this discipline constitutes the achievement of the visionary researchers who sought to innovate by combining theoretical advances in cognitive neuroscience and brain imaging, bio-engineering, genetics, computer science and human factors to better understand human performance in the real world. As reminded by Hancock (2019), neuroergonomics finds its roots in research initiated by researchers concerned with the measure of the neural correlate underlying vigilance, engagement, attention, and multitasking (Parasuraman, 1979; Wickens et al., 1983). Neuroergonomics has grown from the root of the early work on functional neuroimaging (Ogawa et al., 1990; Chance et al., 1993), brain computer interfaces (Vidal, 1973), neurofeedback (Lubar and Shouse, 1976) and neurostimulation (Magnusson and Stevens, 1914; Nitsche and Paulus, 2000). This research paved the way to define a novel framework to go beyond the traditional subjective and behavioral approach sometimes promoted by the human factors and ergonomics community.
Indeed, neuroergonomics proposition is to open the “black box” and to investigate the neurocognitive processes supporting human performance outside the laboratory. This approach to neuroscience offers insight into global neural processing that cannot be achieved using the typical lab settings and artificial tasks. One can propose three main pillars of neuroergonomics: (1) neuroergonomics theory, (2) neuroergonomics abstraction, and (3) neuroergonomics design (Karwowski, 2013). Neuroergonomics theory focuses on the ability to identify, describe, and evaluate human brain signatures and neural markers of human performance, including brain-system interactions in the context of work and technology. Neuroergonomics abstraction refers to the ability to use the neural signatures and relevant brain-system interactions to make predictions about human performance that can be validated in the real world of everyday activities. Finally, neuroergonomics design considers implementing knowledge about the human brain necessary to develop systems that satisfy individual compatibility requirements from the neural processing point of view. Given the above, the neuroergonomics design process can be represented as mapping human brain capabilities and limitations to system-technology-environment requirements and affordances.
To meet this challenge, neuroergonomics has forged its own mobile cutting-edge tools benefiting from the technological advances in highly portable brain imaging, signal processing, artificial intelligence and increased computational power. Within the last decade, this emerging discipline has demonstrated potential to advances our understanding of brain with practical applications in diverse sectors such as medicine, education/training, aviation, automotive, manufacturing, administration, entertainment, communication and everyday life at large (Parasuraman, 2011; Parasuraman et al., 2012; McKendrick et al., 2015; Gramann et al., 2017; Ayaz and Dehais, 2019). Neuroergonomics has now bloomed and grown to several branches such as cognitive, physical, social, consumer, clinical, augmented & synthetic, and neurotechnology & system neuroergonomics (see Figure 1) to reach new heights in the understanding of our brain at work and in everyday life situation.
Figure 1
Here, we identify seven specific sub-domains of neuroergonomics: (i) Cognitive neuroergonomics is concerned with the neural dynamics information underlying perception, attention, memory, emotion, cognitive control and decision during interaction with technical systems at work or in everyday life, using both established neuroimaging approaches and mobile brain imaging methods. (ii) Physical neuroergonomics deals with the human brain in control of muscular performance, movement, and brain-body interactions in conditions of health, workplace, fatigue, training, injury, and disease states. (iii) Social neuroergonomics focuses on how people perform social interaction with other individuals, automation, and autonomy for a diverse spectrum, including teaming, communication, trust, collaboration, competition, or interacting in different ways to share physical or cognitive tasks. (iv) Consumer neuroergonomics research has a strong focus on products, services, and systems on the assessment of their effects on well-being or performance, as well as optimization of design and overall evaluation of any human-interfacing artifact. (v) Augmented & synthetic neuroergonomics focuses on the use of simulations/mixed/virtual reality techniques as well as brain stimulation for cognitive enhancement with or without neuroimaging to investigate and augment brain functioning (e.g., learning/training, perception, affective states) in the real world. (vi) Neurotechnology and Systems neuroergonomics consider all aspects of neurotechnology, which is a topical category of technology where system design incorporates neural principles or directly interfaces with signals from the brain and body. Systems neuroergonomics aims to integrate approaches from neuroergonomics into the design, development, and management of complex systems over their life cycles. And, finally (vii) Clinical neuroergonomics encompasses the utilization of mobile neurotechnologies for brain health and performance across the lifespan as well as prognosis, diagnosis, or personalized treatment of neurological and psychiatric disorders, from hospital to out-patient-clinical settings and particularly toward home settings.
The Challenges
The exploration of the brain functioning “in the wild” requires mastering knowledge in many technical and theoretical concepts. Neuroergonomics research cannot be achieved through the prism of a single domain. For instance, understanding the brain is not a purely scientific or engineering problem as some may think. The brain needs to be analyzed through its physical, biological, psychological and sociological dimensions. As portable neuroimaging devices become more “plug-and-play,” widespread and cheap, a common misunderstanding may arise that neuroergonomics is just about putting sensors and collecting data on the human brain. The discipline of neuroergonomics should be driven by research questions, theories, concepts, and hypotheses together with well-designed protocols, adequate metrics, and well-thought through statistical procedures and other analytical and quantitative approaches. Progress in this field also requires researchers to work as teams in a truly transdisciplinary spirit, following sound ethical principles. This is how brain research will prove to be efficient, reproducible, and will benefit society at large.
Challenge 1: Methodological Considerations
The first main challenge for neuroergonomics is to implement an innovative methodology to avoid the pitfalls of reductionist approach leading to place participants facing repetitive and boring artificial tasks causing degradation of data due to attentional and motivational effects as well as investigating task load with realistic/real-world complex cognitive tasks, with studies ranging from pilots, air traffic controllers, surgeons, car drivers, teacher-students in classroom to pedestrians navigating outdoors (Ayaz et al., 2012; Mühl et al., 2014; McKendrick et al., 2016; Arico et al., 2017; Unni et al., 2017; Bevilacqua et al., 2018; Di Flumeri et al., 2018; Gateau et al., 2018; Callan and Dehais, 2019; Djebbara et al., 2019; Modi et al., 2019; Wunderlich and Gramann, 2020). Thus, the challenge for neuroergonomics is to design an engaging ecological paradigm while assuring a high experimental control level. High-quality neuroergonomics research should proceed by conducting a continuum of experiments starting with controlled protocols with high spatial resolution devices (e.g., fMRI, MEG) progressing to more ecological experiments in dynamic micro-worlds using portable devices that are portable but with lower accuracy, to eventually conducting less controlled experiments in a realistic simulated environment and the real world (Ayaz and Dehais, 2019). This implies the use of complex and continuous natural stimuli (e.g., videos, speech, simulator) and the implementation of appropriate signal conditioning and statistical methods to decode the associated brain response on the fly (see, for example, Wong et al., 2018). Much progress has to be made in this direction, including the design of novel protocols and methods to investigate individual differences. This is an important issue as it may affect the sample size, induce biases of the results and the interpretation at the group level, and decrease single-trial classification accuracy. This is also a relevant to the design of personalized products, services, and neuroadaptive technologies and to improve the efficiency of neurostimulation and neurofeedback.
Challenge 2: Concepts, Measures, and Metrics
Another challenge for neuroergonomics is to develop and shape its own concepts rather than borrowing constructs from other fields. Following this perspective, efforts should be put toward defining new concepts to assess and predict human performance per se. For example, most of the research to-date has focused on the measurement of mental workload, but this transactional construct remains difficult to operationalize despite decades of research and more than 200,000 publications since the early 2000s'. As a measure, the mental workload is highly sensitive to inter and intra-individual variability and is limited to providing a non-specific and global indicator rather like a thermometer. However, unlike a thermometer, it does not give access to an absolute and reliable assessment of degraded performance. We advocate rather to identify neurophysiological, physiological and behavioral markers that specifically account for degraded mental states ranging from task disengagement (e.g., mind wandering, effort withdrawal) to task over-engagement (e.g., attentional tunneling, perseveration, inattentional blindness, and deafness see Dehais et al., 2020 for a comprehensive review). This approach will allow us to design neuroadaptive technology to monitor the mental states and trigger appropriate cognitive-countermeasures to mitigate their deleterious effects on human performance.
There is also a myriad of methods to measure cerebral activity, and new tools and innovative approaches are published every year. For instance, a recent and exciting trend is to implement connectivity metrics over fMRI, MEG, EEG, or fNIRS signals to identify neural pathways and brain dynamics (Farahani et al., 2019). It offers exciting prospects for hyperscanning purposes to study social cognition at the cortical level. Researchers have a choice between model-free vs. model-based, Granger-based, phase-based, information-based, or high-order and non-linear methods. Each of these methods can be implemented via different formalisms (e.g., phase slope index, phase-locking factor, phase-locking values). There is a critical need to establish a consensus and recommend that authors benchmark these methods when reporting their results rather than publishing only the successful ones.
Challenge 3: Improving Portable Sensors
The rapid evolution of personal electronics in the last quarter century has seen remarkable innovation in computers, digitization of sensors and adoption of wearable sensing technologies. Data that could only be collected in laboratory environments is nowadays more accessible, affordable, and easily integrated into popular electronics and other smart devices. This technological development has moved quickly to meet a growing demand for health-analytics, driven by individuals who wanted to learn more about themselves. While, modern activity trackers have introduced physiological measurements such as heart-rate to measure physical exertion or correlates of stress, these measures are fundamentally non-specific, thereby leaving a picture that is far from complete. In order to expand on the features available currently and elevate the role of continuous monitoring solutions in work and at home, the application of wearable sensors must be expanded to new areas and nowhere is there more untapped potential than in the brain (Curtin and Ayaz, 2018).
New applications are now possible due to wearable and mobile nature of portable neuroimaging like investigating neural correlates of spatial navigation and movement (Djebbara et al., 2019), multi-brain interaction (Liu et al., 2017), practical brain-computer interfaces (Zander et al., 2016) and brain to brain interfaces (Jiang et al., 2019). In fact, portable neuroimaging miniaturization efforts started early 2000s (Ayaz et al., 2013; Yücel et al., 2017) and the latest generation of mobile battery operated and wireless systems have allowed monitoring brain activity and investigating cognition-in-action, in increasingly realistic and real-world settings like participants walking outdoors (McKendrick et al., 2016), students in classroom (Poulsen et al., 2017), air-traffic-controllers working on radars (Ayaz et al., 2012), surgeons performing operations (Shewokis et al., 2017; Modi et al., 2019) to pilots flying aircrafts up in the sky (Gateau et al., 2018).
Technical progress has led to the design of portable wireless devices that allow reasonable degrees of freedom of movement to measure brain activity under increasingly naturalistic settings. The development of dry electrodes expanded rapid out-of-lab applications for EEG and has been shown to provide useable signal quality (Zander et al., 2017). Moreover, for optical brain imaging, fiber-less flat sensors were able to increase the surface area of light detectors to increase resistance for motion artifacts, much needed for mobile applications (Ayaz et al., 2013; Wang et al., 2017). However, there are still obstacles plaguing the widespread use of portable and ultra-portable sensors. Several new directions have to be taken to improve and generalize the use of portable neuroimaging for everyday life situations, and specifically at home settings and in clinical applications. For instance, dry-electrode and fiber-based sensors inevitably lead to significant discomfort for participants after an hour. New mobile solutions such as unobtrusive cEEgrid, in-hear electrodes, miniaturized prefrontal adhesive-optodes could allow to overcome these issues. However, one should be aware that these solutions reduce their potential to account for the complexity of the brain. EEG and fNIRS still face some inherent limitations, respectively, in terms of spatial and temporal resolutions. A recent trend is to perform concurrent fNIRS and EEG recording to overcome each other measurement weaknesses and to give a better insight on neurovascular coupling. Again, the combination of these techniques has a cost in terms of setting time, weight, and discomfort for participants. These settings generally result in a non-ideal compromise in terms of signal quality either for fNIRS or for EEG. Hardware should be developed to fully integrate these sensors in a non-intrusive fashion. Futuristic novel approaches are under development, such as holographic optical brain monitoring re-forms light passing through the body may also revolutionize the scanning of the brain in the real world. Similarly, portable magnetoencephalography portable devices are starting to be developed and becoming a new complementary media to investigate human cognition (Boto et al., 2018).
Challenge 4: Advancing Brain Stimulation
Non-invasive brain stimulation techniques such as transcranial magnetic stimulation (TMS) and variants of transcranial electrical stimulation (tES) such as transcranial direct current stimulation (tDCS) can alter brain function by positioning the actuator devices over the scalp. Such neuromodulation approaches have led to a proliferation of research on the brain and cognitive augmentation, both in healthy adults and in patients with neurological or psychiatric disease. Neuromodulation has shown a lot of promise in the treatment of heterogeneous psychiatric disorders and TMS is already FDA approved for multiple indications: major depression, migraine pain, and obsessive-compulsive disorder. The tES systems have the potential for portability and, new methodological developments (Knotkova et al., 2019) offer new vistas for research and clinical use and even at-home settings (Charvet et al., 2020). Furthermore, integration of these technologies with neuroimaging provides opportunities for read-write brain-computer interfaces, that can both monitor and alter brain activity, (see Cinel et al., 2019 and Rao, 2019 for descriptions and Jiang et al., 2019, for a closed loop multi-brain example) as well as rehabilitation for diverse clinical indications (Teo et al., 2016). There are already best-practices guidelines and systematic reviews for multimodal use: tDCS+fMRI (Esmaeilpour et al., 2020), TMS+fNIRS (Curtin et al., 2019), TMS+EEG (Darmani and Ziemann, 2019).
Moreover, newer techniques have been emerging. Focused ultrasound (FUS) promises to bring together strong features of TMS and tES, high spatial resolution and wearable mobile footprint, respectively, into a single system. So far it has been studied with animal models, and a few human studies have been reported. There are still significant engineering and safety challenges before effective research systems could be available.
A more futuristic neuromodulation technique is optogenetics: a combination of genetic and optical methods for targeted and fast control of neural activity (Deisseroth, 2011). Optogenetics utilizes light for milli-second resolution speed and cell-type specific precise control for neurons. As it requires viral injection to modify the genetic material of target neurons (to insert light-sensitive receptor protein on the cell membrane), this technique cannot be used on humans and is not currently compatible with neuroergonomic approach. However, it has become a workhorse of neuroscience to understand diverse neural systems both in healthy and disease animal models.
Recent trends in neuroergonomics and neural engineering have used neurotechnologies to enhance various human capabilities (cognitive function like attention, decision-making, mood), and treat neurological and psychiatric disorders (Valero-Cabre et al., 2017; Cinel et al., 2019). Neurotechnologies for brain stimulation are evolving rapidly, and new advances in the techniques and applications are expected in near to mid-term. However, research is still needed to assess the effectiveness of such technology as some studies found that effects remain inconsistent (Bestmann et al., 2015; Horvath et al., 2015), and new guidelines for realistic environments are emerging only very recently (Bikson et al., 2020; Charvet et al., 2020).
Challenge 5: Artificial Intelligence for Neuroergonomics
Another significant development that will have a substantial impact on future advances in neuroergonomics is the rapid progress in artificial intelligence (AI) (Jason, 2017). Artificial intelligence technology, particularly machine learning (ML), has become ubiquitous for solving many complex problems in our daily lives (Bengio et al., 2013). Many AI approaches, including, for example, Support Vector Machine (SVM) and Fisher Linear Discriminant (FLD), have been successfully used for the assessment of brain states based on fMRI data (Mourao-Miranda et al., 2005). The analysis of fMRI scans by means of SVM has also been applied to a sensory-motor task (Wang et al., 2007). Furthermore, it was demonstrated that the functional brain analysis with neurophysiological interpretation could be facilitated by transforming neural networks “backward models” into “forward models” which is applicable for both EEG and fMRI experimental data (Haufe et al., 2014; Li et al., 2018). Deep learning (DL), a subset of ML, has shown remarkable progress in recent years, including applications to assessment of human performance, with a variety of applications such as image classification, speech recognition, or natural language processing (LeCun et al., 2015; Schmidhuber, 2015). Recently, DL with convolutional neural networks has been successfully applied for EEG decoding and visualization purposes (Schirrmeister et al., 2017). The use of such an approach remains challenging because neuroergonomics experiments generally lead to collect small data samples thus limiting the application of DL techniques. We encourage researchers to share their data with the community following the Brain Imaging Data Structure (BIDS) recommendations so as to constitute very large database to improve our understanding of the brain via AI. Such big data of brain could enable larger scale teamwork across interdisciplinary teams and multi-site collaborations.
Recent advances in the theory and applications of explainable artificial intelligence (XAI) to neuroscience (Fellous et al., 2019), is of high relevance to the field of neuroergonomics. Humans beings are already interacting with robots and AI-based algorithms, and this trend will continue to increase. It is of great importance to ensure transparency and explainability of these artificial decisional systems and their evolution over time to improve trust and optimal human-machine teaming. Currently, the main areas of XAI research in the domain of neuroscience include (1) identifying how explainable learning solutions can be applied, (2) developing a community of scholars working with XAI, and (3) stimulating an open exchange of data and theories. In the near future, it will be possible to apply XAI techniques for intelligent decoding and the modulation of behaviorally activated brain circuits to improve our understanding of human behavior in real-world settings. For example, Searchlight, a sophisticated form of XAI approach, has been developed for the visualization of fMRI, allowing to identify differences in the regional spatial activity pattern of the brain under a variety of experimental conditions (Kriegeskorte et al., 2006). Recently, the potential value of XAI in the field of neurostimulation was demonstrated by Fellous et al. (2019). However, as recently discussed by Arrieta et al. (2020), the field of XAI faces many challenges, including setting the objective metrics on what constitutes a good explanation. For example, Páez (2019) noted that the term “explanation,” as it is currently used in XAI, does not share the properties that are attributed to explanations in epistemology and the philosophy of science, and that the interpretative AI models can provide false assurances of comprehensibility. Furthermore, the barrier of explainability brought by sub-symbolism of deep neural networks initiated the discussion of responsible artificial intelligence, i.e. the ways to implement AI methods with fairness, model explainability, and accountability (Leslie, 2019; Arrieta et al., 2020). Finally, Byrne (2019) pointed out that XAI could benefit from including the rich knowledge in cognitive science about human reasoners' cognitive capacities.
This approach can provide promising prospects for the challenges proposed by the National Academy of Engineering (National Academy of Engineering, 2008) to “reverse engineer the human brain.” The realization of such a challenge requires a much better understanding of brain structure and its cognitive functions, and, among other advantages, would lead to the development of general-purpose artificial intelligence, facilitate human learning, improve methods for diagnosing, treating, and monitoring mental illnesses in a personalized manner, or develop a variety of neuroprosthetics (Roysam et al., 2009). It was also observed that the reverse-engineering the brain is critical to understanding the human mind that will have a profound impact on the future advances in technology, health, and society at large. Clearly, neuroergonomics discipline can contribute to and benefit from the realization of this grand challenge.
Challenge 6: Cognitive Freedom, Privacy, and Ethics in the Age of Neuroergonomics
The advances of neurotechnologies that can record and alter brain activity provide increasingly powerful tools for neuroergonomists and allied professionals and, are rapidly transforming research with implications for everyday life. It is clear that these more powerful methods mean more responsibilities for neuroergonomists. This calls for a new age “neuroergonomics philosophy” as recently defined by Onaral (2021) and informs rethinking of the “neuroergonomic ethos.”
The field of neuroethics emerged in early 2000s triggered with the awareness of advances in cognitive neuroscience (Farah, 2005). Neuroethics encompasses a large and varied set of issues, from practical considerations, like use of neurotechnology or the data, to more philosophical issues. Several ethical and philosophical issues regarding have been recently discussed (Levy, 2007; Giordano and Gordijn, 2010; Farah, 2015; Amadio et al., 2018; Zuk et al., 2018). It can be argued that neuroergonomics faces similar ethical and philosophical challenges as cognitive neuroscience. For example, Farah (2005) and Farah (2015) discussed the implications of the developments in neurotechnology for individuals and society, including the philosophical concerns, including the impact of cognitive neuroscience on the way we think about ourselves as persons, the issue of moral agents, and spiritual beings, the nature of mind, and, ultimately, how, neuroscience will shape the future of individuals and society at large. Recently, Amadio et al. (2018), discussed several neuroethics questions to guide ethical research concerning the potential impact of a model or neuroscientific account of disease on individuals, communities, and society. For example, among many, the following set of considerations, which are also relevant to the field of neuroergonomics, have been posed:
What are the possible unintended consequences of neuroscience research on social stigma and self-stigma?
Is it possible that social or cultural bias has been introduced in research design or in the interpretation of scientific results?
How can human brain data (e.g., images, neural recordings, etc.), and the privacy of participants from whom data is acquired, be protected in case of immediate, or legacy use beyond the experiment?
What are the requisite or minimum features of engineered neural circuitry required to generate a concern about moral significance?
Are the ethical standards for research conduct adequate and appropriate for the evolving methodologies and brain models?
How could brain interventions impact or reduce autonomy?
What measures can be in place to ensure optimal autonomy and agency for participants/users?
Who will have responsibility for effects (where responsibility has broad meaning encompassing legal, economic, and social contexts)?
In which contexts might a neuroscientific technology/innovation be used or deployed?
New ethical challenges that were hypothetical previously are becoming more practical concerns, like who should have access to brain activity patterns, changing personalities with brain stimulation, and mind reading and writing. Considering the growing privacy concerns even about the web surfing behavior, and that social media activity can be used and abused by third parties, the privacy in the age of neuroergonomics is ever vulnerable. Privacy of our brain is the most sensitive data of all as it encapsulates our inner-most thoughts and intents, and the most critical to protect for individuals and society at large. Akin to basic human rights, we should define and protect our neuro rights, fundamental to cognitive freedom and personhood (Ienca and Andorno, 2017).
Responsible neuroergonomics research requires awareness of current neuroethical challenges and continuous interaction among all stakeholders: researchers, ethicists, regulators, lawmakers, lawyers and public at large. As new innovations emerge in neuroergonomic technologies, methods and application, so do new ethical dilemmas. For example, ethical issues specifically arising from the use of portable neuroimaging is recently outlined (Shen et al., 2020), multi-person brain to brain interfacing (Hildt, 2019) and, benefits/risks of neuroenhancement of surgeons (Patel et al., 2020). Recently, Farahany and Ramos (2020) highlighted that neuroethics can foster necessary and beneficial collaborations for responsible neuroscientific discovery. Neuroethics should be an integral part of neuroergonomics, and with the use of foresight, open communication, strategic planning, we can all truly benefit from the advances of neuroergonomics research and development.
Conclusion
As stated by Parasuraman (2003), the focus of neuroergonomics is on the investigation of the neural bases of mental functions and physical performance in relation to technology, work, leisure, and a broad set of real-world settings, including, e.g., health care, transportation, and many other areas of human endeavor in the wild. As a unique new discipline, neuroergonomics should help to increase our knowledge about the role of the brain in shaping the complex inter-relationships between humans (human capacities and limitations), their every-day life social and natural environment, technology (products, machines, devices, processes), and broadly-defined work systems (business processes and organizational structures).
In our view, neuroergonomics, as a fast-growing field of research, will have robust theoretical and practical implications for discovering useful and impactful knowledge about human neural capacities and limitations in the context of our everyday activities at work, home, and at leisure. We look forward to facilitating the development of this new field of study for the ultimate benefit of improving the quality of life for the billions of people around the world, and we hope that you will join us on this exciting journey.
Statements
Author’s note
This is a Field Grand Challenge submitted by the Field Chief Editors.
Author contributions
All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AmadioJ.BiG. Q.BoshearsP. F.CarterA.DevorA.DoyaK.et al. (2018). Neuroethics questions to guide ethical research in the international brain initiatives. Neuron100, 19–36. 10.1016/j.neuron.2018.09.021
2
AricoP.BorghiniG.FlumeriG. D.BonelliS.GolfettiA.GrazianiI.et al. (2017). Human factors and neurophysiological metrics in air traffic control: a critical review. IEEE Rev. Biomed. Eng.10, 250–263. 10.1109/RBME.2017.2694142
3
ArrietaA. B.Díaz-RodríguezN.Del SerJ.BennetotA.TabikS.BarbadoA.et al. (2020). Explainable Artificial Intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inform. Fusion58:82. 10.1016/j.inffus.2019.12.012
4
AyazH.DehaisF. (eds.). (2019). Neuroergonomics: The Brain at Work and in Everyday Life. London: Elsevier; Academic Press.
5
AyazH.OnaralB.IzzetogluK.ShewokisP. A.McKendrickR.ParasuramanR. (2013). Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci.7, 1–13. 10.3389/fnhum.2013.00871
6
AyazH.ShewokisP. A.BunceS.IzzetogluK.WillemsB.OnaralB. (2012). Optical brain monitoring for operator training and mental workload assessment. Neuroimage59, 36–47. 10.1016/j.neuroimage.2011.06.023
7
BearM.ConnorsB.ParadisoM. A. (2020). Neuroscience: Exploring the Brain. Burlington: Jones & Bartlett Learning LLC.
8
BengioY.CourvilleA.VincentP. (2013). Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell.35, 1798–1828. 10.1109/TPAMI.2013.50
9
BestmannS.de BerkerA. O.BonaiutoJ. (2015). Understanding the behavioural consequences of noninvasive brain stimulation. Trends Cogn. Sci. 19, 13–20. 10.1016/j.tics.2014.10.003
10
BevilacquaD.DavidescoI.WanL.ChalonerK.RowlandJ.DingM.et al. (2018). Brain-to-brain synchrony and learning outcomes vary by student–teacher dynamics: evidence from a real-world classroom electroencephalography study. J. Cogn. Neurosci.31, 401–411. 10.1162/jocn_a_01274
11
BiksonM.HanlonC. A.WoodsA. J.GillickB. T.CharvetL.LammC.et al. (2020). Guidelines for TMS/tES clinical services and research through the COVID-19 pandemic. Brain Stimul.13, 1124–1149. 10.1016/j.brs.2020.05.010
12
BotoE.HolmesN.LeggettJ.RobertsG.ShahV.MeyerS. S.et al. (2018). Moving magnetoencephalography towards real-world applications with a wearable system. Nature555, 657–661. 10.1038/nature26147
13
ByrneR. M. (2019). Counterfactuals in explainable artificial intelligence (XAI): evidence from human reasoning. In IJCAI (Macao), 6276–6282. 10.24963/ijcai.2019/876
14
CallanD. E.DehaisF. (2019). “Neuroergonomics for aviation,” in Neuroergonomics, eds H. Ayaz and F. Dehais (London: Elsevier; Academic Press), 55–58. 10.1016/B978-0-12-811926-6.00009-9
15
ChanceB.ZhuangZ.UnAhC.AlterC.LiptonL. (1993). Cognition-activated low-frequency modulation of light absorption in human brain. Proc. Natl. Acad. Sci. U.S.A90, 3770–3774. 10.1073/pnas.90.8.3770
16
CharvetL. E.ShawM. T.BiksonM.WoodsA. J.KnotkovaH. (2020). Supervised transcranial direct current stimulation (tDCS) at home: a guide for clinical research and practice. Brain Stimul.13, 686–693. 10.1016/j.brs.2020.02.011
17
CinelC.ValerianiD.PoliR. (2019). Neurotechnologies for human cognitive augmentation: current state of the art and future prospects. Front. Hum. Neurosci. 13:13. 10.3389/fnhum.2019.00013
18
CurtinA.AyazH. (2018). The age of neuroergonomics: towards ubiquitous and continuous measurement of brain function with fNIRS. Jap. Psychol. Res.60, 374–386. 10.1111/jpr.12227
19
CurtinA.TongS.SunJ.WangJ.OnaralB.AyazH. (2019). A systematic review of integrated functional near-infrared spectroscopy (fNIRS) and transcranial magnetic stimulation (TMS) studies. Front. Neurosci. 13:84. 10.3389/fnins.2019.00084
20
DarmaniG.ZiemannU. (2019). Pharmacophysiology of TMS-evoked EEG potentials: A mini-review. Brain Stimul. Basic Transl. Clin. Res. Neuromodul.12, 829–831. 10.1016/j.brs.2019.02.021
21
DehaisF.LafontA.RoyR.FaircloughS. (2020). A neuroergonomics approach to mental workload, engagement and human performance. Front. Neurosci.14:268. 10.3389/fnins.2020.00268
22
DeisserothK. (2011). Optogenetics. Nat. Methods8, 26–29. 10.1038/nmeth.f.324
23
Di FlumeriG.BorghiniG.Aric,òP.SciaraffaN.LanziP.PozziS.et al. (2018). EEG-based mental workload neurometric to evaluate the impact of different traffic and road conditions in real driving settings. Front. Hum. Neurosci.12:509. 10.3389/fnhum.2018.00509
24
DjebbaraZ.FichL. B.PetriniL.GramannK. (2019). Sensorimotor brain dynamics reflect architectural affordances. Proc. Natl. Acad. Sci. U.S.A.116:14769. 10.1073/pnas.1900648116
25
EsmaeilpourZ.ShereenA. D.Ghobadi-AzbariP.DattaA.WoodsA. J.IronsideM.et al. (2020). Methodology for tDCS integration with fMRI. Hum. Brain Mapp.41, 1950–1967. 10.1002/hbm.24908
26
FarahM. J. (2005). Neuroethics: the practical and the philosophical. Trends Cogn. Sci. (Regul. Ed)9, 34–40. 10.1016/j.tics.2004.12.001
27
FarahM. J. (2015). An ethics toolbox for neurotechnology. Neuron86, 34–37. 10.1016/j.neuron.2015.03.038
28
FarahaniV. F.KarwowskiW.LighthallN. (2019). Application of graph theory for identifying connectivity patterns in human brain networks: a systematic review. Front. Neurosci.13:585. 10.3389/fnins.2019.00585
29
FarahanyN.RamosK. M. (2020). Neuroethics: fostering collaborations to enable neuroscientific discovery. AJOB Neurosci.11, 148–154. 10.1080/21507740.2020.1778117
30
FellousJ. M.SapiroG.RossiA.MaybergH. S.FerranteM. (2019). Explainable artificial intelligence for neuroscience: behavioral neurostimulation. Front. Neurosci.13:1346. 10.3389/fnins.2019.01346
31
FingerS. (2000). The Minds Behind the Brain. Oxford: Oxford University Press.
32
GateauT.AyazH.DehaisF. (2018). In silico vs. over the clouds: on-the-fly mental state estimation of aircraft pilots, using a functional near infrared spectroscopy based passive-BCI. Front. Hum. Neurosci. 12:187. 10.3389/fnhum.2018.00187
33
GiordanoJ. J.GordijnB. (Eds.). (2010). Scientific and Philosophical Perspectives in Neuroethics.Cambridge University Press. 10.1017/CBO9780511676505
34
GramannK.FaircloughS. H.ZanderT. O.AyazH. (2017). Editorial: trends in neuroergonomics. Front. Hum. Neurosci. 11:165. 10.3389/fnhum.2017.00165
35
HancockP. (2019). Neuroergonomics: where the cortex hits the concrete. Front. Hum. Neurosci.13:115. 10.3389/fnhum.2019.00115
36
HancockP. A.SzalmaJ. L. (2003). The future of neuroergonomics. Theoret. Issues Ergon. Sci.4, 238–249. 10.1080/1463922021000020927
37
HaufeS.MeineckeF.GörgenK.DähneS.HaynesJ. D.BlankertzB.et al. (2014). On the interpretation of weight vectors of linear models in multivariate neuroimaging. Neuroimage87, 96–110. 10.1016/j.neuroimage.2013.10.067
38
HildtE. (2019). Multi-person brain-to-brain interfaces: ethical issues. Front. Neurosci.13:1177. 10.3389/fnins.2019.01177
39
HorvathJ. C.ForteJ. D.CarterO. (2015). Evidence that transcranial direct current stimulation (tDCS) generates little-to-no reliable neurophysiologic effect beyond MEP amplitude modulation in healthy human subjects: a systematic review. Neuropsychologia66, 213–236. 10.1016/j.neuropsychologia.2014.11.021
40
IencaM.AndornoR. (2017). Towards new human rights in the age of neuroscience and neurotechnology. Life Sci. Soc. Policy13:5. 10.1186/s40504-017-0050-1
41
Jason (2017). Artificial Intelligence for Health and Health Care. JSR-17-Task-002. McLean, VA: The MITRE Corporation.
42
JiangL.StoccoA.LoseyD. M.AbernethyJ. A.PratC. S.RaoR. P. N. (2019). BrainNet: a multi-person brain-to-brain interface for direct collaboration between brains. Sci. Rep.9:6115. 10.1038/s41598-019-41895-7
43
KarwowskiW. (2005). Ergonomics and human factors: the paradigms for science, engineering, design, technology and management of human-compatible systems. Ergonomics48, 436–463. 10.1080/00140130400029167
44
KarwowskiW. (2013). “Neuroergonomics: a complex system perspective,” in Neuroergonomics: A Cognitive Neuroscience Approach to Human Factors and Ergonomics, eds A. Johnson and R. Proctor (New York, NY: Springer), xx–xxiv.
45
KarwowskiW.SiemionowW.Gielo-PerczakK. (2003). Physical neuroergonomics: the human brain in control of physical work activities. Theoret. Issues Ergon. Sci.4, 175–199. 10.1080/1463922021000032339
46
KnotkovaH.NitscheM. ABiksonMWoodsA. J. (eds.). (2019). Practical Guide to Transcranial Direct Current Stimulation: Principles, Procedures and Applications. Springer. 10.1007/978-3-319-95948-1
47
KriegeskorteN.GoebelR.BandettiniP. (2006). Information-based functional brain mapping. Proc. Natl. Acad. Sci. U.S.A.103, 3863–3868. 10.1073/pnas.0600244103
48
LeCunY.BengioY.HintonG. (2015). Deep learning. Nature521, 436–444. 10.1038/nature14539
49
LeslieD. (2019). Understanding Artificial Intelligence Ethics and Safety: A Guide for the Responsible Design and Implementation of AI Systems in the Public Sector. The Alan Turing Institute. 10.5281/zenodo.3240529
50
LevyN. (2007). Neuroethics: Challenges for the 21st Century. Cambridge: Cambridge University Press.
51
LiX.DvornekN. C.ZhuangJ.VentolaP.DuncanJ. S. (2018). “Brain biomarker interpretation in ASD using deep learning and fMRI,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2018, eds A. F. Frangi, J. A. Schnabel, C. Davatzikos, C. Alberola-López, G. Fichtinger (Cham: Springer International Publishing), 206–214. 10.1007/978-3-030-00931-1_24
52
LiuY.PiazzaE. A.SimonyE.ShewokisP. A.OnaralB.HassonU.et al. (2017). Measuring speaker–listener neural coupling with functional near infrared spectroscopy. Sci. Rep.7:43293. 10.1038/srep43293
53
LubarJ. F.ShouseM. N. (1976). EEG and behavioral changes in a hyperkinetic child concurrent with training of the sensorimotor rhythm (SMR). Biofeedback Self Regul.1, 293–306. 10.1007/BF01001170
54
MagnussonC. E.StevensH. C. (1914). XXIV. Visual sensations caused by a magnetic field. The London, Edinburgh, and Dublin Philosophical Magazine. J. Sci.28, 188–207. 10.1080/14786440808635200
55
McKendrickR.ParasuramanR.AyazH. (2015). Wearable functional near infrared spectroscopy (fNIRS) and transcranial direct current stimulation (tDCS): expanding vistas for neurocognitive augmentation. Front. Syst. Neurosci.9:27. 10.3389/fnsys.2015.00027
56
McKendrickR.ParasuramanR.MurtzaR.FormwaltA.BaccusW.PaczynskiM.et al. (2016). Into the wild: neuroergonomic differentiation of hand-held and augmented reality wearable displays during outdoor navigation with functional near infrared spectroscopy. Front. Hum. Neurosci. 10:216. 10.3389/fnhum.2016.00216
57
ModiH.N.SinghH.FiorentinoF.Orihuela-EspinaF.AthanasiouT.YangG. Z.et al. (2019). Association of residents' neural signatures with stress resilience during surgery. JAMA Surg. 154:e192552. 10.1001/jamasurg.2019.2552
58
Mourao-MirandaJ.BokdeA. L.BornC.HampelH.StetterM. (2005). Classifying brain states and determining the discriminating activation patterns: support vector machine on functional MRI data. Neuroimage28, 980–995. 10.1016/j.neuroimage.2005.06.070
59
MühlC.JeunetC.LotteF. (2014). EEG-based workload estimation across affective contexts. Front. Neurosci. (2014) 8:114. 10.3389/fnins.2014.00114
60
National Academy of Engineering (2008). NAE Grand Challenges for Engineering. Available online at: www.engineeringchallenges.org/challenges/16091.aspx
61
National Institutes of Health (2014). BRAIN 2025: A Scientific Vision. Brain Research Through Advancing Innovative Neurotechnologies (BRAIN) Working Group Report to the Advisory Committee to the Director, NIH. Available online at: https://braininitiative.nih.gov/strategic-planning/brain-2025-report
62
NitscheM. A.PaulusW. (2000). Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. J. Physiol. (Lond)527, 633–639. 10.1111/j.1469-7793.2000.t01-1-00633.x
63
OgawaS.LeeT.KayA.TankD. (1990). Brain magnetic resonance imaging with contrast dependent on blood oxygenation. Proc. Natl. Acad. Sci. U.S.A.87:9868. 10.1073/pnas.87.24.9868
64
OnaralB. (2021). “Responsible brain-system integration,” in Advances in Neuroergonomics and Cognitive Engineering. AHFE 2020. Advances in Intelligent Systems and Computing, vol 1201, eds H. Ayaz and U. Asgher (Cham: Springer). 10.1007/978-3-030-51041-1_15
65
PáezA. (2019). The pragmatic turn in explainable artificial intelligence (XAI). Minds Mach.29, 441–459. 10.1007/s11023-019-09502-w
66
ParasuramanR. (1979). Memory load and event rate control sensitivity decrements in sustained attention. Science205, 924–927. 10.1126/science.472714
67
ParasuramanR. (2003). Neuroergonomics: Research and practice. Theoret. Issues Ergon. Sci.4, 5–20. 10.1080/14639220210199753
68
ParasuramanR. (2011). Neuroergonomics brain, cognition, and performance at work. Curr. Dir. Psychol. Sci.20, 181–186. 10.1177/0963721411409176
69
ParasuramanR.ChristensenJ.GraftonS. (2012). Neuroergonomics: the brain in action and at work. Neuroimage59, 1–3. 10.1016/j.neuroimage.2011.08.011
70
ParasuramanR.RizzoM. (2007). Neuroergonomics: The Brain at Work. New York, NY: Oxford University Press.
71
PatelR.AshcroftJ.DarziA.SinghH.LeffD. R. (2020). Neuroenhancement in surgeons: benefits, risks and ethical dilemmas. Br. J. Surg. 107, 946–950. 10.1002/bjs.11601
72
PosnerM. I. (2012). Expanding horizons in ergonomics research. Neuroimage59, 149–153. 10.1016/j.neuroimage.2011.07.060
73
PoulsenA. T.KamronnS.DmochowskiJ.ParraL. C.HansenL. K. (2017). EEG in the classroom: synchronised neural recordings during video presentation. Sci. Rep.7:43916. 10.1038/srep43916
74
RaoR. P. (2019). Towards neural co-processors for the brain: combining decoding and encoding in brain–computer interfaces. Curr. Opin. Neurobiol.55, 142–151. 10.1016/j.conb.2019.03.008
75
RoysamB.ShainW.AscoliG. A. (2009). The central role of neuroinformatics in the national academy of engineering's grandest challenge: reverse engineer the brain. Neuroinform7, 1–5. 10.1007/s12021-008-9043-9
76
SarterN.SarterM. (2003). Neuroergonomics: Opportunities and challenges of merging cognitive neuroscience with cognitive ergonomics. Theoretical Issues in Ergonomics Science 4, 142–150.
77
SchirrmeisterR. T.SpringenbergJ. T.FiedererL. D. J.GlasstetterM.EggenspergerK.TangermannM.et al. (2017). Deep learning with convolutional neural networks for EEG decoding and visualization. Hum. Brain Mapp. 38, 5391–5420. 10.1002/hbm.23730
78
SchmidhuberJ. (2015). Deep learning in neural networks: An overview. Neural. Netw.61, 85–117. 10.1080/1463922021000020882
79
ShenF. X.WolfS. M.GonzalezR. G.GarwoodM. (2020). Ethical issues posed by field research using highly portable and cloud-enabled neuroimaging. Neuron105, 771–775. 10.1016/j.neuron.2020.01.041
80
ShewokisP. A.ShariffF. U.LiuY.AyazH.CastellanosA.LindD. S. (2017). Acquisition, retention and transfer of simulated laparoscopic tasks using fNIR and a contextual interference paradigm. Am. J. Surg.213, 336–345. 10.1016/j.amjsurg.2016.11.043
81
TeoW. P.MuthalibM.YaminS.HendyA. M.BramstedtK.KotsopoulosE.et al. (2016). Does a combination of virtual reality, neuromodulation and neuroimaging provide a comprehensive platform for neurorehabilitation?-A narrative review of the literature. Front. Hum. Neurosci. 10:284. 10.3389/fnhum.2016.00284
82
UnniA.IhmeK.JippM.RiegerJ. W. (2017). Assessing the driver's current level of working memory load with high density functional near-infrared spectroscopy: a realistic driving simulator study. Front. Hum. Neurosci. 11:167. 10.3389/fnhum.2017.00167
83
Valero-CabreA.AmengualJ. L.StengelC.Pascual-LeoneA.CoubardO. A. (2017). Transcranial magnetic stimulation in basic and clinical neuroscience: A comprehensive review of fundamental principles and novel insights. Neurosci. Biobehav. Rev.83, 381–404. 10.1016/j.neubiorev.2017.10.006
84
VidalJ. J. (1973). Toward direct brain-computer communication. Annu. Rev. Biophys. Bioeng. 2, 157–80. 10.1146/annurev.bb.02.060173.001105
85
WangL.AyazH.IzzetogluM.OnaralB. (2017). Evaluation of light detector surface area for functional Near Infrared Spectroscopy. Comput. Biol. Med.89, 68–75. 10.1016/j.compbiomed.2017.07.019
86
WangZ.ChildressA. R.WangJ.DetreJ. A. (2007). Support vector machine learning-based fMRI data group analysis. Neuroimage36, 1139–1151. 10.1016/j.neuroimage.2007.03.072
87
WickensC.KramerA.VanasseL.DonchinE. (1983). Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. Science221, 1080–1082. 10.1126/science.6879207
88
WongD. D.FuglsangS. A.HjortkjærJ.CeoliniE.SlaneyM.De CheveigneA. (2018). A comparison of regularization methods in forward and backward models for auditory attention decoding. Front. Neurosci.12:531. 10.3389/fnins.2018.00531
89
WunderlichA.GramannK. (2020). Brain dynamics of assisted pedestrian navigation in the real-world. bioRxiv 2020.2006.2008.139469. 10.1101/2020.06.08.139469
90
YücelM. A.SelbJ. J.HuppertT. J.FranceschiniM. A.BoasD. A. (2017). Functional near infrared spectroscopy: enabling routine functional brain imaging. Curr. Opin. Biomed. Eng. 4, 78–86.
91
ZanderT. O.AndreessenL. M.BergA.BleuelM.PawlitzkiJ.ZawallichL.et al. (2017). Evaluation of a dry EEG system for application of passive brain-computer interfaces in autonomous driving. Front. Hum. Neurosci. 11:78. 10.3389/fnhum.2017.00078
92
ZanderT. O.KrolL. RBirbaumerN. P.GramannK. (2016). Neuroadaptive technology enables implicit cursor control based on medial prefrontal cortex activity. Proc. Natl. Acad. Sci. U.S.A. 113, 14898–14903. 10.1073/pnas.1605155114
93
ZukP.TorgersonL.Sierra-MercadoD.Lázaro-MuñozG. (2018). Neuroethics of neuromodulation: an update. Curr. Opin. Biomed. Eng.8, 45–50. 10.1016/j.cobme.2018.10.003
Summary
Keywords
neuroergonomics, cognition, mobile brain imaging, neurotechnology, human system interaction, neuroscience
Citation
Dehais F, Karwowski W and Ayaz H (2020) Brain at Work and in Everyday Life as the Next Frontier: Grand Field Challenges for Neuroergonomics. Front. Neuroergon. 1:583733. doi: 10.3389/fnrgo.2020.583733
Received
15 July 2020
Accepted
28 August 2020
Published
27 October 2020
Volume
1 - 2020
Edited and reviewed by
Michael Posner, University of Oregon, United States
Updates
Copyright
© 2020 Dehais, Karwowski and Ayaz.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Frederic Dehais Frederic.Dehais@isae-supaero.fr
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.