Abstract
Affective neurofeedback training allows for the self-regulation of the putative circuits of emotion regulation. This approach has recently been studied as a possible additional treatment for psychiatric disorders, presenting positive effects in symptoms and behaviors. After neurofeedback training, a critical aspect is the transference of the learned self-regulation strategies to outside the laboratory and how to continue reinforcing these strategies in non-controlled environments. In this mini-review, we discuss the current achievements of affective neurofeedback under naturalistic setups. For this, we first provide a brief overview of the state-of-the-art for affective neurofeedback protocols. We then discuss virtual reality as a transitional step toward the final goal of “in-the-wild” protocols and current advances using mobile neurotechnology. Finally, we provide a discussion of open challenges for affective neurofeedback protocols in-the-wild, including topics such as convenience and reliability, environmental effects in attention and workload, among others.
1. Introduction
Neurofeedback is a sub-area of brain-computer interfaces (BCIs), in which the subject is trained to achieve voluntary control of the ongoing neural activity in brain regions or circuits (Sitaram et al., 2017; Watanabe et al., 2017; Thibault et al., 2018). For this, the user is presented with real-time feedback related to brain activity and must develop and optimize self-regulation strategies to improve the control performance (Strehl, 2014; Sitaram et al., 2017). Applications of neurofeedback range from performance optimization in sports (Mirifar et al., 2017) to clinical applications, where the main objective is to target abnormal functional structures to reduce or even eliminate symptoms (Thibault et al., 2018).
One field that can benefit from neurofeedback protocols is psychiatry (Kim and Birbaumer, 2014; Arns et al., 2017; Thibault et al., 2018). A common approach in these cases is affective neurofeedback (Linhartová et al., 2019), where the protocols target putative mechanisms of emotion regulation (Lindquist et al., 2012, 2016). Recent studies described promising results from neurofeedback training in patients with affective disorders, such as major depressive disorder (MDD) (Trambaiolli et al., 2021a). Moreover, recent studies show that neurofeedback training can lead to symptom improvements that last for weeks after intervention (Rance et al., 2018). Other observed benefits include the normalization of dysfunctional structures and plastic reorganization of intrinsic functional connectivity (Hampson et al., 2011; Scheinost et al., 2013) and directed effective connectivity (Zotev et al., 2011, 2013).
One crucial step for neurofeedback-based therapies is transferring the learned self-regulation strategies to real-life situations, outside of the overly controlled experimental setups (Brühl, 2015; Thibault et al., 2018). This approach is of particular importance to affective neurofeedback experiments since real-life scenarios most likely will include distractors, stressors, or other confounds that could affect the learned self-regulation strategies (Kadosh and Staunton, 2019). In this context, naturalistic setups are of extreme relevance to evaluate affective neurofeedback feasibility as a potential therapeutic approach. Although rare, neurofeedback and BCI experiments have been studied in the real-world (also referred to as “in-the-wild”) (Kosmyna, 2019). Moreover, virtual reality (VR) environments provide immersive, naturalistic experiences that can be used as an intermediate step toward applications in-the-wild. This approach is supported by computational (Renard et al., 2010) and instrumental (Cassani et al., 2020a) advances in the BCI field, providing the necessary tools to create neurofeedback protocols using VR.
This mini-review discusses the state-of-the-art of affective neurofeedback protocols under naturalistic conditions and open challenges in the field. For this, we first provide a brief overview of affective neurofeedback protocols using different neuroimaging modalities. We discuss the possibility of using VR as a transitional step toward experiments in-the-wild and evaluate current protocols using this feedback modality. Then, we assess the status of neurofeedback experiments outside the laboratory and discuss open challenges for developing affective neurofeedback protocols in such conditions.
2. Current Status of Affective Neurofeedback
Electroencephalography (EEG) was the first neuroimaging method used in developing affective neurofeedback protocols, with the first case reports dated from the 1990s (Rosenfeld et al., 1996; Baehr et al., 1997; Earnest, 1999). Usually, these protocols target the activity in prefrontal portions of the scalp. For example, the most common approach relies on possible asymmetries in channels over the prefrontal regions of the scalp (Choi et al., 2011; Peeters et al., 2014; Quaedflieg et al., 2016). This methodology assumes that the hyper- and hypo-activation of opposite hemispheres indicate the valence experienced during emotion regulation (Harmon-Jones et al., 2010) and may reflect symptoms in psychiatric patients (Thibodeau et al., 2006). Controlled experiments show that alpha asymmetry neurofeedback training may reduce negative mood and anxiety in healthy subjects (Quaedflieg et al., 2016; Mennella et al., 2017), as well as relieve depressive symptoms in patients with MDD (Choi et al., 2011; Wang et al., 2019). More examples of EEG-based neurofeedback include the control of alpha or beta bands over the parietal cortex (Escolano et al., 2014; Wang et al., 2019), sensorimotor rhythms (Lee et al., 2019), frequency ratios (Lee et al., 2019), among others.
With the advent of functional magnetic resonance imaging (fMRI), neurofeedback protocols were able to target more precisely the putative mechanisms of emotion regulation (Lindquist et al., 2012, 2016). In this context, different approaches were developed over the years, including protocols targeting the self-regulation of single regions of interest (ROIs) within these networks (Zotev et al., 2011; Young et al., 2014, 2017), multiple regions (Johnston et al., 2010, 2011; Linden et al., 2012; Mehler et al., 2018), or the functional connectivity between areas (Koush et al., 2017). In these cases, common targets include areas such as the lateral and medial prefrontal cortex (PFC), anterior cingulate cortex (ACC), insular cortex (IC), amygdala, among others (Linhartová et al., 2019). For instance, protocols targeting the amygdala self-regulation led to mood changes in healthy subjects (Zotev et al., 2011), and reduced symptoms in patients with MDD (Young et al., 2014, 2017). Moreover, functional connectivity reorganization was observed in these patients (Yuan et al., 2014; Young et al., 2018), as well as in subjects with post-traumatic stress disorder (PTSD) (Misaki et al., 2018). In approaches targeting multiple regions, although healthy subjects did not report changes in mood after training (Johnston et al., 2011), patients with MDD showed symptom improvement after multiple training sessions (Linden et al., 2012; Mehler et al., 2018), with benefits persisting at follow-up (Mehler et al., 2018).
The neurofeedback approach used by EEG and fMRI, although based on different methodologies, presents correlated neural mechanisms. For instance, the self-regulation of the amygdala during neurofeedback also engages brain structures from the frontal cortex (Zotev et al., 2013). Furthermore, studies with simultaneous EEG and fMRI recordings demonstrate an existing association between the amygdala self-regulation and the frontal EEG asymmetry (Zotev et al., 2016, 2018). In this context, Zotev and colleagues recently proposed a hybrid neurofeedback protocol, combining fMRI and EEG data during emotion regulation and demonstrating its feasibility with healthy subjects and MDD patients (Zotev et al., 2014, 2020; Zotev and Bodurka, 2020).
More recently, the use of functional near-infrared spectroscopy (fNIRS) has been explored (Ehlis et al., 2018; Kohl et al., 2020). Protocols targeting areas such as the dorsolateral PFC (dlPFC) (Marx et al., 2015; Hudak et al., 2017; Kimmig et al., 2019) and the orbitofrontal cortex (OFC) (Li et al., 2019) have been studied in healthy subjects and psychiatric populations, although not necessarily targeting emotion regulation. However, several studies using multivariate pattern recognition approaches demonstrated that fNIRS signals from the PFC are sufficient to decode affective processing during the visualization of pictures (Hosseini et al., 2011; Trambaiolli et al., 2018b, 2021b) and videos (Bandara et al., 2018; Hu et al., 2019), as well as during autobiographical affective imagery (Tai and Chau, 2009; Trambaiolli et al., 2018b, 2021b). In this context, Trambaiolli et al. (2018a) proposed a decoding-based affective neurofeedback protocol recalling positive autobiographical memories. Healthy participants were able to achieve satisfactory control of their prefrontal and occipital neural activity. However, further testing of this approach in clinical samples is still needed.
3. Virtual Reality as a Transitional Step
Virtual reality (VR) is an immersive three-dimensional graphical system that provides the sense of presence in the virtual world (Burdea and Coiffet, 2003). This sensation can be experienced by real-time interactions with the synthetic environment (Lotte et al., 2012). To improve the level of interaction, one may also use information from the participant, including body movements or physiological responses (Kritikos et al., 2021). This technology has been investigated as a potential therapeutic approach for neuromotor rehabilitation (Massetti et al., 2016; Ravi et al., 2017), or as an exposure therapy in psychiatry (Maples-Keller et al., 2017; Deng et al., 2019). Moreover, it also allows for investigations combining VR and neuromodulatory technologies (Cassani et al., 2020b). Even though the VR scenario emulates a real-world situation, the experimenter still has control over the environment, and the session can be stopped at any time the patient is uncomfortable (Maples-Keller et al., 2017). Thus, it provides advantages in experimental manipulation and control not previously available.
When combined with neurofeedback, VR can be used to evaluate how a less controlled environment influences the neurofeedback protocol, as well as the learned strategies. For instance, different neurofeedback protocols for attention training included a virtual classroom environment (Rohani and Puthusserypady, 2015; Hudak et al., 2017). In BCI protocols using EEG-based P300 signals, participants were able to control the system even in the presence of distracting elements (Rohani and Puthusserypady, 2015). In an fNIRS-based protocol, participants that learned how to self-regulate their hemodynamic signal in the dlPFC showed improved performance in inhibitory control tasks after training (Hudak et al., 2017). Moreover, a study comparing two-dimensional (2D) and three-dimensional (3D) VR feedback showed higher learning rates in the 3D-VR group (Berger and Davelaar, 2018).
Specific to affective neurofeedback, few protocols can be found in the literature using VR as a feedback tool. For instance, Lorenzetti et al. (2018) proposed a proof-of-concept fMRI-based experiment, with feedback provided by changing the color of the VR scenario. Participants were trained to self-regulate their neural activity in an ROI-based (amygdala) or decoding-based neurofeedback while inducing and sustaining complex emotions, such as tenderness and anguish. Although showing the technical feasibility of incorporating VR to affective neurofeedback, the color-changing scenario did not properly emulate a real-world situation.
On the other hand, the study from Aranyi et al. (2016) trained healthy participants to cheer up a virtual agent using the self-regulation of the asymmetry of fNIRS oxyhemoglobin concentrations in the dlPFC (this dataset is currently publicly available for future investigations; Charles et al., 2020). In a different study, Yamin et al. (2017) trained participants with depth electrodes in the amygdala to down-regulate this region while receiving feedback from virtual agents in a waiting room environment. In both experiments, participants were able to self-regulate the desired ROIs while receiving feedback in the VR setup. Moreover, the feedback provided is more consistent with possible situations faced by patients in real life.
4. Toward Affective Neurofeedback In-the-Wild
Neurofeedback protocols in-the-wild will allow for the continuity of the training outside of the research or clinical environment. This will ensure the reinforcement or adaptation of the developed strategies for the maintenance of long-term benefits.
MEG and fMRI have the highest spatial resolution among the most popular non-invasive neurofeedback protocols. Recent advances in the development of portable scanners (Boto et al., 2018; Wald et al., 2020; Zhang et al., 2020) bring hope to applications in the mid- and long-term future. However, the physical restraints associated with current equipment make in-the-wild experiments impractical (Sulzer et al., 2013). In this context, to increase the portability of a neurofeedback system, the use of mobile or wireless EEG and fNIRS devices emerge as a possible solution (Hondrou and Caridakis, 2012; Pinti et al., 2018; Quaresima and Ferrari, 2019). Comparative studies show that mobile EEG devices have similar accuracy to over the bench equipment (De Vos et al., 2014; Ries et al., 2014), and its applications include studying neural correlates of motor behavior (Packheiser et al., 2020), attention monitoring (Ladouce et al., 2019), and mental state monitoring in ambulatory conditions (Albuquerque et al., 2020; Parent et al., 2020). However, these devices require more pre-processing and filtering steps to compensate for biological artifacts (for instance, ocular and muscular activity) or instrumental and environmental noises (electrode misplacement, electrical, and radio-frequency interference, among others) (Fairclough and Lotte, 2020). Mobile fNIRS devices have also been tested in-the-wild, for instance, while walking (Doi et al., 2013; Mirelman et al., 2014; Maidan et al., 2016), playing table tennis (Balardin et al., 2017b), or playing violin (Vanzella et al., 2019). Similar to EEG, mobile fNIRS have to account for muscular artifacts (Balardin et al., 2017a), as well as instrumental and environmental noises such as optical decoupling and local luminance (Pinti et al., 2018). These approaches can also be combined into hybrid protocols, which have the advantage of combining multiple aspects of neural activity (for example, electric and hemodynamic changes) (Pfurtscheller et al., 2010; Müller-Putz et al., 2011, 2015). In this context, researchers have been developing mobile, and modular multimodal sensors combining EEG and fNIRS channels (von Lühmann et al., 2016).
Studies investigating the feasibility of affective neurofeedback protocols in-the-wild are still rare. However, studies using similar approaches in-the-wild, such as brain-machine interfaces (BMI), can be found in the literature. For instance, healthy participants were able to control the directions of a wheelchair based on P300 (Iturrate et al., 2009), steady-state visual evoked potentials (SSVEP) (Müller et al., 2013), or P300+SSVEP signals combined (Li et al., 2013). Moreover, using a stimulus-independent design, paraplegic patients learned to control a lower limb exoskeleton during gait using a motor imagery protocol (Donati et al., 2016). These examples provide a rationale for the possibility of experimenting with affective neurofeedback protocols in-the-wild.
5. Challenges for Affective Neurofeedback In-the-Wild
Although presenting promising results in controlled environments, current affective neurofeedback protocols face several methodological challenges for real-world applications (Kosmyna, 2019). If neglected, these aspects will become a barrier for in-the-wild setups, and cause frustration and lead to discontinued training. Due to these caveats, some of these challenges are listed, and potential solutions are discussed next.
5.1. Convenience
The physical limitations experienced during current protocols play a fundamental challenge for naturalistic experiences. For instance, fMRI protocols are physically restrictive, and the user may experience claustrophobia during the session (Sulzer et al., 2013). On the other hand, EEG- and fNIRS-based protocols may require a relatively long time for the cap preparation (positioning, conductive gel, calibration, among others). It also results in residual gel over the participant's head after the session. In this context, the use of dry and active electrodes is a possible alternative to reduce the inconvenience of the setup preparation (Lopez-Gordo et al., 2014). For instance, commercially available EEG headbands using dry electrodes were successfully employed in emotion classification in the lab (Arsalan et al., 2019), as well as during attention training neurofeedback (Kovacevic et al., 2015) and stress monitoring (Parent et al., 2020) experiments in-the-wild. Thus, these types of setups should be further explored for affective neurofeedback in-the-wild.
5.2. Feedback Modality
The feedback modality is important during reinforcement learning. For studies using VR, visual feedback seems to be an obvious choice. However, for in-the-wild applications, the best feedback approach is still an open question. One portable option would be using a laptop for real-time data processing and providing visual feedback, but other mobile devices, such as cellphones and tablets, should be explored. For instance, stimulus-dependent BCI protocols are already possible using these devices (Wang et al., 2013; Jijun et al., 2015). Although not typical for affective neurofeedback, other feedback modalities should be explored in-the-wild (Sitaram et al., 2017). For instance, haptic and auditory feedback could be integrated with current wearable technologies, such as smartwatches and headphones, respectively.
5.3. Attention and Workload Variations
Under naturalistic conditions, the neurofeedback protocol will need to consider different effects caused by the environment. For instance, environmental distractions may influence the attention, stress levels, and mental workload, leading to physiological noises such as abrupt changes in EOG and EMG signals caused by reflexive eye movements or muscular responses (Theeuwes et al., 1998; de Wied et al., 2006). Moreover, our brain is continuously processing environmental information, so involuntary neural patterns will also be caused by the environment (Engelien et al., 2000; Boly et al., 2004). As previously mentioned, multimodal approaches could be a solution combining biosignals from different sources to separate the desired neural signal from physiological noises (Pfurtscheller et al., 2010; Müller-Putz et al., 2011, 2015). Additionally, hybrid systems may be used to monitor levels of stress and mental workload to adapt the neurofeedback algorithm (Albuquerque et al., 2020; Parent et al., 2020). For instance, the study from Falk et al. (2010) evaluated the effects of physiological and auditory noises emulating real-world situations during tasks commonly used in BCI experiments. After using compensatory algorithms, participants were able to control the BCI system with performances similar to the silent conditions. In a different scenario, the incorporation of error-related potentials in the BCI algorithm also led to optimized training results (Chavarriaga et al., 2014; Spüler and Niethammer, 2015).
5.4. Algorithm Robustness
As previously described, EEG and fNIRS are the most commonly used neuroimaging modalities in-the-wild. However, these technologies are prone to non-neural physiological noises, such as electromagnetic fields for EEG and environmental light sources for fNIRS (Fatourechi et al., 2007; Strait and Scheutz, 2014; Minguillon et al., 2017). Such noise sources require robust artifact removal algorithms (Fairclough and Lotte, 2020), for example using adaptative filters (Rosanne et al., 2021), or real-time independent component analysis (ICA) (Mayeli et al., 2016; Val-Calvo et al., 2019). Additionally, these algorithms should be simple and computational cost-effective, once they will ultimately be implemented and run in portable devices.
5.5. Decoding Performance
Some neurofeedback protocols use decoding-based approaches (Taschereau-Dumouchel et al., 2020), which allow the bi-directional (up and down) self-regulation of multiple regions or channels, leading to differential plasticity changes in specific subgroups of neurons (Shibata et al., 2019). This approach may require multiple training/calibration blocks before the algorithm starts to identify the user's neural patterns. Although a recent survey shows that while the participants are comprehensive about the need for training blocks during the first session (Kosmyna, 2019), it may become a problem for long-term usage. Also, under naturalistic setups, the decoder is likely to present higher intra-session variability given the shifts in attention and stress levels, mental workload, or environmental noises, as mentioned above. In this context, alternatives such as the use of subject-independent protocols (Ray et al., 2015; Trambaiolli et al., 2021b), artificially generated training samples (Lotte, 2015), or self-recalibrating classifiers (Bishop et al., 2014) have been explored. Moreover, these approaches will be facilitated given recent efforts to create open-access big-databases from decoding-based neurofeedback (Cortese et al., 2021), or affective decoding experiments (Abadi et al., 2015; Lan et al., 2020).
5.6. Non-specific Effects
Although showing potential benefits in specific clinical populations, the results from neurofeedback training can be driven by non-specific effects (Ros et al., 2020). For instance, similar to other clinical interventions, patients under neurofeedback training may present clinical improvement due to placebo effects (Thibault and Raz, 2017; Thibault et al., 2017). Also, other areas composing large-scale networks may present variations in addition to the targeted region of interest (Mayeli et al., 2020). In the context of protocols under naturalistic conditions, the participant may show improvement in mood and anxiety symptoms based on the enriched environment or interaction with the high-tech setup. In this context, studies investigating affective neurofeedback in naturalistic setups must follow proper designs for control groups and measures (Sorger et al., 2019), and adequate reporting practices (Ros et al., 2020).
5.7. Replicability and Reproducibility
Current neurofeedback studies still lack a detailed description of online signal processing (Heunis et al., 2020), while recent checklists do not address the detailed description of offline analysis (Tursic et al., 2020). The accurate and detailed description of experimental protocols and analytical methods is crucial to ensure proper replication studies in the neurofeedback field (Melnikov, 2021). This is particularly important for experiments in-the-wild that will require extensive pipelines to deal with new types of movement and environmental noises (Fairclough and Lotte, 2020).
5.8. Neurofeedback Illiteracy
BCI illiteracy is a phenomenon in which 10–50% of BCI users will not gain voluntary control of their neural activity (Allison and Neuper, 2010; Edlinger et al., 2015). This concept can also be expanded to neurofeedback protocols (Alkoby et al., 2018). In this context, there is an increasing interest for physiological or psychological predictors describing who would benefit from neurofeedback training (Alkoby et al., 2018). For example, several studies report functional neural networks (Weber et al., 2011; Scheinost et al., 2014; Wan et al., 2014; Trambaiolli et al., 2018a) and neuroanatomical differences (Halder et al., 2013) are related to the neurofeedback literacy in both healthy and clinical populations. Also, psychological aspects as control belief, frustration, concentration, among others, play an essential role during the training performance (Alkoby et al., 2018; Kadosh and Staunton, 2019). However, studies of illiteracy predictors are mainly based on experiments under very controlled environments. How these predictors will be affected during neurofeedback training in naturalist setups remains unknown. Moreover, future investigations should identify possible differences between responders in controlled environments and responders under naturalistic setups. For instance, those undergoing VR-based training might experience cybersickness (Weech et al., 2019), which may lead to a new illiteracy category. This way, proper training, and transfer strategies will be developed for each group of users.
6. Conclusion
Affective neurofeedback has been investigated as a potential therapeutic tool in psychiatry, showing promising results in many clinical samples. To advance this technology, the study of neurofeedback protocols under naturalistic conditions is necessary. It will optimize the transference of the learned self-regulation strategies to real-world scenarios or extend the neurofeedback training outside the lab. This mini-review showed that VR setups are already being explored for affective neurofeedback protocols and can be used as a transitional step before investigations in-the-wild. Moreover, the rise of portable EEG and fNIRS devices and the successful application of these instruments for BCI protocols in-the-wild endorse the technical feasibility of affective neurofeedback in such conditions. Besides improving the strategy transference and continuous training, designs that work in-the-wild could be a solution to bring neurofeedback to patients who can not visit large imaging centers for different reasons (location, mobility limitations, among others). Moreover, these protocols and related training can be expanded to non-clinical environments, including applications in gaming, affective computing, sports performance, among others. We close with a discussion on open challenges for neurofeedback training in-the-wild, including: convenience and reliability of the neurofeedback setup, environmental effects in attention and workload, non-specific effects, and possible new neurofeedback illiteracy categories.
Statements
Author contributions
All authors contributed equally to the intellectual efforts and writing of the paper.
Funding
This study was funded by the Natural Sciences and Engineering Research Council of Canada (NSERC), grant number RGPIN-2016-04175.
Acknowledgments
The authors thank Dr. Raymundo Cassani for valuable discussions on this topic.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AbadiM. K.SubramanianR.KiaS. M.AvesaniP.PatrasI.SebeN. (2015). DECAF: MEG-based multimodal database for decoding affective physiological responses. IEEE Trans. Affect. Comput. 6, 209–222. 10.1109/TAFFC.2015.2392932
2
AlbuquerqueI.TiwariA.ParentM.CassaniR.GagnonJ.-F.LafondD.et al. (2020). WAUC: a multi-modal database for mental workload assessment under physical activity. Front. Neurosci. 14:549524. 10.3389/fnins.2020.549524
3
AlkobyO.Abu-RmilehA.ShrikiO.TodderD. (2018). Can we predict who will respond to neurofeedback? A review of the inefficacy problem and existing predictors for successful EEG neurofeedback learning. Neuroscience378, 155–164. 10.1016/j.neuroscience.2016.12.050
4
AllisonB. Z.NeuperC. (2010). Could anyone use a BCI?, in Brain-Computer Interfaces, eds TanD.NijholtA. (London: Springer), 35–54. 10.1007/978-1-84996-272-8_3
5
AranyiG.PecuneF.CharlesF.PelachaudC.CavazzaM. (2016). Affective interaction with a virtual character through an fNIRS brain-computer interface. Front. Comput. Neurosci. 10:70. 10.3389/fncom.2016.00070
6
ArnsM.BatailJ.-M.BioulacS.CongedoM.DaudetC.DrapierD.et al. (2017). Neurofeedback: One of today's techniques in psychiatry?L'encephale43, 135–145. 10.1016/j.encep.2016.11.003
7
ArsalanA.MajidM.ButtA. R.AnwarS. M. (2019). Classification of perceived mental stress using a commercially available EEG headband. IEEE J. Biomed. Health Inform. 23, 2257–2264. 10.1109/JBHI.2019.2926407
8
BaehrE.RosenfeldJ. P.BaehrR. (1997). The clinical use of an alpha asymmetry protocol in the neurofeedback treatment of depression: two case studies. J. Neurother. 2, 10–23. 10.1300/J184v02n03_02
9
BalardinJ. B.MoraisG. A. Z.FuruchoR. A.TrambaiolliL. R.SatoJ. R. (2017a). Impact of communicative head movements on the quality of functional near-infrared spectroscopy signals: negligible effects for affirmative and negative gestures and consistent artifacts related to raising eyebrows. J. Biomed. Opt. 22:046010. 10.1117/1.JBO.22.4.046010
10
BalardinJ. B.Zimeo MoraisG. A.FuruchoR. A.TrambaiolliL.VanzellaP.BiazoliC. Jret al. (2017b). Imaging brain function with functional near-infrared spectroscopy in unconstrained environments. Front. Hum. Neurosci. 11:258. 10.3389/fnhum.2017.00258
11
BandaraD.VelipasalarS.BrattS.HirshfieldL. (2018). Building predictive models of emotion with functional near-infrared spectroscopy. Int. J. Hum. Comput. Stud. 110, 75–85. 10.1016/j.ijhcs.2017.10.001
12
BergerA. M.DavelaarE. J. (2018). Frontal alpha oscillations and attentional control: a virtual reality neurofeedback study. Neuroscience378, 189–197. 10.1016/j.neuroscience.2017.06.007
13
BishopW.ChestekC. C.GiljaV.NuyujukianP.FosterJ. D.RyuS. I.et al. (2014). Self-recalibrating classifiers for intracortical brain-computer interfaces. J. Neural Eng. 11:026001. 10.1088/1741-2560/11/2/026001
14
BolyM.FaymonvilleM.-E.PeigneuxP.LambermontB.DamasP.Del FioreG.et al. (2004). Auditory processing in severely brain injured patients: differences between the minimally conscious state and the persistent vegetative state. Arch. Neurol. 61, 233–238. 10.1001/archneur.61.2.233
15
BotoE.HolmesN.LeggettJ.RobertsG.ShahV.MeyerS. S.et al. (2018). Moving magnetoencephalography towards real-world applications with a wearable system. Nature555, 657–661. 10.1038/nature26147
16
BrühlA. B. (2015). Making sense of real-time functional magnetic resonance imaging (RTfMRI) and RTfMRI neurofeedback. Int. J. Neuropsychopharmacol. 18:pyv020. 10.1093/ijnp/pyv020
17
BurdeaG. C.CoiffetP. (2003). Virtual Reality Technology. Hoboken, NJ: John Wiley & Sons. 10.1162/105474603322955950
18
CassaniR.MoinnereauM.-A.IvanescuL.RosanneO.FalkT. H. (2020a). Neural interface instrumented virtual reality headsets: toward next-generation immersive applications. IEEE Syst. Man Cybernet. Mag. 6, 20–28. 10.1109/MSMC.2019.2953627
19
CassaniR.NovakG. S.FalkT. H.OliveiraA. A. (2020b). Virtual reality and non-invasive brain stimulation for rehabilitation applications: a systematic review. J. Neuroeng. Rehabil. 17, 1–16. 10.1186/s12984-020-00780-5
20
CharlesF.MartinsC. D. C.CavazzaM. (2020). Prefrontal asymmetry bci neurofeedback datasets. Front. Neurosci. 14:601402. 10.3389/fnins.2020.601402
21
ChavarriagaR.SobolewskiA.MillánJ. d. R. (2014). Errare machinale est: the use of error-related potentials in brain-machine interfaces. Front. Neurosci. 8:208. 10.3389/fnins.2014.00208
22
ChoiS. W.ChiS. E.ChungS. Y.KimJ. W.AhnC. Y.KimH. T. (2011). Is alpha wave neurofeedback effective with randomized clinical trials in depression? A pilot study. Neuropsychobiology63, 43–51. 10.1159/000322290
23
CorteseA.TanakaS. C.AmanoK.KoizumiA.LauH.SasakiY.et al. (2021). The DecNef collection, fmri data from closed-loop decoded neurofeedback experiments. Sci. Data8, 1–9. 10.1038/s41597-021-00845-7
24
De VosM.KroesenM.EmkesR.DebenerS. (2014). P300 speller bci with a mobile eeg system: comparison to a traditional amplifier. J. Neural Eng. 11:036008. 10.1088/1741-2560/11/3/036008
25
de WiedM.van BoxtelA.ZaalbergR.GoudenaP. P.MatthysW. (2006). Facial EMG responses to dynamic emotional facial expressions in boys with disruptive behavior disorders. J. Psychiatr. Res. 40, 112–121. 10.1016/j.jpsychires.2005.08.003
26
DengW.HuD.XuS.LiuX.ZhaoJ.ChenQ.et al. (2019). The efficacy of virtual reality exposure therapy for PTSD symptoms: a systematic review and meta-analysis. J. Affect. Disord. 257, 698–709. 10.1016/j.jad.2019.07.086
27
DoiT.MakizakoH.ShimadaH.ParkH.TsutsumimotoK.UemuraK.et al. (2013). Brain activation during dual-task walking and executive function among older adults with mild cognitive impairment: a fNIRS study. Aging Clin. Exp. Res. 25, 539–544. 10.1007/s40520-013-0119-5
28
DonatiA. R.ShokurS.MoryaE.CamposD. S.MoioliR. C.GittiC. M.et al. (2016). Long-term training with a brain-machine interface-based gait protocol induces partial neurological recovery in paraplegic patients. Sci. Rep. 6, 1–16. 10.1038/srep30383
29
EarnestC. (1999). Single case study of EEG asymmetry biofeedback for depression: an independent replication in an adolescent. J. Neurother. 3, 28–35. 10.1300/J184v03n02_04
30
EdlingerG.AllisonB. Z.GugerC. (2015). How many people can use a BCI system?Clin. Syst. Neurosci. 33–66. 10.1007/978-4-431-55037-2_3
31
EhlisA.-C.BarthB.HudakJ.StorchakH.WeberL.KimmigA.-C. S.et al. (2018). Near-infrared spectroscopy as a new tool for neurofeedback training: applications in psychiatry and methodological considerations. Jpn. Psychol. Res. 60, 225–241. 10.1111/jpr.12225
32
EngelienA.HuberW.SilbersweigD.SternE.FrithC. D.DöringW.et al. (2000). The neural correlates of 'deaf-hearing' in man: conscious sensory awareness enabled by attentional modulation. Brain123, 532–545. 10.1093/brain/123.3.532
33
EscolanoC.Navarro-GilM.Garcia-CampayoJ.CongedoM.De RidderD.MinguezJ. (2014). A controlled study on the cognitive effect of alpha neurofeedback training in patients with major depressive disorder. Front. Behav. Neurosci. 8:296. 10.3389/fnbeh.2014.00296
34
FaircloughS. H.LotteF. (2020). Grand challenges in neurotechnology and system neuroergonomics. Front. Neuroergon. 1:2. 10.3389/fnrgo.2020.602504
35
FalkT. H.GuirgisM.PowerS.ChauT. T. (2010). Taking NIRS-BCIs outside the lab: towards achieving robustness against environment noise. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 136–146. 10.1109/TNSRE.2010.2078516
36
FatourechiM.BashashatiA.WardR. K.BirchG. E. (2007). EMG and EOG artifacts in brain computer interface systems: a survey. Clin. Neurophysiol. 118, 480–494. 10.1016/j.clinph.2006.10.019
37
HalderS.VarkutiB.BogdanM.KüblerA.RosenstielW.SitaramR.et al. (2013). Prediction of brain-computer interface aptitude from individual brain structure. Front. Hum. Neurosci. 7:105. 10.3389/fnhum.2013.00105
38
HampsonM.ScheinostD.QiuM.BhawnaniJ.LacadieC. M.LeckmanJ. F.et al. (2011). Biofeedback of real-time functional magnetic resonance imaging data from the supplementary motor area reduces functional connectivity to subcortical regions. Brain Connect. 1, 91–98. 10.1089/brain.2011.0002
39
Harmon-JonesE.GableP. A.PetersonC. K. (2010). The role of asymmetric frontal cortical activity in emotion-related phenomena: a review and update. Biol. Psychol. 84, 451–462. 10.1016/j.biopsycho.2009.08.010
40
HeunisS.LamerichsR.ZingerS.Caballero-GaudesC.JansenJ. F.AldenkampB.et al. (2020). Quality and denoising in real-time functional magnetic resonance imaging neurofeedback: a methods review. Hum. Brain Mapp. 41, 3439–3467. 10.1002/hbm.25010
41
HondrouC.CaridakisG. (2012). “Affective, natural interaction using EEG: sensors, application and future directions,” in Hellenic Conference on Artificial Intelligence (Lamia: Springer), 331–338. 10.1007/978-3-642-30448-4_42
42
HosseiniS. H.ManoY.RostamiM.TakahashiM.SugiuraM.KawashimaR. (2011). Decoding what one likes or dislikes from single-trial fNIRS measurements. Neuroreport22, 269–273. 10.1097/WNR.0b013e3283451f8f
43
HuX.ZhuangC.WangF.LiuY.-J.ImC.-H.ZhangD. (2019). fNIRS evidence for recognizably different positive emotions. Front. Hum. Neurosci. 13:120. 10.3389/fnhum.2019.00120
44
HudakJ.BlumeF.DreslerT.HaeussingerF. B.RennerT. J.FallgatterA. J.et al. (2017). Near-infrared spectroscopy-based frontal lobe neurofeedback integrated in virtual reality modulates brain and behavior in highly impulsive adults. Front. Hum. Neurosci. 11:425. 10.3389/fnhum.2017.00425
45
IturrateI.AntelisJ. M.KublerA.MinguezJ. (2009). A noninvasive brain-actuated wheelchair based on a p300 neurophysiological protocol and automated navigation. IEEE Trans. Robot. 25, 614–627. 10.1109/TRO.2009.2020347
46
JijunT.PengZ.RanX.LeiD. (2015). “The portable P300 dialing system based on tablet and emotiv EPOC headset,” in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Milan), 566–569. 10.1109/EMBC.2015.7318425
47
JohnstonS.LindenD. E. J.HealyD.GoebelR.HabesI.BoehmS. (2011). Upregulation of emotion areas through neurofeedback with a focus on positive mood. Cogn. Affect. Behav. Neurosci. 11, 44–51. 10.3758/s13415-010-0010-1
48
JohnstonS. J.BoehmS. G.HealyD.GoebelR.LindenD. E. (2010). Neurofeedback: a promising tool for the self-regulation of emotion networks. Neuroimage49, 1066–1072. 10.1016/j.neuroimage.2009.07.056
49
KadoshK. C.StauntonG. (2019). A systematic review of the psychological factors that influence neurofeedback learning outcomes. Neuroimage185, 545–555. 10.1016/j.neuroimage.2018.10.021
50
KimS.BirbaumerN. (2014). Real-time functional MRI neurofeedback: a tool for psychiatry. Curr. Opin. Psychiatry27, 332–336. 10.1097/YCO.0000000000000087
51
KimmigA.-C. S.DreslerT.HudakJ.HaeussingerF. B.WildgruberD.FallgatterA. J.et al. (2019). Feasibility of NIRS-based neurofeedback training in social anxiety disorder: behavioral and neural correlates. J. Neural Trans. 126, 1175–1185. 10.1007/s00702-018-1954-5
52
KohlS. H.MehlerD.LührsM.ThibaultR. T.KonradK.SorgerB. (2020). The potential of functional near-infrared spectroscopy-based neurofeedback96a systematic review and recommendations for best practice. Front. Neurosci. 14:594. 10.31234/osf.io/yq3vj
53
KosmynaN. (2019). “Brain-computer interfaces in the wild: lessons learned from a large-scale deployment,” in 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) (Bari), 4161–4168. 10.1109/SMC.2019.8913928
54
KoushY.MeskaldjiD.-E.PichonS.ReyG.RiegerS. W.LindenD. E.et al. (2017). Learning control over emotion networks through connectivity-based neurofeedback. Cereb. Cortex27, 1193–1202. 10.1093/cercor/bhv311
55
KovacevicN.RitterP.TaysW.MorenoS.McIntoshA. R. (2015). ‘My virtual dream': collective neurofeedback in an immersive art environment. PLoS ONE10:e0130129. 10.1371/journal.pone.0130129
56
KritikosJ.AlevizopoulosG.KoutsourisD. (2021). Personalized virtual reality human-computer interaction for psychiatric and neurological illnesses: a dynamically adaptive virtual reality environment that changes according to real-time feedback from electrophysiological signal responses. Front. Hum. Neurosci. 15:596980. 10.3389/fnhum.2021.596980
57
LadouceS.DonaldsonD. I.DudchenkoP. A.IetswaartM. (2019). Mobile EEG identifies the re-allocation of attention during real-world activity. Sci. Rep. 9, 1–10. 10.1038/s41598-019-51996-y
58
LanZ.LiuY.SourinaO.WangL.SchererR.Müller-PutzG. (2020). Safe: an EEG dataset for stable affective feature selection. Adv. Eng. Inform. 44:101047. 10.1016/j.aei.2020.101047
59
LeeY.-J.LeeG.-W.SeoW.-S.KooB.-H.KimH.-G.CheonE.-J. (2019). Neurofeedback treatment on depressive symptoms and functional recovery in treatment-resistant patients with major depressive disorder: an open-label pilot study. J. Korean Med. Sci. 34. 10.3346/jkms.2019.34.e287
60
LiK.JiangY.GongY.ZhaoW.ZhaoZ.LiuX.et al. (2019). Functional near-infrared spectroscopy-informed neurofeedback: regional-specific modulation of lateral orbitofrontal activation and cognitive flexibility. Neurophotonics6:025011. 10.1117/1.NPh.6.2.025011
61
LiY.PanJ.WangF.YuZ. (2013). A hybrid bci system combining p300 and ssvep and its application to wheelchair control. IEEE Trans. Biomed. Eng. 60, 3156–3166. 10.1109/TBME.2013.2270283
62
LindenD. E.HabesI.JohnstonS. J.LindenS.TatineniR.SubramanianL.et al. (2012). Real-time self-regulation of emotion networks in patients with depression. PLoS ONE7:e38115. 10.1371/journal.pone.0038115
63
LindquistK. A.SatputeA. B.WagerT. D.WeberJ.BarrettL. F. (2016). The brain basis of positive and negative affect: evidence from a meta-analysis of the human neuroimaging literature. Cereb. Cortex26, 1910–1922. 10.1093/cercor/bhv001
64
LindquistK. A.WagerT. D.KoberH.Bliss-MoreauE.BarrettL. F. (2012). The brain basis of emotion: a meta-analytic review. Behav. Brain sci. 35:121. 10.1017/S0140525X11000446
65
LinhartováP.LátalováA.KóšaB.KašpárekT.SchmahlC.ParetC. (2019). fMRI neurofeedback in emotion regulation: a literature review. NeuroImage193, 75–92. 10.1016/j.neuroimage.2019.03.011
66
Lopez-GordoM. A.Sanchez-MorilloD.ValleF. P. (2014). Dry EEG electrodes. Sensors14, 12847–12870. 10.3390/s140712847
67
LorenzettiV.MeloB.BasìlioR.SuoC.YücelM.Tierra-CriolloC. J.MollJ. (2018). Emotion regulation using virtual environments and real-time fMRI neurofeedback. Front. Neurol. 9:390. 10.3389/fneur.2018.00390
68
LotteF. (2015). Signal processing approaches to minimize or suppress calibration time in oscillatory activity-based brain-computer interfaces. Proc. IEEE103, 871–890. 10.1109/JPROC.2015.2404941
69
LotteF.FallerJ.GugerC.RenardY.PfurtschellerG.LécuyerA.et al. (2012). Combining BCI with virtual reality: towards new applications and improved BCI, in Towards Practical Brain-Computer Interfaces, eds AllisonB.DunneS.LeebR.MillánJ. D. R.NijholtA. (Berlin: Springer), 197–220. 10.1007/978-3-642-29746-5_10
70
MaidanI.NieuwhofF.Bernad-ElazariH.ReelickM. F.BloemB. R.GiladiN.et al. (2016). The role of the frontal lobe in complex walking among patients with Parkinson's disease and healthy older adults: an fNIRS study. Neurorehabil. Neural Repair30, 963–971. 10.1177/1545968316650426
71
Maples-KellerJ. L.BunnellB. E.KimS.-J.RothbaumB. O. (2017). The use of virtual reality technology in the treatment of anxiety and other psychiatric disorders. Harvard Rev. Psychiatry25:103. 10.1097/HRP.0000000000000138
72
MarxA.-M.EhlisA.-C.FurdeaA.HoltmannM.BanaschewskiT.BrandeisD.et al. (2015). Near-infrared spectroscopy (NIRS) neurofeedback as a treatment for children with attention deficit hyperactivity disorder (ADHD)-a pilot study. Front. Hum. Neurosci. 8:1038. 10.3389/fnhum.2014.01038
73
MassettiT.TrevizanI. L.ArabC.FaveroF. M.Ribeiro-PapaD. C.de Mello MonteiroC. B. (2016). Virtual reality in multiple sclerosis-a systematic review. Multip. Scler. Relat. Disord. 8, 107–112. 10.1016/j.msard.2016.05.014
74
MayeliA.MisakiM.ZotevV.TsuchiyagaitoA.Al ZoubiO.PhillipsR.et al. (2020). Self-regulation of ventromedial prefrontal cortex activation using real-time fMRI neurofeedback-influence of default mode network. Hum. Brain Mapp. 41, 342–352. 10.1002/hbm.24805
75
MayeliA.ZotevV.RefaiH.BodurkaJ. (2016). Real-time EEG artifact correction during fMRI using ICA. J. Neurosci. Methods274, 27–37. 10.1016/j.jneumeth.2016.09.012
76
MehlerD. M.SokunbiM. O.HabesI.BarawiK.SubramanianL.RangeM.et al. (2018). Targeting the affective brain-a randomized controlled trial of real-time fMRI neurofeedback in patients with depression. Neuropsychopharmacology43, 2578–2585. 10.1038/s41386-018-0126-5
77
MelnikovM. Y. (2021). The current evidence levels for biofeedback and neurofeedback interventions in treating depression: a narrative review. Neural Plast. 2021:8878857. 10.1155/2021/8878857
78
MennellaR.PatronE.PalombaD. (2017). Frontal alpha asymmetry neurofeedback for the reduction of negative affect and anxiety. Behav. Res. Ther. 92, 32–40. 10.1016/j.brat.2017.02.002
79
MinguillonJ.Lopez-GordoM. A.PelayoF. (2017). Trends in EEG-BCI for daily-life: requirements for artifact removal. Biomed. Signal Process. Control31, 407–418. 10.1016/j.bspc.2016.09.005
80
MirelmanA.MaidanI.Bernad-ElazariH.NieuwhofF.ReelickM.GiladiN.et al. (2014). Increased frontal brain activation during walking while dual tasking: an fNIRS study in healthy young adults. J. Neuroeng. Rehabil. 11, 1–7. 10.1186/1743-0003-11-85
81
MirifarA.BeckmannJ.EhrlenspielF. (2017). Neurofeedback as supplementary training for optimizing athletes' performance: a systematic review with implications for future research. Neurosci. Biobehav. Rev. 75, 419–432. 10.1016/j.neubiorev.2017.02.005
82
MisakiM.PhillipsR.ZotevV.WongC.-K.WurfelB. E.KruegerF.et al. (2018). Real-time fMRI amygdala neurofeedback positive emotional training normalized resting-state functional connectivity in combat veterans with and without PTSD: a connectome-wide investigation. NeuroImage20, 543–555. 10.1016/j.nicl.2018.08.025
83
MüllerS. M. T.BastosT. F.Sarcinelli FilhoM. (2013). Proposal of a SSVEP-BCI to command a robotic wheelchair. J. Control Autom. Electr. Syst. 24, 97–105. 10.1007/s40313-013-0002-9
84
Müller-PutzG.LeebR.TangermannM.HöhneJ.KüblerA.CincottiF.et al. (2015). Towards noninvasive hybrid brain-computer interfaces: framework, practice, clinical application, and beyond. Proc. IEEE103, 926–943. 10.1109/JPROC.2015.2411333
85
Müller-PutzG. R.BreitwieserC.CincottiF.LeebR.SchreuderM.LeottaF.et al. (2011). Tools for brain-computer interaction: a general concept for a hybrid BCI. Front. Neuroinform. 5:30. 10.3389/fninf.2011.00030
86
PackheiserJ.SchmitzJ.PanY.El BasbasseY.FriedrichP.GüntürkünO.et al. (2020). Using mobile EEG to investigate alpha and beta asymmetries during hand and foot use. Front. Neurosci. 14:109. 10.3389/fnins.2020.00109
87
ParentM.AlbuquerqueI.TiwariA.CassaniR.GagnonJ.-F.LafondD.et al. (2020). Pass: a multimodal database of physical activity and stress for mobile passive body/brain-computer interface research. Front. Neurosci. 14:1274. 10.3389/fnins.2020.542934
88
PeetersF.RonnerJ.BodarL.van OsJ.LousbergR. (2014). Validation of a neurofeedback paradigm: manipulating frontal EEG alpha-activity and its impact on mood. Int. J. Psychophysiol. 93, 116–120. 10.1016/j.ijpsycho.2013.06.010
89
PfurtschellerG.AllisonB. Z.BauernfeindG.BrunnerC.Solis EscalanteT.SchererR.et al. (2010). The hybrid BCI. Front. Neurosci. 4:3. 10.3389/fnpro.2010.00003
90
PintiP.AichelburgC.GilbertS.HamiltonA.HirschJ.BurgessP.et al. (2018). A review on the use of wearable functional near-infrared spectroscopy in naturalistic environments. Jpn. Psychol. Res. 60, 347–373. 10.1111/jpr.12206
91
QuaedfliegC. W.SmuldersF. T.MeyerT.PeetersF.MerckelbachH.SmeetsT. (2016). The validity of individual frontal alpha asymmetry EEG neurofeedback. Soc. Cogn. Affect. Neurosci. 11, 33–43. 10.1093/scan/nsv090
92
QuaresimaV.FerrariM. (2019). Functional near-infrared spectroscopy (fNIRS) for assessing cerebral cortex function during human behavior in natural/social situations: a concise review. Organ. Res. Methods22, 46–68. 10.1177/1094428116658959
93
RanceM.WalshC.SukhodolskyD. G.PittmanB.QiuM.KichukS. A.et al. (2018). Time course of clinical change following neurofeedback. Neuroimage181, 807–813. 10.1016/j.neuroimage.2018.05.001
94
RaviD.KumarN.SinghiP. (2017). Effectiveness of virtual reality rehabilitation for children and adolescents with cerebral palsy: an updated evidence-based systematic review. Physiotherapy103, 245–258. 10.1016/j.physio.2016.08.004
95
RayA. M.SitaramR.RanaM.PasqualottoE.BuyukturkogluK.GuanC.et al. (2015). A subject-independent pattern-based brain-computer interface. Front. Behav. Neurosci. 9:269. 10.3389/fnbeh.2015.00269
96
RenardY.LotteF.GibertG.CongedoM.MabyE.DelannoyV.et al. (2010). Openvibe: an open-source software platform to design, test, and use brain-computer interfaces in real and virtual environments. Presence19, 35–53. 10.1162/pres.19.1.35
97
RiesA. J.TouryanJ.VettelJ.McDowellK.HairstonW. D. (2014). A comparison of electroencephalography signals acquired from conventional and mobile systems. J. Neurosci. Neuroeng. 3, 10–20. 10.1166/jnsne.2014.1092
98
RohaniD. A.PuthusserypadyS. (2015). BCI inside a virtual reality classroom: a potential training tool for attention. EPJ Nonlin. Biomed. Phys. 3, 1–14. 10.1140/epjnbp/s40366-015-0027-z
99
RosT.Enriquez-GeppertS.ZotevV.YoungK. D.WoodG.Whitfield-GabrieliS.et al. (2020). Consensus on the reporting and experimental design of clinical and cognitive-behavioural neurofeedback studies (CRED-NF checklist). Brain143, 1674–1685. 10.1093/brain/awaa009
100
RosanneO.AlbuquerqueI.CassaniR.GagnonJ.-F.TremblayS.FalkT. H. (2021). Adaptive filtering for improved eeg-based mental workload assessment of ambulant users. Front. Neurosci. 15:611962. 10.3389/fnins.2021.611962
101
RosenfeldJ. P.BaehrE.BaehrR.GotlibI. H.RanganathC. (1996). Preliminary evidence that daily changes in frontal alpha asymmetry correlate with changes in affect in therapy sessions. Int. J. Psychophysiol. 23, 137–141. 10.1016/0167-8760(96)00037-2
102
ScheinostD.StoicaT.SaksaJ.PapademetrisX.ConstableR.PittengerC.et al. (2013). Orbitofrontal cortex neurofeedback produces lasting changes in contamination anxiety and resting-state connectivity. Transl. Psychiatry3:e250. 10.1038/tp.2013.24
103
ScheinostD.StoicaT.WasylinkS.GrunerP.SaksaJ.PittengerC.et al. (2014). Resting state functional connectivity predicts neurofeedback response. Front. Behav. Neurosci. 8:338. 10.3389/fnbeh.2014.00338
104
ShibataK.LisiG.CorteseA.WatanabeT.SasakiY.KawatoM. (2019). Toward a comprehensive understanding of the neural mechanisms of decoded neurofeedback. Neuroimage188, 539–556. 10.1016/j.neuroimage.2018.12.022
105
SitaramR.RosT.StoeckelL.HallerS.ScharnowskiF.Lewis-PeacockJ.et al. (2017). Closed-loop brain training: the science of neurofeedback. Nat. Rev. Neurosci. 18, 86–100. 10.1038/nrn.2016.164
106
SorgerB.ScharnowskiF.LindenD. E.HampsonM.YoungK. D. (2019). Control freaks: towards optimal selection of control conditions for fmri neurofeedback studies. Neuroimage186, 256–265. 10.1016/j.neuroimage.2018.11.004
107
SpülerM.NiethammerC. (2015). Error-related potentials during continuous feedback: using EEG to detect errors of different type and severity. Front. Hum. Neurosci. 9:155. 10.3389/fnhum.2015.00155
108
StraitM.ScheutzM. (2014). What we can and cannot (yet) do with functional near infrared spectroscopy. Front. Neurosci. 8:117. 10.3389/fnins.2014.00117
109
StrehlU. (2014). What learning theories can teach us in designing neurofeedback treatments. Front. Hum. Neurosci. 8:894. 10.3389/fnhum.2014.00894
110
SulzerJ.HallerS.ScharnowskiF.WeiskopfN.BirbaumerN.BlefariM. L.et al. (2013). Real-time fMRI neurofeedback: progress and challenges. Neuroimage76, 386–399. 10.1016/j.neuroimage.2013.03.033
111
TaiK.ChauT. (2009). Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface. J. Neuroeng. Rehabil. 6, 1–14. 10.1186/1743-0003-6-39
112
Taschereau-DumouchelV.CorteseA.LauH.KawatoM. (2020). Conducting decoded neurofeedback studies. Soc. Cogn. Affect. Neurosci. 2020, nsaa063. 10.1093/scan/nsaa063
113
TheeuwesJ.KramerA. F.HahnS.IrwinD. E. (1998). Our eyes do not always go where we want them to go: capture of the eyes by new objects. Psychol. Sci. 9, 379–385. 10.1111/1467-9280.00071
114
ThibaultR. T.LifshitzM.RazA. (2017). Neurofeedback or neuroplacebo?Brain140, 862–864. 10.1093/brain/awx033
115
ThibaultR. T.MacPhersonA.LifshitzM.RothR. R.RazA. (2018). Neurofeedback with fMRI: a critical systematic review. Neuroimage172, 786–807. 10.1016/j.neuroimage.2017.12.071
116
ThibaultR. T.RazA. (2017). The psychology of neurofeedback: Clinical intervention even if applied placebo. Am. Psychol. 72:679. 10.1037/amp0000118
117
ThibodeauR.JorgensenR. S.KimS. (2006). Depression, anxiety, and resting frontal EEG asymmetry: a meta-analytic review. J. Abnorm. Psychol. 115:715. 10.1037/0021-843X.115.4.715
118
TrambaiolliL. R.BiazoliC. E.CravoA. M.FalkT. H.SatoJ. R. (2018a). Functional near-infrared spectroscopy-based affective neurofeedback: feedback effect, illiteracy phenomena, and whole-connectivity profiles. Neurophotonics5:035009. 10.1117/1.NPh.5.3.035009
119
TrambaiolliL. R.BiazoliC. E.CravoA. M.SatoJ. R. (2018b). Predicting affective valence using cortical hemodynamic signals. Sci. Rep. 8, 1–12. 10.1038/s41598-018-23747-y
120
TrambaiolliL. R.KohlS. H.LindenD. E.MehlerD. M. (2021a). Neurofeedback training in major depressive disorder: a systematic review of clinical efficacy, study quality and reporting practices. Neurosci. Biobehav. Rev. 125, 33–56. 10.1016/j.neubiorev.2021.02.015
121
TrambaiolliL. R.TossatoJ.CravoA. M.BiazoliC. E.JrSatoJ. R. (2021b). Subject-independent decoding of affective states using functional near-infrared spectroscopy. PLoS ONE16:e0244840. 10.1371/journal.pone.0244840
122
TursicA.EckJ.LührsM.LindenD. E.GoebelR. (2020). A systematic review of fMRI neurofeedback reporting and effects in clinical populations. NeuroImage2020:102496. 10.1016/j.nicl.2020.102496
123
Val-CalvoM.Álvarez-SánchezJ. R.Ferrández-VicenteJ. M.FernándezE. (2019). Optimization of real-time EEG artifact removal and emotion estimation for human-robot interaction applications. Front. Comput. Neurosci. 13:80. 10.3389/fncom.2019.00080
124
VanzellaP.BalardinJ. B.FuruchoR. A.Zimeo MoraisG. A.Braun JanzenT.SammlerD.et al. (2019). fNIRS responses in professional violinists while playing duets: evidence for distinct leader and follower roles at the brain level. Front. Psychol. 10:164. 10.3389/fpsyg.2019.00164
125
von LühmannA.WabnitzH.SanderT.MüllerK.-R. (2016). M3BA: a mobile, modular, multimodal biosignal acquisition architecture for miniaturized EEG-NIRS-based hybrid BCI and monitoring. IEEE Trans. Biomed. Eng. 64, 1199–1210. 10.1109/TBME.2016.2594127
126
WaldL. L.McDanielP. C.WitzelT.StockmannJ. P.CooleyC. Z. (2020). Low-cost and portable MRI. J. Magn. Reson. Imaging52, 686–696. 10.1002/jmri.26942
127
WanF.NanW.VaiM. I.RosaA. (2014). Resting alpha activity predicts learning ability in alpha neurofeedback. Front. Hum. Neurosci. 8:500. 10.3389/fnhum.2014.00500
128
WangS.-Y.LinI.-M.FanS.-Y.TsaiY.-C.YenC.-F.YehY.-C.et al. (2019). The effects of alpha asymmetry and high-beta down-training neurofeedback for patients with the major depressive disorder and anxiety symptoms. J. Affect. Disord. 257, 287–296. 10.1016/j.jad.2019.07.026
129
WangY.-T.WangY.ChengC.-K.JungT.-P. (2013). “Developing stimulus presentation on mobile devices for a truly portable SSVEP-based BCI,” in 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Osaka), 5271–5274.
130
WatanabeT.SasakiY.ShibataK.KawatoM. (2017). Advances in fMRI real-time neurofeedback. Trends Cogn. Sci. 21, 997–1010. 10.1016/j.tics.2017.09.010
131
WeberE.KöberlA.FrankS.DoppelmayrM. (2011). Predicting successful learning of smr neurofeedback in healthy participants: methodological considerations. Appl. Psychophysiol. Biofeedb. 36, 37–45. 10.1007/s10484-010-9142-x
132
WeechS.KennyS.Barnett-CowanM. (2019). Presence and cybersickness in virtual reality are negatively related: a review. Front. Psychol. 10:158. 10.3389/fpsyg.2019.00158
133
YaminH. G.GazitT.TchemodanovN.RazG.JackontG.CharlesF.et al. (2017). Depth electrode neurofeedback with a virtual reality interface. Brain Comput. Interfaces4, 201–213. 10.1080/2326263X.2017.1338008
134
YoungK. D.SiegleG. J.MisakiM.ZotevV.PhillipsR.DrevetsW. C.et al. (2018). Altered task-based and resting-state amygdala functional connectivity following real-time fMRI amygdala neurofeedback training in major depressive disorder. NeuroImage17, 691–703. 10.1016/j.nicl.2017.12.004
135
YoungK. D.SiegleG. J.ZotevV.PhillipsR.MisakiM.YuanH.et al. (2017). Randomized clinical trial of real-time fMRI amygdala neurofeedback for major depressive disorder: effects on symptoms and autobiographical memory recall. Am. J. Psychiatry174, 748–755. 10.1176/appi.ajp.2017.16060637
136
YoungK. D.ZotevV.PhillipsR.MisakiM.YuanH.DrevetsW. C.et al. (2014). Real-time fMRI neurofeedback training of amygdala activity in patients with major depressive disorder. PLoS ONE9:e88785. 10.1371/journal.pone.0088785
137
YuanH.YoungK. D.PhillipsR.ZotevV.MisakiM.BodurkaJ. (2014). Resting-state functional connectivity modulation and sustained changes after real-time functional magnetic resonance imaging neurofeedback training in depression. Brain Connect. 4, 690–701. 10.1089/brain.2014.0262
138
ZhangR.XiaoW.DingY.FengY.PengX.ShenL.et al. (2020). Recording brain activities in unshielded earth92s field with optically pumped atomic magnetometers. Sci. Adv. 6:eaba8792. 10.1126/sciadv.aba8792
139
ZotevV.BodurkaJ. (2020). Effects of simultaneous real-time fMRI and EEG neurofeedback in major depressive disorder evaluated with brain electromagnetic tomography. NeuroImage28:102459. 10.1016/j.nicl.2020.102459
140
ZotevV.KruegerF.PhillipsR.AlvarezR. P.SimmonsW. K.BellgowanP.et al. (2011). Self-regulation of amygdala activation using real-time fMRI neurofeedback. PLoS ONE6:e24522. 10.1371/journal.pone.0024522
141
ZotevV.MayeliA.MisakiM.BodurkaJ. (2020). Emotion self-regulation training in major depressive disorder using simultaneous real-time fMRI and EEG neurofeedback. NeuroImage27:102331. 10.1016/j.nicl.2020.102331
142
ZotevV.PhillipsR.MisakiM.WongC. K.WurfelB. E.KruegerF.et al. (2018). Real-time fMRI neurofeedback training of the amygdala activity with simultaneous EEG in veterans with combat-related PTSD. NeuroImage19, 106–121. 10.1016/j.nicl.2018.04.010
143
ZotevV.PhillipsR.YoungK. D.DrevetsW. C.BodurkaJ. (2013). Prefrontal control of the amygdala during real-time fMRI neurofeedback training of emotion regulation. PLoS ONE8:e79184. 10.1371/journal.pone.0079184
144
ZotevV.PhillipsR.YuanH.MisakiM.BodurkaJ. (2014). Self-regulation of human brain activity using simultaneous real-time fMRI and EEG neurofeedback. NeuroImage85, 985–995. 10.1016/j.neuroimage.2013.04.126
145
ZotevV.YuanH.MisakiM.PhillipsR.YoungK. D.FeldnerM. T.et al. (2016). Correlation between amygdala bold activity and frontal EEG asymmetry during real-time fMRI neurofeedback training in patients with depression. NeuroImage11, 224–238. 10.1016/j.nicl.2016.02.003
Summary
Keywords
neurofeedback, emotion regulation, virtual reality, naturalistic, in-the-wild, brain-computer interfaces
Citation
Trambaiolli LR, Tiwari A and Falk TH (2021) Affective Neurofeedback Under Naturalistic Conditions: A Mini-Review of Current Achievements and Open Challenges. Front. Neuroergon. 2:678981. doi: 10.3389/fnrgo.2021.678981
Received
10 March 2021
Accepted
28 April 2021
Published
24 May 2021
Volume
2 - 2021
Edited by
Sylvain Delplanque, Université de Genève, Switzerland
Reviewed by
Ahmad Mayeli, University of Pittsburgh, United States; Arianna Trettel, BrainSigns, Italy
Updates
Copyright
© 2021 Trambaiolli, Tiwari and Falk.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Lucas R. Trambaiolli ltrambaiolli@mclean.harvard.edu
This article was submitted to Consumer Neuroergonomics, a section of the journal Frontiers in Neuroergonomics
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.