Olivier Rosanne1*
Isabela Albuquerque1
Raymundo Cassani1
Jean-François Gagnon2
Sebastien Tremblay3
Tiago H. Falk1- 1Institut National de la Recherche Scientifique - Centre Énergie, Matériaux et Télécomunication, Université du Québec, Montréal, QC, Canada
- 2Thales Research and Technology, Quebec City, QC, Canada
- 3École de Psychologie, Université Laval, Quebec City, QC, Canada
Recently, due to the emergence of mobile electroencephalography (EEG) devices, assessment of mental workload in highly ecological settings has gained popularity. In such settings, however, motion and other common artifacts have been shown to severely hamper signal quality and to degrade mental workload assessment performance. Here, we show that classical EEG enhancement algorithms, conventionally developed to remove ocular and muscle artifacts, are not optimal in settings where participant movement (e.g., walking or running) is expected. As such, an adaptive filter is proposed that relies on an accelerometer-based referential signal. We show that when combined with classical algorithms, accurate mental workload assessment is achieved. To test the proposed algorithm, data from 48 participants was collected as they performed the Revised Multi-Attribute Task Battery-II (MATB-II) under a low and a high workload setting, either while walking/jogging on a treadmill, or using a stationary exercise bicycle. Accuracy as high as 95% could be achieved with a random forest based mental workload classifier with ambulant users. Moreover, an increase in gamma activity was found in the parietal cortex, suggesting a connection between sensorimotor integration, attention, and workload in ambulant users.
1. Introduction
Many professions, such as first responders (firemen, policemen, paramedics) and pilots are often faced with cognitive challenges including information overload, multitasking, interruptions, and fatigue. All these factors increase stress and reduce the efficiency with which this complex set of tasks is performed (Grtner et al., 2019). In many cases, these individuals are also exposed to a combination of physical and mental factors that further contribute to a high mental workload (MW), thus resulting in increased chances for errors, which could be life threatening. As such, MW monitoring has gained popularity in recent years.
Mental workload assessment can follow three methods: subjective, behavioral, or instrumental/objective. Subjective assessment relies on users reporting their perceived levels of mental workload and the NASA task load index (TLX) (Hart and Staveland, 1988; Cao et al., 2009) has been widely used. Behavioral methods, in turn, rely on task performance metrics (e.g., accuracy, response times, error rate) to characterize MW states. As can be seen, it is difficult for subjective and behavioral assessment methods to provide real-time measures of MW, thus have limited applications in closed-loop systems to improve task performance. This is where instrumental or objective methods have filled a gap. With such systems, real-time correlates of MW are obtained and unobtrusive neuronal and physiological measures have been explored, such as electroencephalography (EEG), electrocardiography (ECG), and galvanic skin response, amongst others.
With the popularization of wearable devices and improved dry electrode technologies, EEGs have emerged as a potential candidate for automated instrumental MW assessment (Lean and Shan, 2012; Mullen et al., 2015). Successful applications have been shown in aircraft pilots and car drivers (Borghini et al., 2014), and air traffic controllers (Aricò et al., 2016), to name a few. Numerous different features have been explored and shown useful, including power spectral, magnitude, and phase coherence (Aghajani and Omurtag, 2016; Dimitrakopoulos et al., 2017; So et al., 2017). For example, increases in theta and decreases in alpha band powers have been shown in prefrontal and parietal brain regions when task difficulty increases (Borghini et al., 2014). Temporal complexity measures have also shown some robustness against ocular and muscular artifacts (Tiwari et al., 2019) and spectro-temporal measures have been shown to provide complementary information to conventional power spectral ones (Albuquerque et al., 2019). Most available works, however, have relied on stationary users, such as sitting pilots and drivers (Borghini et al., 2014; Johnson et al., 2015), or have controlled for body movements (Hogervorst et al., 2014).
Practical applications, however, have users that are highly ambulatory (e.g., first responders). It is known that dry electrodes are very sensitive to movement artifacts, which could severely hamper MW monitoring performance (Morikawa et al., 2013). In our previous work, we explored the use of several conventional EEG enhancement algorithms to gauge their benefits in instrumental measurement of MW in highly ecological settings (Rosanne et al., 2019). We found that while some improvements were seen relative to using noisy raw data, overall MW measurement performance levels remained lower than what has typically been reported for stationary users. This is due to the fact that existing enhancement algorithms have been developed and optimized to remove muscle and eye blink/movement artifacts, and not necessarily movement artifacts seen with, e.g., running.
To overcome this limitation, here we propose the use of an adaptive filter to remove movement-specific motion artifacts from mobile EEG data. Accelerometry signals measured from the participant's torsos are used as reference signals for the adaptive filter. The algorithm was tested on a database collected in-house from 48 participants while they performed the Multi-Attribute Task Battery-II (Santiago-Espada et al., 2011) under two workload conditions (low and high) and two physical activity (PA) types (stationary bike and treadmill), each at three activity levels (none, medium, and high). Experimental results show the proposed algorithm accurately removing body movement artifacts and resulting in MW monitoring performance as high as 97% and independent of activity type and level.
Lastly, with the enhanced signals available, we conducted an in-depth analysis of the top features selected for MW assessment, thus obtaining insights into the cognitive processes involved during the workload task under physical activity. We found typical patterns related to visuo-motor control, attention, and fronto-parietal communication; patterns that would otherwise have been lost due to movement artifacts.
The remainder of this paper is organized as follows: section II describes the materials and methods used in the experiment. Section III presents and discusses the obtained results, and section IV presents the study conclusions.
2. Materials and Methods
2.1. Data Collection
Data was collected from 48 participants (23 females, 27.4 ± 6.6 year old), of which 22 utilized a treadmill during the experiment and 26 a stationary bike. Participants using the treadmill were asked to wear a safety harness around their chest in order to avoid falls. The experimental protocol was approved by the Ethics Boards at INRS and Université Laval, participants provided written consent, and were monetarily compensated for their time.
The experimental protocol comprised two MW levels (low/high) elicited through the MATB-II software, which has participants executing three simultaneous tasks: system monitoring, tracking, and resource management, as presented in Figure 1. Low and high MW settings were implemented based on changing the difficulty levels for each of the three tasks. As an example, a low MW task was composed by “easy” versions of the three tasks. Participants used an Xbox 360 joystick to interact with the MATB-II interface.
Figure 1. Graphical interface of the MATB-II software used to modulate high and low MW levels.
While executing MATB-II, subjects were asked to either bike or walk/jog on a treadmill at three levels of physical activity (PA): no movement, medium (treadmill: 3 km/h, bike: 50 rpm), and high (treadmill: 5 km/h, bike: 70 rpm). In total, six combinations of MW and physical activity were tested. The experiment was then split into six sessions, each one corresponding to one of the six combinations described above, counterbalanced to avoid ordering effects. Each session took 10 min to run and was systematically followed by a 5-min break. Before every session, two baseline periods were recorded. The first corresponded to 1 min without task nor physical activity. The second, in turn, corresponded to 1 min with only physical activity at the same level to be executed in the upcoming session. At the end of the experiment, each subject was asked to fill the NASA-TLX questionnaire (Hart and Staveland, 1988) to subjectively evaluate their perceived workload levels, as well as the reported their fatigue levels using the Borg scale (Borg, 1998).
EEG data was acquired from the participants using the Neurolectrics Enobio 8-channel portable headset with the following channel locations according to the international 10–20 system: Fp1, Fp2, AF7, AF8, T9, T10, P3, P4 (see Figure 2). Signals were collected at a sampling rate 500 Hz and were later downsampled to 250 Hz. Two virtual inter-hemispheric bipolar signals were also computed, namely Fp1-Fp2 and P3-P4. Movement activity was also recorded with a sampling rate of 50 Hz using the embedded accelerometer available in the Zephir Bioharness wearable device, which was placed on the chest of each subject. Accelerometry data was upsampled to 250 Hz to coincide with the EEG data. The interested reader is referred to Albuquerque et al. (2020) for more details about the database.
Figure 2. Electrode placement using the international 10–20 system.
2.2. Movement Artifacts
To illustrate the effects of movement, particularly in the walking/jogging conditions, Figure 3 depicts the average spectral representation of each of the eight EEG channels, as well as that of the accelerometer signals (bottom plot) during 10 s of the high physical activity condition. Here, the accelerometer signal corresponds to a L2-normalization of the accelerometer x, y, and z axes. As can be seen, particularly for the frequency range below 10 Hz, there is a significant effect from gait/movement on the EEG spectra, something previously reported in the literature (Zhang et al., 2014; Nathan and Contreras-Vidal, 2016). As movement artifacts are known to be detrimental to EEG quality (Gao et al., 2010; McMenamin et al., 2011), this has motivated the proposal of an adaptive filter using the accelerometer signal as a reference signal.
Figure 3. Average spectral representation of the eight EEG signals and the accelerometer signal over 10 s of recording for the low MW and high PA condition.
Movement artifacts observed in EEG signals can be caused either by a relative movement between the skin and the electrode (Burbank and Webster, 1978) or by a change in electrical potential when the skin stretches and contracts during movement (de Talhouet and Webster, 1996; Kearney et al., 2007). Movement artifacts have been reported to span spectral content between 0.11 and 20 Hz (Bouten et al., 1997), thus overlap with frequency bands relevant for mental workload monitoring (Mak et al., 2013). Conventional EEG enhancement algorithms, traditionally developed for ocular and muscle artifacts (Urigüen and Garcia-Zapirain, 2015; Mucarquer et al., 2019; Zou et al., 2019), have been shown to help with ambulatory users. For example, in Gwin et al. (2010), independent component analysis (ICA) and component-based template regression was used to remove gait movement artifacts from EEG event related potentials. ICA-based decomposition was also used to remove head movements in Onikura and Iramina (2015). Notwithstanding, these conventional solutions have been shown to interfere with MW assessment (Rosanne et al., 2019). Moreover, ICA-based enhancement methods typically rely on human intervention to remove artifactual components, thus have limited use in real-time applications. Adaptive filtering, in turn, has been used to reduce head movement artifacts (Mihajlović et al., 2014) and simulated random noise in EEGs (Raya and Sison, 2002). To the best of our knowledge, however, the use of adaptive filtering, with or without combined “blind” filtering approaches (i.e., that do not rely on human intervention), has yet to be quantified for EEG-based mental workload monitoring of ambulant users. We aim to fill this gap.
2.3. Adaptive Filtering
Figure 4 depicts a block diagram of the adaptive filtering scheme explored herein. Signal x(n) corresponds to the accelerometer signal, whereas s(n) corresponds to the neuronal activity signal. From the accelerometer signal, movement artifacts are modeled and represent y(n). When added to the neuronal activity signal s(n), the output represents the noisy EEG signal d(n) = s(n) + y(n) recorded during physical activity. The goal of the adaptive filter is to find the optimal distortion weights from the accelerometer signal x(n) to best estimate the movement artifacts via and remove their effects from the noisy EEG signal via .
Figure 4. Block diagram of proposed adaptive filter.
More specifically:
and
The filter weights are found using the normalized least mean squares (NLMS) procedure (Diniz, 1997) for loss function C(n) using the steepest descent algorithm, i.e.:
where ∇ is the gradient operator and 𝔼[·] the expected value. This leads to the following update rule:
where μ/2 is the step size.
We approximate the last term using the single-sample unbiased estimator , thus simplifying (4) to:
Here, a filter length of 500 samples was used, corresponding to a signal duration of 2 s. Figure 5 depicts the noisy and enhanced EEG signals, as well as the accelerometry signal, to visually showcase the movement effects on the EEG signal and the effectiveness of the adaptive filter.
Figure 5. Time representation of a 5-s EEG segment from electrode AF8 before (blue) and after (black) adaptive filtering. The L2-normalization of the x, y, and z accelerometry axes is represented in orange.
2.4. Benchmark Enhancement Algorithms
As mentioned previously, numerous EEG enhancement algorithms exist. Most have been developed to remove eye and muscular artifacts. Some are completely autonomous, whereas others rely on expert supervision. Here, four algorithms widely used for automatic (i.e., not relying on human intervention) EEG enhancement are used as benchmarks. They are used alone or in combination with each other. The following configurations are applied to the entire signals prior to epoching:
• ASR: artifact subspace reconstruction (ASR) is a method developed to remove transient and large-amplitude artifacts from noisy EEG. It relies on principal components analysis to reject large-variance components prior to reconstruction. The method relies on automatically identifying clean portions of the EEG signal and using these segments to determine thresholds for rejecting components. As stated in Chang et al. (2019), ASR has become the standard benchmark for EEG enhancement. The interested reader is referred to Mullen et al. (2015) for more details on the ASR method.
• ADJUST: Automatic EEG artifact Detection based on the Joint Use of Spatial and Temporal features (ADJUST) is an automatic artifact removal method that relies on “templates” of the effects of stereotyped artifacts (e.g., due to eye movements, blinks, and heart beats) on independent components. Components related to stereotyped artifacts are then removed and the signal is reconstructed. It has been reported that non-stereotyped artifacts, such as those due to movement, are not accurately removed with ADJUST and multiple methods are needed. More details about ADJUST can be found in Mognon et al. (2011).
• Wavelet-ICA: Wavelet-enhanced independent component analysis (ICA) relies on wavelet coefficient thresholding of independent components to reject artifactual components. The method has been shown to outperform conventional ICA and to better preserve EEG spectral and phase coherence properties (Castellanos and Makarov, 2006), especially for low-density EEG configurations (Cassani et al., 2014).
• HAPPE: The Harvard Automated Processing Pipeline for Electroencephalography (HAPPE) is a pipeline suitable for low density EEG channels and limited data samples. It relies on wICA and multiple artifact rejection algorithm (MARA) to detect artifactual components for rejection. The interested reader is referred to Gabard-Durnam et al. (2018) for complete details on the HAPPE method.
• Algorithm Combinations: In addition to the combined methods approach in HAPPE, the following additional benchmark algorithmic combinations were also explored: ASR + wICA and ASR + ADJUST. Moreover, the proposed adaptive filter was also used in combination with the benchmark algorithms to explore their combined effectiveness. Henceforth, results represented as “Raw” assume no enhancement, “AF” when only the adaptive filter has been applied, and methods combined with AF will be preceded by the prefix “AF_.”
2.5. Feature Extraction
Prior to feature extraction, EEG signals were first filtered with a FIR band-pass filter in the range 1–45 Hz. The following feature sets were extracted from the raw and enhanced signals:
2.5.1. Power Spectral Density
Power Spectral Density (PSD) features measure signal power across different subband frequencies. In this study, nine frequency bands were considered, namely: δ (1–4 Hz), θ (4–8 Hz), α (8–12 Hz), β (12–30 Hz), low γ (30–45 Hz), δ to β (1–30 Hz), θ to β (4–30 Hz), low α (8–10 Hz), and high α (10–12 Hz). The relative power of each of these bands was calculated by normalizing per-band values by the full-band power. A total of 90 PSD features were extracted. Numerous studies have reported the usefulness of such features for mental workload assessment (Liu et al., 2017; Craik et al., 2019; Zhang et al., 2019).
2.5.2. Phase and Magnitude Spectral Coherence
Phase and Magnitude Spectral Coherence (PMSC) features are useful for measuring connectivity between cortical regions as these techniques measure co-variance of the phase and magnitude between two signals. The interested reader is referred to Aoki et al. (1999) for more details on PMSC computation. PMSC is computed for two pairs of electrodes, namely FP1-FP2 and P3-P4 for each 5 sub-bands (δ, θ, α, β, γ). A total of 20 PMSC features were extracted. These features are motivated from Zhang et al. (2014) and Zarjam et al. (2015) that have shown their usefulness in mental workload assessment.
2.5.3. Amplitude Modulation Rate-of-Change
Amplitude Modulation (AM) rate-of-change features quantify the rate-of-change of specific frequency sub-bands and provides insight into cross-frequency magnitude-magnitude coupling/interactions and reveals interactions between different brain processes (Tort et al., 2010; Voytek et al., 2010; Seeber et al., 2014), as well as long-range communication (Zanto et al., 2011; Clayton et al., 2015). The interested reader is referred to Trambaiolli et al. (2011) and Fraga et al. (2013) for more complete details on the measure. A total of 140 features were extracted that provide robustness against movement artifacts, as described in Albuquerque et al. (2018).
2.5.4. Phase and Magnitude Spectral Coherence of Amplitude Modulation Features (PMSC-AM)
PMSC-AM extends the capacity of PMSC features to amplitude modulations. These features were recently proposed for affective state monitoring and showed useful for arousal and valence prediction (Clerico et al., 2015, 2018). They are explored here for the first time as correlates of mental workload. These features are based on the modulated signals of each band which make a total of fourteen signals per channels (see Clerico et al., 2018 for more details). After splitting the signals into epochs, the magnitude spectral coherence and phase coherence is then computed for the FP1-FP2 and P3-P4 channel pairs only. A total of 56 features were extracted.
2.6. Feature Selection and Ranking
Feature selection is a common step in classification tasks to remove redundant (Peng et al., 2005) or irrelevant features (Blum and Langley, 1997) and for dimensionality reduction (Fan and Fan, 2008) to improve classification performance. In this study, we rely on the so-called minimum Redundancy Maximum Relevance (mRMR) filter method (Peng et al., 2005) which not only finds the most relevant features for the task at hand, but removes features with high mutual information, thus minimizing redundancy. The algorithm has been shown to be extremely useful for EEG-based affective state assessment (e.g., Cassani et al., 2014; Clerico et al., 2018). In addition to feature selection, we further rank the importance of the top-features using a wrapper-based method. It is important to emphasize that feature selection/ranking is not crucial here, given the number of features explored. Nonetheless, we use it to obtain insights into the neuronal patterns related to mental workload during activity and how such patterns may be affected by movement artifacts.
2.7. Classification and Hyperparameter Tuning
We are interested in exploring the effects of movement artifacts and, consequently, EEG enhancement on mental workload assessment. Here, we assume the binary problem of classifying low vs. high mental workload levels. Two conventional classifiers are explored, namely random forest (RF) (Qi, 2012) and support vector machine (SVM). A repeated (10 times) 10-fold cross validation testing setup is used.
For hyperparameter tuning, the cross-validation grid search available in the scikit-learn library (Pedregosa et al., 2011) was explored. This approach, however, yielded a high number of trees (around 500) for the RF classifier, as compared to the amount of available data (Oshiro et al., 2012). As an alternative, we empirically fixed tree depth to 8 and stopped adding trees once the evolution of the area under the curve—receiver operating characteristics (AUC-ROC) became constant across out-of-bag conditions. Next, a similar strategy was used to optimize tree depth and we fixed the number of trees to the value found in the previous analysis. In both cases, a stratified 5-fold cross-validation procedure was used with all subjects to ensure reliable generalization performance.
Figure 6 shows the evolution of AUC-ROC scores for the training and out-of-bag (oob) sets as a function of number of trees. When building each random tree in the forest, not all features and samples of the dataset are used. Instead, a small randomly-selected set called the bootstrap bag is used to build a single tree; this bag is different for each tree. The oob set, thus, corresponds to the remaining unused samples. The accuracy with the oob set is shown to stabilize at around 100 trees. Moreover, Figure 7 depicts accuracy as a function of tree depth. As can be seen, for the out-of-bag set the accuracy plateaus at around a depth of 10. Henceforth, these values are used in our experiments.
Figure 6. Evolution of AUC-ROC for training and out-of-bag (oob) sets as a function of number of trees.
Figure 7. Evolution of AUC-ROC for training and out-of-bag (oob) sets as a function of tree depth.
Figure 8 presents accuracy values obtained during a grid search to find the optimal C and γ values of the support vector classifier. It can be seen that the best accuracy is reached with C = 310 and γ = 0.001 with a Radial Basis Function kernel; these values are used henceforth.
Figure 8. Accuracy hyperparameter grid search for the SVM classifier.
3. Results and Discussion
3.1. Classification Performance
3.1.1. Ablation Study
In order to estimate the impact of the adaptive filter on EEG enhancement, mental workload classification accuracy is reported with and without its use. Tables 1, 2 present classification accuracy values for the RF and SVM classifiers, respectively. While each column corresponds to a tested benchmark enhancement algorithm, with or without (termed “Base”) adaptive filtering, each row corresponds to a specific feature set used for classification in the low and high physical activity (PA) conditions. Row labeled “All” indicates fusion of all features. Results reported are the average of a 10-fold cross-validation test setup repeated ten times by shuffling the partitions each time. Whenever the achieved results with the adaptive filter were significantly different (based on a paired t-test) than without, results are indicated with superscripts “†” and “‡” for p ≤ 0.05 and p ≤ 0.01, respectively.
Table 1. RF mental workload classification accuracy for different feature and enhancement algorithm configurations.
Table 2. SVM mental workload classification accuracy for different feature and enhancement algorithm configurations.
As can be seen from the Tables 1, 2, the adaptive filter significantly improved accuracy for most tested configurations, particularly for features derived from the amplitude modulation analysis, as well as for the high physical activity conditions in which movement artifacts are most pronounced. Overall, the RF classifier consistently outperformed the SVM.
For PSD based features, the best results were achieved with a combination of ASR and ADJUST methods (93.68%), followed closely by HAPPE and AF (92.96%) for low physical activity conditions and the ASR-wICA-AF combination for high PA conditions. Similar accuracy values were achieved for the AM and PMSC feature sets. The PMSC-AM features, on the other hand, resulted in the lowest values, thus suggesting that they may not be useful for mental workload assessment when used alone. Overall, fusion of the different feature sets showed to result in the highest accuracy for both RF and SVM classifiers, thus suggesting their complementarity. The highest accuracy achieved was of 97.90% with the HAPPE-AF combination for both the high and low PA conditions. Such findings show that by combining all feature sets with the proposed adaptive filtering and HAPPE enhancement methods, the same mental workload measurement accuracy can be achieved despite physical activity levels.
3.1.2. Effect of Number of Features
The results reported in Tables 1, 2 relied on all extracted features. In order to investigate the impact of feature dimensionality on overall accuracy, Figure 9 depicts the achieved accuracy as a function of number of features used, in decreasing importance, as ranked by mRMR. Here, the AF-HAPPE enhancement combination is used with the RF classifier and the average accuracy over a single 10-fold cross-validation setup is used. For this comparison, default classifier parameters are used in order to gauge the effectiveness of the features per se, and not the classifier. As can be seen, sharp increases in accuracy are achieved with the first 60 features and then slight increases occur after 100 and then 200 features are considered. A small gap is seen for both low and high physical activity conditions once all 306 features are used. If feature dimensionality is of concern, the achieved results and the small gap between low and high PA conditions suggest that 236 features can be a good compromise (94 and 90%, low and high PA, respectively), followed by 111 features (91 and 87%, low and high PA, respectively). For comparison, with the top-60 features, accuracy of 84 and 88% are achieved, respectively.
Figure 9. Accuracy vs. number of features for a RF classifier and a combined AF-HAPPE enhancement pipeline.
3.2. Top-Ranking Features
To obtain insights from top-selected features, we performed an in-depth analysis of the top-60 features selected from the combined “All” feature set in the low and high physical activity conditions using both the raw data and the top-performing AF_HAPPE enhanced data; Table 3 lists these features.
Table 3. Top-60 features for different physical activity (PA) and signal processing conditions.
As can be seen, for all conditions tested, modulation spectral features resulted in the majority of the top 60 features. For example, for the high PA conditions without and with AF_HAPPE processing, they corresponded to 50 and 70% of the top features, respectively. This corroborates findings from Albuquerque et al. (2018, 2019) and Clerico et al. (2018) that show the importance of such features for mental workload and affective state assessment, as well as their robustness to movement artifacts.
Coherence based measures, in turn, were the second top-performing features and appeared mostly in high PA conditions. They represented ~17 and 18% of the top features for the raw and enhanced conditions, respectively. Coherence measures have been linked movement and visual-motion discrimination and are indicative of the additional mental resources involved during physical activity (Händel and Haarmeier, 2009; Cheron et al., 2016). The important coherence features were mostly extracted from the pre-frontal regions, which have been linked to mental workload and attention (Mandrick et al., 2013), while a few were extracted from parietal regions, thus suggesting some contribution of balance control also involved (Hülsdünker et al., 2015).
Regarding brain hemispheres, features from the right regions were selected slightly more often than the left hemisphere, particularly in high PA conditions. This corroborates previous work (Perennou et al., 1999) that has shown the existence of a right hemispheric dominance for postural control. Inter-hemispheric signals, in turn, corresponded to roughly 33% of the top features for all PA conditions. Within the top features, inter-hemispheric parietal features typically appeared in low PA conditions, whereas inter-hemispheric pre-frontal features appeared during high PA conditions. This suggests a shift in visuo-motor (Iacoboni and Zaidel, 2004) and attention (Vossel et al., 2016) aspects during low PA, to more complex motor behaviors and sensorimotor integration aspects with high PA (Geschwind and Iacoboni, 1999). Overall, in the enhancement scenario, the parietal regions were responsible for the majority of the top features, followed closely by the pre-frontal cortex, for both low and high PA conditions. These results are in line with the classical mental workload literature with non-ambulant users (Aoki et al., 1999; Holm et al., 2009; Borghini et al., 2012; Mandrick et al., 2013; Käthner et al., 2014; Al-Shargie, 2019), thus further showing the promise of the proposed adaptive filtering scheme.
Lastly, regarding EEG subband frequencies, as expected, adaptive filtering combined with HAPPE reduced the importance of features extracted from θ and α bands, as these have the highest overlap with the accelerometry data. It did, on the other hand, boost the importance of features extracted from the β and γ bands. It is well-known that γ is highly sensitive to muscle activity (Muthukumaraswamy, 2013) and HAPPE is known to remove such artifacts. With the proposed enhancement scheme, γ features (and γ−mδ) remained consistent between low and high PA conditions and covered aspects related to sensory motor integration (Aoki et al., 1999; Sauseng et al., 2015), attention (Sammer et al., 2007; Wang et al., 2017), and balance control (Gwin et al., 2011; Sipp et al., 2013). The importance of the β band, in turn, has been observed in other studies during intense physical exercises (Rahman et al., 2019), anticipation in a decision making game (Cohen et al., 2009) and increment of cognitive control and attention (Kakkos et al., 2019).
4. Conclusions
This paper has proposed the use of an adaptive filtering scheme to remove movement artifacts from EEG signals for robust mental workload assessment. Experimental results have shown that the proposed adaptive filtering scheme is best combined with HAPPE and can result in 97% mental workload prediction accuracy for both low and high physical activity conditions. Moreover, an in-depth analysis of the top-selected features have shown the importance of modulation spectral features for the task at hand, as well as the potential of the proposed enhancement solution at maintaining important discriminant information from the EEG for mental workload measurement, in particular those captured by γ frequency band-based features.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by Ethics Review Boards of INRS, Universite Laval, and the PERFORM Centre (Concordia University). The patients/participants provided their written informed consent to participate in this study.
Author Contributions
OR, IA, RC, and J-FG: statistical analysis and programming. OR, IA, and RC: data collection. ST and TF: funding and supervision. All authors experimental design, writing, and reviewing.
Conflict of Interest
J-FG was employed by the company Thales Research and Technology. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The remaining authors declare that this study received funding from Thales Digital Solutions Inc. The funder was not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.
Acknowledgments
The authors wish to acknowledge funding from NSERC, MITACS, PROMPT, and Thales Digital Solutions Inc. The grant number for NSERC is CRDPJ 485455-15.
References
Aghajani, H., and Omurtag, A. (2016). “Assessment of mental workload by EEG+ fNIRS,” in 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Orlando, FL: IEEE), 3773–3776. doi: 10.1109/EMBC.2016.7591549
Albuquerque, I., Rosanne, O., Gagnon, J. F., Tremblay, S., and Falk, T. H. (2019). “Fusion of spectral and spectro-temporal eeg features for mental workload assessment under different levels of physical activity,” in 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER) (San Francisco, CL: IEEE), 311–314. doi: 10.1109/NER.2019.8717092
Albuquerque, I., Tiwari, A., Gagnon, J. F., Lafond, D., Parent, M., Tremblay, S., et al. (2018). “On the analysis of EEG features for mental workload assessment during physical activity,” in 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (Miyazaki: IEEE), 538–543. doi: 10.1109/SMC.2018.00101
Albuquerque, I., Tiwari, A., Parent, M., Cassani, R., Gagnon, J.-F., Lafond, D., et al. (2020). WAUC: a multi-modal database for mental workload assessment under physical activity. Front. Neurosci. 14:549524. doi: 10.3389/fnins.2020.549524
Al-Shargie, F. (2019). Multilevel Assessment of Mental Stress Using SVM With ECOC: An EEG Approach. engrXiv.
Aoki, F., Fetz, E., Shupe, L., Lettich, E., and Ojemann, G. (1999). Increased gamma-range activity in human sensorimotor cortex during performance of visuomotor tasks. Clin. Neurophysiol. 110, 524–537. doi: 10.1016/S1388-2457(98)00064-9
Aricò, P., Borghini, G., Di Flumeri, G., Colosimo, A., Bonelli, S., Golfetti, A., et al. (2016). Adaptive automation triggered by eeg-based mental workload index: a passive brain-computer interface application in realistic air traffic control environment. Front. Hum. Neurosci. 10:539. doi: 10.3389/fnhum.2016.00539
Blum, A. L., and Langley, P. (1997). Selection of relevant features and examples in machine learning. Artif. Intell. 97, 245–271. doi: 10.1016/S0004-3702(97)00063-5
Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., and Babiloni, F. (2014). Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75. doi: 10.1016/j.neubiorev.2012.10.003
Borghini, G., Vecchiato, G., Toppi, J., Astolfi, L., Maglione, A., Isabella, R., et al. (2012). “Assessment of mental fatigue during car driving by using high resolution EEG activity and neurophysiologic indices,” in 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (San Diego, CA: IEEE), 6442–6445. doi: 10.1109/EMBC.2012.6347469
Bouten, C. V., Koekkoek, K. T., Verduin, M., Kodde, R., and Janssen, J. D. (1997). A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity. IEEE Trans. Biomed. Eng. 44, 136–147. doi: 10.1109/10.554760
Burbank, D. P., and Webster, J. G. (1978). Reducing skin potential motion artefact by skin abrasion. Med. Biol. Eng. Comput. 16, 31–38. doi: 10.1007/BF02442929
Cao, A., Chintamani, K. K., Pandya, A. K., and Ellis, R. D. (2009). NASA TLX: software for assessing subjective mental workload. Behav. Res. Methods 41, 113–117. doi: 10.3758/BRM.41.1.113
Cassani, R., Falk, T. H., Fraga, F. J., Kanda, P. A., and Anghinah, R. (2014). The effects of automated artifact removal algorithms on electroencephalography-based Alzheimer's disease diagnosis. Front. Aging Neurosci. 6:55. doi: 10.3389/fnagi.2014.00055
Castellanos, N. P., and Makarov, V. A. (2006). Recovering EEG brain signals: artifact suppression with wavelet enhanced independent component analysis. J. Neurosci. Methods 158, 300–312. doi: 10.1016/j.jneumeth.2006.05.033
Chang, C. Y., Hsu, S. H., Pion-Tonachini, L., and Jung, T. P. (2019). Evaluation of artifact subspace reconstruction for automatic artifact components removal in multi-channel EEG recordings. IEEE Trans. Biomed. Eng. 67, 1114–1121. doi: 10.1109/TBME.2019.2930186
Cheron, G., Petit, G., Cheron, J., Leroy, A., Cebolla, A., Cevallos, C., et al. (2016). Brain oscillations in sport: toward EEG biomarkers of performance. Front. Psychol. 7:246. doi: 10.3389/fpsyg.2016.00246
Clayton, M. S., Yeung, N., and Kadosh, R. C. (2015). The roles of cortical oscillations in sustained attention. Trends Cogn. Sci. 19, 188–195. doi: 10.1016/j.tics.2015.02.004
Clerico, A., Gupta, R., and Falk, T. H. (2015). “Mutual information between inter-hemispheric eeg spectro-temporal patterns: a new feature for automated affect recognition,” in 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER) (Montpellier: IEEE), 914–917. doi: 10.1109/NER.2015.7146774
Clerico, A., Tiwari, A., Gupta, R., Jayaraman, S., and Falk, T. H. (2018). Electroencephalography amplitude modulation analysis for automated affective tagging of music video clips. Front. Comput. Neurosci. 11:115. doi: 10.3389/fncom.2017.00115
Cohen, M. X., Elger, C. E., and Fell, J. (2009). Oscillatory activity and phase–amplitude coupling in the human medial frontal cortex during decision making. J. Cogn. Neurosci. 21, 390–402. doi: 10.1162/jocn.2008.21020
Craik, A., He, Y., and Contreras-Vidal, J. L. (2019). Deep learning for electroencephalogram (EEG) classification tasks: a review. J. Neural Eng. 16:031001. doi: 10.1088/1741-2552/ab0ab5
de Talhouet, H., and Webster, J. G. (1996). The origin of skin-stretch-caused motion artifacts under electrodes. Physiol. Meas. 17, 81. doi: 10.1088/0967-3334/17/2/003
Dimitrakopoulos, G. N., Kakkos, I., Dai, Z., Lim, J., deSouza, J. J., Bezerianos, A., et al. (2017). Task-independent mental workload classification based upon common multiband EEG cortical connectivity. IEEE Trans. Neural Syst. Rehabil. Eng. 25, 1940–1949. doi: 10.1109/TNSRE.2017.2701002
Fan, J., and Fan, Y. (2008). High dimensional classification using features annealed independence rules. Ann. Stat. 36:2605. doi: 10.1214/07-AOS504
Fraga, F. J., Falk, T. H., Kanda, P. A., and Anghinah, R. (2013). Characterizing Alzheimer's disease severity via resting-awake EEG amplitude modulation analysis. PLoS ONE 8:e72240. doi: 10.1371/journal.pone.0072240
Gabard-Durnam, L. J., Mendez Leal, A. S., Wilkinson, C. L., and Levin, A. R. (2018). The harvard automated processing pipeline for electroencephalography (HAPPE): standardized processing software for developmental and high-artifact data. Front. Neurosci. 12:97. doi: 10.3389/fnins.2018.00097
Gao, J., Zheng, C., and Wang, P. (2010). Online removal of muscle artifact from electroencephalogram signals based on canonical correlation analysis. Clin. EEG Neurosci. 41, 53–59. doi: 10.1177/15500594100410011
Geschwind, D. H., and Iacoboni, M. (1999). “Structural and functional asymmetries of the human frontal lobes,” in The Human Frontal Lobes: Functions and Disorders, eds B. L. Miller, and J. L. Cummings (New York, NY: Guilford Press), 45–70.
Grtner, A., Behnke, A., Conrad, D., Kolassa, I.-T., and Rojas, R. (2019). Emotion regulation in rescue workers: differential relationship with perceived work-related stress and stress-related symptoms. Front. Psychol. 9:2744. doi: 10.3389/fpsyg.2018.02744
Gwin, J. T., Gramann, K., Makeig, S., and Ferris, D. P. (2010). Removal of movement artifact from high-density EEG recorded during walking and running. J. Neurophysiol. 103, 3526–3534. doi: 10.1152/jn.00105.2010
Gwin, J. T., Gramann, K., Makeig, S., and Ferris, D. P. (2011). Electrocortical activity is coupled to gait cycle phase during treadmill walking. Neuroimage 54, 1289–1296. doi: 10.1016/j.neuroimage.2010.08.066
Händel, B., and Haarmeier, T. (2009). Cross-frequency coupling of brain oscillations indicates the success in visual motion discrimination. Neuroimage 45, 1040–1046. doi: 10.1016/j.neuroimage.2008.12.013
Hart, S. G., and Staveland, L. E. (1988). Development of nasa-tlx (task load index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183. doi: 10.1016/S0166-4115(08)62386-9
Hogervorst, M. A., Brouwer, A. M., and Van Erp, J. B. (2014). Combining and comparing EEG, peripheral physiology and eye-related measures for the assessment of mental workload. Front. Neurosci. 8:322. doi: 10.3389/fnins.2014.00322
Holm, A., Lukander, K., Korpela, J., Sallinen, M., and Müller, K. M. (2009). Estimating brain load from the EEG. Sci. World J. 9, 639–651. doi: 10.1100/tsw.2009.83
Hülsdünker, T., Mierau, A., Neeb, C., Kleinöder, H., and Strüder, H. (2015). Cortical processes associated with continuous balance control as revealed by EEG spectral power. Neurosci. Lett. 592, 1–5. doi: 10.1016/j.neulet.2015.02.049
Iacoboni, M., and Zaidel, E. (2004). Interhemispheric visuo-motor integration in humans: the role of the superior parietal cortex. Neuropsychologia 42, 419–425. doi: 10.1016/j.neuropsychologia.2003.10.007
Johnson, M. K., Blanco, J. A., Gentili, R. J., Jaquess, K. J., Oh, H., and Hatfield, B. D. (2015). “Probe-independent eeg assessment of mental workload in pilots,” in 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER) (Montpellier: IEEE), 581–584. doi: 10.1109/NER.2015.7146689
Kakkos, I., Dimitrakopoulos, G. N., Gao, L., Zhang, Y., Qi, P., Matsopoulos, G. K., et al. (2019). Mental workload drives different reorganizations of functional cortical connectivity between 2d and 3d simulated flight experiments. IEEE Trans. Neural Syst. Rehabil. Eng. 27, 1704–1713. doi: 10.1109/TNSRE.2019.2930082
Käthner, I., Wriessnegger, S. C., Müller-Putz, G. R., Kübler, A., and Halder, S. (2014). Effects of mental workload and fatigue on the P300, alpha and theta band power during operation of an ERP (P300) brain-computer interface. Biol. Psychol. 102, 118–129. doi: 10.1016/j.biopsycho.2014.07.014
Kearney, K., Thomas, C., and McAdams, E. (2007). “Quantification of motion artifact in ECG electrode design,” in 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Lyon: IEEE), 1533–1536. doi: 10.1109/IEMBS.2007.4352594
Lean, Y., and Shan, F. (2012). Brief review on physiological and biochemical evaluations of human mental workload. Hum. Fact. Ergon. Manuf. Serv. Ind. 22, 177–187. doi: 10.1002/hfm.20269
Liu, Y., Ayaz, H., and Shewokis, P. A. (2017). Mental workload classification with concurrent electroencephalography and functional near-infrared spectroscopy. Brain Comput. Interfaces 4, 175–185. doi: 10.1080/2326263X.2017.1304020
Mak, J. N., Chan, R. H., and Wong, S. W. (2013). “Evaluation of mental workload in visual-motor task: spectral analysis of single-channel frontal EEG,” in IECON 2013–39th Annual Conference of the IEEE Industrial Electronics Society (Vienna: IEEE), 8426–8430. doi: 10.1109/IECON.2013.6700546
Mandrick, K., Derosiere, G., Dray, G., Coulon, D., Micallef, J.-P., and Perrey, S. (2013). Prefrontal cortex activity during motor tasks with additional mental load requiring attentional demand: a near-infrared spectroscopy study. Neurosci. Res. 76, 156–162. doi: 10.1016/j.neures.2013.04.006
McMenamin, B. W., Shackman, A. J., Greischar, L. L., and Davidson, R. J. (2011). Electromyogenic artifacts and electroencephalographic inferences revisited. NeuroImage 54, 4–9. doi: 10.1016/j.neuroimage.2010.07.057
Mihajlović, V., Patki, S., and Grundlehner, B. (2014). “The impact of head movements on EEG and contact impedance: an adaptive filtering solution for motion artifact reduction,” in 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Chicago, IL: IEEE), 5064–5067. doi: 10.1109/EMBC.2014.6944763
Mognon, A., Jovicich, J., Bruzzone, L., and Buiatti, M. (2011). Adjust: an automatic EEG artifact detector based on the joint use of spatial and temporal features. Psychophysiology 48, 229–240. doi: 10.1111/j.1469-8986.2010.01061.x
Morikawa, K., Matsumoto, A., Patki, S., Grundlehner, B., Verwegen, A., Xu, J., et al. (2013). “Compact wireless eeg system with active electrodes for daily healthcare monitoring,” in 2013 IEEE International Conference on Consumer Electronics (ICCE) (Berlin), 204–205. doi: 10.1109/ICCE.2013.6486859
Mucarquer, J. A., Prado, P., Escobar, M. J., El-Deredy, W., and Zañartu, M. (2019). Improving eeg muscle artifact removal with an EMG array. IEEE Trans. Instr. Meas. 69, 815–824. doi: 10.1109/TIM.2019.2906967
Mullen, T. R., Kothe, C. A. E., Chi, Y. M., Ojeda, A., Kerth, T., Makeig, S., et al. (2015). Real-time neuroimaging and cognitive monitoring using wearable dry eeg. IEEE Trans. Biomed. Eng. 62, 2553–2567. doi: 10.1109/TBME.2015.2481482
Muthukumaraswamy, S. (2013). High-frequency brain activity and muscle artifacts in MEG/EEG: a review and recommendations. Front. Hum. Neurosci. 7:138. doi: 10.3389/fnhum.2013.00138
Nathan, K., and Contreras-Vidal, J. L. (2016). Negligible motion artifacts in scalp Electroencephalography (EEG) during treadmill walking. Front. Hum. Neurosci. 9:708. doi: 10.3389/fnhum.2015.00708
Onikura, K., and Iramina, K. (2015). “Evaluation of a head movement artifact removal method for EEG considering real-time prosessing,” in 2015 8th Biomedical Engineering International Conference (BMEiCON) (Pattaya: IEEE), 1–4. doi: 10.1109/BMEiCON.2015.7399577
Oshiro, T. M., Perez, P. S., and Baranauskas, J. A. (2012). “How many trees in a random forest?” in Machine Learning and Data Mining in Pattern Recognition, ed P. Perner (Berlin; Heidelberg: Springer Berlin Heidelberg), 154–168. doi: 10.1007/978-3-642-31537-4_13
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830.
Peng, H., Long, F., and Ding, C. (2005). Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1226–1238. doi: 10.1109/TPAMI.2005.159
Perennou, D., Benaim, C., Rouget, E., Rousseaux, M., Blard, J., and Pelissier, J. (1999). Postural balance following stroke: towards a disadvantage of the right brain-damaged hemisphere. Rev. Neurol. 155, 281–290.
Qi, Y. (2012). “Random forest for bioinformatics,” in Ensemble Machine Learning, eds C. Zhang, Y. Ma and (Princeton, NJ: Springer), 307–323. doi: 10.1007/978-1-4419-9326-7_11
Rahman, M., Karwowski, W., Fafrowicz, M., and Hancock, P. A. (2019). Neuroergonomics applications of electroencephalography in physical activities: a systematic review. Front. Hum. Neurosci. 13:182. doi: 10.3389/fnhum.2019.00277
Raya, M. A. D., and Sison, L. G. (2002). “Adaptive noise cancelling of motion artifact in stress ECG signals using accelerometer,” in Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society (Engineering in Medicine and Biology), Vol. 2 (Houston, TX: IEEE), 1756–1757. doi: 10.1109/IEMBS.2002.1106637
Rosanne, O., Albuquerque, I., Gagnon, J. F., Tremblay, S., and Falk, T. H. (2019). “Performance comparison of automated eeg enhancement algorithms for mental workload assessment of ambulant users,” in 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER) (IEEE), 61–64. doi: 10.1109/NER.2019.8716977
Sammer, G., Blecker, C., Gebhardt, H., Bischoff, M., Stark, R., Morgen, K., et al. (2007). Relationship between regional hemodynamic activity and simultaneously recorded EEG-theta associated with mental arithmetic-induced workload. Hum. Brain Mapp. 28, 793–803. doi: 10.1002/hbm.20309
Santiago-Espada, Y., Myer, R., Latorella, K., and Comstock, J. (2011). The Multi-Attribute Task Battery II (Matb-II) Software for Human Performance and Workload Research: A User's Guide (NASA/TM-2011–217164). Hampton, VA: NASA Langley Research Center.
Sauseng, P., Conci, M., Wild, B., and Geyer, T. (2015). Predictive coding in visual search as revealed by cross-frequency EEG phase synchronization. Front. Psychol. 6:1655. doi: 10.3389/fpsyg.2015.01655
Seeber, M., Scherer, R., Wagner, J., Solis-Escalante, T., and Müller-Putz, G. R. (2014). EEG beta suppression and low gamma modulation are different elements of human upright walking. Front. Hum. Neurosci. 8:485. doi: 10.3389/fnhum.2014.00485
Sipp, A. R., Gwin, J. T., Makeig, S., and Ferris, D. P. (2013). Loss of balance during balance beam walking elicits a multifocal theta band electrocortical response. J. Neurophysiol. 110, 2050–2060. doi: 10.1152/jn.00744.2012
So, W. K., Wong, S. W., Mak, J. N., and Chan, R. H. (2017). An evaluation of mental workload with frontal EEG. PLoS ONE 12:e0174949. doi: 10.1371/journal.pone.0174949
Tiwari, A., Albuquerque, I., Gagnon, J. F., Lafond, D., Parent, M., Tremblay, S., et al. (2019). “Mental workload assessment during physical activity using non-linear movement artefact robust electroencephalography features,” in 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) (Bari: IEEE), 4149–4154. doi: 10.1109/SMC.2019.8914038
Tort, A. B., Komorowski, R., Eichenbaum, H., and Kopell, N. (2010). Measuring phase-amplitude coupling between neuronal oscillations of different frequencies. J. Neurophysiol. 104, 1195–1210. doi: 10.1152/jn.00106.2010
Trambaiolli, L. R., Falk, T. H., Fraga, F. J., Anghinah, R., and Lorena, A. C. (2011). “EEG spectro-temporal modulation energy: a new feature for automated diagnosis of Alzheimer's disease,” in 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Boston, MA: IEEE), 3828–3831. doi: 10.1109/IEMBS.2011.6090951
Urigüen, J. A., and Garcia-Zapirain, B. (2015). EEG artifact removal—state-of-the-art and guidelines. J. Neural Eng. 12:031001. doi: 10.1088/1741-2560/12/3/031001
Vossel, S., Weidner, R., Moos, K., and Fink, G. R. (2016). Individual attentional selection capacities are reflected in interhemispheric connectivity of the parietal cortex. Neuroimage 129, 148–158. doi: 10.1016/j.neuroimage.2016.01.054
Voytek, B., Canolty, R. T., Shestyuk, A., Crone, N., Parvizi, J., and Knight, R. T. (2010). Shifts in gamma phase-amplitude coupling frequency from theta to alpha over posterior cortex during visual tasks. Front. Hum. Neurosci. 4:191. doi: 10.3389/fnhum.2010.00191
Wang, D., Chen, J., Zhao, D., Dai, F., Zheng, C., and Wu, X. (2017). Monitoring workers' attention and vigilance in construction activities through a wireless and wearable electroencephalography system. Autom. Constr. 82, 122–137. doi: 10.1016/j.autcon.2017.02.001
Zanto, T. P., Rubens, M. T., Thangavel, A., and Gazzaley, A. (2011). Causal role of the prefrontal cortex in top-down modulation of visual processing and working memory. Nat. Neurosci. 14:656. doi: 10.1038/nn.2773
Zarjam, P., Epps, J., and Lovell, N. H. (2015). Beyond subjective self-rating: EEG signal classification of cognitive workload. IEEE Trans. Auton. Mental Dev. 7, 301–310. doi: 10.1109/TAMD.2015.2441960
Zhang, C., Yu, X., Yang, Y., and Xu, L. (2014). Phase synchronization and spectral coherence analysis of EEG activity during mental fatigue. Clin. EEG Neurosci. 45, 249–256. doi: 10.1177/1550059413503961
Zhang, P., Wang, X., Chen, J., You, W., and Zhang, W. (2019). Spectral and temporal feature learning with two-stream neural networks for mental workload assessment. IEEE Trans. Neural Syst. Rehabil. Eng. 27, 1149–1159. doi: 10.1109/TNSRE.2019.2913400
Keywords: EEG, physical activity, amplitude modulation features, wearable sensors, adaptive filtering, mental workload assessment
Citation: Rosanne O, Albuquerque I, Cassani R, Gagnon J-F, Tremblay S and Falk TH (2021) Adaptive Filtering for Improved EEG-Based Mental Workload Assessment of Ambulant Users. Front. Neurosci. 15:611962. doi: 10.3389/fnins.2021.611962
Received: 29 September 2020; Accepted: 08 March 2021;
Published: 07 April 2021.
Edited by:
Amit Konar, Jadavpur University, IndiaReviewed by:
Rubita Sudirman, University of Technology Malaysia, MalaysiaLiang Zou, China University of Mining and Technology, China
Copyright © 2021 Rosanne, Albuquerque, Cassani, Gagnon, Tremblay and Falk. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Olivier Rosanne, olivier.rosanne@inrs.ca