<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Hum. Neurosci.</journal-id>
<journal-title>Frontiers in Human Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Hum. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-5161</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnhum.2024.1371631</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Human Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Recording the tactile P300 with the cEEGrid for potential use in a brain-computer interface</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Eidel</surname> <given-names>M.</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/883285/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/methodology/"/>
<role content-type="https://credit.niso.org/contributor-roles/software/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Pfeiffer</surname> <given-names>M.</given-names></name>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Ziebell</surname> <given-names>P.</given-names></name>
<uri xlink:href="https://loop.frontiersin.org/people/797632/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name>
<uri xlink:href="https://loop.frontiersin.org/people/3713/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/funding-acquisition/"/>
<role content-type="https://credit.niso.org/contributor-roles/project-administration/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
<role content-type="https://credit.niso.org/contributor-roles/supervision/"/>
</contrib>
</contrib-group>
<aff><institution>Institute of Psychology, University of W&#x00FC;rzburg</institution>, <addr-line>W&#x00FC;rzburg</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001">
<p>Edited by: Kai Keng Ang, Institute for Infocomm Research (A&#x002A;STAR), Singapore</p>
</fn>
<fn fn-type="edited-by" id="fn0002">
<p>Reviewed by: Alejandro Ojeda, Brain Vision LLC, United States</p>
<p>Penghai Li, Tianjin University of Technology, China</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: M. Eidel, <email>Matthias.Eidel@uni-wuerzburg.de</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>12</day>
<month>06</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>18</volume>
<elocation-id>1371631</elocation-id>
<history>
<date date-type="received">
<day>16</day>
<month>01</month>
<year>2024</year>
</date>
<date date-type="accepted">
<day>27</day>
<month>05</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2024 Eidel, Pfeiffer, Ziebell and K&#x00FC;bler.</copyright-statement>
<copyright-year>2024</copyright-year>
<copyright-holder>Eidel, Pfeiffer, Ziebell and K&#x00FC;bler</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Brain-computer interfaces (BCIs) are scientifically well established, but they rarely arrive in the daily lives of potential end-users. This could be in part because electroencephalography (EEG), a prevalent method to acquire brain activity for BCI operation, is considered too impractical to be applied in daily life of end-users with physical impairment as an assistive device. Hence, miniaturized EEG systems such as the cEEGrid have been developed. While they promise to be a step toward bridging the gap between BCI development, lab demonstrations, and home use, they still require further validation. Encouragingly, the cEEGrid has already demonstrated its ability to record visually and auditorily evoked event-related potentials (ERP), which are important as input signal for many BCIs. With this study, we aimed at evaluating the cEEGrid in the context of a BCI based on tactually evoked ERPs. To compare the cEEGrid with a conventional scalp EEG, we recorded brain activity with both systems simultaneously. Forty healthy participants were recruited to perform a P300 oddball task based on vibrotactile stimulation at four different positions. This tactile paradigm has been shown to be feasible for BCI repeatedly but has never been tested with the cEEGrid. We found distinct P300 deflections in the cEEGrid data, particularly at vertical bipolar channels. With an average of 63%, the cEEGrid classification accuracy was significantly above the chance level (25%) but significantly lower than the 81% reached with the EEG cap. Likewise, the P300 amplitude was significantly lower (cEEGrid R2&#x2013;R7: 1.87&#x2009;&#x03BC;V, Cap Cz: 3.53&#x2009;&#x03BC;V). These results indicate that a tactile BCI using the cEEGrid could potentially be operated, albeit with lower efficiency. Additionally, participants&#x2019; somatosensory sensitivity was assessed, but no correlation to the accuracy of either EEG system was shown. Our research contributes to the growing amount of literature comparing the cEEGrid to conventional EEG systems and provides first evidence that the tactile P300 can be recorded behind the ear. A BCI based on a thus simplified EEG system might be more readily accepted by potential end-users, provided the accuracy can be substantially increased, e.g., by training and improved classification.</p>
</abstract>
<kwd-group>
<kwd>brain-computer interface (BCI)</kwd>
<kwd>P300-event-related potential</kwd>
<kwd>tactile P300</kwd>
<kwd>tactually evoked potentials</kwd>
<kwd>somatosensory sensitivity</kwd>
</kwd-group>
<contract-sponsor id="cn1">Lotte Schopper-Stiftung c/o Rummelsberger Dienste f&#x00FC;r Menschen mit Behinderung gGmbH &#x2013; Schwarzenbruck, Landkreis N&#x00FC;rnberger Land, Mittelfranken, 762 Germany</contract-sponsor>
<contract-sponsor id="cn2">University of Wuerzburg</contract-sponsor>
<counts>
<fig-count count="5"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="69"/>
<page-count count="12"/>
<word-count count="8236"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Brain-Computer Interfaces</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec1">
<label>1</label>
<title>Introduction</title>
<p>Electroencephalography (EEG) is a versatile and accessible tool to record brain activity non-invasively from the scalp and is therefore widely used in psychology, neuroscience and medicine. One field of application particularly relevant for the present study are EEG based brain-computer interfaces (BCIs), a technology that allows users to interact with the environment without requiring muscular control.</p>
<p>In a BCI, brain activity is acquired with EEG or similar technology and translated into commands by specialized machine learning algorithms (for a review, see <xref ref-type="bibr" rid="ref41">Lotte et al., 2018</xref>). This allows access to a variety of functions, often for communication and device control (<xref ref-type="bibr" rid="ref66">Vaughan, 2003</xref>; <xref ref-type="bibr" rid="ref35">K&#x00FC;bler, 2019</xref>; <xref ref-type="bibr" rid="ref55">Saha et al., 2021</xref>). Many BCI paradigms rely on event-related potentials (ERPs) such as the P300 as input signal to determine the user&#x2019;s intent (<xref ref-type="bibr" rid="ref52">Polich and Margala, 1997</xref>; <xref ref-type="bibr" rid="ref45">McFarland, 2020</xref>). P300 BCIs are based on the oddball-paradigm (<xref ref-type="bibr" rid="ref17">Donchin et al., 1978</xref>), in which the user has to concentrate on rare and randomly occurring &#x201C;target&#x201D; stimuli while ignoring frequent &#x201C;non-target&#x201D; stimuli. Target stimulus rarity and unexpectedness have long been considered important factors to elicit large P300 amplitudes in the oddball paradigm, though this notion has recently been challenged (<xref ref-type="bibr" rid="ref67">Verleger and &#x015A;migasiewicz, 2016</xref>; <xref ref-type="bibr" rid="ref68">Wascher et al., 2020</xref>). Generally, P300 amplitude and location may vary between individuals, which might be due to numerous factors, for example the subject&#x2019;s age (<xref ref-type="bibr" rid="ref65">van Dinteren et al., 2018</xref>).</p>
<p>The P300 is typically measured at electrode positions Fz, Cz and Pz. It appears in the EEG as a positive deflection about 300&#x2009;ms after the target stimulus (<xref ref-type="bibr" rid="ref51">Polich, 2007</xref>). Thus, it can be used to automatically detect which stimulus was attended by the user, which is the basis of many BCI approaches.</p>
<p>Due to their independence from voluntary motor control, BCIs have the potential to be a valuable assistive tool to restore or enhance functions even for patients with severe motor paralysis (<xref ref-type="bibr" rid="ref30">Kaufmann et al., 2013</xref>; <xref ref-type="bibr" rid="ref44">McCane et al., 2014</xref>; <xref ref-type="bibr" rid="ref6">Botrel et al., 2017</xref>; <xref ref-type="bibr" rid="ref21">Eidel et al., 2021</xref>). Potential BCI end-users, thus, include people diagnosed with the <italic>locked-in syndrome</italic> (LIS), a state of near-complete paralysis, which can manifest in patients with <italic>amyotrophic lateral sclerosis</italic>, stroke, or other conditions (<xref ref-type="bibr" rid="ref2">Bauer et al., 1979</xref>; <xref ref-type="bibr" rid="ref69">Wolpaw et al., 2002</xref>; <xref ref-type="bibr" rid="ref62">Smith and Delargy, 2005</xref>).</p>
<p>Although there is a considerable need for innovative devices to assist patients with severe or even total motor paralysis in their daily lives, prospective end-users rarely get the chance to establish BCIs in their own home (with a few notable exceptions; for an overview see <xref ref-type="bibr" rid="ref58">Sellers et al., 2010</xref>; <xref ref-type="bibr" rid="ref35">K&#x00FC;bler, 2019</xref>; <xref ref-type="bibr" rid="ref1">Allison et al,. 2020</xref>). Thus, a notable translational gap remains, despite the fact that BCIs have long been proven feasible under laboratory conditions (<xref ref-type="bibr" rid="ref34">K&#x00FC;bler, 2013</xref>; <xref ref-type="bibr" rid="ref38">K&#x00FC;bler et al., 2015</xref>; <xref ref-type="bibr" rid="ref49">Nijboer, 2015</xref>). The user-centered approach to BCI design has been adapted to evaluate BCI operation in a multimodal way (<xref ref-type="bibr" rid="ref70">Zickler et al., 2011</xref>). It includes measures of efficiency (accuracy) and effectiveness (speed in relation to accuracy) of a BCI, but also the individual user satisfaction (<xref ref-type="bibr" rid="ref10">Choi et al., 2017</xref>; <xref ref-type="bibr" rid="ref25">Han et al., 2022</xref>). Low user satisfaction has been suggested as a major contributor to the translational gap, as BCI users often report that they were not satisfied with certain practical aspects of the EEG hardware. Frequent remarks include that setting up the EEG was too difficult for caregivers, the EEG cap cumbersome with too many cables, and that the EEG gel in the hair was unpleasant (<xref ref-type="bibr" rid="ref37">K&#x00FC;bler et al., 2014</xref>; <xref ref-type="bibr" rid="ref42">Lynn et al., 2016</xref>; <xref ref-type="bibr" rid="ref19">Eidel and K&#x00FC;bler, 2020</xref>). On top of that, the EEG cap is often considered as too visually prominent and aesthetically unappealing (<xref ref-type="bibr" rid="ref70">Zickler et al., 2011</xref>; <xref ref-type="bibr" rid="ref28">Hoon Lee et al., 2014</xref>).</p>
<p>Notably, there are efforts to alleviate some of these issues, for example by developing alternative and more compact EEG systems. An extensive study recently confirmed that the auditory N100, MMN, P300 and N400 could be recorded reliably with electrodes placed around the ears (<xref ref-type="bibr" rid="ref46">Meiser and Bleichner, 2022</xref>), despite some expected signal loss as compared to standard scalp-EEG positions. In fact, specialized ear-EEG systems already exist: Examples include tiny EEG sensors that are placed into the <italic>concha</italic> and outer ear canal (<xref ref-type="bibr" rid="ref40">Looney et al., 2011</xref>; <xref ref-type="bibr" rid="ref32">Kidmose et al., 2013</xref>) as well as devices that are positioned around or behind the ear (<xref ref-type="bibr" rid="ref16">Do Valle et al., 2014</xref>), particularly the <italic>cEEGrid</italic> (<xref ref-type="bibr" rid="ref14">Debener et al., 2015</xref>). The cEEGrid is a semi-disposable, flex-printed sensor array of ten Ag/AgCl electrodes per ear (<xref ref-type="fig" rid="fig1">Figure 1</xref> shows the channel configuration for the right ear). With its c-shape, it is simply attached around the ear with double-sided adhesive tape. Only a small amount of gel is added onto the electrode surfaces to ensure low impedances. This gel is protected from drying out by the tape seal around it. Indeed, test subjects wore cEEGrids for several hours of normal activity outside of the lab with no substantial decline in recording quality (<xref ref-type="bibr" rid="ref14">Debener et al., 2015</xref>). A cEEGrid system is flexible and can be connected wirelessly, allowing for high mobility while being relatively unobtrusive and discreet.</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>Hardware setup. On the right ear cEEGrid (version V3), channels R4a and R4b serve as ground and reference, respectively. Left ear channels are named analogously (L1, L2 etc.). Also shown is a single C2 tactor (Engineering Acoustic Inc., Casselberry, United States) and the four tactor positions. To facilitate stimulus perception, two devices were attached per position (activated synchronously).</p>
</caption>
<graphic xlink:href="fnhum-18-1371631-g001.tif"/>
</fig>
<p>Multiple studies have already described how ERPs, for instance the N100, P100 and P300, can be recorded and reliably classified using the cEEGrid &#x2013; sometimes with accuracies statistically on par with those from an EEG cap (<xref ref-type="bibr" rid="ref14">Debener et al., 2015</xref>; <xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>; <xref ref-type="bibr" rid="ref15">Denk et al., 2018</xref>). Notably, it was found that classification of several ERPs worked best at bipolar channels, in particular from electrode pairs which have a large inter-electrode distance and are arranged toward the origin of the signal of interest (<xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>). These studies used either visual or auditory stimulation to elicit the P300. To our knowledge, a tactile P300 has never been recorded with the cEEGrid.</p>
<p>Thus, with the present study, we aimed at providing a first demonstration of a cEEGrid in combination with our tactile BCI system (<xref ref-type="bibr" rid="ref29">Kaufmann et al., 2014</xref>), which was originally developed for potential wheelchair control by paralyzed users. Tactile and other non-visual P300 paradigms (e.g., auditory BCIs) have already been shown to be feasible with conventional scalp EEG recording (<xref ref-type="bibr" rid="ref22">Furdea et al., 2009</xref>; <xref ref-type="bibr" rid="ref7">Brouwer and van Erp, 2010</xref>; <xref ref-type="bibr" rid="ref57">Schreuder et al., 2011</xref>; <xref ref-type="bibr" rid="ref27">Hill and Sch&#x00F6;lkopf, 2012</xref>; <xref ref-type="bibr" rid="ref54">Riccio et al., 2012</xref>; <xref ref-type="bibr" rid="ref29">Kaufmann et al., 2014</xref>; <xref ref-type="bibr" rid="ref61">Simon et al., 2015</xref>; <xref ref-type="bibr" rid="ref3">Baykara et al., 2016</xref>; <xref ref-type="bibr" rid="ref24">Halder et al., 2016</xref>). Importantly, tactile and auditory BCIs could pose a valuable alternative for end-users with impairment of eyesight or gaze control, who may not be able to operate visual paradigms efficiently (<xref ref-type="bibr" rid="ref36">K&#x00FC;bler and Birbaumer, 2008</xref>; <xref ref-type="bibr" rid="ref8">Brunner et al., 2010</xref>). Moreover, several studies confirmed the tactile BCI modality was feasible for severely impaired, potential end-users with LIS (<xref ref-type="bibr" rid="ref59">Severens et al., 2014</xref>), in one example even during a long-term study at the patient&#x2019;s own home (<xref ref-type="bibr" rid="ref21">Eidel et al., 2021</xref>). Although the performances of tactile P300 BCIs are usually lower than those of visual paradigms (see <xref ref-type="bibr" rid="ref19">Eidel and K&#x00FC;bler, 2020</xref> for an overview), we have repeatedly found that training led to significant performance increases among healthy participants (<xref ref-type="bibr" rid="ref26">Herweg et al., 2016</xref>; <xref ref-type="bibr" rid="ref19">Eidel and K&#x00FC;bler, 2020</xref>; <xref ref-type="bibr" rid="ref71">Ziebell et al., 2020</xref>). Latest evidence further suggested that somatosensory sensitivity correlated with accuracy and with performance increases across multiple sessions (<xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>).</p>
<p>To summarize, many crucial preconditions for successful use of a BCI as an assistive tool for patients have been met, but the translational gap remains. It appears that the frequent requests (e.g., <xref ref-type="bibr" rid="ref70">Zickler et al., 2011</xref>) for a simpler, less cumbersome and less visible alternative to the EEG cap might be fulfilled with the cEEGrid, such that BCIs may be more readily implemented and accepted by potential end-users.</p>
<p>With this study, we aimed to explore whether the cEEGrid constitutes a potential option for the home use of a tactile BCI. First, however, we need to further validate the cEEGrid as a device for potential tactile P300 BCI control. Thus, we focused on assessing its feasibility in an application focused, tactile BCI scenario built around established BCI software, and compared it directly to an established cap EEG.</p>
<p>This approach was guided by several hypotheses: Based on numerous observations from other modalities, we expected that the tactile P300 can be recorded with the cEEGrid and that ERP amplitudes correlate between cEEGrid and scalp EEG (H1).</p>
<p>Secondly, we hypothesized that cEEGrid classification accuracy in a typical BCI setting would be significantly above chance level (H2a) or even above the 70% criterion for useful BCI control (<xref ref-type="bibr" rid="ref39">K&#x00FC;bler et al., 2001</xref>) (H2b). We further expected that classification accuracy would not be significantly lower as compared to an EEG cap (H3) (<xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>).</p>
<p>Additionally, we sought to confirm previous observations of a correlation between somatosensory sensitivity and classification accuracy (H4).</p>
</sec>
<sec sec-type="methods" id="sec2">
<label>2</label>
<title>Methods</title>
<sec id="sec3">
<label>2.1</label>
<title>Participants</title>
<p>Forty healthy participants (P) were invited and completed one BCI session. However, two had to be excluded from analysis due to bad recording quality at key cEEGrid positions. Another participant was excluded because he reported that he did not fully concentrate on the tactile stimuli.</p>
<p>The final sample, thus, comprised <italic>n</italic>&#x2009;=&#x2009;37 participants (27 female, 10 male). The age of the participants ranged between 21 and 59&#x2009;years (<italic>M</italic>&#x2009;=&#x2009;24.6, SD&#x2009;=&#x2009;6.2). From three of the participants (P13, P16, and P32), a single run each was excluded from cEEGrid analysis due to technical issues during the recording. All participants except P1 had no prior experience with a tactile BCI. Participants gave written informed consent to the procedure and received either a monetary compensation of &#x20AC; 10/h or course credits. The study was approved by the ethical review board of the Institute of Psychology at the University of W&#x00FC;rzburg, Germany (GZEK 2013-11) and conducted in accordance with the ethical guidelines of the Declaration of Helsinki.</p>
</sec>
<sec id="sec4">
<label>2.2</label>
<title>General session procedure</title>
<p>Participants were seated in front of a monitor and set up with tactile stimulation devices. Firstly, they performed a brief somatosensory intensity discrimination task. After EEG preparation, participants were given an abbreviated demonstration run of the paradigm. This was done to give participants an opportunity to get used to the unfamiliar tactile stimulation and confirm that they understood the procedure, so that they could fully concentrate on the task during the first actual run.</p>
<p>Participants then performed six tactile P300 runs with short breaks in between. During a run, all tactor positions were activated multiple times in a random sequence. Participants were instructed to concentrate only on the current target position indicated on the monitor (e.g., by silently counting the target vibrations) and to ignore all other stimuli. They were advised to avoid unnecessary blinking and other muscular activity. During a run, the target position (either front, back, left or right) was pseudo-randomly switched after ten vibrations of each tactor. Each body position was the target twice per run, without immediate repetitions of the same position. Participants received no online feedback of results. After six runs, this process resulted in a total of 480 target and 1,440 non-target trials.</p>
</sec>
<sec id="sec5">
<label>2.3</label>
<title>Stimulation</title>
<p>Vibrotactile stimulation was applied with tactor devices (C2 tactors; Engineering Acoustic Inc., Casselberry, United States) which translated the stimulation provided by BCI2000 into short vibrations of 220&#x2009;ms (vibration frequency: 250&#x2009;Hz, inter-stimulus interval: 400&#x2009;ms). Tactors were positioned at right and left thighs, abdomen and upper back of the participants, as in previous studies based on this paradigm (e.g., <xref ref-type="bibr" rid="ref29">Kaufmann et al., 2014</xref>; <xref ref-type="bibr" rid="ref19">Eidel and K&#x00FC;bler, 2020</xref>), since it was assumed that this setup facilitated stimulus discrimination due to the relatively large distances between these body positions (<xref ref-type="bibr" rid="ref7">Brouwer and van Erp, 2010</xref>). <xref ref-type="fig" rid="fig1">Figure 1</xref> shows a single C2 tactor and an overview of all tactor positions on the body. To minimize possible confounding effects, the tactors were adjusted until participants reported no perceivable intensity differences between the four tactor positions.</p>
</sec>
<sec id="sec6">
<label>2.4</label>
<title>Intensity discrimination</title>
<p>To test whether the participants&#x2019; individual tactile sensitivity had a predictive function on BCI performance, we implemented a simple intensity discrimination task at the beginning of the session, as described in <xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler (2022)</xref> (similar approaches were used in <xref ref-type="bibr" rid="ref48">Nagarajan et al., 1998</xref>; <xref ref-type="bibr" rid="ref43">Mahns et al., 2006</xref>).</p>
<p>Briefly, participants received an array of various two-stimulus trials and had to report whether they perceived an intensity difference between the two stimuli. A first reference stimulus was set to 100% intensity, whereas the second could be decreased in 5% steps. Stimuli pairs were separated by a pause of 500&#x2009;ms. Pre-recorded tactor noises were presented over speakers, such that the participants could not hear the actual sounds from the tactor device.</p>
<p>The intensity of a trial was set pseudo-randomly. Typically, very similar or extremely different second stimuli were reliably reported as such. In between, however, there were intensity ranges in participants&#x2019; responses were inconsistent after several repetitions of the same trial. Those intensities were tested more frequently. Hence, several responses across all stimulus intensities were processed to determine a threshold value at which a participant could not tell whether the second stimulus intensity was equal or lower as compared to the reference.</p>
<p>To calculate a sensitivity metric, each participant&#x2019;s response ratio for each stimulus intensity was projected onto a scale from 0 (always reported as unequal) to 1 (always reported as equal). A sigmoidal function was automatically fit to these data (see <xref ref-type="fig" rid="fig2">Figure 2</xref>), and the intensity value at the response ratio of 0.5 was extracted.</p>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption>
<p>Example of a response curve from the tactile discrimination task (data from P3). A sigmoidal fit was used to estimate the point at which the second stimulus was reported as equal in 50% of trials. The respective stimulus intensity (here at 78%) was extracted as the participant&#x2019;s threshold for analysis.</p>
</caption>
<graphic xlink:href="fnhum-18-1371631-g002.tif"/>
</fig>
<p>The sensitivity threshold was thus defined as the intensity value (of the second stimulus) that was perceived as equal in 50% of trials. The thresholds were subjected to a Pearson correlation test with the participants&#x2019; offline accuracies.</p>
</sec>
<sec id="sec7">
<label>2.5</label>
<title>EEG recording and preprocessing</title>
<p>Scalp EEG was recorded from twelve passive Ag/AgCl electrodes at positions Fz, FC1, FC2, C3, Cz, C4, P3, Pz, P4, O1, Oz, and O2, with ground and reference electrodes placed at the left and right earlobes. For the cEEGrid system, the area around both ears was cleaned thoroughly with alcohol swabs and abrasive gel. A small drop of electrolyte gel was added onto the electrode surfaces before both cEEGrids were attached. The cEEGrids are semi-disposable. If one was being reused, double sided stickers were placed around the electrodes for better adhesion. Both cEEGrids were connected to an amplifier with an adapter cable.</p>
<p>Impedances at the scalp electrodes were kept below 5 k&#x03A9; and below 30 k&#x03A9; at the cEEGrid (<xref ref-type="bibr" rid="ref14">Debener et al., 2015</xref>). If cEEGrid impedances were too high, a syringe with a blunt metal tip was used to add more gel without removing the cEEGrid if possible (as a result, 32 participants had values below 15 k&#x03A9; at all positions).</p>
<p>The signal from both EEG systems was digitized with two separate BrainAmp amplifiers (Brain Products, Gilching, Germany) and received by the BrainVision Recorder software. These data were relayed to BCI2000 (<xref ref-type="bibr" rid="ref56">Schalk et al., 2004</xref>) via the remote data access protocol and stored using a resolution of 250&#x2009;Hz and a 48&#x2013;52&#x2009;Hz notch filter. BCI2000 handled the paradigm control (i.e., randomization and presentation of stimuli) and the recording of EEG data and markers. Since BCI2000 has no native support for tactor control, a Python 2.7 UDP script was used to address the tactor&#x2019;s API (provided by the manufacturer).</p>
<p>No online classification was performed, as two different EEG systems were involved in the recording. Providing feedback from a combination of EEG data, but also from just one of the EEG systems might have confounded our observations. Instead, we focused on offline analysis for both systems separately, without extensive pre-processing of the data, as an indicator of potential online performance.</p>
<p>For analysis of the ERP physiology, EEG data were bandpass filtered (0.1 to 30&#x2009;Hz). For the following analysis, vertical bipolar channels were calculated for the cEEGrid. Bipolar combinations of ear channels have been analyzed thoroughly (<xref ref-type="bibr" rid="ref14">Debener et al., 2015</xref>; <xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>; <xref ref-type="bibr" rid="ref46">Meiser and Bleichner, 2022</xref>), and certain combinations are known to approximate positions on the scalp (<xref ref-type="bibr" rid="ref13">da Silva Souto et al., 2021</xref>).</p>
<p>Data from both EEG systems were then split into epochs of 800&#x2009;ms post-stimulus, plus an additional 100&#x2009;ms pre-stimulus period for baseline correction. Epochs were rejected as artefacts if they contained any value above or below 75&#x2009;&#x03BC;V. Valid epochs were averaged separately into target and non-target groups for visual analysis and extraction of physiological features. All offline processing was performed with MATLAB<sup>&#x00A9;</sup> (R2015b).</p>
</sec>
<sec id="sec8">
<label>2.6</label>
<title>EEG analysis</title>
<p>Both EEG systems were evaluated and compared based on two metrics: Target classification accuracy (offline), and ERP amplitude (visual and quantitative analysis).</p>
<p>For quantitative analysis of the ERP, the <italic>mean target amplitudes,</italic> calculated from a specific time window, were extracted from each participant&#x2019;s target epoch average. For the scalp EEG, analysis was focused on a time window of 350&#x2013;650&#x2009;ms (post-stimulus) at positions Fz, Cz and Pz.</p>
<p>ERP analysis for the cEEGrid was focused on the vertical bipolar channels R1&#x2013;R8, R2&#x2013;R7, R3&#x2013;R6, R4&#x2013;R5 and their left counterparts (<xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>), which are known to extrapolate toward the classical central scalp positions (highest P300 amplitudes in our data were recorded at Cz) (<xref ref-type="bibr" rid="ref13">da Silva Souto et al., 2021</xref>).</p>
<p>Initial analysis revealed that the ERPs at positions behind the ear had a slightly higher latency. The time window for amplitude extraction was thus shifted to 400&#x2013;700&#x2009;ms post-stimulus.</p>
<p>Offline accuracy was calculated for the two EEG systems separately with a leave-one-out cross-validation approach to prevent overfitting. Classification with either EEG system was based on all available electrodes (cap: 12, cEEGrid: 18) plus the eight bipolar channels in case of the cEEGrid. It was performed with the stepwise linear discriminant analysis classifier included in BCI2000.</p>
<p>Accuracies from the two EEG systems were subjected to a two-tailed paired <italic>t</italic>-test. To detect differences in the EEG physiology, a repeated measures ANOVA of the mean amplitudes was calculated on the EEG channels of interest. If the assumption of sphericity was violated, Greenhouse&#x2013;Geisser adjusted results are reported. Finally, we ran a Pearson correlation test between the two channels with the highest ERP mean amplitude of either EEG system (<xref ref-type="bibr" rid="ref50">Pacharra et al., 2017</xref>).</p>
</sec>
</sec>
<sec sec-type="results" id="sec9">
<label>3</label>
<title>Results</title>
<sec id="sec10">
<label>3.1</label>
<title>ERP comparison</title>
<p>Cap EEG data from P15 was excluded from analysis due to an abundance of electromagnetic stimulation artefacts originating from the tactors. Initial assessment indicated that for the cEEGrid, the recorded ERP was indeed highest at the vertical bipolar channels, in particular at those with the highest inter-electrode distance. Thus, the following analysis focused on L2&#x2013;L7, L3&#x2013;L6, R2&#x2013;R7, and R3&#x2013;R6. <xref ref-type="fig" rid="fig3">Figure 3</xref> shows the grand averages of post-stimulus epochs from these channels in comparison to Fz, Cz and Pz. Visual analysis revealed a distinctive positive deflection in the P300 range. In the cEEGrid, the ERP peak appeared slightly later (<italic>M</italic>&#x2009;=&#x2009;501&#x2009;ms post-stimulus) than at the central midline positions (<italic>M</italic>&#x2009;=&#x2009;463&#x2009;ms).</p>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption>
<p>Post-stimulus epochs averaged across all participants. All plots are displayed with the same scale. Shaded areas indicate standard error between participants. ERPs on the bipolar cEEGrid channels were clearly visible, but smaller than at Fz, Cz, and Pz.</p>
</caption>
<graphic xlink:href="fnhum-18-1371631-g003.tif"/>
</fig>
<p><xref ref-type="table" rid="tab1">Table 1</xref> shows the mean amplitudes extracted from the channels of interest. Mean amplitudes recorded from the EEG cap reached up to <italic>M</italic> =&#x2009;3.53&#x2009;&#x03BC;V (SD =&#x2009;2.92) at Cz, and from the cEEGrid up to 1.87&#x2009;&#x03BC;V (SD =&#x2009;2.72) at R2&#x2013;R7. Mean amplitudes at the cEEGrid channels were generally lower than at the central midline electrodes.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Mean amplitudes obtained from the two EEG systems.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">System</th>
<th align="center" valign="top">Position</th>
<th align="center" valign="top">Mean amplitude [&#x03BC;V] (SD)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle" rowspan="3">EEG Cap</td>
<td align="center" valign="middle">Fz</td>
<td align="center" valign="middle">2.70 (3.61)</td>
</tr>
<tr>
<td align="center" valign="middle"><bold>Cz</bold></td>
<td align="center" valign="middle"><bold>3.53</bold> (2.92)</td>
</tr>
<tr>
<td align="center" valign="middle">Pz</td>
<td align="center" valign="middle">2.68 (2.36)</td>
</tr>
<tr>
<td align="left" valign="middle" rowspan="4">cEEGrid</td>
<td align="center" valign="middle"><bold>R2&#x2013;R7</bold></td>
<td align="center" valign="middle"><bold>1.87</bold> (2.72)</td>
</tr>
<tr>
<td align="center" valign="middle">R3&#x2013;R6</td>
<td align="center" valign="middle">1.69 (2.49)</td>
</tr>
<tr>
<td align="center" valign="middle">L2&#x2013;L7</td>
<td align="center" valign="middle">1.58 (2.11)</td>
</tr>
<tr>
<td align="center" valign="middle">L3&#x2013;L6</td>
<td align="center" valign="middle">1.63 (2.06)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Bold values indicate the highest value per electrode system.</p>
</table-wrap-foot>
</table-wrap>
<p>A repeated measures ANOVA revealed a significant effect of electrode position on ERP amplitude (<italic>F</italic><sub>(2.96, 103.6)</sub>&#x2009;=&#x2009;13.20, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001, <italic>&#x03B7;<sub>p</sub><sup>2</sup></italic>&#x2009;=&#x2009;0.274). Bonferroni-corrected post-hoc comparisons indicated a significant difference between Cz and all four bipolar channels of the cEEGrid. For both Fz and Pz, we found a significant amplitude difference to L2&#x2013;L7, L3&#x2013;L6, and R3&#x2013;R6. Amplitudes at R2&#x2013;R7, the cEEGrid channel with the highest mean values, were not significantly different to Fz and Pz (<italic>p</italic>&#x2009;&#x003E;&#x2009;0.05).</p>
<p>Comparison of channels within the same electrode system (e.g., Fz vs. Cz vs. Pz), revealed no significant difference between scalp electrodes or any combination of the bipolar cEEGrid positions (<italic>p</italic>&#x2009;&#x003E;&#x2009;0.05).</p>
<p><xref ref-type="fig" rid="fig4">Figure 4</xref> shows all ERP averages from channel R2&#x2013;R7 per participant. This visualization reveals high heterogeneity in the individual responses to the tactile stimuli: Some participants appeared to have no clear deflection in the P300 range (e.g., P10), others showed a particularly high peak (e.g., P9). In two cases (P23 and P37), a deflection with a negative polarity was found. For comparison, <xref ref-type="fig" rid="fig5">Figure 5</xref> provides the same overview for position Cz, where similar observations were made (note that different scaling was used in <xref ref-type="fig" rid="fig3">Figures 3</xref>&#x2013;<xref ref-type="fig" rid="fig5">5</xref> for better visibility). Finally, Pearson correlation between the mean amplitudes of Cz and R2&#x2013;R7 was significant (<italic>r<sub>p</sub></italic>&#x2009;=&#x2009;0.753, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001).</p>
<fig position="float" id="fig4">
<label>Figure 4</label>
<caption>
<p>Average post-stimulus epochs from R2&#x2013;R7 for each participant. ERP polarity was inversed for P23 and P37.</p>
</caption>
<graphic xlink:href="fnhum-18-1371631-g004.tif"/>
</fig>
<fig position="float" id="fig5">
<label>Figure 5</label>
<caption>
<p>Average post-stimulus epochs for each participant at Cz. As in the cEEGrid data, ERP polarity of P37 was inversed.</p>
</caption>
<graphic xlink:href="fnhum-18-1371631-g005.tif"/>
</fig>
</sec>
<sec id="sec11">
<label>3.2</label>
<title>Target classification</title>
<p>The cross-validated offline accuracies were very heterogeneous. Individual averages ranged from 6 to 98% for the cEEGrid and from 42 to 100% for the scalp EEG (see <xref ref-type="table" rid="tab2">Table 2</xref> for an overview). Thus, all scalp EEG accuracies were above the threshold of approximately 37% (<xref ref-type="bibr" rid="ref4">Billinger et al., 2013</xref>; <xref ref-type="bibr" rid="ref11">Combrisson and Jerbi, 2015</xref>) to be considered to be significantly (&#x03B1;&#x2009;=&#x2009;0.05) above the chance level of 25%. This threshold was also reached with the cEEGrid system for all but three participants (P10, P34, and P35). The usability criterion of at least 70% (<xref ref-type="bibr" rid="ref39">K&#x00FC;bler et al., 2001</xref>) was met by 27 participants with the scalp EEG and 14 participants with the cEEGrid.</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Overview of offline accuracies (% correct responses) and sensitivity thresholds (percent intensity) per participant.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Participant</th>
<th align="center" valign="top">EEG Cap [%]</th>
<th align="center" valign="top">cEEGrid [%]</th>
<th align="center" valign="top">Sensitivity [%]</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">1</td>
<td align="center" valign="middle">77</td>
<td align="center" valign="middle">83</td>
<td align="center" valign="top">83.4</td>
</tr>
<tr>
<td align="left" valign="middle">2</td>
<td align="center" valign="middle">92</td>
<td align="center" valign="middle">75</td>
<td align="center" valign="top">82.6</td>
</tr>
<tr>
<td align="left" valign="middle">3</td>
<td align="center" valign="middle">91</td>
<td align="center" valign="middle">79</td>
<td align="center" valign="top">78.2</td>
</tr>
<tr>
<td align="left" valign="middle">4</td>
<td align="center" valign="middle">83</td>
<td align="center" valign="middle">65&#x002A;</td>
<td align="center" valign="top">69.6</td>
</tr>
<tr>
<td align="left" valign="middle">5</td>
<td align="center" valign="middle">96</td>
<td align="center" valign="middle">90</td>
<td align="center" valign="top">71.8</td>
</tr>
<tr>
<td align="left" valign="middle">6</td>
<td align="center" valign="middle">83</td>
<td align="center" valign="middle">65&#x002A;</td>
<td align="center" valign="top">76.2</td>
</tr>
<tr>
<td align="left" valign="middle">7</td>
<td align="center" valign="middle">73</td>
<td align="center" valign="middle">50&#x002A;</td>
<td align="center" valign="top">65.0</td>
</tr>
<tr>
<td align="left" valign="middle">8</td>
<td align="center" valign="middle">65&#x002A;</td>
<td align="center" valign="middle">48&#x002A;</td>
<td align="center" valign="top">73.5</td>
</tr>
<tr>
<td align="left" valign="middle">9</td>
<td align="center" valign="middle">100</td>
<td align="center" valign="middle">98</td>
<td align="center" valign="top">76.2</td>
</tr>
<tr>
<td align="left" valign="middle">10</td>
<td align="center" valign="middle">77</td>
<td align="center" valign="middle">29<sup>+</sup></td>
<td align="center" valign="top">77.3</td>
</tr>
<tr>
<td align="left" valign="middle">12</td>
<td align="center" valign="middle">100</td>
<td align="center" valign="middle">69&#x002A;</td>
<td align="center" valign="top">92.0</td>
</tr>
<tr>
<td align="left" valign="middle">13</td>
<td align="center" valign="middle">96</td>
<td align="center" valign="middle">85</td>
<td align="center" valign="top">59.3</td>
</tr>
<tr>
<td align="left" valign="middle">14</td>
<td align="center" valign="middle">65&#x002A;</td>
<td align="center" valign="middle">65&#x002A;</td>
<td align="center" valign="top">73.9</td>
</tr>
<tr>
<td align="left" valign="middle">15</td>
<td align="center" valign="middle">&#x2013;</td>
<td align="center" valign="middle">44&#x002A;</td>
<td align="center" valign="top">92.5</td>
</tr>
<tr>
<td align="left" valign="middle">16</td>
<td align="center" valign="middle">67&#x002A;</td>
<td align="center" valign="middle">67&#x002A;</td>
<td align="center" valign="top">77.7</td>
</tr>
<tr>
<td align="left" valign="middle">18</td>
<td align="center" valign="middle">92</td>
<td align="center" valign="middle">52&#x002A;</td>
<td align="center" valign="top">56.8</td>
</tr>
<tr>
<td align="left" valign="middle">19</td>
<td align="center" valign="middle">100</td>
<td align="center" valign="middle">90</td>
<td align="center" valign="top">85.5</td>
</tr>
<tr>
<td align="left" valign="middle">20</td>
<td align="center" valign="middle">79</td>
<td align="center" valign="middle">73</td>
<td align="center" valign="top">&#x2013;</td>
</tr>
<tr>
<td align="left" valign="middle">21</td>
<td align="center" valign="middle">56&#x002A;</td>
<td align="center" valign="middle">44&#x002A;</td>
<td align="center" valign="top">79.3</td>
</tr>
<tr>
<td align="left" valign="middle">22</td>
<td align="center" valign="middle">96</td>
<td align="center" valign="middle">40&#x002A;</td>
<td align="center" valign="top">78.4</td>
</tr>
<tr>
<td align="left" valign="middle">23</td>
<td align="center" valign="middle">50&#x002A;</td>
<td align="center" valign="middle">46&#x002A;</td>
<td align="center" valign="top">75.3</td>
</tr>
<tr>
<td align="left" valign="middle">24</td>
<td align="center" valign="middle">92</td>
<td align="center" valign="middle">85</td>
<td align="center" valign="top">65.8</td>
</tr>
<tr>
<td align="left" valign="middle">25</td>
<td align="center" valign="middle">42&#x002A;</td>
<td align="center" valign="middle">46&#x002A;</td>
<td align="center" valign="top">&#x2013;</td>
</tr>
<tr>
<td align="left" valign="middle">26</td>
<td align="center" valign="middle">71</td>
<td align="center" valign="middle">42&#x002A;</td>
<td align="center" valign="top">80.9</td>
</tr>
<tr>
<td align="left" valign="middle">27</td>
<td align="center" valign="middle">79</td>
<td align="center" valign="middle">85</td>
<td align="center" valign="top">88.8</td>
</tr>
<tr>
<td align="left" valign="middle">28</td>
<td align="center" valign="middle">79</td>
<td align="center" valign="middle">67&#x002A;</td>
<td align="center" valign="top">74.5</td>
</tr>
<tr>
<td align="left" valign="middle">29</td>
<td align="center" valign="middle">94</td>
<td align="center" valign="middle">56&#x002A;</td>
<td align="center" valign="top">65.2</td>
</tr>
<tr>
<td align="left" valign="middle">30</td>
<td align="center" valign="middle">90</td>
<td align="center" valign="middle">69&#x002A;</td>
<td align="center" valign="top">76.8</td>
</tr>
<tr>
<td align="left" valign="middle">31</td>
<td align="center" valign="middle">100</td>
<td align="center" valign="middle">96</td>
<td align="center" valign="top">89.4</td>
</tr>
<tr>
<td align="left" valign="middle">32</td>
<td align="center" valign="middle">95</td>
<td align="center" valign="middle">75</td>
<td align="center" valign="top">76.9</td>
</tr>
<tr>
<td align="left" valign="middle">33</td>
<td align="center" valign="middle">96</td>
<td align="center" valign="middle">56&#x002A;</td>
<td align="center" valign="top">74.8</td>
</tr>
<tr>
<td align="left" valign="middle">34</td>
<td align="center" valign="middle">50&#x002A;</td>
<td align="center" valign="middle">6<sup>+</sup></td>
<td align="center" valign="top">74.8</td>
</tr>
<tr>
<td align="left" valign="middle">35</td>
<td align="center" valign="middle">75</td>
<td align="center" valign="middle">23<sup>+</sup></td>
<td align="center" valign="top">61.3</td>
</tr>
<tr>
<td align="left" valign="middle">37</td>
<td align="center" valign="middle">54&#x002A;</td>
<td align="center" valign="middle">38&#x002A;</td>
<td align="center" valign="top">73.9</td>
</tr>
<tr>
<td align="left" valign="middle">38</td>
<td align="center" valign="middle">96</td>
<td align="center" valign="middle">71</td>
<td align="center" valign="top">69.6</td>
</tr>
<tr>
<td align="left" valign="middle">39</td>
<td align="center" valign="middle">69&#x002A;</td>
<td align="center" valign="middle">56&#x002A;</td>
<td align="center" valign="top">73.3</td>
</tr>
<tr>
<td align="left" valign="middle">40</td>
<td align="center" valign="middle">94</td>
<td align="center" valign="middle">81</td>
<td align="center" valign="top">58.4</td>
</tr>
<tr>
<td align="left" valign="middle">M</td>
<td align="center" valign="middle">81 (SD&#x2009;=&#x2009;17)</td>
<td align="center" valign="middle">63&#x002A; (SD&#x2009;=&#x2009;21)</td>
<td align="center" valign="top">74.6 (SD&#x2009;=&#x2009;9.0)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Scalp EEG data from P15 was contaminated by several artefacts and thus not analyzed. <sup>+</sup>Not significantly above chance level; <sup>&#x002A;</sup> below usability criterion (<xref ref-type="bibr" rid="ref39">K&#x00FC;bler et al., 2001</xref>).</p>
</table-wrap-foot>
</table-wrap>
<p>With a mean of 63% (SD =&#x2009;21), cEEGrid accuracies were significantly lower than accuracies calculated from the scalp electrodes (<italic>M</italic> =&#x2009;81%, SD =&#x2009;17) (paired <italic>t</italic>-test, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001). Nonetheless, Pearson correlation between accuracies of both EEG systems was high and significant (<italic>r<sub>p</sub></italic>&#x2009;=&#x2009;0.647, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001).</p>
</sec>
<sec id="sec12">
<label>3.3</label>
<title>Intensity discrimination</title>
<p>Somatosensory sensitivity thresholds were extracted based on the data from the intensity discrimination task. <xref ref-type="table" rid="tab2">Table 2</xref> provides an overview of the determined sensitivity thresholds per participant. As in our last study (<xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>), some participants quickly revealed a distinct threshold, whereas the responses of other participants were less consistent, necessitating more trials (on average, 37&#x2009;&#x00B1;&#x2009;8.7 trials were applied). The equal/unequal responses from P20 were still too inconsistent to calculate a threshold, despite performing 53 trials, and were excluded from the analysis. P25 was excluded since no sounds could be played to mask the tactor buzzing due to technical problems with the speakers.</p>
<p>On average, the sensitivity threshold was determined at a second-stimulus intensity of <italic>M</italic> =&#x2009;74.6% (at this intensity, participants correctly detected the difference of the stimuli in 50% of trials). Guided by hypothesis H4, we calculated a Pearson correlation between the discrimination thresholds and offline accuracies obtained from both the scalp EEG and the cEEGrid. However, no significant correlation could be revealed in either case (both <italic>p</italic>&#x2009;&#x003E;&#x2009;0.1). We ran an exploratory analysis for potential correlations of the discrimination thresholds with the mean ERP amplitudes from both systems but found no significant effects.</p>
</sec>
</sec>
<sec sec-type="discussion" id="sec13">
<label>4</label>
<title>Discussion</title>
<sec id="sec14">
<label>4.1</label>
<title>ERP elicitation (H1)</title>
<p>Analysis of the EEG physiology from scalp positions verified that a tactile P300 was successfully elicited with this paradigm. In the time window of interest, average amplitudes were highest at Cz (<italic>M</italic>&#x2009;=&#x2009;3.53&#x2009;&#x03BC;V), slightly exceeding the respective values from our previous studies (2.73&#x2009;&#x03BC;V, <xref ref-type="bibr" rid="ref19">Eidel and K&#x00FC;bler, 2020</xref>; 2.95&#x2009;&#x03BC;V, <xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>).</p>
<p>There was a notable inter-subject variability of P300 amplitudes, which might be due to a variety of factors, including motivation (<xref ref-type="bibr" rid="ref33">Kleih et al., 2010</xref>) and age (<xref ref-type="bibr" rid="ref65">van Dinteren et al., 2018</xref>), as well as somatosensory sensitivity and target discrimination difficulty (<xref ref-type="bibr" rid="ref12">Comerchero and Polich, 1999</xref>; <xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>).</p>
<p>As expected, the highest amplitudes in the cEEGrid system were found at the vertical bipolar channels (up to 1.87&#x2009;&#x03BC;V at R2&#x2013;R7) (<xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>; <xref ref-type="bibr" rid="ref13">da Silva Souto et al., 2021</xref>). At these channels we found a smaller deflection (as compared to the scalp), which we interpreted as the P300. The significant and relatively high correlation (<italic>r<sub>p</sub></italic>&#x2009;=&#x2009;0.753) of mean amplitudes between scalp EEG and cEEGrid supported this interpretation.</p>
<p>These two observations &#x2013; reduced cEEGrid amplitudes, but a notable correlation to scalp EEG data &#x2013; are well in line with previous ERP studies with the cEEGrid (e.g., <xref ref-type="bibr" rid="ref14">Debener et al., 2015</xref>; <xref ref-type="bibr" rid="ref50">Pacharra et al., 2017</xref>). Smaller ERP amplitudes at the cEEGrid were often observed in the literature, possibly due to the distance from the areas of their physiological origin, the small distance between the bipolar electrodes, or because the bipolar combination does not perfectly match the 10&#x2013;20 position of interest (<xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>; <xref ref-type="bibr" rid="ref23">Garrett et al., 2019</xref>). Moreover, the signal-to-noise ratio (SNR) of the P300 and other ERPs were generally lower at the cEEGrid in comparison to cap measurements (<xref ref-type="bibr" rid="ref50">Pacharra et al., 2017</xref>). A decrease at of the cEEGrid SNR was also reported for subcortical auditory potentials (<xref ref-type="bibr" rid="ref23">Garrett et al., 2019</xref>). However, some signal loss is to be expected when recording certain ERPs at ear positions, even with conventional electrodes (<xref ref-type="bibr" rid="ref46">Meiser and Bleichner, 2022</xref>). Overall, though the method of extrapolation using the bipolar combinations of ear channels has been shown to be useful, it appears that it cannot always compensate for the distance to the signal source.</p>
<p>The P300 at the cEEGrid might also have been affected by factors specific to the tactile paradigm. For instance, while the visual P300 amplitude is often largest over parietal regions (<xref ref-type="bibr" rid="ref53">Ravden and Polich, 1999</xref>; <xref ref-type="bibr" rid="ref31">Kaufmann et al., 2011</xref>), in the tactile modality highest amplitudes are often measured at central or even frontal electrode positions (<xref ref-type="bibr" rid="ref63">Thurlings et al., 2012</xref>; <xref ref-type="bibr" rid="ref64">van der Waal et al., 2012</xref>; <xref ref-type="bibr" rid="ref29">Kaufmann et al., 2014</xref>; <xref ref-type="bibr" rid="ref59">Severens et al., 2014</xref>; <xref ref-type="bibr" rid="ref26">Herweg et al., 2016</xref>; <xref ref-type="bibr" rid="ref19">Eidel and K&#x00FC;bler, 2020</xref>). These positions might be less accessible for the cEEGrid, which could further explain the reduced amplitudes behind the ear.</p>
<p>Overall, we found strong evidence to support hypothesis H1 and, thus, provide first evidence that the tactually evoked P300 can be recorded by the cEEGrid.</p>
</sec>
<sec id="sec15">
<label>4.2</label>
<title>BCI performance (H2&#x2013;H3)</title>
<p>Offline accuracies were calculated to provide an indicator of potential online performance of the cEEGrid in comparison to the conventional scalp EEG recording.</p>
<p>The average cEEGrid accuracy of 63% was significantly above the chance level, which confirmed our prediction H2a (while also lending further support for H1, predicting P300 elicitation). Unfortunately, the usability criterion of 70% was not reached on average, such that H2b was not confirmed on the group level. Still, 39% of participants met or exceeded this threshold and could potentially operate a tactile BCI with the cEEGrid.</p>
<p>Comparing both systems, we found that accuracies at the cEEGrid were significantly lower, mirroring our observations from the EEG physiology. Hypothesis H3 must, thus, be rejected. This was in contrast to other studies which reported no significant accuracy differences between cEEGrid and scalp EEG (e.g., <xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>). The distance of the cEEGrid from relevant generators of the tactually evoked P300 may account for this difference in accuracy.</p>
<p>In any case, the high correlation between the two systems suggests that both captured the same physiological process (<xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>).</p>
<p>A closer look at the performance calculated from scalp positions revealed that accuracies (<italic>M</italic>&#x2009;=&#x2009;81%) were well above both chance level and the 70%-criterion. This value was very close to the online performance of 79% (session one) reported in our previous study which used the same paradigm (<xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>). This also indicates successful replication, which is an important side effect in light of the replication crisis (<xref ref-type="bibr" rid="ref60">Shrout and Rodgers, 2018</xref>).</p>
<p>Interestingly, in the study by <xref ref-type="bibr" rid="ref5">Bleichner et al. (2016)</xref>, above-chance classification results were achieved by 85% (scalp EEG) and 80% (cEEGrid) of participants. With the present paradigm, although cEEGrid classification accuracy was significantly lower as compared to the scalp EEG, the above-chance rate was achieved by 92% of participants (100% for scalp EEG data). Although it is hard to compare these different paradigms, the relatively high above-chance rate seems encouraging, as it shows that a meaningful information transfer may be possible for most users.</p>
<p>Accuracy achieved with the tactile P300 BCI has been shown to improve with training (<xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>). We hypothesize that such improvement would also occur when using the cEEGrid, though this must be tested in further studies with healthy and physically impaired participants alike. Further improvement might also be possible by utilizing more advanced classification algorithms (<xref ref-type="bibr" rid="ref41">Lotte et al., 2018</xref>). Future studies should identify which algorithms perform best with the specific design of the cEEGrid.</p>
</sec>
<sec id="sec16">
<label>4.3</label>
<title>Somatosensory sensitivity (H4)</title>
<p>The average discrimination threshold was determined at 74.6%, which was almost identical to the value from our last study (74.9% in session one, <xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>). In contrast to the results of the prior study, however, we found no significant correlation between the somatosensory sensitivities and (offline) accuracies. Hypothesis H4 could, thus, not be supported.</p>
<p>The role of somatosensory sensitivity therefore remains inconclusive, since the previously observed correlation with accuracy could not be reproduced. Still, it may play an important role for training effects of the tactile paradigm (as shown in <xref ref-type="bibr" rid="ref20">Eidel and K&#x00FC;bler, 2022</xref>), but this could not be analyzed in the single-session design of the present study and awaits further investigation.</p>
</sec>
</sec>
<sec id="sec17">
<label>5</label>
<title>Significance and conclusion</title>
<p>Our study adds to the growing list of literature that compares ear-centered EEG with more conventional EEG setups (e.g., <xref ref-type="bibr" rid="ref47">Mikkelsen et al., 2015</xref>; <xref ref-type="bibr" rid="ref5">Bleichner et al., 2016</xref>; <xref ref-type="bibr" rid="ref50">Pacharra et al., 2017</xref>; <xref ref-type="bibr" rid="ref23">Garrett et al., 2019</xref>). The main goal of this study was to describe the cEEGrid system&#x2019;s capability to record the P300 when elicited with an existing tactile BCI paradigm. Hence, the study was designed for best comparability of the EEG systems in a potential online BCI scenario, but at this stage, not for speed or optimization of classification algorithms.</p>
<p>Overall, we found clear evidence that the P300 can be measured with the cEEGrid and that the obtained epochs could be feasibly classified with a widely used BCI machine learning algorithm. However, both ERP amplitudes and classification accuracies were significantly lower as compared to the simultaneously recorded scalp EEG. Since multiple studies demonstrated that the accuracy of the tactile paradigm can be significantly improved across several sessions, even a brief training program might alleviate this performance issue. If higher performances can be achieved, the small and flexible cEEGrid system would constitute a promising tool to increase home application among patients with severest motor impairment up to the locked-in or complete locked-in syndrome, who might accept it more readily than a conventional cap EEG system.</p>
</sec>
<sec sec-type="data-availability" id="sec18">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec sec-type="ethics-statement" id="sec19">
<title>Ethics statement</title>
<p>The study involving humans were approved by the Ethical Review Board of the Institute of Psychology at the University of W&#x00FC;rzburg, Germany. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.</p>
</sec>
<sec sec-type="author-contributions" id="sec20">
<title>Author contributions</title>
<p>ME: Conceptualization, Formal analysis, Investigation, Methodology, Software, Writing &#x2013; original draft, Writing &#x2013; review &#x0026; editing. MP: Conceptualization, Formal analysis, Investigation, Writing &#x2013; review &#x0026; editing. PZ: Conceptualization, Writing &#x2013; review &#x0026; editing. AK: Funding acquisition, Project administration, Writing &#x2013; review &#x0026; editing, Supervision.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="sec21">
<title>Funding</title>
<p>The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This project was funded by the Lotte Schopper-Stiftung c/o Rummelsberger Dienste f&#x00FC;r Menschen mit Behinderung gGmbH &#x2013; Schwarzenbruck, Landkreis N&#x00FC;rnberger Land, Mittelfranken, 762 Germany. This publication was supported by the Open Access Publication Fund of the University of Wuerzburg.</p>
</sec>
<sec sec-type="COI-statement" id="sec22">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="sec23">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Allison</surname> <given-names>B. Z.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name> <name><surname>Jin</surname> <given-names>J.</given-names></name></person-group> (<year>2020</year>). <article-title>30+ years of P300 brain&#x2013;computer interfaces</article-title>. <source>Psychophysiology</source> <volume>57</volume>:<fpage>e13569</fpage>. doi: <pub-id pub-id-type="doi">10.1111/psyp.13569</pub-id></citation></ref>
<ref id="ref2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bauer</surname> <given-names>G.</given-names></name> <name><surname>Gerstenbrand</surname> <given-names>F.</given-names></name> <name><surname>Rumpl</surname> <given-names>E.</given-names></name></person-group> (<year>1979</year>). <article-title>Varieties of the locked-in syndrome</article-title>. <source>J. Neurol.</source> <volume>221</volume>, <fpage>77</fpage>&#x2013;<lpage>91</lpage>. doi: <pub-id pub-id-type="doi">10.1007/BF00313105</pub-id></citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baykara</surname> <given-names>E.</given-names></name> <name><surname>Ruf</surname> <given-names>C. A.</given-names></name> <name><surname>Fioravanti</surname> <given-names>C.</given-names></name> <name><surname>K&#x00E4;thner</surname> <given-names>I.</given-names></name> <name><surname>Simon</surname> <given-names>N.</given-names></name> <name><surname>Kleih</surname> <given-names>S. C.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Effects of training and motivation on auditory P300 brain&#x2013;computer Interface performance</article-title>. <source>Clin. Neurophysiol.</source> <volume>127</volume>, <fpage>379</fpage>&#x2013;<lpage>387</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.clinph.2015.04.054</pub-id></citation></ref>
<ref id="ref4"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Billinger</surname> <given-names>M.</given-names></name> <name><surname>Daly</surname> <given-names>I.</given-names></name> <name><surname>Kaiser</surname> <given-names>V.</given-names></name> <name><surname>Jin</surname> <given-names>J.</given-names></name> <name><surname>Allison</surname> <given-names>B. Z.</given-names></name> <name><surname>M&#x00FC;ller-Putz</surname> <given-names>G. R.</given-names></name> <etal/></person-group>. (<year>2013</year>). &#x201C;<article-title>Is it significant? Guidelines for reporting BCI performance</article-title>&#x201D; in <source><italic>Towards practical brain-computer interfaces: Bridging the gap from research to real-world applications</italic>, <italic>biological and medical physics, biomedical engineering</italic></source>. eds. <person-group person-group-type="editor"><name><surname>Allison</surname> <given-names>B. Z.</given-names></name> <name><surname>Dunne</surname> <given-names>S.</given-names></name> <name><surname>Leeb</surname> <given-names>R.</given-names></name> <name><surname>Del</surname> <given-names>J.</given-names></name> <name><surname>Mill&#x00E1;n</surname> <given-names>R.</given-names></name> <name><surname>Nijholt</surname> <given-names>A.</given-names></name></person-group> (<publisher-loc>Berlin, Heidelberg</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>333</fpage>&#x2013;<lpage>354</lpage>.</citation></ref>
<ref id="ref5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bleichner</surname> <given-names>M. G.</given-names></name> <name><surname>Mirkovic</surname> <given-names>B.</given-names></name> <name><surname>Debener</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Identifying auditory attention with ear-EEG: cEEGrid versus high-density cap-EEG comparison</article-title>. <source>J. Neural Eng.</source> <volume>13</volume>:<fpage>066004</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/13/6/066004</pub-id>, PMID: <pub-id pub-id-type="pmid">27705963</pub-id></citation></ref>
<ref id="ref6"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Botrel</surname> <given-names>L.</given-names></name> <name><surname>Holz</surname> <given-names>E. M.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). &#x201C;<article-title>Using brain painting at home for 5 years: stability of the P300 during prolonged BCI usage by two end-users with ALS</article-title>&#x201D; in <source>Augmented cognition. Enhancing cognition and behavior in complex human environments</source>. eds. <person-group person-group-type="editor"><name><surname>Schmorrow</surname> <given-names>D. D.</given-names></name> <name><surname>Fidopiastis</surname> <given-names>C. M.</given-names></name></person-group>, vol. <volume>10285</volume> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer International Publishing</publisher-name>), <fpage>282</fpage>&#x2013;<lpage>292</lpage>.</citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brouwer</surname> <given-names>A.-M.</given-names></name> <name><surname>van Erp</surname> <given-names>J. B. F.</given-names></name></person-group> (<year>2010</year>). <article-title>A tactile P300 brain-computer Interface</article-title>. <source>Front. Neurosci.</source> <volume>4</volume>:<fpage>19</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnins.2010.00019</pub-id></citation></ref>
<ref id="ref8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brunner</surname> <given-names>P.</given-names></name> <name><surname>Joshi</surname> <given-names>S.</given-names></name> <name><surname>Briskin</surname> <given-names>S.</given-names></name> <name><surname>Wolpaw</surname> <given-names>J. R.</given-names></name> <name><surname>Bischof</surname> <given-names>H.</given-names></name> <name><surname>Schalk</surname> <given-names>G.</given-names></name></person-group> (<year>2010</year>). <article-title>Does the &#x2018;P300&#x2019; speller depend on eye gaze?</article-title> <source>J. Neural Eng.</source> <volume>7</volume>:<fpage>056013</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/7/5/056013</pub-id></citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Choi</surname> <given-names>I.</given-names></name> <name><surname>Rhiu</surname> <given-names>I.</given-names></name> <name><surname>Lee</surname> <given-names>Y.</given-names></name> <name><surname>Yun</surname> <given-names>M. H.</given-names></name> <name><surname>Nam</surname> <given-names>C. S.</given-names></name></person-group> (<year>2017</year>). <article-title>A systematic review of hybrid brain-computer interfaces: taxonomy and usability perspectives</article-title>. <source>PLoS One</source> <volume>12</volume>:<fpage>e0176674</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0176674</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Combrisson</surname> <given-names>E.</given-names></name> <name><surname>Jerbi</surname> <given-names>K.</given-names></name></person-group> (<year>2015</year>). <article-title>Exceeding chance level by chance: the caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy</article-title>. <source>J. Neurosci. Methods</source> <volume>250</volume>, <fpage>126</fpage>&#x2013;<lpage>136</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jneumeth.2015.01.010</pub-id></citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Comerchero</surname> <given-names>M. D.</given-names></name> <name><surname>Polich</surname> <given-names>J.</given-names></name></person-group> (<year>1999</year>). <article-title>P3a and P3b from typical auditory and visual stimuli</article-title>. <source>Clin. Neurophysiol.</source> <volume>110</volume>, <fpage>24</fpage>&#x2013;<lpage>30</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0168-5597(98)00033-1</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>da Silva Souto</surname> <given-names>C. F.</given-names></name> <name><surname>P&#x00E4;tzold</surname> <given-names>W.</given-names></name> <name><surname>Wolf</surname> <given-names>K. I.</given-names></name> <name><surname>Paul</surname> <given-names>M.</given-names></name> <name><surname>Matthiesen</surname> <given-names>I.</given-names></name> <name><surname>Bleichner</surname> <given-names>M. G.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Flex-printed ear-EEG sensors for adequate sleep staging at home</article-title>. <source>Front. Digit. Health</source> <volume>3</volume>:<fpage>688122</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fdgth.2021.688122</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Debener</surname> <given-names>S.</given-names></name> <name><surname>Emkes</surname> <given-names>R.</given-names></name> <name><surname>De Vos</surname> <given-names>M.</given-names></name> <name><surname>Bleichner</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear</article-title>. <source>Sci. Rep.</source> <volume>5</volume>, <fpage>1</fpage>&#x2013;<lpage>11</lpage>. doi: <pub-id pub-id-type="doi">10.1038/srep16743</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Denk</surname> <given-names>F.</given-names></name> <name><surname>Grzybowski</surname> <given-names>M.</given-names></name> <name><surname>Ernst</surname> <given-names>S. M. A.</given-names></name> <name><surname>Kollmeier</surname> <given-names>B.</given-names></name> <name><surname>Debener</surname> <given-names>S.</given-names></name> <name><surname>Bleichner</surname> <given-names>M. G.</given-names></name></person-group> (<year>2018</year>). <article-title>Event-related potentials measured from in and around the ear electrodes integrated in a live hearing device for monitoring sound perception</article-title>. <source>Trends Hear.</source> <volume>22</volume>:<fpage>2331216518788219</fpage>. doi: <pub-id pub-id-type="doi">10.1177/2331216518788219</pub-id></citation></ref>
<ref id="ref16"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Do Valle</surname> <given-names>B. G.</given-names></name> <name><surname>Cash</surname> <given-names>S. S.</given-names></name> <name><surname>Sodini</surname> <given-names>C. G.</given-names></name></person-group> (<year>2014</year>). &#x201C;<article-title>Wireless behind-the-ear EEG recording device with wireless Interface to a Mobile device (iPhone/iPod touch)</article-title>&#x201D; in <source>In <italic>2014 36th annual international conference of the IEEE engineering in medicine and biology society</italic></source> (<publisher-name>Chicago, IL: IEEE</publisher-name>), <fpage>5952</fpage>&#x2013;<lpage>5955</lpage>.</citation></ref>
<ref id="ref17"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Donchin</surname> <given-names>E.</given-names></name> <name><surname>Ritter</surname> <given-names>W.</given-names></name> <name><surname>McCallum</surname> <given-names>W. C.</given-names></name></person-group> (<year>1978</year>). &#x201C;<article-title>Cognitive psychophysiology: the endogenous components of the ERP</article-title>&#x201D; in <source>Event-related brain potentials in man</source>, Eds. Callaway P, Tueting P, Koslow S. New York: Academic Press. vol. <volume>349</volume>, <fpage>411</fpage>.</citation></ref>
<ref id="ref19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eidel</surname> <given-names>M.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>Wheelchair control in a virtual environment by healthy participants using a P300-BCI based on tactile stimulation: training effects and usability</article-title>. <source>Front. Hum. Neurosci.</source> <volume>14</volume>:<fpage>265</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnhum.2020.00265</pub-id>, PMID: <pub-id pub-id-type="pmid">32754019</pub-id></citation></ref>
<ref id="ref20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eidel</surname> <given-names>M.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2022</year>). <article-title>Identifying potential training factors in a vibrotactile P300-BCI</article-title>. <source>Sci. Rep.</source> <volume>12</volume>:<fpage>14006</fpage>. doi: <pub-id pub-id-type="doi">10.1038/s41598-022-18088-w</pub-id></citation></ref>
<ref id="ref21"><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Eidel</surname> <given-names>M.</given-names></name> <name><surname>Tr&#x00F6;ger</surname> <given-names>W.</given-names></name> <name><surname>Winterholler</surname> <given-names>M.</given-names></name> <name><surname>Giesler</surname> <given-names>T.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group>. (<year>2021</year>). &#x201C;<article-title>A tactile brain-computer Interface for virtual wheelchair control at home</article-title>.&#x201D; Pp. <fpage>1</fpage>&#x2013;<lpage>3</lpage> in <conf-name>2021 9th International Winter Conference on Brain-Computer Interface (BCI)</conf-name>.</citation></ref>
<ref id="ref22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Furdea</surname> <given-names>A.</given-names></name> <name><surname>Sebastian Halder</surname> <given-names>D. J.</given-names></name> <name><surname>Krusienski</surname> <given-names>D. B.</given-names></name> <name><surname>Nijboer</surname> <given-names>F.</given-names></name> <name><surname>Birbaumer</surname> <given-names>N.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2009</year>). <article-title>An auditory oddball (P300) spelling system for brain-computer interfaces</article-title>. <source>Psychophysiology</source> <volume>46</volume>, <fpage>617</fpage>&#x2013;<lpage>625</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1469-8986.2008.00783.x</pub-id>, PMID: <pub-id pub-id-type="pmid">19170946</pub-id></citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garrett</surname> <given-names>M.</given-names></name> <name><surname>Debener</surname> <given-names>S.</given-names></name> <name><surname>Verhulst</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <article-title>Acquisition of Subcortical Auditory Potentials with Around-the-ear cEEGrid Technology in Normal and Hearing Impaired Listeners</article-title>. <source>Front. Neurosci.</source> <volume>13</volume>:<fpage>730</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnins.2019.00730</pub-id>, PMID: <pub-id pub-id-type="pmid">31379484</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Halder</surname> <given-names>S.</given-names></name> <name><surname>K&#x00E4;thner</surname> <given-names>I.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2016</year>). <article-title>Training leads to increased auditory brain&#x2013;computer Interface performance of end-users with motor impairments</article-title>. <source>Clin. Neurophysiol.</source> <volume>127</volume>, <fpage>1288</fpage>&#x2013;<lpage>1296</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.clinph.2015.08.007</pub-id></citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Han</surname> <given-names>Y.</given-names></name> <name><surname>Ziebell</surname> <given-names>P.</given-names></name> <name><surname>Riccio</surname> <given-names>A.</given-names></name> <name><surname>Halder</surname> <given-names>S.</given-names></name></person-group> (<year>2022</year>). <article-title>Two sides of the same coin: adaptation of BCIs to internal states with user-Centered design and electrophysiological features</article-title>. <source>Brain-Comput. Interfaces</source> <volume>9</volume>, <fpage>102</fpage>&#x2013;<lpage>114</lpage>. doi: <pub-id pub-id-type="doi">10.1080/2326263X.2022.2041294</pub-id></citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Herweg</surname> <given-names>A.</given-names></name> <name><surname>Gutzeit</surname> <given-names>J.</given-names></name> <name><surname>Kleih</surname> <given-names>S.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2016</year>). <article-title>Wheelchair control by elderly participants in a virtual environment with a brain-computer Interface (BCI) and tactile stimulation</article-title>. <source>Biol. Psychol.</source> <volume>121</volume>, <fpage>117</fpage>&#x2013;<lpage>124</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.biopsycho.2016.10.006</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hill</surname> <given-names>N. J.</given-names></name> <name><surname>Sch&#x00F6;lkopf</surname> <given-names>B.</given-names></name></person-group> (<year>2012</year>). <article-title>An online brain&#x2013;computer Interface based on shifting attention to concurrent streams of auditory stimuli</article-title>. <source>J. Neural Eng.</source> <volume>9</volume>:<fpage>026011</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/9/2/026011</pub-id>, PMID: <pub-id pub-id-type="pmid">22333135</pub-id></citation></ref>
<ref id="ref28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hoon Lee</surname> <given-names>J.</given-names></name> <name><surname>Min Lee</surname> <given-names>S.</given-names></name> <name><surname>Jin Byeon</surname> <given-names>H.</given-names></name> <name><surname>Sook Hong</surname> <given-names>J.</given-names></name> <name><surname>Suk Park</surname> <given-names>K.</given-names></name> <name><surname>Lee</surname> <given-names>S.-H.</given-names></name></person-group> (<year>2014</year>). <article-title>CNT/PDMS-Based Canal-typed ear electrodes for inconspicuous EEG recording</article-title>. <source>J. Neural Eng.</source> <volume>11</volume>:<fpage>046014</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/11/4/046014</pub-id></citation></ref>
<ref id="ref29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaufmann</surname> <given-names>T.</given-names></name> <name><surname>Herweg</surname> <given-names>A.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2014</year>). <article-title>Toward brain-computer Interface based wheelchair control utilizing tactually-evoked event-related potentials</article-title>. <source>J. Neuroeng. Rehabil.</source> <volume>11</volume>:<fpage>7</fpage>. doi: <pub-id pub-id-type="doi">10.1186/1743-0003-11-7</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaufmann</surname> <given-names>T.</given-names></name> <name><surname>Holz</surname> <given-names>E. M.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Comparison of tactile, auditory, and visual modality for brain-computer Interface use: a case study with a patient in the locked-in state</article-title>. <source>Front. Neurosci.</source> <volume>7</volume>:<fpage>129</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnins.2013.00129</pub-id></citation></ref>
<ref id="ref31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaufmann</surname> <given-names>T.</given-names></name> <name><surname>Schulz</surname> <given-names>S. M.</given-names></name> <name><surname>Gr&#x00FC;nzinger</surname> <given-names>C.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>Flashing characters with famous faces improves ERP-based brain&#x2013;computer Interface performance</article-title>. <source>J. Neural Eng.</source> <volume>8</volume>:<fpage>056016</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/8/5/056016</pub-id></citation></ref>
<ref id="ref32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kidmose</surname> <given-names>P.</given-names></name> <name><surname>Looney</surname> <given-names>D.</given-names></name> <name><surname>Ungstrup</surname> <given-names>M.</given-names></name> <name><surname>Rank</surname> <given-names>M. L.</given-names></name> <name><surname>Mandic</surname> <given-names>D. P.</given-names></name></person-group> (<year>2013</year>). <article-title>A study of evoked potentials from ear-EEG</article-title>. <source>IEEE Trans. Biomed. Eng.</source> <volume>60</volume>, <fpage>2824</fpage>&#x2013;<lpage>2830</lpage>. doi: <pub-id pub-id-type="doi">10.1109/TBME.2013.2264956</pub-id>, PMID: <pub-id pub-id-type="pmid">23722447</pub-id></citation></ref>
<ref id="ref33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kleih</surname> <given-names>S. C.</given-names></name> <name><surname>Nijboer</surname> <given-names>F.</given-names></name> <name><surname>Halder</surname> <given-names>S.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>Motivation modulates the P300 amplitude during brain&#x2013;computer Interface use</article-title>. <source>Clin. Neurophysiol.</source> <volume>121</volume>, <fpage>1023</fpage>&#x2013;<lpage>1031</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.clinph.2010.01.034</pub-id>, PMID: <pub-id pub-id-type="pmid">20188627</pub-id></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Brain-computer interfacing: science fiction has come true</article-title>. <source>Brain</source> <volume>136</volume>, <fpage>2001</fpage>&#x2013;<lpage>2004</lpage>. doi: <pub-id pub-id-type="doi">10.1093/brain/awt077</pub-id></citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name></person-group> (<year>2019</year>). <article-title>The history of BCI: from a vision for the future to real support for personhood in people with locked-in syndrome</article-title>. <source>Neuroethics</source> <volume>13</volume>, <fpage>163</fpage>&#x2013;<lpage>180</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s12152-019-09409-4</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name> <name><surname>Birbaumer</surname> <given-names>N.</given-names></name></person-group> (<year>2008</year>). <article-title>Brain&#x2013;computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients?</article-title> <source>Clin. Neurophysiol.</source> <volume>119</volume>, <fpage>2658</fpage>&#x2013;<lpage>2666</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.clinph.2008.06.019</pub-id></citation></ref>
<ref id="ref37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name> <name><surname>Holz</surname> <given-names>E. M.</given-names></name> <name><surname>Riccio</surname> <given-names>A.</given-names></name> <name><surname>Zickler</surname> <given-names>C.</given-names></name> <name><surname>Kaufmann</surname> <given-names>T.</given-names></name> <name><surname>Kleih</surname> <given-names>S. C.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>The user-Centered design as novel perspective for evaluating the usability of BCI-controlled applications</article-title>. <source>PLoS One</source> <volume>9</volume>:<fpage>e112392</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0112392</pub-id></citation></ref>
<ref id="ref38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name> <name><surname>M&#x00FC;ller-Putz</surname> <given-names>G.</given-names></name> <name><surname>Mattia</surname> <given-names>D.</given-names></name></person-group> (<year>2015</year>). <article-title>User-centred Design in Brain&#x2013;Computer Interface Research and Development</article-title>. <source>Ann. Phys. Rehabil. Med.</source> <volume>58</volume>, <fpage>312</fpage>&#x2013;<lpage>314</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.rehab.2015.06.003</pub-id></citation></ref>
<ref id="ref39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name> <name><surname>Neumann</surname> <given-names>N.</given-names></name> <name><surname>Kaiser</surname> <given-names>J.</given-names></name> <name><surname>Kotchoubey</surname> <given-names>B.</given-names></name> <name><surname>Hinterberger</surname> <given-names>T.</given-names></name> <name><surname>Birbaumer</surname> <given-names>N. P.</given-names></name></person-group> (<year>2001</year>). <article-title>Brain-computer communication: self-regulation of slow cortical potentials for verbal communication</article-title>. <source>Arch. Phys. Med. Rehabil.</source> <volume>82</volume>, <fpage>1533</fpage>&#x2013;<lpage>1539</lpage>. doi: <pub-id pub-id-type="doi">10.1053/apmr.2001.26621</pub-id></citation></ref>
<ref id="ref40"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Looney</surname> <given-names>D.</given-names></name> <name><surname>Park</surname> <given-names>C.</given-names></name> <name><surname>Kidmose</surname> <given-names>P.</given-names></name> <name><surname>Rank</surname> <given-names>M. L.</given-names></name> <name><surname>Ungstrup</surname> <given-names>M.</given-names></name> <name><surname>Rosenkranz</surname> <given-names>K.</given-names></name> <etal/></person-group>. (<year>2011</year>). &#x201C;<article-title>An in-the-ear platform for recording electroencephalogram</article-title>.&#x201D; Pp. <fpage>6882</fpage>&#x2013;85 in <conf-name>2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society</conf-name>. Qu&#x00E9;bec, Canada. doi: <pub-id pub-id-type="doi">10.1109/IEMBS.2011.609173</pub-id></citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lotte</surname> <given-names>F.</given-names></name> <name><surname>Bougrain</surname> <given-names>L.</given-names></name> <name><surname>Cichocki</surname> <given-names>A.</given-names></name> <name><surname>Clerc</surname> <given-names>M.</given-names></name> <name><surname>Congedo</surname> <given-names>M.</given-names></name> <name><surname>Rakotomamonjy</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>A review of classification algorithms for EEG-based brain&#x2013;computer interfaces: a 10 year update</article-title>. <source>J. Neural Eng.</source> <volume>15</volume>:<fpage>031005</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2552/aab2f2</pub-id></citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lynn</surname> <given-names>J. M. D.</given-names></name> <name><surname>Armstrong</surname> <given-names>E.</given-names></name> <name><surname>Martin</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>User centred design and validation during the development of domestic brain computer Interface applications for people with acquired brain injury and therapists: a multi-stakeholder approach</article-title>. <source>J. Assist. Technol.</source> <volume>10</volume>, <fpage>67</fpage>&#x2013;<lpage>78</lpage>. doi: <pub-id pub-id-type="doi">10.1108/JAT-01-2016-0002</pub-id></citation></ref>
<ref id="ref43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mahns</surname> <given-names>D. A.</given-names></name> <name><surname>Perkins</surname> <given-names>N. M.</given-names></name> <name><surname>Sahai</surname> <given-names>V.</given-names></name> <name><surname>Robinson</surname> <given-names>L.</given-names></name> <name><surname>Rowe</surname> <given-names>M. J.</given-names></name></person-group> (<year>2006</year>). <article-title>Vibrotactile frequency discrimination in human hairy skin</article-title>. <source>J. Neurophysiol.</source> <volume>95</volume>, <fpage>1442</fpage>&#x2013;<lpage>1450</lpage>. doi: <pub-id pub-id-type="doi">10.1152/jn.00483.2005</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McCane</surname> <given-names>L. M.</given-names></name> <name><surname>Sellers</surname> <given-names>E. W.</given-names></name> <name><surname>McFarland</surname> <given-names>D. J.</given-names></name> <name><surname>Mak</surname> <given-names>J. N.</given-names></name> <name><surname>Steve Carmack</surname> <given-names>C.</given-names></name> <name><surname>Zeitlin</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Brain-computer Interface (BCI) evaluation in people with amyotrophic lateral sclerosis</article-title>. <source>Amyotroph. Lateral Scler. Frontotemporal Degener.</source> <volume>15</volume>, <fpage>207</fpage>&#x2013;<lpage>215</lpage>. doi: <pub-id pub-id-type="doi">10.3109/21678421.2013.865750</pub-id>, PMID: <pub-id pub-id-type="pmid">24555843</pub-id></citation></ref>
<ref id="ref45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McFarland</surname> <given-names>D. J.</given-names></name></person-group> (<year>2020</year>). <article-title>Brain-computer interfaces for amyotrophic lateral sclerosis</article-title>. <source>Muscle Nerve</source> <volume>61</volume>, <fpage>702</fpage>&#x2013;<lpage>707</lpage>. doi: <pub-id pub-id-type="doi">10.1002/mus.26828</pub-id></citation></ref>
<ref id="ref46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meiser</surname> <given-names>A.</given-names></name> <name><surname>Bleichner</surname> <given-names>M. G.</given-names></name></person-group> (<year>2022</year>). <article-title>Ear-EEG compares well to cap-EEG in recording auditory ERPs: a quantification of signal loss</article-title>. <source>J. Neural Eng.</source> <volume>19</volume>:<fpage>026042</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2552/ac5fcb</pub-id></citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mikkelsen</surname> <given-names>K. B.</given-names></name> <name><surname>Kappel</surname> <given-names>S. L.</given-names></name> <name><surname>Mandic</surname> <given-names>D. P.</given-names></name> <name><surname>Kidmose</surname> <given-names>P.</given-names></name></person-group> (<year>2015</year>). <article-title>EEG recorded from the ear: characterizing the ear-EEG method</article-title>. <source>Front. Neurosci.</source> <volume>9</volume>:<fpage>438</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnins.2015.00438</pub-id></citation></ref>
<ref id="ref48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nagarajan</surname> <given-names>S. S.</given-names></name> <name><surname>Blake</surname> <given-names>D. T.</given-names></name> <name><surname>Wright</surname> <given-names>B. A.</given-names></name> <name><surname>Byl</surname> <given-names>N.</given-names></name> <name><surname>Merzenich</surname> <given-names>M. M.</given-names></name></person-group> (<year>1998</year>). <article-title>Practice-related improvements in somatosensory interval discrimination are temporally specific but generalize across skin location, hemisphere, and modality</article-title>. <source>J. Neurosci.</source> <volume>18</volume>, <fpage>1559</fpage>&#x2013;<lpage>1570</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.18-04-01559.1998</pub-id></citation></ref>
<ref id="ref49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nijboer</surname> <given-names>F.</given-names></name></person-group> (<year>2015</year>). <article-title>Technology transfer of brain-computer interfaces as assistive technology: barriers and opportunities</article-title>. <source>Ann. Phys. Rehabil. Med.</source> <volume>58</volume>, <fpage>35</fpage>&#x2013;<lpage>38</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.rehab.2014.11.001</pub-id></citation></ref>
<ref id="ref50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pacharra</surname> <given-names>M.</given-names></name> <name><surname>Debener</surname> <given-names>S.</given-names></name> <name><surname>Wascher</surname> <given-names>E.</given-names></name></person-group> (<year>2017</year>). <article-title>Concealed around-the-ear EEG captures cognitive processing in a visual Simon task</article-title>. <source>Front. Hum. Neurosci.</source> <volume>11</volume>:<fpage>290</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnhum.2017.00290</pub-id>, PMID: <pub-id pub-id-type="pmid">28642695</pub-id></citation></ref>
<ref id="ref51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Polich</surname> <given-names>J.</given-names></name></person-group> (<year>2007</year>). <article-title>Updating P300: an integrative theory of P3a and P3b</article-title>. <source>Clin. Neurophysiol.</source> <volume>118</volume>, <fpage>2128</fpage>&#x2013;<lpage>2148</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.clinph.2007.04.019</pub-id></citation></ref>
<ref id="ref52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Polich</surname> <given-names>J.</given-names></name> <name><surname>Margala</surname> <given-names>C.</given-names></name></person-group> (<year>1997</year>). <article-title>P300 and probability: comparison of oddball and single-stimulus paradigms</article-title>. <source>Int. J. Psychophysiol.</source> <volume>25</volume>, <fpage>169</fpage>&#x2013;<lpage>176</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0167-8760(96)00742-8</pub-id></citation></ref>
<ref id="ref53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ravden</surname> <given-names>D.</given-names></name> <name><surname>Polich</surname> <given-names>J.</given-names></name></person-group> (<year>1999</year>). <article-title>On P300 measurement stability: habituation, intra-trial block variation, and ultradian rhythms</article-title>. <source>Biol. Psychol.</source> <volume>51</volume>, <fpage>59</fpage>&#x2013;<lpage>76</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0301-0511(99)00015-0</pub-id>, PMID: <pub-id pub-id-type="pmid">10579421</pub-id></citation></ref>
<ref id="ref54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Riccio</surname> <given-names>A.</given-names></name> <name><surname>Mattia</surname> <given-names>D.</given-names></name> <name><surname>Simione</surname> <given-names>L.</given-names></name> <name><surname>Olivetti</surname> <given-names>M.</given-names></name> <name><surname>Cincotti</surname> <given-names>F.</given-names></name></person-group> (<year>2012</year>). <article-title>Eye-gaze independent EEG-based brain&#x2013;computer interfaces for communication</article-title>. <source>J. Neural Eng.</source> <volume>9</volume>:<fpage>045001</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/9/4/045001</pub-id></citation></ref>
<ref id="ref55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saha</surname> <given-names>S.</given-names></name> <name><surname>Mamun</surname> <given-names>K. A.</given-names></name> <name><surname>Ahmed</surname> <given-names>K.</given-names></name> <name><surname>Mostafa</surname> <given-names>R.</given-names></name> <name><surname>Naik</surname> <given-names>G. R.</given-names></name> <name><surname>Darvishi</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Progress in brain computer Interface: challenges and opportunities</article-title>. <source>Front. Syst. Neurosci.</source> <volume>15</volume>:<fpage>578875</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnsys.2021.578875</pub-id></citation></ref>
<ref id="ref56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schalk</surname> <given-names>G.</given-names></name> <name><surname>McFarland</surname> <given-names>D. J.</given-names></name> <name><surname>Hinterberger</surname> <given-names>T.</given-names></name> <name><surname>Birbaumer</surname> <given-names>N.</given-names></name> <name><surname>Wolpaw</surname> <given-names>J. R.</given-names></name></person-group> (<year>2004</year>). <article-title>BCI2000: A general-purpose brain-computer Interface (BCI) system</article-title>. <source>IEEE Trans. Biomed. Eng.</source> <volume>51</volume>, <fpage>1034</fpage>&#x2013;<lpage>1043</lpage>. doi: <pub-id pub-id-type="doi">10.1109/TBME.2004.827072</pub-id></citation></ref>
<ref id="ref57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schreuder</surname> <given-names>M.</given-names></name> <name><surname>Rost</surname> <given-names>T.</given-names></name> <name><surname>Tangermann</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Listen, you are writing! Speeding up online spelling with a dynamic auditory BCI</article-title>. <source>Front. Neurosci.</source> <volume>5</volume>:<fpage>112</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnins.2011.00112</pub-id></citation></ref>
<ref id="ref58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sellers</surname> <given-names>E. W.</given-names></name> <name><surname>Vaughan</surname> <given-names>T. M.</given-names></name> <name><surname>Wolpaw</surname> <given-names>J. R.</given-names></name></person-group> (<year>2010</year>). <article-title>A brain-computer Interface for long-term independent home use</article-title>. <source>Amyotroph. Lateral Scler.</source> <volume>11</volume>, <fpage>449</fpage>&#x2013;<lpage>455</lpage>. doi: <pub-id pub-id-type="doi">10.3109/17482961003777470</pub-id>, PMID: <pub-id pub-id-type="pmid">20583947</pub-id></citation></ref>
<ref id="ref59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Severens</surname> <given-names>M.</given-names></name> <name><surname>Van der Waal</surname> <given-names>M.</given-names></name> <name><surname>Farquhar</surname> <given-names>J.</given-names></name> <name><surname>Desain</surname> <given-names>P.</given-names></name></person-group> (<year>2014</year>). <article-title>Comparing tactile and visual gaze-independent brain&#x2013;computer interfaces in patients with amyotrophic lateral sclerosis and healthy users</article-title>. <source>Clin. Neurophysiol.</source> <volume>125</volume>, <fpage>2297</fpage>&#x2013;<lpage>2304</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.clinph.2014.03.005</pub-id></citation></ref>
<ref id="ref60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shrout</surname> <given-names>P. E.</given-names></name> <name><surname>Rodgers</surname> <given-names>J. L.</given-names></name></person-group> (<year>2018</year>). <article-title>Psychology, science, and knowledge construction: broadening perspectives from the replication crisis</article-title>. <source>Annu. Rev. Psychol.</source> <volume>69</volume>, <fpage>487</fpage>&#x2013;<lpage>510</lpage>. doi: <pub-id pub-id-type="doi">10.1146/annurev-psych-122216-011845</pub-id>, PMID: <pub-id pub-id-type="pmid">29300688</pub-id></citation></ref>
<ref id="ref61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Simon</surname> <given-names>N.</given-names></name> <name><surname>K&#x00E4;thner</surname> <given-names>I.</given-names></name> <name><surname>Ruf</surname> <given-names>C. A.</given-names></name> <name><surname>Pasqualotto</surname> <given-names>E.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name> <name><surname>Halder</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <article-title>An auditory multiclass brain-computer Interface with natural stimuli: usability evaluation with healthy participants and a motor impaired end user</article-title>. <source>Front. Hum. Neurosci.</source> <volume>8</volume>:<fpage>1039</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fnhum.2014.01039</pub-id></citation></ref>
<ref id="ref62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>E.</given-names></name> <name><surname>Delargy</surname> <given-names>M.</given-names></name></person-group> (<year>2005</year>). <article-title>Locked-in syndrome</article-title>. <source>BMJ</source> <volume>330</volume>, <fpage>406</fpage>&#x2013;<lpage>409</lpage>. doi: <pub-id pub-id-type="doi">10.1136/bmj.330.7488.406</pub-id></citation></ref>
<ref id="ref63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thurlings</surname> <given-names>M. E.</given-names></name> <name><surname>Brouwer</surname> <given-names>A.-M.</given-names></name> <name><surname>Van Erp</surname> <given-names>J. B. F.</given-names></name> <name><surname>Blankertz</surname> <given-names>B.</given-names></name> <name><surname>Werkhoven</surname> <given-names>P. J.</given-names></name></person-group> (<year>2012</year>). <article-title>Does bimodal stimulus presentation increase ERP components usable in BCIs?</article-title> <source>J. Neural Eng.</source> <volume>9</volume>:<fpage>045005</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/9/4/045005</pub-id>, PMID: <pub-id pub-id-type="pmid">22831989</pub-id></citation></ref>
<ref id="ref64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>van der Waal</surname> <given-names>M.</given-names></name> <name><surname>Severens</surname> <given-names>M.</given-names></name> <name><surname>Geuze</surname> <given-names>J.</given-names></name> <name><surname>Desain</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <article-title>Introducing the tactile speller: an ERP-based brain&#x2013;computer Interface for communication</article-title>. <source>J. Neural Eng.</source> <volume>9</volume>:<fpage>045002</fpage>. doi: <pub-id pub-id-type="doi">10.1088/1741-2560/9/4/045002</pub-id></citation></ref>
<ref id="ref65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Dinteren</surname> <given-names>R.</given-names></name> <name><surname>Huster</surname> <given-names>R. J.</given-names></name> <name><surname>Jongsma</surname> <given-names>M. L. A.</given-names></name> <name><surname>Kessels</surname> <given-names>R. P. C.</given-names></name> <name><surname>Arns</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>Differences in cortical sources of the event-related P3 potential between young and old participants indicate frontal compensation</article-title>. <source>Brain Topogr.</source> <volume>31</volume>, <fpage>35</fpage>&#x2013;<lpage>46</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10548-016-0542-y</pub-id></citation></ref>
<ref id="ref66"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vaughan</surname> <given-names>T. M.</given-names></name></person-group> (<year>2003</year>). <article-title>Guest editorial brain-computer Interface technology: a review of the second international meeting</article-title>. <source>IEEE Trans. Neural Syst. Rehabil. Eng.</source> <volume>11</volume>, <fpage>94</fpage>&#x2013;<lpage>109</lpage>. doi: <pub-id pub-id-type="doi">10.1109/TNSRE.2003.814799</pub-id></citation></ref>
<ref id="ref67"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Verleger</surname> <given-names>R.</given-names></name> <name><surname>&#x015A;migasiewicz</surname> <given-names>K.</given-names></name></person-group> (<year>2016</year>). <article-title>Do rare stimuli evoke large P3s by being unexpected? A comparison of oddball effects between standard-oddball and prediction-oddball tasks</article-title>. <source>Adv. Cogn. Psychol.</source> <volume>12</volume>, <fpage>88</fpage>&#x2013;<lpage>104</lpage>. doi: <pub-id pub-id-type="doi">10.5709/acp-0189-9</pub-id></citation></ref>
<ref id="ref68"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wascher</surname> <given-names>E.</given-names></name> <name><surname>Arnau</surname> <given-names>S.</given-names></name> <name><surname>Schneider</surname> <given-names>D.</given-names></name> <name><surname>Hoppe</surname> <given-names>K.</given-names></name> <name><surname>Getzmann</surname> <given-names>S.</given-names></name> <name><surname>Verleger</surname> <given-names>R.</given-names></name></person-group> (<year>2020</year>). <article-title>No effect of target probability on P3b amplitudes</article-title>. <source>Int. J. Psychophysiol.</source> <volume>153</volume>, <fpage>107</fpage>&#x2013;<lpage>115</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ijpsycho.2020.04.023</pub-id></citation></ref>
<ref id="ref69"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wolpaw</surname> <given-names>J. R.</given-names></name> <name><surname>Birbaumer</surname> <given-names>N.</given-names></name> <name><surname>McFarland</surname> <given-names>D. J.</given-names></name> <name><surname>Pfurtscheller</surname> <given-names>G.</given-names></name> <name><surname>Vaughan</surname> <given-names>T. M.</given-names></name></person-group> (<year>2002</year>). <article-title>Brain&#x2013;computer interfaces for communication and control</article-title>. <source>Clin. Neurophysiol.</source> <volume>113</volume>, <fpage>767</fpage>&#x2013;<lpage>791</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S1388-2457(02)00057-3</pub-id></citation></ref>
<ref id="ref70"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zickler</surname> <given-names>C.</given-names></name> <name><surname>Riccio</surname> <given-names>A.</given-names></name> <name><surname>Leotta</surname> <given-names>F.</given-names></name> <name><surname>Hillian-Tress</surname> <given-names>S.</given-names></name> <name><surname>Halder</surname> <given-names>S.</given-names></name> <name><surname>Holz</surname> <given-names>E.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>A brain-computer Interface as Input Channel for a standard assistive technology software</article-title>. <source>Clin. EEG Neurosci.</source> <volume>42</volume>, <fpage>236</fpage>&#x2013;<lpage>244</lpage>. doi: <pub-id pub-id-type="doi">10.1177/155005941104200409</pub-id></citation></ref>
<ref id="ref71"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ziebell</surname> <given-names>P.</given-names></name> <name><surname>St&#x00FC;mpfig</surname> <given-names>J.</given-names></name> <name><surname>Eidel</surname> <given-names>M.</given-names></name> <name><surname>Kleih</surname> <given-names>S. C.</given-names></name> <name><surname>K&#x00FC;bler</surname> <given-names>A.</given-names></name> <name><surname>Latoschik</surname> <given-names>M. E.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Stimulus modality influences session-to-session transfer of training effects in auditory and tactile streaming-based P300 brain&#x2013;computer interfaces</article-title>. <source>Sci. Rep.</source> <volume>10</volume>:<fpage>11873</fpage>. doi: <pub-id pub-id-type="doi">10.1038/s41598-020-67887-6</pub-id></citation></ref>
</ref-list>
</back>
</article>