Images from the Mind: BCI image reconstruction based on Rapid Serial Visual Presentations of polygon primitives
-
1
Universitat Pompeu Fabra, ICREA-Complex Systems Lab, Spain
-
2
UPF-CSIC, Institut de Biologia Evolutiva, Spain
-
3
Bernstein Center for Computational Neuroscience, Germany
-
4
Berlin Institute of Technology, Germany
We provide a proof of concept for an EEG-based reconstruction of a visual image which is on a user's mind. Our approach is based on the Rapid Serial Visual Presentation (RSVP) of polygon primitives and Brain-Computer Interface (BCI) technology. In an experimental setup, subjects were presented bursts of polygons: some of them contributed to building a target image (because they matched the shape and/or color of the target) while some of them did not. The presentation of the contributing polygons triggered attention-related EEG patterns. These Event Related Potentials (ERPs) could be determined using BCI classification and could be matched to the stimuli that elicited them. These stimuli (i.e. the ERP-correlated polygons) were accumulated in the display until a satisfactory reconstruction of the target image was reached. As more polygons were accumulated, finer visual details were attained resulting in more challenging classification tasks. In our experiments, we observe an average classification accuracy of around 75%. An in-depth investigation suggests that many of the misclassifications were not misinterpretations of the BCI concerning the users' intent, but rather caused by ambiguous polygons that could contribute to reconstruct several different images. When we put our BCI-image reconstruction in perspective with other RSVP BCI paradigms, there is large room for improvement both in speed and accuracy. These results invite us to be optimistic. They open a plethora of possibilities to explore non-invasive BCIs for image reconstruction both in healthy and impaired subjects and, accordingly, suggest interesting recreational and clinical applications.
Keywords:
Brain-computer interface,
image reconstruction,
rapid serial visual presentation,
oddball paradigm,
Electroencephalogram
Conference:
B·DEBATE | A Dialogue with the Cerebral Cortex: Cortical Function and Interfacing (Workshop), Barcelona, Spain, 29 Apr - 30 Apr, 2015.
Presentation Type:
Poster Presentation
Topic:
SESSION 4: Decoding Brain Activity and the Future of Brain Computer Interfaces
Citation:
Seoane
LF,
Gabler
S and
Blankertz
B
(2015). Images from the Mind: BCI image reconstruction based on Rapid Serial Visual Presentations of polygon primitives.
Front. Syst. Neurosci.
Conference Abstract:
B·DEBATE | A Dialogue with the Cerebral Cortex: Cortical Function and Interfacing (Workshop).
doi: 10.3389/conf.fnsys.2015.06.00004
Copyright:
The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers.
They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.
The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.
Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.
For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.
Received:
20 Apr 2015;
Published Online:
06 May 2015.
*
Correspondence:
Mr. Luís F Seoane, Universitat Pompeu Fabra, ICREA-Complex Systems Lab, Barcelona, Spain, luis.seoane@upf.edu
Mr. Stephan Gabler, Bernstein Center for Computational Neuroscience, Berlin, Germany, stephan.gabler@gmail.com
Prof. Benjamin Blankertz, Berlin Institute of Technology, Berlin, Germany, benjamin.blankertz@tu-berlin.de