Investigating the Impact of Assistive Technologies on Working Memory Load in Manual Assembly through Electroencephalography
-
1
Ludwig-Maximilians-Universität München, Germany
-
2
Max-Planck-Institut für biologische Kybernetik, Germany
Introduction & Aim: Mentally demanding tasks are often, but not always, those that place a high load on working memory. In fact, the N-back task is often relied on as the "ground truth" for evaluating brain-computer interfaces that seek to infer user experienced workload [Brouwer2011]. Manual production lines is a real-world example that requires workers to memorize complex assembly instructions, an aspect that is becoming more demanding in recent times as production lot sizes decrease. To assist manual assembly, in-situ displays have been developed that provide just-in-time instructions for assembly [Funk2016]. The utility of this in alleviating mental workload has been validated with measures such as questionnaires or semi-structured interviews, but never with neuroimaging. In this work, we employ electroencephalography (EEG) to evaluate the extent to which in-situ displays alleviate visuospatial working memory during manual assembly.
Methods: An Emotiv Epoc was used to record EEG data throughout the whole experiment. In a within-subject study design (N=12), participants were instructed to use either paper or projected in-situ instructions to assemble a Lego Duplo construction [Funk2016]. Paper instructions were printed on A4 sized sheets of paper. In-situ instructions were projected directly into the workplace (see Figure 1). Before the start of the assembly task, participants performed a one-minute eyes-opened/eyes-closed task followed by two N-back tasks (N=0 and N=2) to ensure a correct setup of the Emotiv Epoc through alpha desynchronization and to determine the individual bandwidth for alpha power. Afterward, participants started to assemble two different Lego Duplo starting with either paper or projected in-situ instructions based on the balanced Latin square. Ground truth for perceived workload is measured via NASA-TLX questionnaires filled out by participants after every N-back and assembly trial.
Results: Alpha power was derived and noise suppressed by using a spatio-spectral decomposition filter [Nikulin2011]. Our findings show significantly higher alpha desynchronization when conducting an N-back task with N=2 than N=0, F(1, 11) = 34.82, p < 0.001. By comparing projected in-situ and paper instructions, projected in-situ instructions showed significantly less alpha desynchronization than paper instructions, F(1, 11) = 14.92, p < 0.003. This converges with collected NASA-TLX questionnaires evaluating perceived workload levels. We also found that item selection errors have significantly increased when using paper instructions instead of projected in-situ instructions, F(1, 11) = 10.75, p < 0.007.
Discussion and Conclusion: Our study shows encouraging results of using a low-cost EEG to evaluate assembly instruction system. Possible reasons for paper instructions causing higher alpha desynchronization, and thus working memory load, might be that every step (e.g. picking and placing a brick) has to be remembered by participants while projected in-situ instructions obviate the need for remembering single steps. This is backed up by a reduced number of item selection errors and supported by NASA-TLX questionnaires. This provides insights for developers to evaluate the feasibility of their assistive system design on a cognitive basis.
References
[Brouwer2011]: Brouwer, A. M., & Van Erp, J. (2011). The TNO tactile P300 BCI.
[Funk2015]: Funk, M., Kosch, T., Greenwald, S. W., & Schmidt, A. (2015, November). A benchmark for interactive augmented reality instructions for assembly tasks. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia(pp. 253-257). ACM.
[Funk2016]: Funk, M., Kosch, T., & Schmidt, A. (2016, September). Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 934-939). ACM.
[Hart1988]: Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology (Vol. 52, pp. 139-183). North-Holland.
[Nikulin2011]: Nikulin, V. V., Nolte, G., & Curio, G. (2011). A novel method for reliable and fast extraction of neuronal EEG/MEG oscillations on the basis of spatio-spectral decomposition. NeuroImage.
Keywords:
working memory,
cognitive workload,
manual assembly,
assistive technologies,
Electroencephalography
Conference:
2nd International Neuroergonomics Conference, Philadelphia, PA, United States, 27 Jun - 29 Jun, 2018.
Presentation Type:
Poster Presentation
Topic:
Neuroergonomics
Citation:
Kosch
T and
Chuang
LL
(2019). Investigating the Impact of Assistive Technologies on Working Memory Load in Manual Assembly through Electroencephalography.
Conference Abstract:
2nd International Neuroergonomics Conference.
doi: 10.3389/conf.fnhum.2018.227.00114
Copyright:
The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers.
They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.
The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.
Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.
For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.
Received:
02 Apr 2018;
Published Online:
27 Sep 2019.
*
Correspondence:
Mr. Thomas Kosch, Ludwig-Maximilians-Universität München, Munich, Germany, thomaskosch90@gmail.com