Multimodal measurements enhance insights into emotional responses to immediate feedback

Anne Horvers^1* Inge Molenaar¹ Heleen Van Der West¹ Tibor Bosse¹ Ard W. Lazonder¹

• ¹Behavioural Science Institute, Radboud University, Netherlands

Adaptive learning technologies often provide students with immediate feedback on task performance. This feedback can elicit various emotional responses, which, in turn, influence learning. Most recent studies capture these emotions by single data streams, contradicting the multi-componential nature of emotion. Therefore, this study investigated 32 university students solving mathematical problems using adaptive learning technology. Students received immediate feedback on every step in the solution process, after which their physiological, experiential and behavioural responses to this feedback were recorded. Physiological arousal was measured by electrodermal activity, valence was measured by self-reports (experiential), and emotion types were measured by observations of facial expressions (behavioural). Results showed more peaks in electrodermal activity after feedback than was expected based on chance. These responses were comparable in strength after feedback on failure and success. Students' experiential responses conveyed mostly positive valence after feedback on success and mostly negative valence after feedback on failure. Behavioural observations showed more negative than positive emotion types after feedback on failure and more positive than negative emotion types after feedback on success. These results show that physiological arousal is a valuable objective indicator of emotional responses after immediate feedback but should be accompanied by other data streams in order to understand students' emotional responses. Both valence and emotion types can be used for this purpose. These outcomes pave the way for designing adaptive learning technologies that take students' emotions into account.