"Now it tells you to press continue": Multimodal Strategies to navigate between Machine-Human and Human-Human Instructions in Thermomix Experience Meetings

Carolin Dix^*

• University of Innsbruck, Innsbruck, Austria

This paper focuses on the interactive multimodal management and orchestration of human-tohuman instructions and machine-to-human instructions when learning how to use the smart cooking aid Thermomix® during cooking experience meetings. These peer-to-peer events, hosted in private homes, combine elements of cooking workshops, product presentations, and sales events. Unlike traditional cooking classes, cooking experience meetings involves a human (the representative) and a machine which both give instructions to the participants. The study focuses on how Thermomix® representatives as experts spatially and interactively position themselves as intermediary between the machine and the users and at the same time as authoritative and legitimate instructors. The examples show how they coordinate their instructions with the digital guidance provided by the machine, elaborate these instructions or add new ones. Using video data from two cooking experience meetings, the analysis shows that while the Thermomix® provides step-by-step directives, the representative plays a crucial role in explaining, evaluating, and adapting the instructions to ensure participants understand the cooking process. The study contributes to research on human-machine interaction by illustrating how instructional authority is distributed between human experts and smart technology in interactive learning environments.