<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="brief-report" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Comput. Sci.</journal-id>
<journal-title>Frontiers in Computer Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Comput. Sci.</abbrev-journal-title>
<issn pub-type="epub">2624-9898</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">694691</article-id>
<article-id pub-id-type="doi">10.3389/fcomp.2021.694691</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Computer Science</subject>
<subj-group>
<subject>Perspective</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A Reflection on the State of Multisensory Human&#x2013;Food Interaction Research</article-title>
<alt-title alt-title-type="left-running-head">Velasco et&#x20;al.</alt-title>
<alt-title alt-title-type="right-running-head">Multisensory Human-Food Interaction</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Velasco</surname>
<given-names>Carlos</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/175023/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Wang</surname>
<given-names>Qian Janice</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/203233/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Obrist</surname>
<given-names>Marianna</given-names>
</name>
<xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/445831/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Nijholt</surname>
<given-names>Anton</given-names>
</name>
<xref ref-type="aff" rid="aff4">
<sup>4</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/81342/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<label>
<sup>1</sup>
</label>Centre for Multisensory Marketing, Department of Marketing, BI Norwegian Business School, <addr-line>Oslo</addr-line>, <country>Norway</country>
</aff>
<aff id="aff2">
<label>
<sup>2</sup>
</label>Department of Food Science, Faculty of Technical Sciences, Aarhus University, <addr-line>Aarhus</addr-line>, <country>Denmark</country>
</aff>
<aff id="aff3">
<label>
<sup>3</sup>
</label>Department of Computer Science, University College London, <addr-line>London</addr-line>, <country>United&#x20;Kingdom</country>
</aff>
<aff id="aff4">
<label>
<sup>4</sup>
</label>Human Media Interaction, University of Twente, <addr-line>Enschede</addr-line>, <country>Netherlands</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/238886/overview">Marko Tkalcic</ext-link>, University of Primorska, Slovenia</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1327319/overview">Jettie Hoonhout</ext-link>, Philips, Netherlands</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1285779/overview">Hanna Jasmin Hauptmann</ext-link>, University of Konstanz, Germany</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Carlos Velasco, <email>carlos.velasco@bi.no</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Human-Media Interaction, a section of the journal Frontiers in Computer Science</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>01</day>
<month>12</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>3</volume>
<elocation-id>694691</elocation-id>
<history>
<date date-type="received">
<day>13</day>
<month>04</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>29</day>
<month>10</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2021 Velasco, Wang, Obrist and Nijholt.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Velasco, Wang, Obrist and Nijholt</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>We present a perspective article on the state of multisensory human&#x2013;food interaction (MHFI) research and lay out some reflections for research and development in this area of inquiry, based on a revision of the different spaces that we have co-created with researchers in this space. We begin by conceptualizing and defining MHFI, before moving onto presenting some of its major themes, as well as possible ways in which such themes can guide future research in the area. This article provides key definitions and foundations for the area of MHFI, as well as a first point of contact for those interested in&#x20;it.</p>
</abstract>
<kwd-group>
<kwd>multisensory</kwd>
<kwd>human&#x2013;food interaction</kwd>
<kwd>technology</kwd>
<kwd>senses</kwd>
<kwd>foundations</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>The emerging field of Human&#x2013;Food Interaction (HFI) is thought to be an area of Human&#x2013;Computer Interaction (HCI) research that addresses our interactions with food (<xref ref-type="bibr" rid="B5">Comber et&#x20;al., 2014</xref>). HFI specifically focuses on the role of technology in supporting and enriching food practices throughout the food chain, that is, from growing, through experiencing, to disposing (<xref ref-type="bibr" rid="B16">Khot and Mueller, 2019</xref>).</p>
<p>A Google Scholar search of &#x201c;Human&#x2013;Food Interaction&#x201d; up to 2010 results in 18 research articles; however, the same search between 2010 and 2020 results in 508 (up to September 22, 2021). This, of course, is not an exhaustive index of the size of the field (perhaps some works might not talk directly about HFI, yet still be part of the field), considering that before researchers started to use the term HFI, research was already being conducted within HCI on human&#x2013;food interaction (<xref ref-type="bibr" rid="B12">Grimes and Harper, 2008</xref>). Yet, this is initial evidence that HFI has grown significantly over the last decade. HFI has given rise to three communities of researchers, namely, Food CHI focusing on food and interaction design; another group of researchers focusing on artificial intelligence (AI) approaches to HFI; and Multisensory Human&#x2013;Food Interaction (MHFI), which highlights the multisensory aspects of HFI (see <xref ref-type="bibr" rid="B1">Bertran et&#x20;al., 2019</xref>, for an exhaustive survey of the field of&#x20;HFI).</p>
<p>In the present article, we present our perspective on MHFI based on the work of multiple workshops and a special issue that we have co-created. While this area of research is still in its infancy, we have seen an increasing interest in fields as diverse as HCI, psychology, sensory science, and marketing, as well as an emerging effort to study the intersection between the senses, food, and technology (e.g., <xref ref-type="bibr" rid="B38">Velasco et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B8">Crofton et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B26">Petit et&#x20;al., 2019</xref>). Last year, the specialized ACM International Conference on Multimodal Interaction (ICMI) workshop on MHFI was conducted for the fourth time (<xref ref-type="bibr" rid="B35">Velasco et&#x20;al., 2020</xref>), yielding a total of 32 research articles across the four workshops. In addition, one special issue has been presented (with another one currently in course), together with the journals <italic>Frontiers in Psychology</italic>, <italic>Computer Science</italic>, and <italic>Nutrition</italic>, resulting in a total of nine articles. Importantly, contributions to MHFI have not been limited to this workshops and special issues.</p>
<p>There have been other initiatives in which research and ideas on the senses, food, and technology have been presented and discussed, such as three Data Engineering meets Intelligent Food and Cooking Recipe (DECOR, <ext-link ext-link-type="uri" xlink:href="http://research.nii.ac.jp/decor/decor2020.html">http://research.nii.ac.jp/decor/decor2020.html</ext-link>) workshops (2018&#x2013;2020), EAT&#x2014;The ICMI 2018 Eating Analysis and Tracking Challenge (<ext-link ext-link-type="uri" xlink:href="https://icmi.acm.org/2018/index.php?id=challenges">https://icmi.acm.org/2018/index.php?id&#x3d;challenges&#x23;eat</ext-link>), ACM Conference on Human Factors in Computing Systems (CHI) Play 2019 Session on Gustatory and Other Sensations, CHI Play 2019 Workshop: Chasing Play Potentials in Food Culture to Inspire Technology Design, the 1st (<ext-link ext-link-type="uri" xlink:href="https://sites.google.com/dis.uniroma1.it/avi2018/co-located-events/satellite-events/the-future-of-computing-food">https://sites.google.com/dis.uniroma1.it/avi2018/co-located-events/satellite-events/the-future-of-computing-food</ext-link>) and 2nd (<ext-link ext-link-type="uri" xlink:href="https://sites.google.com/view/fcfws2/">https://sites.google.com/view/fcfws2/</ext-link>) workshops on the Future of Computing and Food, Internet of Food (<ext-link ext-link-type="uri" xlink:href="https://ieee-iotj.org/special-issues/">https://ieee-iotj.org/special-issues/</ext-link>), IoT4Food (<ext-link ext-link-type="uri" xlink:href="https://www.iof2020.eu/latest/events/2020/03/iot4food">https://www.iof2020.eu/latest/events/2020/03/iot4food</ext-link>), and the Play Food Children workshop at Interaction Design and Children 2020 (<ext-link ext-link-type="uri" xlink:href="https://playandculture.food.blog/">https://playandculture.food.blog/</ext-link>). In addition, this year, there was a CHI workshop entitled &#x201c;The Future of Human&#x2013;Food Interaction&#x201d; (<ext-link ext-link-type="uri" xlink:href="https://www.humanfoodinteraction.org/">https://www.humanfoodinteraction.org/</ext-link>), which also has a dedicated special issue in the International Journal of Gastronomy and Food Science.</p>
<p>For all the aforesaid reasons, we thought it was time to present an article to reflect on the state of the MHFI research area from our perspective, and to contribute to the discussion on current advances and future directions, by considering where it comes from and where it is heading to. To this end, this perspective article focuses on the following aims: (1) define MHFI and present its current state, (2) reflect on the opportunities and challenges to develop this interdisciplinary area of inquiry, (3) reflect on the way forward to maximize the transfer of MHFI research into practice, and (4) present some general conclusions and takeaways. In addressing these aims, we hope to provide a starting point for reflection and discussion on the future developments of the MHFI area for those interested in this emerging&#x20;topic.</p>
</sec>
<sec id="s2">
<title>The State of MHFI Research</title>
<sec id="s2-1">
<title>Defining MHFI</title>
<p>As suggested by Velasco and colleagues (2018), the growing interest in HFI to capitalize on multisensory processes to create, modify, and enhance our food-related experiences may be explained, at least in part, by two observations. First, eating and drinking are among the most multisensory events in our everyday lives. Indeed, we interface with food through most, if not all our senses (<xref ref-type="bibr" rid="B27">Prescott, 2015</xref>; <xref ref-type="bibr" rid="B30">Spence, 2017</xref>). Second, technology is ubiquitous and there are growing efforts toward developing multisensory technologies, that is, technologies that are designed to stimulate the human senses beyond audition and vision allow researchers and practitioners to precisely control sensory quality, quantity, and delivery (e.g., haptic stimulation in mid-air, digitally-controlled smell delivery, electric taste devices; <xref ref-type="bibr" rid="B6">Cornelio et&#x20;al., 2021</xref>; <xref ref-type="bibr" rid="B7">Covaci et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B23">Obrist et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B37">Velasco and Obrist, 2020</xref>). This context paved the way for MHFI as an area of inquiry. As such, it was conceived to focus mainly on the understanding of the multisensory process associated with our interaction with food (mostly eating) and on capitalizing on them when designing novel technologies and food interaction systems (<xref ref-type="bibr" rid="B22">Nijholt et&#x20;al., 2016</xref>).</p>
<p>It is clear, however, that the initial scope of MHFI need to be broadened as the area progressed. First, our interactions with food are not limited to eating. Indeed, research from different fields have characterized the food interaction journey as consisting of different stages such as growing/purchasing, cooking, eating, and disposing (<xref ref-type="bibr" rid="B4">Choi et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B28">Schifferstein, 2016</xref>). Secondly, the world is currently facing multiple challenges concerning food including, but not limited to, unsustainable food practices, food and climate change, food waste, obesity, (mal)nutrition, and hunger (<xref ref-type="bibr" rid="B11">FAO, 2018</xref>). With this in mind, MHFI can contribute beyond eating (e.g., nudging, expectations development, and disposing), to tackle other interaction stages (pre-eating and post-eating), as well as important food-related challenges that humanity faces (e.g., associated with health and sustainability). In fact, MHFI can connect research on the senses, food, and multisensory technologies to design any kind of food interaction and experience.</p>
<p>So how should we define MHFI? We follow the definition of <xref ref-type="bibr" rid="B4">Choi et&#x20;al. (2014)</xref> of HFI as the interrelationship between self and food, though we include others (a social element) as part of our definition, considering that HFI can also involve food interactions between selves, mediated by technology (e.g., commensality, see <xref ref-type="bibr" rid="B31">Spence et&#x20;al., 2019</xref>). Therefore, we define MHFI as a research area that studies the role of the senses in the interrelationship between self, others, and food, and that capitalizes on such understanding to modify existing and/or create new self&#x2013;others&#x2013;food interrelationships through technology. Note that the fact that food experiences are multisensory in nature makes HFI multisensory per se; however, the term MHFI involves the word &#x201c;multisensory&#x201d; as it places the senses at the center of, and emphasizes their role in HFI research and practice. While MHIF is a multidisciplinary area of study as defined above, it is worth mentioning that there is extensive research on multisensory perception and its relationship to food in fields such as psychology and sensory science (e.g., <xref ref-type="bibr" rid="B27">Prescott, 2015</xref>; <xref ref-type="bibr" rid="B30">Spence, 2017</xref>) and thus MHFI can build on such research to modify existing and/or create new self&#x2013;others&#x2013;food interrelationships through technology.</p>
<p>Here, it is important to mention that, in HCI, interaction is defined as any communication between a user and a computer, be it direct or indirect (<xref ref-type="bibr" rid="B14">Hornb&#xe6;k and Oulasvirta, 2017</xref>). As such, MHFI also involves communication as part of it. Importantly, however, MHFI can also be about designing interactive interfaces between humans and digital technology and about designing interactive experiences (<xref ref-type="bibr" rid="B31">Spence et&#x20;al., 2019</xref>). It is perhaps useful to think about MHFI as multisensory experiences in HFI. In other words, &#x201c;In the context of HFI, multisensory experiences refer to impressions formed by specific food-related events, whose sensory elements (e.g., intrinsic and extrinsic to the food, see, for example, <xref ref-type="bibr" rid="B40">Wang et&#x20;al., 2019</xref>) have been carefully crafted by someone for a given receiver (e.g., diners). For instance, to create the impression of a taste, say &#x201c;sweet&#x201d;, colors, textures, and specific smells can be considered in a specific event.&#x201d; (<xref ref-type="bibr" rid="B36">Velasco and Obrist, 2021</xref>, p. 3). Given that experiences are only one part of MHFI, this definition may be broadened as follows: MHFI refers to self&#x2013;food interrelationships formed by specific food-related events, whose sensory elements have been carefully designed by somebody for a given receiver or group of receivers.</p>
</sec>
<sec id="s2-2">
<title>Major Themes in MHFI</title>
<p>To formulate our perspective on the current state of MHFI research, we revisited the various contributions to our four ICMI workshops on MHFI, as well as one research topic in <italic>Frontiers</italic> (<italic>n</italic>&#x20;&#x3d; 41). We identified key themes, associated with the research and development process of the area, that emerged from the articles (see <xref ref-type="sec" rid="s9">Supplementary Appendix SA1</xref>, for the titles of the articles and themes identified). Although the number of articles is relatively small, it is representative if one considers that MHFI focuses only on a subset of research of HFI (see <italic>Introduction</italic>). Importantly, because this article is intended to reflect upon our perspective in MHFI, the sample of articles serves that purpose.</p>
<p>After reviewing these articles, we identified, through a series of iterations, five major themes. Below, we present a summary of such themes and the proportions of articles in each theme (see also <xref ref-type="sec" rid="s9">Supplementary Appendix SA1</xref>).<list list-type="simple">
<list-item>
<p>1) Data collection and analyses: Articles in which a system for data collection and/or analyses are presented. Number of articles &#x3d; 5 (12.3%).</p>
</list-item>
<list-item>
<p>2) Psychological mechanisms: Articles presenting studies designed to better understand psychological mechanisms associated with MHFI (e.g., crossmodal effects on flavor perception, such as the influence of, say, auditory stimuli on perceived taste intensity). Number of articles &#x3d; 13 (31.7%).</p>
</list-item>
<list-item>
<p>3) Design studies: Articles studying design approaches and frameworks. Number of articles &#x3d; 5 (12.2%).</p>
</list-item>
<list-item>
<p>4) Augmentation and interfaces: Articles focused on food augmentation processes and interfaces. Number of articles &#x3d; 7 (17.1%).</p>
</list-item>
<list-item>
<p>5) Applications&#x2014;Commensality, education, entertainment, and/or health: Articles studying interactions specifically targeting one of these areas. Number of articles &#x3d; 11 (26.8%).</p>
</list-item>
</list>
</p>
<p>The majority of articles (about a third) have focused on psychological mechanisms, followed by specific applications in commensality, education, entertainment, and/or health, followed by augmentation and interfaces, design studies, and data collection and analyses. Here, it is worth mentioning that research and development in MHFI can capitalize on existing research from other fields (e.g., research on the neuroscience of flavor perception to develop new systems; <xref ref-type="bibr" rid="B27">Prescott, 2015</xref>).</p>
</sec>
<sec id="s2-3">
<title>Foundations of MHFI: Connecting Fields, Research, and Practice</title>
<p>Following our analyses of the articles and the key themes that we identified, we see that there is possibility for guiding research in MHFI in such a way that it starts from an understanding of MHFI psychological processes, which result in applications (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Possible themes associated with research and development in MHFI.</p>
</caption>
<graphic xlink:href="fcomp-03-694691-g001.tif"/>
</fig>
<p>In <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>, we present the themes associated with progress in MHFI. The first and second themes consist of elucidating psychological mechanisms and data collection and analytical methods, both of which support the human understanding foundations of MHFI. The third theme consists of design studies to develop frameworks and the fourth theme on the development of specific interfaces and augmentation technologies, both of which support the user interaction foundations. These technological interfaces can then be used to target specific applications in various areas such as commensality, education, entertainment, and/or health, which constitutes the fifth theme. Note that it is possible that specific interfaces are already designed with applications in mind, though.</p>
<p>It is perhaps worth illustrating with a now classic example of MHFI, namely, the Chewing Jockey, which is a system that monitors mastication and synchronizes sound-delivery to it (<xref ref-type="bibr" rid="B17">Koizumi et&#x20;al., 2011</xref>). This technology capitalized (1. Psychological mechanisms) on previous studies developed to understand and document the role of auditory cues on modulating texture and taste perception (<xref ref-type="bibr" rid="B41">Zampini and Spence, 2004</xref>). Said studies have suggested, for instance, that the crispiness of potato chips can be enhanced by chewing sounds or white noise with a high-pass filter (see also <xref ref-type="bibr" rid="B29">Spence, 2015</xref>, for a review). Based on this idea and aiming to redesign the eating experience (3. Design studies and frameworks), <xref ref-type="bibr" rid="B17">Koizumi et&#x20;al. (2011)</xref> developed the chewing jockey technology (4. Interfaces and augmentation). Once this interface was designed, the authors moved on to specific applications (5. Applications). Here, the authors suggested at least two applications. The first consisted of using the system to enhance texture perception for the elderly (health), and the second, to design novel fun interactions (entertainment), such as mapping the sounds of screaming sounds to gummy bear chewing. While this study did not fully capitalize on available design frameworks for sound augmentation (3), it follows general experience design guidelines. In addition, while data collection (2) was not a part of it, given that the system uses a chewing tracking system, it is possible to collect data, as well (see also <xref ref-type="bibr" rid="B18">Lin et&#x20;al., 2020</xref>, FoodFab and <xref ref-type="bibr" rid="B19">Narumi et&#x20;al., 2011</xref> Metacookie, for other examples).</p>
<p>All in all, the possible themes associated with research and development in MHFI allow researchers and practitioners to think of how to connect everything from basic research on multisensory influences on self&#x2013;others&#x2013;food interrelationships all the way to possible applications. It is important to mention here that one of the key characteristics of this area of research and practice is its interdisciplinary nature, involving fields such as, though not limited to, psychology and neuroscience, sensory science, HCI, and marketing. This interdisciplinary work can guarantee the strong conceptual and practical foundations of every step of the research and development process (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>).</p>
</sec>
</sec>
<sec id="s3">
<title>Research Directions and Conclusions</title>
<p>MHFI is a nascent area of research and, as such, there are multiple unanswered questions and directions for research that need to be addressed. For example:<list list-type="simple">
<list-item>
<p>&#x2022; What human problems can MHFI design help with? (e.g., help children to enjoy and engage with food in new interactive ways, help enhance flavor experiences for the elderly often suffering of reduced sensory abilities, augment food experiences in outer space where food could be perceived as bland).</p>
</list-item>
<list-item>
<p>&#x2022; How do we move from lab-based research explorations to real-world deployments of MHFI applications/technologies to improve people&#x2019;s lives?</p>
</list-item>
<list-item>
<p>&#x2022; What are some key ethical reflections and responsibilities around MHFI design?</p>
</list-item>
</list>
</p>
<p>Considering those questions, we reflect below upon some key areas for future research and development in the area of MHFI, especially based on the discussions in our workshops and special issues. We also reflect on how to approach MHFI research and put it into practice.</p>
<sec id="s3-1">
<title>Areas of Future Development</title>
<sec id="s3-1-1">
<title>Direct Interaction With Food: Designing Experiences That Enhance the Eating Experience</title>
<p>Designing technology around the ingestion process, we can use the senses to highlight flavor as well as influence appetite. For instance, for the elderly (<xref ref-type="bibr" rid="B10">Doets and Kremer, 2016</xref>), work in MHFI may contribute to making up for losses in smell and taste perception as well as promote desire to eat. MHFI could also solve challenges around eating in extreme situations (e.g., space exploration) where technology and psychological understanding are needed to create new ways of eating (<xref ref-type="bibr" rid="B24">Obrist et&#x20;al., 2019</xref>). Referring to our framework (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>), this area relies on making use of existing knowledge in psychological mechanisms to develop design frameworks, interfaces, and applications to support people&#x2019;s eating experiences.</p>
</sec>
<sec id="s3-1-2">
<title>Social Aspect: Designing Interaction With Others Around Food</title>
<p>Food is a means for socialization and sharing (<xref ref-type="bibr" rid="B21">Niewiadomski et&#x20;al., 2019</xref>). The social aspects around food can include food growing, producing, purchasing, preparation, eating, sharing, and disposing (<xref ref-type="bibr" rid="B36">Velasco and Obrist, 2021</xref>). Remote commensality is a special area of interest (e.g., <xref ref-type="bibr" rid="B3">Ceccaldi et&#x20;al., 2020</xref>), which can be enhanced by considering the multisensory processes associated with social dining (<xref ref-type="bibr" rid="B31">Spence et&#x20;al., 2019</xref>).</p>
</sec>
<sec id="s3-1-3">
<title>Change Attitude Towards Food: Designing Food Interaction to Nudge People</title>
<p>Beyond direct ingestion, how can we use the senses to change people&#x2019;s mindset about specific foods (<xref ref-type="bibr" rid="B9">de Vries et&#x20;al., 2020</xref>; <xref ref-type="bibr" rid="B42">Zhao et&#x20;al., 2016</xref>)? This could be influencing their food-based decision-making&#x2014;including attitude towards certain foods, purchase intentions, and disposal habits (<xref ref-type="bibr" rid="B2">Cadario and Chandon, 2020</xref>; <xref ref-type="bibr" rid="B13">Hollands et&#x20;al., 2017</xref>). For example, the integration of augmented reality and other visually enabling technologies in the process of food purchases can influence the way in which people develop purchase intentions (<xref ref-type="bibr" rid="B25">Petit et al., 2021</xref>; <xref ref-type="bibr" rid="B34">Velasco et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B33">Toet et&#x20;al., 2017</xref>). MHFI has already seen several theoretical developments, but what is missing is the integrated use of novel technologies and data collection mechanisms that can measure large quantities of real-world&#x20;data.</p>
</sec>
<sec id="s3-1-4">
<title>Digital Augmentation: Technology Enabled Food Interaction Experiences</title>
<p>An increasing number of digital technologies are being developed to stimulate our chemical senses and thus create new MHFIs and/or to study multisensory processes (<xref ref-type="bibr" rid="B6">Cornelio et&#x20;al., 2021</xref>). Indeed, there is increasing interest in the way in which technologies can be used to create and/or augment eating and drinking experiences digitally (<xref ref-type="bibr" rid="B32">Spence et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B39">Vi et&#x20;al., 2017</xref>). Note, however, that augmentation is not limited to the chemical senses. Indeed, a wide range of research directions and applications (e.g., context enhancement, food structure and texture, and sensory augmentation) have been forwarded for augmented reality in food interactions (see <xref ref-type="bibr" rid="B20">Narumi, 2016</xref>; <xref ref-type="bibr" rid="B8">Crofton et&#x20;al., 2019</xref>). With respect to the pipeline framework, this is an exciting area with many new interface developments. However, what is less clear are how such interactions can spread outside the lab and be deployed in the real&#x20;world.</p>
</sec>
<sec id="s3-1-5">
<title>Ethical Considerations: Responsible Innovation Around Food Interaction</title>
<p>Recently, <xref ref-type="bibr" rid="B36">Velasco and Obrist (2021)</xref> indicated that, as there is scope for development in MHFI, there are also key responsibilities, and thus, we need to consider the ethical implications of this area of research. This is particularly important when moving from lab-based explorations into real-world deployments. What are key ethical reflections in MHFI? Consider the abilities of digital technologies like food 3D printers and virtual and augmented (VR/AR) reality. Those technologies enable us to create/design realities that are not matching the physical world. For example, we can now change the appearance of food to make it look more appetizing, or we can change the infill structure of 3D printed food to affect people&#x2019;s feeling of satiety (as in FoodFab by <xref ref-type="bibr" rid="B18">Lin et&#x20;al., 2020</xref>). We can create food perception illusions that can deceive people, but in this case benefit the person (eating less, which in light of a global challenge of obesity can be considered a desirable intervention). However, who decides about the beneficiaries and when it is ok to create such experiences? While this will require ongoing discussion on the topic, it is key to treat receivers of MHFIs fairly by considering their differences and similarities, avoiding biases, and ensuring accessibility of technology (see also <xref ref-type="bibr" rid="B4">Choi et&#x20;al., 2014</xref>). This is an overarching concern that touches upon all elements of the pipeline framework.</p>
</sec>
</sec>
<sec id="s3-2">
<title>Open a Dialogue on How to Approach MHFI in Research and Practice</title>
<p>While the themes identified in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> are all important, the question remains how research should be conducted going forward. Should researchers target one specific step, or should all five be considered in order for a study to be considered MHFI? Moreover, how should researchers from different disciplines approach a potential MHFI research topic? Should it grow organically from the ground up, where people should focus on first developing psychological mechanisms? Or should researchers identify problem areas that are needed, then look up research on psychological/neurological mechanisms upon which to develop the technological application? Developments from the four MHFI workshops have shown that in 2016, the focus was on augmentation and interfaces, but with time, the focus has shifted towards the two ends of the research pipeline: Either towards psychological mechanisms or final applications (<xref ref-type="sec" rid="s9">Supplementary Appendix SA1</xref>).</p>
<p>The list of questions raised is evidence of the idea that we are only at the beginning of understanding and exploring the areas and themes around MHFI, and while we wish to provide answers, it is more our intention to open up a dialogue with the community, and as part of that, in effect, continue our past efforts (workshops, special issues), with this perspective article.</p>
<p>MHFI applications are often developed in the laboratory. Brands have recently focused on AR mobile applications to highlight the sensory aspects of their products (<xref ref-type="bibr" rid="B15">Jacobsen et&#x20;al., 2021</xref>). How can the area move research and development from just workshop demos to wider adoptability? Should we engage companies as collaborators, or encourage entrepreneurship among MHFI researchers? Should people work with relevant stakeholders (e.g., hospitals and schools) with an interest in putting research into practice? These questions deserve discussion. Notably, our position is that, in order to make MHFI research relevant in both basic and applied research, in theory development and practical implications, having relevant stakeholders involved will be critical, from consumers, through researchers, to firms and/or other applied contexts. What is more, as the area develops, it will be important to develop both qualitative reviews and meta-analyses that help shape the foundations of MHFI beyond our perspective.</p>
</sec>
</sec>
<sec sec-type="conclusion" id="s4">
<title>Conclusion</title>
<p>We presented here our perspective on the state of MHFI research. We started by placing it in the broader context of HCI and more particularly HFI, and then defining it. Building on the four ICMI workshops on MHFI, as well as one research topic in <italic>Frontiers</italic>, we identified five key themes of research in this area, namely, (1) data collection and analyses, (2) psychological mechanisms, (3) design studies, (4) augmentation and interfaces, and (5) applications&#x2014;commensality, education, entertainment, and/or health. These themes can constitute a compass for the interdisciplinary development of this area, from basic research to practice.</p>
<p>In addition to these themes, we described some key areas of research we believe will be crucial in the development of MHFI, which include: (1) designing experiences that enhance the eating experience, (2) interaction with others around food, (3) changing mindsets and attitudes, (4) interfaces and technologies, and (5) ethics.</p>
<p>We believe that research in MFHI should be approached in a way that connects basic and applied research, and which results, in the end, in applications, potentially co-developed with stakeholders in the applied&#x20;world.</p>
</sec>
</body>
<back>
<sec id="s5">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/<xref ref-type="sec" rid="s9">Supplementary Material</xref>, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>All the authors listed made a substantial, direct, and intellectual contribution to the work and approved it for publication.</p>
</sec>
<sec sec-type="COI-statement" id="s7">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s8">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec id="s9">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.frontiersin.org/articles/10.3389/fcomp.2021.694691/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fcomp.2021.694691/full#supplementary-material</ext-link>
</p>
<supplementary-material xlink:href="DataSheet1.docx" id="SM1" mimetype="application/docx" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Bertran</surname>
<given-names>F. A.</given-names>
</name>
<name>
<surname>Jhaveri</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Lutz</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Isbister</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Wilde</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Making Sense of Human-Food Interaction</article-title>. In <conf-name>Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems</conf-name>, <fpage>678</fpage>. <pub-id pub-id-type="doi">10.1145/3290605.3300908</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cadario</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Chandon</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Which Healthy Eating Nudges Work Best? A Meta-Analysis of Field Experiments</article-title>. <source>Marketing Sci.</source> <volume>39</volume> (<issue>3</issue>), <fpage>465</fpage>&#x2013;<lpage>486</lpage>. <pub-id pub-id-type="doi">10.1287/mksc.2018.1128</pub-id> </citation>
</ref>
<ref id="B3">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Ceccaldi</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Huisman</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Volpe</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Mancini</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Guess Who&#x27;s Coming to Dinner? Surveying Digital Commensality during Covid-19 Outbreak</article-title>. In <conf-name>Companion Publication of the 2020 International Conference on Multimodal Interaction</conf-name> (pp. <fpage>317</fpage>&#x2013;<lpage>321</lpage>). </citation>
</ref>
<ref id="B4">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Choi</surname>
<given-names>J.&#x20;H.-J.</given-names>
</name>
<name>
<surname>Foth</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hearn</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2014</year>). <source>Eat, cook, Grow: Mixing Human-Computer Interactions with Human-Food Interactions</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>MIT Press</publisher-name>. </citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Comber</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Choi</surname>
<given-names>J.&#x20;H.-j.</given-names>
</name>
<name>
<surname>Hoonhout</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>O&#x27;Hara</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Designing for Human-Food Interaction: An Introduction to the Special Issue on &#x27;food and Interaction Design&#x27;</article-title>. <source>Int. J.&#x20;Human-Computer Stud.</source> <volume>72</volume> (<issue>2</issue>), <fpage>181</fpage>&#x2013;<lpage>184</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijhcs.2013.09.001</pub-id> </citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cornelio</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Multisensory Integration as Per Technological Advances: A Review</article-title>. <source>Front. Neurosci.</source> <volume>15</volume>, <fpage>652611</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2021.652611</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Covaci</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Zou</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Tal</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Muntean</surname>
<given-names>G. M.</given-names>
</name>
<name>
<surname>Ghinea</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Is Multimedia Multisensorial?-A Review of Mulsemedia Systems</article-title>. <source>ACM Comput. Surv. (Csur)</source> <volume>51</volume> (<issue>5</issue>), <fpage>1</fpage>&#x2013;<lpage>35</lpage>. </citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Crofton</surname>
<given-names>E. C.</given-names>
</name>
<name>
<surname>Botinestean</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Fenelon</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gallagher</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Potential Applications for Virtual and Augmented Reality Technologies in Sensory Science</article-title>. <source>Innovative Food Sci. Emerging Tech.</source> <volume>56</volume>, <fpage>102178</fpage>. <pub-id pub-id-type="doi">10.1016/j.ifset.2019.102178</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>de Vries</surname>
<given-names>R. A.</given-names>
</name>
<name>
<surname>Keizers</surname>
<given-names>G. H.</given-names>
</name>
<name>
<surname>van Arum</surname>
<given-names>S. R.</given-names>
</name>
<name>
<surname>Haarman</surname>
<given-names>J.&#x20;A.</given-names>
</name>
<name>
<surname>Klaassen</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>van Delden</surname>
<given-names>R. W.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Multimodal Interactive Dining with the Sensory Interactive Table: Two Use Cases</article-title>. In <conf-name>Companion Publication of the 2020 International Conference on Multimodal Interaction</conf-name> (pp. <fpage>332</fpage>&#x2013;<lpage>340</lpage>). <pub-id pub-id-type="doi">10.1145/3395035.3425654</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Doets</surname>
<given-names>E. L.</given-names>
</name>
<name>
<surname>Kremer</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>The Silver Sensory Experience - A Review of Senior Consumers&#x27; Food Perception, Liking and Intake</article-title>. <source>Food Qual. Preference</source> <volume>48</volume>, <fpage>316</fpage>&#x2013;<lpage>332</lpage>. <pub-id pub-id-type="doi">10.1016/j.foodqual.2015.08.010</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="book">
<collab>FAO</collab> (<year>2018</year>). <source>The Future of Food and Agriculture &#x2013; Alternative Pathways to 2050</source>. <publisher-loc>Rome</publisher-loc>, <fpage>224</fpage>. <comment>Licence:CC BY-NC-SA 3.0 IGO</comment>. </citation>
</ref>
<ref id="B12">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Grimes</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Harper</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Celebratory Technology: New Directions for Food Research in HCI</article-title>. In <conf-name>Proceedings of the SIGCHI conference on human factors in computing systems, Florence, Italy, April 5 - 10, 2008</conf-name> (pp. <fpage>467</fpage>&#x2013;<lpage>476</lpage>). </citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hollands</surname>
<given-names>G. J.</given-names>
</name>
<name>
<surname>Bignardi</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Johnston</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kelly</surname>
<given-names>M. P.</given-names>
</name>
<name>
<surname>Ogilvie</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Petticrew</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). <article-title>The TIPPME Intervention Typology for Changing Environments to Change Behaviour</article-title>. <source>Nat. Hum. Behav.</source> <volume>1</volume> (<issue>8</issue>), <fpage>1</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1038/s41562-017-0140</pub-id> </citation>
</ref>
<ref id="B14">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Hornb&#xe6;k</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Oulasvirta</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>What Is Interaction</article-title>. In <conf-name>Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI &#x27;17), Denver, Colorado, USA, May 6 - 11, 2017</conf-name>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>ACM</publisher-name>, <fpage>5040</fpage>&#x2013;<lpage>5052</lpage>. <pub-id pub-id-type="doi">10.1145/3025453.3025765</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jacobsen</surname>
<given-names>L. F.</given-names>
</name>
<name>
<surname>Stancu</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>Q. J.</given-names>
</name>
<name>
<surname>Aschemann-Witzel</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>L&#xe4;hteenm&#xe4;ki</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Connecting Food Consumers to Organisations, Peers, and Technical Devices: The Potential of Interactive Communication Technology to Support Consumers&#x27; Value Creation</article-title>. <source>Trends Food Sci. Techn.</source> <volume>109</volume>, <fpage>622</fpage>&#x2013;<lpage>631</lpage>. <pub-id pub-id-type="doi">10.1016/j.tifs.2021.01.063</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Khot</surname>
<given-names>R. A.</given-names>
</name>
<name>
<surname>Mueller</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Young</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Human-food Interaction</article-title>. <source>FNT in Human-Computer Interaction</source> <volume>12</volume> (<issue>4</issue>), <fpage>238</fpage>&#x2013;<lpage>415</lpage>. <pub-id pub-id-type="doi">10.1561/1100000074</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Koizumi</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Tanaka</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Uema</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Inami</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Chewing Jockey: Augmented Food Texture by Using Sound Based on the Cross-Modal Effect</article-title>. In <conf-name>Proceedings of the 8th international conference on advances in computer entertainment technology, Lisbon, Portugal, November 8 - 11, 2011</conf-name> (pp. <fpage>1</fpage>&#x2013;<lpage>4</lpage>). </citation>
</ref>
<ref id="B18">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Lin</surname>
<given-names>Y. J.</given-names>
</name>
<name>
<surname>Punpongsanon</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Wen</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Iwai</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Sato</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>FoodFab: Creating Food Perception Illusions Using Food 3D Printing</article-title>. In <conf-name>Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA April 25 - 30, 2020</conf-name> (pp. <fpage>1</fpage>&#x2013;<lpage>13</lpage>). <pub-id pub-id-type="doi">10.1145/3313831.3376421</pub-id> </citation>
</ref>
<ref id="B19">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Narumi</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Nishizaka</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Kajinami</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Tanikawa</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Hirose</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>MetaCookie&#x2b;</article-title>. In <conf-name>2011 IEEE Virtual Reality Conference, Singapore, 19-23 March 2011</conf-name>. <publisher-name>IEEE</publisher-name>, <fpage>265</fpage>&#x2013;<lpage>266</lpage>. </citation>
</ref>
<ref id="B20">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Narumi</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2016</year>, <article-title>November). Multi-Sensorial Virtual Reality and Augmented Human Food Interaction</article-title>. In <conf-name>Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction, Tokyo, Japan, 16 November 2016</conf-name> (pp. <fpage>1</fpage>&#x2013;<lpage>6</lpage>). </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Niewiadomski</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Ceccaldi</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Huisman</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Volpe</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Mancini</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Computational Commensality: from Theories to Computational Models for Social Food Preparation and Consumption in HCI</article-title>. <source>Front. Robot. AI</source> <volume>6</volume>, <fpage>119</fpage>. <pub-id pub-id-type="doi">10.3389/frobt.2019.00119</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Nijholt</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Karunanayaka</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Huisman</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2016</year>, <article-title>October). 1st International Workshop on Multi-Sensorial Approaches to Human-Food Interaction (Workshop Summary)</article-title>. In <conf-name>Proceedings of the 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan, 16 November 2016</conf-name> (pp. <fpage>601</fpage>&#x2013;<lpage>603</lpage>). </citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gatti</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Maggioni</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Vi</surname>
<given-names>C. T.</given-names>
</name>
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Multisensory Experiences in HCI</article-title>. <source>IEEE MultiMedia</source> <volume>24</volume> (<issue>2</issue>), <fpage>9</fpage>&#x2013;<lpage>13</lpage>. <pub-id pub-id-type="doi">10.1109/mmul.2017.33</pub-id> </citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Tu</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Yao</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Space Food Experiences: Designing Passenger&#x27;s Eating Experiences for Future Space Travel Scenarios</article-title>. <source>Front. Comput. Sci.</source> <volume>1</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.3389/fcomp.2019.00003</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="other">
<person-group person-group-type="author">
<name>
<surname>Petit</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Javornik</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
</person-group> (2021). <article-title>We Eat First with Our (Digital) Eyes: Enhancing Simulation of Eating through Visual-Enabling Technologies</article-title>. <source>J.&#x20;Retailing</source>. Available at: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.sciencedirect.com/science/article/abs/pii/S0022435921000336">https://www.sciencedirect.com/science/article/abs/pii/S0022435921000336</ext-link> </citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Petit</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Digital Sensory Marketing: Integrating New Technologies into Multisensory Online Experience</article-title>. <source>J.&#x20;Interactive Marketing</source> <volume>45</volume>, <fpage>42</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1016/j.intmar.2018.07.004</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Prescott</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Multisensory Processes in Flavour Perception and Their Influence on Food Choice</article-title>. <source>Curr. Opin. Food Sci.</source> <volume>3</volume>, <fpage>47</fpage>&#x2013;<lpage>52</lpage>. <pub-id pub-id-type="doi">10.1016/j.cofs.2015.02.007</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Schifferstein</surname>
<given-names>H. N. J.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>The Roles of the Senses in Different Stages of Consumers&#x2019; Interactions with Food Products</article-title>,&#x201d; in <source>Multisensory Flavor Perception: From Fundamental Nueroscience through to the Marketplace</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Betina</surname>
<given-names>P. F.</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
</person-group> (<publisher-loc>Sawston</publisher-loc>: <publisher-name>Woodhead Publishing</publisher-name>). <pub-id pub-id-type="doi">10.1016/b978-0-08-100350-3.00015-8</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Eating with Our Ears: Assessing the Importance of the Sounds of Consumption on Our Perception and Enjoyment of Multisensory Flavour Experiences</article-title>. <source>Flavour</source> <volume>4</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1186/2044-7248-4-3</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2017</year>). <source>Gastrophysics: The New Science of Eating</source>. <publisher-loc>Penguin UK</publisher-loc>. </citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Mancini</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Huisman</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Digital Commensality: Eating and Drinking in the Company of Technology</article-title>. <source>Front. Psychol.</source> <volume>10</volume>, <fpage>2252</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2019.02252</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Ranasinghe</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Digitizing the Chemical Senses: Possibilities &#x26; Pitfalls</article-title>. <source>Int. J.&#x20;Human-Computer Stud.</source> <volume>107</volume>, <fpage>62</fpage>&#x2013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijhcs.2017.06.003</pub-id> </citation>
</ref>
<ref id="B33">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Toet</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Schaik</surname>
<given-names>M. G. V.</given-names>
</name>
<name>
<surname>Kaneko</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Erp</surname>
<given-names>J.&#x20;B. V.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Are Food Cinemagraphs More Yummy Than Stills</article-title>. In <conf-name>Proceedings of the 2nd ACM SIGCHI International Workshop on Multisensory Approaches to Human-Food Interaction, Glasgow UK, 13 November 2017</conf-name> (pp. <fpage>1</fpage>&#x2013;<lpage>4</lpage>). </citation>
</ref>
<ref id="B34">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Karunanayaka</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Nijholt</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Editorial: Multisensory Human-Food Interaction</article-title>. <source>Front. Psychol.</source> <volume>9</volume>, <fpage>796</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2018.00796</pub-id> </citation>
</ref>
<ref id="B35">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Nijholt</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Narumi</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Motoki</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Huisman</surname>
<given-names>G.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Multisensory Approaches to Human-Food Interaction</article-title>. In <conf-name>Proceedings of 22nd ACM International Conference on Multimodal Interaction (ICMI&#x2019;20), Virtual Event Netherlands October 25 - 29, 2020</conf-name>. <publisher-loc>Utrecht, the Netherlands, New York, NY, USA</publisher-loc>: <publisher-name>ACM</publisher-name>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.1145/3382507.3419749</pub-id> </citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Multisensory Experiences: A Primer</article-title>. <source>Front. Comput. Sci.</source> <volume>3</volume>, <fpage>614524</fpage>. <pub-id pub-id-type="doi">10.3389/fcomp.2021.614524</pub-id> </citation>
</ref>
<ref id="B37">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <source>Multisensory Experiences: Where the Senses Meet Technology</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>. </citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Velasco</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Petit</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Multisensory Technology for Flavor Augmentation: a Mini Review</article-title>. <source>Front. Psychol.</source> <volume>9</volume>, <fpage>26</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2018.00026</pub-id> </citation>
</ref>
<ref id="B39">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Vi</surname>
<given-names>C. T.</given-names>
</name>
<name>
<surname>Ablart</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Arthur</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Obrist</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Gustatory Interface: the Challenges of &#x2018;how&#x2019;to Stimulate the Sense of Taste</article-title>. In <conf-name>Proceedings of the 2nd ACM SIGCHI International Workshop on Multisensory Approaches to Human-Food Interaction, Glasgow UK, 13 November 2017</conf-name> (pp. <fpage>29</fpage>&#x2013;<lpage>33</lpage>). </citation>
</ref>
<ref id="B40">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Q. J.</given-names>
</name>
<name>
<surname>Mielby</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Junge</surname>
<given-names>J.&#x20;Y.</given-names>
</name>
<name>
<surname>Bertelsen</surname>
<given-names>A. S.</given-names>
</name>
<name>
<surname>Kidmose</surname>
<given-names>U.</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>The Role of Intrinsic and Extrinsic Sensory Factors in Sweetness Perception of Food and Beverages: A Review</article-title>. <source>Foods</source> <volume>8</volume>, <fpage>211</fpage>. <pub-id pub-id-type="doi">10.3390/foods8060211</pub-id> </citation>
</ref>
<ref id="B41">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zampini</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>The Role of Auditory Cues in Modulating the Perceived Crispness and Staleness of Potato Chips</article-title>. <source>J.&#x20;Sensory Stud.</source> <volume>19</volume>, <fpage>347</fpage>&#x2013;<lpage>363</lpage>. <pub-id pub-id-type="doi">10.1111/j.1745-459x.2004.080403.x</pub-id> </citation>
</ref>
<ref id="B42">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Zhao</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Spence</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Wan</surname>
<given-names>X.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Visual Search for Triangles in Wine Labels</article-title>. In <conf-name>Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction, Tokyo, Japan, 16 November 2016</conf-name> (pp. <fpage>1</fpage>&#x2013;<lpage>4</lpage>). <pub-id pub-id-type="doi">10.1145/3007577.3007582</pub-id> </citation>
</ref>
</ref-list>
</back>
</article>