In the last 20 years, the debate on the role of emotions in the field of industrial design has grown exponentially. Emotional Design emerged as the effort to promote positive emotions (Norman, 2007) or pleasure in users (Jordan, 2002; Green and Jordan, 2003) by means of design properties of products and services. According to Van Gorp and Adams (2012), design based on emotions can affect overall user experience deeply, since emotions influence decision making, affect attention, memory, and generate meaning. It is possible to identify two main approaches to applied emotional design. The first is based on the modification of object's aesthetic appearance or interface, the latter focuses on promoting fluent and engaging interactions.
Both these approaches pertain to technology design, which includes especially common-use technological products. Regarding the first approach, several studies showed the importance of emotional aspects as drivers of market success, enjoinment, and active usage of technologies. For instance, Desmet et al. (2007) demonstrated that users attributed a “wow effect” (i.e., the combination of fascination, pleasant surprise, and desire) to those cellphones having some pleasant features in their exteriors. Studies in multimedia learning (Um et al., 2012; Plass et al., 2013) showed that embedding emotional stimuli (e.g., face-like shapes, vibrant colors) into interfaces elicited positive emotions in learners and improved learning outcomes.
The second perspective considers fluid interactions as a fundamental factor for an overall positive experience of use (Hancock et al., 2005; Hassenzahl and Tractinsky, 2006). This approach includes design based on the concept of psychological flow, namely an optimal experience of total absorption in a task when agent's skills and environmental challenges are both at a high level and balanced (Csikzentmihalyi, 1988; Csikszentmihalyi, 2002). Research demonstrated that flow experience is quite common in technology usage (Pilke, 2004; Triberti et al., 2016), such as in video games (Cowley et al., 2008; Jin, 2012; Argenton et al., 2014) and personal computer-mediated activities (Voiskounsky and Smyslova, 2003; Skadberg and Kimmel, 2004). For this reason, flow-inspired design models have been created and applied to the design of interactive digital technologies such as educational games and augmented reality (Alexiou et al., 2012; Neal, 2012). Other approaches for promoting emotions by engagement are gamification or the inclusion of game mechanics in interfaces (such as, prizes, achievements…) and interactive storytelling, which frames interaction within emotional scenarios with compelling characters, events, and motives (Morford et al., 2014).
The objective of the present contribution is to extend the discourse on emotional design, highlighting that technology designers can rely on other components beyond the above-mentioned aesthetic and engagement ones, in order to create innovative and effective devices. Indeed, emotions have further aspects that could be exploited by emotional designers. For instance, emotions are also cognitive processes—based on appraisal component—with a notable influence on the overall quality of interaction. According to this perspective, new technologies can be considered and treated as opportunities to manipulate, enhance and trigger different discrete, and even complex emotional states. Finally, emotions can “participate” to interactions (instead of being a mere byproduct of it), by providing inputs to digital technologies to modify or influence final outputs.
This contribution explores opportunities provided by conceiving emotions as cognitive processes and active agents of interactions, in the field of emotional design.
Since Affective computing studies (Picard, 2003; Tao and Tan, 2005), designer have developed computers able to sense, recognize, and express emotions. New technologies combined with ubiquitous and wearable sensing become able to adapt to users' actual emotional states. For example, video games content changes (e.g., becoming more or less challenging) according to gamers' emotional state (e.g., bored or frustrated; Gilleade et al., 2005). Also mobile apps have been integrated with biofeedback sensors to promote positive emotions and relaxation (Serino et al., 2014). For instance, users can learn to monitor and control their emotional states by looking at virtual environments features (e.g., a burning fire) changing according to their psychophysiological activation. Affective Design (Reynolds and Picard, 2001) has shown that “emotional design” could be conceived not only as the inclusion of pleasant and/or engaging aspects in interfaces to augment pleasure, but also as the recognition and measurement of emotions to provide inputs to the technology and modify its functioning.
However, we argue that this approach, which is mainly based on general affect and moods, can be extended to discrete emotions, each characterized by a specific pattern of appraisal (i.e., emotion's cognitive profile). Studies on appraisal showed that an emotional episode emerges when one evaluates his/her own relationship with the surroundings (Roseman, 1991; Smith and Lazarus, 1993; Aue and Scherer, 2008; So et al., 2015). This automatic and subjective evaluation is based on specific properties of the stimulus such as relevance and congruence to personal goals or agency (oneself, others, or impersonal causes of the event), coping potential and control (Moors et al., 2013). The results of such evaluations bring about specific discrete emotions. Discrete emotional events are separable, distinguishable, and identifiable emotional state inducing changes into psychophysiology, behavior, motivation, judgment, and experience (Lench et al., 2011). Specifically, a discrete emotional event such as surprise, disgust, fear, would emerge after this first evaluation of the stimulus. After the appraisal component has been activated, a motivation to approach or avoid the stimulus follows (Moors et al., 2013). Furthermore, also changes in physiological parameters are involved, ranging from perspiration to muscle contraction. Finally, emotions are subjectively felt, since they can be described by the subject or can be quantified through numerical scales (Harmon-Jones et al., 2016), usually based on arousal (high/low intensity) and valence (positive/negative) aspects of the emotion at least (Mattek et al., 2017).
In our opinion, the scientific knowledge of discrete emotions based on their cognitive components—appraisal—can be easily translated into initial guidelines to develop a cognitive science-informed emotional design.
For instance, a field in which a partial discrete emotional approach was combined with affective is automotive technologies design (Ho and Spence, 2013). Nasoz et al. (2010) successfully tested a multi-modal intelligent car interface based on psychophysiological signals, able to classify driver's discrete emotional state as fear, boredom or anger that can be used to tune multisensory features of the car environment accordingly to help prevent accidents. In this case, technologies provide unprecedented opportunities to record even discrete users' emotional states (monitoring emotions), in order to tailor final outcomes. Future research in emotional design may explore how the continuous measurement of specific emotions can be exploited to influence ongoing interaction with common-use technology, for example modifying real-time easiness of use of devices or selecting digital content depending on the users' ongoing emotional responses.
A lot have been done, but we argue that still more can be done relying on an appraisal-based discrete emotion design approach. Indeed, appraisal theories of emotion have a lot to offer emotional design (Desmet, 2003; Bordegoni et al., 2014; Oatley and Johnson-Laird, 2014). Drawing on the scientific literature on discrete emotions as cognitive process, it is possible to expand the kinds of emotions that designers can reproduce and promote. Insofar emotions are considered as discrete events emerging from a specific pattern of appraisal themes (Smith and Lazarus, 1993), the more these themes are detailed, the higher the number of emotions and emotional nuances a designer can detect and control. For instance, sadness' core appraisal concerns an irrevocable loss (Smith and Ellsworth, 1985; Lazarus, 1991). If we detail this core appraisal, we can distinguish different kinds of sadness, such as melancholy, disappointment.
Such approach not only allows distinguishing different emotional nuances but it can also provide suggestions about reaching and promoting specific complex emotional states which include several single discrete emotional sub-components. Indeed, intervening on aesthetic appeal of interfaces allows designers to promote a general positive feeling in users, that is what has been done by most current approaches. However, the scientific literature can provide indications to elicit even specific complex emotions simply basing on their pattern of appraisal. For instance, one is the emotion of awe or the deep feeling of wonder, astonishment and fear people experience when facing stimuli perceived as incredible and incommensurable (Keltner and Haidt, 2003) (e.g., looking at vast panoramas; witnessing childbirth; etc.). Emotional appraisal leading to the experience of awe includes two distinctive elements, namely the feeling of vastness (perceptual or conceptual) and need for accommodation (i.e., the need for updating one's mental schemas to adapt them to the extraordinary). Recent research demonstrated that immersive technologies (e.g., Virtual Reality and 360° immersive videos) can be used to induce profound awe experiences in controlled environments, such as the lab (Gallagher et al., 2014; Chirico et al., 2016, 2017; Gaggioli et al., 2016). For instance, Chirico et al. (2017) were able to grasp subtle differences in the emergence of awe considering both self-reported and psychophysiological measures of this emotion. Awe resulted in a “freezing” response in front of something perceived vast and whose intensity can be enhanced by placing a user inside a 360° immersive virtual environment even with a low degree of interactivity. Appraisal dimensions of this emotion were analyzed in relation with the psychophysiological ones, thus providing a clearer picture of the emotional process.
In the emotional design, another important aspect concerns that emotions are closely intertwined over a continuous stream within subjects' experience. The sub-components of emotional episodes influence each other and subsequent emotional responses. For example, sad people are more likely to attribute agency of subsequent stimuli to others and the external world, because sadness is an emotion experienced toward events one cannot control (Han et al., 2007). Angry people are more likely to transfer anger to the next event to be evaluated in the surroundings (Beaudry et al., 2010; Darban and Polites, 2016).
In other words, emotions do not appear “out of nowhere” as the simple byproduct of a given stimulus and its appraisal. Instead, they are influenced by previous emotional states, or pre-existing individual traits, dispositions, and contextual factors (Verduyn and Brans, 2012; Kim et al., 2016). Therefore, a technology designer working with emotions should be able to identify and measure emotional profiles or pre-existing individual/contextual characteristics that can influence the effectiveness of emotion-based technological services. For example, smartphones can be designed to elicit reactions such as surprise (Desmet et al., 2007). Nevertheless, such emotional state is not lasting in time, rather it tends to disappear shortly after the first encounters with the stimulus, since surprise arises from unexpected and novel events (Horstmann, 2006). Emotional designer should be able to create technologies updating according to users' personal information, in order to renovate the emotion of surprise continuously. In other words, they should design technological products able to actively adapt their outcomes to users' everyday life in line with individuals' peculiarities. This would allow designers promoting lasting emotional benefits such as loyalty, satisfaction, and possibly happiness and well-being. Although such ability largely depends on the designer's ability, it is possible to empower one's capacity to analyze emotional profiles of users by employing User Centered Design research techniques (Abras et al., 2004; Garrett, 2010; Lowdermilk, 2013; Triberti and Liberati, 2014; Triberti and Barello, 2016), especially those involving the observation of users in the context of use (Viitanen, 2011) and those resuming typical users' needs and emotional benefits (Osterwalder and Pigneur, 2010; Miaskiewicz and Kozar, 2011). Collecting data on users' habits, intentions and context could help the designer to tailor technologies on their pre-existing emotional stream, within a user-centered design framework.
Finally, the advancement of common-use technology, combined with the knowledge available in cognitive science literature, could provide designers with extraordinary possibilities to fully exploit emotions' potential for user experience (see Figure 1 for resume). In our opinion, this new approach could be based on: (1) the assessment of discrete emotions in an ongoing interaction to provide on-line modifications of interfaces (affective computing/affective design); (2) relying on scientific literature on emotions as discrete cognitive processes, to promote even complex emotions, and (3) analyzing users' “emotional profiles” to tailor technologies on their pre-existing emotional traits, within a user-centered design framework.
Figure 1
A resume of the development guidelines for a “scientific” Emotional Design, based on the human centered design phases according to ISO 9241 (hatching stands for possible iteration). While the second guideline in the table regards appraisal-based generation of emotion, the first and the third constitute examples of emotions participating in design.
Statements
Author contributions
ST conceived the ideas presented in the article and wrote the first draft. AC assisted in drafting the manuscript and contributed with important intellectual content. GLR edited the manuscript from a design perspective and created the image. GR supervised the whole process and contributed with important intellectual content.
Acknowledgments
The authors want to thank professor Andrea Gaggioli for his important advices during the revision of the manuscript.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AbrasC.Maloney-KrichmarD.PreeceJ. (2004). User-centered design, in Encyclopedia of Human-Computer Interaction, ed BainbridgeW. (Thousand Oaks, CA: Sage), 1–14.
2
AlexiouA.SchippersM.OshriI. (2012). Positive psychology and digital games: the role of emotions and psychological flow in serious games development. Psychology3, 1243–1247. 10.4236/psych.2012.312A184
3
ArgentonL.TribertiS.SerinoS.MuzioM.RivaG. (2014). Serious games as positive technologies for individual and group flourishing, in Technologies of Inclusive Well-Being, eds BrooksA. L.BrahnamS.JainL. C. (New York, NY: Springer), 221–244.
4
AueT.SchererK. R. (2008). Appraisal-driven somatovisceral response patterning: effects of intrinsic pleasantness and goal conduciveness. Biol. Psychol.79, 158–164. 10.1016/j.biopsycho.2008.04.004
5
BeaudryA.PinsonneaultA.MolsonJ. (2010). The other side of acceptance: studying the direct and indirect effects of emotions on information technology use. MIS Q. 34, 689–710. 10.1287/mnsc.1100.1195
6
BordegoniM.CuginiU.FerriseF.GraziosiS. (2014). A method for bringing user experience upstream to design. Virtual Phys. Prototyp.9, 181–194. 10.1080/17452759.2014.934574
7
ChiricoA.CipressoP.YadenD. B.BiassoniF.RivaG.GaggioliA. (2017). Effectiveness of immersive videos in inducing awe: an experimental study. Sci. Rep.7:1218. 10.1038/s41598-017-01242-0
8
ChiricoA.YadenD. B.RivaG.GaggioliA. (2016). The potential of virtual reality for the investigation of awe. Front. Psychol. 7:1766. 10.3389/fpsyg.2016.01766
9
CowleyB.CharlesD.BlackM.HickeyR. (2008). Toward an understanding of flow in video games. Comput. Entertain. 6:1. 10.1145/1371216.1371223
10
CsikzentmihalyiM. (1988). The flow experience and its significance for human psychology, in Optimal Experience, eds CsikzentmihalyiM.CsikzentmihalyiI. S. (Cambridge, UK: Cambridge University Press), 15–35.
11
CsikszentmihalyiM. (2002). Flow: The Classic Work on How to Achieve Happiness. London: Rider Books.
12
DarbanM.PolitesG. L. (2016). Do emotions matter in technology training? Exploring their effects on individual perceptions and willingness to learn. Comput. Human Behav. 62, 644–657. 10.1016/j.chb.2016.04.028
13
DesmetP. (2003). A multilayered model of product emotions. Des. J. 6, 4–13. 10.2752/146069203789355480
14
DesmetP. M. A.PorcelijnR.van DijkM. B. (2007). Emotional design; application of a research-based design approach. Knowl. Technol. Policy20, 141–155. 10.1007/s12130-007-9018-4
15
GaggioliA.ChiricoA.TribertiS.RivaG. (2016). Transformative interactions: designing positive technologies to foster self-transcendence and meaning. Annu. Rev. Cyber Ther. Telemed.14, 169–175.
16
GallagherS.Reinerman-JonesL.SollinsB.JanzB. (2014). Using a simulated environment to investigate experiences reported during space travel. Theor. Issues Ergon. Sci. 15, 376–394. 10.1080/1463922X.2013.869370
17
GarrettJ. J. (2010). Elements of User Experience The: User-Centered Design for the Web and Beyond. London: Pearson Education.
18
GilleadeK. M.DixA.AllansonJ. (2005). Affective videogames and modes of affective gaming : assist me, challenge me, emote me, in DIGRA (Vancouver, BC), 16–20.
19
GreenW.JordanP. (2003). Pleasure with Products: Beyond Usability. London: Taylor and Francis.
20
HanS.LernerJ. S.KeltnerD. (2007). Feelings and consumer decision making: the appraisal-tendency framework. J. Consum. Psychol. 17, 158–168. 10.1016/S1057-7408(07)70023-2
21
HancockP. A.PepeA.MurphyL. L. (2005). Hedonomics: the power of positive and pleasurable ergonomics. Ergon. Design13, 8–14. 10.1177/106480460501300104
22
Harmon-JonesC.BastianB.Harmon-JonesE. (2016). The discrete emotions questionnaire: a new tool for measuring state self-reported emotions. PLoS ONE11:e0159915. 10.1371/journal.pone.0159915
23
HassenzahlM.TractinskyN. (2006). User experience - a research agenda. Behav. Inform. Technol. 25, 91–97. 10.1080/01449290500330331
24
HoC.SpenceC. (2013). Affective multisensory driver interface design. Int. J. Vehicle Noise Vibrat.9, 61–74. 10.1504/IJVNV.2013.053817
25
HorstmannG. (2006). Latency and duration of the action interruption in surprise. Cogn. Emot. 20, 242–273. 10.1080/02699930500262878
26
JinS.-A. A. (2012). Toward integrative models of flow: effects of performance, skill, challenge, playfulness, and presence on flow in video games. J. Broadcast. Electron. Media56, 169–186. 10.1080/08838151.2012.678516
27
JordanP. W. (2002). Designing Pleasurable Products—An Induction to the New Human Factors. London: Taylor and Francis.
28
KeltnerD.HaidtJ. (2003). Approaching awe, a moral, spiritual, and aesthetic emotion. Cogn. Emot. 17, 297–314. 10.1080/02699930302297
29
KimS.ParkG.LeeY.ChoiS. (2016). Customer emotions and their triggers in luxury retail: understanding the effects of customer emotions before and after entering a luxury shop. J. Bus. Res. 69, 5809–5818. 10.1016/j.jbusres.2016.04.178
30
LazarusR. S. (1991). Emotion and Adaptation. New York, NY: Oxford University Press.
31
LenchH. C.FloresS. A.BenchS. W. (2011). Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology: a meta-analysis of experimental emotion elicitations. Psychol. Bull.137, 834–855. 10.1037/a0024244
32
LowdermilkT. (2013). User-Centered Design: A Developer's Guide to Building User-Friendly Applications. Sebastopol, CA: O'Reilly.
33
MattekA. M.WolfordG.WhalenP. J. (2017). A mathematical model captures the structure of subjective affect. Perspect. Psychol. Sci.12, 508–526. 10.1177/1745691616685863
34
MiaskiewiczT.KozarK. A. (2011). Personas and user-centered design: how can personas benefit product design processes?Des. Stud. 32, 417–430. 10.1016/j.destud.2011.03.003
35
MoorsA.EllsworthP. C.SchererK. R.FrijdaN. H. (2013). Appraisal theories of emotion: state of the art and future development. Emot. Rev. 5, 119–124. 10.1177/1754073912468165
36
MorfordZ. H.WittsB. N.KillingsworthK. J.AlavosiusM. P. (2014). Gamification: the intersection between behavior analysis and game design technologies. Behav. Anal.37, 25–40. 10.1007/s40614-014-0006-1
37
NasozF.LisettiC. L.VasilakosA. V. (2010). Affectively intelligent and adaptive car interfaces. Inf. Sci.180, 3817–3836. 10.1016/j.ins.2010.06.034
38
NealM. (2012). Creating and maintaining psychological flow state in augmented reality applications, in EEE International Conference e-Learning, e-Business, Enterp. Inf. Syst. (Las Vegas: e-Government).
39
NormanD. A. (2007). Emotional Design: Why We Love (or Hate) Everyday Things. Available online at: https://books.google.com/books?id=QtWSu3zBtPoC&pgis=1 (Accessed December 22, 2015).
40
OatleyK.Johnson-LairdP. N. (2014). Cognitive approaches to emotions. Trends Cogn. Sci. 18, 134–140. 10.1016/j.tics.2013.12.004
41
OsterwalderA.PigneurY. (2010). Business Model Generation. New York: John Wiley & Sons.
42
PicardR. W. (2003). Affective computing: challenges. Int. J. Hum. Comput. Stud. 59, 55–64. 10.1016/S1071-5819(03)00052-1
43
PilkeE. M. (2004). Flow experiences in information technology use. Int. J. Hum. Comput. Stud. 61, 347–357. 10.1016/j.ijhcs.2004.01.004
44
PlassJ. L.HeidigS.HaywardE. O.HomerB. D.UmE. (2013). Emotional design in multimedia learning: effects of shape and color on affect and learning. Learn. Instrum.29, 128–140. 10.1016/j.learninstruc.2013.02.006
45
ReynoldsC.PicardR. W. (2001). Designing for affective interactions, in Proceedings from the 9th International Conference on Human-Computer Interaction (New Orleans, LA), 6.
46
RosemanI. J. (1991). Appraisal determinants of discrete emotions. Cogn. Emot. 5, 161–200. 10.1080/02699939108411034
47
SerinoS.CipressoP.GaggioliA.PallaviciniF.CipressoS.CampanaroD.et al. (2014). Smartphone for self-management of psychological stress: a preliminary evaluation of positive technology app. Rev. Psicopatol. Psicol. Clin. 19, 253–260. 10.5944/rppc.vol.19.num.3.2014.13906
48
SkadbergY. X.KimmelJ. R. (2004). Visitors' flow experience while browsing a Web site: its measurement, contributing factors and consequences. Comput. Hum. Behav. 20, 403–422. 10.1016/S0747-5632(03)00050-5
49
SmithC. A.EllsworthP. C. (1985). Patterns of cognitive appraisal in emotion. J. Personal. Soc. Psychol. 48, 813–838. 10.1037/0022-3514.48.4.813
50
SmithC. A.LazarusR. S. (1993). Appraisal components, core relational themes, and the emotions. Cogn. Emot. 7, 233–269. 10.1080/02699939308409189
51
SoJ.AcharC.HanD.AgrawalN.DuhachekA.MaheswaranD. (2015). The psychology of appraisal: specific emotions and decision-making. J. Consum. Psychol. 25, 359–371. 10.1016/j.jcps.2015.04.003
52
TaoJ.TanT. (2005). Affective computing: a review, in Affective Computing and Intelligent Interaction, eds TaoJ.TanT.PicardR. W. (Berlin; Heidelberg: Springer), 981–995.
53
TribertiS.BarelloS. (2016). The quest for engaging AmI: patient engagement and experience design tools to promote effective assisted living. J. Biomed. Inform. 63, 150–156. 10.1016/j.jbi.2016.08.010
54
TribertiS.LiberatiE. G. (2014). Patient centered virtual reality: an opportunity to improve the quality of patient's experience, in Virtual Reality: Technologies, Medical Applications and Challenges, eds CipressoP.SerinoS. (New York, NY: Nova Science), 3–30.
55
TribertiS.ChiricoA.RivaG. (2016). New technologies as opportunities for flow experience: a framework for the analysis, in Flow Experience: Empirical Research and Applications eds HarmatL.AndersenF. Ø.UllénF.WrightJ.SadloG. (New York, NY: Springer), 249–263.
56
UmE.PlassJ. L.HaywardE. O.HomerB. D. (2012). Emotional design in multimedia learning. J. Educ. Psychol. 104, 485–498. 10.1037/a0026609
57
Van GorpT.AdamsE. (2012). Design for Emotions. Waltham, MA: Elsevier.
58
VerduynP.BransK. (2012). The relationship between extraversion, neuroticism and aspects of trait affect. Pers. Individ. Dif. 52, 664–669. 10.1016/j.paid.2011.12.017
59
ViitanenJ. (2011). Contextual inquiry method for user-centred clinical IT system design. Stud. Health Technol. Inform.169, 965–969. 10.3233/978-1-60750-806-9-965
60
VoiskounskyA. E.SmyslovaO. V (2003). Flow in computer hacking : a model. Web Commun. Technol. Internet-related Soc.2713, 176–186. 10.1007/3-540-45036-X_18
Summary
Keywords
emotional design, user centered design, emotions, user experience, appraisal, complex emotions
Citation
Triberti S, Chirico A, La Rocca G and Riva G (2017) Developing Emotional Design: Emotions as Cognitive Processes and their Role in the Design of Interactive Technologies. Front. Psychol. 8:1773. doi: 10.3389/fpsyg.2017.01773
Received
04 July 2017
Accepted
25 September 2017
Published
09 October 2017
Volume
8 - 2017
Edited by
Amon Rapp, Università degli Studi di Torino, Italy
Reviewed by
Maria Denami, University of Strasbourg, France; Chris Baber, University of Birmingham, United Kingdom
Updates
Copyright
© 2017 Triberti, Chirico, La Rocca and Riva.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Stefano Triberti stefano.triberti@unicatt.it
This article was submitted to Cognitive Science, a section of the journal Frontiers in Psychology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.