Abstract
Humans can become aggressive during text messaging. To maintain a healthy interpersonal relationship through text messaging, our negative mental states, such as anger, have to be well-controlled. This paper discusses the use of a handheld social robot deployed as a mediator in text messaging between humans. The robot is equipped with a movable weight inside its body. By controlling the movement of the internal weight during the time when the robot speaks out messages received from a human sender, we hypothesize that the psychological state of a receiver who holds the robot can be affected (for example, he/she will listen to the messages more seriously). In a controlled study (n = 94), in which participants were manipulated to be frustrated by using a context scenario, we studied the effect of three dialogue scripts with/without weight shifts. Results showed that introducing weight shifts together with the robot speech suppressed on average 23% of the user’s anger. However, only 3.5% of the anger was suppressed when the weight shifts were not applied. Additionally, in cases where the robot showed empathy to the user in words with weight shifts, the user’s revenge urge was successfully reduced by 22%. There was almost no effect confirmed when the weight shifts were not applied. A similar effect was also found in avoidance motivation: 15% of the avoidance motivation was reduced if weight shifts were applied. The reductions in revenge and avoidance motivation are considered important factors for human forgiveness. Therefore, our findings provide experimental evidence that weight shifts can be an effective expression modality for mediator robots, from the perspective of not only suppressing the user’s anger but also by inducing forgiveness during messaging.
1 Introduction
Text messaging devices (such as mobile phones) brought huge benefits to interpersonal communication in the last three decades. The advent of these devices has made people’s remote communication become instant. Furthermore, compared with other classic devices based on typing, modern devices with voice recognition capabilities provide a more efficient message creation process to users (such as smart speakers). Also, social robots have been employed as text messaging devices. Research evidences show that social robots that serve as mediators between humans encourage remote communication of the users (; ; ). Moreover, such a mediator robot can influence the message content. For instance, reported that the depth of self-disclosure of the elderly to their remote family members was significantly affected by the behaviors of a mediator robot.
Studies on computer-mediated communication (CMC) revealed that the users’ hostile, aggressive, and uninhibited communicative behaviors, called flaming, were more frequently observed in text messaging than face-to-face and videoconferencing (e.g., ; ; ). To maintain healthy interpersonal relationships by reducing the user’s aggressive behaviors, a mediator robot should be designed so that it can suppress the user’s anger and other interpersonal motivations (e.g., revenge and avoidance motivations). The reduction in both revenge and avoidance motivations is considered the central concept for inducing human forgiveness (). However, from this viewpoint, the introduction of mediator robot has never been explored.
This study investigates the behavior of a mediator robot that is particularly effective for users receiving frustrating messages from other people. We assume a human-robot interaction (HRI) scenario in which a robot verbally gives its opinion to such users while expressing non-verbal signals (in this paper, we call these series of behaviors “robot intervention”) (Figure 1). As the non-verbal expression modality of robot intervention, we focused on a haptic-based interaction channel using internal weight movements (weight shifts). To this end, we introduce a handheld robot, called OMOY, equipped with a movable weight actuated by mechanical components inside its body. Through the weight shifts, the robot expresses its emotions and intentions to the user holding it (). Furthermore, using weight shifts to communicate may influence the users’ social judgments and decisions. Following psychology literature suggesting that the abstract concept of importance is grounded in bodily experiences of weight (), recognized importance of robot’s speech contents may be enhanced when the users feel heaviness in weight shifts.
FIGURE 1
In this paper, we report an HRI study involving 94 participants. By using a context scenario, the participants were manipulated to be frustrated by a message sent from another person. OMOY reported the message while providing its opinion to each participant on how to deal with their frustrations. One of the three opinions was presented to each participant: (1) OMOY suggested that the participant should suppress their anger, (2) OMOY showed empathy to the participant, and (3) OMOY avoided providing some particular comments (the robot tried to be a bystander). During the expression of its opinion, OMOY exhibited weight shifts to half the number of participants. Then, we questioned the participants and analyzed the obtained results to answer the following research questions:
• RQ1: How much can the user’s anger, revenge and avoidance motivations be suppressed by the mediator robot exhibiting weight shifts?
• RQ2: Does exhibiting weight shifts affect the user’s recognition about the seriousness of the robot? If so, does this feature relate with the results for RQ1?
• RQ3: How does the effect of weight shifts differ depending on the opinion type?
The remainder of this paper is organized as follows: Section 2 presents related works. Section 3 explains the robot platform used in this study. Section 4 describes the study method. Section 5 reports the study results. Section 6 provides general discussions and limitations of the study, and Section 7 presents our conclusion.
2 Related Works
2.1 Social Robot as a Mediator for Humans
In the context of CMC, researchers have explored a wide range of the social effects of communication between people using network-connected digital devices to exchange messages (e.g., text messaging, social network site interactions, videoconferencing) (). Among the CMC channels, text messaging has been majorly studied because of its unique features attributed to the limited non-verbal information for exchange and asynchronicity (; ). As important implications on the use of text messaging, researchers identified the users’ hostile, aggressive, and uninhibited communicative behaviors, called flaming, increased compared to those of face-to-face and videoconferencing (e.g., ; ; ). One explanation on the presence of these behaviors has been given based on deindividuation. discussed the phenomenon of the deindividuation in CMC as a situation where “social standards will be less important and communication will be more impersonal and more free because the rapid exchange of text, the lack of social feedback, and the absence of norms governing the social interaction redirect attention away from others and toward the message itself.” Such situations reduce users’ public self-awareness (), and more impulsive and assertive behavior not considering the recipients’ feelings can be promoted ().
To overcome this issue while ensuring the benefit of using text messaging, we consider an approach that involves an intelligent supportive agent, such as a dialogue robot for text messaging. By providing interventions from the robot, such as showing empathy to the users, the quality of messages can be influenced. As an example, from a case study conducted to encourage elderly self-disclosure to their remote family members by applying a social mediator robot, the property of its expressions (i.e., personality traits and quantity of social behaviors) significantly influenced the depth of the elderly self-disclosure (). The key finding of the study is that the information disclosed by users depends on the behaviors of the mediator robot locally interacting with them. Furthermore, recently, conceptualized artificial intelligence-mediated communication (AI-MC) as a modern extension of CMC and envisioned it as a possible future communication style for humans: defined as “interpersonal communication in which an intelligent agent operates on behalf of a communicator by modifying, augmenting, or generating messages to accomplish communication goals.” Some of our devices have been embedded with some agents to mediate our messaging (e.g., Gmail smart reply). Therefore, if more and more robots and AI agents mediate our communication, they can be applied as a new standard in the future.
2.2 Weight Shift as a Novel Expression Modality for Social Robot
Expression modalities of social robots have been widely explored in human-robot interaction (HRI). Many social robots have been designed to convey their internal states by speech dialogues and non-verbal signals. For example, facial expressions (), body movements (), sounds (), sweats (), colors (), vibrations (), and their combinations (; ) have been used as non-verbal expression modalities for social robots. Recently, dynamic haptic parameters, such as changes in skin temperature (; ; ), texture (), and SwarmHaptics () have been discussed in the literature. Interactions using these haptic modalities are particularly useful in complementing the expressiveness of robots designed with few anthropomorphic features and configurations. However, besides (), no study on robotics research has investigated the use of internal weight movements (weight shifts) in robot expression.
From the technical perspective of weight shifts, handheld devices with weight-shifting functions have been mainly studied in the field of virtual reality (VR). Since the relationship between the presented torque and the human perception of heaviness was found by , researchers have designed devices based on the principle. For example, TorqueBAR, Shifty, and Transcalibar are haptic feedback devices equipped with 1D or 2D translational weight-shifting mechanisms. Changing the distribution of the internal weight enhanced the users’ perception of virtual objects (; ; ). SWISH is a human-computer interface capable of simulating dynamic fluid behavior in VR or augmented reality (). It mimics the shifts of the center of gravity of a fluid vessel with a responsive motor actuation integrated with virtual fluid simulation. From other perspectives on weight shift use, haptic displays for mobile phones have been discussed. proposed Weight-Shifting Mobile, a mass-shift based system, for haptic actuation in mobile phones. They suggested that changing of the gravitational properties of the device provides beneficial applications, including augmenting digital content with physical mass, ambient displays, and haptically augmented wayfinding. Compared with previous works, studying weight shifts as an expression modality of social robots is novel. Additionally, we focus on the combining speech dialogues and discuss its effects on human perception, an unexplored area in both HRI and VR.
From the embodied perspective on cognition, the weight-based interaction channel of handheld devices can influence users’ judgements and decisions. suggested that the abstract concept of importance is grounded in bodily experiences. Some important results were obtained from the studies conducted: holding a heavy clipboard increased judgments on the monetary value and made participants consider fair decision-making procedures as more important. Similarly, explored how incidental heaviness sensation affects human decisions. As a result, heavy objects made job candidates appear more important: participants using heavy clipboards rated the candidate as displaying a more serious interest in the position. These findings suggest that, in principle, communicating through weight conveys the seriousness of the robot. Therefore, if an appropriate weight shift is expressed along with robot speech, the user may listen to the speech more seriously than the case no weight shift is expressed.
3 Robot Platform
The platform used in this study is OMOY, a handheld robot specifically developed to study weight shifts and speech dialogues. OMOY presents weight shifts by moving its internal weight. More specifically, a 250 g tungsten weight is attached to a weight carrier unit, allowing the weight to move along a 2D planar space, thus, the robot provides the weight shift perception to the user who holds the robot. For this study, we provide a little modification to this unit. A linear metal guide rail was applied to achieve smoother translational movements and a Dynamixel XC430-W150T servo motor (1.6 Nm at a 12 V with 1.4 A) was installed on the rotational mechanism to achieve more durability (Figure 2). Besides the weight shift expressions, OMOY has basic expression capabilities of hand/head gestures and speech dialogues, similar to other social robots. The dimensions of OMOY are approximately 240 mm (H) × 125/230 mm (arm closed/arm open) (W) × 95 mm (D) and it weights 725 g1. The appearance of the OMOY was designed to minimize the influence of prior knowledge of existing commercial robots, thus, it has a simple appearance and body shape. A full description of the mechanical design is found in ().
FIGURE 2
4 Methods
We investigated the effect of robot behaviors on the user’s negative affective states in a text messaging using weight shifts. Thus, we conducted an HRI study (n = 94) in which OMOY served as a remote communication interface between humans (Figure 3). Participants were provided a specific context scenario that got them frustrated due to a message from their friend (described in Section 4.1). The message was read out by OMOY using its voice-synthesizing function, thus, it did not contain any social cues linked to the message sender. Upon reporting the message, OMOY verbally gave its opinion randomly chosen from the three dialogue scripts: (1) the robot suggests that the participant should suppress his/her anger, (2) the robot shows its empathy to the participant, or (3) the robot avoids providing some particular comments. During the expression of its opinion, the robot exhibited weight shifts to half the numbers of participants (other robotic body movements, such as head/arm gestures were not presented). The study was between-participants design, and the measurement was conducted by questionnaires after each interaction.
FIGURE 3

The experiment was conducted at a booth constructed in a cafeteria in the University of Tsukuba. Each participant was asked to hold OMOY and tested one of its behaviors generated by speech and weight shifts. An experimenter took a seat in front of the participant.
4.1 Context Scenario
To control participants’ mental states to be frustrated in a messaging context, the following scenario and the accompanying message were given to each participant by a paper.
“You had an appointment with your ‘friend A’ to go to a movie. Today is a very hot and humid day in midsummer. You have come to meet A at the promised time, then decided to sit and wait for A in the shade under the scorching sunshine. However, A doesn’t appear and A is holding your tickets. You are already getting angry with A who does not even text you. About an hour passed after the promised meeting time, you received a message from A.”
The message reads: “I’m sorry, I am late. The appointment slipped my mind. Can you wait another hour?”
Context scenarios that make participants frustrated due to the tardiness of others is often used in psychological assessment (e.g.,
In the message sent by friend A, there was a statement explaining the reason for the tardiness. To identify what reasonable statement to be included, a preliminary survey was conducted. From the survey involving 17 participants, it was revealed that recipients felt strong anger when the sender explicitly informed them of forgetting the appointment. Thus, we included the phrase in the message.
4.2 Design of Robot Intervention
4.2.1 Verbal Expressions
The robot gave its opinion to each participant about how he/she should deal with the message. We designed three opinion types for this study based on the roles of a third party in a conflict. Third parties are known to act to support one side or not get involved in conflicts (
• Opinion type 1 (suppressing anger): OMOY sided with friend A. It pacified the participant to regulate his/her anger and wait for the friend, by speaking “It is not good to get angry at the person right away, so you should wait for him/her.”
• Opinion type 2 (showing empathy): OMOY sided with the participant. It affirmed the participant’s anger and showed an empathetic attitude to the participant, by speaking “Because you have already been waiting for an hour, it is natural for you to get angry. So you don’t have to wait any longer.”
• Opinion type 3 (no comment): OMOY did not take either side of friend A nor the participant. In this case, the robot clarifies its position as a bystander by speaking “I am not involved in this topic, so I don’t have any particular opinion.”
For creating the robot’s voice, a commercial voice synthesis software called VOICEROID+ was used.
4.2.2 Physical Expressions (Weight Shifts)
This study followed design recommendations by
By using the design recommendations (
4.3 Participants
Ninety-four participants (51 males; 43 females; age: 18–41, M = 21.6, SD = 3.19) were recruited at the University of Tsukuba. They were all Japanese speakers, and every experimental material (e.g., instructions, questionnaires, and speech dialogues of the robot) were provided in Japanese. An experimental booth was set up in a cafeteria of the university, and the recruitment was conducted for passers-by. Posters and banners were placed near the booth to guide interested people in our study. Each participant got a sticky note with a print picture of OMOY on the front cover as a souvenir. The total duration required for each participant was 10–15 min. The study protocol was approved by the research ethics committee of the Faculty of Engineering, Information, and Systems of the University of Tsukuba (2019R317-2), and all participants provided informed consent.
4.4 Measurements
4.4.1 Seriousness of the Robot
The weight shift pattern used in this study (explained in Section 4.2.2) makes the user feel strong intention of the robot. Additionally, since
4.4.2 Anger
To measure the anger state of participants, we used ten question items (e.g., I am irritated, I want to shout at somebody, etc.) included in the Japanese version (
To verify that the intervention by the robot influenced the user’s anger state, we measured the user’s anger state at two time points (before/after the intervention was provided)4. In this paper, we refer to these two anger states as pre-intervention anger (pre-anger) and post-intervention anger (post-anger), respectively. The pre-anger was measured by presenting the question items to participants and carefully instructing them to assess the mental states they held before the robot intervention (just after reading through the context scenario and hearing OMOY read out the A’s message part: “I’m sorry, I am late. The appointment slipped my mind. Can you wait another hour?”). For measuring the post-anger, we instructed them to assess the mental states they held after the robot intervention, i.e., after listening to all of OMOY’s speech contents including its opinion explained in Section 4.2.1.
4.4.3 Interpersonal Motivations
We hypothesized that forgiveness provided by the participants will differ depending on the robot’s behaviors.
Thus, we measured these motivations using a Japanese-translated version of the Transgression-Related Interpersonal Motivation scale (TRIM) developed by
As earlier noted, it is important to focus on reducing those interpersonal motivations when discussing human forgiveness. Therefore, we measured these quantities twice, both before and after the intervention. These pre/post interpersonal motivations were labeled pre-intervention revenge (pre-revenge), post-intervention revenge (post-revenge), pre-intervention avoidance (pre-avoidance), and post-intervention avoidance (post-avoidance). In measuring those motivations, we provided the same instructions as were used in measuring pre/post-anger.
4.5 Procedure
During the recruitment of participants, we placed a public notice about our study titled “An experiment of a dialogue handheld robot.” at the cafeteria where the experimental booth was set up. If a person approached the booth and showed interest in this study, we encouraged them to take a sit on a chair placed in the booth. The study was conducted under face-to-face conditions between an experimenter and each participant. First, the participant completed a survey on their age, gender, on a form displayed on the iPad. Next, we introduced OMOY to the participant as: “Here is a handheld communication robot, named OMOY. This robot is equipped with a movable weight inside the body. One of its purpose is to mediate human messaging. Today, you will experience an example in which the robot mediates a message.”
To provide a better understanding of how the interaction with OMOY is like (e.g., about the vocal features and weight shifts), each participant was asked to listen to the self-introduction by OMOY. We instructed them to hold OMOY from the back with their non-dominant hand (similar to holding a smartphone) and to not tilt it by more than 45° to prevent it from lying down. Additionally, from pilot studies, noise from the actuators was an important consideration. Thus, participants wore headphones with a noise cancelling function (SONY WH-1000XM4) to listen to the robot. In the self-introduction, OMOY said: “Nice to meet you. Thank you for your cooperation in the test today. My name is OMOY. I will help you with your daily messaging. I read out messages received from someone and can give you my opinions when you are about to make a reply. Additionally, I can do weight shifts like this way. Best regards.” At the underlined part, OMOY performed an weight shift pattern including translational and rotational weight movements that were completely different movement patterns used in the main study.
Subsequently, the experimenter showed the context scenario paper (described in Section 4.1) to each participant while asking them to imagine their “normal friend” as friend A in the context scenario. Because it was known that people easily provide forgiveness to their intimate persons (
4.6 Experimental Design and Statistic Analysis
Since the impressions of the robot’s intervention were expected to be different depending on the user’s affective state, we divided the participants into two groups based on high/low pre-anger using the mean value (with boundary value at 1.85). In the group of participants with low pre-anger, 52 participants were allocated, whereas 42 participants were in the group with higher pre-anger. The t-test ensured that the participants involved in the higher pre-anger group showed stronger pre-anger (M = 2.28, SD = 0.30) than the participants in the group with lower pre-anger (M = 1.50, SD = 0.21; t (70.7) = 14.3, p < 0.001, d = 0.26). To discuss the extent participants’ anger and interpersonal motivation changed before and after the robot intervention, we applied the rate of change (ROC) as dependent variables. Each value of ROC was given by the following equations:
We analyzed the effects of independent factors such as the participants’ pre-anger (high/low), opinion type, and the presence of weight shifts, on each dependent variable: seriousness recognition, post-anger, ROCAnger, ROCRevenge, and ROCAvoid, by performing a 2 × 3 × 2 ANOVA or ANCOVA. Suppose a significant regression coefficient of the gender factor of participants was found, we put this variable into the statistical model as covariance and performed an ANCOVA (otherwise, we used ANOVA).
5 Results
5.1 Seriousness of the Robot
We examined if participants recognized the serious intention of the robot which exhibited weight shifts. A gender difference was detected, thus we performed an ANCOVA. Results showed a significant main effect of weight shifts (F (1, 81) = 16.1, p < 0.001, ) indicating that participants agreed that the robot with weight shifts was more serious (M = 6.10, SD = 2.58) than the case with no weight shift (M = 4.58, SD = 2.62). Therefore, we see that the weight shift pattern used in this study was successfully designed. Also, there was a significant main effect of the opinion type (F (2, 81) = 17.7, p < 0.001, ). Then, we performed the Bonferroni test as a post hoc comparison. Results indicated that participants evaluated the robot with no comment (opinion type 3) as less serious, compared with the robots on the other two opinion types (p < 0.001).
5.2 Anger
First, we performed ANOVA on the post-anger variable to compare the intensity of anger that the participants held after the robot intervention. The results showed a significant interaction between the factors of the participants’ pre-anger and the presence of weight shifts (F (1, 82) = 9.87, p = 0.002, ). Also, post hoc comparisons using t-tests showed a significant difference in the presence of weight shifts for participants with high pre-anger. Their post-anger was significantly smaller if the robot with weight shifts was used (M = 1.77, SD = 0.37), compared with the cases where the robot did not exhibit any weight shift (M = 2.17, SD = 0.53; t (40) = 2.82, p = 0.007, d = 0.46) (Figure 4). However, no significant difference was found in the participant group with low pre-anger. Also, participants having high pre-anger reported significantly larger post-anger than the cases with having low pre-anger: with weight shifts (t (45) = 4.29, p < 0.001, d = 0.33); without weight shifts (t (30.2) = 7.22, p < 0.001, d = 0.41) (Figure 4).
FIGURE 4

Post-anger comparison (marginal means). In the high pre-anger participant group, participants’ post-anger was significantly smaller under the condition the robot exhibited weight shifts compared with the case it exhibited no weight shift (**p < 0.01, ***p < 0.001).
Next, we performed ANOVA on the dependent variable ROCAnger, to compare how participants’ anger level had changed over the robot intervention. The results showed a significant interaction between the factors of pre-anger and the presence of weight shifts (F (1, 82) = 18.5, p < 0.001, ). Post hoc comparisons using t-tests showed significant differences in the presence of weight shifts for both groups, but the opposite effects were observed (Figure 5). In the high pre-anger group, participants’ anger was more suppressed in the condition where the robot exhibited weight shifts (M = − 0.23, SD = 0.18) than the case it exhibited no weight shift (M = − 0.035, SD = 0.15; t (40) = 3.86, p < 0.001, d = 0.17). However, in the low pre-anger group, participants’ anger was more suppressed in the condition where the robot exhibited no weight shift (M = − 0.15, SD = 0.14) than the case it exhibited weight shifts (M = − 0.068, SD = 0.16; t (50) = 2.07, p = 0.043, d = 0.15). In cases applying weight shifts, while 23% of anger was suppressed in the high pre-anger group, only 6.8% was suppressed in the low pre-anger group. The difference was statistically significant (t (45) = 3.28, p = 0.002, d = 0.17). In cases no weight shift is applied, 3.5% of anger was suppressed in the high pre-anger group, and 15% of anger was suppressed in the low pre-anger group. The difference was also statistically significant (t (45) = 2.85, p = 0.007, d = 0.14). No significant effect on the opinion type of the robot was observed.
FIGURE 5

ROCAnger (rate of change of anger) comparison (marginal means). The ANOVA results showed a significant interaction between the factors of pre-anger and the presence of weight shifts. Post hoc comparisons using t-tests showed significant differences in the presence of weight shifts for both groups, but the opposite effects were observed.
5.3 Interpersonal Motivations
5.3.1 Revenge Motivation
ANOVA was performed on the dependent variable ROCRevenge. The results revealed a significant three-way interaction (F (2, 82) = 3.68, p = 0.030, ). Therefore, we performed a simple interaction test as a post-hoc comparison. An interaction was observed in both participant groups, between the presence of weight shifts and the opinion type: low pre-anger group (F (2, 46) = 3.06, p = 0.057, ); high pre-anger group (F (2, 36) = 4.71, p = 0.015, ).
In the high pre-anger group, participants’ revenge motivation was significantly reduced at opinion type 2 (showing empathy) with weight shifts (M = − 0.22, SD = 0.24), compared with the case without weight shifts (M = − 0.0057, SD = 0.16; t (14) = 2.21, p = 0.044, d = 0.20) (Figure 6). In addition, a significant difference was found (F (2, 16) = 4.49, p = 0.028, ) between two opinion types (2 and 3) when using weight shifts (p = 0.029 given by Bonferroni test) (Figure 6).
FIGURE 6

Marginal means of the rate of change (ROC) of revenge motivation in participants having high pre-anger.
In the low pre-anger group, participants’ revenge motivation was significantly reduced at opinion type 1 (suppressing anger) without weight shifts (M = − 0.19, SD = 0.21), compared with the case applying weight shifts (M = 0.11, SD = 0.33; t (18) = 2.36, p = 0.030, d = 0.28) (Figure 7). In addition, a significant difference was found (F (2, 21) = 5.07, p = 0.016, ) between two opinion types (1 and 3) without using weight shifts (p = 0.014 given by Bonferroni test) (Figure 7).
FIGURE 7

Marginal means of the rate of change (ROC) of revenge motivation in participants having low pre-anger.
5.3.2 Avoidance Motivation
ANOVA was performed on the dependent variable ROCAvoid. The results revealed a significant interaction between participants’ pre-anger and the presence of weight shifts (F (1, 82) = 5.34, p = 0.023, ). Post hoc comparisons using t-tests showed significant differences in the presence of weight shifts in both participant groups.
In the high pre-anger group, participants’ avoidance motivation was slightly suppressed when the robot exhibited weight shifts (M = − 0.15, SD = 0.19), compared with the case without weight shifts (M = − 0.058, SD = 0.15; t (40) = 1.68, p = 0.10, d = 0.17).
On the other hand, in the low pre-anger group, participants’ avoidance motivation was significantly suppressed when the robot did not exhibit weight shifts (M = − 0.14, SD = 0.23), compared with the case using weight shifts (M = − 0.0016, SD = 0.23; t (50) = 2.08, p = 0.043, d = 0.23) (Figure 8).
FIGURE 8

Marginal means of the rate of change (ROC) of avoidance motivation.
In addition, a significant difference was found between the high/low pre-anger groups when using weight shifts (t (45) = 3.28, p = 0.031, d = 0.22).
5.4 Regression Analysis
We examined whether the robot’s seriousness recognized by the participants affected their ROCAnger, ROCRevenge, and ROCAvoid by the regression analysis. In the high pre-anger group, a significant regression was found for each dependent variable (ROCAngerR2 = 0.12, F (1, 40) = 5.20, p = 0.028; ROCRevengeR2 = 0.12, F (1, 40) = 5.21, p = 0.028; ROCAvoidR2 = 0.26, F (1, 40) = 13.8, p = 0.001). Regression coefficients (ROCAngerβ = − 0.028, p = 0.028; ROCRevengeβ = − 0.028, p = 0.028; ROCAvoidβ = − 0.038, p = 0.001) show that the seriousness recognition was negatively correlated with the participants’ anger, revenge motivation, and avoidance motivation. However, in the low pre-anger group, no significant regression was found. The results suggest that the seriousness displayed by the robot had effects only on the participants having high pre-anger.
6 Discussions and Limitations
Exhibiting weight shifts during text messaging was particularly effective for participants having high pre-anger. Their anger was suppressed on average by 23%. Notably, the opinion type did not make a significant difference. Because anger is a very primitive emotion and aroused instinctively, verbal messages may have been insufficient to exert a major impact to suppress it. Rather, the haptic sensations produced by the internal weight movements, or the seriousness of the robot enhanced by such movements may have been dominant in suppressing their anger.
For revenge motivation, a complex interaction was observed that involves the opinion type. In cases where the robot showed empathy to the user in words (opinion type 2) with weight shifts, the user’s revenge urge was successfully reduced by 22%. However, we found that in some cases, weight shifts promoted the motivation for revenge, thus, care must be taken in such cases. For example, when the robot expressed its unbiased position (opinion type 3) to participants having high pre-anger, their revenge motivation to the message sender was promoted by weight shifts. Overall, the opinion type 3 brought different impacts on the suppression of the user’s revenge motivation compared to the other opinion types. However, this study did not provide strong evidence for explaining why such differences were observed. Future studies are needed to gain deep understanding about the effect brought by the opinion type 3.
For avoidance motivation, the effects of weight shifts were almost consistent with those for the anger state. On average, 15% of the avoidance motivation was reduced if weight shifts were applied in participants having high pre-anger. As
Additionally, our study results indicate that OMOY could express seriousness to the user through weight shifts. We attempt to discuss this phenomenon from the viewpoint of costly signaling theory, which has been discussed in evolutionary psychology. The theory proposes that costly signals generated by animals (including humans) may guarantee its honesty (
In this study, some differences were found between two participant groups (having high/low pre-anger). Generally speaking, to behave socially, we humans can intentionally suppress our anger to some extent. Neuroimaging studies revealed that our brain shows specific activation patterns when attempting to self-regulate our anger (
A number of studies have been reporting the calming effect of touch in human, animal, and robot interaction (
In haptic interactions between existing social robots and humans, haptic sensations occurred mostly on the user’s skin or organs close to the contact region (e.g., by temperature (
There are several limitations in our study. First, we used a simulated context scenario and the results may not hold when other scenarios are used. Second, all measurements were conducted within a relatively short time window. To supplement our findings, further empirical studies in real-world messaging are needed. Finally, the characteristics of the robot platform underline the results of this study. The results may vary under changes in parameters of the robot, such as appearance and its material. For future work, we are interested in applying the weight shift function into other handheld gadgets such as stuffed animals and cushions.
7 Conclusion
This study explored if a mediator robot having a weight shifting feature can affect the psychological state of the user. The robot’s body expression produced by weight shifts required no specific external components, such as arms or legs, implying that the internal weight movements potentially reduce the users’ anger, etc., without the use of rich body gestures or facial expressions. In conclusion, we suggest that weight shifting can be an effective expression modality for social mediator robots.
Statements
Data availability statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by the research ethics committee of the Faculty of Engineering, Information, and Systems of the University of Tsukuba. The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
Author contributions
YN, HK, and FT are the authors of this article. YN and FT conceptualized and designed the research, and wrote the paper. YN assembled the robot, performed the user study, and analyzed the data. HK assisted in designing the user study, data analysis, and writing about the findings. FT managed and supervised the research project.
Funding
This work was supported by Grant-in-Aid for JSPS Research Fellow Grant Number 20J10887 and Grant-in-Aid for Scientific Research on Innovative Areas Grant Number 20H05553.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Footnotes
1.^It gained 5 g from the original prototype reported in
2.^In case of the strongest stimulus, “stand and wait for A under the scorching sunshine,” and, in case of the weakest stimulus, “sit and wait for A in a coffee shop nearby” were used in
3.^A video showing the weight shift pattern used in this study is available from https://youtu.be/DTkVPoI5Sc0.
4.^As described in the last paragraph of Section 4.5, these were measured at once at the end of each experimental session. In measuring revenge motivation, we used three question items that had the highest factor loadings for revenge motivation in the TRIM developed by
References
1
AckermanJ. M.NoceraC. C.BarghJ. A. (2010). Incidental Haptic Sensations Influence Social Judgments and Decisions. Science328, 1712–1715. 10.1126/science.1189993
2
BlockA. E.KuchenbeckerK. J. “Emotionally Supporting Humans Through Robot Hugs,” in Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, Chicago IL USA, March 2018 (New York, NY, United States: ACM), 293–294. 10.1145/3173386.3176905
3
CastelláV. O.AbadA. M. Z.AlonsoF. P.SillaJ. M. P. (2000). The influence of familiarity among group members, group atmosphere and assertiveness on uninhibited behavior through three different communication media. Comput. Hum. Behav.16, 141–159. 10.1016/S0747-5632(00)00012-1
4
ChauxE. (2005). Role of Third Parties in Conflicts Among Colombian Children and Early Adolescents. Aggr. Behav.31, 40–55. 10.1002/ab.20031
5
DittrichW. H.LeaS. E. G. (1994). Visual Perception of Intentional Motion. Perception23, 253–268. 10.1068/p230253
6
EcksteinM.MamaevI.DitzenB.SailerU. (2020). Calming Effects of Touch in Human, Animal, and Robotic Interaction—Scientific State-of-the-Art and Technical Advances. Front. Psychiatry11, 555058. 10.3389/fpsyt.2020.555058
7
GevaN.UzefovskyF.Levy-TzedekS. (2020). Touching the social robot PARO reduces pain perception and salivary oxytocin levels. Sci. Rep.10, 9814. 10.1038/s41598-020-66982-y
8
GuoY.TanakaF. “Robot that Sweats to Remind the Elderly of High-temperature,” in Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, Cambridge United Kingdom, March 2020 (New York, NY, United States: ACM), 221–223. 10.1145/3371382.3378383
9
HancockJ. T.NaamanM.LevyK. (2020). AI-Mediated Communication: Definition, Research Agenda, and Ethical Considerations. J. Computer-Mediated Commun.25, 89–100. 10.1093/jcmc/zmz022
10
HashimotoT.KarasawaK. (2011). Victim and Observer Asymmetries in Their Reactions to an Apology: How Responsibility Attribution and Emotional Empathy Lead to Forgiveness. Jpn. J. Exp. Soc. Psychol.51, 104–117. 10.2130/jjesp.51.104
11
HemmertF.HamannS.LöweM.ZeipeltJ.JoostG. “Weight-Shifting Mobiles: Two-Dimensional Gravitational Displays in Mobile Phones,” in CHI 2010 Extended Abstracts on Human Factors in Computing Systems, Atlanta Georgia USA, April 2010 (New York, NY, United States: ACM), 3087–3092. 10.1145/1753846.1753922
12
HoogdalemA.SingerE.BekkemaN.SterckE. H. M. (2008). Young children who intervene in peer conflicts in multicultural child care centers. Behaviour145, 1653–1670.
13
HuY.HoffmanG. “Using Skin Texture Change to Design Emotion Expression in Social Robots,” in Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction (IEEE), Daegu, Korea (South), March 2019, 2–10. 10.1109/HRI.2019.8673012
14
HuismanG.Darriba FrederiksA.Van DijkB.HevlenD.KroseB. “The TaSSt: Tactile Sleeve for Social Touch,” in Proceedings of the 2013 IEEE World Haptics Conference (WHC) (IEEE), Daejeon, Korea (South), April 2013, 211–216. 10.1109/WHC.2013.6548410
15
JeeE.-S.CheongY.-J.KimC. H.KwonD.-S.KobayashiH. (2009). “Sound Production for the Emotional Expression of Socially Interactive Robots,” in Advances in Human-Robot Interaction. Editor KulyukinV. (London, UK: IntechOpen), 257–272. 10.5772/6838
16
JoinsonA. N. (2001). Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity. Eur. J. Soc. Psychol.31, 177–192. 10.1002/ejsp.36
17
JostmannN. B.LakensD.SchubertT. W. (2009). Weight as an Embodiment of Importance. Psychol. Sci.20, 1169–1174. 10.1111/j.1467-9280.2009.02426.x
18
KellingC.PitaroD.RantalaJ. “Good Vibes: The Impact of Haptic Patterns on Stress Levels,” in Proceedings of the 20th International Academic Mindtrek Conference, Tampere Finland, October 2016 (New York, NY, United States: ACM), 130–136. 10.1145/2994310.2994368
19
KieslerS.SiegelJ.McGuireT. W. (1984). Social Psychological Aspects of Computer-Mediated Communication. Am. Psychol.39, 1123–1134. 10.1037/0003-066X.39.10.1123
20
KieslerS.ZubrowD.MosesA. M.GellerV. (1985). Affect in Computer-Meditated Communication: An Experiment in Synchronous Terminal-to-Terminal Discussion. Human-Computer Interaction1, 77–104. 10.1207/s15327051hci0101_3
21
KikuchiF.SatoT.AbeT.NiheiY. (2008). Effects of anger emotion, credibility, and the severity on forgiveness. Japan. J. Res. Emotions15, 115–123. (in Japanese). 10.4092/jsre.15.115
22
KimL. H.FollmerS. “SwarmHaptics: Haptic Display with Swarm Robots,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow Scotland UK, May 2019 (New York, NY, United States: ACM), 688. 10.1145/3290605.3300918
23
KobayashiT.KatsuragiK.MiyazakiT.AraiK. “Social Media Intermediation Robot for Elderly People Using External Cloud-Based Services,” in Proceedings of the 5th IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (IEEE), San Francisco, CA, USA, April 2017, 31–38. 10.1109/MobileCloud.2017.18
24
LeaM.O’SheaT.FungP.SpearsR. (1992). “‘Flaming’ in computer-mediated communication: Observations, explanations, implications. Editor LeaM. (London: Harvester-Wheatsheaf), 89–112.
25
LöfflerD.SchmidtN.TscharnR. “Multimodal Expression of Artificial Emotion in Social Robots Using Color, Motion and Sound,” in Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction, Chicago, IL, March 2018 (New York, NY, United States: ACM), 334–343. 10.1145/3171221.3171261
26
MathesonK.ZannaM. P. (1988). The Impact of Computer-Mediated Communication on Self-Awareness. Comput. Hum. Behav.4, 221–233. 10.1016/0747-5632(88)90015-5
27
McAndrewF. T. (2018). “Costly Signaling Theory,” in Encyclopedia of Evolutionary Psychological Science. Editors ShackelfordT. K.Weekes-ShackelfordV. A. (Berlin/Heidelberg, Germany: Springer), 1–8. 10.1007/978-3-319-16999-6_3483-1
28
McCulloughM. E.RachalK. C.SandageS. J.WorthingtonE. L.Jr.BrownS. W.HightT. L. (1998). Interpersonal Forgiving in Close Relationships: II. Theoretical Elaboration and Measurement. J. Personal. Soc. Psychol.75, 1586–1603. 10.1037/0022-3514.75.6.1586
29
MehrabianA. (1996). Pleasure-Arousal-Dominance: A General Framework for Describing and Measuring Individual Differences in Temperament. Curr. Psychol.14, 261–292. 10.1007/BF02686918
30
NakataT.SatoT.MoriT. (1998). “Expression of Emotion and Intention by Robot Body Movement,” in Intelligent Autonomous System IAS-5. Editors KakazuY.WadaM.SatoT. (Amsterdam, Netherlands: IOS Press), 352–359.
31
NieJ.PakM.MarinA. L.SundarS. S. “Can You Hold My Hand?: Physical Warmth in Human-Robot Interaction,” in Proceedings of the 7th ACM/IEEE International Conference on Human-Robot Interaction, Boston Massachusetts USA, March 2012 (New York, NY, United States: ACM), 201–202. 10.1145/2157689.2157755
32
NoguchiY.KamideH.TanakaF. (2020). Personality Traits for a Social Mediator Robot Encouraging Elderly Self-Disclosure on Loss Experiences. ACM Trans. Human-Robot Interact.9, 1–24. 10.1145/3377342
33
NoguchiY.TanakaF. “OMOY: A Handheld Robotic Gadget that Shifts its Weight to Express Emotions and Intentions,” in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu HI USA, April 2020 (New York, NY, United States: ACM), 646. 10.1145/3313831.3376775
34
OhtsuboY.WatanabeE. (2009). Do sincere apologies need to be costly? Test of a costly signaling model of apology. Evol. Hum. Behav.30, 114–123. 10.1016/j.evolhumbehav.2008.09.004
35
PeñaD.TanakaF. (2020). Human Perception of Social Robot's Emotional States via Facial and Thermal Expressions. ACM Trans. Human-Robot Interact.9, 1–19. 10.1145/3388469
36
PietriniP.GuazzelliM.BassoG.JaffeK.GrafmanJ. (2000). Neural Correlates of Imaginal Aggressive Behavior Assessed by Positron Emission Tomography in Healthy Subjects. Amer. J. Psychiat.157, 1772–1781. 10.1176/appi.ajp.157.11.1772
37
RosenzweigS. (1978). The Rosenzweig Picture Frustration (P-F) Study: Basic Manual. St. Louis: Rana House.
38
SaghebS.LiuF. W.BahremandA.KidaneA.LiKamWaR. “SWISH: A Shifting-Weight Interface of Simulated Hydrodynamics for Haptic Perception of Virtual Fluid Vessels,” in Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, New Orleans LA USA, October 2019 (New York, NY, United States: ACM), 751–761. 10.1145/3332165.3347870
39
SasamaR.YamaguchiT.YamadaK. (2011). “An Experiment for Motivating Elderly People with Robot Guided Interaction,” in Universal Access in Human-Computer Interaction. Users Diversity. UAHCI 2011. Lecture Notes in Computer Science. Editor StephanidisC. (Berlin/Heidelberg, Germany: Springer), Vol. 6766, 214–223. 10.1007/978-3-642-21663-3_23
40
ShigeyamaJ.HashimotoT.YoshidaS.NarumiT.TanikawaT.HiroseM. “Transcalibur: A Weight Shifting Virtual Reality Controller or 2D Shape Rendering Based on Computational Perception Model,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow Scotland UK, May 2019 (New York, NY, United States: ACM), 11. 10.1145/3290605.3300241
41
SongS.YamadaS. “Expressing Emotions through Color, Sound, and Vibration with an Appearance-Constrained Social Robot,” in Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction, Vienna Austria, March 2017 (New York, NY, United States: ACM), 2–11. 10.1145/2909824.3020239
42
SpielbergerC. D. (1988). Manual for the State-Trait Anger Expression Inventory (STAXI). Odessa, FL: Psychological Assessment Resources, Inc. Odessa, FL: STAXI.
43
SuzukiT.HarukiY. (1994). The Relationship between Anger and Circulatory Disease. Jpn. J. Health Psychol.7, 1–13. (in Japanese). 10.11560/jahp.7.1_1
44
SwindellsC.UndenA.SangT. “TorqueBAR: An Ungrounded Haptic Feedback Device,” in Proceedings of the 5th International Conference on Multimodal Interfaces, Vancouver British Columbia Canada, November 2003 (New York, NY, United States: ACM), 52–59. 10.1145/958432.958445
45
TeradaK.YamauchiA.ItoA. “Artificial Emotion Expression for a Robot by Dynamic Color Change,” in Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication (IEEE), Paris, France, September 2012, 314–321. 10.1109/ROMAN.2012.6343772
46
ThurlowC.LengelL.TomicA. (2004). Computer Mediated Communication: Social Interaction and the Internet. Thousand Oaks, California, United States: Sage.
47
TodoT. “SEER: Simulative Emotional Expression Robot,” in Proceedings of the ACM SIGGRAPH Emerging Technologies, British Columbia, Vancouver, Canada, August 2018 (New York, NY, United States: ACM), 15. 10.1145/3214907.3214921
48
WaltherJ. B. (1996). Computer-Mediated Communication: Impersonal, Interpersonal, and Hyperpersonal Interaction. Commun. Res.23, 3–43. 10.1177/009365096023001001
49
WoodruffB.HelsonH. (1965). Torque: A New Dimension in Tactile-Kinesthetic Sensitivity. Am. J. Psychol.78, 271–277. 10.2307/1420500
50
ZennerA.KrugerA. (2017). Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Trans. Vis. Comput. Graphics23, 1285–1294. 10.1109/TVCG.2017.2656978
Summary
Keywords
social mediator robot, weight shift, handheld device, text messaging, anger suppression, inducing forgiveness, seriousness
Citation
Noguchi Y, Kamide H and Tanaka F (2022) Weight Shift Movements of a Social Mediator Robot Make It Being Recognized as Serious and Suppress Anger, Revenge and Avoidance Motivation of the User. Front. Robot. AI 9:790209. doi: 10.3389/frobt.2022.790209
Received
06 October 2021
Accepted
27 January 2022
Published
28 February 2022
Volume
9 - 2022
Edited by
Adriana Tapus, École Nationale Supérieure de Techniques Avancées, France
Reviewed by
François Ferland, Université de Sherbrooke, Canada
Takanori Komatsu, Meiji University, Japan
Updates

Check for updates
Copyright
© 2022 Noguchi, Kamide and Tanaka.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Fumihide Tanaka, fumihide.tanaka@gmail.com
This article was submitted to Human-Robot Interaction, a section of the journal Frontiers in Robotics and AI
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.