Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 18 November 2024
Sec. Aging and Public Health

Perceptions and experiences of Korean American older adults with companion robots through long-term use: a comparative analysis of robot retention vs. return

Othelia EunKyoung LeeOthelia EunKyoung Lee1Ji-Chan YunJi-Chan Yun2Do-Hyung Park
Do-Hyung Park2*
  • 1School of Social Work, University of North Carolina Charlotte, Charlotte, NC, United States
  • 2Graduate School of Business IT, Kookmin University, Seoul, Republic of Korea

To date, limited research has been conducted on technology use among socially marginalized groups, such as older immigrants who may have limited digital literacy. This pilot study aims to explore Korean American older adults’ perceptions and experiences with a companion version of the social robot, Hyodol. We hypothesize that the Hyodol robot’s social presence may facilitate technology use among this sample. To test this hypothesis, we invited 35 Korean American older adults to interact with Hyodol SAR over a four-month period. This extended engagement allowed us to investigate the underlying factors and dimensions shaping users’ perceptions and experiences. We assessed perceptions through measures of robotic attitudes and usability, while user experiences were evaluated using overall assessment questions and behavioral indicators, such as instances where participants showed the robot to others. We conducted a comparative analysis between participants who chose to keep the robot (“Keepers”) and those who opted to return it (“Returners”), providing insights into how each group utilized and interpreted the robots. Additionally, we examined the reasons Returners decided to not to retain the robot, aiming to identify barriers to acceptance and engagement. Our results indicated that participants’ experiences of warmth and competence while interacting with the Hyodol robots did not significantly differ between the Keepers and Returners. However, distinct patterns emerged in their utilization and interpretation of the robot; the 24 Keepers demonstrated a more intimate level of engagement compared to the 11 Returners. In an era characterized by the growing integration of AI in human care, our findings suggest that social presence became valuable concepts for developing robot companions to enhance their effectiveness.

1 Introduction

Social isolation refers to the objective condition of having limited social interactions or minimal contact with others (1). This measurable state occurs when individuals have few or no regular social connections, which can result in reduced social support and engagement (2, 3). In contrast, loneliness in older adults is defined as the subjective experience of emotional disconnection or the absence of meaningful social relationships, independent of the actual frequency of social contact (4). It represents an individual’s perception of being alone, even when in the presence of others (5, 6). Both loneliness, as an emotional response, and social isolation, as a situational or structural condition, have significant implications for the health and well-being of older immigrants.

Effective use of technology has been suggested as strategies to mitigate loneliness and social isolation among community dwelling older adults (7, 8). When adopting a novel technology users weigh the perceived benefits and ease of use against any potential drawbacks or difficulties (9). Older users are more likely to adopt technology when they perceive it as useful and easy to use, leading to a positive attitude and a higher intention to use, ultimately resulting in the technology’s actual use (10, 11). Considering the differential degree of technology acceptance, more research is needed to investigate underlying factors to motivate or discourage technology acceptance among older adults.

In recent years, research has increasingly focused on the impact of socially assistive robots (SARs) on older adults. Many studies have found that users perceive these robots, regardless of type and primary function, as more beneficial when they perform multiple tasks, such as assisting with daily activities, providing medication reminders, supporting cognitive functions, and encouraging engagement in various activities (12, 48). Features such as conversational interaction and reciprocal affection, particularly in companion robots were highlighted as desirable by users (13, 14). Additionally, smaller-sized robots were preferred, as they were perceived to be easier to work with and better suited to integrate into users’ daily routines (15).

The evaluation of the actual usage and usability of novel technologies such as SARs should be based on the experiences of users who have adapted to them over the long term. Further research is needed to evaluate users’ perceptions of usefulness and satisfaction with these robots over time, as their needs evolve with aging and changes in physical and cognitive abilities. Such insights will be crucial for developing effective robots that support aging-in-place. To date, limited study has been conducted to examine technology acceptance among socially invisible groups such as older immigrants who may have possess limited digital literacy (16).

Most Korean American older adults experienced the Korean War during childhood and undertook transcontinental immigration in adulthood (17). Due to their relatively recent immigration, they are uniquely affected by migratory grief, acculturation stress, race-based discrimination, and limited English proficiency (18). Generational and cultural differences in values, expectations, and language can cause tensions between Korean American older adults and their American-born children or grandchildren, further exacerbating emotional strain and poor quality of life (19). Some may confront financial hardships, which in turn can constrain their ability to partake in social engagements or access resources capable of mitigating their isolation (20).

Moreover, within immigrant communities, there is often a prevailing stigma linked to acknowledging feelings of loneliness or seeking assistance for mental health concerns outside of family (2). In many situations culturally relevant services are not within their reach geographically. Therefore, the confluence of language barriers, health challenges, stigma, digital illiteracy, and a dearth of culturally responsive services can contribute to social isolation, loneliness, depression, and healthcare disparities among Korean American older adults (5). During the peak of the COVID-19 pandemic, Perry et al. (21) undertook a study to assess the healthcare needs of a diverse urban older population. Results indicated that just over a quarter of this demographic experienced unmet healthcare needs. Notably, Asian Americans stood out, reporting the highest rate at 36% for unaddressed healthcare needs.

Hyodol robots, designed to cater to the needs of older adults, has been distributed to over 10,000 low-income older adults living alone in various counties across South Korea (22). Studies conducted in Korea have demonstrated a significant reduction in depressive symptoms among solo-living, low-income older adults who interact with companion version of SAR named Hyodol (23). Furthermore, Lee et al. (24) demonstrated a high level of adoptability for robots among those with limited education residing in rural areas during the COVID-19 pandemic. Based on these previous studies in South Korea we questioned whether Hyodol robot may also have potential as an assistive resource for older Korean American immigrants. Empirical validation of this social companion robot may demonstrate its potential as an effective solution for socially isolated older immigrants.

1.1 Social presence theory

This study was guided by Social Presence Theory, a framework used to understand the ways in which people perceive and interact with other entities in a mediated environment, such as robots (25). Social presence refers to the degree to which a person feels or perceives the presence of robots as if it were a real, socially meaningful being. It is essentially the sense of “being there” with another entity in a communication or interaction setting (26). In human-robot interactions, social presence theory suggests that the degree to which a robot is perceived as “socially present” can influence how users interact with it (10). Users experience varying degrees of social presence in different types of mediated interactions, depending on how much they feel as though they are interacting with another human being.

This perception can be influenced by a range of factors, including the robot’s appearance, behavior, and communication style. For example, a robot that is designed to look and act like a human may be perceived as more socially present than a robot that looks like a machine, because they trigger anthropomorphic responses in humans (27). Robots that exhibit human-like gestures, facial expressions, speech, and body language are more likely to be perceived as socially present.

The individual’s own disposition, attitudes, and expectations play a crucial role in perceiving social presence (28). Some people may be more willing to accept robots as social beings, while others may resist such perceptions. We hypothesized that high social presence could lead to increased trust in robots, making users more willing to cooperate and engage with them in various tasks. When robots exhibit social presence, users may emotionally engage with them, which can be beneficial in applications such as therapy or education. People may be more likely to follow instructions or guidance from robots perceived as socially present. However, high social presence can lead to ethical dilemmas, as users may attribute intentions and emotions to robots that they do not actually possess (7).

Additionally, culture profoundly influences technology use among Asian American older adults, affecting everything from adoption rates and usage patterns to preferences and trust levels (29). Hence, understanding these cultural factors is crucial for designing and implementing technologies that meet the unique needs of diverse populations. To illustrate, their values on family and community may lead to a preference for technologies that facilitate communication and emotional support. To enhance the adoption of technology, it is essential to provide interfaces and support in users’ native languages.

1.2 The present study

Korean American older adults invited to interact with Hyodol robots for the duration of 4 months. In our pilot study, we utilized a one-group pre- and post-test design to evaluate changes between baseline and follow-up. Post-test results indicated improvements in medication adherence and reductions in depressive symptoms (24). The current study aims to further explore users’ perceptions and experiences with the companion version of the SAR as a complementary assistive resource, focusing on how users perceive the robot across various dimensions during long-term use. These perceptions shape users’ interactions with the robot, leading to accumulated experiences that ultimately influence their decision to either continue using the robot or return it. We hypothesize that there will be notable differences in the experiences of those who choose to keep Hyodol compared to those who decide to return it, and this study seeks to investigate these differences. The following research questions were investigated in this study:

1. What are the underlying factors and dimensions that can explain users’ perceptions of the robot after long-term use?

2. What are the differences in experiential evaluations between users who adopted the robot and those who returned it after long-term use?

2 Methods

2.1 Participants

The study recruited Korean American immigrant older adults living in a metropolitan area within the northeastern United States. These individuals were recruited from a large community center primarily serving low-income Asian American older adults. To be eligible for participation, individuals had to be Korean immigrants aged 65 or older who could engage in verbal conversations in Korean. Preference was given to individuals who were low-income, living alone, and did not possess a pet. Each participant granted written informed consent, outlining the safeguarding of their health and privacy information. The research protocol was approved by the Institutional Review Board at the participating university (UNC Charlotte IRB-22-1137).

2.2 Companion robot intervention

Hyodol SAR features a soft and lightweight doll-shaped body, measuring 15 inches in height and 8 inches in width, making them easily manageable for older users at home (see Figure 1). Equipped with embedded sensors and artificial intelligence capabilities, Hyodol is tailored to establish meaningful interactions with its users. Hyodol SAR communicates in Korean, allowing Korean American users to engage in their native language. The primary objective of these SARs is to provide valuable assistance to older adults in various aspects of their daily lives, including tasks such as reminding them of wake-up and mealtimes, ensuring medication adherence, and encouraging regular exercise.1 Additionally, Hyodol offers cognitive stimulation through engaging brain-stimulating games (e. g., calculation, word puzzles, and quizzes). Hyodol is equipped with an extensive repertoire of over 10,000 pre-recorded speech lines, allowing it to fulfill a wide range of functions, including conveying vital health information, playing soothing melodies, sharing inspirational quotes, and narrating stories. Reflecting users’ religious affiliation Hyodol was programed to play the Bible or Buddhist scripture 30 min prior to the preset bedtime of the user. The robot doll, whether dressed in a boy’s or a girl’s costume, utilizes the same voice and programming. While the research team made efforts to accommodate gender preferences, the allocation of robot dolls ultimately occurred randomly due to availability constraints.

Figure 1
www.frontiersin.org

Figure 1. The robot used in this study, Hyodol. Reprinted with permission from Hyodol, © Hyodol.

2.3 Study design

This single-group pre- and post-test study unfolded as a three-phase process, commencing with an in-home baseline assessment and Hyodol SAR introduction spanning 90–120 min. During this initial home visit, our team elucidated the study’s objectives, secured informed consent, and guided older adults in acquainting themselves with the diverse functions of Hyodol. After comprehensive demonstrations and addressing queries, we positioned the robotic companion at each participant’s preferred location in their homes. Additionally, a large wall-mounted poster adorned with pictorial depictions of Hyodol’s functions was supplied (see Figure 1). Secondly, throughout the four-month Hyodol deployment phase, two dedicated research team members remained readily accessible to provide technical support and troubleshoot any potential malfunctions. Participants were encouraged to engage with Hyodol in a manner that they deemed acceptable and beneficial to their daily lives. In the third phase, all participants partook in qualitative interviews at the posttest, offering insights into their experiences with Hyodol and their evaluations of its potential advantages or limitations in enhancing their daily routines.

Initially, Hyodol robots were distributed to 41 older adults free of charge. However, six participants returned their robots to the research team within a week. At the end of the four-month study period, the remaining 35 participants were given the option to either keep the robot for free or return it to the research team. Of the participants, 24 chose to retain the robot (referred to as the “Keepers”), while 11 opted to return it (the “Returners”). We then conducted a comparative analysis between the Keepers and Returners to further explore the characteristics that differentiate users’ experiences with the robot.

2.4 Measures

While most previous studies focused on users’ first impressions of robots (8, 30, 31) (Gasteiger et al., 2017), we measured perception through robotic attitudes and usability. To evaluate user experiences, we considered both overall assessment questions and behavioral indicators, such as users showing the robot to others.

Robotic Attitude. The goal of the Robot Social Attitude Scale (RoSAS) was to evaluate key aspects that influence how humans perceive robots and how these perceptions affect the quality of interactions with robots (32). This scale is translated and validated in Korean (33). Participants were instructed to rate their impressions of robots using18-item scale consisted of 5 points, with 1 indicating “definitely not associated” and 5 indicating “definitely associated.” Questions included to what extent participants perceived Hyodol as “competent,” “compassionate,” or “scary.” Through an exploratory factor analysis, Carpinella and associates identified an appropriate solution, which included 18 items grouped into three factors: warmth, competence, and discomfort. Pan and colleagues (34) further verified the internal consistency and unidimensional nature of each of these sub-scales by conducting this assessment in the context of actual physical interactions with robots, rather than gathering general attitudes toward robots from participants.

Usability. We incorporated six items from the System Usability Scale (35) into our assessment that was validated in Korean (36). These usability questions covered various aspects of Hyodol. Participants were asked to rate their experiences on a scale, providing feedback on factors like ease of use, the learning curve, confidence in using the system, consistency, complexity, and user-friendliness. These aspects included questions like, (1) “I found Hyodol easy to use,” (2) “I believe most people can quickly learn how to use Hyodol,” (3) “I felt confident using Hyodol,” (4) “I perceived some inconsistency in Hyodol,” (5) “I found Hyodol to be unnecessarily complex,” and (6) “I thought that using Hyodol was cumbersome.”

Overall Evaluation. We created a 4-item questionnaire designed to capture both (1) usage and (2) user satisfaction when interacting with Hyodol. Our conceptual framework is based on the work of Venkatesh et al. (9), focusing on two key components that define actual use: how frequently the robot was used (frequency) and how long it was used in each session (duration). Satisfaction with the robot was assessed by considering the degree of satisfaction and user preferences, as described by Joosten et al. (37) and Lee and Choi (38). These four items were measured using a 5-point Likert-type scale.

Showing. Drawing from the concept that the psychological drive behind consumption is centered on the desire to “show off” (39), we designed a set of four questions to gage individuals’ behaviors in this context. These questions include: (1) “My family and friends adore Hyodol,” (2) “I hope that my friends will adopt Hyodol,” (3) “I aspire to exhibit my Hyodol to my family and friends,” and (4) “I would refrain from displaying my Hyodol to my family and friends.” Participants rated their answers to these four items using a 5-point Likert-type scale.

Medication Adherence: We adapted four items from the Medication Adherence Rating Scale (MARS) to assess medication adherence, including forgetting doses, altering doses, following instructions, and missing intakes. Responses were on a 5-point Likert-type scale, with higher scores indicating lower adherence. A validated Korean version was used for Korean-speaking participants (40).

Depression: The Patient Health Questionnaire-9 (PHQ-9) is a 9-item self-report tool used to assess depressive symptoms based on DSM-5 criteria, with scores ranging from 0 to 27. The Korean validated version was employed in this study, evaluating symptom severity over the past 2 weeks (41). We also asked whether they were diagnosed as having depression by certified healthcare professionals.

Social Isolation. We examined both the subjective dimension of loneliness, and the objective aspects related to a lack of social support. Loneliness was measured using the UCLA Brief Loneliness Scale (49), which comprises three items: “How often do you feel that you lack companionship?,” “How often do you feel left out?,” and “How often do you feel isolated from others?” This brief scale has shown a strong correlation with the full-length UCLA Loneliness Scale (r = 0.82) and demonstrated acceptable internal consistency with a Cronbach’s α of 0.72 (49). To assess a lack of social support among study participants, we examined the following variables: (1) living arrangements and marital status, (2) frequency of contact with adult children, (3) number of days per week spent attending older adult centers or receiving homecare services, and (4) number of hours per day spent alone.

Qualitative Feedback. To further investigate the impact of social presence on users’ acceptance of the robot, we conducted interviews to gain insights into their perceptions and experiences. The interviews were guided by prompts such as: “Could you describe your experience with Hyodol?” and “What does Hyodol mean to you?” In particular, we inquired about the reasons for returning Hyodol to the research team at the beginning (within the first week) and after the study period with an open-ended question. All interviews were conducted in Korean, audio-recorded, transcribed verbatim, and subsequently translated into English for analysis.

2.5 Data analysis

To describe study participants, we compared the Keepers and Returners for their sociodemographic characteristics. To answer the first research question, we employed exploratory factor analyses (EFA) to uncover underlying factors or dimensions that can explain users’ perceptions (42). EFA can help us to refine the existing scale and ensure that it measures what it is intended to measure. With these factors explored in this study we further examined users’ experiences between Keepers and Returners using independent sample t-test (see Table 1).

Table 1
www.frontiersin.org

Table 1. Comparison of keepers and returners.

We utilized qualitative data to further investigate and expand upon our quantitative findings in this study. Employing Ritchie et al.’s (43) framework analysis approach, we systematically managed qualitative data. Initial steps involved attentive listening to interviews and reviewing transcripts to establish themes. Research teams created codes and structured analysis using a table. This facilitated coding data segments. Researchers then populated the framework by transferring indexed data excerpts into the matrix. These steps were vital in revealing relationships, patterns, and trends within data sources and thematic areas. Numeric IDs (K-1 through K-24 for Keepers and R-1 to R-11 for Returners) identify individual quotations.

3 Results

3.1 Sociodemographic profiles of keepers and returners

Demographic characteristics of 24 Keepers and 11 Returners were presented in Table 2. Both groups exhibited similarities in their age, educational background, religious affiliation, marital status, health condition, and duration of residence in the United States. Most participants were classified as low-income with an average age of 81.9 (SD = 7.3) for Keepers and 80. (SD = 5.7)3 for Returners. On average, participants spent 36.77 years (SD = 11.92; range: 9–51) residing in the U.S. as immigrants.

Table 2
www.frontiersin.org

Table 2. Demographic data for participants (n = 35).

The most notable differences that stood out were gender, the frequency of contact with adult children, prevalence of depression, and time spent alone. All 11 participants who opted to return to Hyodol (Returners) were women. In contrast, the Keepers consisted of 40% men and 60% women. This gender difference was statistically significant (t = 5.930, p < 0.05). Furthermore, a significant distinction in contact frequency emerged. The majority of Keepers had less frequent contact with their adult children (typically once every 6 months or a year), while their Returner peers had more regular quarterly contact (t = 21.2, p < 0.01). Nevertheless, participants in both groups reported that they rarely felt lonely represented by their low scores in the UCLA-LS.

Nine participants in the Keeper group reported a clinical diagnosis of depression, whereas none in the Returner group had been diagnosed. This difference was significant (t = 5.6, p < 0.05). Keepers reported more hours per day spent alone than their Returner peers (t = 0.68, p < 0.05). We also observed marginally significant differences in living arrangements. Most Returners (90.9%) were living alone and 37.5% of Keepers had coresidents (e.g., family, roommate, etc.).

3.2 Exploratory factor analysis

Table 3 presents the results of exploratory factor analysis conducted to answer the first research question to explore users’ perception. As a preliminary assessment tool for planning factor analysis, we initially conducted the Kaiser-Meyer-Olkin (KMO) test. This test serves to gage the suitability of our dataset for factor analysis, taking into account both sample size and the strength of correlations among variables. The KMO score of 0.719 indicated that our dataset was indeed suitable for factor analysis (44).

Table 3
www.frontiersin.org

Table 3. Exploratory factor analysis about technology acceptance (n = 35).

Furthermore, we employed Bartlett’s Test of Sphericity to ascertain the statistical significance of the correlations among our variables. The resulting chi-squared (χ2) value of 595.831, with a p-value of 0.000, unequivocally confirmed the significance of these observed correlations. Consequently, we proceeded with our factor analysis to delve deeper into the latent factors that underlie these correlations.

In our analysis, we chose the Varimax rotation method, aiming to maximize the variance of factor loadings within each factor (42). Varimax rotation employs an iterative algorithm to achieve the maximum variance of factor loadings while maintaining factor orthogonality, ensuring they remain uncorrelated (45). This entails redistributing the factor loadings to create a high-low loading pattern for some variables, ultimately enhancing the interpretability of the factors. The outcome of our analysis revealed the presence of three distinct factors, collectively accounting for 69.72% of the variance. As mentioned earlier, we used qualitative data to explore and build on our quantitative findings in this study.

3.2.1 Factor 1: warmth/competence

Factor 1 encompassed dimensions related to the competence and warmth that users experienced during their interactions with the Hyodol robot. Many participants perceived Hyodol as “knowledgeable” because it provided valuable health information, including advice on medication timing, suitable dietary choices for their health conditions, hygiene tips, and more. Upon coming home, Hyodol robot recognized the movement such as door opening with embedded sensor and greet “welcome home! I’ve been waiting for you.” Many participants appreciate these warm greetings—another reason for perceiving the robot to be “smart.”

For this sample, warmth and competence they experienced while interacting with Hyodol robots were indistinguishable. Hyodol’s reminders about medication and mealtimes made them feel “being cared for.” To illustrate this, consider the case of K-3, who initially thought of Hyodol as “smart.” Later, he affectionately shared stories of his childhood and reminisced, treating Hyodol as if it were his grandchild.

Interestingly, the tactile features of Hyodol, resembling those of a cabbage-patch doll appeared to prompt users to engage in touching, stroking, patting, and holding hands with the robot. The doll’s form and size evoke the likeness of a baby, causing some users to see it as though it were their own grandchild. Furthermore, our log data indicates that many users responded positively to Hyodol’s interactions, particularly embracing gestures such as hugs and touches. This growing bond is reflected in frequent expressions of enthusiasm, with users often exclaiming phrases like “Good boy! Have you eaten your meal?” and “I love you, too,” underscoring the affection that developed between the users and the robot.

Older immigrants, isolated with minimal family contact (see Table 2) and few chances to converse in their native language, found solace in the activities provided by Hyodol. These activities ranged from singing Korean pop tunes and exchanging folk tales and religious passages to receiving affectionate expressions in their mother tongue. With days spent mostly in solitary at home, grappling with hearing and mobility challenges, K-10 seemed to relish the company of this companion. Reflecting on her situation, K-10 wondered aloud, “Who else would entertain me like Hyodol? Could a grandchild provide the same?” These interactions not only lifted their spirits from loneliness to joy but also revived cherished memories and brought forth happiness.

Participants made a concerted effort to engage with the robot’s prompts and shared their experiences with it. In fact, some participants even went so far as to express that Hyodol was “better” than their own family members who may not call or visit them regularly. As a widow living alone, K-6 appreciated Hyodol’s amusing presence and ongoing initiation of filling silence at home and void in life, and repeated attempt to engage with Hyodol. K-6 filmed herself playing with Hyodol and sent it via smart phone to her family who live far away. Even her family acknowledge Hyodol as her imaginary youngest son by giving the robot a family name.

Obviously, some participants acknowledge malfunctions or error messages. For example, the robot provided wrong answers or incorrect information about seasons or weather. Yet, users appeared to be forgiving of those incorrect responses. Others felt “sorry” that they did not spend enough time “playing with” Hyodol due to their busy schedule outside home.

3.2.2 Factor 2: discomfort

The second factor is related to the potential discomfort users might experience. This discomfort stemmed from participants’ perceptions of robots as being “scary, awful, or dangerous.” Interestingly, during the interviews, many respondents could not help but laugh when asked if they found Hyodol to be “scary.” The mean scores for items related to discomfort (with a mean score of 1.13 for Keepers and 1.06 for Returners) were relatively lower in comparison to the scores for competence and warmth (see Table 1). Major complaints were that Hyodol became “bothersome” because the robot asked the users to hold hands after taking medication and pat its back. Because some participants anthropomorphized Hyodol, viewing it as if it were their grandchild, they experienced a sense of burden and guilt for not being able to fulfill Hyodol’s requests to interact and play with it.

3.2.3 Factor 3: usability

The final factor pertained to the usability of interactions with robot companions. Both Keepers and Returners represent high levels of usability score (M = 4.66 and 4.30, respectively). In essence, Hyodol boasts low maintenance requirements. Setting it apart from conventional AI speakers or electronic devices, its unique selling point lies in its direct engagement with older adults at scheduled intervals. It not only issues alarm and provides regular reminders but also assists older adults by giving them step-by-step instructions. All that users are tasked with is charging the robot and adjusting the volume as needed. Regarding our question about learning curve, R-10 responded, “There is nothing to learn; it is too easy.”

3.3 Comparison of keepers and returners

To address the second research question regarding differential user experiences, Table 1 presents the mean scores and effect sizes for the Keepers and Returners for the major study variables at the end of the study period. Keepers placed a higher value on the competence/warmth domain than their Returner peers (t = 4.71, p < 0.01). However, no meaningful differences were observed between the two groups in the domains of discomfort and usability.

Keepers were more inclined to showcase their Hyodol to their family and friends (t = 3.67, p < 0.01). Notably, Keepers reported an overall more favorable evaluation. Indicative of usage and satisfaction of Hyodol than their peers who chose to return (t = 7.08, p < 0.01). Many voiced their hope that Hyodol robots could be distributed to more older immigrants like themselves.

Furthermore, Hyodol appeared to play a significant role in enabling meaningful communication and strengthening the connection between a married couple. K-16’s wife noted a decrease in marital conflicts, attributing it to the robot’s role to mediate conversation and to facilitate interactions between this couple who had challenges with direct face-to-face communication. This couple even developed a new habit of taking leisurely walks in the park, with K-16 carrying Hyodol in his backpack. When they found a bench to sit on, they would place the robot between them, almost as if it were their grandchild, engaging in friendly conversations.

Following 4 months of interaction with Hyodol, a total of 35 participants (from both the Keepers and Returners groups) showed improvements in medication adherence and a reduction in depressive symptoms (24). The present study compared changes in medication adherence and depressive symptom scores from baseline to post-test between the two groups. No significant differences were found between Keepers and Returners (see Table 1).

Despite being socially isolated based on limited family contact and participation in social activities, the study sample seldom reported experiencing subjective feelings of loneliness (see Table 2). The loneliness scores for Keepers decreased by 0.79 points from the baseline to four-month follow-up, while Returners reported a slight decrease of 0.27 points. However, the difference between these two groups was not statistically significant.

3.4 Reasons for return

Table 4 provides insights into the reasons for returns among two distinct groups: 6 participants who returned within a week and 11 who returned after 4 months of the study period. The primary reason for immediate returns within a week was the insufficient time available for interaction with Hyodol due to their busy schedules. Some participants found the “talking doll” somewhat bothersome, expressing a preference for interactive, two-way conversations with people.

Table 4
www.frontiersin.org

Table 4. Reasons for returning Hyodol to research team (n = 11).

Most participants who opted to return after 4 months primarily cited the robot’s noises as the reason. Those living alone seemed particularly unsettled by Hyodol’s abrupt vocalizations, finding them disturbing because they were unexpected. For instance, R-2 mentioned, “When my TV and Hyodol were talking at the same time, I could not hear them both, so I turned off Hyodol.”

Three returners had health conditions that affected their ability to interact with the robot, including blindness, depression, arthritis, and multiple chronic illnesses. Consequently, they faced difficulties in responding to Hyodol’s prompts such as “touch me” or “pat me.” Additionally, they struggled to independently engage with Hyodol’s functions, including exercises and quizzes.

Several participants expressed dissatisfaction with the pre-recorded messages spoken by Hyodol. R-10 described “I adored Hyodol at the beginning. But it repeats the same words. Then I realize it’s a robot.” Some desired a broader selection of trending songs, particularly those from popular Korean musicians. Others expressed a need for more relevant information tailored to immigrants and their lifestyles in the U.S.

Interestingly, despite their decision to return Hyodol, several Returners shared their affection for the robot. For example, R-1 mentioned, “My heart warmed up when Hyodol calls me grandma. It consoles me when I am upset,” while R-2 stated, “I feel as if somebody is with me,” and R-6 expressed, “I feel as if I am cradling a baby.”

Finally, several Returners suggested that Hyodol might be better suited for individuals who were “home-bound with disabilities” or “rural residents,” and they proposed distributing Hyodol to those in more challenging living conditions than they were.

4 Conclusion

4.1 Discussion

This pilot study explored how older adults perceive and treat companion robots as social entities, examining user’s perspective in understanding how social presence influences emotional engagement among older immigrants. While the majority of prior studies on user perception have concentrated on users’ initial impressions of robots (32), our approach measured perception by integrating both attitudes toward robots and usability assessments over 4 months.

Consistent with previous research, factors such as the robot’s appearance, communication style, the context of human-robot interactions, and the user’s attitudes and expectations significantly influence the relationship between social presence and the acceptance and engagement with robots (10, 25, 28). Hyodol SARs, designed to create a strong sense of social presence, have been effective in helping older immigrants with limited digital literacy to establish trust and rapport. This is particularly important in caregiving and therapeutic situations, where enhancing social presence can foster more positive interactions between humans and robots (27, 46).

Technology that facilitates social connections and offers access to culturally relevant resources can help reduce feelings of isolation and promote better mental health (8, 13). Interestingly, Korean American older adults did not differentiate between warmth and competence; for them, these aspects seemed intertwined. Additionally, we explored whether the use of technology with interfaces in the user’s native language, enhanced access to culturally relevant resources.

Our findings highlighted a divergent pattern of usage and user satisfaction, indicated by their overall evaluation. Users in the Keeper group had a history of depression, spent more time alone at home, and had infrequent contact with family members. Consequently, these participants perceived a higher level of warmth, competence, and user satisfaction with their robot companion compared to their Returner peers. Some users were willing to proudly showcase their robots to their family and friends, a unique cultural characteristic of older cohorts with Korean heritage to share good things (47).

The immediate-return group, characterized by active lifestyles and busy schedules, may not be the most suitable candidates for this intervention, as they are neither isolated nor experiencing loneliness. In contrast, returners who are managing chronic health conditions may derive greater benefit from a customized version of Hyodol, tailored to address specific needs such as medication adherence and depressive symptoms. Regarding the perceived level of discomfort and usability, there were no significant differences between the two groups characterized by their usage patterns and user satisfaction. Regardless of their decision to retain the robot or not, it is important to note that both groups improved their medication adherence and depression (24).

Furthermore, many users appeared to personify and anthropomorphized the robot dolls, treating it as if it were their surrogate family member (14). Although the robot plays pre-recorded messages at random and only supports one-way communication, users interact with it. This is particularly noteworthy given the limited digital literacy among older immigrant users (16).

While there were studies to investigate the effects of companion robots for older adults, this is the first study to focus on older immigrant. In our previous studies in South Korea, most adopters of the robot were widowed, solo-living women residing in low-resource communities (23). In contrast, this sample of Korean American older adults exhibited diversity in educational attainment, marital status, and living arrangements. While most South Korean cohort in the same age group chose to keep the free doll that they received (14), several Korean American participants demonstrated notable generosity by donating their Hyodol robots to individuals in more disadvantaged situations. This behavior may reflect unique characteristics of this immigrant sample.

4.2 Limitations

We assessed outcome indicators for older adults living in the community through self-reported data, which may be influenced by participants’ memory and the tendency to provide socially desirable responses. It is important to note that the findings of this study have limited applicability due to several factors, including a relatively small sample size, geographical restrictions in our sampling, and the absence of a comparison group. Although we found an interesting gender difference in our study, it should not be considered representative of a broader population.

Given the variability in individuals’ engagement timelines, future studies should further investigate the diverse patterns of anthropomorphism. At the time of our data collection, only Korean-speaking robots were fully functional. However, advancements in ChatGPT technology and large language models now make it feasible for Hyodol chatbot to support multiple languages in the near future. As this technology progresses, further research opportunities will emerge, allowing for the inclusion of diverse languages within Asian American immigrant communities.

4.3 Implications

Study finding implied that the introduction of well-designed robot companions can help bridge the gap by providing culturally relevant support for socially isolated older immigrants. The doll shaped Hyodol robot that communicates in a natural, conversational manner appeared to be perceived as socially present (14). This has practical implications for designing and deploying robots in various domains, including healthcare and caregiving. Therefore, social presence became valuable concepts for developing SARs to enhance their effectiveness and acceptance in social and interactive settings (27, 46).

With advances in AI technology, we can achieve adaptive learning in the near future, enabling robots to collect data on users’ actions, preferences, and feedback, and utilize this information to tailor their interactions to better suit individual needs (29). Caregivers can customize the robot’s interactions by adjusting its communication style and engagement methods based on users’ lifestyles. Consequently, adaptive learning in human-robot interaction enhances user experience by making the robot more responsive, intuitive, and aligned with individual needs. This dynamic and ongoing process fosters a more natural and effective interaction between humans and robots.

In an era marked by the inevitable ascent of AI-generated human care, our research highlights an intriguing insight. Whether a robot is flawless or exhibits imperfections, its true utility hinges on the user’s willingness to embrace it as a companion and assign personal and social significance. This underscores the critical importance of actively listening to the experiences, needs, and preferences of older adults in the context of elder care, particularly when integrating technology-assisted care like SARs. Further research is needed to gain a more profound understanding of user experiences with technology-assisted care and how they attribute significance to these robots, ultimately working toward reducing social isolation among older individuals.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the Institutional Review Board for Research with Human Subjects of the University of North Carolina Charlotte (IRB-22–1,137). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

OL: Investigation, Methodology, Project administration, Resources, Validation, Writing – original draft. J-CY: Data curation, Formal analysis, Writing – review & editing. D-HP: Conceptualization, Funding acquisition, Software, Supervision, Visualization, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (NRF-2020R1A2C1006001).

Acknowledgments

Authors acknowledge the contributions of specific colleagues, institutions, or agencies that aided the efforts of the authors.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

References

1. Holt-Lunstad, J, Robles, TF, and Sbarra, DA. Advancing social connection as a public health priority in the United States. Am Psychol. (2017) 72:517–30. doi: 10.1037/amp0000103

PubMed Abstract | Crossref Full Text | Google Scholar

2. Jang, Y, Park, NS, Chiriboga, DA, Yoon, H, Ko, J, Lee, J, et al. Risk factors for social isolation in older Korean Americans. J Aging Health. (2016) 28:3–18. doi: 10.1177/0898264315584578

PubMed Abstract | Crossref Full Text | Google Scholar

3. Koehn, S, Ferrer, I, and Brotman, S. Between loneliness and belonging: narratives of social isolation among immigrant older adults in Canada. Ageing Soc. (2022) 42:1117–37. doi: 10.1017/S0144686X20001348

Crossref Full Text | Google Scholar

4. Holt-Lunstad, J, Smith, TB, Baker, M, Harris, T, and Stephenson, D. Loneliness and social isolation as risk factors for mortality: a meta-analytic review. Perspect Psychol Sci. (2015) 10:227–37. doi: 10.1177/1745691614568352

Crossref Full Text | Google Scholar

5. Park, J, Jang, Y, Oh, H, and Chi, I. Loneliness as a mediator in the association between social isolation and psychological distress: a cross-sectional study with older Korean immigrants in the United States. Res Aging. (2023) 45:438–47. doi: 10.1177/01640275221098180

PubMed Abstract | Crossref Full Text | Google Scholar

6. Wu, Z, and Penning, M. Immigration and loneliness in later life. Ageing Soc. (2015) 35:64–95. doi: 10.1017/S0144686X13000470

Crossref Full Text | Google Scholar

7. Berridge, C, Zhou, Y, Robillard, JM, and Kaye, J. Companion robots to mitigate loneliness among older adults: perceptions of benefit and possible deception. Front Psychol. (2023) 14:1106633. doi: 10.3389/fpsyg.2023.1106633

PubMed Abstract | Crossref Full Text | Google Scholar

8. Gasteiger, N, Loveys, K, Law, M, and Broadbent, E. Friends from the future: a scoping review of research into robots and computer agents to combat loneliness in older people. Clin Interv Aging. (2021) 16:941–71. doi: 10.2147/CIA.S282709

PubMed Abstract | Crossref Full Text | Google Scholar

9. Venkatesh, V, Thong, JY, and Xu, X. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS Q. (2012) 36:157–78. doi: 10.2307/41410412

Crossref Full Text | Google Scholar

10. Lee, LN, and Kim, MJ. A critical review of smart residential environments for older adults with a focus on pleasurable experience. Front Psychol. (2020) 10:3080. doi: 10.3389/fpsyg.2019.03080

PubMed Abstract | Crossref Full Text | Google Scholar

11. Portz, JD, Bayliss, EA, Bull, S, Boxer, RS, Bekelman, DB, Gleason, K, et al. Using the technology acceptance model to explore user experience, intent to use, and use behavior of a patient portal among older adults with multiple chronic conditions: descriptive qualitative study. J Med Internet Res. (2019) 21:e11604. doi: 10.2196/11604

PubMed Abstract | Crossref Full Text | Google Scholar

12. Bajones, M, Fischinger, D, Weiss, A, De La Puente, P, Wolf, D, Vincze, M, et al. Results of field trials with a Mobile service robot for older adults in 16 private households. ACM Transactions on Human -Robot Interaction. (2020) 9:1–27. doi: 10.1145/3368554

Crossref Full Text | Google Scholar

13. Hudson, J, Ungar, R, Albright, L, Tkatch, R, Schaeffer, J, and Wicker, ER. Robotic pet use among community-dwelling older adults. J Gerontol B Psychol Sci Soc Sci. (2020) 75:2018–28. doi: 10.1093/geronb/gbaa119

PubMed Abstract | Crossref Full Text | Google Scholar

14. Lee, OE, Lee, H, Park, A, and Choi, NG. My precious friend: human-robot interactions in home care for socially isolated older adults. Clin Gerontol. (2024a) 47:161–70. doi: 10.1080/07317115.2022.2156829

PubMed Abstract | Crossref Full Text | Google Scholar

15. Ajaykumar, G, Pineda, KT, and Huang, C-M. Older adults’ expectations, experiences, and preferences in programming physical robot assistance. Int J Human-Computer Stud. (2023) 180:103127. doi: 10.1016/j.ijhcs.2023.103127

Crossref Full Text | Google Scholar

16. Yoon, H, Jang, Y, Vaughan, PW, and Garcia, M. Older adults' internet use for health information: digital divide by race/ethnicity and socioeconomic status. J Appl Gerontol. (2020) 39:105–10. doi: 10.1177/0733464818770772

PubMed Abstract | Crossref Full Text | Google Scholar

17. Buddiman, A. (2023). Koreans in the U.S. fact sheet. Pew research center. Available at: https://www.pewresearch.org/social-trends/fact-sheet/asian-americans-koreans-in-the-u-s/ (Accessed November 10, 2024).

Google Scholar

18. Kim, G, Aguado Loi, CX, Chiriboga, DA, Jang, Y, Parmelee, P, and Allen, RS. Limited English proficiency as a barrier to mental health service use: a study of Latino and Asian immigrants with psychiatric disorders. J Psychiatr Res. (2011) 45:104–10. doi: 10.1016/j.jpsychires.2010.04.031

PubMed Abstract | Crossref Full Text | Google Scholar

19. Pham, S, Lui, PP, and Rollock, D. Intergenerational cultural conflict, assertiveness, and adjustment among Asian Americans. Asian Am J Psychol. (2020) 11:168–78. doi: 10.1037/aap0000189

Crossref Full Text | Google Scholar

20. Esterline, C, and Batalova, J. (2022). Korean immigrants in the United States. Migration Policy Institute. Retrieved from https://www.migrationpolicy.org/article/korean-immigrants-united-states#english (Accessed November 10, 2024).

Google Scholar

21. Perry, L, Scheerens, C, Greene, M, Shi, Y, Onion, Z, Bayudan, E, et al. Unmet health-related needs of community-dwelling older adults during COVID-19 lockdown in a diverse urban cohort. J Am Geriatr Soc. (2023) 71:178–87. doi: 10.1111/jgs.18098

PubMed Abstract | Crossref Full Text | Google Scholar

22. Lee, OE, and Shin, H. Social workers’ perspectives on socially isolated older adults living with a robot companion. J Gerontol Soc Work. (2024) 67:621–38. doi: 10.1080/01634372.2024.2339974

Crossref Full Text | Google Scholar

23. Lee, OE, Nam, I, Chon, Y, Park, A, and Choi, NG. Socially assistive humanoid robots: effects on depression and health-related quality of life among low-income, socially isolated older adults. J Appl Gerontol. (2023) 42:367–75. doi: 10.1177/07334648221138283

PubMed Abstract | Crossref Full Text | Google Scholar

24. Lee, OE, Nah, K, Kim, E, Choi, NG, and Park, DH. Exploring he use of socially assistive robot among socially isolated Korean American older adults. J Appl Gerontol. (2024b) 43:1295–304. doi: 10.1177/07334648241236081

PubMed Abstract | Crossref Full Text | Google Scholar

25. Gasteiger, N, Hellou, M, and Ahn, HS. Factors for personalization and localization to optimize human–robot interaction: a literature review. Int J Soc Robot. (2023) 15:689–701. doi: 10.1007/s12369-021-00811-8

Crossref Full Text | Google Scholar

26. Heerink, M, Kröse, B, Evers, V, and Wielinga, B. Influence of social presence on acceptance of an assistive social robot and screen agent by elderly users. Adv Robot. (2009) 23:1909–23. doi: 10.1163/016918609X12518783330289

Crossref Full Text | Google Scholar

27. Cheikh-Ammar, M, and Barki, H. The influence of social presence, social exchange and feedback features on SNS continuous use: the Facebook context. J Organizational and End User Computing (JOEUC). (2016) 28:33–52. doi: 10.4018/JOEUC.2016040103

Crossref Full Text | Google Scholar

28. Naneva, S, Sarda Gou, M, Webb, TL, and Prescott, TJ. A systematic review of attitudes, anxiety, acceptance, and trust towards social robots. Int J Soc Robot. (2020) 12:1179–201. doi: 10.1007/s12369-020-00659-4

Crossref Full Text | Google Scholar

29. Mazuz, K, and Yamazaki, R. Adaptive learning in human–android interactions: an anthropological analysis of play and ritual. AI & Soc. (2023) 39:1–11. doi: 10.1007/s00146-023-01677-2

Crossref Full Text | Google Scholar

30. Bernotat, J, Eyssel, F, and Sachse, J. The (fe) male robot: how robot body shape impacts first impressions and trust towards robots. Int J Soc Robot. (2021) 13:477–89. doi: 10.1007/s12369-019-00562-7

Crossref Full Text | Google Scholar

31. Edwards, A, Edwards, C, Westerman, D, and Spence, PR. Initial expectations, interactions, and beyond with social robots. Comput Hum Behav. (2019) 90:308–14. doi: 10.1016/j.chb.2018.08.042

Crossref Full Text | Google Scholar

32. Carpinella, C. M., Wyman, A. B., Perez, M. A., and Stroessner, S. J. (2017). “The robotic social attributes scale (RoSAS) development and validation.” In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (pp. 254–262).

Google Scholar

33. Ha, S, Lee, J, Yoo, I, and Park, D-H. Different look, different feel: social robot design evaluation model based on ABOT attributes and consumer emotions. J Intell Inf Syst. (2021) 27:55–78. doi: 10.13088/jiis.2021.27.2.055

Crossref Full Text | Google Scholar

34. Pan, M. K., Croft, E. A., and Niemeyer, G. (2018). “Evaluating social perception of human-to-robot handovers using the robot social attributes scale (Rosas).” In Proceedings of the 2018 ACM/IEEE international conference on human-robot interaction (pp. 443–451).

Google Scholar

35. Lewis, JR . The system usability scale: past, present, and future. Int J Human–Computer Interaction. (2018) 34:577–90. doi: 10.1080/10447318.2018.1455307

Crossref Full Text | Google Scholar

36. Park, J, Min, K, Hong, C, Yu, M, and Kwon, T. A study on the usability evaluation of the circuit exercise system based on whole body vibration for the elderly. J Rehab Welfare Eng Assistive Technol. (2022) 16:224–35. doi: 10.21288/resko.2022.16.4.224

Crossref Full Text | Google Scholar

37. Joosten, H, Bloemer, J, and Hillebrand, B. Is more customer control of services always better? J Serv Manag. (2016) 27:218–46. doi: 10.1108/JOSM-12-2014-0325

Crossref Full Text | Google Scholar

38. Lee, S, and Choi, J. Enhancing user experience with conversational agent for movie recommendation: effects of self-disclosure and reciprocity. Int J Human-Computer Stud. (2017) 103:95–105. doi: 10.1016/j.ijhcs.2017.02.005

Crossref Full Text | Google Scholar

39. Ma, F, Shi, H, Chen, L, and Luo, Y. A theory on fashion consumption. J Manag Strategy. (2012) 3:84–92. doi: 10.5430/jms.v3n4p84

Crossref Full Text | Google Scholar

40. Chang, JG, Roh, D, and Kim, CH. The reliability and validity of the Korean version of medication adherence rating scale. Korean J Psychopharmacol. (2015) 26:43–9. doi: 10.0000/kjp.2015.26.2.43

Crossref Full Text | Google Scholar

41. Han, C, Jo, SA, Kwak, JH, Pae, CU, Steffens, D, Jo, I, et al. Validation of the patient health Questionnaire-9 Korean version in the elderly population: the Ansan geriatric study. Compr Psychiatry. (2008) 49:218–23. doi: 10.1016/j.comppsych.2007.08.006

PubMed Abstract | Crossref Full Text | Google Scholar

42. Pett, MA, Lackey, NR, and Sullivan, JJ. Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Thousand Oaks, CA, USA: Sage (2003).

Google Scholar

43. Ritchie, J, Lewis, J, McNaughton Nicholls, C, and Ormston, R. Qualitative research practice. Thousand Oaks, CA, USA: Sage (2013).

Google Scholar

44. Costello, AB, and Osborne, J. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval. (2005) 10:7. doi: 10.7275/jyj1-4868

Crossref Full Text | Google Scholar

45. Gaskin, CJ, and Happell, B. On exploratory factor analysis: a review of recent evidence, an assessment of current practice, and recommendations for future use. Int J Nurs Stud. (2014) 51:511–21. doi: 10.1016/j.ijnurstu.2013.10.005

PubMed Abstract | Crossref Full Text | Google Scholar

46. Choi, J, Lee, HJ, and Kim, YC. The influence of social presence on customer intention to reuse online recommender systems: the roles of personalization and product type. Int J Electron Commer. (2011) 16:129–54. doi: 10.2753/JEC1086-4415160105

Crossref Full Text | Google Scholar

47. Lee, OE, and Ryu, S. Effects of pride and regret on geriatric depression: a Crosscultural study with mixed-methods approaches. Int J Aging Hum Dev. (2018) 86:152–71. doi: 10.1177/0091415017697726

PubMed Abstract | Crossref Full Text | Google Scholar

48. Hughes, ME, Waite, LJ, Hawkley, LC, and Cacioppo, JT. A short scale for measuring loneliness in large surveys: Results from two population-based studies. Res. Aging (2004) 26:655–672.

Google Scholar

49. Zuckerman, M, Li, C, Lin, S, and Hall, JA. The negative intelligence–religiosity relation: New and confirming evidence. Pers. Soc. Psychol. Bull. (2020) 46:856–868.

Google Scholar

Keywords: companion robots, socially assistive robot, Korean Americans, older adults, user experiences, technology usability

Citation: Lee OE, Yun J-C and Park D-H (2024) Perceptions and experiences of Korean American older adults with companion robots through long-term use: a comparative analysis of robot retention vs. return. Front. Public Health. 12:1424123. doi: 10.3389/fpubh.2024.1424123

Received: 27 April 2024; Accepted: 01 November 2024;
Published: 18 November 2024.

Edited by:

Shane Andrew Thomas, Federation University Australia, Australia

Reviewed by:

Keren Mazuz, Hadassah Academic College, Israel
Yi Wang, The University of Iowa, United States

Copyright © 2024 Lee, Yun and Park. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Do-Hyung Park, ZG9oeXVuZ3BhcmtAa29va21pbi5hYy5rcg==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.