Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 13 December 2021
Sec. Human-Media Interaction
Volume 12 - 2021 | https://doi.org/10.3389/fpsyg.2021.749710

Interpersonal Physiological Synchrony for Detecting Moments of Connection in Persons With Dementia: A Pilot Study

Dannie Fu1,2, Natalia Incio-Serra1, Rossio Motta-Ochoa1 and Stefanie Blain-Moraes1,3*
  • 1Biosignal Interaction and Personhood Technology (BIAPT) Lab, McGill University, Montreal, QC, Canada
  • 2Department of Biomedical Engineering, McGill University, Faculty of Medicine, Montreal, QC, Canada
  • 3School of Physical and Occupational Therapy, Faculty of Medicine and Health Sciences, Montreal, QC, Canada

Interpersonal physiological synchrony has been successfully used to characterize social interactions and social processes during a variety of interpersonal interactions. There are a handful of measures of interpersonal physiological synchrony, but those that exist have only been validated on able-bodied adults. Here, we present a novel information-theory based measure of interpersonal physiological synchrony—normalized Symbolic Transfer Entropy (NSTE)—and compare its performance with a popular physiological synchrony measure—physiological concordance and single session index (SSI). Using wearable sensors, we measured the electrodermal activity (EDA) of five individuals with dementia and six able-bodied individuals as they participated in a movement activity that aimed to foster connection in persons with dementia. We calculated time-resolved NSTE and SSI measures for case studies of three dyads and compared them against moments of observed interpersonal connection in video recordings of the activity. Our findings suggest that NSTE-based measures of interpersonal physiological synchrony may provide additional advantages over SSI, including resolving moments of ambiguous SSI and providing information about the direction of information flow between participants. This study also investigated the feasibility of using interpersonal synchrony to gain insight into moments of connection experienced by individuals with dementia and further encourages exploration of these measures in other populations with reduced communicative abilities.

1. Introduction

Interpersonal physiological synchrony is a measure that has been used to investigate the relationship between individual's physiological dynamics and the interpersonal contexts and interactions in which they manifest. It has become a principal focus in social psychophysiology as an objective measure of the strength of interpersonal interactions across various social contexts (Palumbo et al., 2017; Helm et al., 2018). Physiological synchrony has been successfully used to characterize the relational dynamics of romantic couples (McAssey et al., 2013; Chatel-Goldman et al., 2014; Karvonen et al., 2016; Liu et al., 2016; Chaspari et al., 2017a,b; Timmons et al., 2017; Corner et al., 2019); friends and strangers (Slovák et al., 2014; Danyluck and Page-Gould, 2019; Bizzego et al., 2020); therapist-patient dyads (Marci and Orr, 2006; Marci et al., 2007; Tschacher and Meier, 2020); students working in groups (Guastello et al., 2006; Kelava et al., 2015; Mønster et al., 2016; Ahonen et al., 2018; Haataja et al., 2018; Malmberg et al., 2019); and parent-child dyads (Baker et al., 2015; Bernard et al., 2017; Bell, 2020; Samadani et al., 2021). The patterns of physiological linkages across different social contexts provide insight into social factors such as emotion, empathy, influence, conflict, and cooperation, that may not be accessible through self-reports or behavioral observations alone (Blain and McKeever, 2011; Thorson et al., 2018). As such, it has particular promise for providing insight into the interpersonal interaction dynamics of individuals who are unable to provide self-report and those who are otherwise minimally communicative (Monin and Schulz, 2009; Gifford et al., 2021).

Broadly, two main approaches have been used to quantify interpersonal physiological synchrony. The first examines the relationship between a dyad's physiological signals at the same point in time (Henning et al., 2001; Chatel-Goldman et al., 2014; Thorson et al., 2018). Cross-wavelet analysis and wavelet coherence are measures that have been adopted by several studies to detect co-synchrony of signals in the time-frequency domain (Fujiwara and Daibo, 2016; Ward et al., 2018; Gupta et al., 2019; Fujiwara et al., 2020; Hale et al., 2020). Cross-wavelet analysis, which shows the frequencies with high common power, has been used to analyze movement during dyadic conversations to investigate movement coordination between dancers and non-dancers, and to measure non-verbal social coordination in a group consisting of actors and children with autism during a theatrical workshop (Washburn et al., 2014; Fujiwara and Daibo, 2016; Ward et al., 2018; Gupta et al., 2019). Wavelet coherence highlights common frequencies regardless of power and has been used to capture synchrony in eye blinks and head nodding during face-to-face conversations. It has been used in several studies investigating neural synchronization in EEG recordings (Sun et al., 2003; Gupta et al., 2019; Nguyen et al., 2021). Physiological concordance (PC) and Single Session Index (SSI) are time-domain examples of this approach that are particularly common for measuring synchrony in electrodermal activity (Marci et al., 2007; Slovák et al., 2014; Karvonen et al., 2016; Karvonen, 2017; Di Lascio et al., 2018; Haataja et al., 2018; Gashi et al., 2019; Malmberg et al., 2019; Dindar et al., 2020; Misal et al., 2020; Liu et al., 2021). SSI is a Pearson correlation-based measure which provides an overall measure of synchrony for a particular interaction context. Several studies have adopted a rolling SSI method of analyzing moment-to-moment overall correlation of the physiological signals (Slovák et al., 2014; Haataja et al., 2018; Misal et al., 2020). The second approach uses time-lagged techniques, such as coupled differential equation models, lagged cross-correlations, and Granger causality models, to study the predictive relationship between a dyad's physiological signals (Schreiber, 2000; Müller and Lindenberger, 2011; Ferrer and Helm, 2013; Marzbanrad et al., 2015; Helm et al., 2018). Dynamical systems and coupled oscillator approaches to modeling synchrony have also been widely used to examine interpersonal synchrony (Helm et al., 2012; Ferrer and Helm, 2013; Chaspari et al., 2017a; Zee and Bolger, 2020). For example, Ferrer and Helm (2013) modeled dyadic interrelations using a system of linear equations, with parameters reflecting self-regulation and co-regulation (Ferrer and Helm, 2013; Chaspari et al., 2017a) used a coupled linear oscillator to model acoustic and physiological arousal of young couples engaging in a conflict discussion (Chaspari et al., 2017a; Zee and Bolger, 2020) also used coupled damped 183 oscillator models to explore physiological co-regulation in romantic couples (Zee and Bolger, 2020). Non-linear approaches to analyzing dynamical systems have also been explored in the context of interpersonal synchrony. Specifically, Recurrent Quantification Analysis (RQA), and its extensions such as Cross-RQA and Multidimensional-RQA, are techniques that have been used to investigate EDA synchrony in collaborating students and team collaboration using heart rate variability signals (Dindar et al., 2019; Veerabhadrappa et al., 2021). To date, few studies have examined directed, or causal influence of electrodermal activity signals in dyadic interactions (Helm et al., 2018). This approach has the potential to reveal more information about the dyadic interaction, including direction of influence, strength of influence, and time lags. These measures can be divided into two subcategories: model-based approaches and information-theoretic approaches (Lee et al., 2015). Granger Causality (GC) is a popular model-based approach that is commonly used to assess causality in time series (Müller et al., 2016). Methods like Granger Causality offer information about the coupling strength and direction; however, GC is limited due to its linear interpretation of the data (Lee et al., 2015; Müller et al., 2016). Information-theoretic approaches include transfer entropy, a non-linear extension of GC that addresses many of its limitations (Lee et al., 2015).

While interpersonal synchrony measures can be calculated across a wide range of physiological signals, those collected from unobtrusive wearable sensors offer the advantage of ecologically valid interactional data (Thorson et al., 2018). Signals of the autonomic nervous system (ANS) respond to an individual's mental and emotional state and have commonly been used to measure participant's level of arousal to study dyadic interactions (Guastello et al., 2006; Chaspari et al., 2017a,b; Haataja et al., 2018; Malmberg et al., 2019). In particular, electrodermal activity (EDA) can be unobtrusively collected from the wrist or fingertip and offers insight into the sympathetic responses of an individual. Fluctuations in the EDA signal, called electrodermal reactions (EDRs), reflect responses to various arousal stimuli (e.g., responses to emotional or affective processes, attention orienting stimuli), and are important features in affective computing technologies (Picard et al., 2001; Blain-Moraes et al., 2008).

The primary objective of this study was to apply an information theory-based measure—normalized symbolic transfer entropy (NSTE)—to interpersonal physiological synchrony using electrodermal activity signals. We compare time-resolved measures of NSTE with a traditional measure of interpersonal synchrony (SSI) in detecting observed moments of interpersonal connection. The secondary objective of this study was to assess the feasibility of using interpersonal synchrony measures for detecting moments of interpersonal connection in individuals with dementia. We hypothesized that NSTE would provide insight into interactional elements between individuals with dementia involved in a real-world, free-flow movement activity.

2. Methods

2.1. Participants

Eleven individuals participated in the movement session: five persons with dementia (age = 84.6 ± 7.49 years; three female and two male) and six able-bodied individuals (two dancers, two researchers, two care staff). The current study focuses on three case dyads (n = 6) including three persons with dementia (age = 89.67 ± 2.31 years; one female and two male) who were paired with three able-bodied individuals (two dancers and one researcher) during the activities. The persons with dementia had mild to moderate dementia (Alzheimer's or other dementias), but none demonstrated difficulties in comprehending the instructions and they all were aware of the time and place. All participants are identified through pseudonyms. This study was approved by the Institutional Review Board of McGill University (study number A06-B25-17B). Written consent was obtained from all caregivers and verbal assent was sought from the persons with dementia prior to and throughout the course of the study. Participants also consented to the use of photos from the movement activity for disseminating research results.

2.2. Description of Movement Session

The movement session took place at a non-profit organization for persons with dementia and was led by two dancers and a musician. The session lasted for 34 min and explored the theme of resistance through various activities in two solo/group and two duo exercises (Table 1, Figure 1). Participants were paired up in the same dyads for both duo activities. The lead dancer explained each of the exercises and demonstrated the movements with her own body and with the help of the supporting dancer for the duo exercises. Each exercise was accompanied by live music played by the musician using three instruments (kalimba, carillon, Indigenous drum) to structure the pace of the movements. For further description of the session, the reader is referred to (Motta-Ochoa et al., 2021).

TABLE 1
www.frontiersin.org

Table 1. Description of activities within the session (Motta-Ochoa et al., 2021).

FIGURE 1
www.frontiersin.org

Figure 1. Different activities comprising the movement session: (A) Solo activity: musical textures. (B) Duo activity: Resisting the force (sitting). (C) Duo activity: Resisting the force (standing). (D) Solo activity: Improvisation with music.

2.3. Data Collection

The entire movement session was video recorded through a camera mounted near the ceiling of the room. The camera used was the Sony DCR-SX63 Handycam Camcorder, which has 410k effective pixels of resolution. Video data was synchronized with physiological data collected from a battery-operated wearable sensor (Triple-Physiology Sensor (TPS), Thought Technology Ltd.,) that all participants wore on their fingertip or palm. The sensor is powered by a Lithium-ion polymer battery with a nominal voltage of 3.7V. The physiological sensor captured three autonomic nervous system (ANS) signals: (1) electrodermal activity (EDA), (2) skin temperature, (3) blood volume pulse (BVP). These signals were measured by the TPS at 15, 15, and 300 Hz, respectively, and were transmitted wirelessly using Bluetooth to an Android phone. Changes in these physiological signals are connected to emotional or mental states, and reflect not only changes due to body movement, but also mental and emotional state (Blain-Moraes et al., 2008; Collet et al., 2013). We focused our analysis on EDA, as this signal has been used extensively in previous research to measure physiological synchrony (Palumbo et al., 2017). EDA measurement from the TPS ranged from 0 to 30 μS.

2.4. Data Analysis

2.4.1. Qualitative Video Analysis

Two ethnographers who participated in the movement session comparatively analyzed fieldnotes of participant observations and video recordings to identify moments of interpersonal connection. Videos were reviewed multiple times in an iterative fashion to identify how each participant established connections. Moments of interpersonal connection involved a mutual exchange between two or more participants and were required to meet the following criteria: (1) sustained for 30 s or longer; (2) had a clear beginning and end; and (3) involved the participants focusing his/her attention on another participant or the group. To ensure validity, four researchers not involved in the movement program analyzed more than 10% of the collected material using these criteria, with an inter-rater agreement of 100%. For more details, the reader is referred to (Motta-Ochoa et al., 2021).

2.4.2. Physiological Synchrony Analysis

Prior to computing physiological synchrony, the EDA signals were pre-processed to remove non-physiological artifacts. A 1-D median filter (order n = 75) and moving average filter with a 0.75 s window were applied to smooth the data, and a one-Euro filter was applied to the EDA signal to minimize jitter and lag (Lai Kwan et al., 2019). The smoothed EDA was then used to calculate two measures of physiological synchrony across all dyads: (1) Single Session Index (SSI) (Marci et al., 2007) and (2) normalized Symbolic Transfer Entropy (NSTE).

2.4.2.1. Physiological Concordance (PC) and Single Session Index (SSI)

The EDA signals of both members of the dyad were first Z-score standardized to make them more comparable (Ben-Shakhar, 1985; Haataja et al., 2018). The average slopes of the EDA signal were computed over a 5-s sliding window with a step-size of 1 s. Physiological concordance (PC) was determined by computing consecutive Pearson correlations between the two slopes using a 15-s sliding window with a step-size of 1 s (Marci and Orr, 2006; Marci et al., 2007). The single session index (SSI) was calculated by taking the natural log transform of the ratio of the sum of the positive correlations over the sum of the negative correlations:

SSI=lnR>0RR<0|R|    (1)

We computed the SSI over a 60-s sliding window to analyze the time-resolved interpersonal synchrony across the different activities of the movement session (Slovák et al., 2014). Significance of the moment-by-moment SSI was assessed through Monte Carlo shuffling, which has been similarly applied in previous studies on the PC index (Karvonen et al., 2016). Within a given dyad, the Pearson correlation was computed on the two EDA signals where the time series of one participant was preserved, while that of the second participant was shuffled. This procedure was repeated 1,000 times. Observed SSI values were compared to the distribution of shuffled SSI values, and were considered statistically significant if they exceeded the top 5%.

2.4.2.2. Normalized Symbolic Transfer Entropy (NSTE)

Transfer Entropy (TE) is a non-linear extension of Granger Causality (GC). It is a model-free, information theory-based approach to estimating both the strength and direction of connectivity between a target signal (Y) and source signal (X) (Lee et al., 2013, 2015). Transfer Entropy is defined as the amount of mutual information between the past of X (XP) and the future of Y (YF), when the past of the Y is known (Lee et al., 2015):

TEXY=I(YF;XP|YP)=H(YF;YP)-H(YF;XP,YP),    (2)

where H(YF|YP) is the entropy of the future of Y given its past. That is, if adding the past of the source signal allows us to better predict the future of the target signal, the source has a causal relationship with the target. Symbolic transfer entropy (STE) improves upon TE through symbolizing the vectors for the past of X, the past of Y, and the future if Y. Three parameters define the computation of STE: (1) the embedding dimension (dE) specifies the length of the vector; (2) the time delay (τ) which specifies the time between vector points; and (3) the prediction time (δ), which defines the delay between the source and target signal (Staniek and Lehnertz, 2008; Lee et al., 2015).

To account for potential spurious STE values, we shuffled the source signal (X) while leaving the target signal (Y) intact, such that the frequency distribution and signal characteristics remained the same, but the dependency of XP and Y(F|P) was removed (Gouritch and Eggermont, 2007; Lee et al., 2013, 2015). We repeated this procedure 20 times to produce STEXYshuffled—an estimation of the bias produced by the signal characteristics of the source signal (X). The STE was then normalized to account for the bias incurred if the target signal (Y) exhibits high autocorrelation (Lee et al., 2015):

NSTEXY=STEXY-STEXYshuffledH(YF|YP)[0,1].    (3)

Finally, we assessed the direction of information flow between members of the dyad by computing the asymmetry of the NSTE originating from each participant:

AsymmetryXY=NSTEXY-NSTEYXNSTEXY+NSTEYX[-1,1].    (4)

When asymmetryXY is positive, information predominately flows from person X to person Y, and vice versa when the value is negative. In this study, person X was always set as the able-bodied adult and person Y was always the individual with dementia.

NSTEXY was computed over 60 s sliding windows, and the average asymmetry was computed over 5 sliding windows from the NSTE signal. For the computation of STE, we systematically searched a broad parameter space for the set of parameter values that produced the maximum NSTE for each dyad. The embedding dimension (dE) was fixed at 3, the time delay (τ) was chosen to produce the maximum NSTE from a range of τ=15 to τ=120 (1 to 8 s), and the prediction time (δ) was determined with the time lag resulting in the maximum cross-correlation from 1 to 50 (0.07–3.33 s).

Standardized EDA and the two time-resolved measures of interpersonal synchrony across the full movement session are presented in Figure 2 for an example dyad.

FIGURE 2
www.frontiersin.org

Figure 2. Standardized EDA signals, physiological concordance, SSI, and asymmetry for an example dyad across the entire movement session. Physiological concordance was computed over a 15 s moving window; the SSI was computed over a 30 s moving window; and the asymmetryXY was computed as the average NSTE (computed with a 60 s moving window) in a 5 s window. Moments of interpersonal connection identified by the ethnographers are shown between the vertical red lines. Moments of sustained synchrony (at least 30 s) are highlighted in green (sustained positive SSI), red (sustained negative SSI), blue (sustained asymmetryXY), orange (sustained asymmetryYX). The gray shaded area in the middle of the session indicates the time interval where the sensor disconnected.

2.4.3. Data Triangulation: Physiological and Video Analysis

As we have previously validated the observed moments of interpersonal connection identified in the video analysis (Motta-Ochoa et al., 2021), our primary data triangulation used results from the video observation to frame the physiological analysis. Specifically, we segmented the SSI and NSTE time series according to the moments of connection identified in video analysis, for the three case dyads. This ensured that we extracted all measures of physiological synchrony that corresponded to observed interpersonal connection. Within each of these segmented windows, we compared the dynamic patterns of SSI and NSTE to assess the characteristics of each metric during moments of interpersonal connection. As a secondary triangulation, we used the physiological results to frame the video analysis. Sustained moments of high SSI and high NSTE were time-stamped in the video; movements and interactions of the corresponding dyad were re-examined for potential sources of the high physiological synchrony.

3. Results

Through the video analysis, a total of seven moments of interpersonal connection were identified across three dyads. Detailed descriptions of the moments of connection are presented in Table 2. Moments of interpersonal connection observed in the video predominantly occurred during the duo activities, with one occurring during the improvisation with music activity. While this improvisation was designed as a solo exercise, the video showed that members of the group spontaneously split into pairs and danced, effectively rendering this last moment a duo activity as well. Moment 1 and Moment 2 occurred during the resistance sitting and resistance standing activity between Jean (female, dancer) and Hector (male, person with dementia). Moment 3 and Moment 4 occurred during the resistance sitting and resistance standing activity between Anne (female, dancer) and Erica (female, person with dementia). Moment 5, Moment 6, and Moment 7 occurred during the resistance sitting, resistance standing, and improvisation activity, between Ruth (female, researcher) and Harvey (male, person with dementia). The two physiological synchrony metrics—SSI and NSTE—were calculated across the entire movement session for each dyad that had observed moments of interpersonal connections. The time-resolved physiological synchrony annotated with the movement session activities and moments of interpersonal connection are presented in Figure 3.

TABLE 2
www.frontiersin.org

Table 2. Description of moments of connection from video analysis.

FIGURE 3
www.frontiersin.org

Figure 3. Annotated movement sessions for the three dyads (Dyad 1: Hector and Jean, Dyad 2: Erica and Anne, Dyad 3: Ruth and Harvey). Observed moments of connection are labeled and shown between the vertical red lines. Moments where the sensor disconnected are shown in the gray shaded area.

3.1. NSTE Asymmetry Provides Complementary and Additional Information to SSI About Moments of Interpersonal Connection

Patterns of NSTE asymmetry and SSI were compared during each observed moment of interpersonal connection to assess the characteristics of the two measures of physiological synchrony. In comparison to the established metric of SSI, NSTE asymmetry provided complementary and additional information that informed the interpretation of each of these moments of interpersonal connection. We illustrate the relationship between the two metrics by describing four particular ways that NSTE asymmetry provides additional insight to SSI during a moment of connection.

3.1.1. Case 1: During Sustained Positive SSI, NSTE Asymmetry Informs Direction of Information Flow Within a Dyad

During Moment 4 and Moment 5, the SSI of the dyad's EDA was sustained at a statistically significant positive value for the majority of the interaction (Figure 4). In this case, SSI indicates high interpersonal physiological synchrony in agreement with the observed interaction of the dyad in the video (Slovák et al., 2014). NSTE asymmetry values provide additional information about these moments of synchrony. In Moment 4, the NSTE asymmetry was negative, indicating that the direction of information flow was from Erica to Anne. This corresponded well to the dyad's interaction in the video, where Erica led the interaction of pushing against Anne's hand so that the dyad moved into and out of the middle of the room. In Moment 5, the NSTE asymmetry was positive, indicating that the direction of information flow went from Ruth to Harvey. In reviewing the video recording of this moment, both members of the dyad were attending to each other and appeared engaged in the activity. While the direction of information flow cannot be confirmed through behavioral observation, it is consistent with the typical interactions within this dyad, where Harvey (an individual with dementia) typically follows Ruth (a researcher and also a volunteer at the organization).

FIGURE 4
www.frontiersin.org

Figure 4. SSI and NSTE asymmetry values during two moments of connection: (A) Moment 4: Anne and Erica during the resistance standing activity. (B) Moment 5: Ruth and Harvey during the resistance sitting activity.

3.1.2. During Fluctuating, Significant SSI, NSTE Asymmetry Informs Leader-Follower Relationships Within a Dyad

During Moment 2 and Moment 6, SSI remained statistically significant throughout the observed moment of interpersonal connection but fluctuated between positive and negative values (Figure 5). Interpretation of these SSI fluctuations is informed by the NSTE asymmetry. During Moment 2, NSTE asymmetry also fluctuates, mirroring the pattern of the SSI. Here, the correlation of SSI and NSTE asymmetry reflect the shifting leader-follower roles within the dyad observed in the video. When both SSI and asymmetry were negative, Hector led Jean walking into and out of the middle; when both SSI and asymmetry were positive, Jean led Hector in this activity. In contrast, during Moment 6, SSI fluctuations are not matched by NSTE asymmetry, which remain positive for the majority of this moment of connection. Though the changes in SSI correspond with the observed activity in the video (i.e., when SSI is positive, Ruth is resisting against Harvey; when SSI is negative, Harvey is resisting against Ruth), the NSTE asymmetry indicates that information is flowing from Ruth to Harvey most of the time. This interpretation is well-supported by fieldnotes taken by the ethnographer: during this activity, Harvey was having difficulty understanding the instructions and Ruth was instructing and guiding him in performing the activity.

FIGURE 5
www.frontiersin.org

Figure 5. (A) Moment 2: Hector and Jean during the resistance standing activity. (B) Moment 6: Ruth and Harvey during the resistance standing activity.

3.1.3. Case 3: NSTE Asymmetry Identifies a Moment of Interpersonal Connection When SSI Does Not

The SSI during Moment 1 shifts from a significant negative value to a significant positive value halfway through the interaction (Figure 6). Unlike in case 2, the shift in SSI does not correspond to any observed or reported change in role between the members of the dyad, rendering the fluctuations in SSI unrelated to the moment of interpersonal connection. In contrast, the NSTE asymmetry remains sustained at a high level for over a minute during Moment 1. The positive NSTE asymmetry indicates information flow from Jean to Hector throughout this moment of connection, which corresponds to the observed interaction in the video recording of this interaction. In this case, the sustained high NSTE asymmetry was able to identify a moment of interpersonal connection, while the SSI was not.

FIGURE 6
www.frontiersin.org

Figure 6. SSI and NSTE asymmetry during Moment 1: Hector and Jean during the resistance sitting activity.

3.1.4. Case 4: NSTE Asymmetry Identifies a Moment of Interpersonal Connection When SSI is Negative

Moment 3 is characterized by a sustained negative SSI value throughout the duration of the moment, though not always significant (Figure 7). Although high positive SSI has been associated with aspects of social interaction in previous research, interactions characterized by negative SSI have received little attention to date. A negative SSI indicates predominantly negative correlations between the members of the dyad (e.g., as one increases, the other decreases) (Karvonen et al., 2016). While this metric does not mark the moment of interpersonal connection, the NSTE asymmetry remains high and sustained throughout the interaction. The positive NSTE asymmetry indicates information flow from Anne to Erica, which corresponds to the interaction dynamics observed in the video. In this case, the negative SSI does not canonically reflect the moment of interpersonal connection, while the sustained high NSTE asymmetry does.

FIGURE 7
www.frontiersin.org

Figure 7. SSI and NSTE asymmetry during Moment 3: Anne and Erica during the resistance sitting activity.

3.2. Spurious Sustained SSI and NSTE Asymmetry Can be Generated by a Shared Third-Party Influence

In our secondary triangulation, we examined the SSI and NSTE asymmetry time series for sustained, significant moments that did not correlate to moments of interpersonal connection observed in the video. If there were no interpersonal interactions between the members of the dyad from whom the EDA was recorded at these time points, this would indicate the potential for SSI and NSTE asymmetry to generate false positive indications of physiological synchrony. We observed several instances of spurious sustained SSI and NSTE asymmetry, particularly during the musical textures activity (see Figure 8 for examples). While the musical textures activity was a solo activity, thereby precluding interpersonal moments of connection, the dancer Anne led the group in coordinated movements during these moments. SSI fluctuates inconsistently across two of the three moments (Figures 8A,C), but the NSTE asymmetry is consistently high, indicating information flow from the dancer or able-bodied person to the person with dementia. The third moment (Figure 8B) shows a consistently positive SSI and fluctuating, but predominantly high NSTE asymmetry, corresponding well to their engagement in the activity observed in the video.

FIGURE 8
www.frontiersin.org

Figure 8. Moments of significant SSI and sustained NSTE asymmetry during non-dyadic interactions in the musical textures activity. (A) Anne and Erica. (B) Ruth and Harvey. (C) Jean and Hector.

4. Discussion

The current study presents a novel measure of interpersonal physiological synchrony—normalized symbolic transfer entropy (NSTE)—and demonstrates its potential for detecting moments of interpersonal connection via electrodermal activity. In comparing NSTE to SSI (a more established measure of interpersonal physiological synchrony) during observed moments of connection, we demonstrate that NSTE asymmetry provides complementary and additional information that informs the interpretation of the significant moments of interpersonal interaction. This is also the first study to demonstrate the feasibility of using interpersonal physiological synchrony to detect significant moments of connection in individuals with dementia in a naturalistic environment.

NSTE, transfer entropy and other symbolic analysis techniques have been reliably used in other contexts to assess information flow of biosignals within and between individuals (Lee et al., 2013, 2015; Shovon et al., 2014; Marzbanrad et al., 2015; Müller et al., 2016; Takamizawa and Kawasaki, 2019). Within an individual, symbolic dynamics have been used to assess heart rate variability (Guzzetti et al., 2005; Cesarelli et al., 2012); normalized transfer entropy to measure information transfer between auditory cortical neurons (Gouritch and Eggermont, 2007); and lag-specific transfer entropy in cardiovascular and cardiorespiratory signals to describe alterations in the cardiovascular and respiration mechanisms (Faes et al., 2014). Symbolic transfer entropy has been used in many studies investigating feedforward and feedback connectivity within an individual's brain (Ku et al., 2011; Lee et al., 2013, 2015). These studies have shown the potential of STE for monitoring brain states in surgical patients (Lee et al., 2015). Transfer entropy has been successfully used in biosignals to measure information flow between individuals. Marzbanrad et al. (2015) applied TE to maternal and fetal heart rates to quantify directed interactions between mother and fetus at various time delays and gestational ages. Takamizawa and Kawasaki (2019) used TE to identify the causal relationship between two people (leader and follower) during a cooperative alternative-tapping task. In both computer simulation and human behavioral experiments, TE was able to reliably identify leader and follower interpersonal relationships (Takamizawa and Kawasaki, 2019). The current study builds upon this body of research, extending transfer entropy-related measures to electrodermal activity—a biosignal that reflects the activity of the sympathetic nervous system and reflects an individual's mental and emotional state. We demonstrate that normalized symbolic transfer entropy calculated across the EDA of two individuals is related to significant moments of interpersonal connection within the dyad and can indicate the direction of information flow (e.g., leader-follower relationships) during these moments. In addition, as this measure captures increasing and decreasing patterns in the signal through symbolization of the signal values, rather than the absolute values themselves, we have seen the potential of its use as a translational measure of interpersonal synchrony for capturing relevant features of an individual's emotional and mental response rather than features related to the maintenance of homeostasis (Blain-Moraes et al., 2008).

We compare the performance of NSTE asymmetry to a more traditional measure of physiological synchrony: the single session index. Introduced by Marci and Orr (2006) with several more recent modifications (Slovák et al., 2014; Karvonen et al., 2016; Haataja et al., 2018; Malmberg et al., 2019; Misal et al., 2020; Stuldreher et al., 2020), the SSI has been well-established with electrodermal activity signals. Previous work has demonstrated that high SSI measured from EDA signals between individuals have been associated with high levels of dyadic and group emotional engagement. During real-world conversations between 20 pairs of friends, consistently high EDA synchrony (30 to 40 s) was associated with high dyadic emotional engagement, while inconsistent or fluctuating EDA synchrony was associated with low emotional engagement (Slovák et al., 2014). In clinical sessions, high SSI between patient and therapist EDA was positively associated with patient perception of therapist empathy. Observer ratings of 1-min audio-video segments showed more positive social-emotional responses during high skin conductance concordance (Marci et al., 2007). SSI has also been used to examine group physiological synchrony. Student groups have high physiological synchrony values when monitoring is frequent (Haataja et al., 2018), and when they faced difficulties during a collaborative exam (Malmberg et al., 2019). The strong association between SSI and emotional engagement demonstrated in these previous studies underscores the potential of NSTE, which provides complementary and additional information to the SSI in the current study. NSTE asymmetry could identify the direction of information flow between connected dyads in moments marked by SSI (case 1 and 2) and identified moments of interpersonal connection when SSI was ambiguous (case 3 and 4). It is worth noting both measures employed in this study are based on different fundamental concepts of interpersonal synchrony: correlation (SSI) and information theory (NSTE). Correlation-based methods analyzed concurrent synchrony at a single time point across time, while information theory-based methods examine the predictive power of the transmitter or receiver signals on their respective counterpart (Helm et al., 2018). Our results suggest that the combination of these two types of synchrony measures provide deeper insight into dynamics of social interactions and connection.

Previous studies using SSI to investigate interpersonal physiological synchrony have focused predominantly on moments of sustained, positive SSI. In our study, we observed several moments of sustained negative SSI, both associated and not associated with an observed moment of interpersonal connection. During moments of negative SSI (Moments 2, 3, and 6) both members of the dyad appeared to be engaged. This “negative synchrony” does not necessarily imply disengagement; it is possible that negative SSI measures are generated when one member of the dyad is extremely focused (inducing more EDRs), while the other member is more relaxed (Bailey, 2017). This hypothesis is supported by a handful of previous findings. Karvonen et al. (2016) and Karvonen (2017) reported a negative SSI in a particular case study of a couple during therapy, noting that when one person became more relaxed, the spouse became more alert. The low synchrony did not correspond to disengagement: it could be caused when one person was becoming agitated and the other was trying to stay calm (Karvonen et al., 2016; Karvonen, 2017). Misal et al. (2020) examined EDA synchrony using a rolling SSI in paramedic trainee pairs during in-situ training. They reported a higher percentage of the use of the word “we” during sessions associated with positive SSI and a higher percent usage of the word “you” during sessions associated with negative SSI (Misal et al., 2020), suggesting that negative SSI may correspond to less social cohesion.

Although the current study clearly demonstrates the potential of NSTE for the detection of moments of connection, several challenges need to be addressed before it can be implemented as a reliable measure of interpersonal physiological synchrony. Foremost among these challenges is the ability for NSTE to be confounded by a shared third source. We observed several examples of sustained high NSTE asymmetry indicating strong information flow from the lead dancer to the participants during group activities. Although the group was engaged in similar physical movements during these activities, they were executed solo, without an intentional connection to another group member. While it is known that “physiological influence may reflect exposure to shared stimuli or similar physiological milieu and not a social process between two people,” this is a potential confound that needs to be addressed through careful future study design and interpretation (Thorson et al., 2018).

The study also demonstrates the feasibility of using physiological signals to detect moments of interpersonal synchrony in individuals with dementia. One of the most insidious consequences of dementia is the rupture of relationships that often co-occurs with declining functional and cognitive abilities. Relationships between the individual with dementia and their carers often undergo severe strain when speech and communication change. This may in part be due to caregivers and family members intuitive dependence on language as a sign of emotional connection (Duffy, 1999). As a result, individuals with severe dementia often find themselves increasingly excluded from the social world. This fracturing of relationships at intimate and community levels contributes to the loss of personhood experienced by the individual with dementia and their carer (Kitwood, 1997). Techniques that can detect moments of interpersonal synchrony between an individual with dementia and their carer have the potential to mitigate this loss of personhood by manifesting otherwise-hidden moments of connection (Gifford et al., 2021). This study demonstrates that such a technology is feasible with this population, providing the first step toward the development of systems that use physiological synchrony to sustain the relationships and personhood of individuals with minimal communicative abilities.

This study has several limitations. First, the video recording of the session did not always capture all participants in the room; it is possible that several moments of interpersonal synchrony were missed because one of the participants was out of frame. Second, our identification of moments of interpersonal connection was based on iterative video analysis and ethnographic fieldnotes, rather than participant self-report. While some studies have shown that it is possible to detect interpersonal signals from non-verbal streams, and that macro-judgements may be more relevant and realistic for social signal processing than specific behavioral cues, this method may not have captured all subjective experiences of interpersonal connection (Ambady et al., 2000; Slovák et al., 2014). Third, this study was conducted with a small sample size of n = 6 individuals (three dyads). Although this was sufficient to accomplish the study objective of illustrating the potential of a new measure of interpersonal synchrony, future work needs to validate the reliability of this measure across a larger group of individuals. Fourth, we explored only a single physiological measure—EDA—as this is commonly used for measuring synchrony and emotional arousal. Individuals have different dominant physiological modalities and may manifest synchrony in other biosignals (e.g., heart rate) (Lai Kwan et al., 2019). Other studies have shown that performance of a multimodal physiological synchrony measure was more robust than a single physiological metric across different types of stimuli, even though the maximum performance did not improve over a single physiological metric (Verma and Tiwary, 2014; Stuldreher et al., 2020).

5. Conclusion

This study presented a new measure of interpersonal physiological synchrony—normalized symbolic transfer entropy—and demonstrated that it has the potential to provide complementary and additional information to the single session index in detecting moments of interpersonal connection. NSTE asymmetry provided insight about the direction of information flow within a dyad during moments of connection and detected some moments that SSI did not. These results suggest that information-theory based measures warrant further exploration in the field of interpersonal synchrony. They also suggest the potential of using this technique to detect interpersonal physiological synchrony between individuals with dementia and their carers.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

This study was approved by the Institutional Review Board of McGill University (study number A06-B25-17B). The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author Contributions

RM-O, NI-S, and SB-M collected the experimental data. DF and SB-M analyzed the experimental data, interpreted the findings, and wrote the manuscript. RM-O and NI-S constructively reviewed the manuscript. All authors reviewed and approved the final version of the manuscript.

Funding

This work was supported by the CIHR operating grant Moving With and Tuning In: A participatory mixed methods study to foster social inclusion of individuals with dementia and their carers (CIHR-SII-150,704) and Alzheimer Society of Canada (Grant #17C).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors would like to thank Parisa Alirezaee, Johann Vargas, Danielle Nadin, Charlotte Maschke, and Mathieu Bouchard for their support in the process of data collection and analysis and to the BIAPT lab members for their advice in lab meetings, as well as to the research participants without whom this study would not be possible. We extend our thanks to all the people from Je suis Julio: Marie Valle, Joannie Douville, and Georges-Nicolas Tremblay for delivering and tailoring the movement program. We thank the staff members of the organization for their support in the implementation of the program.

References

Ahonen, L., Cowley, B. U., Hellas, A., and Puolamäki, K. (2018). Biosignals reflect pair-dynamics in collaborative work. Sci. Rep. 8, 3138. doi: 10.1038/s41598-018-21518-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Ambady, N., Bernieri, F. J., and Richeson, J. A. (2000). Toward a histology of social behavior: judgmental accuracy from thin slices of the behavioral stream. Adv. Exp. Soc. Psychol. 32, 201–271. doi: 10.1016/S0065-2601(00)80006-4

CrossRef Full Text | Google Scholar

Bailey, R. L. (2017). “Electrodermal activity (eda),” in The International Encyclopedia of Communication Research Methods (Hoboken, NJ).

Google Scholar

Baker, J. K., Fenning, R. M., Howland, M. A., Baucom, B. R., Moffitt, J., and Erath, S. A. (2015). Brief report: a pilot study of parent–child biobehavioral synchrony in autism spectrum disorder. J. Autism Dev. Disord. 45, 4140–4146. doi: 10.1007/s10803-015-2528-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Bell, M. A. (2020). Mother-child behavioral and physiological synchrony. Adv Child Dev Behav. 58, 163–188. doi: 10.1016/bs.acdb.2020.01.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Ben-Shakhar, G. (1985). Standardization within individuals: a simple method to neutralize individual differences in skin conductance. Psychophysiology 22, 292–299. doi: 10.1111/j.1469-8986.1985.tb01603.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Bernard, N. K., Kashy, D. A., Levendosky, A. A., Bogat, G. A., and Lonstein, J. S. (2017). Do different data analytic approaches generate discrepant findings when measuring mother–infant hpa axis attunement? Dev. Psychobiol. 59, 174–184. doi: 10.1002/dev.21474

PubMed Abstract | CrossRef Full Text | Google Scholar

Bizzego, A., Azhari, A., Campostrini, N., Truzzi, A., Ng, L. Y., Gabrieli, G., et al. (2020). Strangers, friends, and lovers show different physiological synchrony in different emotional states. Behav. Sci. 10:11. doi: 10.3390/bs10010011

PubMed Abstract | CrossRef Full Text | Google Scholar

Blain, S., and McKeever, P. (2011). Revealing personhood through biomusic of individuals without communicative interaction ability. Augment. Alternat. Commun. 27, 1–4. doi: 10.3109/07434618.2011.556663

PubMed Abstract | CrossRef Full Text | Google Scholar

Blain-Moraes, S., Chau, T., and Mihailidis, A. (2008). Peripheral autonomic signals as access pathways for individuals with severe disabilities: a literature appraisal. Open Rehabil. J. 1:27. doi: 10.2174/1874943700801010027

CrossRef Full Text | Google Scholar

Cesarelli, M., Romano, M., Bifulco, P., Improta, G., and D'Addio, G. (2012). An application of symbolic dynamics for fhrv assessment. Stud. Health Technol. Inform. 180, 123–127. doi: 10.3233/978-1-61499-101-4-123

PubMed Abstract | CrossRef Full Text | Google Scholar

Chaspari, T., Han, S. C., Bone, D., Timmons, A. C., Perrone, L., Margolin, G., et al. (2017a). “Quantifying regulation mechanisms in dating couples through a dynamical systems model of acoustic and physiological arousal,” in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (New Orleans, LA: IEEE), 3001–3005.

Google Scholar

Chaspari, T., Timmons, A. C., Baucom, B. R., Perrone, L., Baucom, K. J., Georgiou, P., et al. (2017b). “Exploring sparse representation measures of physiological synchrony for romantic couples,” in 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) (San Antonio, TX: IEEE), 267–272.

Google Scholar

Chatel-Goldman, J., Congedo, M., Jutten, C., and Schwartz, J.-L. (2014). Touch increases autonomic coupling between romantic partners. Front. Behav. Neurosci. 8:95. doi: 10.3389/fnbeh.2014.00095

PubMed Abstract | CrossRef Full Text | Google Scholar

Collet, C., Di Rienzo, F., El Hoyek, N., and Guillot, A. (2013). Autonomic nervous system correlates in movement observation and motor imagery. Front. Hum. Neurosci. 7:415. doi: 10.3389/fnhum.2013.00415

PubMed Abstract | CrossRef Full Text | Google Scholar

Corner, G. W., Saxbe, D. E., Chaspari, T., Rasmussen, H. F., Perrone, L., Pettit, C., et al. (2019). Compassion in a heartbeat: physiology during couples loss discussions. J. Soc. Pers. Relat. 36, 1671–1694. doi: 10.1177/0265407518770267

CrossRef Full Text | Google Scholar

Danyluck, C., and Page-Gould, E. (2019). Social and physiological context can affect the meaning of physiological synchrony. Sci. Rep. 9, 1–13. doi: 10.1038/s41598-019-44667-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Di Lascio, E., Gashi, S., and Santini, S. (2018). Unobtrusive assessment of students' emotional engagement during lectures using electrodermal activity sensors. Proc. ACM on Interact. Mobile Wearable Ubiquit. Technol. 2, 1–21. doi: 10.1145/3264913

CrossRef Full Text | Google Scholar

Dindar, M., Alikhani, I., Malmberg, J., Järvelä, S., and Seppänen, T. (2019). Examining shared monitoring in collaborative learning: A case of a recurrence quantification analysis approach. Comput. Hum. Behav. 100, 335–344. doi: 10.1016/j.chb.2019.03.004

CrossRef Full Text | Google Scholar

Dindar, M., Malmberg, J., Jrvel, S., Haataja, E., and Kirschner, P. A. (2020). Matching self-reports with electrodermal activity data: Investigating temporal changes in self-regulated learning. Educ. Inform. Technol. 25, 1785–1802. doi: 10.1007/s10639-019-10059-5

CrossRef Full Text | Google Scholar

Duffy, M. E. (1999). Handbook of Counseling and Psychotherapy With Older Adults. Hoboken, NJ: John Wiley & Sons, Inc.

Google Scholar

Faes, L., Marinazzo, D., Montalto, A., and Nollo, G. (2014). Lag-specific transfer entropy as a tool to assess cardiovascular and cardiorespiratory information transfer. IEEE Trans. Biomed. Eng. 61, 2556–2568. doi: 10.1109/TBME.2014.2323131

PubMed Abstract | CrossRef Full Text | Google Scholar

Ferrer, E., and Helm, J. L. (2013). Dynamical systems modeling of physiological coregulation in dyadic interactions. Int. J. Psychophysiol. 88, 296–308. doi: 10.1016/j.ijpsycho.2012.10.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Fujiwara, K., and Daibo, I. (2016). Evaluating interpersonal synchrony: wavelet transform toward an unstructured conversation. Front. Psychol. 7:516. doi: 10.3389/fpsyg.2016.00516

PubMed Abstract | CrossRef Full Text | Google Scholar

Fujiwara, K., Kimura, M., and Daibo, I. (2020). Rhythmic features of movement synchrony for bonding individuals in dyadic interaction. J. Nonverbal Behav. 44, 173–193. doi: 10.1007/s10919-019-00315-0

CrossRef Full Text | Google Scholar

Gashi, S., Di Lascio, E., and Santini, S. (2019). Using unobtrusive wearable sensors to measure the physiological synchrony between presenters and audience members. Proc. ACM Interact. Mobile Wearable Ubiquit. Technol. 3, 13:1–13:19. doi: 10.1145/3314400

CrossRef Full Text | Google Scholar

Gifford, A., Marmelat, V., and Beadle, J. N. (2021). A narrative review examining the utility of interpersonal synchrony for the caregiver-care recipient relationship in Alzheimer's disease and related dementias. Front. Psychol. 12:595816. doi: 10.3389/fpsyg.2021.595816

PubMed Abstract | CrossRef Full Text | Google Scholar

Gourvitch, B., and Eggermont, J. J. (2007). Evaluating information transfer between auditory cortical neurons. J. Neurophysiol. 97, 2533–2543. doi: 10.1152/jn.01106.2006

PubMed Abstract | CrossRef Full Text | Google Scholar

Guastello, S. J., Pincus, D., and Gunderson, P. R. (2006). Electrodermal arousal between participants in a conversation: nonlinear dynamics and linkage effects. Nonlinear Dynam. Psychol. Life Sci. 10, 365–399.

PubMed Abstract | Google Scholar

Gupta, A., Strivens, F. L., Tag, B., Kunze, K., and Ward, J. A. (2019). “Blink as you sync: uncovering eye and nod synchrony in conversation using wearable sensing,” in Proceedings of the 23rd International Symposium on Wearable Computers, (London), 66–71.

Google Scholar

Guzzetti, S., Borroni, E., Garbelli, P. E., Ceriani, E., Bella, P. D., Montano, N., et al. (2005). Symbolic dynamics of heart rate variability: a probe to investigate cardiac autonomic modulation. Circulation 112, 465–470. doi: 10.1161/CIRCULATIONAHA.104.518449

PubMed Abstract | CrossRef Full Text | Google Scholar

Haataja, E., Malmberg, J., and Jvel, S. (2018). Monitoring in collaborative learning: co-occurrence of observed behavior and physiological synchrony explored. Comput. Hum. Behav. 87, 337–347. oi: doi: 10.1016/j.chb.2018.06.007

CrossRef Full Text | Google Scholar

Hale, J., Ward, J. A., Buccheri, F., Oliver, D., and Hamilton, A. F. d. C. (2020). Are you on my wavelength? interpersonal coordination in dyadic conversations. J. Nonverbal Behav. 44, 63–83. doi: 10.1007/s10919-019-00320-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Helm, J. L., Miller, J. G., Kahle, S., Troxel, N. R., and Hastings, P. D. (2018). On measuring and modeling physiological synchrony in dyads. Multivariate Behav. Res. 53, 521–543. doi: 10.1080/00273171.2018.1459292

PubMed Abstract | CrossRef Full Text | Google Scholar

Helm, J. L., Sbarra, D., and Ferrer, E. (2012). Assessing cross-partner associations in physiological responses via coupled oscillator models. Emotion 12:748. doi: 10.1037/a0025036

PubMed Abstract | CrossRef Full Text | Google Scholar

Henning, R. A., Boucsein, W., and Claudia Gil, M. (2001). Social physiological compliance as a determinant of team performance. Int. J. Psychophysiol. 40, 221–232. doi: 10.1016/S0167-8760(00)00190-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Karvonen, A. (2017). Sympathetic nervous system synchrony between participants of couple therapy (Ph.D thesis). Jyväskylä.

Google Scholar

Karvonen, A., Kykyri, V.-L., Kaartinen, J., Penttonen, M., and Seikkula, J. (2016). Sympathetic nervous system synchrony in couple therapy. J. Marital Fam. Ther. 42, 383–395. doi: 10.1111/jmft.12152

PubMed Abstract | CrossRef Full Text | Google Scholar

Kelava, A., Muma, M., Deja, M., Dagdagan, J. Y., and Zoubir, A. M. (2015). A new approach for the quantification of synchrony of multivariate non-stationary psychophysiological variables during emotion eliciting stimuli. Front. Psychol. 5:1507. doi: 10.3389/fpsyg.2014.01507

PubMed Abstract | CrossRef Full Text | Google Scholar

Kitwood, T. (1997). Dementia Reconsidered: The Person Comes First. Rethinking ageing series. Maidenhead: Open University Press.

PubMed Abstract | Google Scholar

Ku, S.-W., Lee, U., Noh, G.-J., Jun, I.-G., and Mashour, G. A. (2011). Preferential inhibition of frontal-to-parietal feedback connectivity is a neurophysiologic correlate of general anesthesia in surgical patients. PLoS ONE 6:e25155. doi: 10.1371/journal.pone.0025155

PubMed Abstract | CrossRef Full Text | Google Scholar

Lai Kwan, C., Mahdid, Y., Motta Ochoa, R., Lee, K., Park, M., and Blain-Moraes, S. (2019). Wearable technology for detecting significant moments in individuals with dementia. BioMed Res. Int. 2019:6515813. doi: 10.1155/2019/6515813

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, U., Blain-Moraes, S., and Mashour, G. A. (2015). Assessing levels of consciousness with symbolic analysis. Philos. Trans. Ser. A Math. Phys. Eng. Sci. 373:2034. doi: 10.1098/rsta.2014.0117

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, U., Ku, S., Noh, G., Baek, S., Choi, B., and Mashour, G. A. (2013). Disruption of frontal-parietal communication by ketamine, propofol, and sevoflurane. Anesthesiology 118, 1264–1275. doi: 10.1097/ALN.0b013e31829103f5

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, S., Zhou, Y., Palumbo, R., and Wang, J.-L. (2016). Dynamical correlation: a new method for quantifying synchrony with multivariate intensive longitudinal data. Psychol. Methods 21, 291–308. doi: 10.1037/met0000071

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, Y., Wang, T., Wang, K., and Zhang, Y. (2021). Collaborative learning quality classification through physiological synchrony recorded by wearable biosensors. Front. Psychol. 12:674369. doi: 10.3389/fpsyg.2021.674369

PubMed Abstract | CrossRef Full Text | Google Scholar

Malmberg, J., Haataja, E., Seppänen, T., and Järvelä, S. (2019). Are we together or not? the temporal interplay of monitoring, physiological arousal and physiological synchrony during a collaborative exam. Int. J. Comput. Support. Collabor. Learn. 14, 467–490. doi: 10.1007/s11412-019-09311-4

CrossRef Full Text | Google Scholar

Marci, C. D., Ham, J., Moran, E., and Orr, S. P. (2007). Physiologic correlates of perceived therapist empathy and social-emotional process during psychotherapy. J. Nerv. Ment. Dis. 195, 103–111. doi: 10.1097/01.nmd.0000253731.71025.fc

PubMed Abstract | CrossRef Full Text | Google Scholar

Marci, C. D., and Orr, S. P. (2006). The effect of emotional distance on psychophysiologic concordance and perceived empathy between patient and interviewer. Appl. Psychophysiol. Biofeedback 31, 115–128. doi: 10.1007/s10484-006-9008-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Marzbanrad, F., Kimura, Y., Palaniswami, M., and Khandoker, A. H. (2015). Quantifying the interactions between maternal and fetal heart rates by transfer entropy. PLoS ONE 10:e0145672. doi: 10.1371/journal.pone.0145672

PubMed Abstract | CrossRef Full Text | Google Scholar

McAssey, M. P., Helm, J., Hsieh, F., Sbarra, D. A., and Ferrer, E. (2013). Methodological advances for detecting physiological synchrony during dyadic interactions. Methodology. 9, 41–53. doi: 10.1027/1614-2241/a000053

CrossRef Full Text | Google Scholar

Misal, V., Akiri, S., Taherzadeh, S., McGowan, H., Williams, G., Jenkins, J. L., et al. (2020). “Physiological synchrony, stress and communication of paramedic trainees during emergency response training,” in Companion Publication of the 2020 International Conference on Multimodal Interaction, (Utrecht), 82–86.

Google Scholar

Monin, J. K., and Schulz, R. (2009). Interpersonal effects of suffering in older adult caregiving relationships. Psychol. Aging 24, 681–695. doi: 10.1037/a0016355

PubMed Abstract | CrossRef Full Text | Google Scholar

Mønster, D., Håkonsson, D. D., Eskildsen, J. K., and Wallot, S. (2016). Physiological evidence of interpersonal dynamics in a cooperative production task. Physiol. Behav. 156, 24–34. doi: 10.1016/j.physbeh.2016.01.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Motta-Ochoa, R., Incio-Serra, N., Boulet, A., Fu, D., Frantz, A., William, M., et al. (2021). Mouvement de passage: creating connections through movement among persons with dementia. Dementia. 20, 2573–2596. doi: 10.1177/14713012211004009

PubMed Abstract | CrossRef Full Text | Google Scholar

Müller, V., and Lindenberger, U. (2011). Cardiac and respiratory patterns synchronize between persons during choir singing. PLoS ONE 6:e24893. doi: 10.1371/journal.pone.0024893

PubMed Abstract | CrossRef Full Text | Google Scholar

Müller, A., Kraemer, J. F., Penzel, T., Bonnemeier, H., Kurths, J., and Wessel, N. (2016). Causality in physiological signals. Physiol. Meas. 37:R46. doi: 10.1088/0967-3334/37/5/R46

PubMed Abstract | CrossRef Full Text | Google Scholar

Nguyen, T., Schleihauf, H., Kayhan, E., Matthes, D., Vrtička, P., and Hoehl, S. (2021). Neural synchrony in mother–child conversation: exploring the role of conversation patterns. Soc. Cogn. Affect. Neurosci. 16, 93–102. doi: 10.1093/scan/nsaa079

PubMed Abstract | CrossRef Full Text | Google Scholar

Palumbo, R. V., Marraccini, M. E., Weyandt, L. L., Wilder-Smith, O., McGee, H. A., Liu, S., et al. (2017). Interpersonal autonomic physiology: a systematic review of the literature. Pers. Soc. Psychol. Rev. 21, 99–141. doi: 10.1177/1088868316628405

PubMed Abstract | CrossRef Full Text | Google Scholar

Picard, R., Vyzas, E., and Healey, J. (2001). Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1175–1191. doi: 10.1109/34.954607

PubMed Abstract | CrossRef Full Text | Google Scholar

Samadani, A., Kim, S., Moon, J., Kang, K., and Chau, T. (2021). Neurophysiological synchrony between children with severe physical disabilities and their parents during music therapy. Front. Neurosci. 15:531915. doi: 10.3389/fnins.2021.531915

PubMed Abstract | CrossRef Full Text | Google Scholar

Schreiber, T. (2000). Measuring information transfer. Phys. Rev. Lett. 85:461. doi: 10.1103/PhysRevLett.85.461

PubMed Abstract | CrossRef Full Text | Google Scholar

Shovon, M. H. I., Nandagopal, N., Ramasamy, V., Du, J., and Cocks, B. (2014). “Towards a cognitive metric using normalized transfer entropy,” in ASE BigData/SocialInformatics/PASSAT/BioMedCom 2014 Conference (Harvard University).

Google Scholar

Slovák, P., Tennent, P., Reeves, S., and Fitzpatrick, G. (2014). “Exploring skin conductance synchronisation in everyday interactions,” in Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, (Helsinki), 511–520.

Google Scholar

Staniek, M., and Lehnertz, K. (2008). Symbolic transfer entropy. Phys. Rev. Lett. 100:158101. doi: 10.1103/PhysRevLett.100.158101

PubMed Abstract | CrossRef Full Text | Google Scholar

Stuldreher, I. V., Thammasan, N., Van Erp, J. B., and Brouwer, A.-M. (2020). Physiological synchrony in eeg, electrodermal activity and heart rate detects attentionally relevant events in time. Front. Neurosci. 14:575521. doi: 10.3389/fnins.2020.575521

PubMed Abstract | CrossRef Full Text | Google Scholar

Sun, L., Shen, M., Ting, K., and Chan, F. (2003). “Analysis of time-varying synchronization of multi-channel eeg signals using wavelet coherence,” in International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003, Vol. 1 (Nanjing: IEEE), 216–219.

Google Scholar

Takamizawa, K., and Kawasaki, M. (2019). Transfer entropy for synchronized behavior estimation of interpersonal relationships in human communication: identifying leaders or followers. Sci. Rep. 9. doi: 10.1038/s41598-019-47525-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Thorson, K. R., West, T. V., and Mendes, W. B. (2018). Measuring physiological influence in dyads: a guide to designing, implementing, and analyzing dyadic physiological studies. Psychol. Methods 23, 595–616. doi: 10.1037/met0000166

PubMed Abstract | CrossRef Full Text | Google Scholar

Timmons, A. C., Chaspari, T., Han, S. C., Perrone, L., Narayanan, S. S., and Margolin, G. (2017). Using multimodal wearable technology to detect conflict among couples. Computer 50, 50–59. doi: 10.1109/MC.2017.83

PubMed Abstract | CrossRef Full Text | Google Scholar

Tschacher, W., and Meier, D. (2020). Physiological synchrony in psychotherapy sessions. Psychother. Res. 30, 558–573. doi: 10.1080/10503307.2019.1612114

PubMed Abstract | CrossRef Full Text | Google Scholar

Veerabhadrappa, R., Hettiarachchi, I. T., and Bhatti, A. (2021). “Using recurrence quantification analysis to quantify the physiological synchrony in dyadic ECG data,” in 2021 IEEE International Systems Conference (SysCon) (Vancouver, BC: IEEE), 1–8.

Google Scholar

Verma, G. K., and Tiwary, U. S. (2014). Multimodal fusion framework: a multiresolution approach for emotion classification and recognition from physiological signals. Neuroimage 102, 162–172. doi: 10.1016/j.neuroimage.2013.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Ward, J. A., Richardson, D., Orgs, G., Hunter, K., and Hamilton, A. (2018). “Sensing interpersonal synchrony between actors and autistic children in theatre using wrist-worn accelerometers,” in Proceedings of the 2018 ACM International Symposium on Wearable Computers, (Singapore), 148–155.

Google Scholar

Washburn, A., DeMarco, M., de Vries, S., Ariyabuddhiphongs, K., Schmidt, R., Richardson, M. J., et al. (2014). Dancers entrain more effectively than non-dancers to another actors movements. Front. Hum. Neurosci. 8:800. doi: 10.3389/fnhum.2014.00800

PubMed Abstract | CrossRef Full Text | Google Scholar

Zee, K. S., and Bolger, N. (2020). Using coupled oscillators to examine physiological coregulation during social support interactions. Multivariate Behav. Res. 55, 157–158. doi: 10.1080/00273171.2019.1699392

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: electrodermal activity (EDA), symbolic transfer entropy (STE), physiological coherence, movement, dementia

Citation: Fu D, Incio-Serra N, Motta-Ochoa R and Blain-Moraes S (2021) Interpersonal Physiological Synchrony for Detecting Moments of Connection in Persons With Dementia: A Pilot Study. Front. Psychol. 12:749710. doi: 10.3389/fpsyg.2021.749710

Received: 29 July 2021; Accepted: 17 November 2021;
Published: 13 December 2021.

Edited by:

Shogo Okada, Japan Advanced Institute of Science and Technology, Japan

Reviewed by:

Kai Kunze, Keio University, Japan
Jiri Pribil, Slovak Academy of Sciences, Slovakia

Copyright © 2021 Fu, Incio-Serra, Motta-Ochoa and Blain-Moraes. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Stefanie Blain-Moraes, stefanie.blain-moraes@mcgill.ca

Download