ORIGINAL RESEARCH article
Nonverbal synchrony of head- and body-movement in psychotherapy: different signals have different associations with outcome
- Department of Psychotherapy, University Hospital of Psychiatry, Bern, Switzerland
Objective: The coordination of patient’s and therapist’s bodily movement – nonverbal synchrony – has been empirically shown to be associated with psychotherapy outcome. This finding was based on dynamic movement patterns of the whole body. The present paper is a new analysis of an existing dataset (Ramseyer and Tschacher, 2011), which extends previous findings by differentiating movements pertaining to head and upper-body regions.
Method: In a sample of 70 patients (37 female, 33 male) treated at an outpatient psychotherapy clinic, we quantified nonverbal synchrony with an automated objective video-analysis algorithm (motion energy analysis). Head- and body-synchrony was quantified during the initial 15 min of video-recorded therapy sessions. Micro-outcome was assessed with self-report post-session questionnaires provided by patients and their therapists. Macro-outcome was measured with questionnaires that quantified attainment of treatment goals and changes in experiencing and behavior at the end of therapy.
Results: The differentiation of head- and body-synchrony showed that these two facets of motor coordination were differentially associated with outcome. Head-synchrony predicted global outcome of therapy, while body-synchrony did not, and body-synchrony predicted session outcome, while head-synchrony did not.
Conclusion: The results pose an important amendment to previous findings, which showed that nonverbal synchrony embodied both outcome and interpersonal variables of psychotherapy dyads. The separation of head- and body-synchrony suggested that distinct mechanisms may operate in these two regions: Head-synchrony embodied phenomena with a long temporal extension (overall therapy success), while body-synchrony embodied phenomena of a more immediate nature (session-level success). More explorations with fine-grained analyses of synchronized phenomena in nonverbal behavior may shed additional light on the embodiment of psychotherapy process.
“Relationships are not created by the brain; rather, the brain was created to serve relationships.”
(Baumeister, 2012, p. 136)
Social interaction is a core ingredient of human existence and people have a basic need to belong to other people (Baumeister and Leary, 1995; Baumeister, 2012). The motive for connection – called communion in interpersonal theory (Horowitz et al., 2006) – is observable in most forms of social exchange and interpersonal behavior. The mechanisms involved in this complex and dynamic interplay are manifold, and traditionally, a basic distinction between verbal and nonverbal communication channels has been made. For a long time, nonverbal behavior has been recognized as an important facet of social interaction (Knapp et al., 2013), and various efforts have been made to use this often overlooked source of information. These attempts have been most evident in truth verification (e.g., Ekman and Friesen, 1974; DePaulo and Rosenthal, 1979; Vrij and Semin, 1996; DePaulo et al., 2003; Duran et al., 2013). For instance, the Supreme Court of Canada has recently ruled that judges and jurors must view a witness to “adequately evaluate body language, facial expressions, and other indicators of credibility” (Porter et al., 2012).
Observable manifestations of nonverbal behavior are best described within the framework of embodiment (Oberzaucher and Grammer, 2008; Storch et al., 2010; Tschacher and Bergomi, 2011), and the association between emotion and motion is also well captured from the stance of embodied cognition (Niedenthal, 2007). In this paper, we will focus on phenomena of embodiment in psychotherapy dyads: a previous study on nonverbal behavior in psychotherapy (Ramseyer and Tschacher, 2011) has identified nonverbal synchrony – the coordination of patient’s and therapist’s body-movement – as an indicator of embodied processes in the therapy dyad. Here, we aim to extend this finding by looking more closely at different regions of the body and how their coordination may relate to indices of success in therapy. We assume that the differentiation between body regions will provide additional insight into the dynamics of nonverbal exchange.
Traditionally, research in the domain of nonverbal communication has strongly focused on signals transmitted by the face (de Gelder, 2009). The human nervous system has specialized subsystems that are fine-tuned for such signals: certain regions of the brain are involved when analyzing facial features for the purpose of, e.g., face recognition (fusiform gyrus: Kanwisher et al., 1997), or decoding of emotional signals in facial displays (amygdala: Morris et al., 1998). Similarly, however, selective cortical areas for visual processing of the human body have been identified (extrastriate body area: Downing et al., 2001; Koningsbruggen et al., 2013). Recent neurophysiological evidence implies that face and body perception may rely on different neurocortical systems (Meeren et al., 2013; Van den Stock et al., 2014). The larger part of these processes occur outside conscious awareness (Whalen et al., 1998) both for the encoding as well as the decoding of actions (e.g., micro-expressions: Matsumoto and Willingham, 2006). There is a consensus in the popular literature on “body language” that body parts farther away from the head (e.g., a person’s legs and feet) are progressively less under conscious control (e.g., Pease and Pease, 2006; Reiman, 2007; Goman, 2008), and would therefore betray a person’s “hidden intentions.” Yet such assertions – to our knowledge – have never been tested empirically.
Generally, nonverbal communication uses dynamical information, not only static features. Therefore, movement dynamics is a core facet in the nonverbal domain. For example, the accuracy of detecting facial emotion in movies (i.e., with visible movements of the face) is significantly higher than in still photographs (Brick et al., 2009). Accordingly, body motion detection and interpretation are crucial for social perception (Grèzes and de Gelder, 2009). Thus, the whole body (not just the face) may be viewed as the essential “signaling device” in emotional processing (de Gelder, 2006), and such signals are prime sources of social information.
From an evolutionary point of view (Boone and Buck, 2003), it is vitally important to accurately navigate in social surroundings, because “the basic discrimination of friend and foe likely was one of the earliest interpersonal judgments to evolve” (Williams and Mattingley, 2006). This implies that apart from the accurate detection and decoding of nonverbal information, relevant implications for the interpersonal consequences of an encounter should also be registered and incorporated into the behavioral and emotional responses of an individual. The association between emotional experience and nonverbal behavior is tightly linked (e.g., Niedenthal et al., 2010; Lausberg and Kryger, 2011; Dael et al., 2012). Grahe and Bernieri (1999, p. 265) stated that “rapport is primarily a physically manifested construct; it is a construct that is visible at the surface and readily apparent. (...) In other words, rapport simply may be visible.” In neurobiological terms, sensorimotor loops and the mirror-neuron system are able to transform the primary perception of a partner’s acts into an interpretation of the partner’s emotions and intentions. Most of these processes occur very fast and outside of conscious awareness (Tamietto and de Gelder, 2010). This is also true for the domain of gross body-movement and locomotion detection (Blake and Shiffrar, 2007). The specificity of movement detection is evident early in life (Baldwin et al., 2001) and it is highly relevant for any kind of human social interaction (Burgoon, 1994). Findings from patients suffering from autism spectrum disorders highlight the social consequences of inaccurate, delayed, or missing nonverbal processing (Klin et al., 2009).
Research on the core ingredients of psychotherapy has pointed to a significant role of the therapeutic alliance: the relationship quality between therapist and patient is one of the best empirically supported predictors of therapy outcome (Horvath et al., 2011; Flückiger et al., 2012). The alliance is considered to have several components such as mutual sympathy, pursuing shared goals, and the overcoming of resistance to change. Psychotherapists in practice always regard their own and their patients’ nonverbal behavior (Hall et al., 1995). Recently, however, this topic has almost disappeared from view in psychotherapy research, as evidenced by the lack of references to nonverbal behavior in the latest edition of the Handbook of Psychotherapy and Behavior Change (Lambert, 2013). At the same time, various new approaches for the analysis of nonverbal behavior have appeared in social and clinical psychology (Frey and von Cranach, 1973; Bänninger-Huber, 1992; Altorfer et al., 2000; Boker and Rotondo, 2002; Grammer et al., 2003; Brick and Boker, 2011; Lavelle et al., 2012). Work on mimicry/imitation focused mainly on directly observable and quantifiable (body) movement behaviors (e.g., foot shaking, face rubbing). Recent, highly sophisticated research has addressed head movement dynamics (Boker et al., 2009), showing that the dynamics was the relevant factor that influenced behavior in participants (Boker et al., 2011). This is also found in research on man-machine interfaces: avatars that mimic the head movements of an interaction partner are evaluated more favorably than avatars that do not display such imitative head movements (Bailenson et al., 2004, 2008; Reidsma et al., 2010). Along a similar line, body sway has been shown to become entrained in everyday face-to-face communication (Higo et al., 2012).
Thus, such advances in different fields suggest that disentangling of different body-movement regions may be a next step for research on nonverbal communication in the context of psychotherapy (Henry et al., 2012). We will base these new analyses on a database that was established by a previous study of psychotherapy dyads (Ramseyer and Tschacher, 2011). In the present article we will be focusing on nonverbal signals transmitted by the face (head movement) in contrast to nonverbal signals transmitted by the body (movement of the upper torso and hands) and how these signals relate to measures of success in psychotherapy. Our approach is mainly descriptive and exploratory – we report the extent of movement in the different body regions and the coordination (i.e., the nonverbal synchrony) of patients and therapists based on movement in these regions. Our expectation was that the nonverbal variables would differ in their associations with therapy outcome measures.
Materials and Methods
The present dataset is a subsample of previously published data (Ramseyer and Tschacher, 2011), which consisted of psychotherapy sessions that were randomly drawn from the entire video-recorded data (N > 5000 recordings) of the outpatient center of the University of Bern, Switzerland. We randomly selected one single session of each dyad of the previous sample. This resulted in a total of N = 70 sessions of psychotherapy from 37 female and 33 male same-sex dyads (mean age 36.5 years, SD = 10.2, all white Caucasian European ethnicity). The sample contained 33 sessions from the initial phase and 37 sessions from the final phase of the respective patient’s therapy. Patients belonged to the following main diagnostic groups: 34% anxiety disorders, 29% affective disorders, 37% other diagnoses (11.4% adjustment disorders, 8.6% personality disorders, 17% other disorders). Comorbidity was predominantly found in anxiety disorders (58% comorbid patients) and affective disorders (24%). These percentages are closely representative of the complete database of the outpatient center of N = 838 cases, where 35.1% of patients were diagnosed with anxiety disorders, 24.8% affective disorders, 10.5% adjustment disorder, 4.3% eating disorders, and 15% with no axis-1 disorder. All clinical diagnoses were assessed before initiation of therapy using the Structured Clinical Interview (SCID; Wittchen et al., 1997) for the Diagnostic and Statistical Manual of Mental Disorders [DSM-IV; American Psychiatric Association (APA), 1994].
Mean psychotherapy duration per patient of the present sample was 38.1 sessions (SD = 22.1, range 8–126). Recording of therapy sessions was part of routinely ongoing research activity and quality assurance. Sessions were generally conducted once a week, each lasting 50 min on average. Patients and therapists sat in comfortable chairs facing each other with an angle of ∼110° at a distance of 1.5–2.5 m. Administration of psychotherapy and recording of sessions was independent of the research reported here, and took place before the formulation of research hypotheses, from 1998 to 2004. At the time of recording, patients and therapists were informed about further scientific use of their data and gave informed consent according to Swiss ethical regulation policies. For reasons of comparability and standardization, we analyzed only sessions from same-sex dyads, as was done in the previous analysis (Ramseyer and Tschacher, 2011). The limitation to same-sex dyads was based on research showing that mixed-gender dyads displayed lower nonverbal synchrony (Grammer et al., 1998). Only the first 15 min of any therapy session were chosen for our study. This limitation was put in place because we regarded only interaction sequences where dyads remained seated throughout, i.e., 15 min segments of psychotherapy where patients and therapists exclusively engaged in speaking/listening activity. Instances of, e.g., use of a flip chart or similar device, which implied leaving one’s chair, were excluded from analyses.
Motion Energy Analysis
Motion energy analysis (MEA; Ramseyer, 2014) is a theory-free, objective, and fully automated computer program designed to quantify movement behavior in digital video recordings. Motion energy is defined as differences in gray-scale pixels between consecutive video-frames (frame-differencing: Grammer et al., 1997, 1999; Ramseyer and Tschacher, 2006; Nagaoka and Komori, 2008; Altmann, 2011; Paxton and Dale, 2013). Detection of frame-by-frame change allows an objective quantification of movement occurring in spatially pre-defined regions of interest (ROI’s; see Figure 1C). MEA thus generates time-series of raw pixel-change within a ROI that were filtered and corrected prior to further analyses (see Figure 1D). Details of the processing of raw signals are described in Grammer et al. (1999), further information on MEA is provided in Ramseyer and Tschacher (2011) and may be accessed online (www.psync.ch).
FIGURE 1. (A) Original video recording; (B) Difference-image derived by motion energy analysis; (C) Definition of regions of interest; (D) Time-series (35 s shown) of raw movement for each defined region of interest.
Nonverbal synchrony was conceived as a dynamic quality capturing movement characteristics irrespective of the type of posture displayed in a ROI. Nonverbal synchrony thereby constitutes an objective quantification of the dynamic movement characteristics displayed by patient and therapist.
To compute synchrony, the time-series of motion energy (Figure 1D) were cross-correlated (Boker et al., 2002; Derrick and Thomas, 2004) in window segments of 1 min duration, thus taking into consideration the non-stationarity of movement behaviors. Movements were cross-correlated with time-lags up to ±5 s, in order to allow for exactly simultaneous synchronization (lag of 0 s) and delayed synchronization (lags up to ±5 s). Absolute values of cross-correlation were aggregated over the entire interval of 15 min in each session.
Differentiation of Regions of Interest
Separate regions for head movement and upper-body movement were chosen (see Figure 1). Previous work in the psychotherapy setting indicated differences between head movement and body-movement (Fretz, 1966), which was confirmed in a more recent study with schizophrenia patients (Kupper et al., 2010). Two ROIs were defined per participant: the head region covered the head including the neck and thus contains all head and neck movements; the body region covered the upper-body from the chair’s seating-base upward and the arms. Both ROIs are shown in Figure 1C. Boundaries of ROIs were defined such that a zone of non-contact resulted between head and body. This was done in order to minimize possible region-crossings, i.e., movement from one region being erroneously registered in the other region. The most frequent example of region-crossing is self-touch of the facial region by a hand. Spontaneous facial self-touch occurs frequently (Nicas and Best, 2008), and was found to serve emotion-regulative purposes (Grunwald et al., 2014), and to entail notable effects on social impression formation (Harrigan et al., 1987). In the present analysis, we were not specifically interested in self-touch to the facial region, but in overall movement of head- and body-regions. We addressed this possible confounding aspect by simply regarding facial-touch as an instance of head-movement. This simplification/generalization may be considered conservative, because it attenuates the differentiation between head- and body-movement. At the level of statistical testing, we evaluated all synchrony-outcome associations either with or without partialling out the effect of the other region.
Synchrony Versus Pseudosynchrony
A final step in quantifying nonverbal synchrony is to rule out that the detected movement synchrony may be spurious. We therefore corrected for random contingencies between the two movement streams of patient and therapist. In early research on interactional synchrony, a debate addressed the genuineness of Condon and Ogston’s (1966) findings (McDowall, 1978; Gatewood and Rosenwein, 1981). We acknowledge this critical consideration of synchrony findings by implementing a statistical mechanism that prevents false–positive detection of synchrony in psychotherapy sessions. To accomplish this, for each therapy session, we generated N = 100 surrogate datasets by shuﬄing the genuine data. In order to not destroy the microstructure of movement bursts, we shuﬄed each time-series windows-wise: the original structure inside one window remains intact, but due to shuﬄing of a window’s position, it is paired with another window from a different time in the therapy. For example, the motion energy values of the therapist’s behavior from the first minute may be aligned with the patient’s movements from the ninth minute of the same session. The significance of observed movement synchrony in comparison with chance levels of synchrony is then determined by how much the genuine cross-correlation coefficients departed from the mean shuﬄed coefficients (Ramseyer and Tschacher, 2010).
Measures of Psychotherapy Outcome
Two types of outcome measures were used in this study. They captured change from different time-perspectives, which allowed both the quantification of session-level change – called micro-outcome – as well as overall therapy outcome – called macro-outcome (Ramseyer et al., 2014). The differentiation into micro- and macro-outcomes is not to be confounded with the level of evaluation used in, e.g., psychiatric assessments (Tomba and Bech, 2012), where the initial clinical judgment is called “macro-analysis” and a detailed analysis of symptoms is labeled “micro-analysis.” The distinguishing feature of the outcome measures employed in the present study thus lies in their temporal extension: some events in the therapy process may extend to outcome at the session level, whereas other events may have an impact on the outcome of the whole treatment. Therefore, different temporal dynamics are captured by micro- and macro-outcome.
Post-session questionnaires were administered after the termination of each single therapy session as part of routine assessments. Patient (BPSR-P) and therapist (BPSR-T) versions of the Bern Post-Session Report (Flückiger et al., 2010) are self-report measures comprised of 22 (BPSR-P) and 27 (BPSR-T) items loading on five factors that were determined in previous factor analyses (Tschacher et al., 2007). Two factors captured the patient’s view of core properties of therapy process: patient’s alliance (exemplary item, “My therapist and I get along well”) and patient’s self-efficacy (“I feel more capable of solving my problems”). Other factors reflected the therapist’s perspective on alliance (therapist’s alliance: “Today, I felt comfortable with the patient”) and on the interventions implemented by the therapist; the interventions factors were not considered in the present analysis. Internal consistency of BPSR scales ranged from 0.74 to 0.88 as reported by Flückiger et al. (2010). As an extension for the present analyses in this sample, we constructed an additional factor based on three BPSR-T items that captured the therapist’s assessment of a patient’s resistance (“I find this to be an interactionally difficult patient”; “Did the patient show signs of being observant and reactive?”; “Did you notice patient’s resistance during conversation?”; Cronbach alpha = 0.82). These three items are part of the nine-item therapist alliance rating. We decided to also focus on this facet of problematic/oppositional behavior in the therapeutic relationship because we were interested in its association to head- and body-synchrony.
The overall success of therapies was estimated with direct measures of success: patient self-report questionnaires assessing the amount of change caused by psychotherapy were applied once, at termination of a therapy course. In addition to these direct (retrospective) measures of success, further self-report questionnaires administered before and after therapy had been used. Here we report only direct measures of success as indicators of the macro-outcome of treatment (Michalak et al., 2003; Flückiger et al., 2007). Indirect pre-to-post outcome measures yielded lower associations with both head- and body-synchrony.
Goal attainment scaling
Goal attainment scaling (Cardillo and Smith, 1994) assesses to what extent the individual treatment goals explicitly defined at the beginning of therapies were reached. Assessments were performed by patients at the end of therapies. 7-point Likert scales are used, on which higher scores indicate greater goal attainment. The scores used here range from deterioration (-2: most unfavorable outcome thought likely) to no change (0: less than expected success with treatment) to various levels of improvement (4: best anticipated success with treatment). Cardillo and Smith (1994) reported inter-rater reliabilities of 0.87 and 0.71 for independent judges of GAS.
Changes in experiencing and behavior
The VEV [questionnaire to assess changes in experiencing and behavior (Veränderungsfragebogen des Erlebens und Verhaltens)] is a self-report measure used to assess the experienced changes and behavioral changes that are attributed to therapy. In Willutzki’s (1999) version, patients indicate in 27 items using a 7-point Likert scale to what extent their life has changed compared to a time-point directly before therapy (e.g., “Compared with the time prior to initiation of therapy, I feel more relaxed/more tense”). The measure provides a global index of overall improvement. Zielke and Kopf-Mehnert (2001) reported an internal consistency of 0.98 and test–retest reliability of 0.61 over a 8 week period.
Individual-Level Characteristics: Basic Movement Parameters
We begin with findings pertaining to individual movement parameters. A consistent pattern of movement activity was found: the relative amount of movement was expressed as percentage of time with above-threshold movement. Head-movement (PAT = 28.84%; TH = 33.92%) was higher than body-movement (PAT = 15.60%; TH = 21.34%) both in patients [t(69) = 15.79; p < 0.0001; d = 2.09] and in therapists [t(69) = 14.63; p < 0.0001; d = 1.60]. Female and male patients showed significant differences in their basic movement characteristics: female patients moved their heads more than male patients [F = 30.85%; M = 26.56%; t(69) = 2.89; p = 0.005; d = 0.70], while body-movement was similar for patients of both sexes [F = 16.09%; M = 15.07%; t(69) = 0.69; p = 0.508; d = 0.17]. Therapists showed a similar pattern, however, differences between male and female therapists were lower (and insignificant) in comparison to patient differences, both in head regions [F = 34.97%; M = 32.84%; t(69) = 1.24; p = 0.221; d = 0.30] and in body regions [F = 21.36%; M = 21.32%; t(69) = 0.02; p < 0.982; d = 0.01]. The three diagnostic groups were not significantly different in their basic movement parameters (see Table 1).
Dyad-Level Characteristics: Nonverbal Synchrony
Significance of synchrony over pseudosynchrony was found for both ROIs and across all diagnostic groups. The amounts of nonverbal synchrony differed along the following lines: head-synchrony was higher than body-synchrony [0.089 versus 0.084; t(69) = 2.51; p = 0.014; d = 0.33]; no difference in terms of sex or diagnosis was found (all ps > 0.35). The comparison with pseudosynchrony indicated that the magnitude of the synchony-versus-pseudosynchrony difference was much higher in head-synchrony [t(69) = 6.03; p < 0.0001; d = 0.74; medium to high effect-size] than in body-synchrony [t(69) = 2.17; p < 0.05; d = 0.20; low effect-size].
Associations Between Synchrony and Outcome
Head-synchrony was strongly correlated with body-synchrony [r(69) = 0.40; p < 0.001], therefore associations between synchrony and outcomes were also calculated with the synchrony effect of the respective other ROI partialled out (see Table 2). The two sets of outcomes differ with respect to the time of assessment: micro-outcomes are obtained at the end of each session and relate to the current session only; macro-outcomes are assessed upon termination of therapy and relate to the whole course of treatment.
The synchrony-outcome associations indicated a differential pattern of relationships between head- versus body-synchrony and micro- versus macro-outcome: body-synchrony was associated with micro-outcome [r(69) = 0.22–0.45], whereas head-synchrony was to a lesser extent (r = 0.05–0.29). Head-synchrony was related to macro-outcome [r(69) = 0.26; 0.33], whereas body-synchrony was not [r(69) = 0.14; 0.15; see Table 2 for details]. The most notable difference in associations between synchrony and micro-outcome was found in patient’s alliance and body-synchrony [r(69) = 0.45; p < 0.0001] and patient’s alliance and head-synchrony [r(69) = 0.12; p = n.s.]. A reversed pattern showed up in the association between synchrony and macro-outcome: goal attainment was associated with head-synchrony [r(69) = 0.33; p < 0.01], but not with body-synchrony [r(69) = 0.14; p = n.s.].
Nonverbal synchrony is a pervasive phenomenon found in many different situations of human interaction. Building on previous findings in the psychotherapy setting (Ramseyer and Tschacher, 2008, 2011), the present extended analysis addressed the frequencies of head- and body-movement of patients and therapists. Females moved more than male participants in therapeutic dyads, and patients more than therapists. The main goal was to explore the relative contributions of head- versus body-synchrony to the embodiment of session-level assessments (micro-outcome) and global therapy success (macro-outcome). Using the sample of our previous study, we replicated the result that synchrony existed at a level above chance in both head- and body-synchrony. The associations with outcome were at levels equivalent to those previously found. Yet the present analyses uncovered additional patterns of associations with outcome indicating differential aspects of embodied phenomena: synchronized head-movement was associated particularly with the macro-outcome of psychotherapies, whereas synchronized body-movement predicted short-term micro-outcome at the session-level.
The differential contribution of head- and body-synchrony suggests that distinct aspects of embodied cognition may be effective in psychotherapy: the associations of body-synchrony with alliance found at the session-level may be interpreted as evidence for nonverbal signals that operate completely outside of conscious awareness, and thus may be more strongly associated with immediate effects on relationship quality and emotions. Movements of the torso and the changing of seating positions are processes that require little or no conscious deliberation (Dittmann, 1987), which makes them more susceptible to being automatically triggered in resonating individuals. The implicit association of body-movement with emotional processes is a possible example for this purported link: in therapy phases with high emotional activation, an example for such an emotion-regulation strategy is the changing of posture (Scheflen, 1964; Mehrabian, 1969), and at the level of gestures, the use of so-called self-adaptors (Barroso et al., 1978; Ulrich and Harms, 1985; Lausberg and Kryger, 2011) – gestures that are present in times of heightened emotional stress. The same would be true for gestures that accompany speech, especially in the case of so-called beat gestures – gestures with little or no semantic content (Wagner et al., 2014). Gestures have been shown to be synchronized in dialog (Kimbara, 2008; Holler and Wilkin, 2011). From the perspective of embodied cognition (Tschacher and Bergomi, 2011), the associations with patient-rated alliance and therapist-rated resistance would thus reflect the observable nonverbal manifestation of this immediate expression of therapeutic alliance, and possibly resonance in emotion-regulation, between patient and therapist. Therefore, the patient’s general impression of how helpful and how sympathetic the therapist has been in a session would thus be more closely reflected by the synchronized movements of the bodies, not the heads, of interacting persons.
The link with emotional, implicit content was less pronounced in head-movement synchrony: head movement is correlated with speech activity (Heylen et al., 2011) – e.g., nodding one’s head in connection with affirmative verbalisations – which is a more consciously controlled activity. Hadar et al. (1983) found a high proportion of head-movement (89.9%) during speech activity. A patient likely exerts more deliberate control over her/his head movement compared to her/his body-movement. Movements located more toward the periphery of the body are generally assumed to elude conscious control (Pease and Pease, 2006; Reiman, 2007; Goman, 2008). Head-movement synchrony should thus be more closely associated with long-term aspects of the patient–therapist relationship. This would be the case in a session where the patient experienced a lower alliance with the therapist, but where the overall therapy quality was favorable in a way that the patient “stayed in sync” with the therapist in terms of head-synchrony. Thus the level of head-synchrony – as a potential indicator of (verbal and explicit) agreement on treatment goals and overall relationship quality – should be associated with the overall success of therapy, which was true in our sample.
Patients who manage to resonate with the movements of the therapist (or therapists that manage to get patients to adapt a more healthy movement pattern), could thus profit more from the stronger (more stable) bond emerging between them. This would then be reflected by a more successful reaching of therapy goals.
Limitations and Strengths
No set of specific a priori hypotheses had been generated, which implies that the present exploratory findings should be interpreted with caution. Nevertheless, they fit well with current knowledge on embodied processes in psychotherapy dyads and thus may serve as possible starting points for future research.
The data used in this study have the important advantage of having been monitored several years before the formulation or implementation of the nonverbal synchrony approach described here. Neither therapists nor patients had any awareness of the concept of nonverbal synchrony and its potential assessment by MEA. All shown motor behavior was thus completely uninfluenced by the research questions presented here.
Summary and Conclusion
The present findings are in favor of fine-grained analyses of human movement. This analytic approach has been available for several years, yet its application was restricted to rather invasive procedures such as magnetic motion tracking or time-consuming rating techniques. Frame-differencing methods are increasingly available now, and we think that their ease of applicability and the potential for re-analyses of existing material clearly speak for a more wide-spread use. We hope that our present exploration encourages more research that would allow elaborating more and more differential methods that depict qualitatively distinct processes occurring in the domain of nonverbal movement. To cite Freud, we think that apart from the basic questions that may be answered with these tools, the results also offer promise for future use in clinical practice. “A path leads from identification by way of imitation to empathy, that is, to the comprehension of the mechanism by means of which we are enabled to take up an attitude at all toward another mental life” (Freud, 1955, p. 53).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Altmann, U. (2011). “Investigation of movement synchrony using windowed cross-lagged regression,” in Lecture Notes in Computer Science, eds A. Esposito, A. Vinciarelli, K. Vicsi, C. Pelachaud, and A. Nijholt (Heidelberg: Springer-Verlag), 335–345.
Altorfer, A., Jossen, S., Würmle, O., Käsermann, M. L., Foppa, K., and Zimmermann, H. (2000). Measurement and meaning of head movements in everyday face-to-face communicative interaction. Behav. Res. Methods Instrum. Comput. 32, 17–32. doi: 10.3758/BF03200785
Bailenson, J. N., Beall, A. C., Loomis, J., Blascovich, J., and Turk, M. (2004). Transformed social interaction: decoupling representation from behavior and form in collaborative virtual environments. Presence 13, 428–441. doi: 10.1162/1054746041944803
Barroso, F., Freedman, N., Grand, S., and Van Meel, J. (1978). Evocation of two types of hand movements in information processing. J. Exp. Psychol. Hum. Percept. Perform. 4, 321–329. doi: 10.1037/0096-1522.214.171.1241
Baumeister, R. F. (2012). “Need-to-belong theory,” in Handbook of Theories of Social Psychology, Vol. 2, eds P. A. M. Van Lange, A. W. Kruglanski, and E. T. Higgins (London: Sage Publications), 121–141. doi: 10.4135/9781446249222.n32
Boker, S. M., Cohn, J. F., Theobald, B. J., Matthews, I., Brick, T. R., and Spies, J. R. (2009). Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 3485–3495 doi: 10.1098/rstb.2009.0152
Boker, S. M., Cohn, J. F., Theobald, B. J., Matthews, I., Mangini, M., Spies, J. R.,et al. (2011). Something in the way we move: motion dynamics, not perceived sex, influence head movements in conversation. J. Exp. Psychol. Hum. Percept. Perform. 37, 874–891. doi: 10.1037/a0021928
Boker, S. M., and Rotondo, J. L. (2002). “Symmetry building and symmetry breaking in synchronized movement,” in Mirror Neurons and the Evolution of Brain and Language, eds M. Stamenov and V. Gallese (Amsterdam: John Benjamins Publishing Company), 163–171. doi: 10.1075/aicr.42.14bok
Boker, S. M., Xu, M., Rotondo, J. L., and King, K. (2002). Windowed cross-correlation and peak picking for the analysis of variability in the association between behavioral time series. Psychol. Methods 7, 338–355. doi: 10.1037/1082-989X.7.3.338
Boone, R. T., and Buck, R. (2003). Emotional expressivity and trustworthiness: the role of nonverbal behavior in the evolution of cooperation. J. Nonverbal Behav. 27, 163–182. doi: 10.1023/A:1025341931128
Brick, T. R., Hunter, M. D., and Cohn, J. F. (2009). “Get the FACS fast: automated FACS face analysis benefits from the addition of velocity,” in Proceedings of the Third International Conference on Affective Computing and Intelligent Interaction, Geneva, 1–7. doi: 10.1109/ACII.009.5349600
Cardillo, J. E., and Smith, A. (1994). “Psychometric issues,” in Goal Attainment Scaling: Applications, Theory, and Measurement, eds T. J. Kiresuk, A. Smith, and J. E. Cardillo (Mahwah, NJ: Lawrence Erlbaum), 173–212.
Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D., and Horvath, A. O. (2012). How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis. J. Couns. Psychol. 59, 10–17. doi: 10.1037/a0025749
Flückiger, C., Regli, D., Grawe, K., and Lutz, W. (2007). Similarities and differences between retrospective and pre-post measurements of outcome. Psychother. Res. 17, 359–364. doi: 10.1080/10503300600830728
Flückiger, C., Regli, D., Zwahlen, D., Hostettler, S., and Caspar, F. (2010). Der Berner Patienten- und Therapeutenstundenbogen 2000. Z. Klin. Psychol. Psychother. 39, 71–79. doi: 10.1026/1616-3443/a000015
Frey, S., and von Cranach, M. (1973). “A method for the assessment of body movement variability,” in Social Communication and Movement, eds M. von Cranach and I. Vine. (New York, NY: Academic), 389–418.
Grammer, K., Filova, V., and Fieder, M. (1997). “The communication paradox and possible solutions,” in New Aspects of Human Ethology, eds A. Schmitt, K. Atzwanger, K. Grammer, and K. Schaefer (London, New York: Plenum Press), 91–120. doi: 10.1007/978-0-585-34289-4/_6
Grammer, K., Honda, R., Schmitt, A., and Jütte, A. (1999). Fuzziness of nonverbal courtship communication unblurred by motion energy detection. J. Pers. Soc. Psychol. 77, 487–508. doi: 10.1037/0022-35126.96.36.1997
Grammer, K., Keki, V., Striebel, B., Atzmüller, M., and Fink, B. (2003). “Bodies in motion: a window to the soul,” in Evolutionary Aesthetics, eds E. Voland and K. Grammer (Heidelberg: Springer), 295–324.
Grammer, K., Kruck, K. B., and Magnusson, M. S. (1998). The courtship dance: patterns of nonverbal synchronization in opposite-sex encounters. J. Nonverbal Behav. 22, 3–29. doi: 10.1023/A:1022986608835
Grèzes, J., and de Gelder, B. (2009). “Social perception: understanding other people’s intentions and emotions through their actions,” in Social Cognition: Development, Neuroscience, and Autism, eds T. Striano and V. Reid. (Hoboken, NJ: Wiley-Blackwell), 67–78.
Grunwald, M., Weiss, T., Mueller, S., and Rall, L. (2014). EEG changes caused by spontaneous facial self-touch may represent emotion regulating processes and working memory maintenance. Brain Res. 1557, 111–126. doi: 10.1016/j.brainres.2014.02.002
Henry, S. G., Fuhrel-Forbis, A., Rogers, M. A., and Eggly, S. (2012). Association between nonverbal communication during clinical interactions and outcomes: a systematic review and meta-analysis. Patient Educ. Couns. 86, 297–315. doi: 10.1016/j.pec.2011.07.006
Heylen, D., Bevacqua, E., Pelachaud, C., Poggi, I., Gratch, J., and Schröder, M. (2011). “Generating listening behaviour,” in Emotion-Oriented Systems, eds R. Cowie, C. Pelachaud, and P. Petta (Berlin: Springer), 321–347. doi: 10.1007/978-3-642-15184-2_17
Higo, N., Ogata, T., Ono, E., Nozawa, T., Ara, K., Yano, K.,et al. (2012). “Interpersonal entrainment of body sway in everyday face-to-face communication,” in Proceedings of the 2012 IEEE/SICE International Symposium on System Integration (SII), (Fukuoka: IEEE), 906–911. doi: 10.1109/SII.2012.6427363
Horowitz, L. M., Wilson, K. R., Turan, B., Zolotsev, P., Constantino, M. J., and Henderson, L. (2006). How interpersonal motives clarify the meaning of interpersonal behavior: a revised circumplex model. Pers. Soc. Psychol. Rev. 10, 67–86. doi: 10.1207/s15327957pspr1001_4
Klin, A., Lin, D. J., Gorrindo, P., Ramsay, G., and Jones, W. (2009). Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature 459, 257–261. doi: 10.1038/nature07868
Koningsbruggen, M. G. V., Peelen, M. V., and Downing, P. E. (2013). A causal role for the extrastriate body area in detecting people in real-world scenes. J. Neurosci. 33, 7003–7010. doi: 10.1523/JNEUROSCI.2853-12.2013
Kupper, Z., Ramseyer, F., Hoffmann, H., Kalbermatten, S., and Tschacher, W. (2010). Video-based quantification of body movement during social interaction indicates the severity of negative symptoms in patients with schizophrenia. Schizophr. Res. 121, 90–100. doi: 10.1016/j.schres.2010.03.032
Lausberg, H., and Kryger, M. (2011). Gestisches Verhalten als Indikator therapeutischer Prozesse in der verbalen Psychotherapie: Zur Funktion der Selbstberührungen und zur Repräsentation von Objektbeziehungen in gestischen Darstellungen [Gestural behavior as an indicator of therapeutic processes in verbal psychotherapy: on the function of self-adaptors and representations of object relations in gestural displays]. Psychother. Wiss. 1, 41–55.
Lavelle, M., Healey, P. G., and McCabe, R. (2012). Is nonverbal communication disrupted in interactions involving patients with schizophrenia? Schizophr. Bull. 39, 1150–1158. doi: 10.1093/schbul/sbs091
Matsumoto, D., and Willingham, B. (2006). The thrill of victory and the agony of defeat: spontaneous expressions of medal winners of the 2004 Athens Olympic Games. J. Pers. Soc. Psychol. 91, 568–581. doi: 10.1037/0022-35188.8.131.528
Meeren, H. K., de Gelder, B., Ahlfors, S. P., Hämäläinen, M. S., and Hadjikhani, N. (2013). Different cortical dynamics in face and body perception: an MEG study. PLoS ONE 8:e71408. doi: 10.1371/journal.pone.0071408
Michalak, J., Kosfelder, J., Meyer, F., and Schulte, D. (2003). Messung des Therapieerfolgs. Veränderungsmasse oder retrospektive Erfolgsbeurteilung [Measuring therapy outcome – pre-post effect sizes and retrospective measurement]. Z. Klin. Psychol. Psychother. 32, 94–103. doi: 10.1026/1616-34184.108.40.206
Morris, J. S., Friston, K. J., Büchel, C., Frith, C. D., Young, A. W., Calder, A. J.,et al. (1998). A neuromodulatory role for the human amygdala in processing emotional facial expressions. Brain 121, 47–57. doi: 10.1093/brain/121.1.47
Nagaoka, C., and Komori, M. (2008). Body movement synchrony in psychotherapeutic counseling: a study using the video-based quantification method. IEICE Trans. Inf. Syst. E 91-D, 1634–1640. doi: 10.1093/ietisy/e91-d.6.1634
Nicas, M., and Best, D. (2008). A study quantifying the hand-to-face contact rate and its potential application to predicting respiratory tract infection. J. Occup. Environ. Hyg. 5, 347–352. doi: 10.1080/15459620802003896
Niedenthal, P. M., Mermillod, M., Maringer, M., and Hess, U. (2010). The simulation of smiles (SIMS) model: embodied simulation and the meaning of facial expression. Behav. Brain Sci. 33, 417–433. doi: 10.1017/S0140525X10000865
Oberzaucher, E., and Grammer, K. (2008). “Everything is movement: on the nature of embodied communication,” in Embodied Communication in Humans and Machines, eds I. Wachsmuth, M. Lenzen, and G. Knoblich (Oxford: Oxford University Press), 151–177.
Porter, S., ten Brinke, L., and Wallace, B. (2012). Secrets and lies: involuntary leakage in deceptive facial expressions as a function of emotional intensity. J. Nonverbal Behav. 36, 23–37. doi: 10.1007/s10919-011-0120-7
Ramseyer, F. (2014). MEA. Motion Energy Analysis: Objective Quantification of Nonverbal Behavior Dynamics [Software]. Available at: http://www.psync.ch (accessed February 14, 2014).
Ramseyer, F., Kupper, Z., Caspar, F., Znoj, H., and Tschacher, W. (2014). Time-series panel analysis (TSPA): multivariate modeling of temporal associations in psychotherapy process. J. Consul. Clin. Psychol. doi: 10.1037/a0037168 [Epub ahead of print].
Ramseyer, F., and Tschacher, W. (2008). “Synchrony in dyadic psychotherapy sessions,” in Simultaneity: Temporal Structures and Observer Perspectives, eds S. Vrobel, O. E. Rössler, and T. Marks-Tarlow (Singapore: World Scientific), 329–347.
Ramseyer, F., and Tschacher, W. (2010). “Nonverbal synchrony or random coincidence? How to tell the difference,” in Development of Multimodal Interfaces: Active Listening and Synchrony, eds A. Esposito, N. Campbell, C. Vogel, A. Hussain, and A. Nijholt (Berlin: Springer), 182–196.
Ramseyer, F., and Tschacher, W. (2011). Nonverbal synchrony in psychotherapy: coordinated body-movement reflects relationship quality and outcome. J. Consult. Clin. Psychol. 79, 284–295. doi: 10.1037/a0023419
Reidsma, D., Nijholt, A., Tschacher, W., and Ramseyer, F. (2010). “Measuring multimodal synchrony for human-computer interaction,” in Proceedings of the 2010 International Conference on Cyberworlds, ed. A. Sourin (Singapore: IEEE Computer Society Press), 67–71. doi: 10.1109/CW.2010.21
Tschacher, W., Ramseyer, F., and Grawe, K. (2007). Der Ordnungseffekt im Psychotherapieprozess: Replikation einer systemtheoretischen Vorhersage und Zusammenhang mit dem Therapieerfolg [The order effect in the psychotherapy process]. Z. Klin. Psychol. Psychother. 36, 18–25. doi: 10.1026/1616-34220.127.116.11
Van den Stock, J., Tamietto, M., Zhan, M., Heinecke, A., Hervais-Adelman, A., Legrand, L.,et al. (2014). Neural correlates of body and face perception following bilateral destruction of the primary visual cortices. Front. Behav. Neurosci. 8:30. doi: 10.3389/fnbeh.2014.00030
Whalen, P. J., Rauch, S. L., Etcoff, N. L., McInerney, S. C., Lee, M. B., and Jenike, M. A. (1998). Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. J. Neurosci. 18, 411–418.
Willutzki, U. (1999). VEV-VW. Neue Version des Veränderungsfragebogens des Erlebens und Verhaltens von Zielke [VEV-VW. New Version of the Questionnaire to Assess Changes in Experiencing and Behavior]. Bochum: Institut für Psychologie der Ruhr-Universität.
Zielke, M., and Kopf-Mehnert, C. (2001). Der VEV-R-2001: Entwicklung und testtheoretische Reanalyse der revidierten Form des Veränderungsfragebogens des Erlebens und Verhaltens (VEV) [The VEV-R-2001: Questionnaire to Assess Changes in Experiencing and Behavior]. Klin. Verhaltensmed. Rehabil. 53, 7–19.
Keywords: nonverbal synchrony, embodiment, psychotherapy, motion energy analysis, head movement, body-movement, process-outcome research
Citation: Ramseyer F and Tschacher W (2014) Nonverbal synchrony of head- and body-movement in psychotherapy: different signals have different associations with outcome. Front. Psychol. 5:979. doi: 10.3389/fpsyg.2014.00979
Received: 16 May 2014; Accepted: 19 August 2014;
Published online: 05 September 2014.
Edited by:Lara Bellardita, Fondazione IRCCS Istituto Nazionale dei Tumori, Italy
Reviewed by:Daniela Villani, Catholic University of the Sacred Heart, Italy
Cristina Civilotti, Università degli Studi di Torino, Italy
Copyright © 2014 Ramseyer and Tschacher. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Fabian Ramseyer, Department of Psychotherapy, University Hospital of Psychiatry, Laupenstrasse 49, 3010 Bern, Switzerland email: firstname.lastname@example.org