Skip to main content

ORIGINAL RESEARCH article

Front. Hum. Neurosci., 28 January 2020
Sec. Brain Imaging and Stimulation
Volume 14 - 2020 | https://doi.org/10.3389/fnhum.2020.00007

Right Temporoparietal Junction Involvement in Autonomic Responses to the Suffering of Others: A Preliminary Transcranial Magnetic Stimulation Study

  • 1Center for Mind and Brain, University of California, Davis, Davis, CA, United States
  • 2Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States

Functional neuroimaging studies have emphasized distinct networks for social cognition and affective aspects of empathy. However, studies have not considered whether substrates of social cognition, such as the right temporoparietal junction (TPJ), play a role in affective responses to complex empathy-related stimuli. Here, we used repetitive transcranial magnetic stimulation (TMS) to test whether the right TPJ contributes to psychophysiological responses to another person’s emotional suffering. We used a theory of mind functional localizer and image-guided TMS to target the sub-region of the right TPJ implicated in social cognition, and measured autonomic and subjective responses to an empathy induction video. We found evidence that TMS applied at 1 Hz over the right TPJ increased withdrawal of parasympathetic nervous system activity during the empathy induction (n = 32), but did not affect sympathetic nervous system activity (n = 27). Participants who received TMS over the right TPJ also reported feeling more irritation and annoyance, and were less likely to report feeling compassion over and above empathic sadness, than participants who received TMS over the vertex (N = 34). This study provides preliminary evidence for the role of right TPJ functioning in empathy-related psychophysiological and affective responding, potentially blurring the distinction between neural regions specific to social cognition vs. affective aspects of empathy.

Introduction

Although empathy-related responses involve changes in multiple neurobiological systems, few studies have examined central and autonomic system integration in response to observing suffering in others (Hastings et al., 2014). Furthermore, social neuroscience has emphasized the distinctiveness of neural regions associated with cognitive vs. affective components of empathy-related responding, but psychological models have long considered these components to be interdependent (Zaki and Ochsner, 2012). For instance, perspective-taking could be one social-cognitive route to feeling empathy and compassion rather than aversive emotions (Batson et al., 1997; Vaish et al., 2009; Hastings et al., 2014). In this study we used transcranial magnetic stimulation (TMS) to test whether the functioning of one region centrally implicated in social cognition, the right temporoparietal junction (TPJ), is involved in instantiating autonomic and subjective aspects of responding to others’ emotional suffering.

Observing suffering in others can elicit changes in the activity of the parasympathetic and sympathetic branches of the autonomic nervous system (Hastings et al., 2014; Stellar et al., 2015; Miller, 2018). The parasympathetic nervous system downregulates arousal to contribute to a calm, soothed state that is conducive to social engagement (Porges, 2007). The sympathetic nervous system plays an important role in preparing the body for defensive responses to stress (Porges, 2007). In response to emotion induction video procedures, a dynamic pattern of parasympathetic activity characterized by initial decreases followed by rebound has been linked with subjective empathy, prosocial behavior, control of aggression, and positive maternal caregiving (Miller et al., 2013, 2016; Cui et al., 2015; Giuliano et al., 2015). Conversely, increased sympathetic reactivity to emotional stimuli contributes to increased stress-related arousal that undermines prosocial emotions and behaviors (Fabes et al., 1993; Kalvin et al., 2016). In addition, anger and annoyance, emotions that can interfere with compassionate and prosocial responses (Eisenberg, 2000), are typically associated with increased sympathetic and decreased parasympathetic activity (Kreibig, 2010). Taken together, flexible parasympathetic and decreased sympathetic nervous system reactions to others’ distress have been linked to prosocial responses. Conversely, increased sympathetic activity coupled with decreasing or inflexible parasympathetic activity may contribute to heightened arousal that interferes with prosocial emotions and behaviors.

In addition to physiological changes, observing suffering in others can elicit a range of subjective responses, including sharing or resonating with another person’s feelings (i.e., empathy) and feelings of concern coupled with a desire to alleviate the other’s suffering (i.e., compassion; Singer and Klimecki, 2014; Decety, 2015), but can also elicit feelings of annoyance that can lead to hostility. For example, harsh and abusive parents report being more annoyed and irritated by infant cries than non-abusive parents (Frodi and Lamb, 1980); mental health workers can experience increased irritability toward others’ needs as a symptom of work-related stress and burnout (Figley, 2002); and in research on public attitudes toward people with mental health problems, some people report emotional reactions of anger and irritation toward depressed individuals, who experience periods of intense and chronic suffering (Angermeyer and Matschinger, 2004).

Cognitive processes also can provide an understanding of someone else’s thoughts, intentions, and emotions. The cognitive process of taking another person’s perspective has been shown to be rooted in brain regions that are separate from those that support feeling empathy or compassion (Shamay-Tsoory et al., 2009; Kanske et al., 2015; Preckel et al., 2018), or feeling aggravated by others’ suffering (Kim et al., 2015). In particular, the right TPJ shows increased activation to functional magnetic resonance imaging (fMRI)-based social cognition tasks (Saxe and Powell, 2006; Völlm et al., 2006; Cheng et al., 2010), and stimulation of the right TPJ has been shown to interfere with performing tasks that require thinking about the mental states of others (Young et al., 2010; Mai et al., 2016; Coll et al., 2017). Thus, multiple neuroscience methods suggest that the right TPJ is a critical brain region for inferring and reasoning about others’ cognitive and emotional states.

Interestingly, the right TPJ has been consistently linked with distinguishing between self and other representations, or knowing that one’s own affective state is distinct from—albeit potentially due to—the affective state of another person (Decety and Lamm, 2007; Steinbeis, 2016; Lamm et al., 2019). One explanation for right TPJ involvement in perspective-taking and self-other distinction is that the two processes are interrelated. Self-other distinction is an important part of effectively taking another person’s perspective, as empathy and compassion require affective arousal without confusion over whose feelings belong to whom (Batson et al., 1987; de Vignemont and Singer, 2006; Decety and Lamm, 2009). Overlap in self-other representations may contribute to threat-related autonomic states (Buffone et al., 2017) as well as contagion of aversive effect (Decety and Lamm, 2009). Thus, perspective-taking with self-other distinction is a social cognitive process that could inherently regulate affective processes including psychophysiology. In addition, right TPJ activity during emotion introspection has been associated with trait-level affective empathy (Knight et al., 2019), further suggesting that right TPJ functioning may play a role in affective aspects of empathy. However, at the neural level, the potential role of the right TPJ in modulating physiological activity in response to others’ emotional suffering has yet to be examined.

Lastly, the overwhelming majority of neuroscience research on empathy-related responding has related brain activity during fMRI to behavioral measures. Scientists have argued for more brain stimulation studies on empathy using techniques like TMS to complement evidence from other neuroimaging methods (Hétu et al., 2012). Stimulating specific neural regions may provide experimental confirmation of their causal roles in distinct aspects of empathic engagement with others, such as cognitive vs. affective empathy. To date, TMS studies of empathy have almost exclusively focused on cognitive aspects of empathy (Yang et al., 2018). We are aware of only two published TMS studies of affect-related empathy processes; Balconi and Bortolotti (2012) and Balconi and Canavesio (2013) found that stimulation of prefrontal regions affected facial mimicry of, and subjective empathic responsiveness to, pictures of others’ emotional facial expressions. Whether TMS can provide evidence for the role of the right TPJ in autonomic responding to more complex social stimuli is unclear.

The current study used a multi-method approach to test whether right TPJ functioning is necessary for instantiating physiological aspects of empathic responding to others’ emotional suffering. To the extent that perspective-taking and self-other distinction are: (a) psychologically interdependent; (b) dependent on the right TPJ; and (c) important for effective physiological regulation, the functioning of the right TPJ was expected to play a role in promoting parasympathetic flexibility. Disruption of the right TPJ using TMS was expected to decrease parasympathetic flexibility or increase parasympathetic withdrawal, and potentially increase sympathetic nervous system activity, in response to others’ suffering. In a secondary, complementary analysis, we evaluated whether receiving TMS over the right TPJ was linked to experiencing less compassion and empathy and more annoyance/irritation during the emotion induction procedure.

Materials and Methods

Participants

This study initially included 41 right-handed young adults with normal or corrected-to-normal vision (30 females; Mean age = 21.47, SD = 3.33, range = 18–31). Seven participants were dropped from analyses due to refusing TMS or not participating in both sessions. Thus, the final sample included 34 participants (25 females; Mean age = 20.86, SD = 2.75, range = 18–30). Individuals were screened for contraindication to TMS (Rossi et al., 2009) and were excluded from participating if they met any of the following criteria: metal in the body that could not be removed, fear of small spaces, pregnant, history of neurological disorders or head trauma, history of seizures, significant visual or hearing impairment, developmental delays or psychiatric disorders, major medical problems, and taking prescription medications. Alcohol use was assessed (Saunders et al., 1993), and individuals who regularly engaged in heavy/binge drinking were also excluded. All participants provided written consent, and the study protocol was approved by the institutional review board of our university and carried out in compliance with the Declaration of Helsinki.

Procedure

Each participant took part in two sessions that were on average 18 days apart (SD = 11.43). In the first session, participants underwent structural and functional MRI. This included a theory of mind task used to localize the right TPJ activity for each participant (Dodell-Feder et al., 2011). In the second session, electrodes were attached to the chest and back to measure parasympathetic and sympathetic nervous system activity using electrocardiograph (ECG) and impedance cardiograph signals. Participants were randomly assigned to receive 20 min of repetitive TMS either over the vertex (control condition; n = 17; 13 females; Mean age = 20.87, SD = 2.17, range = 18–26) or over the right TPJ (n = 17; 12 females; Mean age = 20.86, SD = 3.35, range = 18–30). After completing the TMS administration, participants first played a non-emotional computer game, then watched a neutral film clip, then a sadness induction film clip and reported on their subjective emotional experiences. Repetitive TMS leads to disruption of neural activity and behavioral effects that outlast the duration of TMS for roughly 50–200% of the duration of stimulation (Walsh and Cowey, 2000).

Neutral Film

To assess whether TMS over the vertex vs. right TPJ had differential effects on physiology in general (i.e., not specific to the sadness induction), cardiac data were recorded while participants viewed a 2 min instructional film clip meant to be neutral in content. This film clip has been used in previous studies of emotion as a neutral baseline (Troy et al., 2013). The neutral film clip was presented on average 10.57 min after administration of TMS (SD = 3.66, range = 0.91–18.58). The neutral film clip was presented immediately before the emotion induction procedure.

Emotion Induction Procedure

Cardiac data were recorded during a sadness induction procedure that involved watching a 2 min 39 s clip from The Champ, which has been used extensively to study physiological and subjective aspects of empathic sadness (Marsh et al., 2008; Hastings et al., 2009; Seider et al., 2011). This film clip presents a boy experiencing emotional distress in response to the death of his father after a boxing match. The video was presented on average 13.38 min after administration of TMS (SD = 3.54, range = 4.15–21.99). Following the video, participants were asked to rate on a 7-point Likert scale ranging from 1 (Not at all) to 7 (Extremely/a great deal) the degree to which they experienced different emotions during the film clip (afraid/scared, annoyed/irritated, anxious, compassion/sympathy, happy, sad, and warmth/tenderness). The emotion terms were presented in a random order across participants. Given that sadness was the primary emotion depicted in the film clip, we used ratings of sadness as a measure of subjective empathy. To measure compassionate and hostile emotional responding to others’ suffering, we used the ratings of compassion/sympathy and annoyed/irritated, respectively.

MRI Procedure

At the first session, anatomical and fMRI data were acquired using a Siemens 3T Tim Trio scanner with a 32-channel head coil. A high-resolution anatomical image was obtained for each participant using an MPRAGE pulse sequence with a 2,500 ms repetition time (TR), 4.33 ms echo time (TE), 7° flip angle, 0.9 × 0.9 × 0.9 voxels, 208 slices, and 243 mm field-of-view (FOV). Functional images were acquired using a gradient echo pulse sequence with 2,000 ms TR, 27 ms TE, 80° flip angle, 3.5 × 3.5 × 3.5 mm voxels, 35 slices, and 224 mm FOV.

We used a functional localizer to identify each participant’s right TPJ. Participants underwent an fMRI task that presented false-belief stories (i.e., inferences about someone’s beliefs) vs. stories that required inferences about faulty information in photographs (Dodell-Feder et al., 2011). There were two runs of 10 trials including five false-belief stories and five false-photograph stories. Each trial consisted of a 14 s story and was separated by a 12 s fixation screen. This fMRI task was specifically designed to localize right TPJ activation related to social cognition (i.e., theory of mind; Dodell-Feder et al., 2011). Given that we were interested in testing whether the sub-region of the right TPJ implicated in social cognition is causally involved in empathy-related psychophysiology and affect, we chose to use this theory of mind task to guide TMS instead of an emotion induction paradigm. Figure 1 shows the average right TPJ location based on the functional localizer task.

FIGURE 1
www.frontiersin.org

Figure 1. Average location of the right temporoparietal junction (TPJ) based on the theory of mind functional localizer task. The red circle is around the right TPJ cluster. The red portion of the cluster represents the peak activation for contrasting stories about beliefs vs. stories about photographs.

Each participant’s data were preprocessed and analyzed using AFNI (Cox, 1996). Data were motion-corrected, registered to the first volume, and smoothed using a 6 mm half-maximum Gaussian kernel. BOLD response for each trial was modeled using a boxcar regressor of 14 s. The fixation cross was treated as the implicit baseline condition. For each participant, the right TPJ was defined based on a single subject whole-brain analysis of the contrast between false-belief stories and false-photograph stories. AFNI’s 3dClustSim (version AFNI_16.3.05, 2016) was used to identify the minimum cluster size for each participant’s right TPJ as a voxel-wise threshold of p = 0.001 to obtain an overall alpha of p < 0.01.

TMS Procedure

In the second session, we used a Magstim Super Rapid TMS system with a figure-8 shaped coil air-cooled by a vacuum powered fan. In both the control and right TPJ group, low-frequency (1 Hz) TMS was applied for 20 min at 100% of each participant’s motor threshold. The motor threshold was determined by examining the minimum stimulator output required to elicit thumb movement for 50% of TMS pulses over the motor cortex (Varnava et al., 2011). We used Brainsight software (Rogue Industries, Standish, ME, USA) to localize TMS to the stimulation site based on each participant’s anatomical data (control group) or anatomical combined with functional MRI data (right TPJ group). For each individual in the control group, the vertex was defined as the meeting point between the left and right postcentral gyri (Ruff et al., 2006). The coil was placed tangentially against the scalp and oriented in an upright position with the handle pointing posteriorly. For the right TPJ group, each participant’s stimulation site was defined by their functional localizer task data coregistered with their anatomical data in native space. The coil was placed tangentially against the scalp and oriented with the handle pointing posteriorly and approximately 45 degrees to the central sulcus in the right TPJ group. Brainsight was used to monitor accurate coil position during TMS for both conditions.

Psychophysiological Data

ECG and impedance data obtained during the neutral and emotion induction videos were processed using software from MindWare Technologies. Pre-Ejection period (PEP) was used as a measure of sympathetic nervous system activity. PEP is the time in milliseconds between cardiac ventricular depolarization and opening of the aortic valve. Shorter PEP reflects greater sympathetic nervous system activity. Due to not providing useable impedance data or technical problems, PEP data were missing for four participants in the right TPJ group and three participants in the control group. The root-mean-square of successive differences (RMSSD) was used as a measure of heart rate variability related to parasympathetic nervous system activity. Due to technical problems, RMSSD data were missing for 2 participants in the control group.

PEP and RMSSD values were computed for the duration of the neutral film clip and in four 40 s segments of the Champ film clip. The inspection of the data showed one participant with an extreme outlier value for RMSSD (greater than the mean by 1.5 times the difference between quartile 1 and 3). This participant’s RMSSD data was winsorized to maintain the rank-order within the sample by bringing their value down to the second-highest value and adding one.

Analyses

We used mixed analysis of variance (ANOVA) models to examine the effects of applying TMS to the right TPJ on experiential and physiological responses to others’ suffering. This included planned comparisons of the effects of TMS on subjective feelings and overall patterns of change in RMSSD and PEP (i.e., linear vs. quadratic change) over the course of the film. All participants with available data were used for these analyses.

Results

Descriptive statistics are presented in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Descriptive statistics of key study variables.

Physiology During Neutral Film Clip

Participants in the right TPJ and vertex groups did not differ in terms of RMSSD or PEP during the neutral film clip (both |t| < 1.43, p > 0.163).

Physiology During Sad Film Clip

To analyze the effect of TMS site on parasympathetic and sympathetic nervous system activity during the sadness induction video, a 2 (group: right TPJ vs. vertex) × 4 (epoch of champ video) mixed ANOVA was conducted for each of RMSSD and PEP. Mauchly’s test showed that the assumption of sphericity had been violated for RMSSD (χ(5)2 = 29.02, p < 0.001) and PEP (χ(5)2 = 32.00, p < 0.001). Thus, degrees of freedom were corrected using Greenhouse-Geisser estimates of sphericity (RMSSD ε = 0.66, PEP = ε = 0.56).

For RMSSD, there was no significant main effect of epoch, F(1.97,59.03) = 1.78, p = 0.178, partial η = 0.06. There was a significant interaction effect of site of TMS on quadratic change in RMSSD over the course of the sadness induction video, F(1,30) = 5.98, p = 0.021, partial η = 0.17 (see Figure 2). Participants who received TMS to the right TPJ showed a pattern of accelerating decreases in RMSSD as the intensity of the depicted sadness increased over the course of the video. This pattern was characterized by statistically nonsignificant decreases in RMSSD from epochs 1 to 2 (Mean difference = −0.87, p = 0.778) and 2 to 3 (Mean difference = −1.75, p = 0.397), and a significant decrease in RMSSD from epochs 3 to 4 (Mean difference = −5.01, p = 0.038). Looking at the overall change, participants who received TMS to the right TPJ decreased RMSSD from the beginning to the end of the sadness induction video (from epoch 1 to 4) at the trend level (Mean difference = −7.63, p = 0.084). Conversely, participants who received TMS to the vertex showed a pattern of initial decrease followed by accelerating rebound in RMSSD over the course of the sadness induction video, matching the patterns that have been previously observed in other samples (Cui et al., 2015; Miller et al., 2016). RMSSD at the beginning and end of the sadness induction video were not significantly different for participants who received TMS to the vertex (Mean difference = −2.24, p = 0.625). By epoch 4, RMSSD was significantly higher for participants in the vertex group than for those in the TPJ group, t(30) = 2.07, p = 0.047.

FIGURE 2
www.frontiersin.org

Figure 2. Effect of transcranial magnetic stimulation (TMS) site on root mean square of successive differences (RMSSD) during the sadness induction video. Error bars represent the standard errors of the means.

For PEP, there was a significant main effect of epoch, F(1.69,42.29) = 9.25, p = 0.001, partial η = 0.27, but no interaction between epoch and TMS group, F(1.69,42.29) = 1.00, p = 0.364, partial η = 0.04. For the whole sample, there were significant linear, F(1,25) = 12.39, p = 0.002, partial η = 0.33, and quadratic changes, F(1,25) = 4.57, p = 0.042, partial η = 0.16, in PEP suggesting a general trend of increasing PEP length (i.e., decreasing sympathetic nervous system activity) over the course of the video induction. Looking at the overall change from epoch 1 to 4, PEP was significantly longer by the end of the sadness induction video compared to the beginning (Mean difference = 3.07, p = 0.001), indicating that sympathetic nervous system activity had decreased over the course of the induction for participants in both TMS conditions. Figure 3 presents the change in PEP over the course of the sadness induction for participants who received TMS to the right TPJ vs. the vertex.

FIGURE 3
www.frontiersin.org

Figure 3. Effect of TMS site on pre-ejection period (PEP) during the sadness induction video. Error bars represent the standard errors of the means.

Subjective Emotional Experience

Participants who reported feeling more annoyed/irritated in response to the sadness induction reported feeling less compassion/sympathy (whole sample r = −0.64, p < 0.001; right TPJ group r = −0.52, p = 0.033; vertex group r = −0.69, p = 0.002) and sadness (whole sample r = −0.44, p = 0.009; right TPJ group r = −0.60, p = 0.011; vertex group r = −0.53, p = 0.028). Ratings of compassion/sympathy and sadness were positively correlated (whole sample r = 0.50, p = 0.002; right TPJ group r = 0.50, p = 0.043; vertex group r = 0.88, p < 0.001).

Figure 4 presents the reports of subjective emotional experiences of participants who received TMS to the right TPJ vs. the vertex. To analyze the effect of TMS site on subjective emotion, we conducted a 2 (group: right TPJ vs. vertex) × 3 (emotion: annoyed/irritated vs. compassion/sympathy vs. sad) mixed ANOVA. Mauchly’s test showed that the assumption of sphericity had been violated (χ(2)2 = 15.27, p < 0.001). Thus, degrees of freedom were corrected using Greenhouse-Geisser estimates of sphericity (ε = 0.72). A significant main effect of emotion, F(1.44,46.08) = 105.00, p < 0.001, partial η = 0.77, was subsumed within a significant interaction between TMS group and emotion, F(1.44,46.08) = 3.77, p = 0.044, partial η = 0.11 (see Figure 1). In response to the sadness induction video, participants who received TMS to the right TPJ reported significantly more annoyance/irritation compared to participants who received TMS to the vertex (p = 0.013). The two groups did not differ in their reports of compassion (p = 0.102) or sadness (p = 0.690).

FIGURE 4
www.frontiersin.org

Figure 4. Effect of TMS site on reported feelings during the sadness induction video. Error bars represent the standard errors of the means.

Although the two groups did not differ in their mean levels of compassion and sadness, there were significant differences between participants in the two TMS groups in the relative strengths of their affective arousal, specifically in their reported experiencing of annoyance/irritation relative to compassion/sympathy, F(1,32) = 5.90, p = 0.021, partial η = 0.16, and compassion/sympathy relative to sadness, F(1,32) = 5.34, p = 0.027, partial η = 0.14. Participants who received TMS to the vertex reported more compassion/sympathy relative to annoyance/irritation than participants who received TMS to the right TPJ (p = 0.021). In addition, participants who received TMS to the vertex reported significantly more compassion/sympathy than sadness (p = 0.037), whereas participants who received TMS to the right TPJ reported similar levels of compassion/sympathy and sadness (p = 0.284).

Taken together, participants who received TMS to the right TPJ had a profile of feeling more irritation/annoyance than participants in the control group. The right TPJ group reported similar levels of compassion/sympathy and sadness, whereas the control group reported feeling more compassion/sympathy than sadness. Participants in the control group also reported a larger difference in their ratings of compassion/sympathy relative to annoyance/irritation than the participants in the right TPJ group.

Discussion

This preliminary study suggests that disrupting right TPJ activity with offline TMS affects physiological, and potentially some aspects of experiential, responses to others’ suffering. In response to a film clip depicting a child experiencing loss and sadness, TMS over the right TPJ appeared to lead to the withdrawal of parasympathetic nervous system activity. Conversely, participants who received TMS to the vertex demonstrated a pattern of parasympathetic flexibility (i.e., an initial decrease followed by rebound in parasympathetic activity) consistent with what has been observed in other samples (Cui et al., 2015; Miller et al., 2016). The right TPJ is widely considered an important neural region for social cognition, but our findings provide evidence that the right TPJ may also play a role in autonomic and affective responses to others’ suffering.

Right TPJ functioning appears to be important in modulating autonomic reactivity to others’ emotional suffering. These findings were not due to differences in overall arousal, as the two TMS groups did not differ in their physiological responses to a neutral film clip. In response to the sad film clip, TMS to the right TPJ induced a pattern of decreasing parasympathetic activity. The control group demonstrated a specific dynamic pattern of initially decreasing followed by rebounding parasympathetic activity. Previous studies have associated this pattern of parasympathetic flexibility with greater prosociality (Cui et al., 2015; Miller et al., 2016). One interpretation of this pattern of parasympathetic activity is that it reflects a sequence of first orienting to the other’s distress via some arousal (decreasing HRV) followed by calm, social engagement with that distress (HRV rebound; Hastings and Miller, 2014; Miller, 2018). The parasympathetic nervous system is considered to be a key part of a social engagement system, whereas autonomic arousal driven by the sympathetic nervous system can contribute to defensive responding (Porges, 2007). Interestingly, we did not find evidence that TMS to the right TPJ affected the sympathetic nervous system responding. Taken together, TMS to the right TPJ appeared to produce parasympathetic responses previously linked to less concern for others and less prosocial behavior. One interpretation of these findings is that the social cognitive processes supported by the right TPJ have downstream consequences for organizing parasympathetic responses in empathy contexts. These findings inform brain-body models of responding to others’ suffering by highlighting potential pathways by which central and autonomic systems interact. Right TPJ and parasympathetic functioning may be integrated central and autonomic components, respectively, of a social engagement system.

In addition to autonomic responding, the right TPJ may play a role in avoiding feeling aggravated by others’ suffering. One interpretation of this finding is that social cognitive processes supported by the right TPJ contribute to effective emotion regulation, including inhibition of feelings that can lead to hostility or avoidance of others’ distress. TMS to the right TPJ did not affect levels of empathic sadness, which is in line with the perspective that dissociable networks are implicated in cognitive and affective aspects of empathy (Preckel et al., 2018). However, the right TPJ group reported feeling similar levels of compassion and empathic sadness, whereas participants in the control group reported feeling more compassion than empathic sadness. It has been argued that compassion reflects feeling for another in need or distress and that empathy reflects feeling with or similar to another (Singer and Klimecki, 2014). The right TPJ has consistently been linked to perspective-taking with self-other distinction, and these social cognitive processes may contribute to experiencing compassion above and beyond empathic sadness. Although compassion and empathy are generally both considered emotional mechanisms of prosociality (de Waal, 2008; Davidov et al., 2016), compassion is more strongly linked to positive social and personal outcomes like prosocial behavior toward others (Jordan et al., 2016) and increased positive affect (Klimecki et al., 2013). Thus, participants who received TMS to the vertex reported experiencing an emotional profile that may be more positive and prosocial than the profile of emotions experienced by people who received TMS to the right TPJ. Whether these observed emotional profiles: (a) are due to TMS undermining social cognition; and (b) actually lead to different behavioral outcomes, are still open questions. A number of studies have posited that the link between the right TPJ and prosocial behavior is due to perspective-taking skills (Telzer et al., 2011; Morishima et al., 2012). Future research should test the possibility that downstream effects of right TPJ functioning on affective processing might mediate the link between social cognition and prosocial behavior.

There are a number of limitations of this preliminary study that should be considered. First, behavioral measures of perspective-taking or self-other distinction were not included. Given that these social cognitive processes are rooted in right TPJ functioning, presumably they were altered by disrupting the right TPJ activity. However, future research that includes these measures are necessary to confirm whether these social cognitive processes mediate the link between right TPJ functioning and affective response to others’ suffering. Second, a larger sample may have been needed to detect effects on compassion and sympathetic nervous system functioning than were evident for annoyance/irritation and parasympathetic functioning. In addition, applying TMS to the right TPJ and a control region within the same participants across multiple sessions and examining changes in affective responding would be a strong replication and extension of the present preliminary study. Third, we did not collect baseline ratings of subjective feelings. Thus, although we asked participants to report on their feelings during the empathy-induction video, we could not directly test whether group differences in subjective feelings were specific to this period. TMS over the TPJ generally produces more discomfort during stimulation than TMS over the vertex. This could have contributed to the TPJ group reporting greater annoyance, but it should be noted that the empathy-induction video and emotion ratings were administered, on average, more than 10 min after the conclusion of TMS. Fourth, the right TPJ may consist of an anterior portion that is more involved in reorienting attention and a posterior portion dedicated to social cognition (Krall et al., 2015). We cannot rule out that TMS in our study did not partially stimulate the more anterior region of the right TPJ and that this could have contributed to some of the findings. However, we used a theory of mind functional localizer and image-guided TMS to target the specific region of the right TPJ implicated in social cognition for each participant. Lastly, although the current study focused on the right TPJ functioning, spreading of stimulation to other regions strongly connected to the TPJ likely also occurred (Valero-Cabré et al., 2005). The right TPJ is connected to other regions implicated in social cognitive processes, including the precuneus, posterior cingulate, middle temporal gyrus, temporal pole, and medial prefrontal cortex (Krall et al., 2015). Although the effects of TMS on neural activity are strongest in the targeted region, indirect activation in other regions connected to the right TPJ may have also contributed to our findings.

There is a large literature that suggests that the right TPJ is important for social cognition, but the present findings link right TPJ functioning to physiological and subjective components of emotion in an empathy-induction task. We interpret the observed effects of TMS in this study as preliminary evidence that the right TPJ contributes to physiological and experiential aspects of responding to others’ suffering. The right TPJ is widely considered a core part of a social cognition network that is distinct from networks that support empathic sharing of emotion and compassion. At the same time, it is important to keep in mind that social cognitive and affective processes are strongly interactive. Right TPJ functioning may be important for affective processes in response to complex social stimuli, but more brain stimulation research is necessary to replicate and build on these preliminary findings.

Data Availability Statement

The dataset that was analyzed for this study can be found at https://osf.io/t5dw7/.

Ethics Statement

The studies involving human participants were reviewed and approved by UC Davis Institutional Review Board. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

JM, GX, and PH designed the study. JM collected, processed, and analyzed the data. JM drafted the manuscript. GX and PH provided critical revisions. All authors approved the final version of the manuscript.

Funding

This work was supported by the National Institute of Mental Health (T32-MH020006; T32-MH019908), which provided financial support for JM, and an Imaging Research Center seed grant from the UC Davis Center for Mind and Brain, which provided funds for scanning participants. Open access publication fees were partially covered by the UC Davis Library.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank Alice Wuermli, Angelica Carranza, Michelle Shi, and Laura Ong for their help with data collection.

References

Angermeyer, M. C., and Matschinger, H. (2004). Public attitudes to people with depression: have there been any changes over the last decade? J. Affect. Disord. 83, 177–182. doi: 10.1016/j.jad.2004.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Balconi, M., and Bortolotti, A. (2012). Detection of the facial expression of emotion and self-report measures in empathic situations are influenced by sensorimotor circuit inhibition by low-frequency rTMS. Brain Stimul. 5, 330–336. doi: 10.1016/j.brs.2011.05.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Balconi, M., and Canavesio, Y. (2013). High-frequency rTMS improves facial mimicry and detection responses in an empathic emotional task. Neuroscience 236, 12–20. doi: 10.1016/j.neuroscience.2012.12.059

PubMed Abstract | CrossRef Full Text | Google Scholar

Batson, C. D., Early, S., and Salvarani, G. (1997). Perspective taking: imagining how another feels versus imagining how you would feel. Pers. Soc. Psychol. Bull. 23, 751–758. doi: 10.1177/0146167297237008

CrossRef Full Text | Google Scholar

Batson, C. D., Fultz, J., and Schoenrade, P. A. (1987). Distress and empathy: two qualitatively distinct vicarious emotions with different motivational consequences. J. Pers. 55, 19–39. doi: 10.1111/j.1467-6494.1987.tb00426.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Buffone, A. E. K., Poulin, M., Delury, S., Ministero, L., Morrisson, C., and Scalco, M. (2017). Don’t walk in her shoes! Different forms of perspective taking affect stress physiology. J. Exp. Soc. Psychol. 72, 161–168. doi: 10.1016/j.jesp.2017.04.001

CrossRef Full Text | Google Scholar

Cheng, Y., Chen, C., Lin, C. P., Chou, K. H., and Decety, J. (2010). Love hurts: an fMRI study. NeuroImage 51, 923–929. doi: 10.1016/j.neuroimage.2010.02.047

PubMed Abstract | CrossRef Full Text | Google Scholar

Coll, M. P., Tremblay, M. P. B., and Jackson, P. L. (2017). The effect of tDCS over the right temporo-parietal junction on pain empathy. Neuropsychologia 100, 110–119. doi: 10.1016/j.neuropsychologia.2017.04.021

PubMed Abstract | CrossRef Full Text | Google Scholar

Cox, R. W. (1996). AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29, 162–173. doi: 10.1006/cbmr.1996.0014

PubMed Abstract | CrossRef Full Text | Google Scholar

Cui, L., Morris, A. S., Harrist, A. W., Larzelere, R. E., Criss, M. M., and Houltberg, B. J. (2015). Adolescent RSA response during an anger discussion task: relations to emotion regulation and adjustment. Emotion 15, 360–372. doi: 10.1037/emo0000040

PubMed Abstract | CrossRef Full Text | Google Scholar

Davidov, M., Vaish, A., Knafo-Noam, A., and Hastings, P. D. (2016). The motivational foundations of prosocial behavior from a developmental perspective-evolutionary roots and key psychological mechanisms: introduction to the special section. Child Dev. 87, 1655–1667. doi: 10.1111/cdev.12639

PubMed Abstract | CrossRef Full Text | Google Scholar

de Vignemont, F., and Singer, T. (2006). The empathic brain: how, when and why? Trends Cogn. Sci. 10, 435–441. doi: 10.1016/j.tics.2006.08.008

PubMed Abstract | CrossRef Full Text | Google Scholar

de Waal, F. B. (2008). Putting the altruism back into altruism: the evolution of empathy. Ann. Rev. Psychol. 59, 279–300. doi: 10.1146/annurev.psych.59.103006.093625

PubMed Abstract | CrossRef Full Text | Google Scholar

Decety, J. (2015). The neural pathways, development and functions of empathy. Curr. Opin. Behav. Sci. 3, 1–6. doi: 10.1016/j.cobeha.2014.12.001

CrossRef Full Text | Google Scholar

Decety, J., and Lamm, C. (2007). The role of the right temporoparietal junction in social interaction: how low-level computational processes contribute to meta-cognition. Neuroscientist 13, 580–593. doi: 10.1177/1073858407304654

PubMed Abstract | CrossRef Full Text | Google Scholar

Decety, J., and Lamm, C. (2009). “Empathy vs. personal distress,” in The Social Neuroscience of Empathy, eds J. Decety and W. Ickes (Cambridge, MA: MIT Press), 199–214.

Dodell-Feder, D., Koster-Hale, J., Bedny, M., and Saxe, R. (2011). fMRI item analysis in a theory of mind task. Neuroimage 55, 705–712. doi: 10.1016/j.neuroimage.2010.12.040

PubMed Abstract | CrossRef Full Text | Google Scholar

Eisenberg, N. (2000). Emotion, regulation and moral development. Ann. Rev. Psychol. 51, 665–697. doi: 10.1146/annurev.psych.51.1.665

PubMed Abstract | CrossRef Full Text | Google Scholar

Fabes, R. A., Eisenberg, N., and Eisenbud, L. (1993). Behavioral and physiological correlates of children’s reactions to others in distress. Dev. Psychol. 29, 655–663. doi: 10.1037/0012-1649.29.4.655

CrossRef Full Text | Google Scholar

Figley, C. R. (2002). Compassion fatigue: psychotherapists’ chronic lack of self care. J. Clin. Psychol. 58, 1433–1441. doi: 10.1002/jclp.10090

PubMed Abstract | CrossRef Full Text | Google Scholar

Frodi, A. M., and Lamb, M. E. (1980). Child abusers’ responses to infant smiles and cries. Child Dev. 51, 238–241. doi: 10.2307/1129612

PubMed Abstract | CrossRef Full Text | Google Scholar

Giuliano, R. J., Skowron, E. A., and Berkman, E. T. (2015). Growth models of dyadic synchrony and mother-child vagal tone in the context of parenting at-risk. Biol. Psychol. 105, 29–36. doi: 10.1016/j.biopsycho.2014.12.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Hastings, P. D., and Miller, J. G. (2014). “Autonomic regulation, polyvagal theory and children’s prosocial development,” in Prosocial Development: A Multidimensional Approach, eds L. Padilla-Walker and G. Carlo (New York, NY: Oxford University Press), 112–127.

Google Scholar

Hastings, P. D., Miller, J. G., Kahle, S., and Zahn-Waxler, C. (2014). “The neurobiological bases of empathic concern for others,” in Handbook of Moral Development, eds M. Killen and G. Carlo (Malwah, NJ: Erlbaum), 411–434.

Google Scholar

Hastings, P. D., Nuselovici, J. N., Klimes-Dougan, B., Kendziora, K. T., Usher, B. A., Ho, M. H. R., et al. (2009). Dysregulated coherence of subjective and cardiac emotional activation in adolescents with internalizing and externalizing problems. J. Child Psychol. Psychiatry 50, 1348–1356. doi: 10.1111/j.1469-7610.2009.02159.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hétu, S., Taschereau-Dumouchel, V., and Jackson, P. L. (2012). Stimulating the brain to study social interactions and empathy. Brain Stimul. 5, 95–102. doi: 10.1016/j.brs.2012.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Jordan, M. R., Amir, D., and Bloom, P. (2016). Are empathy and concern psychologically distinct? Emotion 16, 1107–1116. doi: 10.1037/emo0000228

PubMed Abstract | CrossRef Full Text | Google Scholar

Kalvin, C. B., Bierman, K. L., and Gatzke-Kopp, L. M. (2016). Emotional reactivity, behavior problems and social adjustment at school entry in a high-risk sample. J. Abnorm. Child Psychol. 44, 1527–1541. doi: 10.1007/s10802-016-0139-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Kanske, P., Böckler, A., Trautwein, F. M., and Singer, T. (2015). Dissecting the social brain: introducing the EmpaToM to reveal distinct neural networks and brain-behavior relations for empathy and theory of mind. NeuroImage 122, 6–19. doi: 10.1016/j.neuroimage.2015.07.082

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, P., Ho, S. S., Evans, G. W., Liberzon, I., and Swain, J. E. (2015). Childhood social inequalities influences neural processes in young adult caregiving. Dev. Psychobiol. 57, 948–960. doi: 10.1002/dev.21325

PubMed Abstract | CrossRef Full Text | Google Scholar

Klimecki, O. M., Leiberg, S., Lamm, C., and Singer, T. (2013). Functional neural plasticity and associated changes in positive affect after compassion training. Cereb. Cortex 23, 1552–1561. doi: 10.1093/cercor/bhs142

PubMed Abstract | CrossRef Full Text | Google Scholar

Knight, L. K., Stoica, T., Fogleman, N. D., and Depue, B. E. (2019). Convergent neural correlates of empathy and anxiety during socioemotional processing. Front. Hum. Neurosci. 13:94. doi: 10.3389/fnhum.2019.00094

PubMed Abstract | CrossRef Full Text | Google Scholar

Krall, S. C., Rottschy, C., Overwelland, E., Bzdok, D., Fox, P. T., Eckhoff, S. B., et al. (2015). The role of the right temporoparietal junction in attention and social interaction as revealed by ALE meta-analysis. Brain Struct. Funct. 220, 587–604. doi: 10.1007/s00429-014-0803-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Kreibig, S. (2010). Autonomic nervous system activity in emotion: a review. Biol. Psychol. 84, 394–421. doi: 10.1016/j.biopsycho.2010.03.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Lamm, C., Rütgen, M., and Wagner, I. C. (2019). Imaging empathy and prosocial emotions. Neurosci. Lett. 693, 49–53. doi: 10.1016/j.neulet.2017.06.054

PubMed Abstract | CrossRef Full Text | Google Scholar

Mai, X., Zhang, W., Hu, X., Zhen, Z., Zhenhua, X., Zhang, J., et al. (2016). Using tDCS to explore the role of the right temporo-parietal junction in theory of mind and cognitive empathy. Front. Psychol. 7:380. doi: 10.3389/fpsyg.2016.00380

PubMed Abstract | CrossRef Full Text | Google Scholar

Marsh, P., Beauchaine, T. P., and Williams, B. (2008). Dissociation of sad facial expressions and autonomic nervous system responding in boys with disruptive behavior disorders. Psychophysiology 45, 100–110. doi: 10.1111/j.1469-8986.2007.00603.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Miller, J. G. (2018). Physiological mechanisms of prosociality. Curr. Opin. Psychol. 20, 50–54. doi: 10.1016/j.copsyc.2017.08.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Miller, J. G., Chocol, C., Nuselovici, J. N., Utendale, W. T., Simard, M., and Hastings, P. D. (2013). Children’s dynamic RSA change during anger and its relations with parenting, temperament and control of aggression. Biol. Psychol. 92, 417–425. doi: 10.1016/j.biopsycho.2012.12.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Miller, J. G., Nuselovici, J. N., and Hastings, P. D. (2016). Nonrandom acts of kindness: parasympathetic and subjective empathic responses to sadness predict children’s prosociality. Child Dev. 87, 1679–1690. doi: 10.1111/cdev.12629

PubMed Abstract | CrossRef Full Text | Google Scholar

Morishima, Y., Schunk, D., Bruhin, A., Ruff, C. C., and Fehr, E. (2012). Linking brain structure and activation in temporoparietal junction to explain the neurobiology of human altruism. Neuron 75, 73–79. doi: 10.1016/j.neuron.2012.05.021

PubMed Abstract | CrossRef Full Text | Google Scholar

Porges, S. W. (2007). The polyvagal perspective. Biol. Psychol. 74, 116–143. doi: 10.1016/j.biopsycho.2006.06.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Preckel, K., Kanske, P., and Singer, T. (2018). On the interaction of social affect and cognition: empathy, compassion and theory of mind. Curr. Opin. Behav. Sci. 19, 1–6. doi: 10.1016/j.cobeha.2017.07.010

CrossRef Full Text | Google Scholar

Rossi, S., Hallett, M., Rossini, P. M., Pascual-Leone, A., and The Safety of TMS Consensus Group. (2009). Safety, ethical considerations and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research. Clin. Neurophysiol. 120, 2008–2039. doi: 10.1016/j.clinph.2009.08.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Ruff, C. C., Blankenburg, G., Bjoertomt, O., Bestmann, S., Freeman, E., Haynes, J. D., et al. (2006). Concurrent TMS-fMRI and psychophysics reveal frontal influences on human retinotopic visual cortex. Curr. Biol. 16, 1479–1488. doi: 10.1016/j.cub.2006.06.057

PubMed Abstract | CrossRef Full Text | Google Scholar

Saunders, J. B., Aasland, O. G., Babor, T. F., De La Fuente, J. R., and Grant, M. (1993). Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction 88, 791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Saxe, R., and Powell, L. J. (2006). It’s the thought that counts: specific brain regions for one component of theory of mind. Psychol. Sci. 17, 692–699. doi: 10.1111/j.1467-9280.2006.01768.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Seider, B. H., Shiota, M. N., Whalen, P., and Levenson, R. W. (2011). Greater sadness reactivity in late life. Soc. Cogn. Affect. Neurosci. 6, 186–194. doi: 10.1093/scan/nsq069

PubMed Abstract | CrossRef Full Text | Google Scholar

Shamay-Tsoory, S. G., Aharon-Peretz, J., and Perry, D. (2009). Two systems for empathy: a double dissociation between emotional and cognitive empathy in inferior frontal gyrus versus ventromedial prefrontal lesions. Brain 132, 617–627. doi: 10.1093/brain/awn279

PubMed Abstract | CrossRef Full Text | Google Scholar

Singer, T., and Klimecki, O. (2014). Empathy and compassion. Curr. Biol. 24, R875–R878. doi: 10.1016/j.cub.2014.06.054

CrossRef Full Text | Google Scholar

Steinbeis, N. (2016). The role of self-other distinction in the understanding of others’ mental and affective states: neurocognitive mechanisms in children and adults. Philos. Trans. R. Soc. Lond. B Biol. Sci. 371:20150074. doi: 10.1098/rstb.2015.0074

PubMed Abstract | CrossRef Full Text | Google Scholar

Stellar, J. E., Cohen, A., Oveis, C., and Keltner, D. (2015). Affective and physiological responses to the suffering of others: compassion and vagal activity. J. Pers. Soc. Psychol. 108, 572–585. doi: 10.1037/pspi0000010

PubMed Abstract | CrossRef Full Text | Google Scholar

Telzer, E. H., Masten, C. L., Berkman, E. T., Lieberman, M. D., and Fuligni, A. J. (2011). Neural regions associated with self control and mentalizing are recruited during prosocial behaviors towards the family. NeuroImage 58, 242–249. doi: 10.1016/j.neuroimage.2011.06.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Troy, A. S., Shallcross, A. J., and Mauss, I. B. (2013). A person-by-situation approach to emotion regulation: cognitive reappraisal can either help or hurt, depending on the context. Psychol. Sci. 24, 2505–2514. doi: 10.1177/0956797613496434

PubMed Abstract | CrossRef Full Text | Google Scholar

Vaish, A., Carpenter, M., and Tomasello, M. (2009). Sympathy through affective perspective taking and its relation to prosocial behavior in toddlers. Dev. Psychol. 45, 534–543. doi: 10.1037/a0014322

PubMed Abstract | CrossRef Full Text | Google Scholar

Valero-Cabré, A., Payne, B. R., Rushmore, J., Lomber, S. G., and Pascual-Leone, A. (2005). Impact of repetitive transcranial magnetic stimulation of the parietal cortex on metabolic brain activity: a 14C-2DG tracing study in the cat. Exp. Brain Res. 163, 1–12. doi: 10.1007/s00221-004-2140-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Varnava, A., Stokes, M. G., and Chambers, C. D. (2011). Reliability of the “observation of movement” method for determining motor threshold using transcranial magnetic stimulation. J. Neurosci. Methods 201, 327–332. doi: 10.1016/j.jneumeth.2011.08.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Völlm, B. A., Taylor, A. N. W., Richardson, P., Corcoran, R., Stirling, J., McKie, S., et al. (2006). Neuronal correlates of theory of mind and empathy: a functional magnetic resonance imaging study in a nonverbal task. NeuroImage 29, 90–98. doi: 10.1016/j.neuroimage.2005.07.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Walsh, V., and Cowey, A. (2000). Transcranial magnetic stimulation and cognitive neuroscience. Nat. Rev. Neurosci. 1, 73–80. doi: 10.1038/35036239

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, C. C., Khalifa, N., and Völlm, B. (2018). The effects of repetitive transcranial magnetic stimulation on empathy: a systematic review and meta-analysis. Psychol. Med. 48, 737–750. doi: 10.1017/s003329171700232x

PubMed Abstract | CrossRef Full Text | Google Scholar

Young, L., Camprodon, J. A., Hauser, M., Pascual-Leone, A., and Saxe, R. (2010). Disruption of the right temporoparietal junction with transcranial magnetic stimulation reduces the role of beliefs in moral judgments. Proc. Natl. Acad. Sci. U S A 107, 6753–6758. doi: 10.1073/pnas.0914826107

PubMed Abstract | CrossRef Full Text | Google Scholar

Zaki, J., and Ochsner, K. N. (2012). The neuroscience of empathy: progress, pitfalls and promise. Nat. Neurosci. 15, 675–680. doi: 10.1038/nn.3085

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: empathy, parasympathetic nervous system, psychophysiology, right temporoparietal junction, TMS

Citation: Miller JG, Xia G and Hastings PD (2020) Right Temporoparietal Junction Involvement in Autonomic Responses to the Suffering of Others: A Preliminary Transcranial Magnetic Stimulation Study. Front. Hum. Neurosci. 14:7. doi: 10.3389/fnhum.2020.00007

Received: 17 October 2019; Accepted: 09 January 2020;
Published: 28 January 2020.

Edited by:

Peter A. Hall, University of Waterloo, Canada

Reviewed by:

Irene Messina, University of Padova, Italy
Cassandra J. Lowe, University of Western Ontario, Canada

Copyright © 2020 Miller, Xia and Hastings. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jonas G. Miller, jgmiller@stanford.edu

Download