Clarifying the interaction types in two-person neuroscience research
Tao Liu
Matthew Pelowski- 1Department of Psychology, Sun Yat-Sen University, Guangzhou, China
- 2Department of Psychology, University of Copenhagen, Copenhagen, Denmark
Human brains and behaviors are shaped, and normally function, in continuous interaction with other humans (Hari and Kujala, 2009). However, because of the methodological difficulties related to the complex dynamics of interaction situations, neural mechanisms underlying interactive behavior remain one of the most poorly understood areas of neuroscience (Hari et al., 2013).
Previous neuroscience research has argued that social processes enabling us to interact with others are internalized and hence can be understood by investigating individual brains (see Konvalinka and Roepstorff, 2012). Based on this assumption, neuroscience studies have mainly examined social cognition from a perception perspective by presenting single participants with socially-relevant pictures or videos (Lieberman, 2007). Although this has led to identification of a set of regions composing our “social brain,” such as amygdala, orbital frontal cortex, medial prefrontal cortex, and mirror neuron system (Frith, 2007), little is still known about how these brain regions function and transfer information between brains in dynamic, real-time interactions. Especially, more recent ideas have proposed that social cognition may be fundamentally different when an individual does engage in an interaction, rather than when one just observes the situation itself (Schilbach, 2010).
Toward a Two-Person Neuroscience
To address this issue, a natural approach is to study the brains of two interacting people in real mutual interactions, rather than only examining single individuals in pseudo social contexts (Hasson et al., 2012; Pfeiffer et al., 2013). “Hyperscanning” is a technique that provides the possibility for simultaneous acquisition of the cerebral data from two or more participants (Montague et al., 2002). Using different hyperscanning approaches such as dual fMRI and EEG/NIRS recordings (Liu and Pelowski, in press), a few studies have examined inter-brain relationship between two participants during various interactive tasks: economic games assessing social decision-making (King-Casas et al., 2005; Astolfi et al., 2011); communication considering transfer of information across brains (Jiang et al., 2012); music playing examining action/emotion synchrony (Babiloni et al., 2011, 2012; Sänger et al., 2012); key-press and finger-movement tasks (Tognoli et al., 2007; Cui et al., 2012; Holper et al., 2012; Naeem et al., 2012; Yun et al., 2012) for body-movement synchrony; and mutual gaze task for shared attention (Saito et al., 2010).
These studies have shown intriguing patterns of correlation—i.e., “inter-brain synchronization”—between activations of two participants' brains, either at the same moments [e.g., in the case of Yun et al. (2012), the frontoparietal network simultaneously activated when participants coordinated movements of fingertips] or in turn-based time delay [Jiang et al. (2012) showed left inferior frontal gyrus (IFG) synchronization in face-to-face communication]. These findings demonstrate promise of hyperscanning for understanding the neural mechanisms of exchanging and sharing information between two brains underlying interpersonal interaction, which cannot be detected when only examining single brains (Babiloni and Astolfi, 2012; Chatel-Goldman et al., 2013). For this reason, a growing number of researchers have called for new investigation of “social interaction and its relationship to social cognitive abilities in more ecologically valid ways” (Schilbach et al., 2013), emphasizing the importance of a “second-person neuroscience” or a “two-person neuroscience” (Hari and Kujala, 2009).
What Does Synchronization Mean?: A Need for Paradigm Classification in Hyperscanning Research
Although recent hyperscanning studies have revealed intriguing synchronization, it remains difficult to explain exactly how and why inter-brain synchronization occurs within such research (Konvalinka and Roepstorff, 2012). As noted by Liu and Pelowski in a recent review, present research paradigms raise some important questions: In order to act synchronously, do interacting agents need to behave the same way at the same time leading to inter-brain synchronization? Alternatively, might synchronization also entail any number of other lawful relations between agents (not the same time/behavior)? Specifically, it is quite possible that by doing the same task in the same environment, two brains activate in similar ways, having little to do with the presence of the other human.
One of the important reasons for this limitation is lack of clear understanding or classification of the interaction tasks used in previous hyperscanning studies. Namely, it may be the paradigm, as well as paradigm differences, creating the present results or major differences in previous research. This paper therefore will review existing tasks with an eye toward impact on hyperscanning results and considering possible parallels or differences. We will also conclude with a suggestion for future study, that might aid in clarifying the structure of interactions and provide reference for hyperscanning research.
Interaction Structures: A Review of Hyperscanning Tasks
Figure 1 illustrates the structure of interaction tasks proposed by this paper. Human behaviors are normally affected by three factors when interacting with other people in a social context: (1) interaction structure, (2) goal structure, and (3) task structure. The x-axis represents the interaction structure. Interaction is defined as “individual's simultaneous or sequential actions that affect the immediate and future outcomes of the other individuals involved in the situation” (Johnson and Johnson, 2005). Thus, Liu and Pelowski (in press) have categorized social interaction into two structures: concurrent interaction requiring body-movement synchrony between two people (i.e., the same behavior with or without time-delay, such as pair Olympic diving) and turn-based interaction that relies primarily on mind-set synchrony—i.e., holding representations of one's own intention and that of others simultaneously for complementary or contrary behavior, such as in a game of chess.
Figure 1. (A) Potential interaction structures in hyperscanning research.
The y-axis indicates the goal structure. Individuals may either facilitate the goal achievement of others (cooperation) or obstruct others (competition) (Deutsch, 1949).
The z-axis represents task structure. There are two main interactive tasks, depending on whether the task requires mutual dependence between participants (Johnson et al., 1981; Tauer and Harackiewicz, 2004). During interdependent tasks such as tennis, both individual behavior and outcome are affected by each other. In contrast, during independent tasks, such as a race, individuals complete the task independently, while final outcome (winning or losing) is determined by the other.
Social psychology literature has consistently demonstrated that different types of interaction may involve different cognitive processes and behaviors (Johnson et al., 1981; Johnson and Johnson, 1989). Therefore, in order to fully understand neural mechanisms underlying human behavior, it is important to clearly separate and examine each type of interaction itself. According to the proposed classification system (Figure 1), there are generally eight interaction types, which we will now consider. We will first discuss studies in concurrent interactions (four types) and then review turn-based (four types).
Concurrent Interactions
First, looking to current research, previous hyperscanning studies have mainly examined concurrent interdependent cooperation tasks. This has involved key-press (Funane et al., 2011; Cui et al., 2012), finger-movement tasks (Tognoli et al., 2007; Holper et al., 2012; Naeem et al., 2012; Yun et al., 2012) and music-playing tasks (Lindenberger et al., 2009; Sänger et al., 2012). Results demonstrate that concurrent interdependent cooperation requires prediction of other's behavior for synchronized body-movements, and has been associated with inter-brain synchronization in right frontoparietal regions.
Regarding concurrent independent cooperation, Dommer et al. (2012) have simultaneously measured pairs of participants' activation in a dual n-back task and revealed inter-brain synchronization in prefrontal cortex (PFC).
On the other hand, Cui et al. (2012) have also studied concurrent independent competition, asking pairs of participants to press two keys as fast as possible to beat their partner, and demonstrated no inter-brain synchronization. This result suggests that individuals may complete the concurrent independent competition without understanding of the other's actions/mind. Therefore, resulting synchronization in paradigms relating to cooperation, but not competition, was argued to be one of the clearest indications of interplay or sharing of information between brains.
At the same time, returning to the structure posed by our figure, careful discussion is needed for the interpretation of these synchronization results in concurrent cooperation/competition. E.g., synchronization in the concurrent tasks, whether independent/interdependent, completion or cooperation, may result from the functional similarity between two participants' task/environment, rather than the specific neural mechanism underlying interactive behavior (Sänger et al., 2012; Liu and Pelowski, in press). That is, future research needs to look at these other two factors, factoring out concurrent behaviors, in order to better assess veracity of brain synchronization. On the other hand, lack of synchronization in the case of Cui et al., which one might be tempted to compare to findings of synchronization in the interdependent tasks, may in fact be result of task independence, rather than a factor of lack of communication between brains. This raises the need for future research to be mindful whether comparisons can be made between Figure paradigms.
No research has investigated concurrent interdependent competition, marking a clear avenue for future work.
Turn-Based Interactions
In turn-based behaviors, previous hyperscanning studies have examined inter-brain relationship between two participants using tasks such as communication (Jiang et al., 2012) and economic games (Astolfi et al., 2011). Results revealed that inter-brain synchronization in the IFG is associated with successful face-to-face communication (i.e., turn-based interdependent cooperation), since there is no inter-brain synchronization between a speaker and a listener who cannot understand the language of the other (Stephens et al., 2010). In contrast, economic games, e.g., the Prisoner's Dilemma, focusing primarily on independent cooperative decision lead to inter-brain synchronization in the PFC and anterior cingulated cortex (ACC). This has been argued to play a role in reading each others' mind (Vogeley et al., 2001).
To examine neural mechanisms underlying turn-based interdependent behavior, Liu et al. (2013, under review) have measured activation of paired participants using a computerized turn-taking game designed by Decety et al. (2004). One member of a pair of participants was assigned to a builder role, with the task of copying a disk-pattern on a monitor, while the partner's task was to either aid the builder in his goal (cooperation condition) or obstruct (competition). Results showed inter-brain synchronization in the IFG during cooperation, and further demonstrated synchronization in the IFG and the inferior parietal lobule (IPL) during competition.
Astolfi et al. (2010) made similar study of cooperation, simultaneously measuring four participants' brains in a Bridge-like card game. Participants were paired into two teams and played the card game in a turn-taking style, cooperating to beat the other team. Results revealed inter-brain synchronization between ACC activity of the second player of a team and the PFC activity of the other player of the same team. According to the authors, this result was consistent with previous argument that the PFC is associated with evaluation of uncertainty and risk, while ACC is associated with conflict monitoring and intention understanding.
However, here questions need to be raised regarding ability to compare across interaction types. In turn this specific type, and especially the finding of Astolfi et al. also raise need for further control to be sure of which category research should be placed within. From a hyperscanning perspective, one possible interpretation of the PFC-ACC synchronization is that the same team members may play the card game as a turn-based independent cooperation task such as in the Prisoner's Dilemma. It is noteworthy that every player cooperated with their in-team partner and competed with their out-team opponents as well. To examine whether or not the results of Astolfi et al. (2010) involve different components, further study is needed to investigate the inter-brain relationship of turn-based independent cooperation and competition separately.
Again, it is also intriguing to note that no study has investigated inter-brain relationship during turn-based independent competition such as a game of darts.
Conclusion
To clearly understand the inter-brain mechanisms underlying human interactive behavior, it is important to clarify the interaction types in the initial two-person neuroscience studies. Specifically, clear separation of interaction types is important to the interpretation and understanding of inter-brain synchronization revealed in various experimental tasks. Concurrent interdependent cooperation may be associated with inter-brain synchronization in the mirror neuron system of two participants, while concurrent independent cooperation may be associated with inter-brain synchronization in the PFC. In particular, Cui et al. (2012) revealed no inter-brain synchronization in the concurrent independent competition, whereas Liu et al. (2013, under review) revealed inter-brain synchronization in participants' mirror neuron system in the turn-based interdependent competition. These results imply that different types of interaction may involve distinctive neural mechanisms, requiring careful separation and interpretation according to the proposed classification system in the future studies.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The author Tao Liu was supported by China Scholarship Council.
References
Astolfi, L. A., Toppi, J., De Vico Fallani, F., Vecchiato, G., Cincotti, F., Wilke, C. T., et al. (2011). Imaging the social brain by simultaneous hyperscanning during subject interaction. IEEE Intell. Syst. 26, 38–45. doi: 10.1109/MIS.2011.61
Astolfi, L. A., Toppi, J., De Vico Fallani, F., Vecchiato, G., Salinari, S., Mattia, D., et al. (2010). Neuroelectrical hyperscanning measures simultaneous brain activity in humans. Brain Topogr. 23, 243–256. doi: 10.1007/s10548-010-0147-9
Babiloni, C., Buffo, P., Vecchio, F., Marzano, N., Del Percio, C., Spada, D., et al. (2012). Brains “in concert”: frontal oscillatory alpha rhythms and empathy in professional musicians. Neuroimage 60, 105–116. doi: 10.1016/j.neuroimage.2011.12.008
Babiloni, C., Vecchio, F., Infarinato, F., Buffo, P., Marzano, N., Spada, D., et al. (2011). Simultaneous recording of electroencephalographic data in musicians playing in ensemble. Cortex 47, 1082–1090. doi: 10.1016/j.cortex.2011.05.006
Babiloni, F., and Astolfi, L. (2012). Social neuroscience and hyperscanning techniques: past, present and future. Neurosci. Biobehav. Rev. doi: 10.1016/j.neubiorev.2012.07.006. [Epub ahead of print].
Chatel-Goldman, J., Schwartz, J.-L., Jutten, C., and Congedo, M. (2013). Non-local mind from the perspective of social cognition. Front. Hum. Neurosci. 7:107. doi: 10.3389/fnhum.2013.00107
Cui, X., Bryant, D. M., and Reiss, A. L. (2012). NIRS-based hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation. Neuroimage 59, 2430–2437. doi: 10.1016/j.neuroimage.2011.09.003
Decety, J., Jackson, P. L., Sommerville, J. A., Chaminade, T., and Meltzoff, A. N. (2004). The neural bases of cooperation and competition: an fMRI investigation. Neuroimage 23, 744–751. doi: 10.1016/j.neuroimage.2004.05.025
Deutsch, M. (1949). A theory of cooperation and competition. Hum. Relat. 2, 129–152. doi: 10.1177/001872674900200204
Dommer, L., Jäger, N., Scholkmann, F., Wolf, M., and Hloper, L. (2012). Between-brain coherence during joint n-back task performance: a two-person functional near-infrared spectroscopy study. Behav. Brain Res. 234, 212–222. doi: 10.1016/j.bbr.2012.06.024
Frith, C. D. (2007). The social brain? Philos. Trans. R. Soc. Lond. B Biol. Sci. 362, 671–678. doi: 10.1098/rstb.2006.2003
Funane, T., Kiguchi, M., Atsumori, H., Sato, H., Kubota, K., and Koizumi, H. (2011). Synchronous activity of two people's prefrontal cortices during a cooperative task measured by simultaneous near-infrared spectroscopy. J. Biomed. Opt. 16:077011. doi: 10.1117/1.3602853
Hari, R., Himberg, T., Nummenmaa, L., Hämäläinen, M., and Parkkonen, L. (2013). Synchrony of brains and bodies during implicit interpersonal interaction. Trends Cogn. Sci. 17, 105–106. doi: 10.1016/j.tics.2013.01.003
Hari, R., and Kujala, M. V. (2009). Brain basis of human social interaction: from concepts to brain imaging. Physiol. Rev. 89, 453–479. doi: 10.1152/physrev.00041.2007
Hasson, U., Ghazanfar, A. A., Galantucci, B., Garrod, S., and Keysers, C. (2012). Brain-to-brain coupling: a mechanism for creating and sharing a social world. Trends Cogn. Sci. 16, 114–121. doi: 10.1016/j.tics.2011.12.007
Holper, L., Scholkmann, F., and Wolf, M. (2012). Between-brain connectivity during imitation measured by fNIRS. Neuroimage 63, 212–222. doi: 10.1016/j.neuroimage.2012.06.028
Jiang, J., Dai, B., Peng, D.-L., Zhu, C.-Z., Liu, L., and Lu, C.-M. (2012). Neural synchronization during face-to-face communication. J. Neurosci. 32, 16064–16069. doi: 10.1523/JNEUROSCI.2926-12.2012
Johnson, D. W., and Johnson, R. T. (1989). Cooperation and Competition: Theory and Research. Edina, MN: Interaction Book Company.
Johnson, D. W., and Johnson, R. T. (2005). New developments in social interdependence theory. Genet. Soc. Gen. Psychol. Monogr. 131, 285–358. doi: 10.3200/MONO.131.4.285-358
Johnson, D. W., Maruyama, G., Johnson, R., Nelson, D., and Skon, L. (1981). Effects of cooperative, competitive, and individualistic goal structures on achievement: a meta-analysis. Psychol. Bull. 89, 47–62. doi: 10.1037/0033-2909.89.1.47
King-Casas, B., Tomlin, D., Anen, C., Camerer, C. F., Quartz, S. R., and Montague, P. R. (2005). Getting to know you: reputation and trust in a two-person economic exchange. Science 308, 78–83. doi: 10.1126/science.1108062
Konvalinka, I., and Roepstorff, A. (2012). The two-brain approach: how can mutually interacting brains teach us something about social interaction? Front. Hum. Neurosci. 6:215. doi: 10.3389/fnhum.2012.00215
Lieberman, M. D. (2007). Social cognitive neuroscience: a review of core process. Annu. Rev. Psychol. 58, 259–289. doi: 10.1146/annurev.psych.58.110405.085654
Lindenberger, U., Li, S., Gruber, W., and Müller, V. (2009). Brains swinging in concert: cortical phase synchronization while playing guitar. BMC Neurosci. 10:22. doi: 10.1186/1471-2202-10-22
Liu, T., and Pelowski, M. (in press). A new research trend in social neuroscience: towards an interactive-brain neuroscience. PsyCh J. doi: 10.1002/pchj.56
Liu, T., Saito, H., and Oi, M. (2013). Inter-brain synchronization in the right inferior frontal gyrus during cooperation: a near-infrared spectroscopy study. Proc. Jpn. Soc. Cogn. Psychol. 11, 7.
Montague, P. R., Berns, G. S., Cohen, J. D., McClure, S. M., Pagnoni, G., Dhamala, M., et al. (2002). Hyperscanning: simultaneous fMRI during linked social interactions. Neuroimage 164, 1159–1164. doi: 10.1006/nimg.2002.1150
Naeem, M., Prasad, G., Watson, D. R., and Kelso, J. A. S. (2012). Electrophysiological signatures of intentional social coordination in the 10-12 Hz range. Neuroimage 59, 1795–1803. doi: 10.1016/j.neuroimage.2011.08.010
Pfeiffer, U. J., Timmermans, B., Vogeley, K., Frith, C. D., and Schilbach, L. (2013). Towards a neuroscience of social interaction. Front. Hum. Neurosci. 7:22. doi: 10.3389/fnhum.2013.00022
Saito, D. N., Tanabe, H. C., Izuma, K., Hayashi, M. J., Morito, Y., Komeda, H., et al. (2010). Stay tuned: inter-individual neural synchronization during mutual gaze and joint attention. Front. Integr. Neurosci. 5:127. doi: 10.3389/fnint.2010.00127
Sänger, J., Müller, V., and Lindenberger, U. (2012). Intra- and interbrain synchronization and network properties when playing guitar in duets. Front. Hum. Neurosci. 6:312. doi: 10.3389/fnhum.2012.00312
Schilbach, L. (2010). A second-person approach to other minds. Nat. Rev. Neurosci. 11:449. doi: 10.1038/nrn2805-c1
Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., et al. (2013). Towards a second-person neuroscience. Behav. Brain Sci. 36, 393–414. doi: 10.1017/S0140525X12000660
Stephens, G. J., Silbert, L. J., and Hasson, U. (2010). Speaker-listener neural coupling underlies successful communication. Proc. Natl. Acad. Sci. U.S.A. 107, 14425–14430. doi: 10.1073/pnas.1008662107
Tauer, J. M., and Harackiewicz, J. M. (2004). The effects of cooperation and competition on intrinsic motivation and performance. J. Pers. Soc. Psychol. 86, 849–861. doi: 10.1037/0022-3514.86.6.849
Tognoli, E., Lagarde, J., DeGuzman, G. C., and Kelso, J. A. (2007). The phi complex as a neuromarker of human social coordination. Proc. Natl. Acad. Sci. U.S.A. 104, 8190–8195. doi: 10.1073/pnas.0611453104
Vogeley, K., Bussfeld, P., Newen, A., Herrmann, S., Happé, F., Falkai, P., et al. (2001). Mind reading: neural mechanisms of theory of mind and self-perspective. Neuroimage 14, 170–181. doi: 10.1006/nimg.2001.0789
Keywords: social neuroscience, hyperscanning, inter-brain synchronization, interaction type, cooperation, competition
Citation: Liu T and Pelowski M (2014) Clarifying the interaction types in two-person neuroscience research. Front. Hum. Neurosci. 8:276. doi: 10.3389/fnhum.2014.00276
Received: 29 January 2014; Accepted: 14 April 2014;
Published online: 30 April 2014.
Edited by:
Leonhard Schilbach, University Hospital Cologne, GermanyReviewed by:
Peter Kirsch, Zentralinstitut für Seelische Gesundheit, GermanyIvana Konvalinka, Technical University of Denmark, Denmark
Anna Katharina Kuhlen, Charité—Universitätsmedizin Berlin, Germany
Copyright © 2014 Liu and Pelowski. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: luomayisima@gmail.com