Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 21 October 2021
Sec. Organizational Psychology

Relating Cultural Distance to Self-Other Agreement of Leader–Observer Dyads: The Role of Hierarchical Position

\r\nTim Vriend,*Tim Vriend1,2*Caroline RookCaroline Rook3Harry GarretsenHarry Garretsen2Janka I. StokerJanka I. Stoker2Manfred Kets de VriesManfred Kets de Vries4
  • 1International Business School, Hanze University of Applied Sciences, Groningen, Netherlands
  • 2Faculty of Economics and Business, University of Groningen, Groningen, Netherlands
  • 3Henley Business School, Henley-on-Thames, United Kingdom
  • 4INSEAD, Paris, France

Multisource feedback is important for leadership development and effectiveness. An important asset of such feedback is that it provides information about the self-other agreement between leaders and observers. Self-other agreement relates to several positive individual, dyadic, and organizational outcomes. Given the increasingly intercultural context in organizations, it is imperative to understand whether and how cultural distance between leaders and observers relates to self-other agreement. We hypothesize that cultural distance within leader-observer dyads is negatively associated with self-other agreement. Moreover, we expect that this relationship is stronger for leader-superior than leader-subordinate dyads. We use a unique multi-cultural dataset of 7,778 leaders (52 nationalities) rated by 22,997 subordinates (56 nationalities) and 10,132 superiors (54 nationalities) to test our hypotheses. Results confirm that cultural distance is negatively associated with self-other agreement; we show that this relationship is driven by increased self-ratings and by reduced other-ratings. In addition, we find that these results are more pronounced for leader–superior than for leader–subordinate dyads. Implications for the theory and practice of self-other agreement and multisource feedback are discussed.

Introduction

In the contemporary, globalized and interconnected business world, where the number of intercultural interactions between people are ever increasing, practicing effective leadership has never been more challenging (Maddux et al., 2021). Accordingly, leaders are increasingly relying on multisource feedback (or 360° feedback) from subordinates, peers, supervisors, and/or customers has become to improve their leadership effectiveness (Atwater et al., 1998, 2002). Indeed, research into multisource feedback suggests that self-other agreement is especially desirable for leaders: notwithstanding boundary conditions, leaders with high self-other agreement have superior individual, dyadic, and even organizational outcomes (Van der Kam et al., 2014).

Self-other agreement is the extent to which leaders’ perceptions of their own leadership behaviors align with the perceptions of observers, like subordinates and superiors (Atwater et al., 1998). Research shows that disagreement is generally more likely to occur than agreement (Harris and Schaubroeck, 1988; Tsui and Ohlott, 1988; Heidemeier and Moser, 2009; Lee and Carpenter, 2018), especially when leaders and observers hold different perceptions about the evaluation criteria used (Tsui and Ohlott, 1988; Yammarino and Atwater, 1993; Oh and Berry, 2009). These criteria are, at least partly, based on people’s cultural backgrounds, which has important implications for how people conceptualize effective leadership practices (Den Hartog et al., 1999; House et al., 2004) and how people evaluate and provide feedback (Atwater et al., 2005, 2009; Gentry et al., 2007; Varela and Premeaux, 2008; Eckert et al., 2010). When people are culturally similar – that is, their cultural distance is negligible (Shenkar, 2001) – they are likely to hold similar views on appropriate and effective leadership behaviors and thus evaluation criteria. As the cultural distance between people increases, however, the number of values, beliefs, and norms they share become decisively fewer, which leads them to have increasingly different views on appropriate and effective leadership behaviors (House et al., 2002; Dickson et al., 2003). Although we would argue that such different views would also feed into the (mis)alignment of leaders and their culturally distant observers, to the best of our knowledge, empirical research studying this is limited. There is research demonstrating that the extent and form of self-other agreement differs between countries and cultures (e.g., Atwater et al., 2005; Gentry et al., 2007; Varela and Premeaux, 2008), but this line of research has solely studied dyads from the same countries and/or cultures. Moreover, previous research has established that coming from different countries and cultures can indeed influence evaluations in general (e.g., Caligiuri and Day, 2000; Kossek et al., 2017), but never within the context of (dis)agreement in evaluations. Accordingly, more research on the link between cultural distance and self-other agreement is warranted.

In this study, we investigate the extent to which cultural distance relates to self-other agreement of transformational and transactional leadership behaviors (Burns, 1978; Bass, 1985; Bass and Avolio, 1990), which we respectively define as the extent to which leaders articulate a compelling vision, mission, and strategy (i.e., transformational), and the extent to which leaders set up appropriate reward structures and provide feedback (i.e., transactional) (cf. Kets De Vries et al., 2004). We present two hypotheses to argue why and when cultural distance relates to self-other agreement. First, drawing from leadership categorization theory (Lord et al., 1982), which holds that individuals attribute enhanced effectiveness to leaders that act in line with their own leader prototypes (van Knippenberg, 2011; Lord et al., 2020), we hypothesize that cultural distance is negatively related to self-other agreement. Second, imbuing this leadership categorization theory perspective with insights from the approach/inhibition theory of power (Keltner et al., 2003), which describes that those with high power (i.e., superiors) are more likely than those with low power (i.e., subordinates) to think and act in line with their own values (Keltner et al., 2003; Galinsky et al., 2008), we hypothesize that the negative relationship between cultural distance and self-other agreement will be stronger for leader-superior dyads than for leader-subordinate dyads. We test these two hypotheses using a unique, longitudinal database that covers the period from 2003 to 2012, containing managers, subordinates and superiors that evaluate manager’s behaviors (see Agrawal and Rook, 2014). This dataset includes 7,778 leaders (52 nationalities) rated by 22,997 subordinates (56 nationalities) and 10,132 superiors (54 nationalities) who completed a leadership inventory (the GELI; see Kets De Vries et al., 2004). Following previous research on self-other agreement (Ostroff et al., 2004; McKee et al., 2018), we used a multivariate regression approach to estimate the effects on self-other agreement (Edwards, 1995).

Our study has two important contributions. First, it answers calls for more research on the role of culture in multisource feedback for leadership (Varela and Premeaux, 2008; Fleenor et al., 2010; Kossek et al., 2017) and studies on culture and leadership in general (Atwater et al., 2021). To the best of our knowledge, our study is the first to provide empirical evidence for the important role of cultural distance in leader–observer self-other agreement. Indeed, research on cultural distance is mostly limited to the international management literature (Hutzschenreuter et al., 2016; Beugelsdijk et al., 2017; Srivastava et al., 2020) and research on cultural distance within the context of leadership and self-other agreement is limited. Previous research has demonstrated that self-other agreement differs between countries and cultures (e.g., Atwater et al., 2005; Gentry et al., 2007; Varela and Premeaux, 2008) and that being from different countries and cultures can affect evaluations in general (e.g., Caligiuri and Day, 2000; Kossek et al., 2017). Continuing these streams of research, by integrating literature on self-other agreement (Yammarino and Atwater, 1993; Atwater et al., 1998) with leadership categorization theory (Lord et al., 1982, 1984; Lord and Maher, 1991), we show that cultural distance within leader–observer dyads is indeed negatively associated with self-other agreement. Second, our study contributes to the discussion that different types of observers should be considered when studying multisource feedback (Heidemeier and Moser, 2009; Lee and Carpenter, 2018). Previous empirical research has suggested that the effects of cultural distance on self-other agreement across different leadership behaviors may be contingent upon the hierarchical position of the observer (Caligiuri and Day, 2000; Kossek et al., 2017). By combining leadership categorization theory (Lord et al., 1982, 1984; Lord and Maher, 1991) with the approach/inhibition theory of power (Keltner et al., 2003), we corroborate and extend these findings, and show that especially the position of superiors is crucial when it concerns the role of cultural distance in self-other agreement.

Theory and Hypotheses

Self-Other Agreement

Leader’ self-other agreement reflects the extent to which leaders’ perceptions of their own behaviors converge and diverge from the perceptions of observers, including subordinates, peers, and superiors (Yammarino and Atwater, 1993; Atwater et al., 1998). Leaders’ self-ratings are only modestly correlated with observers’ ratings (weighted and corrected correlations between 0.14 and 0.56, Lee and Carpenter, 2018), suggesting that disagreement between leaders and observers is more likely to occur than agreement. Initial studies considered disagreement to be an indication of over- or underestimation on part of the leader, assuming that observer ratings are more accurate than leader ratings (Yammarino and Atwater, 1993; Atwater et al., 1998). A more current perspective, however, argues that not only leader’ but also observer’ ratings may be inaccurate (Fleenor et al., 2010).

Indeed, both leaders and observers may be prone to all sorts of (cognitive) biases that influence their self- and other-ratings. Leaders are prone to self-enhancement biases (Harris and Schaubroeck, 1988; Tsui and Ohlott, 1988; Yammarino and Atwater, 1993), which cause them to rate themselves higher than average, by emphasizing positive information and neutralizing negative information (Taylor and Brown, 1988), consequently inflating their self-ratings (Bass and Yammarino, 1991). Observers are also prone to several cognitive biases that influence their ratings, including central tendency, halo, leniency, restriction of range, and severity biases (Saal et al., 1980; Harris and Schaubroeck, 1988; Van Velsor et al., 1993). Consequently, leaders and observers may arrive at different ratings of leadership behaviors because of differences in observations and/or in criteria used (Tsui and Ohlott, 1988; Yammarino and Atwater, 1993; Oh and Berry, 2009).

Several scholars studied antecedents that activate the (cognitive) biases which underlie self-other (dis)agreement. In a review study, Fleenor et al. (2010) summarized how a wide variety of rater, ratee, and rater-ratee dyadic characteristics influence self-other agreement, including biographical characteristics (e.g., age and gender), personality and individual characteristics (e.g., Big Five traits), and job relevant experiences (e.g., feedback giving and receiving). Although they (Fleenor et al., 2010) noted national culture as an important characteristic that directly relates to self-other agreement, as we review in more detail below, evidence for the specific role of cultural distance between rater and ratee is scarce.

Culture and Cultural Distance

We define culture as “characteristic patterns of social behavior, social interaction, and conscious and unconscious influences on action that recur in or typify a society,” with societies being “large, differentiated groups with which members share an identity throughout life” (Peterson and Barreto, 2014, p. 1134). Scholars have developed various typologies to capture these characteristic patterns through different cultural value dimensions (Hofstede, 1980, 2001; Schwartz, 1999; House et al., 2004). These cultural dimensions represent societal values on an aggregate level, which does not necessarily imply that every individual within that society adheres to or shares these values, because individuals may have personal values that are not at all aligned with the society they were cultivated in Hofstede (2006), Peterson and Castro (2006), e.g., ecological fallacy, Robinson (1950). However, according to the cultural expertise and personal values proposition as developed by Peterson and Barreto (2014), it can be argued that being cultivated in a specific societal culture does have a strong influence on both individual members’ cognitive structures (e.g., expertise and intuitive understanding) and acceptance of cultural values, regardless of whether they personally endorse these specific cultural values. Accordingly, for the purpose of our study, when we discuss culture or cultural values, we assume that societal cultural values have influenced how individuals from that culture think and act, although we acknowledge that their specific personal values may not be perfectly aligned.

In support of the cultural expertise and personal values proposition, research has established that leader- and observer-ratings are conditional upon cultural value dimensions (Atwater et al., 2005; Gentry et al., 2007; Fleenor et al., 2010), including assertiveness, individualism, humane orientation, and power distance (Varela and Premeaux, 2008; Atwater et al., 2009; Eckert et al., 2010; Kossek et al., 2017). Results of these studies show for instance that societal cultural values influence how leaders rate themselves (cf. the cultural-relativity hypothesis, Farh et al., 2007) and agreement between self- and other-ratings (Atwater et al., 2009; Eckert et al., 2010). However, research on the role of cultural distance between rater and ratee is limited.

As mentioned earlier, we define ‘cultural distance’ as the extent to which leaders and observers differ in their cultural values (Shenkar, 2001). Although any of the afforementioned typologies for culture can be used as input to define the extent of cultural distance, we have opted to focus on the nine GLOBE dimensions (assertiveness, gender egalitarianism, future orientation, humane orientation, in-group collectivism, institutional collectivism, performance orientation, power distance, and uncertainty avoidance) as they resonate best with our leadership context (House et al., 2004). Cultural distance is then the extent to which leaders and observers increasingly differ on such dimensions. The idea being that as cultural distance increases, leaders and observers are likely to hold increasingly different values, beliefs, and norms (Shenkar, 2001; Beugelsdijk et al., 2018).

Despite there being myriad studies on how culture in general relates to self-other agreement (see e.g., Atwater et al., 2009; Eckert et al., 2010), we know of no research studying the role of cultural distance (cf. Fleenor et al., 2010). There are a few studies that demonstrate the role of cultural distance (that is, being from a different nationality) for observer ratings. Caligiuri and Day (2000) demonstrated that superiors provide lower ratings of contextual and assignment-specific performance to subordinates from different nationalities. In a study of expatriates, Kossek et al. (2017) demonstrated that cultural distance is negatively related to subordinate- and peer-ratings of task and contextual leadership behaviors, but unrelated to superior-ratings. Furthermore, although not the focus of their study, Smith et al. (2012) demonstrate that transformational leadership suppresses the negative effect of cultural distance on relationship quality. Finally, Testa (2002, 2009) demonstrated that subordinates from different nationalities rate their leaders lower on consideration behaviors than culturally similar subordinates.

Although these studies certainly suggest that being from a different culture may influence observer ratings, they are not telling us anything about the possible relationship between cultural distance between the leader and the observer, and self-other agreement. In order to hypothesize how cultural distance could relate to self-other agreement, we draw upon leadership categorization theory.

Leadership Categorization Theory

Leadership categorization theory (Lord et al., 1982, 1984; Lord and Maher, 1991) argues that people continually assess whether a certain person fits a leader role (for reviews, see Epitropaki et al., 2013; Offermann and Coats, 2018; Lord et al., 2020). According to leadership categorization theory, individuals construe implicit leadership theories that are cognitive representations of effective or ‘good’ leader prototypes in terms of personality, qualities, and traits (Lord et al., 1982, 1984; Lord and Maher, 1991). Individuals use these implicit leadership theories to determine whether individuals fit into a leader category, consequently selectively retrieving and encoding information about individuals that is consistent with their effective leader prototypes (Phillips and Lord, 1982; Rush and Russell, 1988; Kenney et al., 1994; van Knippenberg, 2011). Individuals with characteristics that match these effective leader prototypes are more likely to be categorized as leaders than individuals without (Cronshaw and Lord, 1987). Consequently, categorized leaders are more likely than non-categorized leaders to be attributed positive characteristics, including enhanced collegiality, responsibility, and causality for positive events (Lord et al., 1984; Nye and Forsyth, 1991; Ensari and Murphy, 2003), even if actual behavior is similar between prototypical and non-prototypical leaders (Schyns, 2006).

Implicit leadership theories are important pillars of the seminal GLOBE-studies (House et al., 2002, 2004), which studied how societal and organizational cultures affect leadership and organizational practices. In these studies, scholars argued that societal cultural values influence the implicit leadership theories that individuals have about effective leadership prototypes (for a recent overview, see Dorfman et al., 2012) – that is, individuals develop cultural expertise about what constitutes effective leadership. Indeed, the studies demonstrate substantial cross-cultural variation in implicit leadership prototypes and effects (Den Hartog et al., 1999; Dickson et al., 2003; House et al., 2004). Individuals across cultures differ substantially in their interpretations of and preferences for specific leadership behaviors (Gerstner and Day, 1994; Offermann and Hellmann, 1997; Lord and Emrich, 2000; Lord et al., 2001; Ensari and Murphy, 2003; Tsui et al., 2007). Following leadership categorization theory, leadership behaviors that are congruent with one’s societal cultural values are generally perceived to be more effective (Newman and Nollen, 1996) and leaders that demonstrate such culturally congruent behaviors are more likely to be perceived as prototypical (Shaw, 1990). A fit between culturally endorsed leadership prototypes and actual leader attributes and behaviors contribute to leader acceptance and effectiveness (House et al., 2014). Accordingly, leadership categorization theory and its implied implicit leadership theories are often used to explain effects on and of leadership in intercultural contexts (e.g., Dorfman et al., 2012).

One of the main purposes of the GLOBE studies was to explore which leadership attributes and behaviors were universally desirable (i.e., part of all cultures’ leadership prototypes) versus culturally contingent (i.e., part of some cultures’ leadership prototypes). Although the empirical evidence is relatively clear that certain leadership values are considered to be universally desirable, such as being trustworthy, just, and honest (Den Hartog et al., 1999; Dorfman et al., 2012), empirical evidence on the universality of leadership behaviors is mixed (Crede et al., 2019). Whereas some scholars claim that transformational (i.e., charismatic) and transactional (i.e., contingent reward) leadership may be universal (e.g., Dorfman et al., 1997), others claim that their assessment and manifestations may be culturally contingent (e.g., Money and Graham, 1999; Javidan and Carl, 2004; Karakitapoglu-Aygün and Gumusluoglu, 2013). Given that the GLOBE studies demonstrate significant influences of cultural values across all culturally endorsed leadership attributes (House et al., 2004; Dorfman et al., 2012), it seems feasible to assume that leadership behaviors are at least to some extent part of cultural implicit theories of effective leadership.

Relating Cultural Distance to Self-Other Agreement

Based on self-other agreement literature, leadership categorization theory, and the GLOBE studies, we hypothesize that cultural distance is negatively related to self-other agreement. First, we argue that cultural distance by definition implies that leaders and observers have different prototypes of effective leadership. As mentioned earlier, culture reflects “characteristic patterns of social behavior, social interaction, and conscious and unconscious influences on action that recur in or typify a society” (Peterson and Barreto, 2014, p. 1134), captured along several cultural dimensions (Hofstede, 1980; Schwartz, 1999; House et al., 2004). Cultural distance reflects the extent to which cultures diverge or converge on these cultural dimensions. Moreover, as cultures become more distal, the number of values, beliefs, and norms shared between two cultures become decisively fewer (Shenkar, 2001). Furthermore, societies differ substantially in their leadership prototypes and thus what is expected of leaders in order for them to be effective (Offermann and Hellmann, 1997; Lord and Emrich, 2000; Lord et al., 2001; Ensari and Murphy, 2003; Tsui et al., 2007). The contents and manifestations of leadership behaviors are also culturally dependent, such that they are likely to be influenced by the nuances unique to their cultures’ leadership prototypes (Javidan and Carl, 2004; Karakitapoglu-Aygün and Gumusluoglu, 2013). Overall, therefore, as cultural distance increases, the shared ideas about effective leadership prototypes between leaders and observers become less, which makes agreement less likely.

Second, we argue that such leadership prototypes especially shape observers’ ratings of leaders’ behaviors. Rating involves a cognitive process where raters constantly observe, store, encode, integrate, and evaluate the leadership behaviors performed (DeNisi et al., 1984). As mentioned earlier, people are prone to a variety of cognitive biases during this rating process (Saal et al., 1980; Wherry and Barlett, 1982; Harris and Schaubroeck, 1988; Taylor and Brown, 1988; Van Velsor et al., 1993; Yammarino and Atwater, 1993). Importantly, people continuously rely on their leadership prototypes when evaluating leaders (Lord and Maher, 1991), such that raters attribute higher performance evaluations to leaders that act in line with these prototypes (Lord et al., 1984; Nye and Forsyth, 1991; Ensari and Murphy, 2003).

Third, combining the preceding two lines of argumentation, we argue that cultural distance will be negatively associated with self-other agreement, especially due to lower other-ratings. Cultural distance is likely to reduce the extent to which observers categorize leaders as such (Lord and Maher, 1991), which ultimately reduces their ratings of the observed leaders’ behaviors (Lord et al., 1984; Nye and Forsyth, 1991; Ensari and Murphy, 2003). Accordingly, we hypothesize that:

Hypothesis 1: Cultural distance is negatively related to self-other agreement.

The Moderating Role of Hierarchical Position of the Observer

The role of cultural distance in self-other agreement may be contingent upon the hierarchical position of the observer, because several studies demonstrated that self-other agreement may differ substantially based on the hierarchical position of the observer relative to the leader (Lee and Carpenter, 2018). Different types of observers (that is, subordinates and superiors) often do not agree in their ratings of leaders’ behaviors (corrected correlations between 0.22 and 0.34, Conway and Huffcutt, 1997). This finding is typically explained by the fact that observers differ in the types of behaviors they observe, and the performance criteria they use (Tsui and Ohlott, 1988; Yammarino and Atwater, 1993; Oh and Berry, 2009). Also, leaders are argued to differentiate in their behaviors toward different observers (Tett and Burnett, 2003). Leaders target leadership behaviors associated with daily operations at their subordinates, and exert more strategic and political leadership behaviors toward their superiors (Den Hartog et al., 1999). Hence, different observers observe different leadership behaviors from the same leader (Hiller et al., 2011; Hansbrough et al., 2015; Lee and Carpenter, 2018), which in the end also relates to the self-other agreement for leader-subordinate versus leader–superior dyads.

Besides the fact that because of their hierarchical position, different observers might encounter different behaviors of the same leader, we argue that there is another major reason for differences in self-other (dis)agreement differences, namely power. According to the approach/inhibition theory of power (Keltner et al., 2003), the extent of power an individual has relative to others influences their affective, behavioral, cognitive, and motivational states (Keltner et al., 2003). Individuals with high power are more likely than those with low power to act in accordance with their own interests and values and to discard those of others (Keltner et al., 2003; Galinsky et al., 2006, 2008; Magee and Galinsky, 2008). Relative to those with low power, individuals with high power more selectively process information (Guinote, 2007) and are more likely to underestimate threats (Inesi, 2010) and overestimate their own abilities and performance (Brutus et al., 1999). Furthermore, individuals with high power are less receptive to feedback (Sully de Luque and Sommer, 2000; Atwater et al., 2009) and hold those with low power to stricter standards than they would themselves (Lammers et al., 2010).

Clearly, one’s position in a hierarchy determines the extent of their power, such that superiors have high power in leader–superior dyads, whereas subordinates have low power in leader–subordinate dyads. Following both the leadership categorization theory and the approach/inhibition theory of power, we argue that superiors are more likely than subordinates to rely on their implicit leadership prototypes when rating leadership behaviors. Consequently, this proposition has implications for our Hypothesis 1. There, we hypothesized that that cultural distance negatively relates to self-other agreement due to differences in leadership prototypes. We expect that this relationship between cultural distance and self-other agreement is more pronounced for leader-superior dyads, because superiors are more likely to act upon their culturally laden leadership prototypes. We therefore hypothesize that:

Hypothesis 2: The negative relationship between cultural distance and self-other agreement is stronger for leader-superior than leader-subordinate dyads.

Materials and Methods

Sample and Procedure

Data were gathered from 14,523 middle and top management executives who attended leadership development programs at an international business school (France, Singapore, and the Middle East) between 2003 and 2012. Because of this international business context, and because of the fact that this school is also based in three different locations, the sample of respondents is unique when it comes to the number of nationalities. This uniqueness allows for broad generalizations across multiple cultures, leaders, nationalities, and organizations. These executives filled out a survey in which they would indicate self-ratings of their own leadership behaviors. Furthermore, these executives were asked to nominate observers who would provide other-ratings on the same leadership behaviors. Being part of the leadership developmental program, executives were specifically instructed to only nominate those observers that can provide honest feedback, lest they would receive invalid responses that would hamper their development. The observers did not provide personal identifying information and subordinate’s responses were completely anonymous. A total of 41,027 subordinates and 17,259 superiors provided such other-ratings. A link to the online survey was sent to the executive and their observers several weeks before the executive took part in the leadership development program. Both self- and other-ratings were provided before the executives attended the leadership development program. Part of this dataset has been used in previous publications (Ibarra and Obodaru, 2009; Agrawal and Rook, 2014).

We took a three-step approach to preparing the data for analysis. First, we had to account for the fact that several leaders and observers participated multiple times. Particularly, several observers (mostly superiors) have provided multiple ratings of (different) leaders. Providing multiple ratings may be associated with various cognitive biases, including central tendency, halo, leniency, restriction of range, and severity biases (Saal et al., 1980; Wherry and Barlett, 1982; Harris and Schaubroeck, 1988; Taylor and Brown, 1988; Van Velsor et al., 1993; Yammarino and Atwater, 1993). To ensure that ratings are unaffected by such cognitive biases, we limited ourselves to the chronogically first self- or other-rating that participants provided, reducing our sample to 14,209 leaders, 39,955 subordinates, and 13,743 superiors. Second, we removed participants with missing values on our focal variables, further reducing our sample to 12,190 leaders, 34,564 subordinates, and 11,996 superiors. Third, to enable us to assess differences between subordinates and superiors (cf. Hypothesis 2), we only retained leaders for which we had self-, subordinate-, and superior-ratings.

Our final sample therefore consisted of 7,778 leaders rated by 22,997 subordinates (M = 2.96, SD = 1.28, range 1–9) and 10,132 superiors (M = 1.30, SD = 0.57, range = 1–6), operating across 53 different industries, including banking, consulting, and telecommunications. The leader sample consisted of 5,958 men (76.60%) and 1,820 women (23.40%) with an average age of 41.16 years (SD = 6.23) and 52 different nationalities. The subordinate sample consisted of 14,788 men (64.30%) and 8,209 women (35.70%) with an average age of 39.36 years (SD = 8.44) and 56 different nationalities. The superior sample consisted of 8,962 men (88.45%) and 1,170 women (11.55%) with an average age of 48.40 years (SD = 7.44) and 54 different nationalities.

In dyadic terms, 16,572 (72.06%) leader-subordinate dyads and 6,630 (65.44%) leader–superior dyads share the same nationality in terms of country of origin. Importantly, although this leaves sizable samples of leader-subordinate and leader-superior dyads that do not share their country of origin, this does not necessarily mean that they are culturally dissimilar, as there may still be substantial overlap in terms of the number of values, beliefs, and norms they share. Previous research has demonstrated that countries can also be pooled into cultural clusters that determine how similar they are culturally (Ronen and Shenkar, 2013). To get a better appreciation of the cultural diversity of leader-observer dyads within our sample, therefore, Table 1 display the distribution of leader-subordinate and leader–superior dyads according to ten cultural clusters previously devised by GLOBE researchers (Gupta et al., 2002), GLOBE being the general theoretical framework we employ. These tables illustrate that 18,502 (80.45%) leader-subordinate dyads and 7,619 (75.20%) leader–superior dyads are from the same cultural cluster. Furthermore, leaders, subordinates, and superiors are represented across all ten clusters, with leader–subordinate dyads representing 90% of possible cluster-combinations and leader-superior dyads 82%. Although certain (combinations of) clusters are more represented than others, the overall distribution within and between cluster combinations appears relatively equal.

TABLE 1

Measures

Cultural Distance

Cultural distance reflects the extent to which dyads of individuals are culturally proximal (i.e., a score of 0) or increasingly distal (i.e., scores increasingly higher than 0). Operationalizations of cultural distance may differ depending (1) on the used cultural typology and (2) on the used method of calculation (see Beugelsdijk et al., 2018 for a review). First, cultural distance measures can be based on different typologies of underlying cultural dimensions (Hofstede, 1980, 2001; Schwartz, 1999; House et al., 2004). These typologies differ substantially in content and are typically lowly correlated amongst each other, which makes it important to decide on a typology based on theoretical grounds (Beugelsdijk et al., 2018). Following previous research (e.g., Kossek et al., 2017) and our theoretical approach, we use the GLOBE dimensions as a basis for our cultural distance measure. The GLOBE dimensions are assertiveness, gender egalitarianism, future orientation, humane orientation, in-group collectivism, institutional collectivism, performance orientation, power distance, uncertainty avoidance, and come in both ‘as is’ practices (i.e., the cultural characteristics that leaders actually enact) and ‘should be’ values (i.e., the cultural characteristics that leaders idealize) (House et al., 2004). We use values as they better reflect people’s implicit leadership theories (Dorfman et al., 2012). Second, cultural distance measures can be based on different calculation methods, including Euclidean- and Mahalanobis-based indices. One of the advantages of the Mahalanobis index is that it takes the full variance-co-variance matrix of the underlying dimensions into account (Mahalanobis, 1937), which has a substantial impact on the resulting cultural distance measure when its underlying cultural dimensions are not very highly correlated (Brereton and Lloyd, 2016). Although research typically uses an Euclidean approach (e.g., Kossek et al., 2017), the Mahalanobis approach is more appropriate for our purposes as it corrects for the covariances of the GLOBE dimensions (Beugelsdijk et al., 2018). Accordingly, for our main analyses, we operationalized cultural distance based on a Mahalanobis index of the GLOBE values dimensions, which we derived from Beugelsdijk et al. (2018; see Berry et al., 2010 for more details on how Mahalanobis distance was calculated). We would note, however, that conclusions drawn from our analyses are similar regardless of whether we use a Mahalanobis or Euclidean distance measure.

Transformational and Transactional Leadership Behaviors

The Global Executive Leadership Inventory (GELI) is a 360-degree leadership feedback instrument (Kets De Vries et al., 2004). The instrument consists of twelve leadership behaviors and characteristics: visioning, empowering, energizing, designing and controlling, rewarding and feedback, team building, outside orientation, global mindset, tenacity, emotional intelligence, life balance, and resilience to stress. The instrument employs a 7-point Likert scale to indicate how well the scale items describe a leader. The continuum of responses ranges from “does not describe me at all” to “describes me very well.” We used the GELI to operationalize transformational and transactional leadership behaviors. The advantage of using the GELI to examine self-other agreement in transformational and transactional leadership is that its items reflect actual behaviors described and observed in the last two decades in leaders around the globe (Kets De Vries et al., 2004), which forgoes some of the recent criticisms of transformational and transactional leadership operationalizations (e.g., van Knippenberg and Sitkin, 2013).

We operationalized transformational leadership using the eight-item visioning dimension of the GELI (“[a]rticulating a compelling vision, mission and strategy with a multi-country, multi-environment, multi-function and multi-gender perspective that connects employees, shareholders, suppliers and customers on a global scale” [Kets De Vries et al., 2004, p. 479]). This dimension aligns with the notion of transformational leadership behaviors as transforming and motivating followers beyond performance expectations by providing a vision, inspiration, and considering employees and other in their unique individuality (cf. Bass and Avolio, 1990) and adheres to the notion that charismatic elements serve as the core of transformational leadership (Shamir et al., 1993; Conger and Kanungo, 1994; van Knippenberg and Sitkin, 2013). An example item includes “I inspire my people to look beyond existing limitations.” The instrument was internally consistent for both leader self-ratings (α = 0.73) and observer other-ratings (α = 0.85).

We operationalized transactional leadership using the eight-item rewarding and feedback dimension of the GELI (“[s]etting up the appropriate reward structures and giving constructive feedback to encourage the kind of behavior that is expected from employees” [Kets De Vries et al., 2004, p. 480]). This dimension aligns with the notion of transactional leadership behaviors as motivating followers to meet performance goals set for them and providing resources and rewards for meeting these goals (cf. Bass and Avolio, 1990) and adheres to the notion that contingent reward serves as the core of transactional leadership (Shamir et al., 1993; Conger and Kanungo, 1994; van Knippenberg and Sitkin, 2013). An example item includes “I make sure that people’s achievements are recognized.” The instrument was internally consistent for both leader self-ratings (α = 0.80) and observer other-ratings (α = 0.90).

Control Variables

We controlled for industry (Brutus et al., 1998), leader and observer (similarity in) age and gender (Ostroff et al., 2004; Fleenor et al., 2010; Braddy et al., 2020), and hierarchical position (Lee and Carpenter, 2018), as they have been shown to be sources of self-other agreement. Furthermore, given cultural influences on self-other agreement (Atwater et al., 2009; Kossek et al., 2017), we included fixed effects for leader and observer nationality, to ensure that they do not distort our cultural distance effects (Kirkman et al., 2006; Harzing and Pudelko, 2016; Beugelsdijk et al., 2017). Finally, we controlled for the year in which the surveys were administered through dummies to rule out time effects.

Analyses

To test our two hypotheses, following previous research studying effects on self-other agreement (Ostroff et al., 2004; McKee et al., 2018), we employed the multivariate regression approach to self-other agreement (Edwards, 1995). Within this approach, self-other agreement is estimated through multivariate models in which both self- and other-ratings are simultaneously regressed on the same set of predictors. The effects of a predictor on self- and other-ratings can then be compared to gauge whether this predictor contributes to disagreement. Predictors are considered sources of disagreement when their effects on self- and other-ratings is statistically different. This multivariate approach is superior to alternative approaches such as difference scores, as it allows for identification of where disagreement comes from, in this case the self and/or other (for a review, see Fleenor et al., 2010).

We used Stata (StataCorp, 2017) to estimate generalized structural equation models in which we simultaneously regressed leader- and observer-rated transformational and transactional leadership behaviors on the predictors. We used a cluster-robust estimator (Rogers, 1994) to cluster standard errors at the leader level (n = 7,778) to account for the potential bias resulting from leaders being rated by multiple observers (cf. McKee et al., 2018). We chose this approach as previous research has demonstrated that reliabilities within different groups of observers are considered to be relatively low (Conway and Huffcutt, 1997) and because we do not presuppose theoretical differences in within- and between-group estimates (cf. mixed effects models). We standardized the independent variables (i.e., gender, age, hierarchical position, and cultural distance) and used Wald tests to compare the effects of the predictors across the different self- and other-ratings.

Results

Descriptive Statistics

Descriptive statistics and inter-correlations can be found in Table 2. Out of the 33,129 leader–observer dyads, 23,202 (70.04%) were culturally proximal (i.e., had a cultural distance of 0) and 9,927 (29.96%) were culturally distal (i.e., had a cultural distance larger than 0). In line with general self-other agreement findings (e.g., Harris and Schaubroeck, 1988; Lee and Carpenter, 2018), correlations between self- and other-ratings of transformational leadership, r(33,219) = 0.14, p < 0.001, and transactional leadership, r(33,219) = 0.15, p < 0.001, were relatively low. Furthermore, in line with previous research (for an overview, see Fleenor et al., 2010), older, r(33,219) = 0.06, p < 0.001, and male leaders r(33,219) = –0.02, p < 0.001, provided higher self-ratings on transformational leadership than younger and female leaders. Finally, correlation magnitudes are roughly in line with previous research (Ostroff et al., 2004).

TABLE 2
www.frontiersin.org

Table 2. Descriptive statistics and intercorrelations for leader–observer dyads.

Hypotheses Testing

Hypothesis 1 stated that cultural distance is negatively related to self-other agreement. To test this hypothesis, we estimated a model in which we used all control variables and cultural distance as predictors of transformational and transactional leadership (see Table 3). First, in terms of transformational leadership, results indicate that cultural distance is positively related to self-ratings of transformational leadership (b = 0.011, p < 0.05, column 1), and negatively related to other-ratings of transformational leadership, (b = –0.020, p < 0.001, column 2). The Wald test reveals that the effect of cultural distance on self- and other-ratings of transformational leadership are significantly different [b = 0.032, χ2(1) = 21.93, p < 0.001, column 3]. Second, for transactional leadership, results indicate that cultural distance is positively related to self-ratings (b = 0.012, p < 0.10, column 4), and negatively related to other-ratings of transactional leadership (b = –0.012, p < 0.10, column 5) at a marginal significance level. The Wald test reveals that the effects of cultural distance on self- and other-ratings of transactional leadership are significantly different [b = 0.024, χ2(1) = 8.00, p < 0.01, column 6]. Accordingly, these results provide support for Hypothesis 1, by demonstrating that cultural distance is negatively associated with self-other agreement. Interestingly, for both transformational and transactional leadership, this association with self-other agreement is determined both by increased self-ratings and decreased other-ratings.

TABLE 3
www.frontiersin.org

Table 3. Multivariate regressions and Wald tests for leader-observer dyads.

Hypothesis 2 stated that the effect of cultural distance on self-other agreement is moderated by the hierarchical position of the observer (i.e., subordinate vs. superior), such that the relationship is stronger for superiors than for subordinates. To test this hypothesis, we reran the previous model (see Table 3) with the interaction term between hierarchical position and cultural distance added as predictor of transformational and transactional leadership self- and other-ratings (see Table 4), and we calculated simple main effects (see Table 5). First, for transformational leadership, results in Table 4 indicate that the interaction is unrelated to self-ratings (b = 0.004, ns), and negatively to other-ratings (b = –0.011, p < 0.05). The Wald test reveals that the interaction effects are significantly different for self- and other-ratings [b = 0.014, χ2(1) = 6.53, p < 0.05]. As Table 5 shows, simple main effects of cultural distance on self-other agreement on transformational leadership for leader-subordinate dyads (b = 0.021, p < 0.05), and leader-superior dyads (b = 0.053, p < 0.001), are indeed significantly different [b = –0.031, χ2(1) = 6.53, p < 0.05]. Second, for transactional leadership, results in Table 4 indicate that the interaction is unrelated to self-ratings, (b = 0.005, ns), and negatively to other-ratings (b = –0.011, p < 0.05). The Wald test reveals that the interaction effects are significantly different for self- and other-ratings [b = 0.016, χ2(1) = 6.05, p < 0.05]. As Table 5 shows, simple main effects of cultural distance on self-other agreement on transactional leadership for leader-subordinate dyads (b = 0.012, ns), and leader-superior dyads (b = 0.046, p < 0.001), are significantly different [b = –0.034, χ2(1) = 6.05, p < 0.05]. Taken together, these results provide support for Hypothesis 2 by demonstrating that the negative relationship between cultural distance and self-other agreement is stronger for leader-superior than for leader-observer dyads. Interestingly, for both transformational and transactional leadership, this result is determined primarily by lower other-ratings.

TABLE 4
www.frontiersin.org

Table 4. Multivariate regressions and Wald tests for leader-observer dyads.

TABLE 5
www.frontiersin.org

Table 5. Simple main effects for leader-observer dyads.

Robustness Checks

To check the robustness of our findings, we conducted several additional analyses. First, acknowledging that the number of culturally similar leader-observer dyads in our sample is relatively high (70.04%), we alternated the ratios of culturally proximal vs. culturally distal dyads (60% vs. 40%, 50% vs. 50%, 40% vs. 60%, and 30% vs. 70%) by drawing random subsamples of culturally similar leader-observer dyads. We reran our main analyses using these random subsamples, of which results are reported in Appendices A1, A2. These results are very comparable to those from our main analyses. That is, except for a marginally significant interaction effect on self-other agreement of transactional leadership for the 30% vs. 70% subsample, cultural distance effects were significant across all subsamples. Our conclusions are therefore relatively robust against overrepresentation of culturally proximal dyads and underrepresentation of culturally distal dyads.

Second, acknowledging the different approaches to operationalizing cultural distance, we reran our analyses using seven alternative Mahalanobis-based cultural distance measures (see also Beugelsdijk et al., 2018): (a) GLOBE practices, (b) Hofstede (2001), (c) Schwartz (1999), (d) Berry et al. (2010), (e) Beugelsdijk et al. (2015a), (f) a composite of the Hofstede and Schwartz dimensions, and (g) a composite of the GLOBE values, Hofstede, and Schwartz dimensions, of which results are reported in Appendices B1, B2. Results from these supplementary analyses are very comparable to those from our main analyses. That is, except for a non-significant interaction effect on self-other agreement of transformational leadership for the Beugelsdijk et al. (2015a) measure, cultural distance effects were significant across all cultural distance measures. Our conclusions are therefore relatively robust for different cultural distance measures.

Discussion and Implications

In this paper, we analyzed how multisource feedback operates in a multicultural context. Specifically, we studied how cultural distance between leaders and observers relates to self-other agreement. First, drawing from leadership categorization theory (Lord et al., 1982, 1984; Lord and Maher, 1991), we hypothesized and found that cultural distance is associated with lower self-other agreement on transformational and transactional leadership behaviors. Results indicate that cultural distance negatively relates to self-other agreement in two ways. First, cultural distance negatively relates to the other-ratings provided by observers. This finding is in line with leadership categorization theory (Lord et al., 1982, 1984; Lord and Maher, 1991) and research on implicit leadership theories in intercultural settings (House et al., 2004). Moreover, we also find that cultural distance relates to higher self-ratings provided by leaders. One possible explanation for the latter finding might lie in the fact that, in general, inflated self-perceptions of leadership behaviors like transformational behavior boost leaders’ feelings of efficacy and confidence (Taylor and Brown, 1988, 1994). It is conceivable that in a context with culturally distal superiors or subordinates, feeling confident is even more important, such that the inclination to self-enhance as a leader is stronger. This may hold especially true for bicultural leaders that may additionally rely on their cross-cultural competences and multiple cultural profiles (Lakshman, 2013).

Second, drawing upon the approach/inhibition theory of power (Keltner et al., 2003), we hypothesized and found that the negative relationship between cultural distance and self-other agreement depends on the hierarchical position of the observer. Results consistently show that the effects of cultural distance are indeed stronger for leader-superior than for leader-subordinate dyads. This dissimilarity is primarily determined by lower scores of superiors. In line with findings of Galinsky et al. (2006), our results seem to support the idea that people with high power are less dependent on others, and therefore it is less important for them to have an accurate and comprehensive understanding of others, in our case their leaders.

Theoretical Implications for Self-Other Agreement in Multisource Feedback

To the best of our knowledge, our study is the first to investigate the role of cultural distance in multisource feedback and self-other agreement. Whereas previous research has shown that self-other agreement operates differently across countries and cultures (e.g., Atwater et al., 2005; Gentry et al., 2007; Varela and Premeaux, 2008) and that being from a different culture or country can influence evaluations (e.g., Caligiuri and Day, 2000; Testa, 2002, 2009; Smith et al., 2012; Kossek et al., 2017), no study known to us has studied how cultural distance influences self-other agreement, especially not when simultaneously considering the hierarchical position of observers. By doing so, the current study integrates research on self-other agreement with leadership categorization theory (Lord et al., 1982, 1984; Lord and Maher, 1991) and the approach/inhibition theory of power (Keltner et al., 2003). Previous research has come up with various cognitive mechanisms to explain self-other agreement (e.g., McKee et al., 2018), including topics as observability and criteria used when providing self- and other-ratings (Tsui and Ohlott, 1988; Yammarino and Atwater, 1993; Oh and Berry, 2009). Our integrated theoretical perspective and the findings of our study have three theoretical implications.

First, our study has implications for the interpretation and meaning of leader- and observer-ratings in self-other agreement and multisource feedback. Notwithstanding some exceptions (e.g., Fleenor et al., 2010; McKee et al., 2018), the self-other agreement literature in general assumes that self-ratings are considered to be less accurate than other-ratings (e.g., Atwater et al., 1998). Self-other agreement is often assumed to indicate self-awareness on the leaders’ part; the dominant assumption is that disagreement primarily indicates that leaders over- or underestimate themselves. This perspective ignores the fact that leaders’ ratings may be accurate and that observers over- or underestimate the behaviors of the leader (cf. Van der Kam et al., 2014; McKee et al., 2018). Our findings again confirm the limitations of this perspective, because we demonstrate that observer ratings can serve as the primary source of self-other agreement, when cultural distance is taken into account. Moreover, the fact that the relevance of cultural distance is conditional upon the hierarchical position of the observer, serves to exuberate the idea that self-other agreement is driven more strongly by observers’ ratings, particularly in case of superior ratings. Given the overwhelming evidence for biases in self-ratings (Harris and Schaubroeck, 1988; Tsui and Ohlott, 1988; Yammarino and Atwater, 1993; Atwater et al., 1998), we would of course not claim that leaders’ self-ratings are by definition less biased than observers’ ratings. Indeed, to be able to answer whether self- and/or other-ratings are biased, one would need to apply a componential approach using round-robin data (Kwan et al., 2004; Van der Kam et al., 2015), which our dataset unfortunately did not allow for. Notwithstanding this limitation, our results suggest that the field of organizational psychology should further acknowledge that leaders’ self-ratings are not necessarily more (in)accurate than observers’ ratings, especially in case of cultural distance between the leader and the observer, and especially when it concerns ratings of the superior.

Second, extending the previous point, our study has implications for the role of self-awareness in the self-other agreement literature. The self-other agreement literature strongly assumes that classifying leaders as self-aware individuals, overestimators, or underestimators, provides meaningful directions for leader development (Yammarino and Atwater, 1993; Atwater et al., 1998). These classifications are based on an assumption that leaders and observers use equivalent criteria, and also on the assumption that observers’ ratings are more accurate than those by leaders themselves. Our findings suggest that leaders and observers with distinct cultural backgrounds probably have different implicit leadership theories which influence their expectations about appropriate leadership and therefore also influence the criteria they use to assess leadership behaviors (Tsui and Ohlott, 1988; Yammarino and Atwater, 1993; Oh and Berry, 2009).

Third, our study has implications for self-other agreement of transformational and transactional leadership behaviors. Transformational and transactional leadership behaviors are often studied within the context of self-other agreement (e.g., Bass and Yammarino, 1991; Whittington et al., 2009; Ertürk et al., 2018; Vogel and Kroll, 2019). Meta-analytic evidence suggests that leaders and observers are more likely to disagree on transformational than on transactional leadership (Lee and Carpenter, 2018). Although social desirability effects have been suggested to be a source of these differences, it is not clear whether this is actually the case. Furthermore, notwithstanding specific boundary conditions (Crede et al., 2019), there is mixed empirical evidence as to whether such leadership behaviors are culturally universal (Den Hartog et al., 1999) or whether there are specific cultural elements to them (e.g., Gerstner and Day, 1994; Dorfman et al., 1997; Money and Graham, 1999; Javidan and Carl, 2004; Karakitapoglu-Aygün and Gumusluoglu, 2013). Our study demonstrates that cultural distance does influence self-other agreement on both transformational and transactional leadership behaviors – more so for leader–superior than for leader-subordinate dyads.

Finally, notwithstanding slight differences in effect sizes, the relationships between cultural distance and self-other agreement of transformational and transactional leadership are relatively homogeneous across the two leadership behaviors. This result has important theoretical implications for where we can attribute the source of variance to. Specifically, in our study, cultural distance is both (marginally) positively related to self-ratings and (marginally) negatively related to other-ratings, with the effect of superior ratings being even stronger than subordinate ratings. This implies that the rating sources (i.e., self vs. subordinate vs. superior) are not necessarily interchangeable and that these sources may have different conceptualizations of leadership (cf. Lee and Carpenter, 2018). Given the consistent outcomes across transformational and transactional leadership in our study, therefore, it seems plausible to conclude that cultural distance elicits more general cognitive biases effects rather than effects tied into specific leadership styles. On the one hand, these results contribute to understanding some of the unexplained heterogeneity in self-other agreement differences between transformational and transactional leadership (Lee and Carpenter, 2018). On the other hand, these outcomes contribute to the debate about the cultural universality or specificity of transformational and transactional by suggesting that leaders and observers may hold culturally dependent implicit leadership theories about these behaviors.

Practical Implications for Self-Other Agreement in Culturally Dissimilar Dyads

One of the strengths of the self-other agreement literature is that it has immense implications for various groups of practitioners, including the leaders being rated, the observers providing the ratings, and the HR-managers responsible for the multisource feedback systems that facilitate these ratings. The results of our study introduce various relevant practical implications affecting all of these groups, but especially for HR-managers. First and foremost, our study suggests a clear bias of observers against culturally distant leaders. Because culturally distant leaders are already faced with various challenges (Ocker et al., 2011; Kossek et al., 2017), to avoid invalid and even unfair evaluations of their leader behaviors, HR-professionals should use and interpret self-other agreement across culturally different leader–observer dyads with caution.

The bias in self-other agreement seems to originate from different lenses or criteria when raters rate leaders’ behaviors (Tsui and Ohlott, 1988; Yammarino and Atwater, 1993; Oh and Berry, 2009). The implicit leadership theories we hold are not the same across all cultures and contexts (Gerstner and Day, 1994; Den Hartog et al., 1999; House et al., 2004; Dorfman et al., 2012), and these theories affect how we rate culturally similar and dissimilar others (Shaw, 1990; Newman and Nollen, 1996). It is important for both leaders and observers to be aware of this fact (Lu and Wan, 2018). More generally, organizations can reduce the effects of this bias, for instance, by explicitly and specifically stating which aspects of leadership behaviors are to be rated, or by increasing cultural awareness through intercultural sensitivity training programs (Landis and Bhagat, 1996; Lu and Wan, 2018).

Third, self-other agreement is often used as input to make crucial HR-decisions with respect to leader development and performance, and sometimes even promotion (Ostroff et al., 2004; Fleenor et al., 2010). The reliability and viability of these decisions and outcomes critically hinges upon both self- and other-ratings being void of bias. Our results show that in situations of cultural distance, such ratings have to be used with caution, especially the ratings by superiors. If all parties involved really want to use multisource feedback systems for both culturally similar and culturally similar leader–observer dyads, it is imperative that they acknowledge how cultural distance can influence the rating process, and especially how ratings by culturally different superiors are driven by implicit leadership theories.

Limitations and Future Research Directions

Notwithstanding its merits, our study is not without limitations. There are several methodological and statistical issues that limit our contribution. First, we used a cross-sectional design in which we administered the survey to measure our variables at the same time. To be able to make causal claims, a preferred research design would include repeated measures of the same leaders with multiple ratings of culturally similar and dissimilar observers. Second, while the instruments were administered to a wide variety of leaders across various contexts, industries, and countries allowing for broad generalizations, most of the leaders were relatively high up the hierarchical level. Although research has demonstrated that leader status is unrelated to self-other agreement (Lee and Carpenter, 2018), this cannot rule out that the effects demonstrated in our study do not apply to leaders lower down the hierarchical ladder. Third, leaders were personally responsible for nominating observers that would provide honest feedback. Given the instructions provided to the leaders and the leadership development program they were in, we are relatively confident that they would draw a representative sample of observers. We cannot rule out, however, the potential for selection bias that could affect the reliability of the other-ratings. Fourth, the data we used in our study were collected between 2003 and 2012, which makes the dataset nearly a decade old at the time of writing. Notwithstanding the fact that our results are robust to temporal effects in the decade under study (i.e., we controlled for year in our estimations), our results may be subject to other temporal effects occurring after the period our data were gathered. Specifically, while the relative distances between cultures are likely to remain stable over time (Beugelsdijk et al., 2015b), people’s cognitive schemas about how to handle cultural distance in terms of receiving and providing feedback may be subject to temporal changes.

Fifth, because we had no information about the organization of the participants in the leadership development program, we were unable to control for the actual geographical location of the organization. Accordingly, although we know when leaders and observers originate from different countries, we do not know which one can be considered the expatriate. This is unfortunate, as expatriates are typically treated differently than locals (Kossek et al., 2017). Hence, knowing whether a leader is an expatriate or a local may have important implications for the type of leadership behaviors they prefer and how they are accordingly are perceived by observers. In a similar vein, we used cultural values at the country-level as input for our cultural distance measure, which may not represent the personal values at the individual level. Although cultural and personal values are likely to be related (cf. the cultural expertise and personal values proposition, Peterson and Barreto, 2014), these studying these cultural values at the country-level may have attenuated our findings. Moreover, in line with our theoretical approach, we used a cultural distance measure based on a configuration of cultural dimensions rather than studying single cultural value dimensions. While this approach corresponds with previous cultural distance research (Beugelsdijk et al., 2018), this does not rule out that distance on some cultural dimensions may have stronger effects on self-other agreement than others. Although we have explored the effects of cultural distance on specific cultural dimensions (results available on request from the first author), found that certain cultural dimensions had stronger effects than others, we were unable to draw meaningful conclusions within the scope of this manuscript. Still, disentangling distance effects of specific cultural dimensions could increase our understanding of how self-other agreement operates in intercultural contexts. Similarly, although we have focused on studying culture, there are several other societal and national factors that could contribute to self-other agreement in multinational teams, including differences in development, language, or status (e.g., Haas, 2005; Neeley, 2013; Paunova, 2017).1

Also, we do not explicitly test whether the relationship between cultural distance and self-other agreement is indeed driven by implicit leadership theories. Recent studies have demonstrated that culturally endorsed leadership attributes serve as crucial mediating mechanisms between (leadership) variables that are seemingly unrelated (Dorfman et al., 2012). Although measuring implicit leadership theories is no precondition for using leadership categorization theory as an explanatory framework (e.g., Den Hartog et al., 1999; House et al., 2004), not measuring them opens up the possibility that our effects could be driven by alternative (causal) mechanisms. Indeed, whereas we assume that leader prototypes influence leader evaluations, earlier research on leadership categorization theory suggest that leader evaluations influence leader prototypes (e.g., Phillips and Lord, 1982; Cronshaw and Lord, 1987). This seems unlikely within our study context given that implicit leadership theories are culturally dependent (Gerstner and Day, 1994; Den Hartog et al., 1999; House et al., 2004), but is not something we can rule out at this time. In a similar vein, our results could instead be driven by in-group favoritism effects due to similarity-attraction mechanisms (Byrne et al., 1986). Given that we find no such similarity-attraction effects for age and gender, however, leads us to believe that our effects are unlikely to be driven merely by similarity-attraction mechanisms. Still, there are various other characteristics, such as race and personality, not available in our data that may yet influence self-other agreement through similarity-attraction processes (Antonioni and Park, 2001; Ostroff et al., 2004; Rosette et al., 2008). Future research could more explicitly test whether the effects reported here are driven by implicit leadership theories, similarity-attraction concerns, or other theoretically meaningful mechanisms.

Finally, we limited ourselves to studying transformational and transactional leadership behaviors. Although these leadership styles have previously been studied within self-other agreement contexts (e.g., Bass and Yammarino, 1991; Whittington et al., 2009; Ertürk et al., 2018; Vogel and Kroll, 2019), effects for self-other agreement may be different for other leadership styles (Lee and Carpenter, 2018). Furthermore, we used the GELI (Kets De Vries et al., 2004) to operationalize transformational and transactional leadership behaviors, which may not fully capture all underlying dimensions of transformational and transactional leadership. To further explore whether all or specific dimensions of transactional and transformational leadership are culturally contingent (Den Hartog et al., 1999), future research could use more extensive scales (e.g., the MLQ, Bass and Avolio, 1990).

Conclusion

In our increasingly globalized world, multisource feedback plays a crucial role in guiding leader development (Atwater et al., 1998, 2009; Fleenor et al., 2010; Kossek et al., 2017). An important result of such multisource feedback is self-other agreement, which has shown to be relevant for leader effectiveness (Yammarino and Atwater, 1993; Atwater et al., 1998). Our study suggests that the cultural distance between leaders and observers is a crucial variable for self-other agreement, such that cultural distance is associated with lower self-other agreement on transformational and transactional leadership behaviors. Although it may be tempting to conclude that this disagreement may stem from the culturally distant leaders, our results indicate that this disagreement mostly stems from observers, and particularly from superiors. It may therefore be inappropriate and even dangerous to base important development and promotion decisions on such potentially biased self-other agreement within intercultural contexts. Given the importance and prevalence of multisource feedback in gauging leader effectiveness and development (Yammarino and Atwater, 1993; Atwater et al., 1998), organizations should interpret the results from multisource feedback systems in culturally dissimilar dyads with caution, by being aware that the ratings are strongly related to the cultural distance between a leader and the observer.

Data Availability Statement

The data analyzed in this study is subject to the following licenses/restrictions: The data are owned by the Kets de Vries Institute and INSEAD. The authors have no rights to share the data with others. Requests to access these datasets should be directed to MK, research@kdvi.com.

Ethics Statement

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

TV, CR, HG, and JS contributed to developing the research idea, conceptualizing the framework, and writing the manuscript. TV contributed to the statistical analyses. CR and MK contributed to data collection. All authors read and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

  1. ^ We thank the reviewer for offering this suggestion.

References

Agrawal, A., and Rook, C. (2014). Global leaders in east and west: do all global leaders lead in the same way. Adv. Glob. Leadersh. 8:15. doi: 10.1108/S1535-120320140000008015

CrossRef Full Text | Google Scholar

Antonioni, D., and Park, H. (2001). The effects of personality similarity on peer ratings of contextual work behaviors. Personnel Psychol. 54, 331–360. doi: 10.1111/j.1744-6570.2001.tb00095.x

CrossRef Full Text | Google Scholar

Atwater, L. E., Ostroff, C., Yammarino, F. J., and Fleenor, J. W. (1998). Self-other agreement: does it really matter? Pers. Psychol. 51, 577–598. doi: 10.1111/j.1744-6570.1998.tb00252.x

CrossRef Full Text | Google Scholar

Atwater, L. E., Waldman, D. A., and Brett, J. F. (2002). Understanding and optimizing multisource feedback. Hum. Resour. Manag. 41, 193–208. doi: 10.1002/hrm.10031

CrossRef Full Text | Google Scholar

Atwater, L. E., Waldman, D. A., Robie, C., Ostroff, C., and Johnson, K. M. (2005). Self-other agreement: comparing its relationship with performance in the U.S. and Europe. Int. J. Select. Assess. 13, 25–40. doi: 10.1111/j.0965-075x.2005.00297.x

CrossRef Full Text | Google Scholar

Atwater, L. E., Wang, M., Smither, J. W., and Fleenor, J. W. (2009). Are cultural characteristics associated with the relationship between self and others’ ratings of leadership? J. Appl. Psychol. 94, 876–886. doi: 10.1037/a0014561

PubMed Abstract | CrossRef Full Text | Google Scholar

Atwater, L. E., Yu, J., Tawse, A., Fields, L. H., and McFarren, J. A. (2021). Relevance of culture in studies of leadership: ignored or dismissed? Asia Pac. J. Manag. 38, 687–708. doi: 10.1007/s10490-019-09678-w

CrossRef Full Text | Google Scholar

Bass, B. M. (1985). Leadership and Performance Beyond Expectation. New York, NY: Free Press.

Google Scholar

Bass, B. M., and Avolio, B. J. (1990). Transformational Leadership Development: Manual For The Multifactor Leadership Questionnaire. Palo Alto, CA: Consulting Psychologists Press.

Google Scholar

Bass, B. M., and Yammarino, F. J. (1991). Congruence of self and others’ leadership ratings of naval officers for understanding successful performance. Appl. Psychol. 40, 437–454. doi: 10.1111/j.1464-0597.1991.tb01002.x

CrossRef Full Text | Google Scholar

Berry, H., Guillén, M. F., and Zhou, N. (2010). An institutional approach to cross-national distance. J. Int. Bus. Stud. 41, 1460–1480. doi: 10.1057/jibs.2010.28

CrossRef Full Text | Google Scholar

Beugelsdijk, S., Ambos, B., and Nell, P. C. (2018). Conceptualizing and measuring distance in international business research: recurring questions and best practice guidelines. J. Int. Bus. Stud. 49, 1113–1137. doi: 10.1057/s41267-018-0182-4

CrossRef Full Text | Google Scholar

Beugelsdijk, S., Kostova, T., and Roth, K. (2017). An overview of Hofstede-inspired country-level culture research in international business since 2006. J. Int. Bus. Stud. 48, 30–47. doi: 10.1057/s41267-016-0038-8

CrossRef Full Text | Google Scholar

Beugelsdijk, S., Maseland, R., Onrust, M., Van Hoorn, A., and Slangen, A. (2015a). Cultural distance in international business and management: from mean-based to variance-based measures. Int. J. Hum. Resour. Manag. 26, 165–191. doi: 10.1080/09585192.2014.922355

CrossRef Full Text | Google Scholar

Beugelsdijk, S., Maseland, R., and van Hoorn, A. (2015b). Are scores on Hofstede’s dimensions of national culture stable over time? A cohort analysis. Glob. Strat. J. 5, 223–240. doi: 10.1002/gsj.1098

CrossRef Full Text | Google Scholar

Braddy, P. W., Sturm, R. E., Atwater, L., Taylor, S. N., and McKee, R. A. (2020). Gender bias still plagues the workplace: looking at derailment risk and performance with self–other ratings. Group Organ. Manag. 45, 315–350. doi: 10.1177/1059601119867780

CrossRef Full Text | Google Scholar

Brereton, R. G., and Lloyd, G. R. (2016). Re-evaluating the role of the Mahalanobis distance measure. J. Chemometr. 30, 134–143. doi: 10.1002/cem.2779

CrossRef Full Text | Google Scholar

Brutus, S., Fleenor, J. W., and London, M. (1998). Does 360-degree feedback work in different industries? A between-industry comparison of the reliability and validity of multi-source performance ratings. J. Manag. Dev. 17, 177–190. doi: 10.1108/eum0000000004487

CrossRef Full Text | Google Scholar

Brutus, S., Fleenor, J. W., and McCauley, C. D. (1999). Demographic and personality predictors of congruence in multi-source ratings. J. Manag. Dev. 18, 417–435. doi: 10.1108/02621719910273569

CrossRef Full Text | Google Scholar

Burns, J. M. (1978). Leadership. New York: Harper & Row.

Google Scholar

Byrne, D., Clore, G. L., and Smeaton, G. (1986). The attraction hypothesis: do similar attitudes affect anything? J. Personal. Soc. Psychol. 51, 1167–1170. doi: 10.1037/0022-3514.51.6.1167

CrossRef Full Text | Google Scholar

Caligiuri, P. M., and Day, D. V. (2000). Effects of self-monitoring on technical, contextual, and assignment-specific performance. Group Organ. Manag. 25, 154–174. doi: 10.1177/1059601100252004

CrossRef Full Text | Google Scholar

Conger, J. A., and Kanungo, R. N. (1994). Charismatic leadership in organizations: perceived behavioral attributes and their measurement. J. Organ. Behav. 15, 439–452. doi: 10.1002/job.4030150508

CrossRef Full Text | Google Scholar

Conway, J. M., and Huffcutt, A. I. (1997). Psychometric properties of multisource performance ratings: a meta-analysis of subordinate, supervisor, peer, and self-ratings. Hum. Perform. 10, 331–360. doi: 10.1207/s15327043hup1004_2

CrossRef Full Text | Google Scholar

Crede, M., Jong, J., and Harms, P. (2019). The generalizability of transformational leadership across cultures: a meta-analysis. J. Manag. Psychol. 34, 139–155. doi: 10.1108/jmp-11-2018-0506

CrossRef Full Text | Google Scholar

Cronshaw, S. F., and Lord, R. G. (1987). Effects of categorization, attribution, and encoding processes on leadership perceptions. J. Appl. Psychol. 72, 97–106. doi: 10.1037/0021-9010.72.1.97

CrossRef Full Text | Google Scholar

Den Hartog, D. N., House, R. J., Hanges, P. J., Antonio Ruiz-Quintanilla, S., and Dorfman, P. W. (1999). Culture specific and cross-culturally generalizable implicit leadership theories: are attributes of charismatic/transformational leadership universally endorsed? Leadersh. Q. 10, 219–252.

Google Scholar

DeNisi, A. S., Cafferty, T. P., and Meglino, B. M. (1984). A cognitive view of the performance appraisal process: a model and research propositions. Organ. Behav. Hum. Perform. 33, 360–396. doi: 10.1016/0030-5073(84)90029-1

CrossRef Full Text | Google Scholar

Dickson, M. W., Den Hartog, D. N., and Mitchelson, J. K. (2003). Research on leadership in a cross-cultural context: making progress, and raising new questions. Leadersh. Q. 14, 729–768. doi: 10.1016/j.leaqua.2003.09.002

CrossRef Full Text | Google Scholar

Dorfman, P. W., Howell, J. P., Hibino, S., Lee, J. K., and Tate, U. (1997). Leadership in Western and Asian countries: commonalities and differences in effective leadership processes across cultures. Leadersh. Q. 8, 233–274. doi: 10.1016/s1048-9843(97)90003-5

CrossRef Full Text | Google Scholar

Dorfman, P. W., Javidan, M., Hanges, P. J., Dastmalchian, A., and House, R. J. (2012). GLOBE: a twenty year journey into the intriguing world of culture and leadership. J. World Bus. 47, 504–518. doi: 10.1016/j.jwb.2012.01.004

CrossRef Full Text | Google Scholar

Eckert, R., Ekelund, B. Z., Gentry, W. A., and Dawson, J. F. (2010). “I don’t see me like you see me, but is that a problem?” Cultural influences on rating discrepancy in 360-degree feedback instruments. Eur. J. Work Organ. Psychol. 19, 259–278. doi: 10.1080/13594320802678414

CrossRef Full Text | Google Scholar

Edwards, J. R. (1995). Alternatives to difference scores as dependent variables in the study of congruence in organizational research. Organ. Behav. Hum. Decis. Process. 64, 307–324. doi: 10.1006/obhd.1995.1108

CrossRef Full Text | Google Scholar

Ensari, N., and Murphy, S. E. (2003). Cross-cultural variations in leadership perceptions and attribution of charisma to the leader. Organ. Behav. Hum. Decis. Process. 92, 52–66.

Google Scholar

Epitropaki, O., Sy, T., Martin, R., Tram-Quon, S., and Topakas, A. (2013). Implicit leadership and followership theories “in the wild”: taking stock of information-processing approaches to leadership and followership in organizational settings. Leadersh. Q. 24, 858–881. doi: 10.1016/j.leaqua.2013.10.005

CrossRef Full Text | Google Scholar

Ertürk, A., Van den Broeck, H., and Verbrigghe, J. (2018). Self-other agreement on transformational leadership and subordinates’ assessment of supervisor’s performance: mediating role of leader-member exchange. Leadersh. Organ. Dev. J. 39, 291–308. doi: 10.1108/lodj-02-2016-0048

CrossRef Full Text | Google Scholar

Farh, J.-L., Dobbins, G. H., and Cheng, B.-S. (2007). Cultural relativity in action: a comparison of self-ratings made by Chinese and U.S. workers. Personnel Psychol. 44, 129–147. doi: 10.1111/j.1744-6570.1991.tb00693.x

CrossRef Full Text | Google Scholar

Fleenor, J. W., Smither, J. W., Atwater, L. E., Braddy, P. W., and Sturm, R. E. (2010). Self-other rating agreement in leadership: a review. Leadersh. Q. 21, 1005–1034. doi: 10.1016/j.leaqua.2010.10.006

CrossRef Full Text | Google Scholar

Galinsky, A. D., Magee, J. C., Gruenfeld, D. H., Whitson, J. A., and Liljenquist, K. A. (2008). Power reduces the press of the situation: implications for creativity, conformity, and dissonance. J. Pers. Soc. Psychol. 95, 1450–1466. doi: 10.1037/a0012633

PubMed Abstract | CrossRef Full Text | Google Scholar

Galinsky, A. D., Magee, J. C., Inesi, M. E., and Gruenfeld, D. H. (2006). Power and perspective not taken. Psychol. Sci. 17, 1068–1074.

Google Scholar

Gentry, W. A., Hannum, K. M., Ekelund, B. Z., and de Jong, A. (2007). A study of the discrepancy between self- and observer-ratings on managerial derailment characteristics of European managers. Eur. J. Work Organ. Psychol. 16, 295–325. doi: 10.1080/13594320701394188

CrossRef Full Text | Google Scholar

Gerstner, C. R., and Day, D. V. (1994). Cross-cultural comparison of leadership prototypes. Leadersh. Q. 5, 121–134. doi: 10.1016/1048-9843(94)90024-8

CrossRef Full Text | Google Scholar

Guinote, A. (2007). Power affects basic cognition: increased attentional inhibition and flexibility. J. Exp. Soc. Psychol. 43, 685–697. doi: 10.1016/j.jesp.2006.06.008

CrossRef Full Text | Google Scholar

Gupta, V., Hanges, P. J., and Dorfman, P. W. (2002). Cultural clusters: methodology and findings. J. World Bus. 37, 11–15. doi: 10.1016/s1090-9516(01)00070-0

CrossRef Full Text | Google Scholar

Haas, M. R. (2005). “Cosmopolitans and locals: status rivalries, deference, and knowledge in international teams,” in Research on Managing Groups and Teams: Status and Groups, 7th Edn, eds E. A. Mannix, M. A. Neale, and M. C. Thomas-Hunt (Oxford: Elsevier), 201–227.

Google Scholar

Hansbrough, T. K., Lord, R. G., and Schyns, B. (2015). Reconsidering the accuracy of follower leadership ratings. Leadersh. Q. 26, 220–237. doi: 10.1016/j.leaqua.2014.11.006

CrossRef Full Text | Google Scholar

Harris, M. M., and Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Pers. Psychol. 41, 43–62. doi: 10.1111/j.1744-6570.1988.tb00631.x

CrossRef Full Text | Google Scholar

Harzing, A.-W., and Pudelko, M. (2016). Do we need to distance ourselves from the distance concept? Why home and host country context might matter more than (cultural) distance. Manag. Int. Rev. 56, 1–34. doi: 10.1007/s11575-015-0265-4

CrossRef Full Text | Google Scholar

Heidemeier, H., and Moser, K. (2009). Self-other agreement in job performance ratings: a meta-analytic test of a process model. J. Appl. Psychol. 94, 353–370. doi: 10.1037/0021-9010.94.2.353

PubMed Abstract | CrossRef Full Text | Google Scholar

Hiller, N. J., DeChurch, L. A., Murase, T., and Doty, D. H. (2011). Searching for outcomes of leadership: a 25-year review. J. Manag. 37, 1137–1177. doi: 10.1177/0149206310393520

CrossRef Full Text | Google Scholar

Hofstede, G. (1980). Culture’s Consequences: International Differences in Work- Related Values. Beverly Hills, CA: SAGE Publications, Inc.

Google Scholar

Hofstede, G. (2001). Culture’s Consequences; Comparing Values, Behaviors, Institutions, and Organizations Across Nations. Thousand Oaks, CA: SAGE Publications, Inc.

Google Scholar

Hofstede, G. (2006). What did GLOBE really measure? Researchers’ minds versus respondents’ minds. J. Int. Bus. Stud. 37, 882–896. doi: 10.1057/palgrave.jibs.8400233

CrossRef Full Text | Google Scholar

House, R. J., Dorfman, P. W., Javidan, M., Hanges, P. J., and de Luque, M. F. S. (2014). Strategic Leadership Across Cultures: The GLOBE Study of CEO Leadership Behavior and Effectiveness in 24 Countries. London: SAGE Publications, Ltd.

Google Scholar

House, R. J., Hanges, P. J., Javidan, M., Dorfman, P. W., and Gupta, V. (2004). Leadership, Culture and Organizations: The GLOBE Study of 62 Societies. Thousand Oaks, CA: Sage Publications Inc.

Google Scholar

House, R. J., Javidan, M., Hanges, P. J., and Dorfman, P. W. (2002). Understanding cultures and implicit leadership theories across the globe: an introduction to project GLOBE. J. World Bus. 37, 3–10. doi: 10.1016/s1090-9516(01)00069-4

CrossRef Full Text | Google Scholar

Hutzschenreuter, T., Kleindienst, I., and Lange, S. (2016). The concept of distance in international business research: a review and research agenda. Int. J. Manag. Rev. 18, 160–179. doi: 10.1111/ijmr.12065

CrossRef Full Text | Google Scholar

Ibarra, H., and Obodaru, O. (2009). Women and the vision thing. Harvard Bus. Rev. 87, 62–70.

Google Scholar

Inesi, M. E. (2010). Power and loss aversion. Organ. Behav. Hum. Decis. Process. 112, 58–69.

Google Scholar

Javidan, M., and Carl, D. E. (2004). East meets West: a cross-cultural comparison of charismatic leadership among Canadian and Iranian executives. J. Manag. Stud. 41, 665–694. doi: 10.1111/j.1467-6486.2004.00449.x

CrossRef Full Text | Google Scholar

Karakitapoglu-Aygün, Z., and Gumusluoglu, L. (2013). The bright and dark sides of leadership: transformational vs. non-transformational leadership in a non-Western context. Leadership 9, 107–133. doi: 10.1177/1742715012455131

CrossRef Full Text | Google Scholar

Keltner, D., Gruenfeld, D. H., and Anderson, C. (2003). Power, approach, and inhibition. Psychol. Rev. 110, 265–284. doi: 10.1037/0033-295x.110.2.265

PubMed Abstract | CrossRef Full Text | Google Scholar

Kenney, R. A., Blascovich, J., and Shaver, P. R. (1994). Implicit leadership theories: prototypes for new leaders. Basic Appl. Soc. Psychol. 15, 409–437. doi: 10.1207/s15324834basp1504_2

CrossRef Full Text | Google Scholar

Kets De Vries, M. F. R., Vrignaud, P., and Florent-Treacy, E. (2004). The global leadership life inventory: development and psychometric properties of a 360-degree feedback instrument. Int. J. Hum. Resour. Manag. 15, 475–492. doi: 10.1080/0958519042000181214

CrossRef Full Text | Google Scholar

Kirkman, B. L., Lowe, K. B., and Gibson, C. B. (2006). A quarter century of culture’s consequences: a review of empirical research incorporating Hofstede’s cultural values framework. J. Int. Bus. Stud. 37, 285–320. doi: 10.1057/palgrave.jibs.8400202

CrossRef Full Text | Google Scholar

Kossek, E. E., Huang, J. L., Piszczek, M. M., Fleenor, J. W., and Ruderman, M. (2017). Rating expatriate leader effectiveness in multisource feedback systems: cultural distance and hierarchical effects. Hum. Resour. Manag. 56, 151–172. doi: 10.1002/hrm.21763

CrossRef Full Text | Google Scholar

Kwan, V. S. Y., Kenny, D. A., John, O. P., Bond, M. H., and Robins, R. W. (2004). Reconceptualizing individual differences in self-enhancement bias: an interpersonal approach. Psychol. Rev. 111, 94–110. doi: 10.1037/0033-295x.111.1.94

PubMed Abstract | CrossRef Full Text | Google Scholar

Lakshman, C. (2013). Biculturalism and attributional complexity: cross-cultural leadership effectiveness. J. Int. Bus. Stud. 44, 922–940. doi: 10.1057/jibs.2013.36

CrossRef Full Text | Google Scholar

Lammers, J., Stapel, D. A., and Galinsky, A. D. (2010). Power increases hypocrisy: moralizing in reasoning, immorality in behavior. Psychol. Sci. 21, 737–744. doi: 10.1177/0956797610368810

PubMed Abstract | CrossRef Full Text | Google Scholar

Landis, D., and Bhagat, R. S. (1996). “A model of intercultural behavior and training,” in Handbook of Intercultural Training, eds D. Landis and R. S. Bhagat (Thousand Oaks, CA: SAGE Publications, Inc).

Google Scholar

Lee, A., and Carpenter, N. C. (2018). Seeing eye to eye: a meta-analysis of self-other agreement of leadership. Leadersh. Q. 29, 253–275. doi: 10.1016/j.leaqua.2017.06.002

CrossRef Full Text | Google Scholar

Lord, R. G., Brown, D. J., Harvey, J. L., and Hall, R. J. (2001). Contextual constraints on prototype generation and their multilevel consequences for leadership perceptions. Leadersh. Q. 12, 311–338. doi: 10.1016/s1048-9843(01)00081-9

CrossRef Full Text | Google Scholar

Lord, R. G., and Emrich, C. G. (2000). Thinking outside the box by looking inside the box. Leadersh. Q. 11, 551–579. doi: 10.1016/s1048-9843(00)00060-6

CrossRef Full Text | Google Scholar

Lord, R. G., Epitropaki, O., Foti, R. J., and Hansbrough, T. K. (2020). Implicit leadership theories, implicit followership theories, and dynamic processing of leadership information. Annu. Rev. Organ. Psychol. Organ. Behav. 7, 49–74.

Google Scholar

Lord, R. G., Foti, R. J., and De Vader, C. L. (1984). A test of leadership categorization theory: internal structure, information processing, and leadership perceptions. Organ. Behav. Hum. Perf. 34, 343–378. doi: 10.1016/0030-5073(84)90043-6

CrossRef Full Text | Google Scholar

Lord, R. G., Foti, R. J., and Phillips, J. S. (1982). “A theory of leadership categorization,” in Leadership: Beyond Establishment Views, eds J. G. Hunt, U. Sekaran, and C. A. Schriesheim (Carbondale: Southern Illinois University Press).

Google Scholar

Lord, R. G., and Maher, K. J. (1991). Leadership and Information Processing. London: Routledge.

Google Scholar

Lu, C., and Wan, C. (2018). Cultural self-awareness as awareness of culture’s influence on the self: implications for cultural identification and well-being. Pers. Soc. Psychol. Bull. 44, 823–837. doi: 10.1177/0146167217752117

PubMed Abstract | CrossRef Full Text | Google Scholar

Maddux, W. W., Lu, J. G., Affinito, S. J., and Galinsky, A. D. (2021). Multicultural experiences: a systematic review and new theoretical framework. Acad. Manag. Ann. 15, 345–376. doi: 10.5465/annals.2019.0138

CrossRef Full Text | Google Scholar

Magee, J. C., and Galinsky, A. D. (2008). Social hierarchy: the self-reinforcing nature of power and status. Acad. Manag. Ann. 2, 351–398. doi: 10.1080/19416520802211628

CrossRef Full Text | Google Scholar

Mahalanobis, P. C. (1937). Normalisation of statistical variates and the use of rectangular coordinates in the theory of sampling distributions. Sankhya 3, 35–40.

Google Scholar

McKee, R. A., Lee, Y., Atwater, L. E., and Antonakis, J. (2018). Effects of personality and gender on self-other agreement in ratings of leadership. J. Occup. Organ. Psychol. 91, 285–315. doi: 10.1111/joop.12209

CrossRef Full Text | Google Scholar

Money, B., and Graham, J. L. (1999). Salesperson performance, pay, and job satisfaction: tests of a model using data collected in the United States and Japan. J. Int. Bus. Stud. 30, 149–171. doi: 10.1057/palgrave.jibs.8490064

CrossRef Full Text | Google Scholar

Neeley, T. B. (2013). Language matters: status loss and achieved status distinctions in global organizations. Organ. Sci. 24, 476–497. doi: 10.1287/orsc.1120.0739

PubMed Abstract | CrossRef Full Text | Google Scholar

Newman, K. L., and Nollen, S. D. (1996). Culture and congruence: the fit between management practices and national culture. J. Int. Bus. Stud. 27, 753–779. doi: 10.1057/palgrave.jibs.8490152

CrossRef Full Text | Google Scholar

Nye, J. L., and Forsyth, D. R. (1991). The effects of prototype-based biases on leadership appraisals: a test of leadership categorization theory. Small Group Res. 22, 360–379. doi: 10.1177/1046496491223005

CrossRef Full Text | Google Scholar

Ocker, R. J., Huang, H., Benbunan-Fich, R., and Hiltz, S. R. (2011). Leadership dynamics in partially distributed teams: an exploratory study of the effects of configuration and distance. Group Decis. Negotiation 20, 273–292. doi: 10.1007/s10726-009-9180-z

CrossRef Full Text | Google Scholar

Offermann, L. R., and Coats, M. R. (2018). Implicit theories of leadership: stability and change over two decades. Leadersh. Q. 29, 513–522. doi: 10.1016/j.leaqua.2017.12.003

CrossRef Full Text | Google Scholar

Offermann, L. R., and Hellmann, P. S. (1997). Culture’s consequences for leadership behavior: national values in action. J. Cross Cult. Psychol. 28, 342–351. doi: 10.1177/0022022197283008

CrossRef Full Text | Google Scholar

Oh, I.-S., and Berry, C. M. (2009). The five-factor model of personality and managerial performance: validity gains through the use of 360 degree performance ratings. J. Appl. Psychol. 94, 1498–1513. doi: 10.1037/a0017221

PubMed Abstract | CrossRef Full Text | Google Scholar

Ostroff, C., Atwater, L. E., and Feinberg, B. J. (2004). Understanding self-other agreement: a look at rater and ratee characteristics, context, and outcomes. Pers. Psychol. 57, 333–375. doi: 10.1111/j.1744-6570.2004.tb02494.x

CrossRef Full Text | Google Scholar

Paunova, M. (2017). Who gets to lead the multinational team? An updated status characteristics perspective. Human Relations 70, 883–907. doi: 10.1177/0018726716678469

CrossRef Full Text | Google Scholar

Peterson, M. F., and Barreto, T. S. (2014). The like it or not proposition: implications of societal characteristics for the cultural expertise and personal values of organization members. J. Organ. Behav. 35, 1134–1152. doi: 10.1002/job.1977

CrossRef Full Text | Google Scholar

Peterson, M. F., and Castro, S. L. (2006). Measurement metrics at aggregate levels of analysis: implications for organization culture research and the GLOBE project. Leadersh. Q. 17, 506–521. doi: 10.1016/j.leaqua.2006.07.001

CrossRef Full Text | Google Scholar

Phillips, J. S., and Lord, R. G. (1982). Schematic information processing and perceptions of leadership in problem-solving groups. J. Appl. Psychol. 67, 486–492. doi: 10.1037/0021-9010.67.4.486

CrossRef Full Text | Google Scholar

Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. Am. Sociol. Rev. 15, 351–357. doi: 10.2307/2087176

CrossRef Full Text | Google Scholar

Rogers, W. H. (1994). Regression standard errors in clustered samples. Stata Tech. Bull. 3:13.

Google Scholar

Ronen, S., and Shenkar, O. (2013). Mapping world cultures: cluster formation, sources and implications. J. Int. Bus. Stud. 44, 867–897. doi: 10.1057/jibs.2013.42

CrossRef Full Text | Google Scholar

Rosette, A. S., Leonardelli, G. J., and Phillips, K. W. (2008). The white standard: racial bias in leader categorization. J. Appl. Psychol. 93, 758–777. doi: 10.1037/0021-9010.93.4.758

PubMed Abstract | CrossRef Full Text | Google Scholar

Rush, M. C., and Russell, J. E. A. (1988). Leader prototypes and prototype-contingent consensus in leader behavior descriptions. J. Exp. Soc. Psychol. 24, 88–104. doi: 10.1016/0022-1031(88)90045-5

CrossRef Full Text | Google Scholar

Saal, F. E., Downey, R. G., and Lahey, M. A. (1980). Rating the ratings: assessing the psychometric quality of rating data. Psychol. Bull. 88, 413–428.

Google Scholar

Schwartz, S. H. (1999). A theory of cultural values and some implications for work. Appl. Psychol. 48, 23–47. doi: 10.1111/j.1464-0597.1999.tb00047.x

CrossRef Full Text | Google Scholar

Schyns, B. (2006). The role of implicit leadership theories in the performance appraisals and promotion recommendations of leaders. Equ. Opportunities Int. 25, 188–199. doi: 10.1108/02610150610687836

CrossRef Full Text | Google Scholar

Shamir, B., House, R. J., and Arthur, M. B. (1993). The motivational effects of charismatic leadership: a self-concept based theory. Organ. Sci. 4, 577–594. doi: 10.1287/orsc.4.4.577

PubMed Abstract | CrossRef Full Text | Google Scholar

Shaw, J. B. (1990). A cognitive categorization model for the study of intercultural management. Acad. Manag. Rev. 15, 626–645. doi: 10.5465/amr.1990.4310830

CrossRef Full Text | Google Scholar

Shenkar, O. (2001). Cultural distance revisited: towards a more rigorous conceptualization and measurement of cultural differences. J. Int. Bus. Stud. 32, 519–535. doi: 10.1057/palgrave.jibs.8490982

CrossRef Full Text | Google Scholar

Smith, B., Andras, T. L., and Rosenbloom, B. (2012). Transformational leadership: managing the twenty-first centure sales force. Psychol. Mark. 290, 434–444. doi: 10.1002/mar.20532

CrossRef Full Text | Google Scholar

Srivastava, S., Singh, S., and Dhir, S. (2020). Culture and international business research: a review and research agenda. Int. Bus. Rev. 29:101709. doi: 10.1016/j.ibusrev.2020.101709

CrossRef Full Text | Google Scholar

StataCorp (2017). Stata: Release 15. Statistical Software. College Station, TX: StataCorp LLC.

Google Scholar

Sully de Luque, M. F., and Sommer, S. M. (2000). The impact of culture on feedback-seeking behavior: an integrated model and propositions. Acad. Manag. Rev. 25, 829–849. doi: 10.5465/amr.2000.3707736

CrossRef Full Text | Google Scholar

Taylor, S. E., and Brown, J. D. (1988). Illusion and well-being: a social psychological perspective on mental health. Psychol. Bull. 103, 193–210. doi: 10.1037/0033-2909.103.2.193

CrossRef Full Text | Google Scholar

Taylor, S. E., and Brown, J. D. (1994). Positive illusions and well-being revisited: separating fact from fiction. Psychol. Bull. 116, 21–27. doi: 10.1037/0033-2909.116.1.21

PubMed Abstract | CrossRef Full Text | Google Scholar

Testa, M. R. (2002). Leadership dyads in the cruise industry: the impact of cultural congruency. Int. J. Hosp. Manag. 21, 425–441. doi: 10.1016/s0278-4319(02)00036-1

CrossRef Full Text | Google Scholar

Testa, M. R. (2009). National culture, leadership and citizenship: implications for cross-cultural management. Int. J. Hosp. Manag. 28, 78–85. doi: 10.1016/j.ijhm.2008.04.002

CrossRef Full Text | Google Scholar

Tett, R. P., and Burnett, D. D. (2003). A personality trait-based interactionist model of job performance. J. Appl. Psychol. 88, 500–517. doi: 10.1037/0021-9010.88.3.500

PubMed Abstract | CrossRef Full Text | Google Scholar

Tsui, A. S., Nifadkar, S., and Ou, A. Y. (2007). Cross-national, cross-cultural organizational behavior research: advances, gaps, and recommendations. J. Manag. 33, 426–478. doi: 10.1177/0149206307300818

CrossRef Full Text | Google Scholar

Tsui, A. S., and Ohlott, P. (1988). Multiple assessment of managerial effectiveness: interrater agreement and consensus in effectiveness models. Pers. Psychol. 41, 779–803. doi: 10.1111/j.1744-6570.1988.tb00654.x

CrossRef Full Text | Google Scholar

Van der Kam, N. A., Janssen, O., Van der Vegt, G. S., and Stoker, J. I. (2014). The role of vertical conflict in the relationship between leader self-enhancement and leader performance. Leadersh. Q. 25, 267–281. doi: 10.1016/j.leaqua.2013.08.007

CrossRef Full Text | Google Scholar

Van der Kam, N. A., Van der Vegt, G. S., Janssen, O., and Stoker, J. I. (2015). Heroic or hubristic? A componential approach to the relationship between perceived transformational leadership and leader–member exchanges. Eur. J. Work Organ. Psychol. 24, 611–626. doi: 10.1080/1359432x.2014.958149

CrossRef Full Text | Google Scholar

van Knippenberg, D. (2011). Embodying who we are: leader group prototypicality and leadership effectiveness. Leadersh. Q. 22, 1078–1091. doi: 10.1016/j.leaqua.2011.09.004

CrossRef Full Text | Google Scholar

van Knippenberg, D., and Sitkin, S. B. (2013). A critical assessment of charismatic—transformational leadership research: back to the drawing board? Acad. Manag. Annauls 7, 1–60. doi: 10.5465/19416520.2013.759433

CrossRef Full Text | Google Scholar

Van Velsor, E., Taylor, S., and Leslie, J. B. (1993). An examination of the relationships among self-perception accuracy, self-awareness, gender, and leader effectiveness. Hum. Resour. Manag. 32, 249–263. doi: 10.1002/hrm.3930320205

CrossRef Full Text | Google Scholar

Varela, O. E., and Premeaux, S. F. (2008). Do cross-cultural values affect multisource feedback dynamics? The case of high power distance and collectivism in two Latin American countries. Int. J. Select. Assess. 16, 134–142. doi: 10.1111/j.1468-2389.2008.00418.x

CrossRef Full Text | Google Scholar

Vogel, D., and Kroll, A. (2019). Agreeing to disagree? Explaining self–other disagreement on leadership behaviour. Public Manag. Rev. 21, 1867–1892. doi: 10.1080/14719037.2019.1577910

CrossRef Full Text | Google Scholar

Wherry, R. J., and Barlett, C. J. (1982). The control of bias in ratings: a theory of rating. Pers. Psychol. 35, 521–551. doi: 10.1111/j.1744-6570.1982.tb02208.x

CrossRef Full Text | Google Scholar

Whittington, J. L., Coker, R. H., Goodwin, V. L., Ickes, W., and Murray, B. (2009). Transactional leadership revisited: self-other agreement and its consequences. J. Appl. Soc. Psychol. 39, 1860–1886. doi: 10.1111/j.1559-1816.2009.00507.x

CrossRef Full Text | Google Scholar

Yammarino, F. J., and Atwater, L. E. (1993). Understanding self-perception accuracy: implications for human resource management. Hum. Resour. Manag. 32, 231–247. doi: 10.1002/hrm.3930320204

CrossRef Full Text | Google Scholar

Appendix

Appendix A1
www.frontiersin.org

Appendix A1. Multivariate regressions and Wald tests for leader–observer dyads for alternative random samples.

Appendix A2
www.frontiersin.org

Appendix A2. Multivariate regressions and Wald tests for leader–observer dyads for alternative random samples.

Appendix B1
www.frontiersin.org

Appendix B1. Multivariate regressions and Wald tests for leader–observer dyads for alternative cultural distance measures.

Appendix B2
www.frontiersin.org

Appendix B2. Multivariate regressions and Wald tests for leader–observer dyads for alternative cultural distance measures.

Keywords: cultural distance, self-other agreement, leadership categorization theory, approach/inhibition theory of power, multisource feedback systems

Citation: Vriend T, Rook C, Garretsen H, Stoker JI and Kets de Vries M (2021) Relating Cultural Distance to Self-Other Agreement of Leader–Observer Dyads: The Role of Hierarchical Position. Front. Psychol. 12:738120. doi: 10.3389/fpsyg.2021.738120

Received: 08 July 2021; Accepted: 24 September 2021;
Published: 21 October 2021.

Edited by:

Matteo Cristofaro, Tor Vergata University of Rome, Italy

Reviewed by:

Xueyan Zhang, Nanjing University of Science and Technology, China
Ahmad Adeel, University of Lahore, Pakistan
Peng Wen, Central China Normal University, China
Minna Paunova, Copenhagen Business School, Denmark

Copyright © 2021 Vriend, Rook, Garretsen, Stoker and Kets de Vries. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Tim Vriend, t.vriend@pl.hanze.nl

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.