The Impact of Non-Brazilian Contribution on the Publishing Performance of Psychology Journals in Brazil

There is considerable variability in publishing performance among psychology journals in Brazil. However, research as to why is very scarce. This study empirically examined the relationship between non-Brazilian contribution and publishing performance, among these journals. A total of 746 articles from the top-18 psychology journals in Brazil were coded for study type, international collaboration, and non-Brazilian contribution. Analyses revealed that publishing performance was associated with the following: (i) international collaboration and (ii) non-Brazilian contribution. Collaboration with, and contribution from, English-speaking authors was more prevalent among the higher performing journals; while contribution from non-Brazilian Ibero-American authors was more prevalent among the lower performing journals. These findings suggest that publishing performance for psychology journals in Brazil may be strongly tied to non-Brazilian contribution. Implications may be relevant to journal publishers and editors, as well as arbiters of scientific policy.


INTRODUCTION
There has been much written about "lost science" (Packer, 2001;Meneghini and Packer, 2007;Packer and Meneghini, 2007;Montgomery, 2013;Fradkin, 2017a), a term coined by Gibbs (1995) that refers to "the unaccessed scientific output of the 'emerging' or 'developing' nations (EDNs)" (Fradkin, 2015, p. 100). Among the EDNs, the BRICS nations, of Brazil, Russia, India, China, and South Africa, are a commonly referred to group that makes up 43% of the world's population and 25% of its gross domestic product (Wilson and Purushothaman, 2003;Raghuramapatruni, 2015). Unfortunately, much of the scientific output from this group "remains inaccessible or 'lost' to many scholars in the English-speaking world" (Fradkin, 2015, p. 100), due to the fact that it is not published in English (Gibbs, 1995). In addition, the quality of these journals is typically lower than their lingua franca counterparts, due in large part to their less stable business model (Meneghini, 2012). Nonetheless, there is variability among these journals in their publishing performance. We will examine this variability among journals in the BRICS nation of Brazil. We will focus on publications in the field of psychology, an area which has experienced a boon in recent years (Hutz et al., 2004;Gamba et al., 2015).
For decades, Brazilian science has endured criticism from elitists in lingua franca quarters (Gibbs, 1995). In 2015, librarian Jeffrey Beall described these journals as residing on open-access platforms which "are more like publication favelas" 1 (Beall, 2015). Nonetheless, over the last decade, a tiering of psychology journals in Brazil has come to be, with two of the top journals in the field now appearing on the global stage. These journals, Psicologia: Reflexão e Crítica and Psychology & Neuroscience, are now in partnerships with Springer and the American Psychological Association, both top-tiered international publishing houses. Through these partnerships, these journals now publish to a global audience. These international affiliations give these journals an advantage, when compared to their domestic counterparts. In short, they have: a wider dissemination through expanded databases; a higher level of translators and support team; and a higher prevalence of international submissions (Landeira-Fernandez et al., 2015;Remor, 2016). Because of these advantages, these two journals now perform at a higher level than their domestic counterparts. From this vantage, these two journals unwittingly provide an ideal for their sister journals to aspire to.
A recent study (Fradkin, 2017b) examined differences between these two internationally published journals and their lower tiered domestic counterparts. The findings indicated that these top two journals had a higher prevalence of lead authors from lingua franca/English-speaking countries than their lower tiered domestic counterparts (U = 0.00, p = 0.003). The findings also indicated that these journals had a higher prevalence of editorial board members from lingua franca/English-speaking countries (U = 1.50, p = 0.041). These findings provoked discussion in the field (see Medeiros, 2017;Nassi-Calò, 2017). There were queries about international collaboration. There were queries about non-Brazilian contribution.
While one might think this information is available online; after searching, one discovers it is not. There are exceptions though. There is the journal Psychology & Neuroscience, which ran an editorial in 2014 (Mograbi, 2014) that provided an international breakdown of reviewers and submissions. There is also the journal Paidéia (Ribeirão Preto), which has run an international breakdown of ad hoc consultants and submissions since 2008 (Santos et al., 2008;Santos and de Oliveira, 2009;Santos, 2010Santos, , 2011Santos, , 2012Santos, , 2013Santos, , 2014Santos, , 2015Santos, , 2016Santos, , 2017. These withstanding, there has been no comprehensive tally of international collaboration or non-Brazilian contribution, among the psychology journals of Brazil. This absence is surprising, because these variables are linked inextricably to publishing performance (Smith et al., 2014;Bordons et al., 2015;Fradkin, 2015;Gamba et al., 2015).
With regard to international contribution, Rogério Meneghini, of the Scientific Electronic Library Online (SciELO), sees this variable as critical to high performing journals (Meneghini, 2013). In an examination of journal content from England, Netherlands, and Switzerland, Meneghini found that 85% was international. By contrast, in an examination of content from Brazil, China, and India, Meneghini found that only 20% 1 Favela is the Brazilian term for shantytown or slum. was international (Meneghini, 2013). These findings suggest that international contribution is more prevalent among developed nation journals -those journals with the higher impact factors. And higher impact factors are synonymous in most circles with higher publishing performance (Packer, 2014;Bornmann et al., 2015;Fradkin, 2017a).
Regarding international collaboration, the findings are the same. In an examination of the most heavily cited Brazilian articles, SciELO's Packer and Meneghini (2006) found that 84% were international collaborations, in contrast to 16% written solely by Brazilians. Of these articles, most of them were products of multinational collaboration (i.e., an author from Brazil and authors from at least two other countries). This relationship between international collaboration and strong publishing performance has also been documented in the United Kingdom (Adams et al., 2007), Asia (Arunachalam and Doss, 2000), Spain (Bordons et al., 2015), and Norway (Aksnes, 2003).
In sum, these studies indicate a positive relationship between: (a) international contribution and publishing performance (Meneghini, 2013;Packer, 2014;Bornmann et al., 2015), and (b) international collaboration and publishing performance (Arunachalam and Doss, 2000;Aksnes, 2003;Packer and Meneghini, 2006;Adams et al., 2007;Bordons et al., 2015). While we acknowledge that several studies have focused on these variables within the purview of Brazilian science broadly (e.g., Packer and Meneghini, 2006), there have been no studies that we know of that have examined these variables specifically among psychology journals in Brazil.
Therefore, this study aimed to examine the relationship between international contribution and collaboration and journal publishing performance among psychology journals in Brazil. Our hypotheses were based on the weight of findings from past studies. With regard to study type, we hypothesized that, in relation to their lower tiered domestic counterparts, the internationally published psychology journals in Brazil would have: (H1) a higher prevalence of international collaboration, (H2) a higher prevalence of non-Brazilian authored contributions, and (H3) a lower prevalence of noncollaborative Brazilian contributions. In the area of international collaboration, we hypothesized that the internationally published psychology journals in Brazil would have: (H4) a lower prevalence of Ibero-American collaborations and (H5) a higher prevalence of lingua franca collaborations. And finally, in the area of non-Brazilian contribution, we hypothesized that the internationally published psychology journals in Brazil would have: (H6) a lower prevalence of non-Brazilian Ibero-American contributions and (H7) a higher prevalence of non-Brazilian lingua franca contributions.

MATERIALS AND METHODS
A bibliometric analysis was conducted on the top-ranked psychology journals of Brazil, from the year 2016. The analysis assessed the relationship between international contribution and collaboration and the publishing performance of these journals.

Sample
SCImago (SCImago, 2017) provides a ranking of scientific journals based on the number of citations received by a journal and the importance or prestige of the journals where such citations came from. Of the 1,063 worldwide psychology journals listed in the 2015 SCImago Journal Ranking (SJR), 18 (1.7%) were included from Brazil. These journals supplied the articles that comprised this study's sample. From the output of these journals for the year 2016 (814 articles), 746 research articles were included in the study. Excluded were as follows: editorials, book reviews, interviews, corrections, letters, obituaries, and republications of historical works.

Variables of Interest
International collaboration was recorded dichotomously (yes/no) for each article of each issue of each journal for the year. Articles co-authored by a scholar affiliated with a Brazilian institution and at least one scholar affiliated with a non-Brazilian institution met the criteria for international collaboration.
Brazilian authored articles refers to articles authored solely by scholars affiliated with Brazilian institutions. This classification was recorded dichotomously (yes/no) for each article of each issue of each journal for the year.
Non-Brazilian authored articles refers to articles authored solely by scholars affiliated with non-Brazilian institutions. Non-Brazilian authored status was recorded dichotomously (yes/no) for each article of each issue of each journal for the year. Prevalence of non-Brazilian authored articles was calculated separately for the two comparison groups (see publication house) and for the sample as a whole: n articles NON−BRAZIL−AUTH ÷ n articles TOTAL .
Region of article was determined by country of authorship. International collaborations and non-Brazilian contributions were coded: (1) Ibero-American, for articles by authors based in Spanish-and Non-Brazilian Portuguese-speaking countries (South and Central America, Mexico, Caribbean, Spain, Portugal, Angola, Mozambique); (2) Lingua Franca, for articles by authors based in native English-speaking countries (United States, United Kingdom, Canada, South Africa, Australia, New Zealand); and (3) others, for articles that did not meet the previous criteria. Articles received more than one code, if authors were based in different regions.

Grouping Variable
Publication house defined the structure through which the journal disseminates its work. This information was gathered from each journal's web site and recorded dichotomously (international publication house/no international publication house). This variable defined our two groups for comparison.

Data Collection
Research articles (e.g., research reports, reviews, and theoretical articles) were included in the study. Non-research articles (e.g., editorials, book reviews, interviews, corrections, letters, obituaries, and re-publication of historical works) were excluded.
From a starting pool of 814 articles, 68 non-research articles were excluded resulting in 746 research articles for the sample. Articles were first coded for study type (international collaboration, Brazilian authored, and non-Brazilian authored). They were then coded for region (Ibero-American, lingua franca, and others), with articles receiving more than one code, if authors came from different regions. Information on the journals' publication house was gathered from the journals' web site. As two of the journals were published through international publishing houses, we used the variable publication house (international or Brazilian) to differentiate the journals of higher (n = 2) from those of lower (n = 16) performance status.

Data Analysis
Analyses were performed using SPSS version 16.0. First, frequencies of study type (international collaboration, Brazilian authored articles, and non-Brazilian authored articles) were tallied and converted to percentages of the sample's total articles (e.g., international collaboration = n articles INT−COLLAB ÷ n articles TOTAL ). Frequencies of these variables were then tallied within the two comparison groups (Brazilian publication house/international publication house) and converted to percentages as before. Next, frequencies of region (Ibero-American, lingua franca, and others) were tallied and converted to percentages of the sample's articles of international collaboration (e.g., Ibero-American = n articles IBERO−AMERICAN−NON−BRAZILIAN ÷ n articles TOTAL−INT−COLLAB ). Frequencies of these variables were then tallied within the two comparison groups and converted to percentages as before. Next, frequencies of region were tallied and converted to percentages of the sample's articles of non-Brazilian contribution (e.g., Ibero-American = n articles IBERO−AMERICAN−NON−BRAZILIAN ÷ n articles TOTAL−NON−BRAZILIAN ). Frequencies of these variables were then tallied within the two comparison groups and converted to percentages. Chi-square tests were then conducted on each variable to determine significant differences between comparison groups. In one case, which had an observed cell count of zero, a Fisher's exact test was performed in lieu of Chi-square. As all variables were in dichotomous format, testing was conducted within 2 × 2 contingency tables, with alpha set at 0.05.

Descriptive Statistics
The 18 journals of Table 1 supplied the sample's articles. Of these journals, three publish articles exclusively in English; three in Portuguese; and the remaining in a hybrid format. Nine of the journals are indexed by the SciELO database, which attests to their presence in the Latin American and Caribbean markets. Of the journals not indexed by SciELO, it should be noted that Psychology & Neuroscience withdrew from SciELO upon establishing a partnership with an international publishing house. Also shown is the Qualis indicator. Qualis is a ranking system administered by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) 2 for the evaluation of Brazil's scientific journals. Among the journals of our sample, all but one received this system's first or second highest rating (A1 or A2, respectively). And critical to the study is publication house assignment, which places the two journals published by international publishing houses in the top third of the sample.
Association Between Performance and Study Type (Hypotheses 1-3) Table 2 presents a breakdown of the study types by journal, while Table 3 presents the data across groups. Hypothesis 1 predicted that there would be a higher prevalence of international collaboration among the internationally published journals than among their lower tiered domestic counterparts. A chi-square test revealed that the prevalence of international collaboration was 2 CAPES is the agency affiliated with the Brazilian Ministry of Education that oversees graduate education programs.
higher among the internationally published journals (M = 13.4%) than among their lower tiered domestic counterparts (M = 5.3%), χ 2 (1) = 8.37, p = 0.004. In the presence of a significant main effect, Hypothesis 1 was supported. Hypothesis 2 predicted that there would be a higher prevalence of non-Brazilian authored contributions among the internationally published journals than among their lower tiered domestic counterparts. A chi-square test revealed that the prevalence of non-Brazilian authored contributions was higher among the internationally published journals (M = 31.7%) than among their lower tiered domestic counterparts (M = 11.0%), χ 2 (1) = 27.21, p < 0.001. In the presence of a significant main effect, Hypothesis 2 was supported.
Hypothesis 3 predicted that there would be a lower prevalence of non-collaborative Brazilian contributions among the internationally published journals than among their lower tiered domestic counterparts. A chi-square test revealed that the prevalence of non-collaborative Brazilian  Lower tiered includes articles from journals affiliated with Brazilian publishing houses (n = 16); higher tiered includes articles from journals affiliated with international publishing houses (n = 2). Int'l, international. Total % may not match sums because of rounding.
contributions was lower among the internationally published journals (M = 54.9%) than among their lower tiered domestic counterparts (M = 83.7%), χ 2 (1) = 38.81, p < 0.001. In the presence of a significant main effect, Hypothesis 3 was supported. Hypothesis 5 predicted that there would be a higher prevalence of lingua franca collaboration among the internationally published journals than among their lower tiered domestic counterparts. A chi-square test revealed that the prevalence of lingua franca collaboration was higher among the internationally published journals (M = 72.7%) than among their lower tiered domestic counterparts (M = 28.6%), χ 2 (1) = 6.85, p = 0.009. In the presence of a significant main effect, Hypothesis 5 was supported.

Association Between Performance and Non-Brazilian Contributions (Hypotheses 6-7)
Table 5 presents non-Brazilian contributions across groups. Hypothesis 6 predicted that there would be a lower prevalence of non-Brazilian Ibero-American contributions among the internationally published journals than among their lower tiered domestic counterparts. A chi-square test revealed that the Lower tiered includes articles from journals affiliated with Brazilian publishing houses (n = 16); higher tiered includes articles from journals affiliated with international publishing houses (n = 2); Ibero-American includes Spanish-and Portuguese-speaking countries (South and Central America, Mexico, Caribbean, Spain, Portugal, Angola, and Mozambique); Lingua Franca includes native English-speaking countries (United States, United Kingdom, Canada, and South Africa). The total sums exceed those of Table 2 because of multinational collaborations. Total % may not match sums because of rounding. prevalence of non-Brazilian Ibero-American contributions was lower among the internationally published journals (M = 53.8%) than among their lower tiered domestic counterparts (M = 82.2%), χ 2 (1) = 8.16, p = 0.004. In the presence of a significant main effect, Hypothesis 6 was supported. Hypothesis 7 predicted that there would be a higher prevalence of non-Brazilian lingua franca contributions among the internationally published journals than among their lower tiered domestic counterparts. A Fisher's exact test revealed that the prevalence of non-Brazilian lingua franca contributions was higher among the internationally published journals (M = 46.2%) than among their lower tiered domestic counterparts (M = 0.0%), p < 0.001. In the presence of a significant main effect, Hypothesis 7 was supported.

DISCUSSION
This study is the first empirical examination of international contribution and collaboration and its relationship with publishing performance among psychology journals in Brazil. Consistent with Hypothesis 1, as well as recent research (Adams et al., 2007;Bordons et al., 2015), is the finding of a higher prevalence of international collaboration among the internationally published journals in the sample. Consistent with Hypothesis 2, as well as recent research (Packer, 2014;Bornmann et al., 2015), is the finding of a higher prevalence of non-Brazilian authored contributions among the internationally published journals, in relation to their domestic counterparts. Consistent with Hypothesis 3, as well as recent research (Meneghini, 2013;Packer, 2014), is the finding of a lower prevalence of non-collaborative Brazilian contributions among the internationally published journals in the sample. These findings indicate that non-Brazilian input, be it collaborative or non-Brazilian authored, is associated with higher journal/publishing performance. These findings are also consistent with a recent study (Fradkin, 2017b) that found a higher prevalence of lead authors from lingua franca/English-speaking countries among those journals of higher internationalization. From these parallel trajectories, the critical thinker might infer that internationalization and performance are related. If so, this thinking would be consistent with the government's evaluation standards for its graduate programs (Bianco et al., 2015;Gomes and Fradkin, 2015) and its scientific journals (Guzzo et al., 2015;Neto et al., 2016).
Within international collaboration, our findings yielded mixed results. Inconsistent with Hypothesis 4, as well as recent research (Paiva et al., 2017), is the finding that there is not a lower prevalence of Ibero-American collaboration among the internationally published journals in our sample. In hindsight, this might be expected, as the language of Brazil is most compatible with dialects from Ibero-American countries. Consistent with Hypothesis 5, as well as recent research (Bordons et al., 2015), is the finding of a higher prevalence of lingua franca collaboration among the internationally published journals. This finding of a higher lingua franca presence is consistent with the previously mentioned study (Fradkin, 2017b) that found a higher prevalence of lead authors from lingua franca/English-speaking countries among those journals of higher internationalization. Taken with Finding 4, one might infer it is the presence of lingua franca input, rather than the absence of Ibero-American input, that serves as fuel for the higher performing journals.
Within non-Brazilian contributions, our findings brought hypothesized results. Consistent with Hypothesis 6, as well as recent research (Loughborough et al., 2016), is the finding of a lower prevalence of non-Brazilian Ibero-American contributions among the internationally published journals in the sample. And consistent with Hypothesis 7, as well as recent research (Loughborough et al., 2016;González-Álvarez and Cervera-Crespo, 2017), is the finding of a higher prevalence of non-Brazilian lingua franca contributions among the internationally published journals in the sample. These last two findings highlight two points that serve as bookends: (1) there is a positive relationship between the publishing of material from non-Brazilian lingua franca countries and higher journal/publishing performance; and (2) there is a negative relationship between the publishing of material from non-Brazilian Ibero-American countries and higher journal/publishing performance. These last two findings reaffirm the value that non-Brazilian lingua franca studies have for psychology journals in Brazil.
As a whole, these findings suggest that the performance of psychology journals in Brazil is strongly linked to contributions from non-Brazilian quarters. When taken with the findings (Fradkin, 2017b) that the higher tiered psychology journals in Brazil have a higher prevalence of editorial board members and lead authors from lingua franca countries, these implications are powerfully compelling (see Table 6). In fact, they may serve as a blueprint for those editors and publishers who aspire to reach a global readership. For them, the message is: to better reach the global market, you must embrace non-Brazilian contribution. The findings of our study may also be of value to the arbiters of policy. For those involved with Qualis ranking, the message should ring clear: to better rank Brazilian journals, your criteria should include the value of non-Brazilian contribution. For some, the notion of non-Brazilian contribution may be threatening. "They're depriving our journals of our [Brazilian] content, " they may say. For those editors and publishers, it should be stressed that non-Brazilian contributions should supplement their now existing content (Fradkin, 2017b). In terms of collaboration, we are by no means suggesting that Brazilians should only work with lingua franca scholars. Rather, we are suggesting that Brazilians supplement their present pool, with non-Brazilians that speak fluent lingua franca. Programs are in place that promote such collaborations. The Fulbright Association (Fulbright Brasil, 2018), for one, offers grants for Brazilian scholars to develop their research in the United States. Additionally, CAPES offers funding for Brazilian scholars to pursue graduate and post-graduate studies overseas (Fundação CAPES, 2018).
These travel opportunities are key for Brazilian scholars, who must master English to build an international career . For them, their value as a scholar is gauged by their publication record in high impact factor, English-language journals (Lehmann et al., 2006;Mazloumian, 2012). Thus, their language presentation when submitting manuscripts must be competitive with native English-language scholars Fradkin, 2017a). This brings us back to the notion of lost science. With the higher impact factor journals publishing in English, the acceptance rate for nonnative English speaking scholars is much lower than for their lingua franca counterparts (Vasconcelos et al., 2007;Paiva et al., 2017). Likewise, the publishing performance for emerging nation journals is much lower than for their lingua franca counterparts (Tijssen et al., 2006;Packer, 2014;Fradkin, 2015Fradkin, , 2017b. This reality creates a less-than-even playing field for the dissemination of newly published science. Much science published in emerging nation mother tongue is unavailable in English for lingua franca readers. Conversely, English language science is available, but is only readable by emerging nation scholars who read English (Gibbs, 1995). This wall in both directions is the gist of lost science; and the solution is far from being present.
The recommendations, from our findings, are that a subset of emerging nation journals adopt the hallmarks of the higher performing journals. We define this subset as journals that: (1) are publishing content of a global (v. regional) nature; (2) have an administrative staff comfortable in English; and (3) have a natural affinity for lingua franca publication. Of the lower tiered journals in our sample, the one that fits these criteria most closely would be Paidéia, based on its publishing of articles exclusively in English (see Table 1). Among the remaining lower tiered journals, the ones that meet these criteria most weakly would be the three that publish articles exclusively in Portuguese. Thus, the recommendations that we offer would be intended for Paidéia and a portion of the hybrid-language journals in our sample (see Table 1).
These recommendations, however, give pause to several questions. Did the non-Brazilian authors submit their articles to the higher tiered Brazilian journals because of the journals' higher quality and status? Or did the publication of submissions from non-Brazilian authors elevate the quality and status of the journal? The answer to these questions: "It depends." In addition to directionality, a related issue would be the path the journal takes if it aspires to reach the global market. Should the focus of the journal be on upgrading its quality? Or should it be in attracting non-Brazilian authors to submit?
The answers to these questions are not easy to untangle. Through SciELO, Meneghini and Packer (2007) work to upgrade the quality of Brazilian science. We should remember, however, that among the journals in Brazil, not all of them were conceived as global instruments. For the most part, they were conceived within the confines of the university, as voices of the graduate departments (Féres-Carneiro et al., 2018). As such, they featured work from local scientists and scholars -work more Brazilian in its scope than international. Thus, the system that sustained them is different than the models of today's global publishers (e.g., Elsevier, Sage, and Springer) that are structured as commercial enterprises (Hutz et al., 2004;Meneghini, 2012). Thus said, the recovery of lost science is not a simple undertaking, in spite of open access and today's technology.
Among limitations in this study, the first would be materials acquisition. The assemblage of the articles began in January 2017, but by June, three journals in the sample had yet to publish their last 2016 issue 3 . For our findings, analyses were run with materials outstanding from these three; however, we have no reason to believe that the outstanding articles were significantly different from those included in the study. Of interest is the fact that two of these three journals publish articles exclusively in Portuguese. Another limitation would be in the coding of article type by institutional affiliation. We acknowledge that this would lead to articles by Brazilian nationals working at international institutions being coded "international" and not "Brazilian." Nonetheless, with an author roster of our size, a noninstitutional coding was not feasible. Another limitation would be the correlational nature of the study, from which causality cannot be inferred. And, as this study is a snapshot of only one year's worth of issues, we should refrain from projecting outcomes for 3 Publication delay is problematic with Brazilian journals, overall. It also highlights the shortcomings of the nation's publication model, which depends on academic (vs. commercial) funding for sustenance. the future. But, despite these limitations, our findings serve a purpose that may ripple past the borders of Brazil.

CONCLUSION
Opportunities exist for emerging nation science as they never have before. Collaborations can be brokered through research network sites (e.g., Academia, ResearchGate, and Mendeley); articles can be accessed on the Net. Through today's technology, the emerging nation journal can disseminate its findings to the world. Our findings suggest that publishing performance for psychology journals in Brazil may be tied to non-Brazilian contribution. Having said that, we acknowledge that variability exists among the variety of emerging nation journals. Thus, the recommendations that we offer are primarily for those journals that have the content, staff, and lingua franca temperament, that lend themselves to global publication. For the publishers and editors of journals of this type, these recommendations are respectfully directed.

AUTHOR CONTRIBUTIONS
The author confirms being the sole contributor of this work and has approved it for publication.