The Impacts of Global Research and International Educational Experiences on Texas A&M University System LSAMP Participants

The Texas A&M University System was one of the first six Louis Stokes Alliance for Minority Participation (LSAMP) awardees. All current members of the Alliance are part of the Texas A&M University System. Many high impact practices (HIP) have been emphasized in the Alliance’s 30 years of programming with Diversity/Global Learning as a focus in the last 14 years. Diversity/Global Learning has been supported in two formats on the Alliance campuses, through traditional study abroad programming and a College of Engineering initiative. Data presented were derived from a number of sources, project evaluation information regarding student perspectives and outcomes, survey research conducted by an independent party, and institutional data and online platforms accessed to assess student outcomes. Triangulation was completed between data sets. Results indicate both forms of programming were efficacious for underrepresented and first-generation students. Outcomes reported were substantial increases in awareness of and interest in graduate school, increases in cultural learning, confidence in travel outside the United States, learning relevant to major, commitment to continuing involvement with research, interest in another similar experience, and willingness to consider employment outside the U.S. Participants reported statistically significant growth in personal, professional, and research skills. They persisted, participated in additional study abroad experiences, and graduated at higher rates than their institutional peers with approximately 90% of informants indicating intention to consider graduate school in the future, over 40% indicating intent to attend immediately following undergraduate study, and 39.4% of 2007–2014 participants enrolling in graduate school by the spring of 2021. Programming described is replicable at and likely to be efficacious for a wide variety of institutions of higher education.

INTRODUCTION academic, intercultural, and career benefits reported for undergraduates participating in study abroad programming (Dwyer and Peters, 2005) motivated this action. Specifically, "employability skills such as interpersonal and communication skills, teamwork skills. . .problem solving and analytical skills" (Potts, 2015, p. 441) were in view as they had been reported "as the greatest perceived benefits" (Potts, 2015, p. 441) of participation in study abroad. "Career-related benefits such as future career prospects and increased motivation and passion for their chosen career direction" (Potts, 2015, p. 441) and intercultural learning (Kamdar and Lewis, 2015;Paras et al., 2019), which had also been identified with study abroad, were other motivating factors. The result was a series of programming emphases that have spanned 14 years.
Two different forms of study abroad programming were found to be efficacious for underrepresented and first-generation engineering students. Outcomes reported were substantial increases in awareness of and interest in graduate school, increases in cultural learning, confidence in travel outside the United States, learning relevant to major, commitment to continuing involvement with research, interest in another similar experience, and willingness to consider employment outside the United States. Participants also reported statistically significant growth in personal, professional, and research skills. They persisted, participated in additional study abroad experiences, graduated, and enrolled in graduate school at higher rates than their institutional and national peers.

PEDAGOGICAL FRAMEWORK
Three reports have been published that include information about international programming in TAMUS LSAMP. They are, in chronological order: 1) Garcia et al. (2017), 2) Merriweather et al. (2017), and 3) Preuss et al. (2020). The pedagogical framework for TAMUS LSAMP international programming prior to 2015 was not addressed in these publications but that after 2015 has been. A brief description of both frameworks will follow with the description of activity after 2015 referencing the earlier publications.
TAMUS LSAMP's first framework for Diversity/Global Learning was support of individual students in study abroad opportunities they sought out. The second, which continues to the present, was facilitation of a TAMU College of Engineering (COE) initiative offered annually and designed for underrepresented and first-generation students. Support of study abroad opportunities officially became a project goal in November of 2007. By the summer of 2008 there were five TAMU and two TAMUCC students participating in international experiences in Singapore, Spain, and Mexico. Participation increased at a regular and steady pace from that point forward, with 10 students supported in 2011 in Spain, Mexico, El Salvador, and six locations in Brazil.
To promote Diversity/Global Learning TAMUS LSAMP instituted seminars for participants that described study abroad opportunities. These seminars were offered in two ways. Seminars specific to each Alliance member were held each year and the annual research symposium sponsored for TAMUS LSAMP participants included a presentation about study abroad opportunities. The seminars were intended to increase awareness of study abroad opportunities and included information to help students overcome institutional obstacles and hesitancy on their part or that of their parents, concerns especially relevant to underrepresented and first-generation college students (Brux and Frye, 2010). Evaluation data gathered from students at each institution over a five-year period confirmed the seminars were offered each year and showed that between 67% and 90% of the participants found these sessions at least somewhat helpful.
While seminars about study abroad opportunities continued within the Alliance, emphasis shifted in the 2014-2015 school year to support of the Engineering Learning Community Introduction to Research (ELCIR) program. ELCIR is a onecredit hour, introduction-to-research course that includes "a two-week, study-abroad research program implemented in a learning community pattern. Ten days of international instruction are completed at" (Preuss et al., 2020, p. 1) institutions of higher education in Merida, Yucatan that partner with TAMU. "ELCIR has three purposes: 1) to expose students to research early in their academic careers, 2) to introduce students to cultural differences and global challenges, and 3) to provide students with the basic tools to prepare them for future research opportunities within TAMU's College of Engineering research internship programs, especially study abroad internships" (Preuss et al., 2020, p. 2). Participation during the first two years was "limited to first generation college students and/or students from underrepresented populations who are associated with the Access and Inclusion program in the College of Engineering" (Preuss et al., 2020, p. 2) but was expanded to larger cohorts open to any freshman Engineering student following that.
One distinction between TAMUS LSAMP's initial and later emphasis on Diversity/Global Learning was the age of the participants. Prior to 2015, students funded for study abroad were exclusively juniors and seniors (n 33). The 2014-2015 transition to supporting student participation in ELCIR included shifting to early career students, freshmen and sophomores. A second distinction between the two periods was the emphasis placed on research as a component of the student's international experience. From 2007 to 2014, students completing international opportunities focused primarily on completing courses at a university outside the United States. Of the 28 students funded for international experiences who provided feedback from 2007 to 2012, all but one reported taking classes but only four reported participating in a research endeavor as part of their time abroad. The one exception to class taking was a student who participated in a summer medical internship and the first report of research involvement as part of a TAMUS LSAMP international experience was four years into the initiative in 2012. ELCIR, though, was conceived as an opportunity that included exposing "students to research early in their academic careers" (Preuss et al., 2020, p. 2).

LEARNING ENVIRONMENT
Prior to 2015, students were encouraged to participate in study abroad opportunities recognized by their university. These, as has already been noted, were predominantly study at a university outside the United States. Only four of 28 informants in a fiveyear period participated in a research project as part of their study abroad programming.
In the 2014-2015 school year, TAMUS LSAMP shifted to supporting student participation in the ELCIR program. It "engages students at the beginning of their engineering education in four sets of experiences: 1) a hands-on research class, allowing students to identify their own research problem with the support of faculty and researchers, 2) international travel and two-week residence outside the United States, 3) engagement with highly experienced researchers and well-known research centers, and 4) a [five-page report regarding and] poster presentation of their research proposal results to peers, faculty, and administrators" (Preuss et al., 2020, p. 2). As noted in Preuss et al. (2020), the result is a combination of up to seven HIPs in one program.
"The intention of ELCIR is 'for underrepresented first generation ethnic minority students to be engaged in a research course'" (Garcia et al., 2017, p.2). "Participant selection is based on the student's status as an underrepresented minority and/or as a first-generation college student, his/her grade point average and resume, and a response to a question about what s/he expects to gain from participating in the project. A letter of recommendation from a faculty member [wa]s also requested and considered as part of the participant application" (Preuss, et al., 2020, p. 2) for the first 2 years. Since participants are early in their college careers, faculty could comment on little beyond class performance limiting the breadth of the recommendations and the practice of gathering faculty recommendations was discontinued beginning in ELCIR's third year.
A "one-credit course, ENGR 291 -Engineering Learning Community Introduction to Research, was added in 2016. . .. Inclusion of course credit has been maintained since that time. The initial course consisted of workshops regarding research, global competency, and travel preparation that were conducted with the ELCIR cohort in the spring of their freshman year. It has since been expanded to include more specificity in some areas and to accommodate several additional topics. These include 'introduction of the ELCIR Program purpose and goals, introduction to research topics, introduction to LSAMP/NSF sponsored responsibilities, research and research abroad expectations, [a] seminar on cultural competency, expectations [regarding] living with host families, [and] traveling/departure official documents' (Garcia et al., 2017, p. 3)" (Preuss et al., 2020, p. 2). The first year ELCIR participants stayed in a hotel but from 2016 on they have been placed with host families to increase cultural learning.
"The two-week international experience is a trip to Merida, Mexico where participants attend an introduction to research seminar (two hours per day), make visits to research sites and participate in research expeditions, receive hands-on experience in research labs, conduct their own research, visit cultural sites, and participate in cultural learning activities. The research course in the summer experience has been taught by 'Dr. Medina-Cetina and the vice president for research of Universidad Marista' (Garcia et al., 2017, p. 4)" (Preuss et al., 2020, p. 2). Growth of the program and expansion of partnerships in Yucatan resulted in the addition of Dr. John Walewski as a facilitator and a second host institution, the Politechnic University of Yucatan in 2017. Also, in 2017, Mexican students were incorporated in the program enabling multi-national student teams in activities and assignments. "Participants can select from a group of topic areas in which to conduct research. These are 'energy, coastal dynamics, logistics, aquifers and early warning system [s]' (Garcia et al., 2017, p. 2) which were chosen because faculty from TAMU collaborate with researchers in Yucatan in these areas" (Preuss et al., 2020, p. 2).
When they return to the U.S., TAMU "participants complete research reports and create research posters based on their investigations in Merida, Mexico. An online community is maintained as part of the project and used as a resource for exchanging materials, offering guidance, and then providing critiques when students are developing their research papers and presentations. Research posters are presented at TAMU COE in September each year" (Preuss et al., 2020, pp. 2-3).

RESULTS TO DATE
The material presented covers 13 years of programming for engineering students and is based on survey data. Several publications, as noted above, have been completed. The distinctive and notable contribution made here is consideration of 13 years of data rather than two-or four-year segments, inclusion of material from all applicable data sets, data regarding two distinct forms of international experience, consideration of outcomes for upper level and early career students, and presentation of long-term impact on participation in additional study abroad programming, persistence, graduation, and continuation to graduate school. The data included were drawn from project evaluation, with consideration of two different pedagogical frameworks, a research endeavor, and programmatic, institutional, and online student outcomes data. The primary emphasis was on obtaining information about and understanding the cumulative impact of study abroad experiences and ELCIR rather than the impact of various components of these opportunities. Surveys completed prior to 2015 had a participation rate just over 90%. The ELCIR-specific survey responses have a 95% confidence level with a confidence interval of 4.29 as they were submitted by 91 of 110 participants in five distinct cohorts (82.7% response rate).
The information presented is arranged chronologically. Material from before 2015 is presented first. It is based on self-reported data from juniors and seniors after they participated in traditional study abroad programming. That is followed by information provided by ELCIR participants who were almost entirely freshman and sophomores. Data gathering for project evaluation of ELCIR did not include pre-participation processes. However, Garcia et al.ʼs (2017) investigation of the first two years of programming did. Quantitative data from project evaluation underwent descriptive and tabular analysis while Garcia et al.ʼs (2017) data could support inferential statistics. Thus, this consideration addresses two forms of Diversity/Global Learning programming for students with similar backgrounds, all from the same institutions. These two populations provided responses regarding many of the same topics. That information is supplemented by insights from Garcia et al. (2017) which discusses a separate data set.

Study Abroad Programming With Juniors and Seniors (2007-2014)
Three surveys that had the entire TAMUS LSAMP participant population as the audience included questions about the impact of the seminars regarding study abroad. Some of the questions were deployed for two years and others for as many as 4 years.
Responses from two retrospective pre-and post-participation questions appear in Table 1 (informants were asked to recall and report their pre-participation stance). These questions addressed awareness of international education experiences and interest in them. They were multiple choice questions that employed customized Likert scales. The choices offered to the informants on the first were: 1) never heard anything about (NHAA), 2) only heard a little about (OHALA), 3) had some basic knowledge (HSBK), 4) had some understanding (HSU), and 5) had a good understanding (HGU). These were meant to assess levels of awareness. The choices for the second question, meant to assess interest, were: 1) never heard anything about, 2) not at all interested in (NAAI), 3) a little interested in (ALI), 4) interested in (II), and 5) very interested in (VII).
The customized Likert scales make statistical analysis impossible as the responses are not all related to the same construct and were nominal, for example never heard anything about and not at all interested do not address the same idea or represent a pattern with defined distance between the options. However, the results do indicate changes in awareness and interest resulting from exposure to one or more seminars about study abroad opportunities. More than 77% of respondents felt they had at least some understanding following participation when 24% of them reported this level of understanding as their prior state. Responses for interest were similar with selection of not at all interested dropping by 15.3%, a little interested in dropping by 7.2%, while interested in and very interested in increased by 8.1% and 23.0%, respectively.
Questions specific to the seminars offered at the annual research symposium were also asked. A query that occurred only in 2010 asked how helpful the informants felt information about study abroad and international experiences Frontiers in Education | www.frontiersin.org July 2021 | Volume 6 | Article 674772 was to them. Forty-six of the 60 participants responded, a 76.7% response rate (95% confidence with a 7.04 interval). Of them, 53.3% felt the seminar was very helpful and 23.4% that it was helpful. An additional 15.0%, 9 persons, found is slightly helpful. While only asked 1 year, almost 92% of the 46 respondents that year reported that the symposium seminar was slightly to very helpful. Responses from two prompts, one focused on the LSAMP programming and the other specific to the symposium seminars appear in Table 2.
These multiple-choice questions used the same customized Likert scale (see explanation in the table). Like above, the use of a nominal Likert scale prevented statistical analysis. Yet, the responses from students across four years suggest that the on-campus seminars, which would have been prepared by local personnel and included opportunities specific to the institution, had a greater impact than the general interest sessions presented at the symposium although 61.5% of the informants found the symposium workshops about international experiences contributed at least somewhat to their interest.
A series of six questions was asked of participants from 2010 to 2013 (Table 3). This information represents the earliest TAMUS LSAMP efforts to gather specifics about impacts of international experiences. The question set remained uniform for the entire period and the students participating were recruited as juniors and seniors. Four of these questions were retained for 2015 on but, as noted above, the audience and programming experienced were different at that time.
Only one student disagreed at any level with a prompt. That was for considering employment outside the United States. The ratings submitted facilitate a rank ordering by percent agreement. Items with the higher percentage of strongly agree responses were listed first in the case of ties.

Able to participate because of LSAMP support (100%).
Learned about the culture of area visited (100%). 2. Increased confidence in ability to travel abroad (96.4%).
These responses from 28 students across a four-year period support the efficacy of study abroad and, in this case, its effect on LSAMP participants. Many of the students would have been from underrepresented groups but determination of the exact percentage is not possible as ethnic and racial identity information was not solicited on the surveys during this period. Note: NR no response. The awareness data are from three years. The interest data are from four years. It is possible that some individuals submitted more than one response for each if they were involved with TAMUS LSAMP programming for more than one year.  From 2015 through 2019, TAMUS LSAMP sponsored involvement in ELCIR. This was also planned for summer of 2020 but prevented by the COVID-19 pandemic. Students participating in the programming were asked a consistent set of questions on a post-participation survey. These included demographic information and 14 other queries. Ninety-one students from a total cohort of 110 submitted responses. The following is a compendium of results from all known sources including previously unpublished material from evaluation data.

Informant Demographics and Experiential Background
ELCIR survey informants provided demographic data. There were 44 females, 45 males, and two persons who did not categorize themselves. Of these, 82 identified as Hispanic and eight as non-Hispanic (one no response). These individuals thought of themselves as African American (n 7), Native American (n 6), Other (n 8), and White (n 69) (four no response; Hispanic/Latino was not included as a racial category). When completing the survey in the fall following their summer ELCIR experience, they reported academic classification as freshmen (n 1), sophomores (n 80), juniors (n 8), and seniors (n 1) (also one no response). Preuss et al. (2020) presents a comparison of these figures to the overall cohort of LSAMP-funded participants in ELCIR programming during the same period. The outcome of that comparison was recognition of informants exhibiting "a slight shift toward females when compared to the overall cohort. The ethnic identity of the survey respondents was similar to that of the overall cohort, the majority of the respondents (89.0%) identified as Hispanic, although this shows there was a slight oversampling of non-Hispanics. The distribution across races was similar. . .. Overall, the sample parallels the cohort with limited variation which was most pronounced in proportion of females to males, 5% more females in the sample, and in respect to underrepresentation of persons identifying as Native Americans/Alaska Natives" (p. 7).
Participants were asked if they had experience with international travel and study abroad as this had the potential to impact student responses to other queries. Students with prior experience might not confront as many new and challenging realities when participating in ELCIR. Even though the informants were nearly all early career college students (89.0%), 45% of them (n 41) had traveled internationally. Of those, three (3.3%) had previous experience in a study abroad program. The remaining 47 (51.6%) had no prior experience with international travel. With slightly less than half having traveled internationally the potential for new experiences involved with international travel to impact student responses was reduced.
Another topic of interest in the background of the participants was prior experience in a research setting. While this was not included in the evaluation data gathered from 2015 to 2019, it was part of Garcia et al. (2017) investigation. The question was asked of participants in the 2015 pilot of ELCIR. Fourteen of the sixteen respondents had no prior research experience, one reported one academic semester of research and another two semesters.
Another survey question that informs an understanding of the general orientation of participants to ELCIR programming asked about the student's ability to participate without an LSAMPprovided stipend. This question was added for the 2016 survey and retained for the next three years (n 81). Informants were asked which of a series of five responses best described what their "participation in an international research experience would have been without the financial support from LSAMP." The five possible answers were: 1) not participate (55.6%), 2) probably not participate (23.5%), 3) might have participated (11.1%), 4) probably participate (3.7%), and 5) would have participated (3.7%). There was also one party who did not respond. Only 7.4% of respondents felt they would have or probably would have participated without receiving financial support.

Findings Regarding ELCIR Programming
One of the first queries in the surveys from 2015 through 2019 asked for an overall rating of the ELCIR program. This resulted in a strongly positive response with 49 responses of excellent (53.8%), 32 of very good (35.2%), and eight of good (8.8%). Two students did not submit a response (2.2%) and no responses of fair or poor were received. The median and mode values were excellent.
The remainder of the multiple-choice questions asked of ELCIR participants were discussed in detail in Preuss et al. (2020). Table 4 provides a summary of the findings related to: 1) interest in another similar experience, 2) interest in continued engagement with research, 3) learning achieved regarding the culture of the region visited, 4) increase in knowledge related to the student's major, 5) confidence in travel abroad, 6) impact on interest in employment abroad, 7) impact on career choice, 8) highest degree the student will pursue, and 9) involvement with research post ELCIR. Table 5 chronicles findings related to graduate school: 1) awareness of, interest in, and plans to attend, 2) view of the affordability of graduate school, and 3) perception of support from family regarding a decision to pursue a graduate degree. For each topic considered in Tables 4 and 5, there was no significant difference when comparing responses by gender, ethnicity, race, or prior experience with international travel but measure of the extent of change was not possible as preparticipation data was not gathered.
The responses related to learning and change of perspective can be rank ordered by level of agreement (combining responses of agree and strongly agree). Fully 72.8% of these early career minority and first-generation college students indicated intent to pursue a master's degree or doctorate and 18.5% reported immediate continuation with UR.
ELCIR participation also had a strong impact on awareness of and interest in graduate school when retrospective pre-and post-participation ratings were compared (Table 5) although the use of a nominal scale prevented anything other than descriptive analysis. Like for the responses regarding highest degree the student would pursue, most of the respondents indicated they would attend graduate school with over 40% stating they would attend immediately after completing their baccalaureate degree. Interestingly, 64.4% of the respondents expressed concern about the affordability of graduate school while 83.3% felt their family would support a decision to pursue a graduate degree. Garcia et al. (2017) Interest in Research and Graduate School Garcia et al. (2017) presented ELCIR participants with 14 sentence length descriptions of ways they could engage with graduate school in 2015 and 13 in 2016. Informants were asked to make selections on the pre-and post-participation surveys. In 2015, the "majority. . .(n 14) indicated they planned to pursue a graduate level degree either in the near future or after obtaining some work experience. The remaining two individuals were uncertain about their future plans" (p. 12). The 2016 respondents (n 37) showed "similar patterns. . .with a shift towards more research-oriented plans after ELCIR took place. Only two individuals had no plans to go to graduate school, and four were unsure" (p. 12). Garcia et al. (2017) pre-and post-participation survey included 13 elements grouped as personal and professional skills. The skills listed fell in the following domains: 1) leadership, 2) interpersonal communication, 3) networking, 4) communicating technical information, 5) teamwork, 6) personal management, and 7) construction and presentation of written or verbal research summaries. The rating scale for responses was shifted from a fiveto four-point pattern between 2015 and 2016. Due to this, data for the 2 years could not be combined.

Personal and Professional Skills
Ratings submitted by the 2015 cohort (n 16) showed increases in nine of the 13 areas pre-to post-participation. Interest in continued involvement with research 91 77 students agreed or strongly agreed; median score of agree and mode of agree (n 40). Learned about local culture during time in Mexico 90 88 of 90 respondents (97.8%) agreed (strongly agree n 25; agree n 63). Only two parties did not agree (strongly disagree n 2). Knowledge enhanced regarding concepts in field in which majoring 90 78.8% agreed (strongly agree n 32; agree n 39), 16.7% neither agreeing or disagreeing, and 4.4% disagreeing (disagree n 3; strongly disagree n 1). Increased confidence in travel outside the United States 90 "Eighty-seven of 90 students. . .Agree or Strongly Agree. . .their ELCIR experience had increased their confidence in traveling abroad" (Preuss et al., 2020, p. 9). Interest in employment outside the United States following ELCIR 90 77.8% agreed (strongly agree n 47; agree n 23), 18.9% neither agreeing or disagreeing (n 17), and 3.3% disagreed (disagree n 2; strongly disagree n 1). ELCIR helped with career choice 90 "Just over 50% of the students, 47 of 90 respondents, agreed" (Preuss et al., 2020, p. 12); 31.1% neither agree or disagree (n 28), 13.3% disagree (n 12), 3.3% strongly disagree (n 1). Highest degree will pursue 81 72.8% indicated would pursue master's or doctorate. Involvement in UR since ELCIR 81 66 said no but 15 said yes just two months following ELCIR.
Note: n 81 occurred for questions that were not asked in 2015. Awareness of 81 "Responses skewed strongly in a positive direction following ELCIR programming with the median value moving up one category, 80.2% of responses occurring in the top two categories, no responses in the lowest category" (Preuss et al., 2020, p. 10). Interest in 81 "Answers skewed positive toward interest in graduate school post-ELCIR. . .all students had heard about graduate school and only six were "Not at all interested. . .". . .a reduction by 28.4 percentage points. The remaining 75 were "A little interested" (n 22), "Interested" (n 29), or "Very interested" (n 24). . . increases of 125% for interested and nearly 250% for very interested" (Preuss et al., 2020, p. 10). Plans to attend 81 Post-participation "a total of 91.4% of the participants felt that they might, probably would, or would go to graduate school and 43.2% stated they would go immediately after graduation or at some time in the future. . ..All the other students persisted at their [prior] level of interest or became more interested and none of the students had their level of interest decrease" (Preuss et al., 2020, p. 11). Affordability 90 64.4% agreed or strongly agreed with the statement "I would like to go to graduate school but I just don't see how I can afford it." Family would support decision to go 90 83.3% agreed or strongly agreed their family "would be supportive" of their attending graduate school; the "median response. . .being Agree" (Preuss et al., 2020, p. 12).
Note: n 81 occurred for questions that were not asked in 2015.
Frontiers in Education | www.frontiersin.org July 2021 | Volume 6 | Article 674772 The difference in means was statistically significant at the p < 0.05 level for one of these, ability "to write a research abstract" (Garcia et al., 2017, p. 9). The authors attributed the general pattern of increase in ratings but few statistically significant differences to high levels of student confidence prior to their international experience. Pre-and post-participation ratings regarding the same 13 skills were also solicited from the 2016 cohort (n 37). Even though all the pre-participation means were moderately to strongly positive, only four were lower than three (3) on a four-point scale and all the others were between 3.10 and 3.74, there were statistically significant increases for post-participation responses for all 13 at the p < 0.01 level. This pattern was interpreted as indicating student growth in all seven areas noted above resulting from project programming. Garcia et al. (2017) asked about the student's perceived level of knowledge regarding as set of six research activities. The intention was seeking comparative ratings of "level of knowledge. . .possessed in the area of research they were working on over the summer" (Garcia et al., 2017, p. 7). The six research activities were knowledge of: 1) "the process of research," 2) "the research literature," 3) "the research skills and/or lab techniques," 4) "how to do statistical analysis of research data," 5) "how to interpret research data," and 6) "how to apply research data" (p. 11). Limiting significance to p < 0.05, there was one significant finding for 2015. "Students felt that their knowledge of the process of research in their area improved (p 0.002)" (p. 7). For the 2016 cohort, differences between the pre-and post-assessment means were statistically significant for increases in knowledge at the p < 0.001 level for all six statements.

Orientation to and Understanding of Culture
The penultimate topic on Garcia et al. (2017) survey addressed the students' orientation to and understanding of culture. Informants were presented with a list of 19 statements regarding "working and engaging with others of different backgrounds, [and] challenges to their personal beliefs, self-concept, and cultural values" (p. 14). "For the 2015 cohort, there were no significant changes from pre-to posttest. . .. The 2016 cohort, however, had many significant differences in their post-test results compared to their pre-test results. . .. This may be due to. . .students in this cohort stay [ing] with local families. . .whereas the 2015 cohort. . .stayed in hotels. This may have had a greater impact on. . .cultural perspectives" (Garcia et al., 2017, p. 14). Garcia et al. (2017) attempted to use Grade Point Average (GPA) as a means of assessing academic impact of ELCIR participation. They compared GPA from the semester preceding the summer experience to that at the end of the semester immediately following it. "There were no significant differences between the two cohorts' overall GPAs from one semester to the next, [but] both [cohorts] demonstrated improvement" (p. 18). Given the level of the GPAs involved, annual averages near or slightly above 3.0, the potential for a substantial improvement in one semester was limited.

IMPACT ON ACADEMIC OUTCOMES AND PERSISTENCE
The 2017 study also considered persistence. "The retention of both cohorts in the College of Engineering at Texas A&M University [w]as. . .remarkable" (p. 18).
-96.0% of the 2015 cohort and 88.0% of the 2016 participants retained majors in Engineering (Garcia et al., 2017). -100% of 2015 and 88.0% of 2016 participants persisted through their next year as TAMU students (Garcia et al., 2017) when the historic second year persistence rate for TAMU first-time-in-college Engineering students was 86.7% between 2015 and 2018 (Texas A&M University, n.d.).
Graduation and persistence data for all LSAMP-supported ELCIR participants between 2015 and 2019 confirm high retention rates and, for the two years for which it is possible, higher than average graduation rates.
-One-and two-year retention rates for the cohort were 97.3% and 93.0%, respectively, while for their peers in Engineering they were 92.6% and 87.4% (Texas A&M University, n.d.). -Six-year graduation rates for former participants were 92.3% when the TAMU rate for undergraduates in the same period was 82.6% (Texas A&M University, n.d.).
Student tracking also confirmed higher than average engagement with study abroad programming post-ELCIR, and high levels of graduate school enrollment.
-Forty-one of the ELCIR participants (37.3%) completed a second study abroad program yet the Open Doors Report on International Educational Exchange indicated only 6% of engineering students completed study abroad experiences during the same time period (opendoor, n.d.). -Graduate school enrollment was also high. Thirteen of 33 students (39.4%) in the 2007-2014 group attended graduate school resulting in nine master's degrees, a PhD, an MD, and two other parties active in graduate study at the time this report was written. -Seventy-two of the 2015-2019 ELCIR participants completed bachelor's degrees by the time of publication with seven enrolled in or having completed graduate study. Twenty-nine were still TAMU undergraduates and nine were no longer studying at TAMU.

DISCUSSION
The findings parallel the benefits noted in the literature that were the basis of planning the initiatives. They were consistent for traditional study abroad programming facilitated for junior and seniors and for programming with freshman and sophomores as the audience.
-Seminars were noted as contributing to student interest in international educational experiences with those prepared and presented by local university personnel showing slightly higher impact. -Students at all academic levels reported substantial increases in awareness of and interest in graduate school. -Students at all academic levels and on several different measures reported increases in cultural learning, confidence in travel outside the United States, learning relevant to their major, commitment to continuing involvement with research, interest in another similar experience, and willingness to consider employment outside the United States. -Approximately 90% indicated intention to consider graduate school in the future with over 40% indicating intent to attend immediately following undergraduate study and 39.4% doing so in the 6 years following participation. -37.3% of ELCIR participants completed a second study abroad experience as undergraduates. -Participants persisted and graduated at higher rates than their institutional peers.
The outcomes are likely related to the growth in personal, professional, and research skill reported by participants. The areas in which there was the least impact, career plans and immediate continuation with undergraduate research (UR), were measures taken with early career students in the semester following the international experience. It is possible that a significant number did not have firmly established career plans and that there was limited motivation to initiate a new course of UR while completing the final requirements of the ELCIR program. Having 18.5% of the students continue with UR immediately is positive as "approximately 25% of TAMU engineering students participate in UR prior to graduation" (Preuss et al., 2020).
The TAMUS LSAMP findings included no statistically significant differences regarding student experience, learning, or perspectives when compared by gender, ethnicity, race, and prior experience with international travel. This is a notable confirmation that the programming described was efficacious for college students from underrepresented groups, many of whom were first-generation college students who may also have had limited resources. The vast majority of the students indicated they would not have been able to participate without financial assistance and nearly two-thirds indicated uncertainty regarding whether and how they could afford graduate school. Yet, it is also notable that over 84% of informants, who were predominantly URM students with 91.1% identifying as Hispanic, felt their family would support pursuit of a graduate degree as this does not align with historic patterns in STEM graduate programs and employment (Bayer Corporation, 2012;Linley and George-Jackson, 2013;Collins, 2018;NSF, 2018).
That these findings existed for URM students early in their academic careers and as juniors and seniors, across thirteen years of activity, with students attending Minority-Serving Institutions and a Predominantly White Institution (PWI) with differing Carnegie classifications, and for two different Diversity/Global Learning frameworks distinguishes this material from that describing other efforts. As a combined set, the data demonstrate substantial impact on participant perspective, interest, intention, and learning as well as suggesting a connection to high levels of persistence, continuing engagement with Diversity/Global Learning programs, degree completion, and enrollment in graduate school.

IMPLICATIONS
There are several simple implications of the findings. First, both traditional study abroad programming and structured programming including short-term involvement in research in an international setting were efficacious with LSAMP participants. Programming of either type is likely to have similar results at other institutions as the TAMUS participants came from a PWI, an HBCU, and an HSI that have different Carnegie classifications. Second, both types of programming were effective with students from underrepresented groups and who were first generation college students. Third, the year in school of the participant does not appear to influence the potential for substantial benefit from the programming, although this is a generalization based on different age groups reporting similar results to the two different approaches rather than samples of students at every level of undergraduate study experiencing both approaches. An important caveat, though, is the ability of an institution to provide stipends to enable student participation as this was a primary component in both approaches enacted by TAMUS LSAMP.
Replication of the initial pedagogical framework is possible for many institutions. Identifying funds for participant stipends would be the most challenging element. Sponsoring personnel could use existing study abroad programming as the platform and collaborate with their study abroad office in refining informational and orientation seminars for participating students. Replication of ELCIR requires funding to support participants, creation of a one-unit course, identification of and program planning with an institution of higher education outside the United States, and planning and implementing pre-and post-participation seminars and processes. Garcia et al. (2017) and Preuss et al. (2020) provide additional details as can authors of this publication. While substantial institutional and time commitment would be required to initiate and maintain such an effort, it may be more possible for institutions near the international borders of the United States and the potential for long-term societal impact demonstrated by the pronounced and positive outcomes for URMs has a strong appeal in light of the known need for persons with STEM degrees and patterns of underrepresentation in the STEM workforce of the United States employment (Bayer Corporation, 2012;Linley and George-Jackson, 2013;Collins, 2018;NSF, 2018).

LIMITATIONS
The data came as student self-reports and addressed experience, self-assessment, and personal opinions. Control groups were not included. Thus, the majority of information considered herein is descriptive. Inferential analysis was limited to one data stream, although those findings corroborated and elucidated the descriptive analysis. The sample sizes were moderate, less than 100 persons. The findings are then, primarily, a descriptive case study of two patterns of Diversity/Global Learning programming. Support from other sources and through further investigation by TAMUS LSAMP will be necessary to establish more robust evidence of efficacy.

DATA AVAILABILITY STATEMENT
The datasets presented in this article are not readily available because the data include responses from a small number of participants. This could make information individually identifiable. Requests to access the datasets should be directed to exquiri.michael@gmail.com.

ETHICS STATEMENT
The studies involved human participants and were reviewed and approved by the Texas A&M University Institutional Review Board. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individuals for the publication of any potentially identifiable images or data included in this article.

AUTHOR CONTRIBUTIONS
First authorship is shared by MP, SM, and JA. MP compiled applicable data from evaluation materials, completed quantitative data analysis, planned and led group analysis of qualitative data, completed secondary research, and drafted the article. SM and JA coordinated data gathering from partnering institutions and completed analysis of those data, completed data gathering and analysis specific to TAMU, helped plan the presentation, and provided comments on drafts. Senior authors are KB-P, KW, SW, PO, FP, JM, and MR. They coordinated site-specific activity and commented at different points during development of the article. JK, HL, MA, and SG are last authors. JK and HL planned and conducted evaluation processes that resulted in data presented in the article. MA and SG coordinated the ELCIR efforts, approved use of content from their 2017 publication, gathered institutional data, and commented on descriptions of ELCIR in this article.

FUNDING
This material is based upon work supported by the National Science Foundation under Grants No. HRD-073290, 1304975, and 1911375. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.