Hidden Identities Shape Student Perceptions of Active Learning Environments

Abstract

Active-learning pedagogies represent one suite of tools commonly thought to promote greater classroom inclusivity. However, the social aspects of many active-learning techniques, such as in-class group work, may differentially impact students who feel pressure to conceal certain aspects of their identity, such as sexual orientation, political affiliation, or religion. We used a post-course survey of over 1300 students at a large midwestern University to ascertain which aspects of a student's identity are most salient in their experiences in active-learning environments, especially with respect to group work. Using path analysis, we show that students who are politically conservative, religious, or who commute to campus perceive lower inclusion in active-learning environments, while students who identify as queer report negative experiences in groups. These and other findings lead us to conclude that targeted efforts to improve classroom climate, such as equitable teaching strategies, will benefit students who might feel marginalized in peer-learning environments.

Introduction

Attempts to improve the representation of historically underserved groups within science, technology, engineering, and mathematics (STEM) fields include targeted national efforts to promote and retain students at the undergraduate level (e.g., Maton et al., 2012; Wilson et al., 2012; Hernandez et al., 2013; Snyder et al., 2016; Yeager et al., 2016). Among those efforts, science educators committed to using evidence-based teaching methods have turned toward a suite of evidence-based pedagogies in large-enrollment classes, typically characterized collectively as “active learning pedagogies,” or ALP.

Active learning is based on constructivist learning theory and as such rests on the assumption that students actively construct—rather than passively acquire–their own knowledge by integrating new information with past experience and prior knowledge (Dewey, 1938; Vygotsky, 1963; Bruner, 1985). Under this broad umbrella, many pedagogies can be defined as active learning, e.g., games and simulations, worksheets, problem-based learning exercises, case studies, concept maps, and so on. However, in higher education, and in STEM in particular, much emphasis has been placed on the importance of the social, or interpersonal, aspects of active learning (Freeman et al., 2014). Emphasizing group work and its importance to individual learning has its roots in Vygotsky (1963) theory of social constructivism, whereby learning is initiated in a social context. Critically, social constructivism posits that learning relies on interpersonal interactions such as those promoted during in-class discussions and group work.

The inclusion of ALPs within STEM courses has rapidly increased over the last decade, due in part to national calls for change (Olson and Riordan, 2012), university programs and departments aimed at supporting active learning initiatives, and peer-reviewed journals focused on evidence-based biology education research (e.g., CBE Life Science Education) and curricular resources for active learning in biology (e.g., CourseSource). While empirical evidence highlights the value of ALP—from positive impacts on student performance and the reduction of achievement gaps in under-represented groups in STEM, to enhanced well-being and improved classroom social climate (Eddy and Hogan, 2014; Ballen et al., 2017) – the interpersonal aspects of many of these pedagogies by definition include social elements not present in the traditional lecture (Eddy et al., 2015; Cooper and Brownell, 2016; Freeman et al., 2017; Sullivan et al., 2018).

Within the social settings, students are often required to actively engage with other students and instructors and are often awarded points based on their ability to contribute ideas in class discussion or as members of small lecture groups. The interaction among students in these situations may heighten awareness of social identity differences among peers compared to traditional lecture courses where student social identity is relatively invisible to peers and the instructor. The heightened awareness of identity differences among students in a course may impact engagement and participation for minority-identity students, which will likely impact their science self-efficacy (Ballen et al., 2017) and sense of social belonging (Weaver and Qi, 2005; Aschbacher et al., 2010; Rocca, 2010). For instance, a students' gender, racial background, socio-economic status, and whether they are the first member in their family to attend college (i.e., first-generation students) can shape student-instructor interactions, willingness to speak up in class, as well as student aspirations for advanced degrees (Kim and Sax, 2009a; Aschbacher et al., 2010; Rocca, 2010). Thus, group work and other forms of class discussion may have unintended consequences for students with minority social identities by exacerbating feelings of isolation and reducing participation and intent to remain in a discipline (Rankin et al., 2014; Cooper and Brownell, 2016; BrckaLorenz et al., 2017).

While many aspects of social identity—such as race, cis gender, or physical disability—can be gleaned (or guessed) from external attributes, other aspects of individual identity can be invisible or hidden. We use the term hidden identity to refer to any personal, invisible descriptors of a person's identity that are not apparent—accurately or not—from outward appearance (Table 1, Vandrick, 1997; Quinn, 2006). However, we recognize that “identity” is itself a complex topic (e.g., Gee, 2000) and realize the facets of identity we present are not all-encompassing, nor do they exist apart from the multiple aspects of a student's identity we do not consider here. Rather, our emphasis is on “identities in practice,” namely aspects of student identity that are most salient in the STEM classroom (e.g., Barton, 1998; Tan and Barton, 2008).

Hidden identities are unique from conspicuous identities in that individuals can choose to reveal hidden identity facets to peers and instructors or may choose to keep them hidden (Quinn, 2006; Cooper and Brownell, 2016; Hughes, 2018). When students working in groups drift into conversation not directly related to course content, such as how they spent their weekend, students with hidden identities must consider whether to reveal personal information about themselves that might lead to discrimination from their peers as a result of conscious or unconscious bias. The choice to reveal or conceal hidden identities is determined by a multitude of factors including the perceived social identities of peers and instructors, classroom climate, campus climate as well as intrinsic factors (Garvey and Rankin, 2015a; Cooper and Brownell, 2016). Suppression and concealment of identity may exacerbate feelings of exclusion and undermine the psychosocial gains often associated with ALP, however research on this topic has been mixed (Frable et al., 1990; Vandrick, 1997; Smart and Wegner, 1999; Cooper and Brownell, 2016). Further, we felt compelled to illustrate, for our colleagues, how multiple aspects of student identity—beyond the broad categories so commonly discussed, such as race/ethnicity and gender—may impact a student's willingness to engage in class activities, and may consequently impact student learning.

Here we used a survey of 1,305 introductory-biology students to quantify the relationship between twelve facets of student identities and student experiences of courses that implement social aspects of ALP. While ALP can represent a range of curricular elements (e.g., small group discussions and activities, online homework and quizzing and consistent formative assessment), we focus here on the interactive aspects of ALP (i.e., group work and student-faculty interactions). We chose to focus on these social aspects of ALP because of their broad implementation at our institution, and a general sense that the interpersonal nature of these pedagogies would be more likely to highlight identity differences. Specifically, we were interested in understanding how students' identities influenced: (1) science self-efficacy, (2) sense of belonging and participation in ALP courses, and (3) perceptions of campus and course climates. We implemented a voluntary, post-course survey across five introductory courses which included a number of questions related to student confidence in their ability to read and interpret scientific data (Ballen et al., 2017), student experiences interacting with peers and the instructor in the context of ALP, as well as student perceptions of institutional inclusivity.

Methods

Participant Pool

Our student population included undergraduates at the University of Minnesota, a large, public, research institution in the upper Midwest, USA. Our work is restricted to a single institution with one cultural profile—predominantly white (63%), liberal, outwardly LGBTQIA-friendly, female-dominated (53%), and metropolitan (University of Minnesota Office of Institutional Research, 2019). In the present study, we investigated variables that influenced student perceptions of active learning by surveying students across 10 sections in five large introductory biology classes taken in spring 2018 by non-biology majors (Table S2). Surveys were administered as a larger post-course survey and student participation in the study was completely voluntary. Within these five courses, the amount and type of active learning pedagogies implemented differed and lecturing composed between 19.5 and 54.8%, on average, of class time (Petra Kranzfelder, pers comm). While we did not directly ask students about implemented ALPs within their courses and percentages used, all courses implemented small-group discussions and activities, a classroom response system (app-based, devices, or notecards), consistent formative assessment, online homework and/or quizzing. None of the courses were fully-flipped or relied solely on problem-based learning or case studies. Next, a third-party individual, not involved in the course or this research, matched student survey responses to institutional data on student gender, race/ethnicity, age, and incoming academic preparation (American College Test, hereafter ACT). In a few cases (N = 13), student self-reported gender misaligned with the information we obtained from the institution. In these cases we used self-reported gender. Survey items and methodology were granted an exemption from full review by the University of Minnesota's IRB, #1405E50826.

Study Design and Questionnaire Development

Student Experiences Within ALP Courses

We asked students to complete a survey that related to their experiences in ALP courses, with a focus on their interactions with peers and the instructor (Table S1). Because no research-validated inventory exists to address the specific questions we had related to perceptions of the social elements of active learning, we designed a survey to reflect the most relevant themes, and validated the survey through exploratory factor analysis (Tables S1, S3) and principle component analysis (Tables S4, S5). Themes included group interactions (e.g., “In group work, my enjoyment is impacted by the members in my group.”), peer dynamics (e.g., “I feel students will judge me if I express my true identity within the classroom.”), student-instructor dynamics (e.g., “I feel comfortable having personal conversations with the instructor(s) in this class.”), and general preference for ALP courses over traditional lecture (“e.g., I enjoy the active learning classrooms more than traditional style lecture classes.”) (for full questionnaire see Table S1). We asked students to rate the extent to which they agreed with statements on a 1–7 Likert scale ranging from strongly disagree to strongly agree. Additionally, we explored elements of science self-efficacy because of its demonstrated influence on student retention and performance in different educational contexts (Chemers et al., 2011; Ballen et al., 2017).

Student Identities

Following the Perceptions of ALPs survey, we asked students to provide their ethnicity, sexual orientation, gender identity, religiosity, spirituality, political affiliation, the size of the community they grew up in, how far they commute to campus, whether they live alone, with families, or with roommates, whether they are a first-generation college student, were internationally born, or are part of a historically under-represented group in STEM disciplines (Tables 1, 2). At the end of the survey, we asked three open-ended questions to explore experiences and challenges they face within ALP courses, and how their identities shape interactions with peers and/or instructors within ALP courses. From these qualitative responses we categorized themes from select individuals that highlighted the multi-dimensional dynamics of student identities and how multiple identity facets shape ALP engagement. Further, these open responses served to confirm whether we had, in fact, included the most salient—to the students—identities in our constrained-choice options.

Data Analysis

All statistical analyses were conducted in R version 3.3.2 (R Development Core Team, 2016) and RStudio version 1.0.44 (RStudio Team, 2015), with packages cited where applicable. From our initial pool of 1,305 participants, we omitted any participants that did not respond to all survey items, leaving us with 976 total participants. In order to simplify our analyses and to explore patterns in how respondents answered questions, we performed a maximum-likelihood exploratory factor analysis using the factanal function with a varimax rotation. To determine the proper number of factors to include within our factor analysis, we used the nScree function (nFactors, Raiche and Magis, 2015). and vss function (psych, Revelle, 2016) as two independent measures of numbers of factors to include. We found that both Velicer's minimum average partial test and parallel analysis tests converged on the retention of 8 factors. Final factor groupings were determined based on Comrey and Lee (1992) criteria; we rejected any factor loading <0.5 (Table S3). Because our eighth factor did not have any components that passed the Comrey and Lee criteria, we were left with a total of seven factors (Table S3).

Overall, factor groupings seemed to conform to logical themes within our survey questions (Tables S1, S3). For instance, our first factor consisted of 11 questions related to the participant's level of confidence in their ability to do tasks related to science, which we termed “science self-efficacy.” Survey questions consisted of self-reported student confidence in their ability to evaluate science literature, analyze graphs and figures, develop hypotheses, design an experiment, analyze data, and draw conclusions with the results; this factor explained 15% of the variation within our questionnaire data. Factor 2, “pressure to conform,” grouped survey questions together that asked students the extent that they think about the identity of others as well as their own in class, fear judgment from peers and instructors for expressing their identity or opinions in the classroom, and feel the pressure to conform to peers and instructors within the classroom; this factor explained 12% of variation in questionnaire data (Table S1). The third factor, “sense of belonging in the class,” explained an additional 9% of variation and the questions related to student comfort with having personal conversations in class, enjoyment of those personal connections with both peers and instructors, and perceived valued as a unique individual in the classroom. The fourth factor related to student “preference toward ALP courses” and included survey questions about enjoyment of active learning, learning experiences and comfort in ALP courses relative to traditional lecture courses and explained 6% of questionnaire data variation. The fifth factor related to “active learning courses as a community” and combined survey questions exploring the perceptions of being part of student-led learning communities in ALP courses; this factor explained 5% of data variation. The sixth factor, “science as a career,” explained 4% of questionnaire variation and was related to student interest in taking more science courses and pursuing a career in science. The final factor was related to ALP courses highlighting differences in gender, sexual orientation, socio-economic status, religious, and cultural backgrounds among peers and explained 4% of questionnaire variation (Tables S1, S3).

To reduce the number of statistical models we ran, we created composite outcome measures with the results of our factor analysis using principal component analysis (PCA). For each of our seven factors, we conducted a PCA using the rda function (vegan, Oksanen et al., 2015), then we extracted scores of the first principal component to serve as our composite outcome measure (Results in Tables S4, S5).

To understand the relationship of facets of student identity and outcome measures, we constructed multiple regression models using our 12 facets of identity to explain all outcome measures (Summary statistics in Table S6). In addition to the seven composite outcome measures, we also constructed multiple regression models on seven outcome measures from our survey questions that did not cluster with other outcome measures in our factor analysis (Table 3, Table S1), for a total of 14 outcome measures. From these full models, we used a multi-model inference and model averaging (Grueber et al., 2011) to determine which identity facets best predicted outcome measures, using the dredge function in the MuMIn library (Grueber et al., 2011).

Table 3

Predictors retained (blue) within multi-model fitting of 10 multiple regression models that predicted outcome measures that were within 4 AIC score units.

We used the retained predictor variables (blue) to parameterize our initial path model.

We used the final averaged multiple regression models to parameterize a path model to better explore the relationships among identity facets and to understand how a student's multidimensional identity shapes perceptions to ALP courses. We performed multilevel path analysis (Shipley, 2009, 2013) using the piecewiseSEM package (Lefcheck, 2016). Our initial path model included all the identity facets that were retained within the final multiple-regression model for all 14 outcome measures. Next, we tested for goodness of fit using the d-separation test (Shipley, 2009), derived an AIC score from Fisher's C statistic (CIC) (Cardon et al., 2011; Shipley, 2013), and extracted path co-efficients from models which fit using the sem.fit function. Next, we fit additional paths and removed non-significant paths from our model based on estimates of path strength using a step-wise fitting procedure. To improve model fit, we added correlated error terms between several outcome measures (for example: Pressure to conform to the views of peers and instructors & sense of belonging among peers in class, see Table S7 for full list of correlated error terms). From our best fit path model, we report standardized path coefficients, calculated p-values using the Kenwood-Roger method (Lefcheck, 2016), and the variation explained by our fourteen regression models (Nakagawa and Schielzeth, 2013). To simplify results, we removed four outcome measures from our analysis (Inclusion—Course community, Science as a career path, distractions in ALP courses, importance of group selection) due to low explanatory power of the identity facets (R² <0.02, Full model fit results can be found in Table S8).

Results

Identity Facets as Predictors of Outcome Measures

We set out to investigate how different facets of student identity impact outcome measures in classrooms that use active learning, such as sense of social belonging and the extent to which groups shape enjoyment in class. To understand which identity facets predicted our seven outcome measures, we first constructed full multiple regression models which included all 12 identity facets and used multi-model inference and model averaging to determine the identity facets that predicted each outcome measure. Overall, we found that each of our identity facets was a significant predictor for at least one of our outcome measures (Table 3). While no identity facet was retained in all 10 outcome measures (Table 3), it was apparent that certain identities impacted student perceptions in active learning environments, which other identities played less of a role in reported outcome measures. For example, being from a historically under-represented group and commuter status was retained in 6 of 10 multiple regression models (Table 3). Internationally-born and first-generation college status were identity facets that were retained in 5 of 10 regression models; gender identity, ethnicity, religiosity, spirituality, and political affiliation were retained in 3 of 10 regression models. We found that sexual orientation was retained in 3 of 10 models and finally, the size of the community the student grew up in was retained only in a single regression model (Table 3). All of our outcome measures were predicted by multiple identity facets, confirming that student perceptions of ALP courses are driven by multi-dimensional aspects of student identity, including often-overlooked “hidden” identity facets.

Path Models to Understand Multidimensional Student Identities

We used the final averaged multiple regression models to parameterize a multi-level path analysis model to better explore the relationships among identities. Overall, our identity predictors were able to explain 3.5 to 11 % of the variation of outcome measures (Table 4). Similar to the multiple regression results, we found that all 12 identity facets were significant predictors for all 10 outcome measures, however which identity facets are significant and their relative strength differed depending on the outcome measure considered (Figure 1, Table S9).

Figure 1

Gender

Overall, we found gender identity was a significant predictor in four of our outcome measures: (1) a student's pressure to conform to the views of peers and instructors in ALP courses, (2) the identity of the group shapes the enjoyment of group work, (3) ALP courses are more inclusive than traditional classes, and (4) classes using ALP highlight identity differences among peers. However, the directionality and relationships were somewhat surprising. For instance, cis-females reported lower pressure to conform, a lower sense of identity differences, and that ALP courses are more inclusive, relative to their cis-male counterparts. These differences may be due to the female-positive climates of these female-dominated biology classrooms. Future work would profit from close examination of whether survey items vary in different environments, such as those that are cis-male dominated and stereotyped (e.g., computer science courses). Conversely, gender-variant students (gender neutral, fluid, non-binary, trans identifying) often reported higher pressure to conform to the viewpoints of their peers and instructors and a lower feeling that ALP courses are inclusive relative to cis-gender peers, although these relationships were not all significant (Figure S1); however, our ability to interpret these results is limited by the low number of students reporting as gender-variant.

Ethnicity

Ethnicity was retained as a significant predictor within four outcome measures: (1) science self-efficacy, (2) pressure to conform to the views of peers and instructors, (3) institutional sense of belonging, and (4) preference to work alone. Specifically, Asian students (Asian-American and internationally born) reported lower science self-efficacy and higher pressure to conform to the views of their peers and instructors, but also a higher institutional sense of belonging and lower preference to work alone in ALP courses, relative to white peers (Figure 1). Black students reported higher pressure to conform to the views of their peers and instructors and lower preferences to work alone in ALP courses relative to white students (Figure 1). We did not observe significant differences in perceptions or attitudes of ALP courses among other ethnic groups within our sampled population, however we may have been limited by low sample size.

First Generation College Students

Students that reported as first-generation had a lower sense of belonging in classes relative to peers from continuing-education families (Figure 1, Figure S2). First-generation students also reported lower preference to work alone and were less likely to report that ALP courses highlighted differences among peers relative to students from continuing-education families (Figure S2). Additionally, retained within our best-fit model, first-generation students also reported lower science self-efficacy and a lower preference for ALP courses relative to continuing education peers, although these differences were not statistically significant (Figure S2, Table S9).

Sexual Orientation

Self-reported sexual identity shaped student perceptions and attitudes of ALP course inclusivity, enjoyment of working in groups, and preference toward ALP courses over traditional-style courses. For instance, students reporting as queer or bi-curious were less likely to say that active learning courses were more inclusive relative to their heterosexual, liberal, on-campus peers (Figure 1, Table S9). Students reporting as bisexual and pansexual reported a lower preference for active learning courses relative to their straight or heterosexual peers (Figure 1, Table S9). Students reporting as bisexual and asexual were more likely than their peers to report that group identity shapes their enjoyment in ALP courses.

Religion and Politics

Conservative and political leanings were critical factors that predicted a students' comfort speaking in class, their view of course and campus climate, a pressure to conform to the views of peers and instructors, and science self-efficacy. For instance, highly religious and conservative students reported less comfort speaking in ALP courses relative to non-religious and very liberal peers (Figure 1). Additionally, students reporting as very or moderately religious had lower science self-efficacy and a lower institutional sense of belonging relative to non-religious peers. Conservative students were less likely to report ALP courses as more inclusive and felt stronger pressure to conform to the views of peers and instructors than very liberal students (Figure 1, Table S9). Future work on this topic may highlight the context-dependent nature of these results; because the current study took place within the Midwest United States, highly religious or conservative students constitute a minority of the student population.

Commuter Status

Commuter status was retained as a significant predictor within six outcome measures (Figure S5). Relative to on-campus living peers, commuters had a lower science self-efficacy, lower sense of belonging among peers, lower preference for ALP courses, lower comfort speaking in class, but a lower preference to work alone in ALP courses (Figure S5). However, much of our significant commuter relationships were driven by commuters living within 5 miles from campus. The patterns observed within these short-distance commuters were not always observed within long-distance commuters, however we also had significantly fewer long-distance commuters (Figure S5).

Multi-dimensional Identities Through the Eyes of the Students

We provided open-ended questions for students to report how their identity facets shape their interactions with peers and instructors in ALP courses. Specifically, we asked students to describe how aspects of their identity impact their experiences in class. Overall, our student responses further highlight the multi-faceted nature of student identity and how those identities shape peer and instructor interactions within ALP courses (Table 5). Within the 200 participants that provided answers to the open-ended questions, we found culture, language, and ethnicity differences (23/200 participants) and religiosity (20/200 participants) were the two most commonly reported identity facets that shaped student interactions with peers and instructors. Additionally, socio-economic status (10/200), sexual orientation and gender identity (10/200), political affiliation (11/200), first-generation college status (6/200), growing up in a rural environment (8/200), and commuter status (2/200) were also reported by multiple students and were often reported together (Table 5). Although not considered within our initial study design, multiple students reported that differences in mental health strongly shaped their interactions with peers and instructors within ALP courses (Table 5). These student responses highlight the importance of student mental health struggles, which may be impacted in group learning environments that require interactions with peers.

Discussion

Many faculty trained in inclusive pedagogy have likely encountered the “iceberg model” of cultural diversity, in which the bulk of an individual's identity is determined by sub-surface—or hidden—aspects such as beliefs and values (Hall, 1976; Vandrick, 1997). Our findings support the iceberg model in the context of student diversity, and confirm that not only are our students characterized by multiple visible and hidden identities, but these aspects of identity influence student perceptions in our courses. We can confirm some trends previously documented for students identifying along established race and gender spectra: black students are less likely to feel institutional inclusion and more likely to feel pressure to conform in groups (Thompson, 2004; Johnson, 2012; Booker, 2016; Boston and Warren, 2017), women prefer to work in groups (Kuhn and Villeval, 2011, 2015) and feel less comfortable speaking in class (Eddy et al., 2014; Ballen et al., 2018; Neill et al., 2019); and international student status predicts a greater awareness of identity differences in the classroom (Schmitt et al., 2003; Popov et al., 2012; Glass et al., 2015; Heng, 2017).

We advance the dialogue by highlighting how identities influence perceptions of interpersonal aspects of ALP. For example, students who commute to campus, those who are politically conservative, and those who are highly religious report lower sense of inclusion in courses that employ ALP (Navarro et al., 2009). Further, in many cases, these hidden identities hold more sway over student perceptions of active learning than previously assumed (Vandrick, 1997). Gender and sexual orientation serve as potent examples, whereby group work negatively impacts the enjoyment of queer students, and asexual and bisexual students prefer to work alone rather than in groups. These findings echo recent work demonstrating that, in ALP settings involving group work, LGBTQIA students felt an increased sense of these minoritized identities (Garvey and Rankin, 2015a; Cooper and Brownell, 2016; Garvey et al., 2018), and suggest mechanisms that may contribute to the lower retention of sexual and gender variant minorities in STEM (Garvey and Rankin, 2015a; BrckaLorenz et al., 2017; Garvey et al., 2018; Hughes, 2018). We thus question the idea that group work is a pedagogical panacea to the large-lecture problem. Faculty seeking to create a welcoming environment for all students should note the complexities of student identities in their classroom, many of which are not outwardly visible or outward appearance may not match internal identity.

We envision several research priorities stemming from these findings. First, our work is restricted to a single institution with one cultural profile—predominantly white, liberal, outwardly LGBTQIA-friendly, female-dominated, and metropolitan. At different institutions, with different profiles (e.g., minority-serving, conservative, rural), we may see different student identities emerge as predictive of engagement in active-learning settings. Given that sense of belonging, and subsequent performance and retention, are often affected by minoritized status, we predict that student concerns will vary as a function of institutional culture. For example, it is possible that URM students would approach active learning differently at a minority-serving institution where they are less likely to feel marginalized for their racial or ethnic identities. Further, our analysis did not include an exploration of interaction effects, although we are confident that intersectionality will be a key feature of this narrative. In fact, many of the student comments (Table 5) are difficult to assign to a single category of identification (e.g., “My disability and Christian faith has made it harder for me to express my opinion in the classroom…”). Thus, the impact of combined marginalized identities should be explored in future work.

Altogether, the twelve identity predictors explained anywhere from 3.5 to 11 % of the variation of outcome measures. This suggests that any individual identity facet explained anywhere from about 1–3% of the variation in an outcome measure which is inline within previous studies that have reported the effects of a single identity facet like: gender identity, students identifying as an URM, socio-economic status, first-generation students, age, science self-efficacy (Ballen et al., 2017) and academic performance (Gilardi and Guglielmetti, 2011; Richardson et al., 2012). The low predictive power of our identity facets reinforces the idea that student perceptions of small-group dynamics, interactions with peers and instructors, comfort speaking in courses, and science self-efficacy are not wholly determined by these broad identity groupings. While a shared ethnic, gender, political affiliation, or sexual orientation may provide us some insight into challenges faced by our students, ultimately, our students are complex, multi-faceted, with unique past experiences that will fully shape their perceptions of courses that use ALP. For instance, student motivational factors and specific personality traits (Richardson et al., 2012), access to social support (Baker, 2013) as well as other external pressures, like maintaining employment (Gilardi and Guglielmetti, 2011) can exert stronger influence than inclusion in broad gender, ethnicity, URM, or first-generation groupings.

Future research would also profit from exploring the impact of established equity interventions on students' multiple identities. For example, affirmation exercises have demonstrated success with improving the performance of students from certain underrepresented racial and ethnic groups (Cohen, 2006), women (Miyake et al., 2010), and first-generation college students (Tibbetts et al., 2016). These affirmation exercises could thus be explored as a possible belongingness intervention for lowering the barriers perceived by students with other non-dominant or marginalized identities—non-traditional students, LGBTQIA students, commuters, etc. Similarly, role-modeling interventions, designed to introduce diverse student populations to scientists from diverse backgrounds, have been successful (Schinske et al., 2016; Barnes et al., 2017; Holt et al., 2018); broadening the reach of these interventions, and being intentionally inclusive of some of the hidden identities discussed herein (e.g., political conservatives, LGBTQIA students) may serve to help more students feel included during in-class activities.

Group work itself—the cornerstone of many transitions to active learning (Prince, 2004; Michael, 2006; Freeman et al., 2014) —should be critically evaluated from the standpoint of multiple student identities. Many active learning techniques rely on students collaborating in small groups, either in or out of class. These techniques include Process Oriented Guided Inquiry Learning (POGIL; Thomas et al., 2008) and team-based learning (TBL; Jeno et al., 2017), possibly in the context of the flipped classroom (Baepler et al., 2014; Betihavas et al., 2016). While the benefits of small-group learning, especially for women (Lewis et al., 2016; Sullivan et al., 2018; Neill et al., 2019), have been documented, less attention has been paid to students who may feel their identities put them at a disadvantage in small groups. An exception includes Cooper and Brownell's (2016) work with LGBTQIA students, in which they document the social anxiety triggered by group work in some sexual minorities. Specifically, students are not compelled to “out” themselves in the traditional large-lecture setting, but the nature of informal group discussions can demand more personal sharing—revelations that can be stressful. Similarly, our work suggests that religious students and politically conservative students may feel less comfortable sharing ideas in classes that emphasize evolution (often considered at odds with religious doctrine; Pobiner et al., 2018) or climate change (the acceptance of which is generally aligned with more liberal ideologies; McCright and Dunlap, 2011; Walker et al., 2017). And group work that requires in-person, out-of-class commitments may be especially difficult for non-traditional students, commuters, or those with full-time work responsibilities.

Preparing for Group Work

The best practices for implementing group work will necessarily consider inclusion and equity from multiple perspectives. We have compiled a number of suggestions that can help instructors prepare implementing group work in their classroom. A good start may simply involve designing groups in ways that minimize anxiety: assign students to groups, rather than permit them to self-assort, to reduce anxiety and feelings of marginalization (Englund, 2018); create a pattern of expected student and instructor behaviors to reduce anxiety (McCroskey, 2009); avoid cold-calling on individual students and instead opt for a transparent—possibly random—method of calling on groups, ideally after time for discussion (Rocca, 2010); and be clear about course expectations (Neer, 1990; Zhang and Zhang, 2005). However, future work should explore the effectiveness of these anxiety-reduction strategies in improving the engagement of all students in ALP.

Limitations

Our conclusions are limited by the singular focus of our study—one large research institution in the upper Midwest. Our findings are restricted to students in introductory-biology courses. We did not include other aspects of social identity or personality traits within our survey items (Rocca, 2010). For example, we did not ask about student abilities, but would certainly do so in future surveys. We did not explore interactions and intersectionality between identity facets and perceptions of active learning. And, even though all surveyed students were in ALP courses, some of these courses were offered in technology-enhanced active-learning classrooms (Cotner et al., 2013), and some were not. Thus, we cannot be sure that all students interpreted survey prompts the same.

While we were interested in understanding how students' identities were influencing their experiences in ALP courses, our questionnaire items did not allow us to asses or understand processes of student identity development (Waterman, 1999; Morgan, 2013; Cooper and Brownell, 2016), meaning making and the influence of the ALP experience on identity development (Singer, 2004; McAdams and McLean, 2013). To assess these aspects, we would need to collect richer open-ended qualitative data, allowing students to describe their experiences in ALP courses. As such, our findings provide baseline data indicating differences in attitudes in ALPs among different social identities, which will inform qualitative data collection in follow-up studies.

Additionally, since all courses implemented ALPs in some capacity, we are really not able to disentangle differences between ALP courses and traditional lecture style courses in terms of classroom climate, comfort, and perceptions of ALPs and how identity shaped those relationships. For instance, gender-queer, politically conservative, and commuters were more likely to report that ALP courses were less inclusive, however it's unknown whether students were drawing on experiences in this course, all their courses, or overall campus climate. Follow-up studies could attempt to disentangle certain aspects of ALP courses are less inclusive for these individuals by addressing certain ALPs specific to these courses. Additionally, we also did not specifically test for differences in course logistics (e.g., class size, seating structure, time of day) within our analyses, however we did account for differences among courses broadly by including course as a random effect within our mixed-effect models. Finally, we invite researchers to implement similar questionnaires across a range of geographically, politically, and culturally diverse institutions to understand how campus climate and social identities shape student perception of ALPs.

Conclusions

Regardless of limitations, these findings should alert our colleagues to several key implications: (1) our students are multi-faceted individuals, with many sub-surface aspects of identity; (2) these complex identities result in complex perceptions of ALP, and well intentioned faculty may repel the very students these pedagogies are designed to attract or retain; (3) no single classroom tactic is likely to be effective for all of our students, thus we echo previous calls for diverse pedagogies to reach diverse student populations; and (4) national and global initiatives to promote diversity in STEM should consider diversity broadly, and realize that our collective goal is unlikely to be a “one-size-fits-all” pedagogy.

References

• 1

  AschbacherP. R.LiE.RothE. J. (2010). Is science me? High school students' identities, participation and aspirations in science, engineering, and medicine. J. Res. Sci. Teach.47, 564–582. 10.1002/tea.20353

  • CrossRef
  • Google Scholar

• 2

  BaeplerP.WalkerJ. D.DriessenM. (2014). It's not about seat time: Blending, flipping, and efficiency in active learning classrooms. Comput. Educ.78, 227–236. 10.1016/j.compedu.2014.06.006

  • CrossRef
  • Google Scholar

• 3

  BakerC. N. (2013). Social support and success in higher education: The influence of on-campus support on African American and Latino college students. Urban Rev.45, 632–650. 10.1007/s11256-013-0234-9

  • CrossRef
  • Google Scholar

• 4

  BallenC. J.LeeD.RaknerL.CotnerS. (2018). Politics a “Chilly” Environment for Undergraduate Women in Norway. PS Polit. Sci. Polit.51, 653–658. 10.1017/S1049096518000045

  • CrossRef
  • Google Scholar

• 5

  BallenC. J.WiemanC.SalehiS.SearleJ. B.ZamudioK. R. (2017). Enhancing diversity in undergraduate science: self-efficacy drives performance gains with active learning. CBE Life Sci. Educ.16:ar56. 10.1187/cbe.16-12-0344

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 6

  BarnesM. E.ElserJ.BrownellS. E. (2017). Impact of a short evolution module on students' perceived conflict between religion and evolution. Am. Biol. Teach.79, 104–111. 10.1525/abt.2017.79.2.104

  • CrossRef
  • Google Scholar

• 7

  BartonA. C. (1998). Teaching science with homeless children: Pedagogy, representation, and identity. J. Res. Sci. Teach. 35, 379–394.

  • Google Scholar

• 8

  BetihavasV.BridgmanH.KornhaberR.CrossM. (2016). The evidence for ‘flipping out': a systematic review of the flipped classroom in nursing education. Nurse Educ. Today38, 15–21. 10.1016/j.nedt.2015.12.010

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 9

  BookerK. (2016). Connection and commitment: how sense of belonging and classroom community influence degree persistence for african american undergraduate women. Int. J. Teach. Learn. High. Educ.28, 218–229.

  • Google Scholar

• 10

  BostonC.WarrenS. R. (2017). The Effects of Belonging and Racial Identity on Urban African American High School Students' Achievement. J. Urban Learn. Teach. Res.13, 26–33.

  • Google Scholar

• 11

  BrckaLorenzA.GarveyJ. C.HurtadoS. S.LatopolskiK. (2017). High-impact practices and student–faculty interactions for gender-variant students. J. Divers. High. Educ.10:350. 10.1037/dhe0000065

  • CrossRef
  • Google Scholar

• 12

  BrunerJ. (1985). Models of the learner. Educ. Res.14, 5–8. 10.3102/0013189X014006005

  • CrossRef
  • Google Scholar

• 13

  CardonM.LootG.GrenouilletG.BlanchetS. (2011). Host characteristics and environmental factors differentially drive the burden and pathogenicity of an ectoparasite: a multilevel causal analysis. J. Anim Ecol.80, 657–667. 10.1111/j.1365-2656.2011.01804.x

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 14

  ChemersM. M.ZurbriggenE. L.SyedM.GozaB. K.BearmanS. (2011). The role of efficacy and identity in science career commitment among underrepresented minority students. J. Soc. Issues67, 469–491. 10.1111/j.1540-4560.2011.01710.x

  • CrossRef
  • Google Scholar

• 15

  CohenG. L. (2006). Reducing the racial achievement gap: a social-psychological intervention. Science313, 1307–1310. 10.1126/science.1128317

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 16

  ComreyA. L.LeeH. B. (1992). Interpretation and application of factor analytic results, in A First Course in Factor Analysis, eds ComreyA. L.LeeH. B. (Hillsdale, NJ: Lawrence Erlbaum Associates, Inc).

  • Google Scholar

• 17

  CooperK. M.BrownellS. E. (2016). Coming out in class: Challenges and benefits of active learning in a biology classroom for LGBTQIA students. CBE Life Sci. Educ.15:ar37. 10.1187/cbe.16-01-0074

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 18

  CotnerS.LoperJ.WalkerJ. D.BrooksD. C. (2013). “It's Not You, It's the Room”—are the high-tech, active learning classrooms worth it?J. Coll. Sci. Teach.42, 82–88.

  • Google Scholar

• 19

  DeweyJ. (1938). Experience and Education. New York, NY: Macmillan Company.

  • Google Scholar

• 20

  EddyS. L.BrownellS. E.ThummaphanP.LanM.-C.WenderothM. P. (2015). Caution, student experience may vary: social identities impact a student's experience in peer discussions. CBE Life Sci. Educ.14:ar45. 10.1187/cbe.15-05-0108

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 21

  EddyS. L.BrownellS. E.WenderothM. P. (2014). Gender gaps in achievement and participation in multiple introductory biology classrooms. CBE Life Sci. Educ.13, 478–492. 10.1187/cbe.13-10-0204

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 22

  EddyS. L.HoganK. A. (2014). Getting under the hood: how and for whom does increasing course structure work?CBE Life Sci. Educ.13, 453–468. 10.1187/cbe.14-03-0050

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 23

  EnglundH. (2018). Relationship between marginality and minority status in undergraduate nursing students. J. Nurs. Educ.57, 339–346. 10.3928/01484834-20180522-04

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 24

  FrableD. E.BlackstoneT.ScherbaumC. (1990). Marginal and mindful: deviants in social interactions. J. Pers. Soc. Psychol.59:40. 10.1037/0022-3514.59.1.140

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 25

  FreemanS.EddyS. L.McDonoughM.SmithM. K.OkoroaforN.JordtH.et al. (2014). Active learning increases student performance in science, engineering, and mathematics. Proc. Natl. Acad. Sci. U.S.A.111, 8410–8415. 10.1073/pnas.1319030111

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 26

  FreemanS.TheobaldR.CroweA. J.WenderothM. P. (2017). Likes attract: Students self-sort in a classroom by gender, demography, and academic characteristics. Act. Learn. Higher Educ.18, 115–126. 10.1177/1469787417707614

  • CrossRef
  • Google Scholar

• 27

  GarveyJ. C.BrckaLorenzA.LatopolskiK.HurtadoS. S. (2018). High-impact practices and student–faculty interactions for students across sexual orientations. J. Coll. Stud. Dev.59, 210–226. 10.1353/csd.2018.0018

  • CrossRef
  • Google Scholar

• 28

  GarveyJ. C.RankinS. R. (2015a). Making the grade? Classroom climate for LGBTQ students across gender conformity. J. Stud. Affairs Res. Pract.52, 190–203. 10.1080/19496591.2015.1019764

  • CrossRef
  • Google Scholar

• 29

  GarveyJ. C.RankinS. R. (2015b). The influence of campus experiences on the level of outness among trans-spectrum and queer-spectrum students. J. Homosex.62, 374–393. 10.1080/00918369.2014.977113

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 30

  GeeJ. P. (2000). Chapter 3: Identity as an analytic lens for research in education. Rev. Res. Educ.25, 99–125. 10.3102/0091732X025001099

  • CrossRef
  • Google Scholar

• 31

  GilardiS.GuglielmettiC. (2011). University life of non-traditional students: engagement styles and impact on attrition. J. Higher Educ.82, 33–53. 10.1353/jhe.2011.0005

  • CrossRef
  • Google Scholar

• 32

  GlassC. R.KociolekE.WongtriratR.LynchR. J.CongS. (2015). Uneven experiences: the impact of student-faculty interactions on international students' sense of belonging. J. Int. Stud.5, 353–367.

  • Google Scholar

• 33

  GrueberC. E.NakagawaS.LawsR. J.JamiesonI. G. (2011). Multimodel inference in ecology and evolution: challenges and solutions. J. Evol. Biol.24, 699–711. 10.1111/j.1420-9101.2010.02210.x

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 34

  HaakD. C.HilleRisLambersJ.PitreE.FreemanS. (2011). Increased structure and active learning reduce the achievement gap in introductory biology. Science332, 1213–1216. 10.1126/science.1204820

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 35

  HallE. T. (1976). Beyond Culture. Garden City, NY: Anchor Books.

  • Google Scholar

• 36

  HarackiewiczJ. M.CanningE. A.TibbettsY.GiffenC. J.BlairS. S.RouseD. I.et al. (2014). Closing the social class achievement gap for first-generation students in undergraduate biology. J. Educ. Psychol.106:375. 10.1037/a0034679

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 37

  HengT. T. (2017). Voices of Chinese international students in USA colleges:‘I want to tell them that….'Stud. High. Educ.42, 833–850. 10.1080/03075079.2017.1293873

  • CrossRef
  • Google Scholar

• 38

  HernandezP. R.SchultzP.EstradaM.WoodcockA.ChanceR. C. (2013). Sustaining optimal motivation: a longitudinal analysis of interventions to broaden participation of underrepresented students in STEM. J. Educ. Psychol.105:89. 10.1037/a0029691

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 39

  HoltE. A.OgdenT. H.DurhamS. L. (2018). The positive effect of role models in evolution instruction. Evol. Educ. Outreach11:11. 10.1186/s12052-018-0086-6

  • CrossRef
  • Google Scholar

• 40

  HughesB. E. (2018). Coming out in STEM: Factors affecting retention of sexual minority STEM students. Sci. Adv.4:eaao6373. 10.1126/sciadv.aao6373

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 41

  JacobyB.GarlandJ. (2004). Strategies for enhancing commuter student success. J. College Stud. Retent. Res. Theory Practice6, 61–79. 10.2190/567C-5TME-Q8F4-8FRG

  • CrossRef
  • Google Scholar

• 42

  JenoL. M.RaaheimA.KristensenS. M.KristensenK. D.HoleT. N.HauglandM. J.et al. (2017). The relative effect of team-based learning on motivation and learning: a self-determination theory perspective. CBE Life Sci. Educ.16:ar59. 10.1187/cbe.17-03-0055

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 43

  JohnsonD. R. (2012). Campus racial climate perceptions and overall sense of belonging among racially diverse women in STEM majors. J. Coll. Stud. Dev.53, 336–346. 10.1353/csd.2012.0028

  • CrossRef
  • Google Scholar

• 44

  KimY. K.SaxL. J. (2009a). Student–faculty interaction in research universities: differences by student gender, race, social class, and first-generation status. Res. High. Educ.50, 437–459. 10.1007/s11162-009-9127-x

  • CrossRef
  • Google Scholar

• 45

  KimY. K.SaxL. J. (2009b). Student – faculty interaction in research universities : and first-generation status. Res. High. Educ.50, 437–459.

  • Google Scholar

• 46

  KuhnP.VillevalM. C. (2015). Are women more attracted to co-operation than men?Econom. J.125, 115–140. 10.1111/ecoj.12122

  • CrossRef
  • Google Scholar

• 47

  KuhnP. J.VillevalM. C. (2011). Do Women Prefer a Co-Operative Work Environment? GATE Working Paper No. 1127. Available online at https://ssrn.com/abstract=1946160

  • Google Scholar

• 48

  LefcheckJ. S. (2016). piecewiseSEM: piecewise structural equation modelling in r for ecology, evolution, and systematics. Methods Ecol. Evol.7, 573–579. 10.1111/2041-210X.12512

  • CrossRef
  • Google Scholar

• 49

  LewisK. L.StoutJ. G.PollockS. J.FinkelsteinN. D.ItoT. A. (2016). Fitting in or opting out: a review of key social-psychological factors influencing a sense of belonging for women in physics. Phys. Rev. Phys. Educ. Res.12:20110. 10.1103/PhysRevPhysEducRes.12.020110

  • CrossRef
  • Google Scholar

• 50

  MatonK. I.PollardS. A.McDougall WeiseT. V.HrabowskiF. A. (2012). Meyerhoff scholars program: a strengths-based, institution-wide approach to increasing diversity in science, technology, engineering, and mathematics. Mount Sinai J. Med.79, 610–623. 10.1002/msj.21341

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 51

  McAdamsD. P.McLeanK. C. (2013). Narrative identity. Curr. Dir. Psychol. Sci.22, 233–238. 10.1177/0963721413475622

  • CrossRef
  • Google Scholar

• 52

  McCrightA. M.DunlapR. E. (2011). Cool dudes: The denial of climate change among conservative white males in the United States. Global Environ. Change21, 1163–1172. 10.1016/j.gloenvcha.2011.06.003

  • CrossRef
  • Google Scholar

• 53

  McCroskeyJ. C. (2009). Communication apprehension: what have we learned in the last four decades. Hum. Commun.12, 157–171.

  • Google Scholar

• 54

  MichaelJ. (2006). Where's the evidence that active learning works?Adv. Physiol. Educ.30, 159–167. 10.1152/advan.00053.2006

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 55

  MiyakeA.Kost-SmithL. E.FinkelsteinN. D.PollockS. J.CohenG. L.ItoT. A. (2010). Reducing the gender achievement gap in college science: a classroom study of values affirmation. Science330, 1234–1237. 10.1126/science.1195996

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 56

  MorganE. M. (2013). Contemporary issues in sexual orientation and identity development in emerging adulthood. Emerging Adulthood1, 52–66. 10.1177/2167696812469187

  • CrossRef
  • Google Scholar

• 57

  NakagawaS.SchielzethH. (2013). A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods Ecol. Evol.4, 133–142. 10.1111/j.2041-210x.2012.00261.x

  • CrossRef
  • Google Scholar

• 58

  NavarroR. L.WorthingtonR. L.HartJ.KhairallahT. (2009). Liberal and conservative political ideology, experiences of harassment, and perceptions of campus climate. J. Divers. High. Educ.2, 78–90. 10.1037/a0015174

  • CrossRef
  • Google Scholar

• 59

  NeerM. R. (1990). Reducing situational anxiety and avoidance behavior associated with classroom apprehension. South. J. Commun.56, 49–61. 10.1080/10417949009372815

  • CrossRef
  • Google Scholar

• 60

  NeillC.CotnerS.DriessenM.BallenC. J. (2019). Structured learning environments are required to promote equitable participation. Chem. Educ. Res. Pract.20, 197–203. 10.1039/C8RP00169C

  • CrossRef
  • Google Scholar

• 61

  OksanenJ.BlanchetF. G.KindtR.LegendreP.MinchinP. R.O'HaraR. B.et al. (2015). Package ‘vegan.'Community Ecology Package, Version, 2.2–1.

  • Google Scholar

• 62

  OlsonS.RiordanD. G. (2012). Engage to excel: producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. Report to the President. Executive Office of the President, Washington, DC, United States.

  • Google Scholar

• 63

  PikeG. R. (2002). naspa journal the differential effects of on-and off-campus living arrangements on students' Openness to Diversity^*) the differential effects of on-and off-campus living arrangements on students' openness to. Diversity^*, NASPA J.39, 283–299. 10.2202/1949-6605.1179

  • CrossRef
  • Google Scholar

• 64

  PobinerB.BeardsleyP. M.BertkaC. M.WatsonW. A. (2018). Using human case studies to teach evolution in high school AP biology classrooms. Evol. Educ. Outreach11:3. 10.1186/s12052-018-0077-7

  • CrossRef
  • Google Scholar

• 65

  PopovV.BrinkmanD.BiemansH. J. A.MulderM.KuznetsovA.NorooziO. (2012). Multicultural student group work in higher education: an explorative case study on challenges as perceived by students. Int. J. Intercul. Relat.36, 302–317. 10.1016/j.ijintrel.2011.09.004

  • CrossRef
  • Google Scholar

• 66

  PrinceM. (2004). Does active learning work? A review of the research. J. Eng. Educ.93, 223–231. 10.1002/j.2168-9830.2004.tb00809.x

  • CrossRef
  • Google Scholar

• 67

  PryorJ. T. (2015). Out in the classroom: transgender student experiences at a large public university. J. Coll. Stud. Dev., 56, 440–455. 10.1353/csd.2015.0044

  • CrossRef
  • Google Scholar

• 68

  QuinnD. M. (2006). Concealable versus conspicuous stigmatized identities, in Stigma and Group Inequality, eds LevinS.Van LaarC. (MahWah, NJ: Psychology Press, 97–118.

  • Google Scholar

• 69

  R Development Core Team (2016). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. Available online at: http://www.R-project.org/

  • Pubmed Abstract
  • Google Scholar

• 70

  RaicheG.MagisD. (2015). nFactors, version 2.3. 3: Parallel Analysis and Non Graphical Solutions to the Cattell.

  • Google Scholar

• 71

  RaineyK.DancyM.MickelsonR.StearnsE.MollerS. (2019). A descriptive study of race and gender differences in how instructional style and perceived professor care influence decisions to major in STEM. Int. J. STEM Educ.6, 6. 10.1186/s40594-019-0159-2

  • CrossRef
  • Google Scholar

• 72

  RankinS.WeberG.GarveyJ. C. (2014). From invisibility to visibility: queer spectrum and trans-spectrum college students, in Today's College Students: A Reader, eds SassoP.JosephD. (New York, NY: Peter Lang, 165–182.

  • Google Scholar

• 73

  RevelleW. (2016). psych: Procedures for Psychological, Psychometric, and Personality Research [Software]. Available online at: http://personality-project.org/r/psych_manual.pdf

  • Google Scholar

• 74

  RichardsonM.AbrahamC.BondR. (2012). Psychological correlates of university students' academic performance: a systematic review and meta-analysis. Psychol. Bull.138, 353–387. 10.1037/a0026838

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 75

  RiosK.ChengZ. H.TottonR. R.ShariffA. F. (2015). Negative stereotypes cause Christians to underperform in and disidentify with science. Soc. Psychol. Personal. Sci.6, 959–967. 10.1177/1948550615598378

  • CrossRef
  • Google Scholar

• 76

  RoccaK. A. (2010). Student participation in the college classroom: an extended multidisciplinary literature review. Commun. Educ.59, 185–213. 10.1080/03634520903505936

  • CrossRef
  • Google Scholar

• 77

  RStudio Team (2015). RStudio: Integrated Development for R. Boston, MA: RStudio, Inc. Available online at: http://www.rstudio.com/

  • Google Scholar

• 78

  SchinskeJ. N.PerkinsH.SnyderA.WyerM. (2016). Scientist spotlight homework assignments shift students' stereotypes of scientists and enhance science identity in a diverse introductory science class. CBE Life Sci. Educ.15:ar47. 10.1187/cbe.16-01-0002

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 79

  SchmittM. T.SpearsR.BranscombeN. R. (2003). Constructing a minority group identity out of shared rejection: the case of international students. Eur. J. Soc. Psychol.33, 1–12. 10.1002/ejsp.131

  • CrossRef
  • Google Scholar

• 80

  ShipleyB. (2009). Confirmatory path analysis in a generalized multilevel context. Ecology90, 363–368. 10.1890/08-1034.1

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 81

  ShipleyB. (2013). The AIC model selection method applied to path analytic models compared using ad-separation test. Ecology94, 560–564. 10.1890/12-0976.1

  • CrossRef
  • Google Scholar

• 82

  SingerJ. A. (2004). Narrative identity and meaning making across the adult lifespan: an introduction. J. Pers.72, 437–460. 10.1111/j.0022-3506.2004.00268.x

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 83

  SmartL.WegnerD. M. (1999). Covering up what can't be seen: concealable stigma and mental control. J. Pers. Soc. Psychol.77:474. 10.1037/0022-3514.77.3.474

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 84

  SnyderJ. J.SloaneJ. D.DunkR. D. P.WilesJ. R. (2016). Peer-led team learning helps minority students succeed. PLoS Biol.14:e1002398. 10.1371/journal.pbio.1002398

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 85

  SoriaK. M.StebletonM. J. (2012). First-generation students' academic engagement and retention. Teach. High. Educ.17, 673–685. 10.1080/13562517.2012.666735

  • CrossRef
  • Google Scholar

• 86

  StebletonM.SoriaK. (2013). Breaking Down Barriers: Academic Obstacles of First-Generation Students at Research Universities. The Learning Assistance Review. University of Minnesota Digital Conservancy. Available online at: http://hdl.handle.net/11299/150031

  • Google Scholar

• 87

  SullivanL. L.BallenC. J.CotnerS. (2018). Small group gender ratios impact biology class performance and peer evaluations. PLoS ONE13:e0195129. 10.1371/journal.pone.0195129

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 88

  TanE.BartonA. C. (2008). Unpacking science for all through the lens of identities-in-practice: the stories of Amelia and Ginny. Cult. Stud. Sci. Educ.3, 43–71. 10.1007/s11422-007-9076-7

  • CrossRef
  • Google Scholar

• 89

  ThomasE.JackK.VickyM.RichardS. M.TerryP. (2008). Pedagogies of engagement in science: a comparison of PBL, POGIL, and PLTL. Biochem. Mol. Biol. Educ.36, 262–273. 10.1002/bmb.20204

  • CrossRef
  • Google Scholar

• 90

  ThompsonG. L. (2004). Through Ebony Eyes: What Teachers Need to Know but Are Afraid to Ask About African-American Students.San Francisco, CA: Jossey-Bass.

  • Google Scholar

• 91

  TibbettsY.HarackiewiczJ. M.CanningE. A.BostonJ. S.PriniskiS. J.HydeJ. S. (2016). Affirming independence: exploring mechanisms underlying a values affirmation intervention for first-generation students. J. Pers. Soc. Psychol.110, 635–639. 10.1037/pspa0000049

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 92

  University of Minnesota Office of Institutional Research (2019). Official Enrollment Statistics. Available online at: https://www.oir.umn.edu/student/enrollment/ (accessed June 30, 2019).

  • Pubmed Abstract
  • Google Scholar

• 93

  VandrickS. (1997). The role of hidden identities in the postsecondary ESL classroom. Tesol Quart.31, 153–157. 10.2307/3587980

  • CrossRef
  • Google Scholar

• 94

  VygotskyL. S. (1963). Learning and mental development at school age. Educ. Psychol. USSR1, 21–34.

  • Google Scholar

• 95

  WalkerJ. D.WassenbergD.FrantaG.CotnerS. (2017). What Determines student acceptance of politically controversial scientific conclusions?J. Coll. Sci. Teach.47, 46–56. 10.2505/4/jcst17_047_02_46

  • CrossRef
  • Google Scholar

• 96

  WatermanA. S. (1999). Identity, the identity statuses, and identity status development: a contemporary statement. Dev. Rev. 19, 591–621. 10.1006/drev.1999.0493

  • CrossRef
  • Google Scholar

• 97

  WeaverR. R.QiJ. (2005). Classroom organization and participation: college students' perceptions. J. Higher Educ.76, 570–601. 10.1353/jhe.2005.0038

  • CrossRef
  • Google Scholar

• 98

  WilsonZ. S.HolmesL.SylvainM. R.BatisteL.JohnsonM.McGuireS. Y.et al. (2012). Hierarchical mentoring: a transformative strategy for improving diversity and retention in undergraduate STEM disciplines. J. Sci. Educ. Technol.21, 148–156. 10.1007/s10956-011-9292-5

  • CrossRef
  • Google Scholar

• 99

  YeagerD. S.WaltonG. M.BradyS. T.AkcinarE. N.PauneskuD.KeaneL.et al. (2016). Teaching a lay theory before college narrows achievement gaps at scale. Proc. Natl. Acad. Sci. U.S.A. 201524360. 10.1073/pnas.1524360113

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 100

  ZhangQ.ZhangJ. (2005). Teacher clarity: effects on classroom communication apprehension, student motivation, and learning in Chinese college classrooms. J. Int. Commun. Res.34, 255–266.

  • Google Scholar