Inclusive Instructional Practices: Course Design, Implementation, and Discourse

As national efforts strive to make STEM more inclusive, it is important to identify instructional practices that maximize effective learning for all and provide students from different demographic and educational backgrounds equal opportunities to excel. Here, we present a guideline for inclusive instructional practices based on findings from 1) cognitive psychology about learning and memory, 2) social psychology about creating inclusive discourse, and 3) discipline-based education research (DBER) about effective learning practices in STEM higher education. Our aim is to promote equity across STEM education by providing researchers and instructors across different STEM fields with concrete suggestions for implementing inclusive instructional practices in their courses.


INTRODUCTION
Testing the effectiveness of instructional practices in undergraduate STEM requires empirical assessments across multiple disciplinary and institutional contexts (C. A. Brewer and Smith, 2011;National Academies of Sciences and Medicine, E, 2016). Investigations into student outcomes include comparisons of performance measures such as exam scores, final grades, concept inventory scores, student behaviors, or affective factors (e.g., the extent to which students identify as scientists) (see National Research Council, 2012 for overview of different measures used in DBER research). Over one hundred studies have examined the impacts of evidencebased learner-centered pedagogy, also referred to as active learning, on measures of aggregated class performance outcomes (Freeman et al., 2014). However, of these studies, few focused on the effects of active learning pedagogies on underrepresented students in STEM specifically, or have considered the reduction or closure of performance gaps as stand-alone measures worthy of explicit focus (e.g., Haak et al., 2011;Ballen et al., 2017;Casper et al., 2019;Theobald EJ. et al., 2020). Under-represented groups in STEM are those whose representation in STEM fields is smaller than their actual representation in the society (e.g., African-Americans constitute 13% of US population but they earned only up to 8% of STEM B.S. degrees in the last 20 years (Rivers, 2017)). Studies that explicitly tracked the performance of under-represented students showed that across different STEM disciplines, active learning pedagogies had a disproportionate positive impact on their performance (Theobald EJ. et al., 2020). However, these studies were still limited in number and context. Therefore, as one of the next frontiers of STEM education, it is incumbent upon the STEM education community to examine and identify inclusive instructional practices in order to support national efforts to promote and retain those historically underrepresented in STEM. We consider inclusive instructional practices as a collection of historically-, socially-, cognitively-, and culturally-sensitive instructional practices implemented in classrooms in order to create equitable learning opportunities for students from different demographic and educational backgrounds. For example, for designing historically-sensitive instructional practices in the United States, one ought to consider the fact that a number of demographic groups were deprived of educational resources over several generations. These historical injustices led to current circumstances in which some demographics are more likely to live in neighborhoods and to attend K-12 schools which are under-resourced, leading to lower academic preparation as students enter higher education (Chetty and Hendren, 2018;Fahle et al., 2020).
We provide a guide for inclusive instructional practices using theoretical and empirical findings from diverse fields. Specifically, we draw from cognitive psychology to discuss learning and memory; social psychology to inform our thinking on creating inclusive discourse; and discipline-based education research to apply effective instructional practices in higher education STEM. There are theoretical reasons for believing the efficacy of these previous findings would be transferrable across different STEM fields, even when empirical studies are limited. We have organized this inclusive teaching practices guide around three major aspects of a STEM course: design, implementation, and classroom discourse. The individual practices fall largely into two groups, as we have labelled: 1) General Category [GC]: generally effective teaching practices which have been shown to benefit all students including underrepresented students; and 2) Targeted Category [TC]: effective teaching practices which particularly benefit underrepresented students by addressing specific aspects that serve as barriers to academic success that are unique to underrepresented students (Schwartz et al., 2016). Targeted practices do not benefit underrepresented students by hindering the performance of over-represented students (Powers et al., 2016), but rather, the extent of their positive effects is larger for underrepresented students, as they target the barriers that are more pronounced for these students. Both categories of inclusive instructional practices are required to create an equitable learning environment which helps students from different backgrounds to thrive, and some practices may span both categories.

GUIDELINE FOR INCLUSIVE INSTRUCTIONAL PRACTICES
(1) Course Design: Have all students understand what they need to do to succeed, regardless of their background. The absence of this information in course materials rewards students who are aware of the "hidden curriculum," who are better prepared for college courses, and are more familiar with the culture, expectations, and assessment methods of higher education (Anyon, 1980;Margolis, 2001;Smith, 2013;Basyiruddin, 2020). For example, effective study habits, which encompass the strategies students use to learn, understand, and retain course content, can be underdeveloped among incoming STEM students (Blasiman et al., 2017). Students (and instructors) commonly rely on ineffective study strategies aimed at short-term goals, such as passing an exam, rather than meaningful understanding of the material (Kornell and Bjork, 2007). Clarifying how to study effectively and actively will encourage success for all students, rather than those who entered the course with existing knowledge of the material or advanced study habit strategies.
Have all students understand different components of their course grade, their weights, and how the final course grade is calculated to ensure grades are providing meaningful and effective feedback to students (Quinn, 2013;Feldman, 2018). Lack of a clear grading scheme makes it challenging for students to use the grade they receive in each component of the course as a measure of their learning, and to prioritize investment on learning different aspects of the course. For example, curving grades without clarifying the scheme renders the scores uninterpretable to students, particularly those less familiar with the curving practice. This practice discourages these students as they underestimate their performance in the course (Seymour and Hunter, 2019).
Have all students recognize the resources available to them, and how they can best use each of these resources. Without clearly enumerating all the available resources and how students can use them, resources will be utilized by students who are more aware of the university environment and better prepared for college courses, particularly STEM courses (Cotten and Wilson, 2006). For example, students from different backgrounds have different ideas as to what is meant by "instructor office hours", and how they can benefit from them. For students who did not have office hours in their precollege education may perceive instructor office hours as a place for them to demonstrate what they have already learned, as opposed to a place for instructors to provide additional individual help with what they have not already learned (Jack, 2019).

• [GC] Provide supplementary materials and instructions that
will support students with gaps in their preparation, as well as tools to allow students and instructors to identify such gaps. Communicate in advance when students should seek out and use these resources (Rath et al., 2007). Many STEM courses are based on pre-requisite foundational knowledge. For introductory courses, this knowledge should be provided in high school courses. However, significant gaps in the quality and quantity of high school courses equate to gaps in foundational knowledge (Reardon et al., 2019). Previous work shows gaps in incoming preparation is the main reason for demographic performance gaps in introductory STEM courses (Salehi et al., 2019;Salehi et al., 2020). Without providing supplementary materials to address these gaps in preparation, the STEM courses tend to target the well-prepared students and discriminate against students who came from under-resourced schools with regard to STEM education (Seymour and Hunter, 2019).  (Fullilove and Treisman, 1990;Batz et al., 2015); 2) dedicate one of the instructor office hours or TA sections to less prepared students; 3) offer an explicit list of external resources (e.g., free online educational videos) that cover course pre-requisites. In providing these resources, one should be mindful of efficiency of supplemental materials in order to balance between inside-and outside-class workload. Many of the students without proper incoming preparation are from less-privileged backgrounds and may work a paid job to cover the cost of their education and/or support their family. This makes their time outside classroom more limited. • [GC] Design instruction based on the "deliberate practice" approach. As Ericsson et al. (1993) showed in different contexts, acquiring expertise requires: 1) decomposing expertise into subskills, acknowledging that some subskills must be mastered before learning other ones; 2) designing learning activities that directly address each of those subskills through practice; 3) engaging learners in those activities; 4) providing specific, timely, nonthreatening, and actionable feedback about learner's performance; 5) allowing the learner to repeat the activity using the feedback to improve that subskill. To design the course based on deliberate practice approach in STEM courses, the instructor can: ○ Clarify and decompose the learning goals to the point that corresponding learning activities directly address each goal. Identify more challenging learning goals and dedicate more resources to them. ■ Note: this is particularly an important activity for the instructor to engage in as they prepare their course materials, as it helps them overcome their "expert blind spots" of difficult topics that they may overlook. ○ Provide students with frequent practice and feedback opportunities. Design learning activities that the individual can engage in between lecture sessions to practice those learning goals (Wood et al., 1994;Willoughby et al., 2000;Preszler et al., 2007;Thomas and McDaniel, 2007;Dunlosky et al., 2013). Without the opportunity to repeat and improve, less prepared students will struggle compared to those who have received more academic preparation. • [GC] Explicitly align learning activities that students complete in class with their formal assessments. Consequential, high-stakes exams are not the time to test more complex questions than what students have been exposed to in class, though research has never explored the extent to which instructors assess this way (Morris et al., 1977;McDaniel et al., 1978;Ericsson et al., 1993;Morgan et al., 2007;Thomas and McDaniel, 2007;Wormald et al., 2009;Jensen et al., 2014). Alignment will provide students with different levels of academic preparation more equal opportunity to study effectively and perform well on tests. The mismatch between cognitive difficulty of the assessments and learning activities students engage in during the course (e.g., homework) mean students have to "read the instructor's mind" to prepare for exams. Underprepared students are at a disadvantage if assessed this way, particularly as they may often come from different backgrounds and cultures than the instructor. If the course learning activities match the course assessments, then student investment in these activities will help their performance on the assessments. The mismatch, on the other hand, leads to performance on assessments that is more reflective of students' prior preparation (and/or creative use of resources to which select students have access) than of knowledge and mastery of material from class.
(2) Course Implementation: Check that all students clearly see how each learning activity maps to a specific learning goal that defines in operational terms what they should be able to do. This will benefit students by providing a roadmap for monitoring their own learning and understanding which resources to use to address challenging material. • [GC] Include frequent low stakes formative assessments/ quizzes that give students (and the instructor) feedback about student learning. Feedback is essential for students to improve their learning and for instructors to adapt their teaching. Using various formative assessment methods during class, such as polling tools or worksheets, provides frequent feedback to students and instructors about how well students are understanding the topics covered in lecture sessions. • [TC] After communicating the course syllabus and roadmaps to success in the course, survey the students for the challenges they expect to encounter in the course, and work with them on finding support and/or accommodations where suitable (Meaders et al., 2020). • [TC] Actively reach out to students who indicate performance struggles and explore how you can help them. • [GC and TC] Encourage supportive and educationally productive group work in class. Set norms for interactions during group work to avoid dominance of individuals, and ensure every student is comfortable contributing. Group work benefits students' learning if done properly; if not deliberately structured, it can be unpleasant for some students and generally ineffective.
To encourage successful group work: ○ Create well-defined activities for groups that include both individually-completed and group-completed components. ○ Randomly assign tasks to ensure the rotation of roles in groups such as who reports back from each group or who records notes. Although "cold calling" on individuals to answer questions about the work has been shown to be more equitable and improve performance of at-risk groups, it can be stressful on individuals (Dallimore et al., 2013;Cooper et al., 2018). This can be reduced by calling on individuals to present "what your group thinks", rather than their individual answer. ○ Intervene if individuals are dominating the group interactions or interrupting others, or if some members are excluded from the group discussions. ○ Provide students with an opportunity to think individually before group activities or answering in-class polls (Rowe, 1969;Nicol and Boyle, 2003;Nielsen et al., 2012). • [TC] Consider the cost of learning technologies and resources required for your course and try to minimize and/or provide support for the cost as much as possible. For example: 1) choose a free desktop or mobile application or website (e.g., Poll Everywhere) for formative assessments instead of clickers, which cost money; 2) If any component of the course (e.g., textbook or assignment platforms) costs money, explore potential resources for students who need help to cover the costs and explicitly list those resources in the course syllabus.
(3) Class Discourse: • [TC] Avoid language and examples that imply a particular group of students is the main audience of your course. For example, an instructor who apologizes for the price of the expensive textbook required for the class, but then encourages students to "just have your parents pay for it," is problematic for many reasons. Some students are paying for their own education, and many others are generally concerned about their finances (Harrison and Tanner 2018). In this example, the instructor's language is excluding those students and subtly communicating that their financial situation is of no concern to them. Spend time reflecting on the diverse backgrounds and experiences of your students and acknowledge this diversity in the class discourse. • [TC] Emphasize the importance of an inclusive learning environment and the roles of the teaching team and students: ○ List expectations of how students should treat one another in class in order to foster an inclusive environment and encourage students to review and modify the expectations. ○ Call out unacceptable comments or behavior (see microaggressions below). ○ Be open to learn from your students about your implicit biases and/or exclusive behaviors by providing them the platform to give feedback. • [GC and TC] Work to encourage a growth mindset (Claro et al., 2016;Yeager et al., 2016). Avoid references to "talent", stress the overriding importance of focused effort to achieve mastery, and emphasize that this applies to everyone (Lin-Siegler et al., 2016). Beware the common conflation of "talented" with "privileged" and therefore educationally better prepared. ○ Share your own personal challenges in mastering a topic, methods you found to overcome them, and general challenges and strategies to learn. This will emphasize expertise in STEM topics is not the product of inherent talent or intelligence, but rather the product of repeated and deliberate practice. ○ [TC] Communicate your belief in students' capability to learn and succeed. Previous studies have shown this disproportionately benefits underrepresented students (Cohen et al., 1999). ○ Emphasize hard work over innate ability (Aronson et al., 2002;Good et al., 2012), but also be sensitive to needs for the right kind of hard work. Remember that less prepared students may not know how to study effectively, and everyone benefits from explicit guidance. ○ Emphasize errors as natural and instructional (Bell and Kozlowski, 2008). Explain not just the correct answers but the reasons why an answer is wrong and how to fix it, along with what can be learned from the wrong answer. Provide students with opportunities to "redo" so that in the process they learn from their errors and can improve their grades. • [TC] Emphasize the responsibility of the instructor as a facilitator of students' growth and learning. Students are in class to learn new skills, not to show off previous skills (Canning et al., 2019). • Be vigilant and willing to intervene in response to microaggressions aimed at a student (Harrison and Tanner 2018). Microaggressions are brief, sometimes subtle comments that put down others based on their perceived personal characteristics, such as gender, sexual orientation, or underrepresented status (Sue, 2010). • Discourage students from contributing "questions" that are actually just attempts to show off, not actual questions on the course material. Instructors who reward this behavior likely discourage students who have meaningful questions from asking them, and may make students feel like they are inferior and do not belong; which is a consequence of the "question that is not a question".

FUTURE DIRECTIONS IN INCLUSIVE STEM EDUCATION
We hope the guideline presented here contributes to improving equitable STEM education by providing researchers and instructors with concrete actions for improving the inclusivity of their courses. While this guideline is not a comprehensive literature review, we offer practical suggestions based on previous works to promote inclusive instructional practices. We acknowledge that there remain many detailed research questions still to be explored. While previous research has shown active learning disproportionately benefits underrepresented students, future work will explore what particular components of active learning courses benefit underrepresented students, features define successful implementation, and through what mechanisms are these effective-and for whom? Addressing these research objectives requires better measures of incoming student preparation, and better measures of learning within a class. These are critical factors that currently serve as limitations to research, if the objective is to measure learning in response to different instructional practices over the course of a semester. While obtaining accurate measures of preparation and Frontiers in Education | www.frontiersin.org October 2021 | Volume 6 | Article 602639 knowledge is challenging, researchers can use multiple measures of content-specific assessments and concept inventories that are tailored to specific classrooms (Salehi et al., 2019). A second important advance needed in education research is to collect and analyze data that go deeper than simply the overall class level; to examine the dependencies across different demographic groups (e.g., Ballen, Salehi et al., 2017;Casper et al., 2019). For example, if the outcome of an instructional practice results in the relative underperformance of a group on the basis of, for example, gender or race/ethnicity, we should question the inclusiveness of the practice rather than question the capacity of the students. Third, instead of relying on broad descriptions such as "active learning" or "flipped classroom", researchers should report the instructional practices used in their study in much more detail, and with precision, including the details of implementation (Driessen et al., 2020). Detailed descriptions will power robust metareviews of active learning components that are inclusive. Fourth, there is a need to better understand the contextual factors that influence inclusiveness of instructional practices by testing them across disciplinary and institutional contexts (Kanim and Cid, 2020;Thompson et al., 2020). To achieve this requires expanding the pool of research subjects beyond students at selective, research-intensive universities, which have dominated contemporary DBER studies.

DATA AVAILABILITY STATEMENT
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

AUTHOR CONTRIBUTIONS
SS had written the first draft and other co-authors equally contributes to revising the draft.