Qian Guo
Young-Suk Kim
Yan Liu3
Wenkai Sun- 1Department of Foreign Languages and Literatures, Tsinghua University, Beijing, China
- 2School of Education, University of California, Irvine, Irvine, CA, United States
- 3Language Centre, Tsinghua University, Beijing, China
- 4School of Economics, Renmin University of China, Beijing, China
Background: There are over 14 million migrant children in the compulsory education system in China and the number has been increasing rapidly. However, the quality of education in schools for migrant children is often poor. Meanwhile, numerous studies indicated the importance of reading skills developed by the end of third grade. Few studies, however, have investigated the early reading development of migrant children in migrant schools in China. In the current study, we examined, with a randomized control trial design, the effects of reading strategy instruction via teacher professional development for migrant children in migrant schools.
Method: A total of 1,679 students from 47 third-grade classes in 13 migrant schools for migrant children in Beijing, China, participated in the study. The intervention was composed of teacher professional development on reading strategy. Students in both treatment and control conditions received books for independent reading.
Results: The program resulted in a higher overall reading performance for students in the treatment classes than those in the control classes, with the difference larger in inferential comprehension and for students who did not live in Beijing before starting elementary school (which we speculate captures the degree of family mobility and the rural–urban gap in the access to educational resources).
Conclusion: The results suggest that a reading strategy instruction via teacher professional development may promote the reading development of migrant children in migrant schools in China.
Implications for practice
What is already known about this topic
• Increasing access to books has mixed effects on children’s reading skills.
• Employing appropriate reading strategies during reading is important.
What this paper adds
• Instruction on reading strategies in addition to access to books results in positive impact on Grade 3 migrant students in China.
• Effects are particularly pronounced on higher-order reading comprehension.
Implications for theory, policy or practice
• In addition to increasing access to books, teach students reading strategies.
• This might be particularly important for students from disadvantaged and marginalized backgrounds.
Introduction
Reading skill development in early elementary grades is of vital importance. Reading lays a foundation for learning content areas such as mathematics, science, and social studies. It is, therefore, closely linked to academic success and thus to life success, given the essentiality of a college degree in the current society (Lesaux et al., 2010; Hernandez, 2011; National Center for Education Statistics, 2011; Sparks et al., 2014). A few studies have emphasized the importance of reading at grade level by third grade. Students below grade level in third grade are more likely to experience learning difficulties and behavioral problems at school and have lower probabilities of graduating from high school and attending college than their more capable peers (Lesaux et al., 2010; Lesnick et al., 2010). This is likely due to the transition from learning to read by the end of third grade to reading to learn from the beginning of fourth grade. The demands for comprehending the written material substantially increase in upper elementary grades, making it more difficult for struggling readers to succeed at school (Annie E. Casey Foundation, 2010). It may explain why remedial programs for struggling readers are more successful if implemented before third grade (e.g., Foorman et al., 2003; Annie E. Casey Foundation, 2010; Sparks et al., 2014) and it is critical to support language and reading development in primary grades.
Despite the significance of early reading development, reading resources tend to be inadequate in developing countries, or at least for children in certain regions of these countries. Take China as an example. Studies found that, while about two-thirds of the families in large cities bought about 10 children’s books each year and children in cities, on average, read over 10 books each year (Li, 2016), only about 30–40% of the families in rural China had 10 or more children’s books at home and less than 1% had 25 or more (Gao et al., 2018; Yi et al., 2019; Wang N. et al., 2020). What makes the matter even worse is that children in remote rural areas in China have little access to public libraries and bookstores, which further restricts their reading resources (Wang H. et al., 2020; Wei, 2021). In fact, three-fourths of the rural children surveyed in a study listed “limited reading resources” as a barrier to independent reading. In contrast, only about one-third of the urban children made the same claim (Wei, 2021). Not surprisingly, children in rural areas have been found to be low in reading achievement. Researchers assessed rural primary school fourth-graders/rising fifth-graders with items from the Progress in International Reading Literacy Study (PIRLS) test and found that rural primary schoolers on average scored lower than the PIRLS participants from all 44 countries and regions (Wang N. et al., 2020; Gao et al., 2021, 2022).
These previous studies in China are predicated on the hypothesis that reading volume or quantity is important to students’ reading skills because reading experience provides an opportunity to practice reading (e.g., decoding) and helps gain world and content knowledge, both of which are essential for reading skills. However, studies examining the effects of increasing reading experience and opportunity have produced mixed results (see Allington and McGill-Franzen, 2021 for a review). For instance, programs that provided both reading materials and teacher professional development in reading instruction produced positive effects on students’ reading achievement in the Philippines and Rwanda (Abeberese et al., 2014; Friedlander et al., 2019). Similarly, a summer reading program conducted in the United States improved students’ performance on the year-end state reading test, although not their performance on the reading assessments administered in the fall semester immediately after the summer vacation (Stein, 2017). Yet another program implemented in the United States exerted no overall effect, but a more nuanced analysis indicated that it produced positive effects for high-poverty schools and negative effects for moderate-poverty schools (White et al., 2014). A meta-analysis of 67 studies conducted in low- and middle-income countries indicates an overall positive effect of explicit and systematic literacy interventions, including increased access to reading materials, on reading skill development (Kim et al., 2020).
Reading intervention programs implemented in China have also delivered mixed results. For example, Gao et al. (2018), using a matching method, found that a program combining an in-class library with high-quality teacher training (“focus[ing] on instructing students on how to read independently”) improved not only students’ reading skills (measured with reading items adopted from PIRLS and translated into Chinese) but also their mathematics and Chinese language arts test scores (assessed with standardized mathematics and Chinese language arts tests developed by the researchers with assistance from local educators); in contrast, a program that provided only books and a program that combined an in-class library with low-quality teacher training (“focus[ing] primarily on how to instruct Chinese language classes in the manner mandated by the national curriculum”) exerted no effects (p. 114). Using a randomized control trial, Yi et al. (2019) found that an in-class library program had no effect on students’ reading or academic achievement, but it improved their reading habits and their attitudes toward reading though decreasing their reading confidence. Also employing a randomized control trial, Guo et al. (2021) found that providing free books for summer reading improved students’ word reading performance and summer reading amount but not their reading comprehension performance. The program was particularly beneficial to low-performing students and students who had parents with limited education.
Intervention programs targeted at socioeconomically disadvantaged children in China have mostly been implemented in rural areas; very few are intended for migrant children, i.e., children who moved to cities from rural areas along with their parents. There are more than 14 million migrant children in the compulsory education system in China, with the number increasing every year (Ministry of Education of the People’s Republic of China, 2018, 2019, 2020, 2021). It is difficult for these children to enter local public schools because of the unique household registration (hukou) system in China; many of them can only go to private schools specifically for migrant children (i.e., “migrant schools”). Migrant schools in China in general are characterized by poor educational resources and inferior teaching quality, many staffed with “under-qualified and unmotivated teachers with high job turnover” (Lai et al., 2015, p. 36). As a result, children in these schools do not perform as well as local children, migrant children in urban public schools, or even children in rural public schools (Chen and Feng, 2013; Lai et al., 2014; Afridi et al., 2015; Lv and Wang, 2017; Wang et al., 2017).
Many prior reading interventions focused on increasing students’ access to books (see above). However, although access to books is necessary, it may be insufficient for improving students’ reading skills if it is not accompanied by quality reading experiences. One of the consistent results in the field of reading is that students’ knowledge of how to read (reading strategies) is important to their reading skills (see Shanahan et al., 2010 for a review). For example, using graphic organizers and understanding text structure (e.g., characters, problems, and solution) support students’ comprehension (e.g., Kim et al., 2004; Bogaerds-Hazenberg et al., 2021). Strategies of activating background knowledge, questioning, summarizing, searching for and organization information can help reading comprehension (Guthrie et al., 2004; Guthrie and Klauda, 2014). Therefore, in the current study, we examined whether instruction on reading strategies and reading activities makes a difference over and above access to books for migrant children in China.
Extant literature suggests that the impact of reading interventions is not uniform, but instead is moderated by factors such as parental education level, prior reading performance, and urbanicity of the area where the intervention was implemented (Kim et al., 2020; Guo et al., 2021). Research has found that intervention results tend to be larger for students with lower academic performance, and lower performance has been found to be associated with biological sex, parental education, access to books, and family mobility (Zhang and Guo, 2011; Kim and Quinn, 2013; White et al., 2014; Guo et al., 2021).
Research examining differential impact has mostly focused on students’ demographic backgrounds (e.g., differential effect as a function of biological sex, parent education, prior achievement), as described in the preceding paragraph. In the present study, we extend previous studies by examining the impact of intervention on different types of reading comprehension. Reading comprehension is widely classified as shallow/literal comprehension and deep/inferential comprehension. Shallow/literal comprehension refers to recall or retrieval of explicitly presented information whereas deep/inferential comprehension refers to understanding of the text including inferring, interpreting, and evaluation information (Mullis and Martin, 2019). Not surprisingly, there are different types of items in reading comprehension tasks that are designed to tap into literal and inferential comprehension, and those are widely classified into literal, inferential, and evaluative ones. These types are aligned with the PIRLS Framework for Assessing Reading Achievement (Mullis and Martin, 2019). These represent different levels of cognitive demands placed on the reader and varying levels of interaction with the text required of the reader (Herber, 1970). For literal comprehension, a reader simply needs to recall information explicitly stated in the passage (Carnine et al., 2010). For inferential comprehension, a reader needs to infer information that is not explicitly stated in the text, including interpreting the author’s meaning, inferring meaning by relating what they have read in the text to their prior knowledge and experiences, and establishing relationships between elements in the text by “reading between the lines” and connecting information dispersed throughout the text (Vacca et al., 2009; Carnine et al., 2010; Basaraba et al., 2013; Kim and Petscher, 2021). For evaluative comprehension, a reader needs to move beyond the text and evaluate it critically (Rupley and Blair, 1983; McCormick, 1992; Basaraba et al., 2013; Mullis and Martin, 2019). Literal comprehension is indispensable as it establishes foundational understanding of the texts for higher-order comprehension such as inferential and evaluative comprehension (Basaraba et al., 2013). However, literal comprehension relies on recall while it is higher-order inferential and evaluative comprehension that are essential for deep comprehension of texts and learning. Therefore, investigation into students’ performance on different types of reading comprehension would provide more nuanced information on the impact of a reading intervention program.
Present study
Few studies examine reading skill development in early elementary grades in migrant schools of China. This omission is regrettable, in view of the ample evidence supporting the significance of reading development in the early stage. The study also addresses a theoretical gap in the literature, where much of understanding of reading development is based on languages with alphabetic writing systems (Share, 2021; but also see rapidly growing literature on reading development in Chinese). In the present study, we investigated the impact of reading intervention programs for migrant children in migrant schools using an RCT design (please see “Participants” in the Methods section for detail). Beyond the examination of the main effect of the reading intervention, we investigated whether the reading intervention had differential impacts as a function of types of reading comprehension skills and student’ demographic backgrounds.
We addressed the following research questions:
1. Do students who participate in the reading strategy instruction program have higher reading comprehension skills than their peers who do not participate in the program?
2. Does the reading strategy instruction program cause a difference between the two groups of students in reading performance on different types of comprehension?
3. Does the reading strategy instruction program benefit some subgroups of students more than others?
Method
Participants
We conducted a randomized control trial in the third-grade classes of 13 migrant schools for migrant children in Beijing, China. A total of 1,679 students from 47 classes participated in the study. Within each of the migrant schools, the rising third-grade classes were randomly assigned (i.e., the participants were randomly assigned in clusters at the class level) to either the treatment group or the control group, with the Chinese language arts teachers of the treatment classes receiving training in reading instruction. Altogether, 931 students in 27 classes were assigned to the treatment group, and 748 students in the other 20 classes served as the control, all with parental consent. A total of 23 teachers in the treatment condition received training. Four teachers each taught two treatment classes, and five other teachers each taught a control class as well as a treatment class. We reiterated the importance of keeping the control classes unaffected by the program for an unbiased estimate of the program impact, and the five teacher trainees did not instruct the control classes how to read the two books. However, given that five teachers taught classes across treatment conditions, potential spillover effect was examined (see the Results section).
Intervention
The intervention focused on reading comprehension strategies that students can use during reading (see the literature review above). The teachers in the treatment condition received two sessions of teacher professional development that lasted about 2 h per session, once in the fall semester and once in the spring semester. The training was conducted by a teacher with years of teaching experiences in a public elementary school in Beijing. She had directed or participated in various projects that promoted the thematic approach or the whole book approach to reading instruction. The trainer informed teachers of the importance of independent reading to reading skill development and academic success. Then she introduced comprehension strategies that young readers could apply in independent reading (e.g., guessing what the book is about on the basis of information such as the book title, checking to see whether one’s guesses are right or wrong, slowing down and re-reading if necessary when the text becomes difficult, stopping from time to time to think what one is reading, using context clues to understand what one is reading, finding relationships among ideas in the text, and integrating what one knows with what one is reading for a better understanding). After that, she provided, for each book to be used, a list of recommended activities that teachers could employ to encourage independent reading after class, applying comprehension strategies (e.g., having students each create a diagram to display the plot of a story, asking students to identify the problems and the solutions in a story, giving students the beginning of stories and asking them to guess how each story will develop and then read to check whether their guesses are right). During each training session, the trainer used one of the books recommended for that semester by the Ministry of Education in China. The Ministry of Education recommends books for independent reading each semester for each grade, with a list of the books printed on a page entitled “Happy Reading (kuai le du shu ba)” in the textbook for the grade. These books, however, were usually ignored in migrant schools, because they were recommended, but not compulsory, reading. We chose books from the Ministry of Education recommendation list because these books might be perceived with authority by the principals of the migrant schools. Students in both treatment and control conditions received books for independent reading.
After the teacher training session, third-grade students in the participating schools across the treatment conditions were each provided with a copy of the book chosen for the semester. The books were Andersen’s Fairy Tales for the fall semester and Ancient Chinese Fables for the spring semester. Then teachers of the treatment condition spent two periods of the Chinese language class (a total of 70–80 min) each semseter instructing students on how to read the book. In contrast, students in the control classes received business-as-usual instruction, i.e., instruction focusing on the textbook, with no instruction on independent reading. For each unit in the textbook, the teacher would usually first go over the text with the students, analyzing the text and directing students’ attention to words, phrases, and rhetorical devices that the teacher considered important. After this, the teacher would choose tasks from a textbook companion workbook for homework assignments. Example tasks in the workbook include choosing the correct pronunciation for Chinese characters or the correct meaning for words to answering comprehension questions (typically sentence completion questions) related to the text. The control group students in this study were similar to children in the treatment group of some previous research, provided with free books but not extra instruction (e.g., Allington et al., 2010; Guo et al., 2021).
Measures
The third-grade students took a reading comprehension test and a demographic background survey toward the end of the academic year, i.e., spring semester. We would have administered a pre-test of reading comprehension at the beginning of the school year, but were not allowed to enter the schools due to the COVID-19 pandemic. The survey enabled us to examine whether the two groups of students were comparable on personal and family background characteristics.
Chinese reading comprehension
Chinese Reading comprehension was measured by an experimental task that was composed of two parts. In the first part, students read three short passages and answered multiple-choice questions, sentence completion questions (e.g., “According to the passage, Chinese people like drinking tea because ________”), and short answer questions (e.g., “Who gave the little grass help during its growth?”). This part contained 16 items, with each item worth 2–6 points (depending on the length and the difficulty of the answer needed) and a total of 48 points. The first two passages were fictional while the third one was non-fictional. The students could refer to the text when answering the questions since each text was printed on the same page as the corresponding items. In the second part, students answered multiple-choice questions and sentence completion questions related to the two books provided to all the participating students. For example, for one sentence completion item, students were asked to write down the idiom (derived from a Chinese fable story) that is similar in meaning to another fable story, with the latter presented in a picture. The second part contained six items, which were worth a total of 20 points. For this part, the students could not refer to the two books. The Cronbach’s alpha estimate for the reading comprehension test (with a total of 22 items) was 0.82.
Students’ responses were given full, partial, and no credit depending on the accuracy. For instance, the correct answer for one part of a sentence completion item is “giving a loud cry (da hou),” which can be found in the text. Students were given full credit (2 points) for this answer, but only partial credit (1 point) for an answer like “crying (jiao sheng),” which also appears in the text but is a less accurate answer. Answers completely irrelevant [e.g., “fleeing (tao zou)” received no credit]. Trained research assistants scored the responses, and they were blind to students’ treatment conditions.
The type of reading comprehension items was determined by the first two authors of this article. The first author is an expert on English as a foreign language, and the second author is an expert on reading development and instruction. The two authors discussed and classified the items in the reading comprehension task. Of the 22 items, 18 items were classified as literal (7 items), inferential (8 items), and evaluative (3 items) comprehension, respectively, totaling 20, 25, and 9 points, respectively; the other four items (all in the second part of the reading comprehension task, totaling 14 points) were classified as book recall items because they required information from the two books provided (e.g., determining which one of four fairy tales were written by Andersen, or writing down four four-word idioms originating from Chinese fable stories in response to pictures depicting the four stories).
Demographic background survey
A survey was administered to students prior to the reading comprehension test. The questionnaire asked for information about students’ date of birth, gender, paternal education, the place where they had lived before they started school, and the number of books (and in particular children’s books) at home. We included place of stay prior to elementary school as well as the factors commonly found to be associated with school performance since we suspected that this factor might also contribute to students’ early elementary school performance: it could reflect the degree of family mobility and the rural–urban gap in the access to educational resources. The questions for both number of books and number of children’s books were multiple choice questions, with several categories as the answer options, since it would have been difficult for third-graders to give the exact numbers. All questions and answer options were read in class to ensure that the students understood, and explanations were provided where necessary.
Data analytic strategy
For research question 1, we employed simple ordinary least square (OLS) regression, with the reading test score as the outcome. The key predictor was treatment status (Treated = 1). Suspecting that the treatment might impact the control classes taught by the five teacher trainees who each taught a treatment class and a control class, we also estimated the treatment effects separately for the 10 classes that they taught and the other 37 classes. For all analyses, we controlled for the school fixed effects, and clustered standard errors at the school level to account for the potential error correlation within each school.
For research question 2, we first ran OLS regression similar to that for research question 1, this time with the scores for different types of comprehension items as the outcomes. As stated earlier, the types of comprehension in this study include book recalling as well as literal, inferential, and evaluative comprehension. Then we further examined whether the intervention might have a differential impact as a function of different types of comprehension. We generated a categorical variable for the four types of comprehension (literal, inferential, evaluative, and book recalling). The key predictor was the interaction term between Treated and the categorical variable.
For research question 3 (possible heterogeneous effects as a function of demographic characteristics), we examined whether the program affected socioeconomically disadvantaged students (in terms of paternal education, number of books at home, and place of stay before starting school) differently than their peers and whether the program had different effects on male and female students. For each possible heterogeneous effect, we added, to the simple OLS regression for RQs 1 and 2, the interaction term between Treated and the corresponding variable (e.g., a dichotomous variable indicating whether one’s father had less than elementary education). Again, for all analyses, we controlled for the school fixed effects, and clustered standard errors at the school level.
Results
We examined whether the treatment and control groups were equivalent on demographic characteristics and found the two groups comparable. As can be seen from Table 1, the two groups were not statistically significantly different in student or family characteristics.
Table 1. Descriptive statistics for the treatment and the control groups.
Research question 1: Overall reading performance
The treatment group (M = 38.53, SD = 11.82) slightly outperformed the control group (M = 36.58, SD = 12.01). Regression results support the same conclusion. Students in the treatment classes, on average, scored 2.2 more points (out of 68) higher than those in the control classes, and the difference was marginally significant (p < 0.10; Column 1, Table 2). The effect size was about 0.18. The results also show that the treatment effect was smaller for the 10 classes taught by the five teacher trainees who each taught a treatment class and a control class (Column 2) than that for all classes, whereas the effect for the other 37 classes was larger, at about 2.7 points (p = 0.10; Column 3). The results suggest a possible spillover effect for the five control classes taught by the teacher trainees even though these teachers did not spend time in class instructing students how to read the books provided. Therefore, the test results for all classes provide a lower bound of the treatment effects.
Table 2. Effects of the reading instruction program on reading comprehension performance (robust standard errors in parentheses).
Research question 2: Differential effects as a function of different types of reading comprehension
On average, students in the treatment classes scored about 1 point higher on items assessing inferential comprehension, out of a total of 22 points (p < 0.05; Column 2, Table 3); and about 0.6 point higher on items measuring book recalling, out of a total of 14 points (p < 0.10; Column 4). Students in the treatment classes also outperformed the control classes on items assessing literal and evaluative comprehension, but the score differences did not reach conventional statistical significance. The effect sizes for literal, inferential, evaluative, and book recalling items were 0.11, 0.19, 0.11, and 0.20, respectively.
Table 3. Effects of the reading instruction program on students’ reading skill development for different comprehension item types (robust standard errors in parentheses).
A comparison of the differences in scores between the treatment and control groups across the comprehension item types supports the same conclusion. As can be seen from Table 4, the score differences between the two groups were larger for inferential comprehension and book recalling items than for literal comprehension items, the omitted category of items (Rows 1 and 3), though only the difference between inferential and literal comprehension items was statistically significant. The results suggest that the reading program had a significantly larger impact on inferential comprehension than on literal comprehension.
Table 4. Differential effects of the reading instruction program on different comprehension item types (robust standard errors in parentheses).
Research question 3: Heterogeneous effects as a function of demographic backgrounds
This sub-section presents the results of possible heterogeneous effects of the reading instruction program as a function of demographic backgrounds: biological sex (Panel A), parental education (father’s highest education; Panel B), lived in Beijing before starting school (Panel C), and number of books and number of children’s books at home (Panels D and E, respectively). We found that the reading program had a statistically significantly larger impact for children who did not live in Beijing before starting elementary school than for their peers (Panel C, Table 5), narrowing the achievement gap between children who lived, and those who did not live, in Beijing prior to elementary school. This was true of the students’ overall performance and of their performance on literal and inferential comprehension items. The effect sizes in the overall performance for students who did not live in Beijing prior to elementary school and those who lived in Beijing were 0.299 and 0.151, respectively, with a difference of 0.148 in the effect size for the two subgroups of students. No other differential effect of the program was detected (Panels A, B, D, and E).
Table 5. Differential effects of the reading instruction program for subgroups of students (robust standard errors in parentheses).
Discussion
With a randomized control trial, we examined the effects of a reading strategy instruction program on reading skill development for third-grade migrant children in migrant schools in Beijing, China. We randomly assigned classes to the treatment group and the control group. Each semester, the Chinese language arts teachers in the treatment classes received two-hour training in reading instruction and then spent 70–80 min in class instructing students how to read a book provided, for two consecutive semesters. In contrast, the teachers of the control classes would teach business-as-usual. Students in these classes also received the same book each semester and therefore, the only difference between the conditions was the reading strategy instruction. Overall, students in the reading strategy instruction condition performed higher than those in the business-as-usual condition. Interestingly, what drove the differences in the overall reading performance was students’ performance on inferential comprehension. In addition, the effects were significantly larger for students who did not live in Beijing prior to starting elementary school than for their peers.
The treatment group outperformed the control group in the overall reading comprehension by 0.18 standard deviation. Direct comparison of this effect size to other interventions is difficult due to differences in study populations, contexts and settings, duration, and target intervention. For example, many studies in developing countries had multi-component interventions where multiple skills were addressed (e.g., word reading, emergent literacy skills in addition to reading comprehension; see a meta-analysis by Kim et al., 2020). With this caveat in mind, the effect size of the present study is in line with previous reading comprehension interventions. For example, a 31-day reading program implemented in the Philippines, which provided both reading material and teacher training, yielded an effect size of 0.13 (Abeberese et al., 2014). A two-year intervention program implemented in rural Rwanda compared the school-only and lifewide-learning approaches to supporting early-grade learning (with the latter approach including a community component) and found an effect size of 0.21 for the former and 0.33 for the latter (Friedlander et al., 2019). Meta-analyses also produced similar results: Kim and Quinn (2013) found a mean size of 0.23 for effects of summer reading programs on reading comprehension in the United States and Canada; McEwan (2015) a mean effect size of 0.12 for teacher training in developing-country elementary schools; and Kim et al. (2020) a mean effect size of 0.25 for literacy interventions on reading comprehension in low- and middle-income countries. The program reported in this study was fairly effective considering the facts that it did not require extensive amount of teachers’ time in either training or in-class reading instruction and that the study included a rigorous comparison where students in the comparison condition received books.
It is a highly encouraging finding that the treatment classes performed significantly better than the control classes on inferential comprehension although the two groups’ performance was comparable on literal comprehension. This indicates that the treatment classes outperformed the control classes on higher-level comprehension of making inferences about meanings not explicitly stated. Inferential comprehension is generally more cognitively demanding than literal comprehension and is a more advanced comprehension (Kintsch and Rawson, 2005; Nation, 2005; Basaraba et al., 2013). The importance of inference making in successful comprehension is highlighted in theoretical models of reading comprehension (e.g., Kintsch and Rawson, 2005; Perfetti and Stafura, 2014; Kim, 2020) and associated large body of literature e.g., (see Cain and Oakhill, 2007 for a review). The larger impact on inferential comprehension by the intervention suggests that beyond support for access to book, it is important to provide reading instruction on reading strategies during independent reading. These results are in line with previous evidence that reading strategy instruction improves students’ reading comprehension skills (Shanahan et al., 2010), but also show that what drives the improvement of reading comprehension is higher-order inferential comprehension at least for third grade students from migrant families in China.
Another notable finding is that the program had a differential effect as a function of whether students live in Beijing or not before they started elementary school. Children who did not live in Beijing prior to elementary school benefited more from the intervention. These results might be because these students’ families had been more mobile than their peers’, and family mobility was negatively associated with children’s reading performance, probably because constant mobility interrupted children’s learning and forced them to keep adjusting to new environments (Zhang and Guo, 2011). Alternatively, these findings may be because these children’s place of stay had been less educationally favorable than Beijing, as children in remote rural areas tend to have very limited access to reading resources (Wei, 2021). No matter what the reason may be, these children were likely to have a lower starting point in reading. In fact, regression results indicate that living in Beijing prior to elementary schools was positively associated with reading performance (Table 2). The results are encouraging that the program narrowed the reading achievement gap between the two groups of students. This is consistent with prior findings that intervention programs tended to produce greater effects for students at a disadvantage, in terms of socioeconomic status and prior performance (Kim and Quinn, 2013; White et al., 2014; Guo et al., 2021). Future studies are needed to find the mechanism explaining the differential effects.
Another unique aspect of the study is an explicit examination of a potential spillover effect, and we found evidence of some spillover effects. The treatment effects were smaller for the classes taught by the five teacher trainees who each taught a treatment class and a control class even though they did not instruct their control classes how to read the two books provided. These teacher trainees might intentionally or unintentionally have introduced reading strategies and employed teaching activities that they had learned from the training. As a result, positive reading behaviors might have also been encouraged in the control classes that they taught. The observed spillover effect is a concern for RCTs. On the other hand, however, the results also suggest students may benefit from their teachers’ training in reading instruction even when teachers do not allot in-class time to specifically and formally focus on reading instruction.
This study has other limitations. One notable limitation is that, as stated earlier, we could not administer pre-test at the beginning of the school year because of the COVID-19 pandemic. As a result, we could compare the treatment group and the control group only on personal and family characteristics but not on reading skills before the program was implemented. Although it is not highly unusual for RCTs not to include pretests, future research could replicate this study with a pre-test component.
To our knowledge, this is one of the first studies to explore the possible effects of reading programs on the early reading development of migrant children in migrant schools in China. Reading strategy instruction made a difference in overall reading performance and, in particular, performance in inferential comprehension. The findings are encouraging for researchers and practitioners intending to foster the reading development of migrant children in migrant schools, especially migrant schools located in large cities. Explicit reading strategy instruction supported by teacher professional development in addition to access to books can be a potential way to improve the reading skills of migrant children in migrant schools, an important segment of the population in China.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
Ethical approval was not required for the study involving human participants in accordance with the local legislation and institutional requirements. The research was conducted with full cooperation from the schools involved. Written informed consent to participate in the study was provided by the participants’ legal guardians/next of kin.
Author contributions
QG obtained the grant and designed the study with the co-authors, and conducted data analysis. Y-SK made contributions to conceptualization and writing. YL, YP, WS, JY, and LY contributed to conceptualization, implementation, data collection, and analysis. All authors contributed to the article and approved the submitted version.
Funding
The work reported here was funded by the National Natural Science Foundation of China (grant 71874094) and the Tsinghua University Initiative Scientific Research Program (grant 2015THZWYY06) to QG. The authors are grateful to all the participants for their support of this study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Abeberese, A. B., Kumler, T. J., and Linden, L. L. (2014). Improving reading skills by encouraging children to read in school: a randomized evaluation of the Sa Aklat Sisikat reading program in the Philippines. J. Hum. Resour. 49, 611–633. doi: 10.3368/jhr.49.3.611
Afridi, F., Li, S. X., and Ren, Y. (2015). Social identity and inequality: the impact of China’s hukou system. J. Public Econ. 123, 17–29. doi: 10.1016/j.jpubeco.2014.12.011
Allington, R. L., and McGill-Franzen, A. M. (2021). Reading volume and reading achievement: a review of recent research. Read. Res. Q. 56, S231–S238. doi: 10.1002/rrq.404
Allington, R. L., McGill-Franzen, A., Camilli, G., Williams, L., Graff, J., Zeig, J., et al. (2010). Addressing summer reading setback among economically disadvantaged elementary students. Read Psychol. 31, 411–427. doi: 10.1080/02702711.2010.505165
Annie E. Casey Foundation (2010). Early Warning! Why Reading by the End of Third-Grade Matters: A KIDS COUNT Special Report from the Annie E. Casey Foundation. Baltimore, MD: Annie E. Casey Foundation
Basaraba, D., Yovanoff, P., Alonzo, J., and Tindal, G. (2013). Examining the structure of reading comprehension: do literal, inferential, and evaluative comprehension truly exist? Read. Writ. 26, 349–379. doi: 10.1007/s11145-012-9372-9
Bogaerds-Hazenberg, S. T. M., Evers-Vermeul, J., and van den Bergh, H. (2021). A meta-analysis on the effects of text structure instruction on reading comprehension in the upper elementary grades. Read. Res. Q. 56, 435–462. doi: 10.1002/rrq.311
Cain, K., and Oakhill, J. (Eds.) (2007). Children’s Comprehension Problems in Oral and Written Language: A Cognitive Perspective. New York, NY: Guildford Press.
Carnine, D. W., Silbert, J., Kameenui, E. J., and Tarver, S. G. (2010). Direct Instruction Reading (5th) Upper Saddle River, NJ: Merrill.
Chen, Y., and Feng, S. (2013). Access to public schools and the education of migrant children in China. China Econ. Rev. 26, 75–88. doi: 10.1016/j.chieco.2013.04.007
Foorman, B. R., Breier, J. I., and Fletcher, J. M. (2003). Interventions aimed at improving reading success: an evidence-based approach. Dev. Neuropsychol. 24, 613–639. doi: 10.1080/87565641.2003.9651913
Friedlander, E. W., Arshan, N., Zhou, S., and Goldenberg, C. (2019). Lifewide or school-only learning: approaches to addressing the developing world’s learning crisis. Am. Educ. Res. J. 56, 333–367. doi: 10.3102/0002831218792841
Gao, Q., Wang, H., Chang, F., An, Q., Yi, H., Kenny, K., et al. (2022). Feeling bad and doing bad: student confidence in reading in rural China. Compare 52, 269–288. doi: 10.1080/03057925.2020.1759027
Gao, Q., Wang, H., Chang, F., Yi, H., and Shi, Y. (2021). Reading achievement in China’s rural primary schools: a study of three provinces. Educ. Stud. 47, 344–368. doi: 10.1080/03055698.2019.1701994
Gao, Q., Wang, H., Mo, D., Shi, Y., Kenny, K., and Rozelle, S. (2018). Can reading programs improve reading skills and academic performance in rural China? China Econ. Rev. 52, 111–125. doi: 10.1016/j.chieco.2018.07.001
Guo, Q., Kim, Y.-S. G., Liu, Y., Peng, Y., Sun, W., Wang, Y., et al. (2021). The effects of a summer reading program for migrant children in migrant schools: first-year results from a randomized experiment. Asia Pac. Educ. Rev. 22, 139–154. doi: 10.1007/s12564-020-09659-5
Guthrie, J. T., and Klauda, S. L. (2014). Effects of classroom practices on reading comprehension, engagement, and motivations for adolescents. Read. Res. Q. 49, 387–416. doi: 10.1002/rrq.81
Guthrie, J. T., Wigfield, A., Barbosa, P., Perencevich, K. C., Taboada, A., Davis, M. H., et al. (2004). Increasing Reading comprehension and engagement through concept-oriented Reading instruction. J. Educ. Psychol. 96, 403–423. doi: 10.1037/0022-0663.96.3.403
Hernandez, D. J. (2011). Double Jeopardy: How Third-Grade Reading Skills and Poverty Influence High School Graduation. Baltimore, MD: The Annie E. Casey Foundation
Kim, Y.-S. G. (2020). Hierarchical and dynamic relations of language and cognitive skills to reading comprehension: testing the direct and indirect effects model of reading (DIER). J. Educ. Psychol. 112, 667–684. doi: 10.1037/edu0000407
Kim, Y.-S. G., Lee, H. S., and Zuilkowski, S. S. (2020). Impact of literacy interventions on reading skills in low- and middle-income countries: a meta-analysis. Child Dev. 91, 638–660. doi: 10.1111/cdev.13204
Kim, Y.-S. G., and Petscher, Y. (2021). Influences of person, text, and assessment factors on text/discourse comprehension in oral language (listening comprehension). Ann. Dyslexia 71, 218–237. doi: 10.1007/s11881-020-00208-8
Kim, J. S., and Quinn, D. M. (2013). The effects of summer reading on low-income children’s literacy achievement from kindergarten to grade 8: a meta-analysis of classroom and home interventions. Rev. Educ. Res. 83, 386–431. doi: 10.3102/0034654313483906
Kim, A., Vaughn, S., Wanzek, J., and Wei, S. (2004). Graphic organizers and their effects on the reading comprehension of students with LD: a synthesis of research. J. Learn. Disabil. 37, 105–118. doi: 10.1177/00222194040370020201
Kintsch, W., and Rawson, K. A. (2005). “Comprehension” in The Science of Reading: A Handbook. eds. M. J. Snowling and C. Hulme (Oxford: Blackwell), 209–226.
Lai, F., Liu, C., Luo, R., Zhang, L., Ma, L., Bai, Y., et al. (2014). The education of China’s migrant children: the missing link in China’s education system. Int. J. Educ. Dev. 37, 68–77. doi: 10.1016/j.ijedudev.2013.11.006
Lai, F., Luo, R., Zhang, L., Huang, X., and Rozelle, S. (2015). Does computer-assisted learning improve learning outcomes? Evidence from a randomized experiment in migrant schools in Beijing. Econ. Educ. Rev. 47, 34–48. doi: 10.1016/j.econedurev.2015.03.005
Lesaux, N. K., Hastings, M. E., Kelley, J. G., Marietta, S. H., and Russ, J. M. (2010). Turning the Page: Refocusing Massachusetts for Reading Success. Available at: http://www.strategiesforchildren.org/docs_research/10_TurningThePageReport.pdf
Lesnick, J., Goerge, R., Smithgall, C., and Gwynne, J. (2010). Reading on Grade Level in Third Grade: How Is It Related to High School Performance and College Enrollment? Chicago: Chapin Hall at the University of Chicago
Li, L. (2016). Shoufa: Zhongguo chengshi ertong yuedu diaocha baogao [report release: Survey Report on Children’s Reading in Urban China]. Available at: http://www.cbbr.com.cn/contents/533/8455.html
Lv, L., and Wang, F. (2017). Renkou liudong yu ertong jiaoyu: Jiben Shishi yu jieshi [migration and children’s education: facts and explanations]. Popul. Res. 41, 45–57.
McCormick, S. (1992). Disabled readers’ erroneous responses to inferential comprehension questions: description and analyses. Read. Res. Q. 27, 54–77. doi: 10.2307/747833
McEwan, P. J. (2015). Improving learning in primary schools of developing countries: a meta-analysis of randomized experiments. Rev. Educ. Res. 85, 353–394. doi: 10.3102/0034654314553127
Ministry of Education of the People’s Republic of China (2018). 2017 National Education Development Statistics Bulletin. Available at: http://www.moe.gov.cn/jyb_sjzl/sjzl_fztjgb/201807/t20180719_343508.html
Ministry of Education of the People’s Republic of China (2019). 2018 National Education Development Statistics Bulletin. Available at: http://www.moe.gov.cn/jyb_sjzl/sjzl_fztjgb/201907/t20190724_392041.html
Ministry of Education of the People’s Republic of China (2020). 2019 National Education Development Statistics Bulletin. Available at: http://www.moe.gov.cn/jyb_sjzl/sjzl_fztjgb/202005/t20200520_456751.html
Ministry of Education of the People’s Republic of China (2021). 2020 National Education Development Statistics Bulletin. Available at: http://www.moe.gov.cn/jyb_sjzl/sjzl_fztjgb/202108/t20210827_555004.html
Mullis, I. V. S., and Martin, M. O. (Eds.). (2019). PIRLS 2021 Assessment Frameworks. TIMSS & PIRLS International Study Center, lynch School of Education, Boston College and International Association for the Evaluation of educational achievement (IEA). Available at: https://pirls2021.org/wp-content/uploads/sites/2/2019/04/P21_Frameworks.pdf
Nation, K. (2005). “Children’s reading comprehension difficulties” in The Science of Reading: A Handbook. eds. M. J. Snowling and C. Hulme (Oxford: Blackwell), 248–265.
National Center for Education Statistics (2011). The Nation’s Report Card: Reading 2011 (NCES 2012–457). Washington, DC: Institute of Education Sciences, U.S. Department of Education.
Perfetti, C., and Stafura, J. (2014). Word knowledge in a theory of reading comprehension. Sci. Stud. Read. 18, 22–37. doi: 10.1080/10888438.2013.827687
Rupley, W. H., and Blair, T. R. (1983). Reading Diagnosis and Remediation: Classroom and Clinic. 2nd Edn. Boston, MA: Houghton Mifflin.
Shanahan, T., Callison, K., Carriere, C., Duke, N. K., Pearson, P. D., Schatschneider, C., et al. (2010). Improving Reading Comprehension in Kindergarten through 3rd Grade: A Practice Guide (NCEE 2010–4038). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education.
Share, D. (2021). Is the science of reading just the science of reading English? Read. Res. Q. 56, S391–S402. doi: 10.1002/rrq.401
Sparks, R. L., Patton, J., and Murdoch, A. (2014). Early reading success and its relationship to reading achievement and reading amount: replication of ‘10 years later’. Read. Writ. Interdiscip. J. 27, 189–211. doi: 10.1007/s11145-013-9439-2
Stein, M. L. (2017). Supporting the summer reading of urban youth: an evaluation of the Baltimore SummerREADS program. Educ. Urban Soc. 49, 29–52. doi: 10.1177/0013124516630595
Vacca, J. L., Vacca, R. T., Gove, M. K., Burkey, L. C., Lenhart, L. A., and McKeon, C. A. (2009). Reading and Learning to Read. 7th Edn. New York, NY: Pearson.
Wang, H., Guan, H., Yi, H., Seevak, E., Manheim, R., Boswell, M., et al. (2020). Independent reading in rural China’s elementary schools: a mixed-methods. Int. J. Educ. Dev. 78, 102241–102211. doi: 10.1016/j.ijedudev.2020.102241
Wang, X., Luo, R., Zhang, L., and Rozelle, S. (2017). The education gap of China’s migrant children and rural counterparts. J. Dev. Stud. 53, 1865–1881. doi: 10.1080/00220388.2016.1274395
Wang, N., Wang, H., Chang, F., Lu, F., and Dill, S.-E. (2020). Factors linked to cultivating successful readers: evidence from rural China. Int. J. Educ. Res. 103, 101636–101610. doi: 10.1016/j.ijer.2020.101636
Wei, W.. (2021). Shuju diaocha: Xiangcun ertong yu chengshi ertong yuedu chayi zai na [data survey: Differences in Reading between Urban and Rural Children]. Available at: http://zhiku.hsw.cn/system/2021/0425/3207.shtml
White, T. G., Kim, J. S., Kingston, H. C., and Foster, L. (2014). Replicating the effects of a teacher-scaffolded voluntary summer reading program: the role of poverty. Read. Res. Q. 49, 5–30. doi: 10.1002/rrq.62
Yi, H., Mo, D., Wang, H., Gao, Q., Shi, Y., Wu, P., et al. (2019). Do resources matter? Effects of an in–class library project on student independent reading habits in primary schools in rural China. Read. Res. Q. 54, 383–411. doi: 10.1002/rrq.238
Keywords: reading development, reading, intervention, teacher professional development, randomized control trial, migrant children in China
Citation: Guo Q, Kim Y-S, Liu Y, Peng Y, Sun W, Yan J and Yang L (2023) Differential effects of a reading strategy intervention program for migrant children in migrant schools in China. Front. Educ. 8:1066609. doi: 10.3389/feduc.2023.1066609
Edited by:
Ying Guo, University of Cincinnati, United StatesReviewed by:
Zhengdong Gan, University of Macau, ChinaStephanie W. Y. Chan, The University of Hong Kong, Hong Kong SAR, China
Copyright © 2023 Guo, Kim, Liu, Peng, Sun, Yan and Yang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Young-Suk Kim, eW91bmdzazdAdWNpLmVkdQ==; Wenkai Sun, c3Vud2tAcnVjLmVkdS5jbg==