Showing papers in "Review of Educational Research in 2023"
TL;DR: This article presented a systematic review of elementary school universal school-based social and emotional learning (SEL) interventions from 2008 through 2020 for two groups of minoritized students in education research and practice: students with disabilities and/or minoritized racial identities.
Abstract: The authors present a systematic review of elementary school universal school-based (USB) social and emotional learning (SEL) interventions from 2008 through 2020 for two groups of minoritized students in education research and practice: students with disabilities and/or minoritized racial identities. Completed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses standards, in this review the authors identified 269 studies for inclusion, which reflected 107 USB SEL interventions. Eleven studies explicitly excluded students with disabilities. Studies varied widely in how disability and racial identity were categorized within and across studies and provided limited evidence of effectiveness through the use of subgroup analyses to support meaningful assessment of how students with disabilities and racially minoritized elementary school age students are benefiting from USB SEL interventions. The authors discuss the limitations of findings, education research best practices, and the minimum reporting standards necessary to ensure ability and racially minoritized youth representation in future USB SEL research.
7 citations
TL;DR: A systematic literature review examined the research on prior knowledge and its activation to ascertain how these terms are defined, what specific techniques have been empirically investigated, and the conditions under which prior knowledge activation facilitated students' comprehension as discussed by the authors .
Abstract: This systematic literature review examined the research on prior knowledge and its activation to ascertain how these terms are defined, what specific techniques have been empirically investigated, and the conditions under which prior knowledge activation facilitated students’ comprehension. Fifty-four articles met the inclusion criteria and revealed that the terms prior knowledge and prior knowledge activation were often vaguely defined. Further, 30 unique techniques for activating readers’ prior knowledge representing eight different categories were identified. Those categories were open-ended prompts, procedural or strategic supports during reading, visual representations, analogical reasoning, text alteration, augmented activation, extratextual activities, and spontaneous activation. Techniques meant to facilitate knowledge activation prior to reading were most common, although the prompting of students’ existing knowledge was beneficial during and after reading as well. Variability in the effectiveness of activation techniques was related, in part, to the amount, accuracy, and specificity of students’ knowledge. Based on the key findings identified in this review, recommendations for future inquiry are forwarded, including suggested definitions of prior knowledge and prior knowledge activation.
3 citations
TL;DR: A systematic literature review of critical approaches to quantitative inquiry emerged as a new paradigm within quantitative methods and whether there is any distinction between quantitative criticalism, QuantCrit, and critical quantitative inquiries or simply interchangeable wordplay as discussed by the authors .
Abstract: Although the critical research cannon is often associated with qualitative scholars, there is a growing number of critical scholars who are refusing positivist-informed quantitative analyses. However, as a growing number of education scholars engaged in critical approaches to quantitative inquiry, instances of conflation began to surface. We understood this conflation as the interchangeable use of the terms quantitative criticalism, QuantCrit, and critical quantitative throughout the literature and even within the same chapter or article. The purpose of our systematic literature review is twofold: (a) to understand how critical approaches to quantitative inquiry emerged as a new paradigm within quantitative methods and (b) whether there is any distinction between quantitative criticalism, QuantCrit, and critical quantitative inquiries or simply interchangeable wordplay. We share how critical quantitative approaches are definite shifts within the quantitative research paradigm, highlight relevant assumptions, and share strategies and future directions for applied practice in this emergent field.
1 citations
TL;DR: In this article , a meta-analysis summarized 136 independent effect sizes (N = 53,258) for the association between need for cognition and academic achievement and investigated the moderating effects of variables related to research context, methodology, and instrumentation.
Abstract: Need for cognition is conceptualized as an individual’s intrinsic motivation to engage in and enjoy effortful cognitive activities. Over the past three decades, there has been increasing interest in how need for cognition impacts and correlates with learning performance. This meta-analysis summarized 136 independent effect sizes (N = 53,258) for the association between need for cognition and academic achievement and investigated the moderating effects of variables related to research context, methodology, and instrumentation. The overall effect size weighted by inverse variance and using a random effects model was found to be small, r = .20, with a 95% confidence interval ranging from .18 to .22. The association between need for cognition and learning performance was moderated by grade level, geographic region, exposure to intervention, and outcome measurement tool. The implications of these findings for practice and future research are discussed.
1 citations
TL;DR: In this paper , the authors synthesize 19 studies that investigated professional development on literacy instruction and intervention for English learners (ELs) and found that although professional development often targets teachers' implementation of literacy instruction, PD is less likely to focus on teachers' implementing of literacy interventions for ELs experiencing reading difficulties.
Abstract: An important way to address the literacy needs of English learners (ELs) is to ensure that ELs receive evidence-based literacy instruction and intervention. To support teachers’ implementation of this instruction and intervention, it is necessary to provide effective professional development (PD). In this systematic review, we synthesized 19 studies that investigated PD on literacy instruction and intervention for ELs. Findings revealed that although PD often targets teachers’ implementation of literacy instruction, PD is less likely to focus on teachers’ implementation of literacy interventions for ELs experiencing reading difficulties. Nonetheless, PD programs typically resulted in positive changes in teachers’ knowledge and practices. However, only 12 of the studies reported on student outcomes. We conclude with research and practical implications related to PD for teachers of ELs that is responsive to the needs of ELs.
1 citations
TL;DR: This article conducted a meta-analysis to investigate reading-writing relations and found that the relation between reading and writing was strongly related (r = .72) whereas reading comprehension and written composition were moderately related.
Abstract: We conducted a meta-analysis to investigate reading-writing relations. Beyond the overall relation, we systematically investigated moderation of the relation as a function of linguistic grain size (word reading and spelling versus reading comprehension and written composition), measurement of reading comprehension (e.g., multiple choice, open-ended, cloze), and written composition (e.g., writing quality, writing productivity, writing fluency, writing syntax), and developmental phase of reading and writing (grade levels as a proxy). A total of 395 studies (k = 2,265, N = 120,669) met inclusion criteria. Overall, reading and writing were strongly related (r = .72). However, the relation differed depending on the subskills of reading and writing such that word reading and spelling were strongly related (r =.82) whereas reading comprehension and written composition were moderately related (r =.44). In addition, the word reading-spelling relation was stronger for primary-grade students (r =.82) than for university students/adults (r =.69). The relation of reading comprehension with written composition differed depending on measurement of reading comprehension and written composition—reading comprehension measured by multiple choice and open-ended tasks had a stronger relation with writing quality than reading comprehension measured by oral retell tasks; and reading comprehension had moderate relations with writing quality, writing vocabulary, writing syntax, and writing conventions but had weak relations with writing productivity and writing fluency. Relations tended to be stronger when reliability was higher, and the relation between word reading and spelling was stronger for alphabetic languages (r = .83) than for Chinese (r = .71). These results add important nuances about the nature of relations between reading and writing.
1 citations
TL;DR: This paper conducted a systematic review of literature on the experiences of substitute teachers, also known as casual or relief teachers, and found that substitute teachers are a heterogeneous group, their conditions and experiences are less than satisfactory, exacerbated by a lack of targeted support.
Abstract: This article reports on a systematic review of literature on the experiences of substitute teachers, also known as casual or relief teachers. This occupational group are an essential part of school improvement efforts, allowing release time for other teachers to participate in professional learning, complete administrative duties, and attend to personal matters. Although a ubiquitous component of the teaching workforce, little is known about their work conditions, motivations, experiences, and support. This study involved a mixed-methods research synthesis approach. Peer-reviewed studies and dissertations that examined the experiences and needs of substitute teachers in primary/elementary, middle, and secondary/high schools were examined. The study found that, although substitute teachers are a heterogeneous group, their conditions and experiences are less than satisfactory, exacerbated by a lack of targeted support. Education systems need to consider professionalizing this occupational group further. In addition, systems need to develop policies and practices that improve substitute teachers’ work.
TL;DR: The authors examined 12 educational clearinghouses to describe their effectiveness criteria, to estimate how consistently they rate the same program, and to probe why their judgments differ, and concluded that identifying evidence-based interventions is still more of a policy aspiration than a reliable research practice.
Abstract: Clearinghouses set standards of scientific quality to vet existing research to determine how “evidence-based” an intervention is. This paper examines 12 educational clearinghouses to describe their effectiveness criteria, to estimate how consistently they rate the same program, and to probe why their judgments differ. All the clearinghouses value random assignment, but they differ in how they treat its implementation, how they weight quasi-experiments, and how they value ancillary causal factors like independent replication and persisting effects. A total of 1359 programs were analyzed over 10 clearinghouses; 83% of them were assessed by a single clearinghouse and, of those rated by more than one, similar ratings were achieved for only about 30% of the programs. This high level of inconsistency seems to be mostly due to clearinghouses disagreeing about whether a high program rating requires effects that are replicated and/or temporally persisting. Clearinghouses exist to identify “evidence-based” programs, but the inconsistency in their recommendations of the same program suggests that identifying “evidence-based” interventions is still more of a policy aspiration than a reliable research practice.
TL;DR: In this paper , a meta-analysis of DGBL interventions' effects on different learning outcomes (cognitive, metacognitive, affective-motivational) in the school context, using studies published between 2015 and 2020 and meta-analytic techniques (including moderator analyses).
Abstract: Digital game-based learning (DGBL) interventions can be superior to traditional instruction methods for learning, but previous meta-analyses covered a huge period and included a variety of different target groups, limiting the results’ transfer on specific target groups. Therefore, the aim of this meta-analysis is a theory-based examination of DGBL interventions’ effects on different learning outcomes (cognitive, metacognitive, affective-motivational) in the school context, using studies published between 2015 and 2020 and meta-analytic techniques (including moderator analyses) to examine the effectiveness of DGBL interventions compared to traditional instruction methods. Results from random-effects models revealed a significant medium effect for overall learning (g = .54) and cognitive learning outcomes (g = .67). Also found were a small effect for affective-motivational learning outcomes (g = .32) and no significant effect for metacognitive learning outcomes. Additionally, there was no evidence of publication bias. Further meta-regression models did not reveal evidence of moderating personal, environmental, or confounding factors. The findings partially support the positive impact of DGBL interventions in school, and the study addresses its practical implications.
TL;DR: This article used Bayesian network meta-analysis to investigate the intervention effectiveness of different reading comprehension strategy combinations on reading comprehension among students with reading difficulties in 3rd through 12th grade, and found that the effects of strategies only held when background knowledge instruction was included.
Abstract: Based on 52 studies with samples mostly from English-speaking countries, the current study used Bayesian network meta-analysis to investigate the intervention effectiveness of different reading comprehension strategy combinations on reading comprehension among students with reading difficulties in 3rd through 12th grade. We focused on commonly researched strategies: main idea, inference, text structure, retell, prediction, self-monitoring, and graphic organizers. Results showed (1) instruction of more strategies did not necessarily have stronger effects on reading comprehension; (2) there was no single reading comprehension strategy that produced the strongest effect; (3) main idea, text structure, and retell, taught together as the primary strategies, seemed the most effective; and (4) the effects of strategies only held when background knowledge instruction was included. These findings suggest strategy instruction among students with reading difficulties follows an ingredient-interaction model—that is, no single strategy works the best. It is not “the more we teach, the better outcomes to expect.” Instead, different strategy combinations may produce different effects on reading comprehension. Main idea, text structure, and retell together may best optimize the cognitive load during reading comprehension. Background knowledge instruction should be combined with strategy instruction to facilitate knowledge retrieval as to reduce the cognitive load of using strategies.
TL;DR: In this paper , the authors assess the prevalence of these issues by reviewing 166 impact evaluations of teacher preparation practices published in peer-reviewed journals between 2002 and 2019 and highlight some innovative approaches and present a checklist of considerations to assist future researchers in designing more rigorous impact evaluations.
Abstract: Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher preparation practices published in peer-reviewed journals between 2002–2019. Although I find that very few studies address issues of internal validity, measurement, and external validity, I highlight some innovative approaches and present a checklist of considerations to assist future researchers in designing more rigorous impact evaluations.
TL;DR: This article conducted a meta-analysis of 25 preschool to third grade math interventions with 83 effect sizes that yielded a statistically significant summary effect (g = 0.26, 95% CI [0.07, 0.45] on children's math achievement).
Abstract: The purposes of this study included conducting a meta-analysis and reviewing the study reporting quality of math interventions implemented in informal learning environments (e.g., the home) by children’s caregivers. This meta-analysis included 25 preschool to third-grade math interventions with 83 effect sizes that yielded a statistically significant summary effect (g = 0.26, 95% CI [0.07, 0.45) on children’s math achievement. Significant moderators of the treatment effect included the intensity of caregiver training and type of outcome measure. There were larger average effects for interventions with caregiver training that included follow-up support and for outcomes that were comprehensive early numeracy measures. Studies met 58.0% of reporting quality indicators, and analyses revealed that quality of reporting has improved in recent years. The results of this study offer several recommendations for researchers and practitioners, particularly given the growing evidence base of math interventions conducted in informal learning environments.
TL;DR: In this article , a literature review methodology (KanakaʻŌiwiLRM) is conceptualized and engaged to analyze 20 literature sources to understand how scholars operationalize self-determination and Ea (sovereignty, life) in research on Native Hawaiian CBE and the extent to which this operationalization provides pathways for students to internalize the two concepts, self-identify as Indigenous, and enact praxis.
Abstract: Although research shows that critical outcomes occur for Native students when culture-based education (CBE) centers self-determination, sovereignty, and Indigeneity, Kanaka ʻŌiwi (Native Hawaiian) students rarely learn about these concepts. This review thus seeks to understand how scholars operationalize self-determination and Ea (sovereignty, life) in research on Native Hawaiian CBE and the extent to which this operationalization provides pathways for students to internalize the two concepts, self-identify as Indigenous, and enact praxis. By foregrounding Kānaka ways of knowing and being, a Kanaka ʻŌiwi literature review methodology (KanakaʻŌiwiLRM) is conceptualized and engaged to analyze 20 literature sources. Findings indicate that self-determination and Ea are positioned as the foundations and outcomes of CBE, yet disregarded as a basis for Indigenous self-identification. This results in a call for a purposeful decolonial Native Hawaiian CBE approach that nourishes Indigenous unity and supports self-determination, Ea, and pathways toward praxis.
TL;DR: This paper identified 80 empirical research studies on strategies for reducing excellence gaps published between 2010 and 2021 and identified themes related to the seven facets of the Excellence Gap Intervention Model (K-12 school accountability support, teacher professional learning, expanded advanced learning opportunities, universal screening with local norms, frontloading, flexible ability grouping, psychosocial interventions).
Abstract: Unequal access to advanced learning opportunities is among the most complex and controversial issues in American K–12 schools. Interventions that address policy, programming, and instruction can provide opportunities for students with advanced learning needs in school systems that prioritize minimum grade-level standards. Excellence gaps are differences in advanced performance among student subgroups that result from inequities in education and society. In this systematic review of the literature, the authors identified 80 empirical research studies on strategies for reducing excellence gaps published between 2010 and 2021 and identified themes related to the seven facets of the Excellence Gap Intervention Model (K–12 school accountability support, teacher professional learning, expanded advanced learning opportunities, universal screening with local norms, frontloading, flexible ability grouping, psychosocial interventions). This analysis revealed substantial evidence of intervention development over the past decade and suggests a revised approach to equitable, advanced education that begins with preparation (e.g., teacher professional learning, student frontloading) and is followed by placement, evaluation, and adjustment as students’ learning needs change.
TL;DR: In this article , the authors systematically review the literature on the marketing activities of primary and secondary schools worldwide and find that schools deploy a range of marketing techniques with the intensity of activity directly correlated to the level of local competition and their position in the local hierarchy.
Abstract: School-choice programs may increase schools' incentives for marketing rather than improving their educational offering. This article systematically reviews the literature on the marketing activities of primary and secondary schools worldwide. The 81 articles reviewed show that schools’ marketing has yet to be tackled by marketing academics or other social scientists outside the education field. Market-oriented U.S. charter schools and their international equivalents have stimulated recent research, but geographical gaps remain, particularly in countries with long-established school-choice policies and in rural areas. Schools deploy a range of marketing techniques with the intensity of activity directly correlated to the level of local competition and their position in the local hierarchy. Studies have analyzed schools’ use of market scanning, specific words and images in brochures, branding, segmentation, and targeting. These marketing activities are rarely accompanied by substantive curricular change, however, and may even contribute to social division through targeting or deceptive marketing activity.
TL;DR: In this paper , a systematic integrative review aims to develop an empirically grounded view of how identities are conceptualized in childhood across content areas and to consider the feasibility of a shared conception of content area identities.
Abstract: The concept of identity has been used to interrogate a wide range of topics about children’s learning in the content areas, including learning in literacy, math, and science. Despite this, there is a paucity of attention to how the construct of identities is conceptualized across content areas. This systematic integrative review aims to develop an empirically grounded view of how identities are conceptualized in childhood across content areas and to consider the feasibility of a shared conception of content area identities. To do this, the review examines 66 articles on content area identities in early childhood and childhood (birth through Grade 5). Findings show diverse theories are used to examine content area identities in children and at the same time significant consensus in the underlying assumptions about what content area identities are and how they develop. These findings suggest that researchers move away from the current siloed approach to content area identity research and toward a more connected field of study.