计量经济分析 = Econometric analysis

This article presents findings from a meta-analysis of 213 school-based, universal social and emotional learning (SEL) programs involving 270,034 kindergarten through high school students. Compared to controls, SEL participants demonstrated significantly improved social and emotional skills, attitudes, behavior, and academic performance that reflected an 11-percentile-point gain in achievement. School teaching staff successfully conducted SEL programs. The use of 4 recommended practices for developing skills and the presence of implementation problems moderated program outcomes. The findings add to the growing empirical evidence regarding the positive impact of SEL programs. Policy makers, educators, and the public can contribute to healthy development of children by supporting the incorporation of evidence-based SEL programming into standard educational practice.

http://explorefhp.com/wp-content/uploads/2013/03/Durlak-Weissberg-Child-Development-Meta-Analysis.pdf

The Impact of Enhancing Students’ Social and Emotional Learning: A Meta‐Analysis of School‐Based Universal Interventions

Purposeful sampling is widely used in qualitative research for the identification and selection of information-rich cases related to the phenomenon of interest. Although there are several different purposeful sampling strategies, criterion sampling appears to be used most commonly in implementation research. However, combining sampling strategies may be more appropriate to the aims of implementation research and more consistent with recent developments in quantitative methods. This paper reviews the principles and practice of purposeful sampling in implementation research, summarizes types and categories of purposeful sampling strategies and provides a set of recommendations for use of single strategy or multistage strategy designs, particularly for state implementation research.

/pdf/purposeful-sampling-for-qualitative-data-collection-and-2zi83jnr1f.pdf

Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research.

The first purpose of this review was to assess the impact of implementation on program outcomes, and the second purpose was to identify factors affecting the implementation process. Results from over quantitative 500 studies offered strong empirical support to the conclusion that the level of implementation affects the outcomes obtained in promotion and prevention programs. Findings from 81 additional reports indicate there are at least 23 contextual factors that influence implementation. The implementation process is affected by variables related to communities, providers and innovations, and aspects of the prevention delivery system (i.e., organizational functioning) and the prevention support system (i.e., training and technical assistance). The collection of implementation data is an essential feature of program evaluations, and more information is needed on which and how various factors influence implementation in different community settings.

/pdf/implementation-matters-a-review-of-research-on-the-influence-1wt0xfs3gm.pdf

Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation

The author suggests that we apply recent research knowledge to improve our conceptualization, measures, and methodology for studying the effects of teachers’ professional development on teachers and students. She makes the case that there is a research consensus to support the use of a set of core features and a common conceptual framework in professional development impact studies. She urges us to move away from automatic biases either for or against observation, interviews, or surveys in such studies. She argues that the use of a common conceptual framework would elevate the quality of professional development studies and subsequently the general understanding of how best to shape and implement teacher learning opportunities for the maximum benefit of both teachers and students.

/pdf/improving-impact-studies-of-teachers-professional-3pzi4k3euo.pdf

Improving Impact Studies of Teachers’ Professional Development: Toward Better Conceptualizations and Measures

There is no universal guideline or rule of thumb for judging the practical importance or substantive significance of a standardized effect size estimate for an intervention. Instead, one must develop empirical benchmarks of comparison that reflect the nature of the intervention being evaluated, its target population, and the outcome measure or measures being used. This approach is applied to the assessment of effect size measures for educational interventions designed to improve student academic achievement. Three types of empirical benchmarks are illustrated: (a) normative expectations for growth over time in student achievement, (b) policy-relevant gaps in student achievement by demographic group or school performance, and (c) effect size results from past research for similar interventions and target populations. The findings can be used to help assess educational interventions, and the process of doing so can provide guidelines for how to develop and use such benchmarks in other fields.

/pdf/empirical-benchmarks-for-interpreting-effect-sizes-in-zu1ntd2hve.pdf

Empirical Benchmarks for Interpreting Effect Sizes in Research

Two complementary approaches to developing empirical benchmarks for achievement effect sizes in educational interventions are explored. The first approach characterizes the natural developmental progress in achievement made by students from one year to the next as effect sizes. Data for seven nationally standardized achievement tests show large annual gains in the early elementary grades followed by gradually declining gains in later grades. A given intervention effect will therefore look quite different when compared to the annual progress for different grade levels. The second approach explores achievement gaps for policy-relevant subgroups of students or schools. Data from national- and district-level achievement tests show that, when represented as effect sizes, student gaps are relatively small for gender and much larger for economic disadvantage and race/ethnicity. For schools, the differences between weak schools and average schools are surprisingly modest when expressed as student-level e...

/pdf/performance-trajectories-and-performance-gaps-as-achievement-2qz6fuxhpp.pdf

Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions

/pdf/performance-trajectories-and-performance-gaps-as-achievement-agsb6ekg85.pdf

Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions. MDRC Working Papers on Research Methodology.

/pdf/the-impact-of-two-professional-development-interventions-on-5fv3heii1t.pdf

The Impact of Two Professional Development Interventions on Early Reading Instruction and Achievement. NCEE 2008-4030.

This article examines how controlling statistically for baseline covariates, especially pretests, improves the precision of studies that randomize schools to measure the impacts of educational inte...

Howard S. Bloom

Papers

Empirical Benchmarks for Interpreting Effect Sizes in Research

Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions

Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions. MDRC Working Papers on Research Methodology.

The Impact of Two Professional Development Interventions on Early Reading Instruction and Achievement. NCEE 2008-4030.

Using Covariates to Improve Precision for Studies that Randomize Schools to Evaluate Educational Interventions.