Showing papers in "Education Finance and Policy in 2015"

Development, Discouragement, or Diversion? New Evidence on the Effects of College Remediation

Abstract: Half of all college students will enroll in remedial coursework but evidence of its effectiveness is mixed. Using a regression-discontinuity design with data from a large urban community college system, we make three contributions. First, we articulate three alternative hypotheses regarding the potential impacts of remediation. Second, in addition to credits and degree completion we examine several underexplored outcomes, including initial enrollment, grades in subsequent courses, and post-treatment proficiency test scores. Finally, we exploit rich high school background data to examine impact heterogeneity by predicted dropout risk. We find that remedial assignment does little to develop students’ skills. But we also find little evidence that it discourages initial enrollment or persistence, except for a subgroup we identify as potentially misassigned to remediation. Instead, the primary effect of remediation appears to be diversionary: students simply take remedial courses instead of college-lev...

Can value-added measures of teacher performance be trusted?

Abstract: We investigate whether commonly used value-added estimation strategies produce accurate estimates of teacher effects under a variety of scenarios. We estimate teacher effects in simulated student achievement data sets that mimic plausible types of student grouping and teacher assignment scenarios. We find that no one method accurately captures true teacher effects in all scenarios, and the potential for misclassifying teachers as high- or low-performing can be substantial. A dynamic ordinary least squares estimator is more robust across scenarios than other estimators. Misspecifying dynamic relationships can exacerbate estimation problems.

Does Teacher Evaluation Improve School Performance? Experimental Evidence from Chicago's Excellence in Teaching Project.

Abstract: Chicago Public Schools initiated the Excellence in Teaching Project, a teacher evaluation program designed to increase student learning by improving classroom instruction through structured principal–teacher dialogue. The pilot began in forty-four elementary schools in 2008–09 (cohort 1) and scaled up to include an additional forty-eight elementary schools in 2009–10 (cohort 2). Leveraging the experimental design of the rollout, cohort 1 schools performed better in reading and math than cohort 2 schools at the end of the first year, though the math effects are not statistically significant. We find the initial improvement for cohort 1 schools remains even after cohort 2 schools adopted the program. Moreover, the pilot differentially impacted schools with different characteristics. Higher-achieving and lower-poverty schools were the primary beneficiaries, suggesting the intervention was most successful in more advantaged schools. These findings are relevant for policy makers and school leaders who ...

Do Study Abroad Programs Enhance the Employability of Graduates

Abstract: Despite the great popularity of international educational mobility schemes, relatively little research has been conducted to explore their benefits. Using data on a large sample of recent Italian graduates, this paper investigates the extent to which participation in study abroad programs during university studies impacts subsequent employment likelihood. To address the problem of endogeneity related to participation in study abroad programs, we use university-department fixed effects and instrumental variable estimation where the instrumental variable is exposure to international student exchange schemes. Our estimates show that studying abroad has a relatively large and statistically meaningful effect on the probability of being in employment 3 years after graduation. This effect is mainly driven by the impact that study abroad programs have on the employment prospects of graduates from disadvantaged backgrounds.

Teacher preparation programs and teacher quality: are there real differences across programs?

Abstract: We compare teacher preparation programs in Missouri based on the effectiveness of their graduates in the classroom. The differences in effectiveness between teachers from different preparation programs are much smaller than has been suggested in previous work. In fact, virtually all of the variation in teacher effectiveness comes from within-program differences between teachers. Prior research has overstated differences in teacher performance across preparation programs by failing to properly account for teacher sampling.

Does Shortening the School Week Impact Student Performance? Evidence from the Four-Day School Week

Abstract: School districts use a variety of policies to close budget gaps and stave off teacher layoffs and furloughs. More schools are implementing four-day school weeks to reduce overhead and transportation costs. The four-day week requires substantial schedule changes as schools must increase the length of their school day to meet minimum instructional hour requirements. Although some schools have indicated this policy eases financial pressures, it is unknown whether there is an impact on student outcomes. We use school-level data from Colorado to investigate the relationship between the four-day week and academic performance among elementary school students. Our results generally indicate a positive relationship between the four-day week and performance in reading and mathematics. These findings suggest there is little evidence that moving to a four-day week compromises student academic achievement. This research has policy relevance to the current U.S. education system, where many school districts must...

School Districts and Student Achievement

Abstract: School districts are a focus of education reform efforts in the United States, but there is very little existing research about how important they are to student achievement. We fill this gap in the literature using 10 years of student-level, statewide data on fourth- and fifth-grade students in Florida and North Carolina. A variance decomposition analysis based on hierarchical linear models indicates that districts account for only a small share (1 to 2 percent) of the total variation in student achievement. Nevertheless, the differences between lower- and higher-performing districts are large enough to be of practical and policy significance, with a one standard deviation difference in district effectiveness corresponding to about 0.11 standard deviations in student achievement (about nine weeks of schooling). District performance is generally stable over time, but there are examples of districts that have shown significant increases or decreases in performance.

Hold Back To Move Forward? Early Grade Retention And Student Misbehavior

Abstract: Test-based accountability has become the new norm in public education over the last decade. In many states and school districts nationwide, student performance on standardized tests plays an important role in high-stakes decisions, such as grade retention. This study examines the effects of grade retention on student misbehavior in Florida, which requires students with reading skills below grade level to be retained in the third grade. The regression discontinuity estimates suggest that grade retention increases the likelihood of disciplinary incidents and suspensions in the short run, yet these effects dissipate over time. The findings also suggest that these short-term adverse effects are concentrated among economically disadvantaged and male students.

Which Teachers Choose a Defined Contribution Pension Plan? Evidence from the Florida Retirement System

Abstract: Since 2002, public school teachers in Florida have been permitted to choose between a defined benefit (DB) and a defined contribution (DC) retirement plan. We exploit this unique policy environment to study new teachers’ revealed preferences over pension plan structures. Roughly 30 percent of teachers hired between 2003 and 2008 selected the DC plan, despite the fact that teachers not actively deciding within six months were defaulted into the DB plan. The share choosing the DC plan was higher among teachers with advanced degrees, math and science teachers, and teachers in charter schools. It was lower among special education teachers and especially among black and Hispanic teachers. There was only a slight relationship between plan choice and teacher value added to student achievement, with teachers in the bottom value-added quartile roughly 2 percentage points less likely to choose the DC option.

Teacher Layoffs, Teacher Quality, and Student Achievement: Evidence from a Discretionary Layoff Policy.

Abstract: Most teacher layoffs during the Great Recession were implemented following inverse-seniority policies. In this paper, I examine the implementation of a discretionary layoff policy in Charlotte Mecklenburg Schools. Administrators did not uniformly lay off the most or least senior teachers but instead selected teachers who were previously retired, late-hired, unlicensed, low-performing, or nontenured. Using quasi-experimental variation within schools across grades, I then estimate the differential effects of teacher layoffs on student achievement based on teacher seniority and effectiveness. Mathematics achievement in grades that lost an effective teacher, as measured by principal evaluations or value-added scores, decreased 0.05 to 0.11 standard deviations more than in grades that lost an ineffective teacher. In contrast, teacher seniority has limited predictive power on the effects of layoffs. Simulation analyses show that the district selected teachers who were, on average, less effective than th...

How to Make Additional Time Matter: Integrating Individualized Tutorials into an Extended Day.

Abstract: Evidence on the effect of extending the school day is decidedly mixed because of the stark differences in how schools use additional time. In this paper, I focus narrowly on the effect of additional time used for individualized tutorials. In 2005, MATCH Charter Public High School integrated two hours of tutorials throughout an extended day. The unanticipated implementation of this initiative and the school's admissions lottery allow me to use two complementary quasi-experimental methods to estimate program effects. I find that providing students with daily tutorials that are integrated into the school day and taught by full-time, recent college graduates increased achievement on tenth-grade English language arts exams by 0.15–0.25 standard deviations per year. I find no average effect in mathematics beyond the large gains students were already achieving, although quantile regression estimates suggest the tutorials raised the lowest end of the achievement distribution in mathematics.

Does failing a placement exam discourage underprepared students from going to college

Abstract: About one third of college students are required to take remedial courses. Assignment to remediation is generally made on the basis of performance on a placement exam. When students are required to take a placement exam prior to enrolling in college-level courses, assignment to remediation may dissuade students from actually going to college. This is because remediation could increase the time required to complete a degree (because remedial courses do not count toward academic degrees), and also because being identified as needing remediation might have stigma effects or provide students with new information about their unsuitability for college. This paper examines this issue empirically using administrative data from Texas. Using regression discontinuity methods, we find that students whose placement exam scores would require them to be in remediation are no less likely to enroll in college than are students who score just above the remediation placement cutoff.

Attendance Spillovers between Public and For-Profit Colleges: Evidence from Statewide Variation in Appropriations for Higher Education

Abstract: Between 2000 and 2010, U.S. public colleges and universities experienced widespread and uneven changes in funding from state and local appropriations. We find that over this period annual decreases...

Charter School Expansion and Within-District Equity: Confluence or Conflict?

Abstract: This article explores whether two popular policy initiatives are compatible or conflicting strategies for enhancing educational equality in diverse large urban centers. These two initiatives are (1) charter school expansion and (2) improvement of resource equity across urban public school systems through policies often referred to as weighted student funding formulas. In this article, we focus on New York and Houston, two cities where districts have adopted initiatives to improve equity of the distribution of school site funding and have concurrently experienced significant expansion of charter schooling. We find that charter schools have the tendency to amplify student population differences across schools by disability, language, and low income status, and that charter schools’ access to financial resources varies widely. Nevertheless, we find that in very large urban districts like New York City, where charter market share remains small, the overall effects of charters on system-wide inequity r...

Bridging the Discontinuity in Adolescent Literacy? Mixed Evidence from a Middle Grades Intervention

Abstract: Strong literacy skills are crucial to ensuring an individual's future educational and economic success. Existing evidence suggests the transition from elementary to middle school is a decisive period for literacy development. In this paper I investigate the impact of extended learning time in literacy instruction on subsequent cognitive outcomes. I capitalize on the existence of a natural experiment born out of a district's use of an exogenously- determined cutoff in Iowa Test scores in fifth grade to assign students to an additional literacy course in middle school. My findings suggest that exposure to this intervention generates strong negative impacts for black students, and noisy positive impacts for white, Latino, and Asian students. My findings suggest that additional literacy instruction in middle school can have markedly different effects on students, and program differentiation or augmentation may be necessary to prevent harm for students of average literacy ability in fifth grade.

A Smart Break? College Tenure Interruption and Graduating Student Outcomes.

Abstract: Using data from a longitudinal survey of college students from over 400 institutions, we examine the impacts of occupational internship programs and voluntary academic leave on returning academic achievement, post-college ambitions, and general facets of the college experience. Previous literature on college internships has focused on labor market effects and the literature on academic leave has emphasized its causes. Much less has been done to analyze effects of these occurrences on collegiate outcomes. College internships are found to have a positive effect on grades, increase desires to work full-time or attend graduate school immediately following graduation, and slightly increase ambitions to have administrative responsibilities and be financially well off. Voluntary academic leave is found to have only negative effects on collegiate outcomes, including study habits and academic achievement upon return. Implied policy implications are that colleges and universities should champion internship ...

Staffing a Low-Performing School: Behavioral Responses to Selective Teacher Transfer Incentives

Abstract: We examine behavioral responses to an incentive program that offers high-performing teachers in ten school districts across the country $20,000 to transfer into the district's hardest-to-staff schools. We discuss behavioral responses to the program on high-performing teachers’ willingness to transfer (supply) and the effect of the transfer offer on the internal dynamics of the receiving schools (demand). We found low take-up rates among the 1,514 high-performing teachers who were offered the incentive, with minimal sorting on observable characteristics. Within the new schools, transfer teachers were less likely than their counterparts in a randomized control group to require mentoring and more likely to provide mentoring themselves. No significant differences occurred in school climate, collegiality, or the way in which students were assigned to teachers, but evidence indicates that principals may have strategically assigned existing teachers to grades in both treatment and control schools in resp...

Messengers of Bad News or Bad Apples? Student Debt and College Accountability

Abstract: Student loan debt and defaults have been steadily rising, igniting public worry about the associated public and private risks. This has led to controversial regulatory attempts to curb defaults by holding colleges, particularly those in the for-profit sector, increasingly accountable for the student loan repayment behavior of their students. Such efforts endeavor to protect taxpayers against the misuse of public money used to encourage college enrollment and to safeguard students against potentially risky human capital investments. Recent policy proposals penalize colleges for students’ poor repayment performance, raising questions about institutions’ power to influence this behavior. Many of the schools at risk of not meeting student loan default measures also disproportionately enroll low-income, nontraditional, and financially independent students. Policy makers therefore face the challenge of promoting the efficient use of public funds and protecting students while also encouraging access to h...

The relationship between student transfers and district academic performance: accounting for feedback effects

Abstract: This paper draws attention to a subtle, but concerning, empirical challenge common in panel data models that seek to estimate the relationship between student transfers and district academic performance. Specifically, if such models have a dynamic element, and if the estimator controls for unobserved traits by including district-level effects, then model validity does not allow for a district's academic performance, in turn, to impact future transfers. Yet it seems reasonable that families, having access to publicly available aggregated information on standardized test results, seek to move their children to better-performing districts. In this paper, we demonstrate that, not only is such feedback quantitatively and qualitatively important, but also that allowing for such feedback substantially alters the estimated relationship between transfers and district performance.

Shifting Boundaries and Shady Borders: A Call for Research on the Political Economy of Education Reform

Abstract: jh1785@georgetown.edu INTRODUCTION In 2014, the Association for Education Finance and Policy (AEFP) held its thirty-ninth annual conference in San Antonio, Texas. The relevance of the host city for much of the research presented at the conference was not lost on most members. A little over forty years ago the Supreme Court of the United States ruled in San Antonio v. Rodriguez [411 U.S. 1 (1973)] that education is not a fundamental right protected by the U.S. Constitution. Parents had brought suit arguing that basing school financing on property wealth resulted in the unequal provision of education, presumably a fundamental right. The Supreme Court decision was a close one, at 5 to 4. If the decision had gone the other way, we would likely now have a national education system. Instead, what evolved is a complex system of education policy making, often described as a “marble cake federalism,” where different levels of government intermingle in different ways in policies and programs or as a “Rube-Goldberg-like” machine where complicated hoops and hurdles are required to produce relatively simple policy inputs. Something else has changed in the last forty years. The United States led the world throughout the twentieth century in expanding access to secondary and college education (Goldin and Katz 2000; Goldin 2001) but it is no longer the leader in access—nor for that matter does