Showing papers in "New Directions for Evaluation in 1998"
TL;DR: In this article, the authors compare two principal streams of participatory evaluation, practical participatory and transformative participatory, and compare them on a set of dimensions relating to control, level, and range of participation.
Abstract: This chapter posits two principal streams of participatory evaluation, practical participatory evaluation and transformative participatory evaluation, and compares them on a set of dimensions relating to control, level, and range of participation. The authors then situate them among other forms of collaborative evaluations.
580 citations
Journal Article•
TL;DR: In this article, the authors address three basic questions: what is participatory evaluation, in what contexts is it most useful, and how does one actually do it in practice, and they identify what they identify as the principal streams in PE: practical participatory evaluative evaluation (P-PE), which is pragmatic and has as its central function the fostering of evaluation use; and transformative participatorial evaluation (T-PE) which is based in emancipation and social-justice activism and focuses on the empowerment of oppressed groups.
Abstract: Participation is viewed generally as a positive activity, certainly in the context of democratic societies. Although still contested in some quarters, the idea of stakeholder participation in evaluation is now widely accepted within the evaluation community. Yet the meanings, even the purposes, of stakeholder participation in evaluation remain diverse, multiple, and thus clouded in many contexts. This volume presents participatory evaluation (PE) as a viable and creative addition to the contemporary repertoire of evaluation approaches. The authors address three basic questions: what is participatory evaluation, in what contexts is it most useful, and how does one actually do it in practice. The two primary themes in the volume are what we identify as the the principal streams in PE: practical participatory evaluation (P-PE), which is pragmatic and has as its central function the fostering of evaluation use; and transformative participatory evaluation (T-PE), which is based in emancipation and social-justice activism and focuses on the empowerment of oppressed groups. In addition to discussing these two streams, historically and philosophically, the volume examines the practical challenges of PE, by presenting it as a process of engagement and by illustrating PE through diverse case examples. Critical reflection on both practice and theory offers valuable insights into and lessons about participation and evaluation. This is the 80th issue of the quarterly journal "New Directions for Evaluation."
129 citations
TL;DR: The authors traces the history and philosophical roots of participatory evaluation and examines some current debates in the field, including the role of technology in the evaluation process, as well as its application.
Abstract: This chapter traces the history and philosophical roots of participatory evaluation and examines some current debates in the field.
92 citations
TL;DR: In this paper, the author examines three of her experiences with practical participatory evaluation and reflects on what makes this approach work in practice and what makes it work well in practice in practice.
Abstract: The author examines three of her experiences with practical participatory evaluation (or “meliorative participatory evaluation,” as she suggests) and reflects on what makes this approach work in practice.
71 citations
TL;DR: This chapter begins with a discussion of participatory evaluation as a set of principles and a process, with an emphasis on the how-to.
Abstract: This chapter begins with a discussion of participatory evaluation as a set of principles and a process. Drawing on her own experience and that of other practitioners, the author highlights key moments in the implementation of this process, with an emphasis on the how-to.
70 citations
Journal Article•
60 citations
TL;DR: In this article, a case study of participatory evaluation in a large-scale community revitalization program, using grassroots "citizen learning teams" to monitor and track progress, is presented.
Abstract: This chapter provides a detailed case study of participatory evaluation in a large-scale community-revitalization program, using grassroots “citizen learning teams” to monitor and track progress. Lessons and implications for scaling up participatory evaluation in government programs are discussed.
49 citations
TL;DR: Some of the essential points of applying emergent realist theory to practice are sketched in this paper, and an example pre-proposal highlights important aspects of practice is given.
Abstract: Some of the essential points of applying emergent realist theory to practice are sketched in this chapter. First a running conversation is offered to explain emergent realist evaluation; then an example pre-proposal highlights important aspects of practice.
45 citations
TL;DR: Realism offers an alternative to the traditional positivist and constructivist paradigms as discussed by the authors, and its implications for knowledge construction are described here, as well as the principles of this approach.
Abstract: Realism offers an alternative to the traditional positivist and constructivist paradigms. The principles of this approach are described here, as are its implications for knowledge construction.
40 citations
TL;DR: In this paper, realist principles frame evaluation as a support for democratic processes in the pursuit of social betterment, defined as the extent to which public policies and programs meet the ever-emerging complex of human needs.
Abstract: In this chapter, realist principles frame evaluation as a support for democratic processes in the pursuit of social betterment. Social betterment is defined as the extent to which public policies and programs meet the ever-emerging complex of human needs. Distinct implications for the practice of evaluation, including balancing among values, analyzing distributional aspects of a program, and informing democratic processes are discussed.
24 citations
TL;DR: In this article, a theory of evaluation use must be contextualized within the venue in which use is expected, with particular emphasis on shaping realist practice to increase the potential for utilization.
Abstract: A theory of evaluation use must be contextualized within the venue in which use is expected. Use in policy-making and social programming is analyzed with particular emphasis on shaping realist practice to increase the potential for utilization.
TL;DR: In this paper, staff members of nongovernmental organizations are trained in participatory evaluation methodology and then apply their training in facilitating the evaluation of fifteen grassroots projects, and a case study reviews the lessons learned, the key outcomes, and some limitations of the process.
Abstract: Haitian staff members of nongovernmental organizations are trained in participatory evaluation methodology and then apply their training in facilitating the evaluation of fifteen grassroots projects. This case study reviews the lessons learned, the key outcomes, and some limitations of the process.
TL;DR: In this paper, the authors evaluate the effectiveness of the Low-Income Housing Tax Credit (LIHTC) and the feasibility of replacing the program with a directly budgeted subsidy.
Abstract: Central issues in evaluating the Low-Income Housing Tax Credit are cost-effectiveness as the program stands; whether it adds to the supply of affordable housing; whether development costs of tax credit projects are reasonable relative to private, unsubsidized housing development; whether alternative means of achieving the objectives would be more efficient or be better targeted to lower-income households; and the feasibility of replacing the program with a directly budgeted subsidy. Methodological requirements for the evaluation include developing clear relationships among government costs, transaction costs, investor returns, and net equity provided to a project.
Journal Article•
TL;DR: In this article, the authors discuss the evaluators role in informing social policy and find the secret to improve the quality of life by reading this scandinavian perspective on the evaluation process.
Abstract: Find the secret to improve the quality of life by reading this scandinavian perspectives on the evaluators role in informing social policy. This is a kind of book that you need now. Besides, it can be your favorite book to read after having this book. Do you ask why? Well, this is a book that has different characteristic with others. You may not need to know who the author is, how well-known the work is. As wise word, never judge the words from who speaks, but make the words as your good value to your life.
TL;DR: The meaning of modernization as a strategy for reforming the Danish welfare state must be deconstructed in order to reveal a proper role for evaluation practice as mentioned in this paper, which is not the case in Denmark.
Abstract: The meaning of modernization as a strategy for reforming the Danish welfare state must be deconstructed in order to reveal a proper role for evaluation practice.
TL;DR: Evaluation practice conceived in terms of a Socratic dialogue offers a particular kind of benefit for evaluation in a Swedish political context as discussed by the authors, and it has been applied in a variety of contexts.
Abstract: Evaluation practice conceived in terms of a Socratic dialogue offers a particular kind of benefit for evaluation in a Swedish political context.
TL;DR: The investment tax credit is a familiar example of a tax expenditure as mentioned in this paper, and the evaluation of its effectiveness described in this chapter provides a model for evaluating other tax expenditures, such as the tax credit.
Abstract: The investment tax credit is a familiar example of a tax expenditure. The evaluation of its effectiveness described in this chapter provides a model for evaluating other tax expenditures.
TL;DR: The authors reviewed the complex dynamic, political, and contextual factors that influence social programming, and from these conclusions about the conduct of emergent realist evaluation, and drew conclusions about how to evaluate social programming.
Abstract: Social programming is an evolved mechanism for addressing social needs (among other things). Evaluation focuses largely on social programs. We review selected aspects of the complex dynamic, political, and contextual factors that influence social programming, and from these we draw conclusions about the conduct of emergent realist evaluation.
TL;DR: The development of and prospects for Danish evaluation practice are best understood in light of an examination of two cultures of Danish social science as discussed by the authors, in which the development of evaluation practice is best understood by considering two cultures.
Abstract: The development of and prospects for Danish evaluation practice are best understood in light of an examination of two cultures of Danish social science.
TL;DR: In this article, the authors provide a brief history of the role that evaluation has played in Norwegian industrial development efforts and offer a critical commentary on the current state-of-the art.
Abstract: The author provides a brief history of the role that evaluation has played in Norwegian industrial development efforts and offers a critical commentary on the current state of the art.
TL;DR: The current philosophy and politics of social reform strategies in Norway pose unique challenges and opportunities for evaluation theory as discussed by the authors, as well as the challenges of evaluation theory in social reform in Norway.
Abstract: The current philosophy and politics of social reform strategies in Norway pose unique challenges and opportunities for evaluation theory.
TL;DR: In this article, tax expenditure evaluations are compared against a simple but sturdy general framework for conducting results evaluations that looks at target populations; the treatment, program, or policy; the response variable; how relative effects are estimated; and what happens when no effects are discovered.
Abstract: What does the work on tax expenditures over, the last decade imply about the better design of evaluations in this area? The tax expenditure evaluations are compared against a simple but sturdy general framework for conducting results evaluations that looks at target populations; the treatment, program, or policy; the response variable; how relative effects are estimated; and what happens when no effects are discovered.
TL;DR: In this paper, the authors describe the tax incentive for flow-through shares in mining and energy companies in Canada and discuss an evaluation of its performance conducted by the Department of Finance Canada.
Abstract: Flow-through shares are an income tax incentive for certain equity investments in mining and energy companies in Canada. This chapter describes this tax incentive and discusses an evaluation of its performance conducted by the Department of Finance Canada.
TL;DR: In this paper, a framework for tax expenditures is presented in the form of answers to five questions: what are they, what they are used for, how big they are, who benefits from them, and who loses.
Abstract: A framework for thinking about tax expenditures is presented in the form of answers to five questions: what are they, what are they used for, how big are they, who benefits from them, and who loses? Distinctions are discussed among the use of tax expenditures to fine-tune ability to pay, to influence economic behavior, to mimic the features of a direct-spending program, and for other purposes.
TL;DR: The evaluation used multiple methods and data sources both to enrich findings and to protect against unwarranted conclusions as mentioned in this paper. But the evaluation was limited to a single state program with similar features.
Abstract: Enterprise zones are intended to revitalize America's economically distressed cities and rural areas, relying primarily on tax and regulatory relief to encourage private investment in areas that otherwise might be unattractive. Congress requested a prospective evaluation based on a state program with similar features. The evaluation used multiple methods and data sources both to enrich findings and to protect against unwarranted conclusions.
TL;DR: The Earned Income Tax Credit (EITC) is the largest cash or near-cash program available to low-income families in the United States as discussed by the authors, and it has been extensively studied.
Abstract: The Earned Income Tax Credit is expected to cost the federal government $27.1 billion in 1998, making it the largest cash or near-cash program available to low-income families in the United States. Strategies most commonly employed to gain insight into the central issues of this tax credit include data sleuthing, simulations, natural experiments comparing participant and control groups, and cross-sectional econometric techniques.
TL;DR: In this paper, a study of the impact of employee stock ownership plans on corporate performance illustrates the possibility of using tax data for a quasi-experimental design and some attendant evaluation issues.
Abstract: A study of the impact of employee stock ownership plans on corporate performance illustrates the possibility of using tax data for a quasi-experimental design and some attendant evaluation issues.