Showing papers in "New Directions for Program Evaluation in 1986"
TL;DR: The emergence of a new paradigm of inquiry (naturalistic) has led to a demand for rigorous criteria that meet traditional standards of inquiry, and two sets are suggested, one of which, the “trustworthiness” criteria, parallels conventional criteria, while the second, “authenticity" criteria, is implied directly by new paradigm assumptions.
Abstract: The emergence of a new paradigm of inquiry (naturalistic) has, unsurprisingly enough, led to a demand for rigorous criteria that meet traditional standards of inquiry. Two sets are suggested, one of which, the “trustworthiness” criteria, parallels conventional criteria, while the second, “authenticity” criteria, is implied directly by new paradigm assumptions.
2,372 citations
TL;DR: This paper pointed out serious shortcomings in DEA's treatment of price efficiency, illustrates the dangers of misspecification errors in DEA, and suggests extentions of the basic DEA formulation that address these shortcomings.
Abstract: This chapter points out serious shortcomings in DEA's treatment of price efficiency, illustrates the dangers of misspecification errors in DEA, and suggests extentions of the basic DEA formulation that address these shortcomings.
1,173 citations
TL;DR: In this paper, the concept of proximal similarity is substituted for external validity in the notion of local molar causal validity in quasi-experimental research, which can be seen as an alternative to external validity.
Abstract: Confusion about the meaning of validity in quasi-experimental research can be addressed by carefully relabeling types of validity. Internal validity can more aptly be termed “local molar causal validity.” More tentatively, the “principle of proximal similarity” can be substituted for the concept of external validity.
216 citations
TL;DR: Data envelopment analysis is a linear programming–based method that has clear advantages over competing approaches, but its own limitations should not be overlooked.
Abstract: Data envelopment analysis is a linear programming–based method that has clear advantages over competing approaches. However, its own limitations should not be overlooked.
158 citations
TL;DR: There are circumstances in which the evaluator can and should choose to use multiple methods and approaches to answer evaluative questions as mentioned in this paper, and this is the case in many cases.
Abstract: There are circumstances in which the evaluator can and should choose to use multiple methods and approaches to answer evaluative questions.
46 citations
TL;DR: In this paper, DEA can be used to identify real hospital inefficiencies and opportunities for cost reduction that more traditional techniques do not reveal, and to improve the efficiency and reducing the cost of health care is a particularly complex task.
Abstract: Improving the efficiency and reducing the cost of health care is a particularly complex task, DEA can be used to identify real hospital inefficiencies and opportunities for cost reduction that more traditional techniques do not reveal.
44 citations
TL;DR: In this article, the coherent use of historical analysis, life history, and ethnographic observation is illustrated for life history and life history analysis, and the use of life history information is discussed.
Abstract: The coherent use of historical analysis, life history, and ethnographic observation is illustrated.
43 citations
TL;DR: In this article, the authors go beyond the primary concerns of validity typologies by studying causal process and by being explicit about the reasoning that underlies their inferences, which can enhance our understanding of quasi-experiments.
Abstract: Validity typologies can enhance our understanding of quasi-experiments, but they can also serve as blinders. We can go beyond the primary concerns of validity typologies by studying causal process and by being explicit about the reasoning that underlies our inferences.
43 citations
TL;DR: The role of human judgment in the development and synthesis of evidence has not been adequately developed or acknowledged within quasi-experimental analysis as mentioned in this paper, which requires not only consideration of plausible rival explanations but evidence that the purported causal agent is itself plausible.
Abstract: The role of human judgment in the development and synthesis of evidence has not been adequately developed or acknowledged within quasi-experimental analysis. Like ordinary causal inference, comprehensive causal analysis requires not only consideration of plausible rival explanations but evidence that the purported causal agent is itself plausible.
42 citations
TL;DR: Since it is usually the case that no defensible option for performing a task within quasi-experimentation is unbiased, it is desirable to select several options that reflect biases in different directions.
Abstract: Since it is usually the case that no defensible option for performing a task within quasi-experimentation is unbiased, it is desirable to select several options that reflect biases in different directions. This aim is to avoid constant biases and to overlook only those biases that can be considered least plausible.
29 citations
TL;DR: In this paper, the authors explain the biases of causal models and show how to take them into account, and present a discussion of how to overcome these biases and how to improve them.
Abstract: Causal models often omit variables that should be included, use variables that are measured fallibly, and ignore time lags. Such practices can lead to severely biased estimates of effects. The discussion explains these biases and shows how to take them into account.
TL;DR: This training directory can guide prospective students as well as provide insights into the current state of evaluation training.
Abstract: This training directory can guide prospective students as well as provide insights into the current state of evaluation training.
TL;DR: In this article, a few simple questions about the context of an evaluation can help decide if a naturalistic approach is appropriate for a given evaluation, and they also show that naturalistic approaches may not always be appropriate.
Abstract: Asking a few simple questions about the context of an evaluation can help you decide if a naturalistic approach is appropriate.
TL;DR: Data envelopment analysis and related techniques are applied in an evaluation of the performance efficiency of various classifications of national parks.
Abstract: Data envelopment analysis and related techniques are applied in an evaluation of the performance efficiency of various classifications of national parks.
TL;DR: Although disciplines differ in their curricular emphases, there is increasing agreement about the general topics evaluation courses should address as mentioned in this paper, and there is also increasing agreement that general topics should be addressed in evaluation courses.
Abstract: Although disciplines differ in their curricular emphases, there is increasing agreement about the general topics evaluation courses should address.
TL;DR: The diversity and abundance of course materials used to teach educational evaluation reflect its varied roles and demands as mentioned in this paper, and a single core course cannot produce evaluation competence, since it is not suitable for all learners.
Abstract: The diversity and abundance of course materials used to teach educational evaluation reflect its varied roles and demands. A single core course cannot produce evaluation competence.
TL;DR: If one undertakes naturalistic evaluation without formal training, there are some important considerations and sources of information to keep in mind.
Abstract: If one undertakes naturalistic evaluation without formal training, there are some important considerations and sources of information to keep in mind.
TL;DR: In this article, the authors present a web of ethical considerations in the design and implementation of a methodological design and its implementation, which are often entangled in a web-of-ethics.
Abstract: Methodological design and implementation are often entangled in a web of ethical considerations.
TL;DR: In this paper, the authors explore one particular interdisciplinary graduate evaluation course, discussing its content, products, strengths, and weaknesses, and discuss its content and products, products and weaknesses.
Abstract: This chapter explores one particular interdisciplinary graduate evaluation course, discussing its content, products, strengths, and weaknesses.
TL;DR: In this article, a case study dealing with the specifics of Native American education in Canada is presented, which is an example of educational change and takes its larger meaning from that reality.
Abstract: Permeated with ethical and political concerns, with racial, gender, and cultural differences, this case study deals with the specifics of Native American education in Canada. It is an example of educational change and takes its larger meaning from that reality.
TL;DR: Modeling the process by which participants are selected into groups, rather than adjusting for preexisting group differences, provides the basis for several new approaches to the analysis of data from nonrandomized studies.
Abstract: Modeling the process by which participants are selected into groups, rather than adjusting for preexisting group differences, provides the basis for several new approaches to the analysis of data from nonrandomized studies.
TL;DR: In this paper, the authors view courses in evaluation research as integral parts of advanced degree training in public health, and discuss three such courses, which are discussed in detail in detail.
Abstract: This chapter views courses in evaluation research as integral parts of advanced degree training in public health. Three such courses are discussed.
TL;DR: In this article, the authors explore the issues faced by teachers who want to integrate program evaluation into the curriculum of schools of management, and discuss the challenges faced by such teachers in doing so.
Abstract: This chapter explores the issues faced by teachers who want to integrate program evaluation into the curriculum of schools of management.
TL;DR: The character and content of Northwestern's joint program in methodology research and clinical research is described and subject matter for the core evaluation courses is discussed in this article, where the authors discuss the subject matter of the evaluation courses.
Abstract: The character and content of Northwestern's joint program in methodology research and clinical research is described and the subject matter for the core evaluation courses is discussed.