Showing papers in "New Directions for Program Evaluation in 1992"
TL;DR: The coupling of interorganizational theory and social network analysis techniques provides a way of assessing systems of services at the community level for children and youth with severe emotional disturbances as discussed by the authors, which can be used to assess the effectiveness of services.
Abstract: The coupling of interorganizational theory and social network analysis techniques provides a way of assessing systems of services at the community level for children and youth with severe emotional disturbances.
46 citations
TL;DR: In this paper, no method of classifying mental health services is accepted by all service sectors and no standardization of methods must be achieved, because classification is central to understanding the service delivery system for children and families.
Abstract: Currently, no method of classifying mental health services is accepted by all service sectors. Because classification is central to understanding the service delivery system for children and families, standardization of methods must be achieved.
41 citations
TL;DR: Ethnic and racial minorities have the most at stake in the evaluation of social services and educational programs, yet advocates of the participation of multiple stakeholders in evaluation seldom include minority participants in the process.
Abstract: Advocates of the participation of multiple stakeholders in evaluation seldom include minority participants in the process, yet ethnic and racial minorities have the most at stake in the evaluation of social services and educational programs.
21 citations
TL;DR: Studies of children's mental health services have suffered from low internal validity, and suggestions are provided on ways to improve the design of future evaluations.
Abstract: Studies of children's mental health services have suffered from low internal validity. Suggestions are provided on ways to improve the design of future evaluations.
18 citations
TL;DR: In this paper, voices from one multicultural evaluation convey a sense of the struggle involved in developing an evaluation that is sensitive to and empowering of multicultural peoples and perspectives, as well as their perspectives.
Abstract: In this chapter, voices from one multicultural evaluation convey a sense of the struggle involved in developing an evaluation that is sensitive to and empowering of multicultural peoples and perspectives.
15 citations
TL;DR: In this paper, a chorale of many voices is used to invite dialogue with the people affected and, in so doing, become a choral ensemble of many different voices.
Abstract: Program evaluation can invite dialogue with the people affected and, in so doing, become a chorale of many voices.
13 citations
TL;DR: Three broad domains of outcomes (psychopathology, social competence, and satisfaction) are explored from the vantage points of client, professional, and societal stakeholders.
Abstract: A client-level focus is needed when examining the effectiveness of mental health interventions. Three broad domains of outcomes (psychopathology, social competence, and satisfaction) are explored from the vantage points of client, professional, and societal stakeholders.
12 citations
TL;DR: For example, program evaluators often use race as an explanatory variable without clearly articulating what race means in an evaluation context as discussed by the authors, which makes it difficult for the evaluator to understand what race actually means.
Abstract: Program evaluators often use race as an explanatory variable without clearly articulating what race means in an evaluation context.
11 citations
Journal Article•
TL;DR: The 55th volume of the New Directions for Evaluation series as discussed by the authors is the most recent volume, which includes government documents pertaining to evaluation as well as contributions from federal evaluators and administrators, outlining the duties, responsibilities, and methodological approaches of various government offices with evaluative functions.
Abstract: A significant report on a critical topic, this classic volume of the New Directions for Evaluation series is now in print and available again This issue, which includes government documents pertaining to evaluation as well as contributions from federal evaluators and administrators, outlines the duties, responsibilities, and methodological approaches of the various government offices with evaluative functions, and details some of the strategies used by these agencies to cope with the twin pressures of reduced funding and greater calls to demonstrate the effectiveness of government programs pressures first felt in the 1980s and which continue to the present day The contributors discuss federal evaluation agencies in three broad categories: executive branch social agencies, such as the Department of Health and Human Services and the Department of Housing and Urban Development, where the cutbacks were the most severe; the three so-called central executive branch agencies the Office of Management and Budget, the Office of Personnel Management, and the General Services Administration where cutbacks were less severe but still significant, and where attitudes towards evaluation varied over time; and the evaluative agencies of the legislative branch the General Accounting Office, the Congressional Budget Office, the Congressional Research Service, and the Office of Technology Assessment where evaluation remained fairly robust and well-funded This is the 55th volume of the quarterly report series New Directions for Evaluation
10 citations
TL;DR: A description of the characteristics of investigative inquiry can illuminate examples of evaluation practice that are increasingly investigative as mentioned in this paper, which can be found in the article "The characteristics of the investigative inquiry".
Abstract: A description of the characteristics of investigative inquiry can illuminate examples of evaluation practice that are increasingly investigative.
9 citations
Journal Article•
TL;DR: Using standardized test scores to determine program effectiveness may contribute to further inequities in education.
Abstract: Using standardized test scores to determine program effectiveness may contribute to further inequities
TL;DR: This article pointed out that early evaluation efforts can be criticized as costly, time-consuming, and in need of clearer focus, and critics overlook the fact that evaluation is a relatively new profession and will require time to develop a solid place in public management.
Abstract: Program evaluation has been all but eliminated from government as a normal part of program management and needs to be rebuilt. Although early evaluation efforts can be criticized as costly, time-consuming, and in need of clearer focus, critics overlook the fact that evaluation is a relatively new profession and will require time to develop a solid place in public management.
TL;DR: This chapter highlights unique problems and challenges to evaluators studying systems of care for children's mental health that are being used to improve the availability and effectiveness of services.
Abstract: Recent developments in the field of children's mental health, particularly the development of community-based systems of care, are being used to improve the availability and effectiveness of services for children. This chapter highlights unique problems and challenges to evaluators studying these systems of care.
TL;DR: In this paper, the authors present an essential part of government administration, which needs to be used in the most efficient and effective manner, and this necessity was never more pressing than today, when the country faces a growing list of unmet social needs.
Abstract: Evaluation is an essential part of government administration. Scarce public resources need to be used in the most efficient and effective manner. This necessity was never more pressing than today, when the country faces a growing list of unmet social needs.
TL;DR: In this article, issues for program evaluation are raised through an analysis of previous integrative research in multicultural teacher education, and issues for evaluation are identified through a qualitative evaluation of program evaluation.
Abstract: Issues for program evaluation are raised through an analysis of previous integrative research in multicultural teacher education.
TL;DR: In this article, the evaluation in international technical assistance programs places a unique set of pressures on the evaluator, which in turn places special demands on the investigative strategies employed. But the evaluation of technical assistance is a difficult and time-consuming process.
Abstract: Evaluation in international technical assistance programs places a unique set of pressures on the evaluator, which in turn places special demands on the investigative strategies employed.
TL;DR: A search for alternative management strategies and evaluation techniques has allowed the function of education to survive and prosper as discussed by the authors, and has enabled the function to be evaluated in the U.S. Department of Education.
Abstract: Evaluation in the U.S. Department of Education declined significantly in the early 1980s. But a search for alternative management strategies and evaluation techniques has allowed the function to survive and prosper.
TL;DR: In this paper, auditors concentrate on comparing a condition against a criterion; evaluators concentrate on what has occurred, estimating what would have occurred without the program and comparing the two situations to determine program effects.
Abstract: Evaluation specialists and auditors are working side by side to improve program performance. Auditors concentrate on comparing a condition against a criterion; evaluators concentrate on what has occurred, estimating what would have occurred without the program and comparing the two situations to determine program effects.
TL;DR: In this article, the need for research that integrates costs and outcomes is asserted, and some of the challenges associated with this research are explored, and an emphasis is placed on cost-effectiveness analysis and development of a mental health outcomes measure appropriate for this technique.
Abstract: The need for research that integrates costs and outcomes is asserted, and some of the challenges associated with this research are explored. An emphasis is placed on cost-effectiveness analysis and development of a mental health outcomes measure appropriate for this technique.
TL;DR: Investigative methods can play a role in the development of programs and policies as well as in their evaluation as mentioned in this paper, and they have been shown to play an important role in improving the performance of programs.
Abstract: Investigative methods can play a role in the development of programs and policies as well as in their evaluation.
TL;DR: Using rapid, in-house evaluation, the inspectors general have helped top decision makers improve program efficiency, effectiveness, and integrity at many federal departments as discussed by the authors, and have helped to improve program effectiveness and integrity.
Abstract: Using rapid, in-house evaluation, the inspectors general have helped top decision makers improve program efficiency, effectiveness, and integrity at many federal departments
TL;DR: In 1988, the comptroller general of the United States, Charles A. Bowsher, issued the report Program Evaluation Issues, which documented a serious decline in program evaluation capacity in the federal government.
Abstract: In November 1988, the comptroller general of the United States, Charles A. Bowsher, issued the report Program Evaluation Issues, which documented a serious decline in program evaluation capacity in the federal government. Reproduced below is his letter transmitting the report to the executive and legislative branches of government. The letter is significant because it is an unusually clear and forceful—and rare—statement of the essential role of program evaluation in government.
TL;DR: Evaluators can use criminal investigation findings to focus and design program evaluations as discussed by the authors, which can be used to improve program evaluation quality and reduce program evaluation time, but it is not always appropriate.
Abstract: Evaluators can use criminal investigation findings to focus and design program evaluations.
TL;DR: In this article, the authors have documented a serious decline in executive branch evaluation capacity, as reflected in declining budget and staff resources and a narrowing of the methods employed and issues examined.
Abstract: General Accounting Office studies have documented a serious decline in executive branch evaluation capacity, as reflected in declining budget and staff resources and a narrowing of the methods employed and issues examined. However, increasing interest by the Office of Management and Budget and recent steps taken to encourage program evaluation should lead to its broader application and more frequent use.
TL;DR: P Procedural and methodological issues that are critical to the application of these instruments in mental health evaluation studies are discussed here.
Abstract: Numerous interview instruments are available to determine diagnosis and assess symptomatology in children and adolescents. Procedural and methodological issues that are critical to the application of these instruments in mental health evaluation studies are discussed here.
TL;DR: The Congressional Research Service provides analytical work on request to members of Congress as mentioned in this paper, but some of this is short-term information and background research, but some is substantial in-depth research and analysis.
Abstract: The Congressional Research Service provides analytical work on request to members of Congress. Much of this is short-term information and background research, but some is substantial in-depth research and analysis. Analysis is almost always based on secondary data and rarely employs sophisticated methodologies.
TL;DR: The Congressional Budget Office (CBO) provides analytical advice to Congress on the development of the national budget as mentioned in this paper, which involves the use of analytical evaluation techniques, especially cost-effectiveness and cost-benefit analysis, based mostly on secondary data.
Abstract: The Congressional Budget Office provides analytical advice to Congress on the development of the national budget. While its work is not strictly program evaluation, it does involve the use of analytical evaluation techniques, especially cost-effectiveness and cost-benefit analysis, based mostly on secondary data.
TL;DR: In this paper, a modified evaluation audit and a case study evaluation are presented to illustrate two different approaches to investigation, and salient features of the modified audit and case study are discussed.
Abstract: Salient features of a modified evaluation audit and a case study evaluation are presented to illustrate two different approaches to investigation.