American Journal of Evaluation 

About: American Journal of Evaluation is an academic journal published by SAGE Publishing. The journal publishes majorly in the area(s): Program evaluation & Theory of change. It has an ISSN identifier of 1098-2140. Over the lifetime, 1177 publications have been published receiving 42336 citations. The journal is also known as: The American journal of evaluation.

A General Inductive Approach for Analyzing Qualitative Evaluation Data

Abstract: A general inductive approach for analysis of qualitative evaluation data is described. The purposes for using an inductive approach are to (a) condense raw textual data into a brief, summary format; (b) establish clear links between the evaluation or research objectives and the summary findings derived from the raw data; and (c) develop a framework of the underlying structure of expe- riences or processes that are evident in the raw data. The general inductive approach provides an easily used and systematic set of procedures for analyzing qualitative data that can produce reliable and valid findings. Although the general inductive approach is not as strong as some other analytic strategies for theory or model development, it does provide a simple, straightforward approach for deriving findings in the context of focused evaluation questions. Many evaluators are likely to find using a general inductive approach less complicated than using other approaches to qualitative data analysis.

Fidelity Criteria: Development, Measurement, and Validation.

Abstract: Fidelity may be defined as the extent to which delivery of an intervention adheres to the protocol or program model originally developed. Fidelity measurement has increasing significance for evaluation, treatment effectiveness research, and service administration. Yet few published studies using fidelity criteria provide details on the construction of a valid fidelity index. The purpose of this review article is to outline steps in the development, measurement, and validation of fidelity criteria, providing examples from health and education literatures. We further identify important issues in conducting each step. Finally, we raise questions about the dynamic nature of fidelity criteria, appropriate validation and statistical analysis methods, the inclusion of structure and process criteria in fidelity assessment, and the role of program theory in deciding on the balance between adaptation versus exact replication of model programs. Further attention to the use and refinement of fidelity criteria is important to evaluation practice.

Unpacking Black Boxes: Mechanisms and Theory Building in Evaluation:

Abstract: There is growing interest in the concept of ‘‘mechanism’’ across many areas of the social sciences. In the field of program and policy evaluation, a number of scholars have also emphasized the importance of causal mechanisms for explaining how and why programs work. However, there appears to be some ambiguity about the meaning and uses of mechanism-based thinking in both the social science and evaluation literature. In this article we attempt to clarify what is meant by mechanisms in the context of program evaluation by identifying three main characteristics of mechanisms and outlining a possible typology of mechanisms. A number of theoretical and practical implications for evaluators are also discussed, along with some precautions to consider when investigating mechanisms that might plausibly account for program outcomes.

Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability:

Abstract: An important final step in the life cycles of programs and their evaluation involves assessing new programs’ or innovations’ sustainability. This review and synthesis of 19 empirical studies of the sustainability of American and Canadian health-related programs examines the extent of sustainability achieved and summarizes factors contributing to greater sustainability. Three definitions for measuring sustainability were examined: continued program activities (18 studies), continued measured benefits or outcomes for new clients (2 studies), and maintained community capacity (6 studies). Methods of studying sustainability were also assessed. In 14 of 17 studies covering the continuation of program activities, at least 60% of sites reported sustaining at least one program component. Although these studies’ methods had substantial limitations, cross-study analysis showed consistent support for five important factors influencing the extent of sustainability: (a) A program can be modified over time, (b) a “cham...