scispace - formally typeset
Search or ask a question

Showing papers in "Evaluation and Program Planning in 1989"


Journal ArticleDOI
TL;DR: Each step in the process is described, major methodological issues and problems are considered, and computer programs which can be used to accomplish the process are discussed.

1,333 citations


Journal ArticleDOI
TL;DR: Pattern matching is a general framework which can guide the use of theory within program evaluation as mentioned in this paper, which minimally involves the specification of a theoretical pattern, the acquisition of an observed pattern, and an attempt to match these two.

528 citations


Journal ArticleDOI
TL;DR: In this article, the scientific side of concept mapping is viewed as soft science and the artistic one as hard art to imply that the process has some qualities of both, but probably does not fall exclusively within either's domain.

247 citations


Journal ArticleDOI
TL;DR: There is a strong movement in program evaluation to move from black box evaluations, concerned primarily with the relationship between the inputs and outputs of a program, to theory-oriented evaluations as discussed by the authors.

141 citations


Journal ArticleDOI
TL;DR: Development of a self-report Service Satisfaction Scale designed to measure consumer response to both health and mental health services is described and two interpretable satisfaction factors were consistently found across services.

121 citations


Journal ArticleDOI
TL;DR: Four different theory forms are described and analyzed: causal modeling, the “basic two-step,” stage-state theory, and substantive models, and three practical approaches to theory development are discussed.

121 citations


Journal ArticleDOI
TL;DR: In this paper, the authors developed ways of quantifying interventions so that strength may be related to outcome and so that results of different interventions may be more usefully compared, and incorporated theory into planning of interventions and their evaluation.

58 citations


Journal ArticleDOI
TL;DR: In this paper, the authors outline the conceptual framework of the theory-driven perspective and provide a heuristic scheme which enables stakeholders and evaluators to work together to select a theorydriven evaluation that fits the nature of the program and stakeholders' needs within the constraints of resources and timeliness.

56 citations


Journal ArticleDOI
TL;DR: In this article, the authors outline a conceptual model of evaluation research that has both guided and flowed from their research on the process and outcome of treatment for alcohol abuse and for depression.

49 citations


Journal ArticleDOI
TL;DR: The authors discusses ways in which attention to face validity and working with stakeholders' own theory of action may be more appropriate ways to proceed for evaluations that are more action-oriented than "truth "oriented.

44 citations


Journal ArticleDOI
TL;DR: Variations of the structured conceptualization process were conducted with three different groups; nurses, patients, and nurse theorist/researchers and a separate concept map was derived for each group.

Journal ArticleDOI
TL;DR: A consumer satisfaction scale was developed for psychiatric inpatients and subjects discriminated areas of satisfaction by expressing higher levels of dissatisfaction on the factors of Trust of Staff and Hospital Environment.

Journal ArticleDOI
TL;DR: In this paper, the authors argue that it may not be possible to achieve external validity, particularly if the adaptive and evolutionary theories of implementation are correct, and it may be better to move away from causal to other forms of theorizing to get out of the validity dilemma.

Journal ArticleDOI
TL;DR: The general conclusion is that despite the more demanding requirements of the modelling strategy, it promises a greater yield of policy relevant conclusions than do evaluation designs in the “black box” tradition.

Journal ArticleDOI
TL;DR: In this paper, the authors describe how concept mapping was used to organize a conceptual framework from which a questionnaire was constructed, in order to evaluate the One-to-One Big Brother/Big Sister youth program.

Journal ArticleDOI
TL;DR: Suggestions for increasing the use of program theory include improving the education and training of evaluators, changing journal policies, and augmenting the methodology for theory development.

Journal ArticleDOI
TL;DR: In this paper, a case study of women in Fordham University's EXCEL reentry program for adults demonstrates the use of this method in the descriptive and exploratory phase of research.

Journal ArticleDOI
TL;DR: In this paper, the authors describe the use of structured conceptualization to develop a framework for understanding the concept of feminism and describe the advantages of using this method for understanding women's issues.

Journal ArticleDOI
TL;DR: In this article, the authors used a pattern matching approach to assess the degree of construct validity using the multitrait-multimethod (MTMM) matrix framework, which is the most widely known and used method for establishing construct validity.

Journal ArticleDOI
Marc Mannes1
TL;DR: In this article, the authors used concept mapping to analyze and compare the process of planning to implement a specific social technology, known as family based intensive in-home services (FABIIHS), which has demonstrated effectiveness in certain settings and is being adopted in two new sites (the Upper Peninsula of Michigan and the Rio Grande Corridor in New Mexico).

Journal ArticleDOI
TL;DR: This paper expands the component-oriented approach to evaluation of program effectiveness, examining interventions at a level where operational definitions can be employed and replicability is possible and is expanded using the example of case management programs.

Journal ArticleDOI
Douglas Keith1
TL;DR: The method that was used to control the effects of these strong, but experimentally irrelevant, category-based associations which subjects in this study made among certain items in a subset of the data is described.

Journal ArticleDOI
TL;DR: Pattern matching is an approach for determining the correspondence between program theory and the observations or data collected from a program based on that theory as mentioned in this paper, and it is used to provide evidence for the construct validity of an instrument developed for a program evaluation.

Journal ArticleDOI
Jeanne Dumont1
TL;DR: The authors examined the validity of multidimensional scaling in the context of structured conceptualization using hand constructed and computer maps and found congruence at specific results and significant differences at the level of whole map findings.

Journal ArticleDOI
TL;DR: In this article, the authors describe three general issues that elaborate on Chen and Rossi's framework: (a) limitations imposed by the policy context; (b) alternative conceptualizations to optimize validity; and (c) alternative procedures (e.g., logical ordering, examining interrelationships among specific threats to validity, and pragmatics) for establishing priorities among the four classes of threats.


Journal ArticleDOI
H.S. Bhola1
TL;DR: Action Training Model (ATM) as mentioned in this paper was developed to overcome many of the problems identified in currently available approaches to evaluation training in non-academic settings in the Third World.

Journal ArticleDOI
TL;DR: In this article, the authors describe the realities of organizational decision making, in contrast to the simple unitary rational actor model's predictions, and clarify the findings of an evaluation of an energy audit program for organizations.

Journal ArticleDOI
TL;DR: In this paper, a review of the theoretical debate surrounding self-selection bias and methods to mitigate and control the problem is presented, concluding that the issue of selfselection should not undermine our confidence in the results of a well-designed evaluation.

Journal ArticleDOI
TL;DR: In this article, the authors describe several methods of utilizing simplified time series analysis (STSA) when there are attrition/augmentation problems and discuss strengths and weaknesses of each approach.