Dictionary of Statistics and Methodology.

Our online web service was introduced by using a wish to work as a comprehensive on the web electronic digital collection that gives access to many PDF file e-book catalog. You could find many kinds of e-guide as well as other literatures from your documents data base. Particular preferred subjects that spread out on our catalog are famous books, solution key, assessment test questions and solution, guide sample, training information, test test, user handbook, consumer guidance, support instruction, repair handbook, and so forth.

Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation

Foundations of program evaluation: Theories of practice

There is paucity of detailed information in the literature on how to develop procedures for estimating content validity to increase trustworthiness of assessment instruments. The authors present three unique examples, interpretation, and application of Tables of Specifications (ToS) for generating these estimates. The development and logic of the ToS requires presenting evidence that has transparency and creates trustworthiness in the validity estimates by maintaining an audit trail and using of triangulation, expert debriefing, and peer review. The argument presented is that content validity requires a mixed methods approach since data are developed through qualitative and quantitative methods that inform each other. This process is iterative and provides feedback on the effectiveness of the ToS through a process of determining consensus.

Content validity using a mixed methods approach: Its application and development through the use of a table of specifications methodology

REALWORLD EVALUATION: WORKING UNDER BUDGET, TIME, DATA, AND POLITICAL CONSTRAINTS Michael Bamberger, Jim Rugh and Linda Mabry Thousand Oaks CA: Sage Publications 2006, PB xxxii + 468 pp, AUD 44.95, ISBN 1412909465The last two years have seen a flowering of fine books on evaluation. These have icluded the 7th edition of the world's top seller in the field (Rossi, Lipsey and Freeman's 2004 Evaluation: A Systematic Approach); the 3rd edition of Australian scholar John Owen's 2006 Program Evaluation: Forms and Approaches; Davidson's 2005 Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation (which may well become a core reference for students); and Mathieson's wonderful new 2005 Encyclopedia of Evaluation. These, and other new publications I could mention, support the contention that evaluation has become not only a profession, but also a discipline.Bamberger, Rugh and Mabry's 2006 RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints is the latest offering from Sage Publication's evaluation booklist. Bamberger is a private consultant and a former Senior Sociologist at the World Bank; Rugh is with CARE International; and Mabry a Washington State University academic. They have much experience in conducting evaluations and teaching evaluation concepts and practice in developing countries and elsewhere, and this solid experience permeates the book.The title conveys the way in which this book differs from so many others apparently covering similar ground: the numerous how-to evaluation resource books. The authors start with the real world of program evaluators, the world in which there is often insufficient money, time, data and political support to undertake sound evaluations. What, then, is the alternative to the types of evaluation research we would undertake - were there sufficient money, time, data and political support? The authors point out that, for far too many evaluators, the alternative is a 'quick and dirty' study; meaning one which lacks methodological rigour and ignores threats to the validity of the study's findings.'RealWorld evaluation' is defined as 'An approach developed for evaluations operating under budget, time, data and political constraints intended to maximise the rigor of methods and the validity of findings' (p. 439). RealWorld evaluation, as portrayed in this volume, has seven steps:(1) planning and scoping the evaluation;(2-5) directly addressing the budget, time and data constraints, along with the political influences;(6) strengthening the evaluation design and the validity of the conclusions; and(7) helping clients to use the evaluation's processes and products.These are the features, the authors argue, which make this book different from the many others covering program and policy evaluation.An example may assist. The chapter covering 'Critical information is missing or difficult to collect: addressing data constraints', deals seriatim with the following strategies: reconstructing baseline data, identifying and constructing comparison groups, problems of non-equivalent comparison groups, and collecting data on sensitive topics and from difficult-to-reach groups. In each area, specific research strategies to overcome the constraints are described and discussed. …

Realworld Evaluation: Working under Budget, Time, Data, and Political Constraints

/pdf/youth-participatory-evaluation-strategies-for-engaging-young-rijicx00n3.pdf

Youth Participatory Evaluation: Strategies for Engaging Young People

Participatory evaluation approaches have a relatively long history of advocacy and application in the international development evaluation community. Despite widespread use and apparent resonance with practitioners and donors alike, very little empirical research exists on why and how participatory evaluation approaches are used in international development settings. In this article, we present results derived from a mixed method investigation of a sample of practicing international development evaluators regarding their perceptions of how and why stakeholders are included in international development evaluations. Findings suggest that participatory evaluation approaches are interpreted and practiced in widely differing ways. Implications for international development evaluation practice and future research are discussed.

The Politics and Consequences of Including Stakeholders in International Development Evaluation

Background: Since the late 1970s participatory approaches have been widely promoted to evaluate international development programs. However, there is no universal agreement of what is meant by participatory evaluation.  For some evaluators, participatory evaluations involve the extensive participation of all stakeholder groups (from donor to non-recipients) in every phase of the evaluation (from design to dissemination). For others, the participation of donors in the design constitutes a participatory evaluation approach. Participatory evaluation approaches are best considered on a continuum. In other words, there are many gradations to participation and evaluations should be classified accordingly.  Purpose: The lack of shared meaning of participatory evaluation approaches also impedes serious discussion on their use including their merits and demerits, suggestions for their improvement, and their overall effectiveness. The purpose of this article is to present an examination of the literature on participatory evaluation approaches to highlight commonalities and differences. Setting: Not applicable Intervention: Not applicable. Research Design: Not applicable. Data Collection and Analysis: Desk review. Findings: This article clearly demonstrates how broadly participatory evaluation is conceptualized and practiced and underscores the clear need for specification and precision when discussing what is meant by participatory evaluation. Recommendations for how evaluators should describe participatory evaluations are provided. Keywords: participatory evaluation; collaborative evaluation; empowerment evaluation; stakeholder-based evaluation

/pdf/forms-and-functions-of-participatory-evaluation-in-3z3ex9h4qb.pdf

Forms and Functions of Participatory Evaluation in International Development: A Review of the Empirical and Theoretical Literature

In this paper, concept mapping techniques for planning and evaluating energy efficiency initiatives are presented using a case example from an evaluability assessment of a statewide initiative in the USA. Cluster maps, point cluster maps, cluster rating maps, pattern matches, go-zones, and other information are used to demonstrate how concept mapping can inform non-arbitrary, defensible decisions and subsequent actions for energy efficiency and renewable energy financing, program planning, and evaluation.

Using concept mapping for planning and evaluation of a statewide energy efficiency initiative

Participatory approaches to evaluation have long been vogue in the international development evaluation community. However, despite their widespread use, there is a dearth of research on the impact of stakeholder participation in international development evaluations. Although proponents of participatory approaches to international development evaluation assert many advantages of their use, the evidence to support these claims is largely anecdotal. Similarly, critics of participatory approaches do not have empirical data on which to base their assertions. Further confusing the matter are multiple and conflicting definitions of stakeholder and participation. Some interpret stakeholders to mean funders while others view stakeholders as those who are impacted by a program. Similarly, some view participation as any type of consultation with stakeholders, while others only deem side-by-side collaboration to be participation. Without systematic scrutiny, it is difficult to repudiate or substantiate any of these claims. In this dissertation the primary aim is to investigate this matter by undertaking a study that documents current practices and international development evaluators’ perceived consequences of stakeholder participation in development evaluation. The following research questions are addressed: Why are participatory approaches used in international development evaluations? How do evaluators and those who commission them decide which stakeholders should participate and the nature of their participation? What is the impact of participation on (i) validity and credibility, (ii) the usefulness and use of findings, (iii) implementation of the evaluation, (iv) fairness, (v) time and financial resources, (vi) social change, (vii) stakeholders’ technical research skills, and (viii) empowerment of stakeholders? The findings suggest that participatory evaluation approaches are interpreted and practiced in widely differing ways. Despite criticisms that participatory evaluation approaches sacrifice objectivity and validity via the inclusion of stakeholders, the results of this study provide evidence that evaluators typically maintain control of the evaluation process. Donor dominance of the evaluation process is another important finding of this study. These findings underscore the importance of clarity and the need for details when discussing participatory evaluation approaches. Implications for evaluation practice and future research are discussed.

/pdf/the-politics-and-consequences-of-stakeholder-participation-3yy0blcymk.pdf

Anne Cullen

Papers

Youth Participatory Evaluation: Strategies for Engaging Young People

The Politics and Consequences of Including Stakeholders in International Development Evaluation

Forms and Functions of Participatory Evaluation in International Development: A Review of the Empirical and Theoretical Literature

Using concept mapping for planning and evaluation of a statewide energy efficiency initiative

The Politics and Consequences of Stakeholder Participation in International Development Evaluation