Author Ray Pawson presents a devastating critique of the dominant approach to systematic review namely the 'meta-analytic' approach as sponsored by the Cochrane and Campbell collaborations. In its place is commended an approach that he terms 'realist synthesis'. On this vision, the real purpose of systematic review is better to understand program theory, so that policies Author Ray Pawson presents a devastating critique of the dominant approach to systematic review namely the 'meta-analytic' approach as sponsored by the Cochrane and Campbell collaborations. In its place is commended an approach that he terms 'realist synthesis'. On this vision, the real purpose of systematic review is better to understand program theory, so that policies can be properly targeted and developed to counter an ever-changing landscape of social problems. The book will be essential reading for all those who loved (or loathed) the arguments developed in Realistic Evaluation (Sage, 1997). It offers a complete blueprint for research synthesis, supported by detailed illustrations and worked examples from across the policy waterfront.

Evidence-based Policy: A Realist Perspective

Aspects of Scientific Explanation: and Other Essays in the Philosophy of Science

Causes and conditions.

This issue of Development Policy Review arises from a study of the impact and effectiveness of transparency and accountability initiatives (TAIs) in different development sectors. It analyses existing evidence, discusses how approaches to learning about TAIs might be improved, and recommends how impact and effectiveness could be enhanced.

/pdf/the-impact-of-transparency-and-accountability-initiatives-2g4q5ih4u4.pdf

The Impact of Transparency and Accountability Initiatives

Rising standards for accurately inferring the impact of development projects has not been matched by equivalently rigorous procedures for guiding decisions about whether and how similar results might be expected elsewhere. These ‘external validity’ concerns are especially pressing for ‘complex’ development interventions, in which the explicit purpose is often to adapt projects to local contextual realities and where high quality implementation is paramount to success. A basic analytical framework is provided for assessing the external validity of complex development interventions. It argues for deploying case studies to …

/pdf/using-case-studies-to-explore-the-external-validity-of-1tlsfpbiwr.pdf

Using case studies to explore the external validity of 'complex' development interventions

Diese Studie behandelt schwierige methodologische und theoretische Herausforderungen, mit denen jene konfrontiert sind, welche die Auswirkungen internationaler Entwicklungspolitik bewerten wollen. Die meisten Investitionen in die Wirkungsevaluierung (WE) sind bisher in einen engen Teilbereich von vorwiegend experimentellen und statistischen Methoden und Entwurfen gegangen, die nach DFID nur auf einen kleinen Teil ihres derzeitigen Programmportfolios anwendbar sind. Diese Studie soll das Spektrum erweitern und komplexe und schwer zu evaluierende Programme mit den Moglichkeiten der WE erschliesen. Die Studie betrachtet die bestehende WE-Praxis, uberpruft die Literatur zu den Methoden und beurteilt, wie hochmoderne Evaluierungsentwurfe und -methoden bei aktuellen Entwicklungsprogrammen angewendet werden konnten.

N. Stame

Papers

DFID Working Paper 38. Broadening the range of designs and methods for impact evaluations.