This new edition of Ann Bowling's well-known and highly respected text has been thoroughly revised and updated to reflect key methodological developments in health research. It is a comprehensive, easy to read, guide to the range of methods used to study and evaluate health and health services. It describes the concepts and methods used by the main disciplines involved in health research, including: demography, epidemiology, health economics, psychology and sociology.The research methods described cover the assessment of health needs, morbidity and mortality trends and rates, costing health services, sampling for survey research, cross-sectional and longitudinal survey design, experimental methods and techniques of group assignment, questionnaire design, interviewing techniques, coding and analysis of quantitative data, methods and analysis of qualitative observational studies, and types of unstructured interviewing. With new material on topics such as cluster randomization, utility analyses, patients' preferences, and perception of risk, the text is aimed at students and researchers of health and health services. It has also been designed for health professionals and policy makers who have responsibility for applying research findings in practice, and who need to know how to judge the value of that research.

Research Methods in Health. Investigating health and health services

Public Management Reform. A Comparative Analysis

The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review. Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population. 145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage. Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.

/pdf/a-systematic-review-of-barriers-to-and-facilitators-of-the-44sn4xlod3.pdf

A systematic review of barriers to and facilitators of the use of evidence by policymakers

Context: Understanding how and why programs work—not simply whether they work—is crucial. Good theory is indispensable to advancing the science of improvement. We argue for the usefulness of ex post theorization of programs.

Methods: We propose an approach, located within the broad family of theory-oriented methods, for developing ex post theories of interventional programs. We use this approach to develop an ex post theory of the Michigan Intensive Care Unit (ICU) project, which attracted international attention by successfully reducing rates of central venous catheter bloodstream infections (CVC-BSIs). The procedure used to develop the ex post theory was (1) identify program leaders’ initial theory of change and learning from running the program; (2) enhance this with new information in the form of theoretical contributions from social scientists; (3) synthesize prior and new information to produce an updated theory.

Findings: The Michigan project achieved its effects by (1) generating isomorphic pressures for ICUs to join the program and conform to its requirements; (2) creating a densely networked community with strong horizontal links that exerted normative pressures on members; (3) reframing CVC-BSIs as a social problem and addressing it through a professional movement combining “grassroots” features with a vertically integrating program structure; (4) using several interventions that functioned in different ways to shape a culture of commitment to doing better in practice; (5) harnessing data on infection rates as a disciplinary force; and (6) using “hard edges.”

Conclusions: Updating program theory in the light of experience from program implementation is essential to improving programs’ generalizability and transferability, although it is not a substitute for concurrent evaluative fieldwork. Future iterations of programs based on the Michigan project, and improvement science more generally, may benefit from the updated theory present here.

Explaining Michigan: Developing an Ex Post Theory of a Quality Improvement Program

What is it that makes a profession a profession and assures its members special status? What do professionals need to be able to claim their turf and establish priority over others who interact wit...

The gold standard: the challenge of evidence-based medicine and standardization in health care

Background: The gap between research findings and clinical practice is well documented and a range of interventions has been developed to increase the implementation of research into clinical practice. Findings: A review of systematic reviews of the effectiveness of interventions designed to increase the use of research in clinical practice. A search for relevant systematic reviews was conducted of Medline and the Cochrane Database of Reviews 1998-2009. 13 systematic reviews containing 313 primary studies were included. Four strategy types are identified: audit and feedback; computerised decision support; opinion leaders; and multifaceted interventions. Nine of the reviews reported on multifaceted interventions. This review highlights the small effects of single interventions such as audit and feedback, computerised decision support and opinion leaders. Systematic reviews of multifaceted interventions claim an improvement in effectiveness over single interventions, with effect sizes ranging from small to moderate. This review found that a number of published systematic reviews fail to state whether the recommended practice change is based on the best available research evidence. Conclusions: This overview of systematic reviews updates the body of knowledge relating to the effectiveness of key mechanisms for improving clinical practice and service development. Multifaceted interventions are more likely to improve practice than single interventions such as audit and feedback. This review identified a small literature focusing explicitly on getting research evidence into clinical practice. It emphasizes the importance of ensuring that primary studies and systematic reviews are precise about the extent to which the reported interventions focus on changing practice based on research evidence (as opposed to other information codified in guidelines and education materials).

/pdf/effective-implementation-of-research-into-practice-an-1baju9v4ua.pdf

Effective implementation of research into practice: an overview of systematic reviews of the health literature.

This article illustrates how distributed change agency can implement complex organizational changes in the absence of formal management plans, roles, and structures. Distributed change agency typically involves small teams and senior groups. In this qualitative study of service improvements in the treatment of prostate cancer at an acute hospital, Grange, change roles were distributed more widely, with responsibilities `migrating' among a large informal cast supporting four central characters. This distribution appears to have been triggered by the change goals and substance, and by the network organization through which services were delivered. Cross-case comparisons with other hospitals, Henley and Norwood, suggest that a combination of factors contributed to the development of a distributed approach. Analytical generalization invites speculation concerning the transferability of this model, with `nobody in charge', to other settings. One policy implication concerns the provision of development in change agency competencies to staff other than those in senior positions.

Nobody in charge: Distributed change agency in healthcare:

Partnerships in primary care in Australia: network structure, dynamics and sustainability.

Implementing WHO DOTS strategy in the Russian Federation: stakeholder attitudes.

Health service reconfigurations are of international interest but remain poorly understood. This article focuses on the use of evidence by senior managerial decision-makers involved in the reconfiguration of stroke services in London 2008–2012. Recent work comparing stroke service reconfiguration in London and Manchester emphasises the ability of senior managerial decision-makers in London to ‘hold the line’ in the crucial early phases of the stroke reconfiguration programme. In this article, we explore in detail how these decision-makers ‘held the line’ and ask what the broader power implications of doing so are for the interaction between evidence, health policy and system redesign. The research combined semi-structured interviews (n = 20) and documentary analysis of historically relevant policy papers and contemporary stroke reconfiguration documentation published by NHS London and other interested parties (n = 125). We applied a critical interpretive and reflexive approach to the analysis of the data. We identified two forms of power which senior managerial decision-makers drew upon in order to ‘hold the line’. Firstly, discursive power, which through an emphasis on evidence, better patient outcomes, professional support and clinical credibility alongside a tightly managed consultation process, helped to set an agenda that was broadly receptive to the overall decision to change stroke services in the capital in a radical way. Secondly, once the essential parameters of the decision to change services had been agreed, senior managerial decision-makers ‘held the line’ through hierarchical New Public Management style power to minimise the traditional pressures to de-radicalise the reconfiguration through ‘top down’ decision-making. We problematise the concept of ‘holding the line’ and explore the power implications of such managerial approaches in the early phases of health service reconfiguration. We highlight the importance of evidence for senior managerial decision-makers in agenda setting and the limitations of clinical research findings in guiding politically sensitive policy decisions which impact upon regional healthcare systems.

/pdf/holding-the-line-a-qualitative-study-of-the-role-of-evidence-4luitgikuo.pdf

Juan I. Baeza

Papers

Effective implementation of research into practice: an overview of systematic reviews of the health literature.

Nobody in charge: Distributed change agency in healthcare:

Partnerships in primary care in Australia: network structure, dynamics and sustainability.

Implementing WHO DOTS strategy in the Russian Federation: stakeholder attitudes.

‘Holding the line’: a qualitative study of the role of evidence in early phase decision-making in the reconfiguration of stroke services in London