Showing papers in "Health Technology Assessment in 2011"

Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.

Abstract: Background: Methods for reviewing and synthesising findings from quantitative research studies in health care are well established. Although there is recognition of the need for qualitative research to be brought into the evidence base, there is no consensus about how this should be done and the methods for synthesising qualitative research are at a relatively early stage of development.Objective: To evaluate meta-ethnography as a method for synthesising qualitative research studies in health and health care.Methods: Two full syntheses of qualitative research studies were conducted between April 2002 and September 2004 using meta-ethnography: (1) studies of medicine-taking and (2) studies exploring patients? experiences of living with rheumatoid arthritis. Potentially relevant studies identified in multiple literature searches conducted in July and August 2002 (electronically and by hand) were appraised using a modified version of the Critical Appraisal Skills Programme questions for understanding qualitative research. Candidate papers were excluded on grounds of lack of relevance to the aims of the synthesis or because the work failed to employ qualitative methods of data collection and analysis.Results: Thirty-eight studies were entered into the medicine-taking synthesis, one of which did not contribute to the final synthesis. The synthesis revealed a general caution about taking medicine, and that the practice of lay testing of medicines was widespread. People were found to take their medicine passively or actively or to reject it outright. Some, in particular clinical areas, were coerced into taking it. Those who actively accepted their medicine often modified the regimen prescribed by a doctor, without the doctor?s knowledge. The synthesis concluded that people often do not take their medicines as prescribed because of concern about the medicines themselves. ?Resistance? emerged from the synthesis as a concept that best encapsulated the lay response to prescribed medicines. It was suggested that a policy focus should be on the problems associated with the medicines themselves and on evaluating the effectiveness of alternative treatments that some people use in preference to prescribed medicines. The synthesis of studies of lay experiences of living with rheumatoid arthritis began with 29 papers. Four could not be synthesised, leaving 25 papers (describing 22 studies) contributing to the final synthesis. Most of the papers were concerned with the everyday experience of living with rheumatoid arthritis. This synthesis did not produce significant new insights, probably because the early papers in the area were substantial and theoretically rich, and later papers were mostly confirmatory. In both topic areas, only a minority of the studies included in the syntheses were found to have referenced each other, suggesting that unnecessary replication had occurred.Limitations: We only evaluated meta-ethnography as a method for synthesising qualitative research, but there are other methods being employed. Further research is required to investigate how different methods of qualitative synthesis influence the outcome of the synthesis.Conclusions: Meta-ethnography is an effective method for synthesising qualitative research. The process of reciprocally translating the findings from each individual study into those from all the other studies in the synthesis, if applied rigorously, ensures that qualitative data can be combined. Following this essential process, the synthesis can then be expressed as a ?line of argument? that can be presented as text and in summary tables and diagrams or models. Meta-ethnography can produce significant new insights, but not all meta-ethnographic syntheses do so. Instead, some will identify fields in which saturation has been reached and in which no theoretical development has taken place for some time. Both outcomes are helpful in either moving research forward or avoiding wasted resources. Meta-ethnography is a highly interpretative method requiring considerable immersion in the individual studies to achieve a synthesis. It places substantial demands upon the synthesiser and requires a high degree of qualitative research skill. Meta-ethnography has great potential as a method of synthesis in qualitative health technology assessment but it is still evolving and cannot, at present, be regarded as a standardised approach capable of application in a routinised way.Funding: Funding for this study was provided by the Health Technology Assessment programme of the National Institute for Health Research.

The Clinical Effectiveness and Cost-Effectiveness of Exercise Referral Schemes: A Systematic Review and Economic Evaluation

Abstract: Copyright @ Queen’s Printer and Controller of HMSO 2011. This work was produced by Pavey et al. under the terms of a commissioning contract issued by the Secretary of State for Health.

Adalimumab, Etanercept, Infliximab, Rituximab and Abatacept for the Treatment of Rheumatoid Arthritis After the Failure of a Tumour Necrosis Factor Inhibitor: A Systematic Review and Economic Evaluation

Abstract: Rheumatoid arthritis is a common inflammatory condition which typically causes a symmetrical chronic arthritis that causes joint pain, swelling and in some cases a systemic illness. The cause of rheumatoid arthritis is unknown but important genetic influences are recognised. The goal of treatment is to achieve remission if patients present with early disease. In later disease key goals are to control pain and inflammation and thereby reduce functional limitations and the risk of permanent joint damage.

Evaluation of patient reporting of adverse drug reactions to the UK 'Yellow Card Scheme': literature review, descriptive and qualitative analyses, and questionnaire surveys.

Abstract: Background: The monitoring of adverse drug reactions (ADRs) through pharmacovigilance is vital to patient safety. Spontaneous reporting of ADRs is one method of pharmacovigilance, and in the UK this is undertaken through the Yellow Card Scheme (YCS). Yellow Card reports are submitted to the Medicines and Healthcare products Regulatory Agency (MHRA) by post, telephone or via the internet. The MHRA electronically records and reviews information submitted so that important safety issues can be detected. While previous studies have shown differences between patient and healthcare professional (HCP) reports for the types of drugs and reactions reported, relatively little is known about the pharmacovigilance impact of patient reports. There have also been few studies on the views and experiences of patients/consumers on the reporting of suspected ADRs. Objectives: To evaluate the pharmacovigilance impact of patient reporting of ADRs by analysing reports of suspected ADRs from the UK YCS and comparing reports from patients and HCPs. To elicit the views and experiences of patients and the public about patient reporting of ADRs. Design: (1) Literature review and survey of international experiences of consumer reporting of ADRs; (2) descriptive analysis of Yellow Card reports; (3) signal generation analysis of Yellow Card reports; (4) qualitative analysis of Yellow Card reports; (5) questionnaire survey of patients reporting on Yellow Cards; (6) qualitative analysis of telephone interviews with patient reporters to the scheme; (7) qualitative analysis of focus groups and usability testing of the patient YCS; and (8) national omnibus telephone survey of public awareness of the YCS. Participants: Patients (n = 5180) and HCPs (n = 20,949) submitting Yellow Card reports from October 2005 to September 2007. Respondents to questionnaire survey (n = 1362). Participants at focus groups and usability testing sessions (n = 40). National omnibus telephone survey (n = 2028). Setting: The literature review included studies in English from across the world. All other components included populations from the UK; the omnibus survey was restricted to Great Britain. Interventions: None. Main outcome measures: Characteristics of patient reports: types of drug and suspected ADR reported; seriousness of reports; and content of reports. The relative contributions of patient reports and of HCP reports to signal generation. Views and experiences of patient reporters. Views of members of the public about the YCS, including user-friendliness and usability of different ways of patient reporting. Public awareness of the YCS. Suggestions for improving patient reporting to the YCS. Results: Compared with HCPs, patient reports to the YCS contained a higher median number of suspected ADRs per report, and described reactions in more detail. The proportions of reports categorised as 'serious' were similar; the patterns of drugs and reactions reported differed. Patient reports were richer in their descriptions of reactions than those from HCPs, and more often noted the effects of ADRs on patients' lives. Combining patient and HCP reports generated more potential signals than HCP reports alone; some potential signals in the 'HCP-only' data set were lost when combined with patient reports, but fewer than those gained; the addition of patient reports to HCP reports identified 47 new 'serious' reactions not previously included in 'Summaries of Product Characteristics'. Most patient reporters found it fairly easy to make reports, although improvements to the scheme were suggested, including greater publicity and the redesign of web- and paper-based reporting systems. Among members of the public, 8.5% were aware of the YCS in 2009. Conclusions: Patient reporting of suspected ADRs has the potential to add value to pharmacovigilance by reporting types of drugs and reactions different from those reported by HCPs; generating new potential signals; and describing suspected ADRs in enough detail to provide useful information on likely causality and impact on patients' lives. These findings suggest that further promotion of patient reporting to the YCS is justified, along with improvements to existing reporting systems. In order of priority, future work should include further investigation of (1) the pharmacovigilance impact of patient reporting in a longer-term study; (2) the optimum approach to signal generation analysis of patient and HCP reports; (3) the burden of ADRs in terms of impact on patients' lives; (4) the knowledge and attitudes of HCPs towards patient reporting of ADRs; (5) the value of using patient reports of ADRs to help other patients and HCPs who are seeking information on patient experiences of ADRs; and (6) the impact of increasing publicity and/or enhancements to reporting systems on the numbers and types of Yellow Card reports from patients. Funding: The National Institute for Health Research Health Technology Assessment programme.

The clinical effectiveness and cost-effectiveness of long-term weight management schemes for adults: a systematic review.

Abstract: Objective To assess the long-term clinical effectiveness and cost-effectiveness of multicomponent weight management schemes for adults in terms of weight loss and maintenance of weight loss. Data sources Bibliographic databases were searched from inception to December 2009, including the Cochrane Library, MEDLINE (Ovid), EMBASE (Ovid), and MEDLINE In-Process & Other Non-Indexed Citations. Bibliographies of related papers were screened, key conferences and symposia were searched and experts were contacted to identify additional published and unpublished references. Review methods For the clinical effectiveness review, two reviewers independently screened titles and abstracts for eligibility. Inclusion criteria were applied to the full text of retrieved papers by one reviewer and checked by a second reviewer using a pre-piloted inclusion flow chart. The studies were long-term randomised controlled trials (RCTs) of adult participants who were classified by body mass index as overweight or obese. Interventions were multicomponent weight management programmes (including diet, physical activity and behaviour change strategies) that assessed weight measures. Programmes that involved the use of over-the-counter medicines licensed in the UK were also eligible. For the cost-effectiveness review two reviewers independently screened studies for inclusion. Cost-effectiveness, cost-utility, cost-benefit or cost-consequence analyses were eligible. Data were extracted using a standardised and pre-piloted data extraction form. The quality of included studies was assessed using standard criteria. Studies were synthesised through a narrative review with full tabulation of results. Results A total of 3358 references were identified, of which 12 were included in the clinical effectiveness review. Five RCTs compared multicomponent interventions with non-active comparator groups. In general, weight loss appeared to be greater in the intervention groups than in the comparator groups. Two RCTs compared multicomponent interventions that focused on the diet component. In these studies there were no statistically significant differences in weight loss between interventions. Four RCTs compared multicomponent interventions that focused on the physical activity component. There was little consistency in the pattern of results seen, in part owing to the differences in the interventions. In one RCT the intervention focused on the goal-setting interval and it appeared that weight loss was greatest in those given daily goals compared with weekly goals. Overall, where measured, it appeared that most groups began to regain weight at further follow-up. Of the 419 studies identified in the cost-effectiveness searches, none met the full inclusion criteria. Two economic evaluations are described in our review; however, caution is required in their interpretation, as they did not meet all inclusion criteria. Lifetime chronic disease models were used in these studies and the models included the costs and benefits of avoiding chronic illness. Both studies found the interventions to be cost-effective, with estimates varying between -£473 and £7200 (US$12,640) per quality-adjusted life-year gained; methodological omissions from these studies were apparent and caution is therefore required in the interpretation of these results. Conclusions Long-term multicomponent weight management interventions were generally shown to promote weight loss in overweight or obese adults. Weight changes were small however and weight regain was common. There were few similarities between the included studies; consequently an overall interpretation of the results was difficult to make. There is some evidence that weight management interventions are likely to be cost-effective, although caution is required as there were some limitations in the two cost-evaluation studies described. Funding The National Institute for Health Research Health Technology Assessment programme.

A Systematic Review and Economic Evaluation of the Use of Tumour Necrosis Factor-Alpha (TNF-α) Inhibitors, Adalimumab and Infliximab, for Crohn's Disease

Abstract: Background: Crohn's disease (CD) is a severe, lifelong disease characterised by inflammation of the gastrointestinal mucosa. The impact on patients and society is high as ill health can be lifelong and can negatively affect patients' quality of life. Costs to the NHS are high, particularly for patients needing hospitalisation. Conventional treatment pathways are complex. More recently, a group of drugs called tumour necrosis factor (TNF) inhibitors (anti-TNF-alpha agents) have been evaluated for their effectiveness in CD. One of these, infliximab, is currently recommended by the National Institute for Health and Clinical Excellence (NICE; 2002) for patients with severe, active CD where patients are refractory to or intolerant of conventional treatment.Objectives: To investigate whether there is evidence for greater clinical effectiveness or cost-effectiveness for either adalimumab or infliximab.Data sources: Cochrane Library (Cochrane Central Register of Controlled Trials) 2007 Issue 2; MEDLINE (Ovid) 2000 to May/June 2007; MEDLINE In-Process & Other Non-Indexed Citations (Ovid) 4 June and 26 June 2007; EMBASE (Ovid) 2000 to May/June 2007. The European Medicines Agency, the US Food and Drug Administration and other relevant websites.Review methods: Standard systematic review methods were used for study identification and selection, data extraction and quality assessment. Only randomised controlled trials (RCTs) comparing adalimumab or infliximab with standard treatment (placebo), RCTs comparing adalimumab with infliximab, or RCTs comparing different dosing regimens of either adalimumab or infliximab in adults and children with moderate-to-severe active CD intolerant or resistant to conventional treatment were eligible for inclusion. A systematic review of published studies on the cost and cost-effectiveness of adalimumab and infliximab was undertaken. The economic models of cost-effectiveness submitted by the manufacturers of both drugs were critically appraised and, where appropriate, rerun using parameter inputs based on the evidence identified by the authors of the technology asessment report. A de novo Markov state transition model was constructed to calculate the incremental cost-effectiveness ratio for adalimumab and infliximab therapy compared with standard care.Results: Based on 11 trials, there was evidence from both induction and maintenance trials that both adalimumab and infliximab therapy were beneficial compared with placebo (standard care) for adults with moderate-to-severe CD and, for infliximab, for adults with fistulising CD; results were statistically significant for some time points. Between 6% and 24% (adalimumab), and 21% and 44% (infliximab) more patients achieved remission with anti-TNF-alpha antibodies than with placebo in the induction trials. Between 24% and 29% (adalimumab), and 14% and 24% (infliximab) more patients achieved remission with anti-TNF-alpha antibodies in the two large maintenance trials at reported follow-up. In fistulising CD, between 29% and 42% (induction trial) and 23% (maintenance trial) more patients achieved a > 50% reduction in fistulas with infliximab than with placebo at reported follow-up. There was no direct evidence to show that 'responders' were more likely to benefit from treatment than 'non-responders' in the longer term. Few differences were found between treatment and standard care arms for selected adverse events, though high proportions of scheduled crossovers resulted in a lack of a true placebo group in most of the maintenance trials. No published studies on the cost-effectiveness of adalimumab were identified. The four independently funded studies identified for infliximab suggested high cost-effectiveness ratios [all above 50,000 pound/quality-adjusted life-year (QALY) for non-fistulising disease and all above 100,000 pound/QALY for fistulising disease]. A budget impact assessment suggested that total cost to the NHS in England and Wales for induction in severe disease only could range between 17M pound and 92M pound and for maintenance for 1 year between 140M pound and 200M pound.Limitations: Regarding clinical effectiveness, there were concerns about the trial design and lack of clarity, which may have affected interpretation of results. None of the trials matched exactly the licence indications or NICE guidance, which specify the use of these drugs in patients with 'severe' disease. All trials were multicentre, and applicability to UK populations, particularly in terms of standard care being provided and in terms of patients having failed or having become intolerant to conventional treatment, was uncertain. The published economic models relied heavily on little information and data from small samples.Conclusions: Anti-TNF therapy with adalimumab or infliximab may have a beneficial effect compared with standard care on outcome measures for induction and maintenance. The findings were that for induction, both adalimumab and infliximab are cost-effective (dominant relative to standard care) in the management of severe CD, and adalimumab (but not infliximab) is cost-effective for moderate CD, according to limits generally accepted by NICE. On the basis of the analysis presented here, neither drug is likely to be cost-effective as maintenance therapy for moderate or severe disease. Perhaps, most importantly, the analysis reflected the fact that a substantial number of patients would achieve remission under standard care and that the incidence of relapse among those in remission was such that maintenance therapy would have to show greater effectiveness than at present and/or be much less costly than it currently is in order to reach the levels of generally accepted cost-effectiveness. Any future trials need to be designed to meet the particular challenges of measuring and quantifying benefit in this patient group.

Diagnostic Management Strategies for Adults and Children with Minor Head Injury: A Systematic Review and an Economic Evaluation

Abstract: Background Patients with minor head injury [Glasgow Coma Scale (GCS) score 13–15] have a small but important risk of intracranial injury (ICI) that requires early identification and neurosurgical treatment. Diagnostic assessment can use either a clinical decision rule or unstructured assessment of individual clinical features to identify those who are at risk of ICI and in need of computerised tomography (CT) scanning and/or hospital admission. Selective use of CT investigations helps minimise unnecessary radiation exposure and resource use, but can lead to missed opportunities to provide early treatment for ICI. Objectives To determine the diagnostic accuracy of decision rules, individual clinical characteristics, skull radiography and biomarkers, and the clinical effectiveness and cost-effectiveness of diagnostic management strategies for minor head injury (MHI). Data sources Several electronic databases [including MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, Cumulative Index to Nursing and Allied Health Literature (CINAHL), EMBASE and The Cochrane Library] were searched from inception to April 2009 (updated searches to March 2010 were conducted on the MEDLINE databases only). Searches were supplemented by hand-searching relevant articles (including citation searching) and contacting experts in the field. For each of the systematic reviews the following studies were included (1) cohort studies of patients with MHI in which a clinical decision rule or individual clinical characteristics (including biomarkers and skull radiography) were compared with a reference standard test for ICI or need for neurosurgical intervention and (2) controlled trials comparing alternative management strategies for MHI. Review methods Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool (for the assessment of diagnostic accuracy) or criteria recommended by the Effective Practice and Organisation of Care Review Group (for the assessment of management practices). Where sufficient data existed, a meta-analysis was undertaken to generate pooled estimates of diagnostic parameters. A decision-analysis model was developed using Simul8 2008 Professional software (Simul8 Corporation, Boston, MA, USA) to estimate the costs and quality-adjusted life-years (QALYs) accrued by management strategies for MHI. The model took a lifetime horizon and NHS perspective. Estimates of the benefits of early treatment, harm of radiation exposure and long-term costs were obtained through literature reviews. Initial analysis was deterministic, but probabilistic sensitivity analysis was also performed. Secondary analyses were undertaken to explore the trade-off between sensitivity and specificity in diagnostic strategies and to determine the cost-effectiveness of scenarios involving hospital admission. Results The literature searches identified 8003 citations. Of these, 93 full-text papers were included for the assessment of diagnostic accuracy and one for the assessment of management practices. The quality of studies and reporting was generally poor. The Canadian CT Head Rule (CCHR) was the most widely validated adult rule, with sensitivity of 99–100% and 80–100% for neurosurgical and any ICI, respectively (high- or medium-risk criteria), and specificity of 39–51%. Rules for children had high sensitivity and acceptable specificity in derivation cohorts, but limited validation. Depressed, basal or radiological skull fracture and post-traumatic seizure (PTS) [positive likelihood ratio (PLR) > 10]; focal neurological deficit, persistent vomiting, decrease in GCS and previous neurosurgery (PLR 5–10); and fall from a height, coagulopathy, chronic alcohol use, age > 60 years, pedestrian motor vehicle accident (MVA), any seizure, undefined vomiting, amnesia, GCS 10), coagulopathy, PTS and previous neurosurgery (PLR 5–10), visual symptoms, bicycle and pedestrian MVA, any seizure, loss of consciousness, vomiting, severe or persistent headache, amnesia, GCS < 14, GCS < 15, intoxication and radiological skull fracture (PLR 2–5) increased the likelihood of ICI in children. S100 calcium-binding protein B had pooled sensitivity of 96.8% [95% highest-density region (HDR) 93.8% to 98.6%] and specificity of 42.5% (95% HDR 31.0% to 54.2%). The only controlled trial showed that early CT and discharge is cheaper and at least as effective as hospital admission. Economic analysis showed that selective CT use dominated ‘CT all’ and ‘discharge all’ strategies. The optimal strategies were the CCHR (adults) and the CHALICE (Children’s Head injury Algorithm for the prediction of Important Clinical Events) or NEXUS II (National Emergency X-Radiography Utilization Study II) rule (children). The sensitivity and specificity of the CCHR (99% and 47%, respectively) represented an appropriate trade-off of these parameters. Hospital admission dominated discharge home for patients with non-neurosurgical injury, but cost £39 M per QALY for clinically normal patients with a normal CT. Conclusions The CCHR is widely validated and cost-effective for adults. Decision rules for children appear cost-effective, but need further validation. Hospital admission is cost-effective for patients with abnormal, but not normal, CT. The main research priorities are to (1) validate decision rules for children; (2) determine the prognosis and treatment benefit for non-neurosurgical injuries; (3) evaluate the use of S100B alongside a validated decision rule; (4) evaluate the diagnosis and outcomes of anticoagulated patients with MHI; and (5) evaluate the implementation of guidelines, clinical decision rules and diagnostic strategies. Formal expected value of sample information analysis would be recommended to appraise the cost-effectiveness of future studies. Funding The National Institute for Health Research Health Technology Assessment programme.

Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology.

Abstract: Objectives To compare user satisfaction and acceptability, reliability and validity of three different methods of assessing the surgical skills of trainees by direct observation in the operating theatre across a range of different surgical specialties and index procedures. Design and setting A 2-year prospective, observational study in the operating theatres of three teaching hospitals in Sheffield. Methods The assessment methods were procedure-based assessment (PBA), Objective Structured Assessment of Technical Skills (OSATS) and Non-technical Skills for Surgeons (NOTSS). The specialties were obstetrics and gynaecology (O&G) and upper gastrointestinal, colorectal, cardiac, vascular and orthopaedic surgery. Two to four typical index procedures were selected from each specialty. Surgical trainees were directly observed performing typical index procedures and assessed using a combination of two of the three methods (OSATS or PBA and NOTSS for O&G, PBA and NOTSS for the other specialties) by the consultant clinical supervisor for the case and the anaesthetist and/or scrub nurse, as well as one or more independent assessors from the research team. Outcome measures Information on user satisfaction and acceptability of each assessment method from both assessor and trainee perspectives was obtained from structured questionnaires. The reliability of each method was measured using generalisability theory. Aspects of validity included the internal structure of each tool and correlation between tools, construct validity, predictive validity, interprocedural differences, the effect of assessor designation and the effect of assessment on performance. Results Of the 558 patients who were consented, a total of 437 (78%) cases were included in the study: 51 consultant clinical supervisors, 56 anaesthetists, 39 nurses, 2 surgical care practitioners and 4 independent assessors provided 1635 assessments on 85 trainees undertaking the 437 cases. A total of 749 PBAs, 695 NOTSS and 191 OSATSs were performed. Non-O&G clinical supervisors and trainees provided mixed, but predominantly positive, responses about a range of applications of PBA. Most felt that PBA was important in surgical education, and would use it again in the future and did not feel that it added time to the operating list. The overall satisfaction of O&G clinical supervisors and trainees with OSATS was not as high, and a majority of those who used both preferred PBA. A majority of anaesthetists and nurses felt that NOTSS allowed them to rate interpersonal skills (communication, teamwork and leadership) more easily than cognitive skills (situation awareness and decision-making), that it had formative value and that it was a valuable adjunct to the assessment of technical skills. PBA demonstrated high reliability (G > 0.8 for only three assessor judgements on the same index procedure). OSATS had lower reliability (G > 0.8 for five assessor judgements on the same index procedure). Both were less reliable on a mix of procedures because of strong procedure-specific factors. A direct comparison of PBA between O&G and non-O&G cases showed a striking difference in reliability. Within O&G, a good level of reliability (G > 0.8) could not be obtained using a feasible number of assessments. Conversely, the reliability within non-O&G cases was exceptionally high, with only two assessor judgements being required. The reasons for this difference probably include the more summative purpose of assessment in O&G and the much higher proportion of O&G trainees in this study with training concerns (42% vs 4%). The reliability of NOTSS was lower than that for PBA. Reliability for the same procedure (G > 0.8) required six assessor judgements. However, as procedure-specific factors exerted a lesser influence on NOTSS, reliability on a mix of procedures could be achieved using only eight assessor judgements. NOTSS also demonstrated a valid internal structure. The strongest correlations between NOTSS and PBA or OSATS were in the ‘decision-making’ domain. PBA and NOTSS showed better construct validity than OSATS, the year of training and the number of recent index procedures performed being significant independent predictors of performance. There was little variation in scoring between different procedures or different designations of assessor. Conclusions The results suggest that PBA is a reliable and acceptable method of assessing surgical skills, with good construct validity. Specialties that use OSATS may wish to consider changing the design or switching to PBA. Whatever workplace-based assessment method is used, the purpose, timing and frequency of assessment require detailed guidance. NOTSS is a promising tool for the assessment of non-technical skills, and surgical specialties may wish to consider its inclusion in their assessment framework. Further research is required into the use of health-care professionals other than consultant surgeons to assess trainees, the relationship between performance and experience, the educational impact of assessment and the additional value of video recording. Funding The National Institute for Health Research Health Technology Assessment programme.

Identification of risk factors by systematic review and development of risk-adjusted models for surgical site infection.

Abstract: Background: Surgical site infections (SSIs) are complications of surgery that cause significant postoperative morbidity. SSI has been proposed as a potential indicator of the quality of care in the context of clinical governance and monitoring of the performance of NHS organisations against targets. Objectives: We aimed to address a number of objectives. Firstly, identify risk factors for SSI, criteria for stratifying surgical procedures and evidence about the importance of postdischarge surveillance (PDS). Secondly, test the importance of risk factors for SSI in surveillance databases and investigate interactions between risk factors. Thirdly, investigate and validate different definitions of SSI. Lastly, develop models for making risk-adjusted comparisons between hospitals. Data sources: A single hospital surveillance database was used to address objectives 2 and 3 and the UK Surgical Site Infection Surveillance Service database to address objective 4. Study design: There were four elements to the research: (1) systematic reviews of risk factors for SSI (two reviewers assessed titles and abstracts of studies identified by the search strategy and the quality of studies was assessed using the Newcastle Ottawa Scale); (2) assessment of agreement between four SSI definitions; (3) validation of definitions of SSI, quantifying their ability to predict clinical outcomes; and (4) development of operation-specific risk models for SSI, with hospitals fitted as random effects. Results: Reviews of SSI risk factors other than established SSI risk indices identified other risk; some were operation specific, but others applied to multiple operations. The factor most commonly identified was duration of preoperative hospital stay. The review of PDS for SSI confirmed the need for PDS if SSIs are to be compared meaningfully over time within an institution. There was wide variation in SSI rate (SSI%) using different definitions. Over twice as many wounds were classified as infected by one definition only as were classified as infected by both. Different SSI definitions also classified different wounds as being infected. The two most established SSI definitions had broadly similar ability to predict the chosen clinical outcomes. This finding is paradoxical given the poor agreement between definitions. Elements of each definition not common to both may be important in predicting clinical outcomes or outcomes may depend on only a subset of elements which are common to both. Risk factors fitted in multivariable models and their effects, including age and gender, varied by surgical procedure. Operative duration was an important risk factor for all operations, except for hip replacement. Wound class was included least often because some wound classes were not applicable to all operations or were combined because of small numbers. The American Association of Anesthesiologists class was a consistent risk factor for most operations. Conclusions: The research literature does not allow surgery-specific or generic risk factors to be defined. SSI definitions varied between surveillance programmes and potentially between hospitals. Different definitions do not have good agreement, but the definitions have similar ability to predict outcomes influenced by SSI. Associations between components of the National Nosocomial Infections Surveillance risk index and odds of SSI varied for different surgical procedures. There was no evidence for effect modification by hospital. Estimates of SSI% should be disseminated within institutions to inform infection control. Estimates of SSI% across institutions or countries should be interpreted cautiously and should not be assumed to reflect quality of medical care. Future research should focus on developing an SSI definition that has satisfactory psychometric properties, that can be applied in everyday clinical settings, includes PDS and is formulated to detect SSIs that are important to patients or health services.

A study of the safety and harms of antidepressant drugs for older people: a cohort study using a large primary care database.

Abstract: OBJECTIVES: The aim of this study was to establish the relative safety and balance of risks for antidepressant treatment in older people. The study objectives were to (1) determine relative and absolute risks of predefined adverse events in older people with depression, comparing classes of antidepressant drugs [tricyclic and related antidepressants (TCAs), selective serotonin reuptake inhibitors (SSRIs), monoamine oxidase inhibitors (MAOIs) and other antidepressants] and commonly prescribed individual drugs with non-use of antidepressant drugs; (2) directly compare the risk of adverse events for SSRIs with TCAs; (3) determine associations with dose and duration of antidepressant medication; (4) describe patterns of antidepressant use in older people with depression; and (5) estimate costs of antidepressant medication and primary care visits. DESIGN: A cohort study of patients aged 65 years and over diagnosed with depression. SETTING: The study was based in 570 general practices in the UK supplying data to the QResearch database. PARTICIPANTS: Patients diagnosed with a new episode of depression between the ages of 65 and 100 years, from 1 January 1996 to 31 December 2007. Participants were followed up until 31 December 2008. INTERVENTIONS: The exposure of interest was treatment with antidepressant medication. Antidepressant drugs were grouped into the major classes and commonly prescribed individual drugs were identified. MAIN OUTCOME MEASURES: There were 13 predefined outcome measures: all-cause mortality, sudden cardiac death, suicide, attempted suicide/self-harm, myocardial infarction, stroke/transient ischaemic attack (TIA), falls, fractures, upper gastrointestinal bleeding, epilepsy/seizures, road traffic accidents, adverse drug reactions and hyponatraemia. RESULTS: In total, 60,746 patients were included in the study cohort. Of these, 54,038 (89.0%) received at least one prescription for an antidepressant during follow-up. The associations with the adverse outcomes were significantly different between the classes of antidepressant drugs for seven outcomes. SSRIs were associated with the highest adjusted hazard ratios (HRs) for falls [1.66, 95% confidence interval (CI) 1.58 to 1.73] and hyponatraemia (1.52, 95% CI 1.33 to 1.75), and the group of other antidepressants was associated with the highest HRs for all-cause mortality (1.66, 95% CI 1.56 to 1.77), attempted suicide/self-harm (5.16, 95% CI 3.90 to 6.83), stroke/TIA (1.37, 95% CI 1.22 to 1.55), fracture (1.63, 95% CI 1.45 to 1.83) and epilepsy/seizures (2.24, 95% CI 1.60 to 3.15) compared with when antidepressants were not being used. TCAs did not have the highest HR for any of the outcomes. There were also significantly different associations between the individual drugs for seven outcomes, with trazodone, mirtazapine and venlafaxine associated with the highest rates for several of these outcomes. The mean incremental cost (for all antidepressant prescriptions) ranged between £51.58 (amitriptyline) and £641.18 (venlafaxine) over the 5-year post-diagnosis period. CONCLUSIONS: This study found associations between use of antidepressant drugs and a number of adverse events in older people. There was no evidence that SSRIs or drugs in the group of other antidepressants were associated with a reduced risk of any of the adverse outcomes compared with TCAs; however, they may be associated with an increased risk for certain outcomes. Among individual drugs trazodone, mirtazapine and venlafaxine were associated with the highest rates for some outcomes. Indication bias and residual confounding may explain some of the study findings. The risks of prescribing antidepressants need to be weighed against the potential benefits of these drugs. FUNDING: The National Institute for Health Research Health Technology Assessment programme. Language: en

Etanercept, Infliximab and Adalimumab for the Treatment of Psoriatic Arthritis: A Systematic Review and Economic Evaluation

Abstract: BACKGROUND: Etanercept, infliximab and adalimumab are licensed in the UK for the treatment of active and progressive psoriatic arthritis (PsA) in adults who have an inadequate response to standard treatment. OBJECTIVE: To determine the clinical effectiveness, safety and cost-effectiveness of these biologic agents in the treatment of active and progressive PsA. DATA SOURCES: Systematic reviews were performed, with data sought from 10 electronic databases (MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, Science Citation Index, Conference Proceedings Citation Index - Science, ClinicalTrials.gov, metaRegister of Current Controlled Trials, NHS Economic Evaluation Database, Health Economic Evaluations Database and EconLit) up to June 2009. REVIEW METHODS: Full paper manuscripts of titles/abstracts considered relevant were obtained and assessed for inclusion by two reviewers according to criteria on study design, interventions, participants and outcomes. Data on study and participant characteristics, efficacy outcomes, adverse effects, costs to the health service and cost-effectiveness were extracted, along with baseline data where reported. The primary efficacy outcomes were measures of anti-inflammatory response, skin lesion response and functional status, and the safety outcome was the incidence of serious adverse events. The primary measure of cost-effectiveness was incremental cost per additional quality-adjusted life-year (QALY). Standard meta-analytic techniques were applied to efficacy data. Published cost-effectiveness studies and the economic analyses submitted to the National Institute for Health and Clinical Excellence (NICE) by the biologic manufacturers were reviewed. An economic model was developed by updating the model produced by the York Assessment Group for the previous NICE appraisal of biologics in PsA. RESULTS: Pooled estimates of effect demonstrated a significant improvement in patients with PsA for all joint disease and functional status outcomes at 12-14 weeks' follow-up. The biologic treatment significantly reduced joint symptoms for etanercept [relative risk (RR) 2.60, 95% confidence interval (CI) 1.96 to 3.45], infliximab (RR 3.44, 95% CI 2.53 to 4.69) and adalimumab (RR 2.24, 95% CI 1.74 to 2.88), with 24-week data demonstrating maintained treatment effects. Trial data demonstrated a significant effect of all three biologics on skin disease at 12 or 24 weeks. Evidence synthesis found that infliximab appeared to be most effective across all outcomes of joint and skin disease. The response in joint disease was greater with etanercept than with adalimumab, whereas the response in skin disease was greater with adalimumab than with etanercept, although these differences are not statistically significant. Under base-case assumptions, etanercept was the most likely cost-effective strategy for patients with PsA and mild-to-moderate psoriasis if the threshold for cost-effectiveness was �20,000 or �30,000 per QALY. All biologics had a similar probability of being cost-effective for patients with PsA and moderate-to-severe psoriasis at a threshold of �20,000 per QALY. LIMITATIONS: Limited available efficacy data and difficulty in assessing PsA activity and its response to biologic therapy. CONCLUSIONS: The data indicated that etanercept, infliximab and adalimumab were efficacious in the treatment of PsA compared with placebo, with beneficial effects on joint symptoms, functional status and skin. Short-term data suggested that these biologic agents can delay joint disease progression and evidence to support their use in the treatment of PsA is convincing. Future research would benefit from long-term observational studies with large sample sizes of patients with PsA to demonstrate that beneficial effects are maintained, along with further monitoring of the safety profiles of the biologic agents. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

The clinical effectiveness and cost-effectiveness of management strategies for sciatica: systematic review and economic model.

Abstract: Background Sciatica is a symptom characterised by well-localised leg pain with a sharp, shooting or burning quality that radiates down the back of the leg and normally to the foot or ankle. It is often associated with numbness or altered sensation in the leg. Objectives To determine the clinical effectiveness and cost-effectiveness of different management strategies for sciatica. Data sources Major electronic databases (e.g. MEDLINE, EMBASE and NHS Economic Evaluation Database) and several internet sites including trial registries were searched up to December 2009. Review methods Systematic reviews were undertaken of the clinical effectiveness and cost-effectiveness of different treatment strategies for sciatica. Effectiveness data were synthesised using both conventional meta-analyses and mixed treatment comparison (MTC) methods. An economic model was then developed to estimate costs per quality-adjusted life-year gained for each treatment strategy. Results The searches identified 33,590 references, of which 270 studies met the inclusion criteria and 12 included a full economic evaluation. A further 42 ongoing studies and 93 publications that could not be translated were identified. The interventions were grouped into 18 treatment categories. A larger number of studies evaluated invasive interventions and non-opioids than other non-invasive interventions. The proportion of good-quality studies for each treatment category ranged from 0% to 50%. Compared with studies of less invasive interventions, studies of invasive treatments were more likely to confirm disc herniation by imaging, to limit patients included to those with acute sciatica (< 3 months’ duration) and to include patients who had received previous treatment. The MTC analyses gave an indication of relative therapeutic effect. The statistically significant odds ratios of global effect compared with inactive control were as follows: disc surgery 2.8, epidural injection 3.1, chemonucleolysis 2.0 and non-opioids 2.6. Disc surgery and epidural injections were associated with more adverse effects than the inactive control. There was some evidence for the effectiveness of biological agents and acupuncture. Opioid medication and activity restriction were found to be less effective than the comparator interventions and opioids were associated with more adverse effects than the inactive control. The full economic evaluations were of reasonable to good quality, but were not able to fully address our research question. Although individual studies raised a number of important issues, it was difficult to draw meaningful conclusions across studies because of their heterogeneity. The economic model demonstrated that stepped-care approaches to patient management were likely to be cost-effective, relative to strategies that involved direct referral to disc surgery. Limitations The limited number of studies for some comparisons, the high level of heterogeneity (within treatment comparisons) and the potential inconsistency (between treatment comparisons) weaken the interpretation of the MTC analyses. Conclusions These findings provide support for the effectiveness of currently used therapies for sciatica such as non-opioid medication, epidural corticosteroid injections and disc surgery, but also for chemonucleolysis, which is no longer used in the UK NHS. These findings do not provide support for the effectiveness of opioid analgesia, which is widely used in this patient group, or activity restriction. They also suggest that less frequently used treatments, such as acupuncture, and experimental treatments, such as anti-inflammatory biological agents, may be effective. Stepped-care approaches to treatment for patients with sciatica are cost-effective relative to direct referral for surgery. Future research should include randomised controlled trials with concurrent economic evaluation of biological agents and acupuncture compared with placebo or with currently used treatments. Development of alternative economic modelling approaches to assess relative cost-effectiveness of treatment regimes, based on the above trial data, would also be beneficial. Funding The National Institute for Health Research Health Technology Assessment programme.

The Value of FDG Positron Emission Tomography/Computerised Tomography (PET/CT) in Pre-Operative Staging of Colorectal Cancer: A Systematic Review and Economic Evaluation

Abstract: OBJECTIVES: In the UK, colorectal cancer (CRC) is the third most common malignancy (behind lung and breast cancer) with 37,514 cases registered in 2006: around two-thirds (23,384) in the colon and one-third (14,130) in the rectum. Treatment of cancers of the colon can vary considerably, but surgical resection is the mainstay of treatment for curative intent. Following surgical resection, there is a comprehensive assessment of the tumour, it's invasion characteristics and spread (tumour staging). A number of imaging modalities are used in the pre-operative staging of CRCs including; computerised tomography (CT), magnetic resonance imaging, ultrasound imaging and positron emission tomography (PET). This report examines the role of CT in combination with PET scanning (PET/CT 'hybrid' scan). The research objectives are: to evaluate the diagnostic accuracy and therapeutic impact of fluorine-18-deoxyglucose (FDG) PET/CT for the pre-operative staging of primary, recurrent and metastatic cancer using systematic review methods; undertake probabilistic decision-analytic modelling (using Monte Carlo simulation); and conduct a value of information analysis to help inform whether or not there is potential worth in undertaking further research. DATA SOURCES: For each aspect of the research - the systematic review, the handsearch study and the economic evaluation - a database was assembled from a comprehensive search for published and unpublished studies, which included database searches, reference lists search and contact with experts. In the systematic review prospective and retrospective patient series (diagnostic cohort) and randomised controlled trials (RCTs) were eligible for inclusion. Both consecutive series and series that are not explicitly reported as consecutive were included. REVIEW METHODS: Two reviewers extracted all data and applied the criteria independently and resolved disagreements by discussion. Data to populate 2 x 2 contingency tables consisting of the number of true positives, true negatives, false positives and false negatives using the studies' own definitions were extracted, as were data relating to changes in management. Fourteen items from the Quality Assessment of Diagnostic Accuracy Studies checklist were used to assess the methodological quality of the included studies. Patient-level data were used to calculate sensitivity and specificity with confidence intervals (CIs). Data were plotted graphically in forest plots. For the economic evaluation, economic models were designed for each of the disease states: primary, recurrent and metastatic. These were developed and populated based on a variety of information sources (in particular from published data sources) and literature, and in consultation with clinical experts. RESULTS: The review found 30 studies that met the eligibility criteria. Only two small studies evaluated the use of FDG PET/CT in primary CRC, and there is insufficient evidence to support its routine use at this time. The use of FDG PET/CT for the detection of recurrent disease identified data from five retrospective studies from which a pooled sensitivity of 91% (95% CI 0.87% to 0.95%) and specificity of 91% (95% CI 0.85% to 0.95%) were observed. Pooled accuracy data from patients undergoing staging for suspected metastatic disease showed FDG PET/CT to have a pooled sensitivity of 91% (95% CI 87% to 94%) and a specificity of 76% (95% CI 58% to 88%), but the poor quality of the studies means the validity of the data may be compromised by several biases. The separate handsearch study did not yield any additional unique studies relevant to FDG PET/CT. Models for recurrent disease demonstrated an incremental cost-effectiveness ratio of pound21,409 per quality-adjusted life-year (QALY) for rectal cancer, pound6189 per QALY for colon cancer and pound21,434 per QALY for metastatic disease. The value of handsearching to identify studies of less clearly defined or reported diagnostic tests is still to be investigated. CONCLUSIONS: The systematic review found insufficient evidence to support the routine use of FDG PET/CT in primary CRC and only a small amount of evidence supporting its use in the pre-operative staging of recurrent and metastatic CRC, and, although FDG PET/CT was shown to change patient management, the data are divergent and the quality of research is generally poor. The handsearch to identify studies of less clearly defined or reported diagnostic tests did not find additional studies. The primary limitations in the economic evaluations were due to uncertainty and lack of available evidence from the systematic reviews for key parameters in each of the five models. In order to address this, a conservative approach was adopted in choosing DTA estimates for the model parameters. Probabilistic analyses were undertaken for each of the models, incorporating wide levels of uncertainty particularly for the DTA estimates. None of the economic models reported cost-savings, but the approach adopted was conservative in order to determine more reliable results given the lack of current information. The economic evaluations conclude that FDG PET/CT as an add-on imaging device is cost-effective in the pre-operative staging of recurrent colon, recurrent rectal and metastatic disease but not in primary colon or rectal cancers. There would be value in undertaking an RCT with a concurrent economic evaluation to evaluate the therapeutic impact and cost-effectiveness of FDG PET/CT compared with conventional imaging (without PET) for the pre-operative staging of recurrent and metastatic CRC. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Positron emission tomography (PET) and magnetic resonance imaging (MRI) for the assessment of axillary lymph node metastases in early breast cancer: systematic review and economic evaluation

Abstract: Background Breast cancer is the most common type of cancer in women Evaluation of axillary lymph node metastases is important for breast cancer staging and treatment planning Objectives To evaluate the diagnostic accuracy, cost-effectiveness and effect on patient outcomes of positron emission tomography (PET), with or without computed tomography (CT), and magnetic resonance imaging (MRI) in the evaluation of axillary lymph node metastases in patients with newly diagnosed early-stage breast cancer Data sources A systematic review of literature and an economic evaluation were carried out Key databases (including MEDLINE, EMBASE and nine others) plus research registers and conference proceedings were searched for relevant studies up to April 2009 A decision-analytical model was developed to determine cost-effectiveness in the UK Review methods One reviewer assessed titles and abstracts of studies identified by the search strategy, obtained the full text of relevant papers and screened them against inclusion criteria Data from included studies were extracted by one reviewer using a standardised data extraction form and checked by a second reviewer Discrepancies were resolved by discussion Quality of included studies was assessed using the quality assessment of diagnostic accuracy studies (QUADAS) checklist, applied by one reviewer and checked by a second Results Forty-five citations relating to 35 studies were included in the clinical effectiveness review: 26 studies of PET and nine studies of MRI Two studies were included in the cost-effectiveness review: one of PET and one of MRI Of the seven studies evaluating PET/CT (n = 862), the mean sensitivity was 56% [95% confidence interval (CI) 44% to 67%] and mean specificity 96% (95% CI 90% to 99%) Of the 19 studies evaluating PET only (n = 1729), the mean sensitivity was 66% (95% CI 50% to 79%) and mean specificity 93% (95% CI 89% to 96%) PET performed less well for small metastases; the mean sensitivity was 11% (95% CI 5% to 22%) for micrometastases (≤ 2 mm; five studies; n = 63), and 57% (95% CI 47% to 66%) for macrometastases (> 2 mm; four studies; n = 111) The smallest metastatic nodes detected by PET measured 3 mm, while PET failed to detect some nodes measuring > 15 mm Studies in which all patients were clinically node negative showed a trend towards lower sensitivity of PET compared with studies with a mixed population Across five studies evaluating ultrasmall super-paramagnetic iron oxide (USPIO)-enhanced MRI (n = 93), the mean sensitivity was 98% (95% CI 61% to 100%) and mean specificity 96% (95% CI 72% to 100%) Across three studies of gadolinium-enhanced MRI (n = 187), the mean sensitivity was 88% (95% CI 78% to 94%) and mean specificity 73% (95% CI 63% to 81%) In the single study of in vivo proton magnetic resonance spectroscopy (n = 27), the sensitivity was 65% (95% CI 38% to 86%) and specificity 100% (95% CI 69% to 100%) USPIO-enhanced MRI showed a trend towards higher sensitivity and specificity than gadolinium-enhanced MRI Results of the decision modelling suggest that the MRI replacement strategy is the most cost-effective strategy and dominates the baseline 4-node sampling (4-NS) and sentinel lymph node biopsy (SLNB) strategies in most sensitivity analyses undertaken The PET replacement strategy is not as robust as the MRI replacement strategy, as its cost-effectiveness is significantly affected by the utility decrement for lymphoedema and the probability of relapse for false-negative (FN) patients Limitations No included studies directly compared PET and MRI Conclusions Studies demonstrated that PET and MRI have lower sensitivity and specificity than SLNB and 4-NS but are associated with fewer adverse events Included studies indicated a significantly higher mean sensitivity for MRI than for PET, with USPIO-enhanced MRI providing the highest sensitivity However, sensitivity and specificity of PET and MRI varied widely between studies, and MRI studies were relatively small and varied in their methods; therefore, results should be interpreted with caution Decision modelling based on these results suggests that the most cost-effective strategy may be MRI rather than SLNB or 4-NS This strategy reduces costs and increases quality-adjusted life-years (QALYs) because there are fewer adverse events for the majority of patients However, this strategy leads to more FN cases at higher risk of cancer recurrence and more false- positive (FP) cases who would undergo unnecessary axillary lymph node dissection Adding MRI prior to SLNB or 4-NS has little effect on QALYs, though this analysis is limited by lack of available data Future research should include large, well-conducted studies of MRI, particularly using USPIO; data on the long-term impacts of lymphoedema on cost and patient utility; studies of the comparative effectiveness and cost-effectiveness of SLNB and 4-NS; and more robust UK cost data for 4-NS and SLNB as well as the cost of MRI and PET techniques Funding This study was funded by the Health Technology Assessment programme of the National Institute of Health Research

Adaptive e-learning to improve dietary behaviour: a systematic review and cost-effectiveness analysis.

Abstract: BACKGROUND: UK public health policy strongly advocates dietary change for the improvement of population health and emphasises the importance of individual empowerment to improve health. A new and evolving area in the promotion of dietary behavioural change is 'e-learning', the use of interactive electronic media to facilitate teaching and learning on a range of issues including health. The high level of accessibility, combined with emerging advances in computer processing power, data transmission and data storage, makes interactive e-learning a potentially powerful and cost-effective medium for improving dietary behaviour. OBJECTIVE: This review aims to assess the effectiveness and cost-effectiveness of adaptive e-learning interventions for dietary behaviour change, and also to explore potential psychological mechanisms of action and components of effective interventions. DATA SOURCES: Electronic bibliographic databases (Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library, Dissertation Abstracts, EMBASE, Education Resources Information Center, Global Health, Health Economic Evaluations Database, Health Management Information Consortium, MEDLINE, PsycINFO and Web of Science) were searched for the period January 1990 to November 2009. Reference lists of included studies and previous reviews were also screened; authors were contacted and trial registers were searched. REVIEW METHODS: Studies were included if they were randomised controlled trials, involving participants aged ≥ 13 years, which evaluated the effectiveness of interactive software programs for improving dietary behaviour. Primary outcomes were measures of dietary behaviours, including estimated intakes or changes in intake of energy, nutrients, dietary fibre, foods or food groups. Secondary outcome measures were clinical outcomes such as anthropometry or blood biochemistry. Psychological mediators of dietary behaviour change were also investigated. Two review authors independently screened results and extracted data from included studies, with any discrepancies settled by a third author. Where studies reported the same outcome, the results were pooled using a random-effects model, with weighted mean differences (WMDs), and 95% confidence intervals (CIs) were calculated. Cost-effectiveness was assessed in two ways: through a systematic literature review and by building a de novo decision model to assess the cost-effectiveness of a 'generic' e-learning device compared with dietary advice delivered by a health-care professional. RESULTS: A total of 36,379 titles were initially identified by the electronic searches, of which 43 studies were eligible for inclusion in the review. All e-learning interventions were delivered in high-income countries. The most commonly used behavioural change techniques reported to have been used were goal setting; feedback on performance; information on consequences of behaviour in general; barrier identification/problem solving; prompting self-monitoring of behaviour; and instruction on how to perform the behaviour. There was substantial heterogeneity in the estimates of effect. E-learning interventions were associated with a WMD of +0.24 (95% CI 0.04 to 0.44) servings of fruit and vegetables per day; -0.78 g (95% CI -2.5 g to 0.95 g) total fat consumed per day; -0.24 g (95% CI -1.44 g to 0.96 g) saturated fat intake per day; -1.4% (95% CI -2.5% to -0.3%) of total energy consumed from fat per day; +1.45 g (95% CI -0.02 g to 2.92 g) dietary fibre per day; +4 kcal (95% CI -85 kcal to 93 kcal) daily energy intake; -0.1 kg/m2 (95% CI -0.7 kg/m2 to 0.4 kg/m2) change in body mass index. The base-case results from the E-Learning Economic Evaluation Model suggested that the incremental cost-effectiveness ratio was approximately £102,112 per quality-adjusted life-year (QALY). Expected value of perfect information (EVPI) analysis showed that although the individual-level EVPI was arguably negligible, the population-level value was between £37M and £170M at a willingness to pay of £20,000-30,000 per additional QALY. LIMITATIONS: The limitations of this review include potential reporting bias, incomplete retrieval of completed research studies and data extraction errors. CONCLUSION: The current clinical and economic evidence base suggests that e-learning devices designed to promote dietary behaviour change will not produce clinically significant changes in dietary behaviour and are at least as expensive as other individual behaviour change interventions. FUTURE WORK RECOMMENDATIONS: Despite the relatively high EVPI results from the cost-effectiveness modelling, further clinical trials of individual e-learning interventions should not be undertaken until theoretically informed work that addresses the question of which characteristics of the target population, target behaviour, content and delivery of the intervention are likely to lead to positive results, is completed. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Hysterectomy, endometrial ablation and Mirena® for heavy menstrual bleeding: a systematic review of clinical effectiveness and cost-effectiveness analysis

Abstract: Objective The aim of this project was to determine the clinical effectiveness and cost-effectiveness of hysterectomy, first- and second-generation endometrial ablation (EA), and Mirena® (Bayer Healthcare Pharmaceuticals, Pittsburgh, PA, USA) for the treatment of heavy menstrual bleeding. Design Individual patient data (IPD) meta-analysis of existing randomised controlled trials to determine the short- to medium-term effects of hysterectomy, EA and Mirena. A population-based retrospective cohort study based on record linkage to investigate the long-term effects of ablative techniques and hysterectomy in terms of failure rates and complications. Cost-effectiveness analysis of hysterectomy versus first- and second-generation ablative techniques and Mirena. Setting Data from women treated for heavy menstrual bleeding were obtained from national and international trials. Scottish national data were obtained from the Scottish Information Services Division. Participants Women who were undergoing treatment for heavy menstrual bleeding were included. Interventions Hysterectomy, first- and second-generation EA, and Mirena. Main outcome measures Satisfaction, recurrence of symptoms, further surgery and costs. Results Data from randomised trials indicated that at 12 months more women were dissatisfied with first-generation EA than hysterectomy [odds ratio (OR): 2.46, 95% confidence interval (CI) 1.54 to 3.93; p = 0.0002), but hospital stay [WMD (weighted mean difference) 3.0 days, 95% CI 2.9 to 3.1 days; p < 0.00001] and time to resumption of normal activities (WMD 5.2 days, 95% CI 4.7 to 5.7 days; p < 0.00001) were longer for hysterectomy. Unsatisfactory outcomes associated with first- and second-generation techniques were comparable [12.2% (123/1006) vs 10.6% (110/1034); OR 1.20, 95% CI 0.88 to 1.62; p = 0.2). Rates of dissatisfaction with Mirena and second-generation EA were similar [18.1% (17/94) vs 22.5% (23/102); OR 0.76, 95% CI 0.38 to 1.53; p = 0.4]. Indirect estimates suggested that hysterectomy was also preferable to second-generation EA (OR 2.32, 95% CI 1.27 to 4.24; p = 0.006) in terms of patient dissatisfaction. The evidence to suggest that hysterectomy is preferable to Mirena was weaker (OR 2.22, 95% CI 0.94 to 5.29; p = 0.07). In women treated by EA or hysterectomy and followed up for a median [interquartile range (IQR)] duration of 6.2 (2.7–10.8) and 11.6 (7.9–14.8) years, respectively, 962/11,299 (8.5%) women originally treated by EA underwent further gynaecological surgery. While the risk of adnexal surgery was similar in both groups [adjusted hazards ratio 0.80 (95% CI 0.56 to 1.15)], women who had undergone ablation were less likely to need pelvic floor repair [adjusted hazards ratio 0.62 (95% CI 0.50 to 0.77)] and tension-free vaginal tape surgery for stress urinary incontinence [adjusted hazards ratio 0.55 (95% CI 0.41 to 0.74)]. Abdominal hysterectomy led to a lower chance of pelvic floor repair surgery [hazards ratio 0.54 (95% CI 0.45 to 0.64)] than vaginal hysterectomy. The incidence of endometrial cancer following EA was 0.02%. Hysterectomy was the most cost-effective treatment. It dominated first-generation EA and, although more expensive, produced more quality-adjusted life-years (QALYs) than second-generation EA and Mirena. The incremental cost-effectiveness ratios for hysterectomy compared with Mirena and hysterectomy compared with second-generation ablation were £1440 per additional QALY and £970 per additional QALY, respectively. Conclusions Despite longer hospital stay and time to resumption of normal activities, more women were satisfied after hysterectomy than after EA. The few data available suggest that Mirena is potentially cheaper and more effective than first-generation ablation techniques, with rates of satisfaction that are similar to second-generation techniques. Owing to a paucity of trials, there is limited evidence to suggest that hysterectomy is preferable to Mirena. The risk of pelvic floor surgery is higher in women treated by hysterectomy than by ablation. Although the most cost-effective strategy, hysterectomy may not be considered an initial option owing to its invasive nature and higher risk of complications. Future research should focus on evaluation of the clinical effectivesness and cost-effectiveness of the best second-generation EA technique under local anaesthetic versus Mirena and types of hysterectomy such as laparoscopic supracervical hysterectomy versus conventional hysterectomy and second-generation EA. Funding The National Institute for Health Research Health Technology Assessment programme.

The clinical effectiveness and cost-effectiveness of different surveillance mammography regimens after the treatment for primary breast cancer: systematic reviews registry database analyses and economic evaluation.

Abstract: Background: Following primary breast cancer treatment, the early detection of ipsilateral breast tumour recurrence (IBTR) or ipsilateral secondary cancer in the treated breast and detection of new primary cancers in the contralateral breast is beneficial for survival. Surveillance mammography is used to detect these cancers, but the optimal frequency of surveillance and the length of follow-up are unclear. Objectives: To identify feasible management strategies for surveillance and follow-up of women after treatment for primary breast cancer in a UK setting, and to determine the effectiveness and cost-effectiveness of differing regimens. Methods: A survey of UK breast surgeons and radiologists to identify current surveillance mammography regimens and inform feasible alternatives; two discrete systematic reviews of evidence published from 1990 to mid 2009 to determine (i) the clinical effectiveness and cost-effectiveness of differing surveillance mammography regimens for patient health outcomes and (ii) the test performance of surveillance mammography in the detection of IBTR and metachronous contralateral breast cancer (MCBC); statistical analysis of individual patient data (West Midlands Cancer Intelligence Unit Breast Cancer Registry and Edinburgh data sets); and economic modelling using the systematic reviews results, existing data sets, and focused searches for specific data analysis to determine the effectiveness and cost-utility of differing surveillance regimens. Results: The majority of survey respondents initiate surveillance mammography 12 months after breast-conserving surgery (BCS) (87%) or mastectomy (79%). Annual surveillance mammography was most commonly reported for women after BCS or after mastectomy (72% and 53%, respectively). Most (74%) discharge women from surveillance mammography, most frequently 10 years after surgery. The majority (82%) discharge from clinical follow-up, most frequently at 5 years. Combining initiation, frequency and duration of surveillance mammography resulted in 54 differing surveillance regimens for women after BCS and 56 for women following mastectomy. The eight studies included in the clinical effectiveness systematic review suggest surveillance mammography offers a survival benefit compared with a surveillance regimen that does not include surveillance mammography. Nine studies were included in the test performance systematic review. For routine IBTR detection, surveillance mammography sensitivity ranged from 64% to 67% and specificity ranged from 85% to 97%. For magnetic resonance imaging (MRI), sensitivity ranged from 86% to 100% and specificity was 93%. For non-routine IBTR detection, sensitivity and specificity for surveillance mammography ranged from 50% to 83% and from 57% to 75%, respectively, and for MRI from 93% to 100% and from 88% to 96%, respectively. For routine MCBC detection, one study reported sensitivity of 67% and specificity of 50% for both surveillance mammography and MRI, although this was a highly select population. Data set analysis showed that IBTR has an adverse effect on survival. Furthermore, women experiencing a second tumour measuring >20 mm in diameter were at a significantly greater risk of death than those with no recurrence or those whose tumour was <10mm in diameter. In the base-case analysis, the strategy with the highest net benefit, and most likely to be considered cost-effective, was surveillance mammography alone, provided every 12 months at a societal willingness to pay for a quality-adjusted life-year of either 20,000 pound or 30,000 pound. The incremental cost-effectiveness ratio for surveillance mammography alone every 12 months compared with no surveillance was 4727 pound. Limitations: Few studies met the review inclusion criteria and none of the studies was a randomised controlled trial. The limited and variable nature of the data available precluded any quantitative analysis. There was no useable evidence contained in the Breast Cancer Registry database to assess the effectiveness of surveillance mammography directly. The results of the economic model should be considered exploratory and interpreted with caution given the paucity of data available to inform the economic model. Conclusions: Surveillance is likely to improve survival and patients should gain maximum benefit through optimal use of resources, with those women with a greater likelihood of developing IBTR or MCBC being offered more comprehensive and more frequent surveillance. Further evidence is required to make a robust and informed judgement on the effectiveness of surveillance mammography and follow-up. The utility of national data sets could be improved and there is a need for high-quality, direct head-to-head studies comparing the diagnostic accuracy of tests used in the surveillance population. Funding: The National Institute for Health Research Health Technology Assessment programme.

The clinical effectiveness and cost-effectiveness of bortezomib and thalidomide in combination regimens with an alkylating agent and a corticosteroid for the first-line treatment of multiple myeloma: a systematic review and economic evaluation.

Abstract: Background. Multiple myeloma (MM) is the second most common haematological cancer in the UK. MM is not curable but can be treated with a combination of supportive measures and chemotherapy that aim to extend the duration and quality of survival. The majority of patients are not able to withstand intensive treatment, such as high-dose chemotherapy with autologous stem cell transplantation (SCT), and so they are offered single-agent or combination chemotherapy. Combination therapies typically include chemotherapy with an alkylating agent and a corticosteroid. More recently, combination therapies have incorporated drugs such as thalidomide (Thalidomide Celgene®, Celgene) and bortezomib (Velcade®, Janssen–Cilag). Objective. To assess the clinical effectiveness and cost-effectiveness of bortezomib or thalidomide in combination chemotherapy regimens with an alkylating agent and a corticosteroid for the first-line treatment of MM. Data sources. Electronic bibliographic databases, including MEDLINE, EMBASE and The Cochrane Library, were searched from 1999 to 2009 for English-language articles. Bibliographies of articles, grey literature sources and manufacturers’ submissions were also searched. Experts in the field were asked to identify additional published and unpublished references. Review methods. Titles and abstracts were screened for eligibility by two reviewers independently. The inclusion criteria specified in the protocol were applied to the full text of retrieved papers by one reviewer and checked independently by a second reviewer. Data extraction and quality assessment were undertaken by one reviewer and checked by a second reviewer. Differences in opinion were resolved through discussion at each stage. A cost–utility decision-analytic model was used to compare the cost-effectiveness estimates of bortezomib in combination with melphalan and prednisolone/prednisone (VMP), thalidomide in combination with cyclophosphamide and attenuated dexamethasone (CTDa), and thalidomide in combination with melphalan and prednisolone/prednisone (MPT) versus melphalan and prednisolone/prednisone (MP). Results. A total of 1436 records were screened and 40 references were retrieved for the systematic review of clinical effectiveness. Five randomised controlled trials (RCTs) met the inclusion criteria for the review: one RCT evaluated VMP, three evaluated MPT and one evaluated CTDa. The comparator in all of the included trials was MP. The review found that VMP and MPT can both be considered more clinically effective than MP for the first-line treatment of MM in people for whom high-dose therapy and SCT would not be appropriate. CTDa was more effective than MP in terms of complete response but data on survival outcomes did not meet the inclusion criteria. Cost-effectiveness analysis indicated that MPT has a greater probability of being cost-effective than either VMP or CTDa. Limitations. For most RCTs, details needed to judge study quality were incompletely reported. All studies stated that the analyses followed intention-to-treat principles but none adequately reported data censoring. Only one RCT contributed data on VMP and the published peer-reviewed follow-up data were immature. For MPT, overall survival data from two trials were eligible for inclusion but the doses of thalidomide differed between the trials and the treatment period was not reflective of current UK practice so the generalisability of the findings was uncertain. Two RCTs had a maintenance phase with thalidomide that did not meet the inclusion criteria so some of these results were not eligible for the review. Limited evidence on health-related quality of life (HRQoL) was provided by the single trial of VMP versus MP. Conclusions. Service provision is unlikely to change greatly. As uncertainties remain, further research is needed regarding the use of bortezomib- and thalidomide-containing combination regimens. Head-to-head trials of bortezomib- and thalidomide-containing combination regimes are required, including assessments of patient HRQoL in response to treatment.

An evidence synthesis of qualitative and quantitative research on component intervention techniques, effectiveness, cost-effectiveness, equity and acceptability of different versions of health-related lifestyle advisor role in improving health

Abstract: Background: There is a need to identify and analyse the range of models developed to date for delivering health related lifestyle advice (HRLA), or training, for effectiveness and cost-effectiveness in improving the health and well-being of individuals and communities in the UK, with particular reference to the reduction of inequalities. Objectives: To identify the component intervention techniques of lifestyle advisors (LAs) in the UK and similar contexts, and the outcomes of HRLA interventions. Data sources: Stakeholder views, secondary analysis of the National Survey of Health Trainer Activity, telephone survey of health trainer leads/coordinators. A search of a range of electronic databases was undertaken [including the Applied Social Sciences Index and Abstracts (ASSIA), EMBASE, NHS Economic Evaluation Database (NHS EED), MEDLINE, Psyc INFO, etc.], as well searching relevant journals and reference lists, conducted from inception to September 2008. Review methods: Identified studies were scanned by two reviewers and those meeting the following criteria were included: studies carrying out an evaluation of HRLA; those taking place in developed countries similar to the UK context; those looking at adult groups; interventions with the explicit aim of health improvement; interventions that involved paid or voluntary work with an individual or group of peers acting in an advisory role; advice delivered by post, online or electronically; training, support or counselling delivered to patients, communities or members of the public. After quality assessment, studies were selected for inclusion in the review. Data were abstracted from each study according to an agreed procedure and narrative, and realist and economic approaches were used to synthesise the data. Cost-effectiveness analysis of interventions was undertaken. Results: In total, 269 studies were identified but 243 were excluded. The 26 included studies addressing chronic care, mental health, breastfeeding, smoking, diet and physical activity, screening and human immunodeficiency virus (HIV) infection prevention. Overall, there was insufficient evidence to either support or refute the use of LAs to promote health and improve quality of life (QoL), and thus uncertainty about the interventions’ cost-effectiveness. However, the economic analysis showed that LA interventions were cost-effective in chronic care and smoking cessation, inconclusive for breastfeeding and mental health and not cost-effective for screening uptake and diet/physical activity. LA interventions for HIV prevention were cost effective, but not in a UK context. Limitations: The wide variety of LA models, delivery settings and target populations prevented the reviewers from establishing firm causal relationships between intervention mode and study outcomes. Conclusions: Evidence was variable, giving only limited support to LAs having a positive impact on health knowledge, behaviours and outcomes. Levels of acceptability appeared to be high. LAs acted as translational agents, sometimes removing barriers to prescribed behaviour or helping to create facilitative social environments. Reporting of processes of accessing or capitalising on indigenous knowledge was limited. Ambiguity was apparent with respect to the role and impact of lay and peer characteristics of the interventions. A future programme of research on HRLA could benefit from further emphasis on identification of needs, the broadening of population focus and intervention aims, the measurement of outcomes and the reviewing of evidence. Funding: This study was funded by the Health Technology Assessment programme of the National Institute for Health Research.

Palivizumab for immunoprophylaxis of respiratory syncytial virus (RSV) bronchiolitis in high-risk infants and young children: A systematic review and additional economic modelling of subgroup analyses

Abstract: BACKGROUND Respiratory syncytial virus (RSV) is a seasonal infectious disease, with epidemics occurring annually from October to March in the UK. It is a very common infection in infants and young children and can lead to hospitalisation, particularly in those who are premature or who have chronic lung disease (CLD) or congenital heart disease (CHD). Palivizumab (Synagis®, MedImmune) is a monoclonal antibody designed to provide passive immunity against RSV and thereby prevent or reduce the severity of RSV infection. It is licensed for the prevention of serious lower respiratory tract infection caused by RSV in children at high risk. While it is recognised that a policy of using palivizumab for all children who meet the licensed indication does not meet conventional UK standards of cost-effectiveness, most clinicians feel that its use is justified in some children.

A Systematic Review and Economic Evaluation of Cilostazol, Naftidrofuryl Oxalate, Pentoxifylline and Inositol Nicotinate for the Treatment of Intermittent Claudication in People with Peripheral Arterial Disease

Abstract: Background Peripheral arterial disease (PAD) is a condition in which there is blockage or narrowing of the arteries that carry blood to the legs and arms. It is estimated to affect around 4.5% of people aged between 55 and 74 years within the UK. The most common symptom of PAD is intermittent claudication (IC), characterised by pain in the legs on walking that is relieved with rest. Objective To assess the effectiveness and cost-effectiveness of cilostazol, naftidrofuryl oxalate, pentoxifylline and inositol nicotinate, compared with no vasoactive drugs, for IC due to PAD in adults whose symptoms continue despite a period of conventional management. Data source Electronic bibliographic databases were searched during April to June 2010 (MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, The Cochrane Library databases, Cumulative Index to Nursing and Allied Health Literature, Web of Science, Conference Proceedings Citation Index, BIOSIS Previews). Review methods Effectiveness outcomes sought were maximal walking distance (MWD), pain-free walking distance (PFWD), ankle–brachial pressure index, cardiovascular events, mortality, adverse events (AEs) and health-related quality of life (HRQoL). A narrative synthesis was provided for all outcomes and a network meta-analysis was undertaken for the walking distance outcomes. A Markov model was developed to assess the relative cost-effectiveness of the interventions from a NHS perspective over a lifetime. The model has three states: vasoactive drug treatment, no vasoactive drug treatment and death. Each 1-week cycle, patients may continue with the drug, discontinue the drug or die. Regression analysis was undertaken to model the relationship between MWD and utility so that a cost per quality-adjusted life-year (QALY) outcome measure could be presented. Univariate and probabilistic sensitivity analyses were undertaken. All costs and outcomes were discounted at 3.5%. Results Twenty-six randomised controlled trials were identified that met the inclusion criteria for the clinical effectiveness review. There was evidence that walking distance outcomes were significantly improved by both cilostazol and naftidrofuryl oxalate; the 95% credible intervals for the difference from placebo in the logarithm mean change MWD from baseline were 0.108 to 0.337 and 0.181 to 0.762, respectively. It was not possible to include inositol nicotinate within the meta-analysis of MWD and PFWD owing to the lack of 24-month data; however, the shorter-term data did not suggest a significant effect. AEs were minor for all drugs and included headaches and gastrointestinal difficulties. The incidence of serious adverse events (SAEs), including cardiovascular events and mortality, was not increased by the vasoactive drugs compared with placebo; however, most studies had a relatively short follow-up time to address this outcome. HRQoL data were limited. Two studies of limited quality were identified within the review of cost-effectiveness. The de novo model developed suggests that naftidrofuryl oxalate dominates cilostazol and pentoxifylline and has a cost per QALY gained of around £6070 compared with no vasoactive drug. This result is reasonably robust to changes within the key model assumptions. Inositol nicotinate was not included within the main analysis owing to lack of data. However, it is unlikely to be considered to be cost-effective due to its high acquisition cost (£900 vs £100–500 per year for the other drugs). Conclusions Naftidrofuryl oxalate and cilostazol both appear to be effective treatments for this patient population, with minimal SAEs. However, naftidrofuryl oxalate is the only treatment that is likely to be considered cost-effective. The long-term effectiveness is uncertain and hence a trial comparing cilostazol, naftidrofuryl oxalate and placebo beyond 24 weeks would be beneficial. Outcomes associated with naftidrofuryl oxalate could also be compared with those associated with supervised exercise programmes and angioplasty. Source of funding The National Institute for Health Research Health Technology Assessment programme.

Bone-Anchored Hearing Aids (BAHAs) for People who are Bilaterally Deaf: A Systematic Review and Economic Evaluation

Abstract: Background A bone-anchored hearing aid (BAHA) consists of a permanent titanium fixture, which is surgically implanted into the skull bone behind the ear, and a small detachable sound processor that clips onto the fixture. BAHAs are suitable for people with conductive or mixed hearing loss who cannot benefit fully from conventional hearing aids. Objectives To assess the clinical effectiveness and cost-effectiveness of BAHAs for people who are bilaterally deaf. Data sources Nineteen electronic resources, including MEDLINE, EMBASE and The Cochrane Library (inception to November 2009). Additional studies were sought from reference lists and clinical experts. Review methods Inclusion criteria were applied by two reviewers independently. Data extraction and quality assessment were undertaken by one reviewer and checked by a second. Prospective studies of adults or children with bilateral hearing loss were eligible. Comparisons were BAHAs versus conventional hearing aids [air conduction hearing aid (ACHA) or bone conduction hearing aid (BCHA)], unaided hearing and ear surgery; and unilateral versus bilateral BAHAs. Outcomes included hearing measures, validated measures of quality of life (QoL), adverse events and measures of cost-effectiveness. For the review of cost-effectiveness, full economic evaluations were eligible. Results Twelve studies were included (seven cohort pre–post studies and five cross-sectional ‘audiological comparison’ studies). No prospective studies comparing BAHAs with ear surgery were identified. Overall quality was rated as weak for all included studies and meta-analysis was not possible due to differences in outcome measures and patient populations. Limitations The economic evaluation presented in this report is severely limited by a lack of robust evidence on the outcome of hearing aid provision. This has lead to a more restricted analysis than was originally anticipated (limited to a comparison of BAHA and BCHA). In the absence of useable QoL data, the cost-effectiveness analysis is based on potential utility gains from hearing, that been inferred using a QoL instrument rather than measures reported by hearing aid users themselves. As a result the analysis is regarded as exploratory and the reported results should be interpreted with caution. Conclusions Exploratory cost-effectiveness analysis suggests that BAHAs are unlikely to be a cost-effective option where the benefits (in terms of hearing gain and probability of using of alternative aids) are similar for BAHAs and their comparators. The greater the benefit from aided hearing and the greater the difference in the proportion of people using the hearing aid for ≥ 8 hours per day, the more likely BAHAs are to be a cost-effective option. The inclusion of other dimensions of QoL may also increase the likelihood of BAHAs being a cost-effective option. A national audit of BAHAs is needed to provide clarity on the many areas of uncertainty surrounding BAHAs. Further research into the non-audiological benefits of BAHAs, including QoL, is required. Funding This report was commissioned by the National Institute for Health Research Health Technology Assessment programme.

Peginterferon alfa and ribavirin for chronic hepatitis C in patients eligible for shortened treatment, re-treatment or in HCV/HIV co-infection: a systematic review and economic evaluation.

Abstract: The aim of this health technology assessment is to assess the clinical-effectiveness and cost-effectiveness of peginterferon alfa and ribavirin for the treatment of chronic hepatitis C. Interferon alfa (pegylated and non-pegylated) and ribavirin for the treatment of moderate to severe hepatitis C was appraised by NICE in 2004 (TA751) and an appraisal specifically for mild hepatitis C was carried out in 2006 (TA1062). Both appraisals were based on independent assessment reports conducted by SHTAC.3,4 Since NICE's clinical guidance was published, there have been extensions to the licences for peginterferon alfa-2a and -2b. This health technology assessment is a part-review of the current NICE guidance and will be restricted to the patient subgroups that are affected by the licence extensions for the peginterferons. This includes people who have been previously treated with peginterferon alfa and ribavirin in combination and who either did not respond or who responded but relapsed, people who meet the licensed criteria for receiving shortened courses of combination therapy and people with HCV/HIV co-infection The HTA Programme commissioned this technology assessment report on behalf of the National Institute for Health and Clinical Excellence.

Insulin sensitisers in the treatment of non-alcoholic fatty liver disease: a systematic review.

Abstract: Background: Non-alcoholic fatty liver disease (NAFLD) is closely linked with obesity and the prevalence of NAFLD is about 17% to 33% in the Western world. There is a strong association of NAFLD with insulin resistance and, hence, insulin sensitisers have been tried. This systematic review examined the clinical effectiveness of insulin sensitisers in patients with NAFLD, to help decide whether or not a trial or trials of the insulin sensitisers was necessary and also to explore whether or not non-invasive alternatives to liver biopsy were available that could be used in a large trial of the insulin sensitisers. Objective: To review the use of insulin sensitisers in the treatment of NAFLD. Review methods: A systematic review of the clinical effectiveness of metformin, rosiglitazone and pioglitazone was carried out, including reviews and randomised controlled trials (RCTs). Databases searched were MEDLINE, 1950 to June 2010; EMBASE, 1980 to June 2010; Science Citation Index Expanded, June 2010; Conference Proceedings Citation Index – Science June 2010; The Cochrane Library 2005–10. Abstracts were screened independently by two researchers. A narrative review of diagnostic methods was conducted. Results: Clinical effectiveness. We identified 15 RCTs (one available as abstract). Four papers explored efficacy of pioglitazone, one rosiglitazone, eight metformin; two compared metformin and rosiglitazone, although one used both metformin and rosiglitazone. The duration of most trials was between 6 and 12 months. Many trials had a small number of participants and the quality of the studies was mixed. Pioglitazone improved all parameters of liver histology. Metformin showed mixed results, with ultrasound changes in two studies showing some improvement in steatosis, whereas there were no changes in the other two. Metformin, however, showed no improvement in non-alcoholic steatohepatitis (NASH) stages. Metformin showed greater reduction in glycosylated haemoglobin (–0.23% to –1.2% vs –0.2% to –0.7%) and fasting plasma glucose (+0.05 to –3.19 mmol/l vs –0.17 to –1.11 mmol/l) compared with pioglitazone. Metformin led to weight reduction (–4.3 to –6.7 kg), whereas participants on pioglitazone gained weight (+2.5 to +4.7 kg). Alanine aminotransferase levels were reduced with both metformin and pioglitazone; however, the reduction in levels with pioglitazone was not different to that caused by vitamin E. Most studies suggested that metformin led to a significant reduction in insulin resistance. Diagnosis. Non-invasive methods of diagnosing NAFLD without liver biopsy, using combinations of clinical history, laboratory tests and ultrasound, have been explored, but so far liver biopsy is the only proven method of distinguishing simple steatosis from NASH. Transient elastography appears useful, but less so in obese individuals. Magnetic resonance spectroscopy shows promise, but is expensive and not readily available. Limitations: Mixed quality of trials, with lack of detail as to how some trials were conducted. Many trials had small numbers of patients. Conclusions: The main need for drug trials is at the NASH stage. However, at present, any trial in the more advanld have to use liver biopsy. The highest may, therefore, be in the diagnosis of NAFLD, and theen steewer agents, the glucagon-like peptide-1aglutide, may be more worthy of a trial. Funding: The National Institute for Health Research Health Technology Assessment programme.

Hemiarthroplasty and Total Hip Arthroplasty for Treating Primary Intracapsular Fracture of the Hip: A Systematic Review and Cost-Effectiveness Analysis

Abstract: Background Hip fracture is a common problem in people aged > 60 years. The treatment options for individuals with high pre-fracture mobility, function and independence are hemiarthroplasty (HA) and total hip arthroplasty (THA). Objective The aim of this report is to assess the clinical effectiveness and cost-effectiveness evidence of THA compared with HA in patients with displaced intracapsular fracture who are cognitively intact with high pre-fracture mobility or function. Data sources A systematic search was made of 11 databases of published and unpublished literature from their inception to december 2010: MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library, Biological Science Citation Index, Social Science Citation Index, Conference Proceedings Citation Index - Science, UK Clinical Trials Research Network and the National Research Register archive, Current Controlled Trials and ClinicalTrials.gov. Review methods A systematic review of randomised controlled trials (RCTs) to assess the effectiveness of THA compared with HA in terms of dislocations, revisions, pain and function, and quality of life. Meta-analysis, independent subgroup analyses and exploratory cost-effectiveness modelling were performed. Results The literature search identified 532 unique citations, of which eight RCTs with almost 1000 participants satisfied the criteria for the effectiveness review. Meta-analysis found a statistically significant increased risk of dislocation for patients treated with THA compared with HA (p = 0.01), but a reduced risk of revision (p = 0.0003). There were no differences in terms of mortality. In all trials, individuals treated with THA reported better function and mobility and less pain than those treated with HA. Four trials reporting utility data found similar trends. Sensitivity analyses indicated that there were no statistically significant differences in outcomes based on follow-up, study quality, surgical approach taken, type of head or the use of cement. Four papers reported a cost-utility analysis or the cost-effectiveness of THA compared with HA. Exploratory modelling was undertaken that showed that THA is likely to be cost-effective compared with HA even when the limitations of the data and methodology are considered. Limitations The costs and disutilities associated with revisions and dislocations were not included in the economic evaluation. Conclusions THA appears to be more cost-effective than HA. It is likely that THA will be associated with increased costs in the initial 2-year period, but lower longer-term costs, owing to potentially lower revision rates. However, these longer-term costs have not been modelled. The capacity and experience of surgeons to perform THA have not been explored and these would need to be addressed at local level were THA to become recommended for active, elderly patients in whom THA is not contraindicated. Further studies examining the impact of surgeon experience on performing the two procedures may offer more robust evidence on outcomes. Funding The National Institute for Health Research Health Technology Assessment programme.

Processes in recruitment to randomised controlled trials of medicines for children (RECRUIT): a qualitative study.

Abstract: OBJECTIVES: To investigate recruitment processes across a range of clinical trials and from the perspective of parents, young people and practitioners to identify strategies to improve recruitment and its conduct across the spectrum of trials of medicines for children. DESIGN: Qualitative interview and observational study. SETTING: Eleven paediatric clinical trial centres recruiting to four trials. PARTICIPANTS: Members of 60 families approached to consider entry to one of the participating trials and 31 practitioners. INTERVENTIONS: None. MAIN OUTCOME MEASURES: Data were verbatim transcripts of (1) audio-recorded trial recruitment discussions between practitioners and families (n = 41) and (2) semi-structured interviews with parents (n = 62), young people (n = 22) and practitioners (19 doctors and 12 research nurses). Analyses were interpretive, following the general principles of the constant comparative method. RESULTS: Practitioners were concerned to avoid overburdening parents and some indicated that they found approaching families about trials to be aversive. By contrast, even in the most difficult situations, parents did not mind being asked about trials and they did not describe the approach as burdensome. Some parents viewed the trial approach as a positive or exciting opportunity. Parents and young people took little active part in the trial discussions and asked few questions. Despite this, they were satisfied with how they had been approached, and spoke of how they had felt involved, valued, cared for and comfortable to interject during the discussion. However, we identified several parents who had important misunderstandings about the trial. There were few differences between parents who consented and those who declined a trial. Regardless of whether they consented or declined, parents' trial decisions were influenced by their perceptions of the trial in relation to their child's safety and well-being, potential benefits to the child and family, potential benefits to others and the practicality of participation. Of these, parents' paramount consideration was safety. Parents', young people's and practitioners' views of what was important when considering a trial were broadly convergent, although families gave greater importance than practitioners to the trial's practical requirements. All parties valued the face-to-face trial discussion highly and wanted shorter and less complex written information. Parents did not feel pressured by the trial team to participate, but some described how their personal values made them reluctant to decline, and several parents who did decline described a passing sense of discomfort. CONCLUSIONS: The concerns of some practitioners that families would be overburdened were unfounded, as parents did not object to being asked about research. Practitioners may benefit from support that helps them feel personally more at ease in approaching families about trials. Parents and young people often described the trial discussions in strongly positive terms and emphasised the importance of the social and emotional aspects of these encounters. Informed consent training could be enhanced if it similarly emphasised these aspects of recruitment; the misunderstandings we identified indicate how this training could also help practitioners to improve the clarity of their trial discussions with families. Guidelines on informed consent documents should take account of findings that all groups thought that these documents should be shorter and more straightforward. FUNDING: This research was commissioned by the National Institute for Health Research Health Technology Assessment programme.

The clinical effectiveness and safety of prophylactic retinal interventions to reduce the risk of retinal detachment and subsequent vision loss in adults and children with Stickler syndrome: a systematic review.

Abstract: Background Stickler syndrome, also known as hereditary progressive arthro-ophthalmopathy, is an inherited progressive disorder of the collagen connective tissues. Manifestations include short-sightedness, cataracts, retinal problems leading to retinal detachment and possible blindness. This is principally the case among individuals with type 1 Stickler Syndrome. It is the most commonly identified inherited cause of retinal detachment in childhood. However, there is no consensus regarding best practice and no current guidelines on prophylactic interventions for this population. Objectives The aim of this systematic review was to assess the evidence for the clinical effectiveness and safety of primary prophylactic interventions for the prevention of retinal detachment in previously untreated eyes without retinal detachment in patients with Stickler syndrome. The primary outcome of interest was retinal detachment post prophylaxis. Data sources A systematic search was made of 11 databases of published and unpublished literature, which included MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, the Cumulative Index to Nursing and Allied Health Literature and The Cochrane Library. There was no restriction by language or date. The references of all included studies were checked for further relevant citations and authors of studies with potentially relevant data were also contacted. Review methods Two reviewers double-screened all titles and abstracts of the citations retrieved by the search to identify studies that satisfied the inclusion criteria. Both reviewers also independently extracted and quality assessed all included studies. A narrative synthesis was performed. Results The literature search identified 1444 unique citations, of which four studies satisfied the inclusion criteria. The two principal studies were both retrospective cohort studies with control groups in populations with type 1 Stickler syndrome. One study evaluated 360° cryotherapy (n = 204) and the other focal or circumferential laser treatment (n = 22). Both studies reported a statistically significant difference in the rate of retinal detachment per eye between the groups receiving prophylaxis and the controls. However, both studies were subject to a high risk of bias. The results of the two supporting studies of Wagner-Stickler patients were either relatively inconsistent or unreliable. No study reported any major or long-term complications associated with the interventions. Despite the weaknesses of the evidence, the rate of retinal detachment in the intervention groups, especially the cryotherapy group, was lower than the rate either experienced in the study control groups or reported in other studies of untreated Stickler syndrome populations not exposed to prophylaxis. Conclusions Only 360° cryotherapy and focal and circumferential laser treatment have been evaluated for the type 1 Stickler syndrome population, and then only by a single retrospective, controlled, cohort study in each case. Both of these studies report a significant difference between intervention and control groups (principally no treatment) and no major or long-term side effects or complications. However, there is a high risk of bias within these two studies, so the relative effectiveness of either intervention is uncertain. Future work A service priority is to determine reliably the prevalence of Stickler syndrome, i.e. how many individuals have type 1 or type 2 Stickler syndrome, and their risk of retinal detachment and subsequent blindness. A non-randomised, prospective cohort comparison study, in which eligible participants are treated, followed-up and analysed in one of three study arms, for no treatment, laser therapy or cryotherapy, would potentially offer further certainty in terms of the relative efficacy of both prophylaxis versus no prophylaxis and cryotherapy versus laser therapy than is possible with the currently available data. Alternatively, continued follow-up and analysis of existing study data, and data collection from relevant sample populations, are required to assess the long-term risks of blindness, retinal detachment and prophylaxis. Funding This study was funded by the National Institute for Health Research Health Technology Assessment programme.

The clinical effectiveness and cost-effectiveness of genotyping for CYP2D6 for the management of women with breast cancer treated with tamoxifen: a systematic review.

Abstract: BACKGROUND: Breast cancer is the most common cancer affecting women in the UK. Tamoxifen (TAM) is considered as the standard of care for many women with oestrogen receptor positive breast cancer. However, wide variability in the response of individuals to drugs at the same doses may occur, which may be a result of interindividual genetic differences (pharmacogenetics). TAM is known to be metabolised to its active metabolites N-desmethyl TAM and 4-hydroxytamoxifen by a number of CYP450 enzymes, including CYP2D6, CYP3A4, CYP2C9, CYP2C19 and CYP2B6. N-desmethyl TAM is further metabolised to endoxifen by CYP2D6. Endoxifen, which is also formed via the action of CYP2D6, is 30- to 100-fold more potent than TAM in suppressing oestrogen-dependent cell proliferation, and is considered an entity responsible for significant pharmacological effects of TAM. Thus, an association between the cytochrome P450 2D6 (CYP2D6) genotype and phenotype (expected drug effects) is believed to exist and it has been postulated that CYP2D6 testing may play a role in optimising an individual's adjuvant hormonal treatment. OBJECTIVES: To determine whether or not testing for cytochrome P450 2D6 (CYP2D6) polymorphisms in women with early hormone receptor positive breast cancer leads to improvement in outcomes, is useful for health decision-making and is a cost-effective use of health-care resources. DATA SOURCES: Relevant electronic databases and websites including MEDLINE, EMBASE and HuGENet? [Centers for Disease Control and Prevention (Office of Public Health Genomics), Human Genome Epidemiology Network] were searched until July 2009. Further studies that became known to the authors via relevant conferences or e-mail alerts from an automatically updated search of the Scopus database were also included as the review progressed, up to March 2010. REVIEW METHODS: A systematic review of the clinical effectiveness and cost-effectiveness of CYP2D6 testing was undertaken. As it was not possible to conduct meta-analyses, data were extracted into structured tables and narratively discussed. An exploratory analysis of sensitivity and specificity was undertaken. A review of economic evaluations and models of CYP2D6 testing for patients treated with TAM was also carried out. RESULTS: A total of 25 cohorts were identified which examined clinical efficacy (overall survival and relapse/recurrence), adverse events and endoxifen plasma concentrations by genotype/phenotype. Significantly, six cohorts suggest extensive metabolisers (Ems) appear to have better outcomes than either poor metabolisers (PMs) or PMs + intermediate metabolisers in terms of relapse/recurrence; however, three cohorts report apparently poorer outcomes for EMs (albeit not statistically significant). There was heterogeneity across the studies in terms of the patient population, alleles tested and outcomes used and defined. One decision model proposing a strategy for CYP2D6 testing for TAM was identified, but this was not suitable for developing a model to examine the cost-effectiveness of CYP2D6 testing. It was not possible to produce a de novo model because of a lack of data to populate it. CONCLUSION: This is a relatively new area of research that is evolving rapidly and, although international consortia are collaborating, the data are limited and conflicting. Therefore, it is not possible to recommend pharmacogenetic testing in this patient population. Future research needs to focus on which alleles (including, or in addition to, those related to CYP2D6) reflect patient response, the link between endoxifen levels and clinical outcomes, and the appropriate pathways for implementation of such pharmacogenetic testing in patient care pathways. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Lapatinib and Trastuzumab in Combination with an Aromatase Inhibitor for the First-Line Treatment of Metastatic Hormone Receptor-Positive Breast Cancer which Over-Expresses Human Epidermal Growth Factor 2 (HER2): A Systematic Review and Economic Analysis

Abstract: Background Breast cancer is the uncontrolled, abnormal growth of malignant breast tissue affecting predominantly women. Metastatic breast cancer (mBC) is an advanced stage of the disease when the disease has spread beyond the original organ. Hormone receptor status and human epidermal growth factor 2 (HER2) status are two predictive factors that are taken into consideration when estimating the prognosis of patients with breast cancer. Objectives To review the clinical effectiveness and cost-effectiveness evidence base for lapatinib (LAP) in combination with an aromatase inhibitor (AI) and trastuzumab (TRA) in combination with an AI for the first-line treatment of patients who have hormone receptor-positive (HR+)/human epidermal growth factor 2-positive (HER2+) mBC. Data sources Relevant electronic databases and websites, including MEDLINE, EMBASE and the Cochrane Library, were searched until May 2010. Further data were derived from the manufacturers' submissions for LAP + AI and TRA + AI. Review methods A systematic review of the clinical effectiveness and cost-effectiveness of LAP + AI and TRA + AI was undertaken. As it was deemed inappropriate to compare LAP + AI with TRA + AI, two separate assessments of cost-effectiveness versus AIs alone were undertaken. Results Three trials were included in the systematic review [the patient populations of the efficacy and safety of lapatinib combined with letrozole (EGF30008) trial, the efficacy and safety of trastuzumab combined with anastrozole (TAnDEM) trial and the efficacy and safety of letrozole combined with trastuzumab (eLEcTRA) trial]. As a result of differences in the exclusion criteria and because one trial was halted prematurely, comparisons across trials were believed to be inappropriate and meta-analysis was not possible. Individually, however, the findings from the trials all suggest that LAP + AI or TRA + AI results in improved progression-free survival and/or time to progression when compared with AIs alone. The trials do not show a statistically significant benefit in terms of overall survival. Two separate economic analyses were conducted based on the completed trials; neither LAP + AI nor TRA + AI was found to be cost-effective when compared with AI monotherapy. Limitations Because of differences in the EGF30008 and the TAnDEM trials, the Assessment Group believes the indirect comparisons analyses conducted by the manufacturers are inappropriate and, for the same reason, chooses not to compare LAP + AI with TRA + AI in an economic evaluation. Conclusions LAP + AI and TRA + AI appear to be clinically more effective than AI monotherapy, but neither is cost-effective compared with AIs alone. It was not possible to compare LAP + AI with TRA + AI. Future research should include research into treating mBC in the HR+/HER2+ population who are not TRA (or LAP) naive and into comparing the clinical effectiveness of AIs as monotherapy in patients with HER2+ and human epidermal growth factor 2-negative breast cancer. Funding The National Institute for Health Research Technology Assessment programme.

MAVARIC – a comparison of automation-assisted and manual cervical screening: a randomised controlled trial

Abstract: Objectives The principal objective was to compare automation-assisted reading of cervical cytology with manual reading using the histological end point of cervical intraepithelial neoplasia grade II (CIN2) or worse (CIN2+). Secondary objectives included (i) an assessment of the slide ranking facility of the Becton Dickinson (BD) FocalPoint™ Slide Profiler (Becton Dickinson, Franklin Lakes, NJ, USA), especially ‘No Further Review’, (ii) a comparison of the two approved automated systems, the ThinPrep® Imaging System (Hologic, Bedford, MA, USA) and the BD FocalPoint Guided Screener Imaging System, and (iii) automated versus manual in terms of productivity and cost-effectiveness. Design A 1 : 2 randomised allocation of slides to either manual reading or automation-assisted paired with manual reading. Cytoscreeners were blinded to whether samples would be read only manually or manually paired with automated. Slide reading procedures followed real-life laboratory protocol to produce a final result and, for paired readings, the worse result determined the management. Costs per event were estimated and combined with productivity to produce a cost per slide, per woman and per CIN2+ and cervical intraepithelial neoplasia grade III (CIN3) or worse (CIN3+) lesion detected. Cost-effectiveness was estimated using cost per CIN2+ detected. Lifetime cost-effectiveness in terms of life-years and quality-adjusted life-years was estimated using a mathematical model. Setting Liquid-based cytology samples were obtained in primary care, and a small number of abnormal samples were obtained from local colposcopy clinics, from different women, in order to enrich the proportion of abnormals. All of the samples were read in a single large service laboratory. Liquid residues used for human papillomavirus (HPV) triage were tested (with Hybrid Capture 2, Qiagen, Crawley, UK) in a specialist virology laboratory in Edinburgh, UK. Histopathology was read by a specialist gynaecological pathology team blinded to HPV results and type of reading. Participants Samples were obtained from women aged 25–64 years undergoing primary cervical screening in Greater Manchester, UK, with small proportions from women outside this age range and from women undergoing colposcopy. Interventions The principal intervention was automation-assisted reading of cervical cytology slides which was paired with a manual reading of the same slide. Low-grade cytological abnormalities (borderline and mild dyskaryosis) were triaged with HPV testing to direct colposcopy referral. Women with high-grade cytology were referred for colposcopy and those with negative cytology were returned to recall. Main outcome measures The principal outcome measure was the sensitivity of automation-assisted reading relative to manual for the detection of CIN2+. A secondary outcome measure was cost-effectiveness of each type of reading to detect CIN2+. The study was powered to detect a relative sensitivity difference equivalent to an absolute difference of 5%. Results The principal finding was that automated reading was 8% less sensitive relative to manual, 6.3% in absolute terms. ‘No further review’ was very reliable and, if restricted to routine screening samples, < 1% of CIN2+ would have been missed. Automated and manual were very similar in terms of cost-effectiveness despite a 60%–80% increase in productivity for automation-assisted reading. Conclusions The significantly reduced sensitivity of automated reading, combined with uncertainty over cost-effectiveness, suggests no justification at present to recommend its introduction. The reliability of ‘no further review’ warrants further consideration as a means of saving staff time. Trial registration Current Controlled Trials ISRCTN66377374. Funding This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 15, No. 3. See the HTA programme website for further project information.