scispace - formally typeset
Search or ask a question
Author

David Mawdsley

Bio: David Mawdsley is an academic researcher from University of Bristol. The author has contributed to research in topics: Sample size determination & Randomized controlled trial. The author has an hindex of 6, co-authored 8 publications receiving 242 citations. Previous affiliations of David Mawdsley include University of Manchester & University of Leicester.

Papers
More filters
Journal ArticleDOI
TL;DR: Flaws in the design of randomized trials may bias intervention effect estimates and increase between‐trial heterogeneity, and Inconsistency in criteria for risk‐of‐bias judgements applied by individual reviewers is a likely limitation of routinely collected bias assessments.
Abstract: Flaws in the design of randomized trials may bias intervention effect estimates and increase between-trial heterogeneity. Empirical evidence suggests that these problems are greatest for subjectively assessed outcomes. For the Risk of Bias in Evidence Synthesis (ROBES) Study, we extracted risk-of-bias judgements (for sequence generation, allocation concealment, blinding, and incomplete data) from a large collection of meta-analyses published in the Cochrane Library (issue 4; April 2011). We categorized outcome measures as mortality, other objective outcome, or subjective outcome, and we estimated associations of bias judgements with intervention effect estimates using Bayesian hierarchical models. Among 2,443 randomized trials in 228 meta-analyses, intervention effect estimates were, on average, exaggerated in trials with high or unclear (versus low) risk-of-bias judgements for sequence generation (ratio of odds ratios (ROR) = 0.91, 95% credible interval (CrI): 0.86, 0.98), allocation concealment (ROR = 0.92, 95% CrI: 0.86, 0.98), and blinding (ROR = 0.87, 95% CrI: 0.80, 0.93). In contrast to previous work, we did not observe consistently different bias for subjective outcomes compared with mortality. However, we found an increase in between-trial heterogeneity associated with lack of blinding in meta-analyses with subjective outcomes. Inconsistency in criteria for risk-of-bias judgements applied by individual reviewers is a likely limitation of routinely collected bias assessments. Inadequate randomization and lack of blinding may lead to exaggeration of intervention effect estimates in randomized trials.

238 citations

Journal ArticleDOI
01 Aug 2016
TL;DR: In this article, the authors proposed a model-based network meta-analysis (MBNMA) that combines both approaches, that respects randomization, and allows estimation and prediction for multiple agents and a range of doses, using plausible physiological doseresponse models.
Abstract: Model-based meta-analysis (MBMA) is increasingly used in drug development to inform decision-making and future trial designs, through the use of complex dose and/or time course models. Network meta-analysis (NMA) is increasingly being used by reimbursement agencies to estimate a set of coherent relative treatment effects for multiple treatments that respect the randomization within the trials. However, NMAs typically either consider different doses completely independently or lump them together, with few examples of models for dose. We propose a framework, model-based network meta-analysis (MBNMA), that combines both approaches, that respects randomization, and allows estimation and prediction for multiple agents and a range of doses, using plausible physiological dose-response models. We illustrate our approach with an example comparing the efficacies of triptans for migraine relief. This uses a binary endpoint, although we note that the model can be easily modified for other outcome types.

41 citations

Journal ArticleDOI
TL;DR: In this paper, the authors investigated the associations between risk of bias judgments from Cochrane reviews for sequence generation, allocation concealment and blinding, and between-trial heterogeneity, and found that heterogeneity variances were, on average, increased among trials at high/unclear risk for bias for sequence generator and blinding.

24 citations

Journal ArticleDOI
TL;DR: The two models for meta-analysis are compared using a random sample of 448 meta-analyses drawn from the Cochrane Database of Systematic Reviews, finding that the multiplicative model tends to give results that are closer to the null, with a narrower confidence interval.
Abstract: In meta-analysis, the random-effects model is often used to account for heterogeneity. The model assumes that heterogeneity has an additive effect on the variance of effect sizes. An alternative model, which assumes multiplicative heterogeneity, has been little used in the medical statistics community, but is widely used by particle physicists. In this paper, we compare the two models using a random sample of 448 meta-analyses drawn from the Cochrane Database of Systematic Reviews. In general, differences in goodness of fit are modest. The multiplicative model tends to give results that are closer to the null, with a narrower confidence interval. Both approaches make different assumptions about the outcome of the meta-analysis. In our opinion, the selection of the more appropriate model will often be guided by whether the multiplicative model's assumption of a single effect size is plausible. Copyright © 2016 John Wiley & Sons, Ltd.

19 citations

Posted Content
TL;DR: There is some indication that between-trial heterogeneity could be partially explained by reported design characteristics, and hence adjustment for bias could potentially improve accuracy of meta-analysis results.
Abstract: Objective: We investigated the associations between risk of bias judgments from Cochrane reviews for sequence generation, allocation concealment and blinding and between-trial heterogeneity. Study Design and Setting: Bayesian hierarchical models were fitted to binary data from 117 meta-analyses, to estimate the ratio {\lambda} by which heterogeneity changes for trials at high/unclear risk of bias, compared to trials at low risk of bias. We estimated the proportion of between-trial heterogeneity in each meta-analysis that could be explained by the bias associated with specific design characteristics. Results: Univariable analyses showed that heterogeneity variances were, on average, increased among trials at high/unclear risk of bias for sequence generation ({\lambda} 1.14, 95% interval: 0.57 to 2.30) and blinding ({\lambda} 1.74, 95% interval: 0.85 to 3.47). Trials at high/unclear risk of bias for allocation concealment were on average less heterogeneous ({\lambda} 0.75, 95% interval: 0.35 to 1.61). Multivariable analyses showed that a median of 37% (95% interval: 0% to 71%) heterogeneity variance could be explained by trials at high/unclear risk of bias for sequence generation, allocation concealment and/or blinding. All 95% intervals for changes in heterogeneity were wide and included the null of no difference. Conclusion: Our interpretation of the results is limited by imprecise estimates. There is some indication that between-trial heterogeneity could be partially explained by reported design characteristics, and hence adjustment for bias could potentially improve accuracy of meta-analysis results.

18 citations


Cited by
More filters
01 Jan 2012
TL;DR: Prostaglandin inhibitors and calcium channel blockers had the highest probability of delaying delivery and improving neonatal and maternal outcomes and were the tocolytics with the best probability of being ranked in the top three medication classes for the outcomes of 48 hour delay in delivery, respiratory distress syndrome, neonatal mortality, and maternal side effects (all cause).
Abstract: Objective To determine the most effective tocolytic agent at delaying delivery. Design Systematic review and network meta-analysis. Data sources Cochrane Central Register of Controlled Trials, Medline, Medline In-Process, Embase, and CINAHL up to 17 February 2012. Study selection Randomised controlled trials of tocolytic therapy in women at risk of preterm delivery. Data extraction At least two reviewers extracted data on study design, characteristics, number of participants, and outcomes reported (neonatal and maternal). A network meta-analysis was done using a random effects model with drug class effect. Two sensitivity analyses were carried out for the primary outcome; restricted to studies at low risk of bias and restricted to studies excluding women at high risk of preterm delivery (those with multiple gestation and ruptured membranes). Results Of the 3263 titles initially identified, 95 randomized controlled trials of tocolytic therapy were reviewed. Compared with placebo, the probability of delivery being delayed by 48 hours was highest with prostaglandin inhibitors (odds ratio 5.39, 95% credible interval 2.14 to 12.34) followed by magnesium sulfate (2.76, 1.58 to 4.94), calcium channel blockers (2.71, 1.17 to 5.91), beta mimetics (2.41, 1.27 to 4.55), and the oxytocin receptor blocker atosiban (2.02, 1.10 to 3.80). No class of tocolytic was significantly superior to placebo in reducing neonatal respiratory distress syndrome. Compared with placebo, side effects requiring a change of medication were significantly higher for beta mimetics (22.68, 7.51 to 73.67), magnesium sulfate (8.15, 2.47 to 27.70), and calcium channel blockers (3.80, 1.02 to 16.92). Prostaglandin inhibitors and calcium channel blockers were the tocolytics with the best probability of being ranked in the top three medication classes for the outcomes of 48 hour delay in delivery, respiratory distress syndrome, neonatal mortality, and maternal side effects (all cause). Conclusions Prostaglandin inhibitors and calcium channel blockers had the highest probability of delaying delivery and improving neonatal and maternal outcomes.

270 citations

Journal ArticleDOI
TL;DR: This meta‐analysis reinforces the efficacy of using MBIs for improving the mental health and wellbeing of youth as assessed using the gold standard RCT methodology.
Abstract: Background Mindfulness based interventions (MBIs) are an increasingly popular way of attempting to improve the behavioural, cognitive and mental health outcomes of children and adolescents, though there is a suggestion that enthusiasm has moved ahead of the evidence base. Most evaluations of MBIs are either uncontrolled or nonrandomized trials. This meta-analysis aims to establish the efficacy of MBIs for children and adolescents in studies that have adopted a randomized, controlled trial (RCT) design. Methods A systematic literature search of RCTs of MBIs was conducted up to October 2017. Thirty-three independent studies including 3,666 children and adolescents were included in random effects meta-analyses with outcome measures categorized into cognitive, behavioural and emotional factors. Separate random effects meta-analyses were completed for the seventeen studies (n = 1,762) that used an RCT design with an active control condition. Results Across all RCTs we found significant positive effects of MBIs, relative to controls, for the outcome categories of Mindfulness, Executive Functioning, Attention, Depression, Anxiety/Stress and Negative Behaviours, with small effect sizes (Cohen's d), ranging from .16 to .30. However, when considering only those RCTs with active control groups, significant benefits of an MBI were restricted to the outcomes of Mindfulness (d = .42), Depression (d = .47) and Anxiety/Stress (d = .18) only. Conclusions This meta-analysis reinforces the efficacy of using MBIs for improving the mental health and wellbeing of youth as assessed using the gold standard RCT methodology. Future RCT evaluations should incorporate scaled-up definitive trial designs to further evaluate the robustness of MBIs in youth, with an embedded focus on mechanisms of action.

235 citations

Journal ArticleDOI
13 Mar 2019-BMJ
TL;DR: Systematic review and meta-analysis of randomised controlled trials found that SMT produces similar effects to recommended therapies for chronic low back pain, whereas SMT seems to be better than non-recommended interventions for improvement in function in the short term.
Abstract: Objective To assess the benefits and harms of spinal manipulative therapy (SMT) for the treatment of chronic low back pain. Design Systematic review and meta-analysis of randomised controlled trials. Data sources Medline, PubMed, Embase, Cochrane Central Register of Controlled Trials (CENTRAL), CINAHL, Physiotherapy Evidence Database (PEDro), Index to Chiropractic Literature, and trial registries up to 4 May 2018, including reference lists of eligible trials and related reviews. Eligibility criteria for selecting studies Randomised controlled trials examining the effect of spinal manipulation or mobilisation in adults (≥18 years) with chronic low back pain with or without referred pain. Studies that exclusively examined sciatica were excluded, as was grey literature. No restrictions were applied to language or setting. Review methods Two reviewers independently selected studies, extracted data, and assessed risk of bias and quality of the evidence. The effect of SMT was compared with recommended therapies, non-recommended therapies, sham (placebo) SMT, and SMT as an adjuvant therapy. Main outcomes were pain and back specific functional status, examined as mean differences and standardised mean differences (SMD), respectively. Outcomes were examined at 1, 6, and 12 months. Quality of evidence was assessed using GRADE. A random effects model was used and statistical heterogeneity explored. Results 47 randomised controlled trials including a total of 9211 participants were identified, who were on average middle aged (35-60 years). Most trials compared SMT with recommended therapies. Moderate quality evidence suggested that SMT has similar effects to other recommended therapies for short term pain relief (mean difference −3.17, 95% confidence interval −7.85 to 1.51) and a small, clinically better improvement in function (SMD −0.25, 95% confidence interval −0.41 to −0.09). High quality evidence suggested that compared with non-recommended therapies SMT results in small, not clinically better effects for short term pain relief (mean difference −7.48, −11.50 to −3.47) and small to moderate clinically better improvement in function (SMD −0.41, −0.67 to −0.15). In general, these results were similar for the intermediate and long term outcomes as were the effects of SMT as an adjuvant therapy. Evidence for sham SMT was low to very low quality; therefore these effects should be considered uncertain. Statistical heterogeneity could not be explained. About half of the studies examined adverse and serious adverse events, but in most of these it was unclear how and whether these events were registered systematically. Most of the observed adverse events were musculoskeletal related, transient in nature, and of mild to moderate severity. One study with a low risk of selection bias and powered to examine risk (n=183) found no increased risk of an adverse event (relative risk 1.24, 95% confidence interval 0.85 to 1.81) or duration of the event (1.13, 0.59 to 2.18) compared with sham SMT. In one study, the Data Safety Monitoring Board judged one serious adverse event to be possibly related to SMT. Conclusion SMT produces similar effects to recommended therapies for chronic low back pain, whereas SMT seems to be better than non-recommended interventions for improvement in function in the short term. Clinicians should inform their patients of the potential risks of adverse events associated with SMT.

156 citations

Journal ArticleDOI
01 Nov 2018-Drugs
TL;DR: The aim of the study was to estimate the efficacy and safety of CBD as adjunctive treatment in patients with epilepsy using meta-analytical techniques.
Abstract: Approximately one-third of patients with epilepsy presents seizures despite adequate treatment. Hence, there is the need to search for new therapeutic options. Cannabidiol (CBD) is a major chemical component of the resin of Cannabis sativa plant, most commonly known as marijuana. The anti-seizure properties of CBD do not relate to the direct action on cannabinoid receptors, but are mediated by a multitude of mechanisms that include the agonist and antagonist effects on ionic channels, neurotransmitter transporters, and multiple 7-transmembrane receptors. In contrast to tetra-hydrocannabinol, CBD lacks psychoactive properties, does not produce euphoric or intrusive side effects, and is largely devoid of abuse liability. The aim of the study was to estimate the efficacy and safety of CBD as adjunctive treatment in patients with epilepsy using meta-analytical techniques. Randomized, placebo-controlled, single- or double-blinded add-on trials of oral CBD in patients with uncontrolled epilepsy were identified. Main outcomes included the percentage change and the proportion of patients with ≥ 50% reduction in monthly seizure frequency during the treatment period and the incidence of treatment withdrawal and adverse events (AEs). Four trials involving 550 patients with Lennox–Gastaut syndrome (LGS) and Dravet syndrome (DS) were included. The pooled average difference in change in seizure frequency during the treatment period resulted 19.5 [95% confidence interval (CI) 8.1–31.0; p = 0.001] percentage points between the CBD 10 mg and placebo groups and 19.9 (95% CI 11.8–28.1; p < 0.001) percentage points between the CBD 20 mg and placebo arms, in favor of CBD. The reduction in all-types seizure frequency by at least 50% occurred in 37.2% of the patients in the CBD 20 mg group and 21.2% of the placebo-treated participants [risk ratio (RR) 1.76, 95% CI 1.07–2.88; p = 0.025]. Across the trials, drug withdrawal for any reason occurred in 11.1% and 2.6% of participants receiving CBD and placebo, respectively (RR 3.54, 95% CI 1.55–8.12; p = 0.003) [Chi squared = 2.53, degrees of freedom (df) = 3, p = 0.506; I2 = 0.0%]. The RRs to discontinue treatment were 1.45 (95% CI 0.28–7.41; p = 0.657) and 4.20 (95% CI 1.82–9.68; p = 0.001) for CBD at the doses of 10 and 20 mg/kg/day, respectively, in comparison to placebo. Treatment was discontinued due to AEs in 8.9% and 1.8% of patients in the active and control arms, respectively (RR 5.59, 95% CI 1.87–16.73; p = 0.002). The corresponding RRs for CBD at the doses of 10 and 20 mg/kg/day were 1.66 (95% CI 0.22–12.86; p = 0.626) and 6.89 (95% CI 2.28–20.80; p = 0.001). AEs occurred in 87.9% and 72.2% of patients treated with CBD and placebo (RR 1.22, 95% CI 1.11–1.33; p < 0.001). AEs significantly associated with CBD were somnolence, decreased appetite, diarrhea, and increased serum aminotransferases. Adjunctive CBD in patients with LGS or DS experiencing seizures uncontrolled by concomitant anti-epileptic treatment regimens is associated with a greater reduction in seizure frequency and a higher rate of AEs than placebo.

146 citations

Journal ArticleDOI
21 Jan 2020-BMJ
TL;DR: No evidence was found for an average difference in estimated treatment effect between trials with and without blinded patients, healthcare providers, or outcome assessors, and this results could reflect that blinding is less important than often believed or meta-epidemiological study limitations, such as residual confounding or imprecision.
Abstract: Objectives To study the impact of blinding on estimated treatment effects, and their variation between trials; differentiating between blinding of patients, healthcare providers, and observers; detection bias and performance bias; and types of outcome (the MetaBLIND study). Design Meta-epidemiological study. Data source Cochrane Database of Systematic Reviews (2013-14). Eligibility criteria for selecting studies Meta-analyses with both blinded and non-blinded trials on any topic. Review methods Blinding status was retrieved from trial publications and authors, and results retrieved automatically from the Cochrane Database of Systematic Reviews. Bayesian hierarchical models estimated the average ratio of odds ratios (ROR), and estimated the increases in heterogeneity between trials, for non-blinded trials (or of unclear status) versus blinded trials. Secondary analyses adjusted for adequacy of concealment of allocation, attrition, and trial size, and explored the association between outcome subjectivity (high, moderate, low) and average bias. An ROR lower than 1 indicated exaggerated effect estimates in trials without blinding. Results The study included 142 meta-analyses (1153 trials). The ROR for lack of blinding of patients was 0.91 (95% credible interval 0.61 to 1.34) in 18 meta-analyses with patient reported outcomes, and 0.98 (0.69 to 1.39) in 14 meta-analyses with outcomes reported by blinded observers. The ROR for lack of blinding of healthcare providers was 1.01 (0.84 to 1.19) in 29 meta-analyses with healthcare provider decision outcomes (eg, readmissions), and 0.97 (0.64 to 1.45) in 13 meta-analyses with outcomes reported by blinded patients or observers. The ROR for lack of blinding of observers was 1.01 (0.86 to 1.18) in 46 meta-analyses with subjective observer reported outcomes, with no clear impact of degree of subjectivity. Information was insufficient to determine whether lack of blinding was associated with increased heterogeneity between trials. The ROR for trials not reported as double blind versus those that were double blind was 1.02 (0.90 to 1.13) in 74 meta-analyses. Conclusion No evidence was found for an average difference in estimated treatment effect between trials with and without blinded patients, healthcare providers, or outcome assessors. These results could reflect that blinding is less important than often believed or meta-epidemiological study limitations, such as residual confounding or imprecision. At this stage, replication of this study is suggested and blinding should remain a methodological safeguard in trials.

141 citations