scispace - formally typeset
Search or ask a question

Showing papers in "Systematic Reviews in 2018"


Journal ArticleDOI
TL;DR: Registration of SRs in PROSPERO increased rapidly between 2011 and 2017, thus benefiting users of health evidence who want to know about ongoing SRs, and whether registered SRs address necessary questions.
Abstract: The International Prospective Register of Systematic Reviews (PROSPERO) was launched in February 2011 to increase transparency of systematic reviews (SRs). There have been few investigations of the content and use of the database. We aimed to investigate the number of PROSPERO registrations from inception to 2017, and website usage in the last year. We also aimed to explore the epidemiological characteristics of and completeness of primary outcome pre-specification in a sample of PROSPERO records from 2017. The PROSPERO database managers provided us with data on the annual and cumulative number of SR registrations up to October 10, 2017, and the number of visits to the PROSPERO website over the year preceding October 10, 2017. One author collected data on the focus of the SR (e.g. therapeutic, diagnostic), health area addressed, funding source and completeness of outcome pre-specification in a random sample of 150 records of SRs registered in PROSPERO between April 1, 2017 and September 30, 2017. As of October 10, 2017, there were 26,535 SRs registered in PROSPERO; guided by current monthly submission rates, we anticipate this figure will reach over 30,000 by the end of 2017. There has been a 10-fold increase in registrations, from 63 SRs per month in 2012 to 800 per month in 2017. In the year preceding October 10, 2017, the PROSPERO website received more than 1.75 million page views. In the random sample of 150 registered SRs, the majority were focused on a therapeutic question (78/150 [52%]), while only a few focused on a diagnostic/prognostic question (11/150 [7%]). The 150 registered SRs addressed 18 different health areas. Any information about the primary outcome other than the domain (e.g. timing, effect measures) was not pre-specified in 44/150 records (29%). Registration of SRs in PROSPERO increased rapidly between 2011 and 2017, thus benefiting users of health evidence who want to know about ongoing SRs. Further work is needed to explore how closely published SRs adhere to the planned methods, whether greater pre-specification of outcomes prevents selective inclusion and reporting of study results, and whether registered SRs address necessary questions.

205 citations


Journal ArticleDOI
TL;DR: Six main organizational contextual features (organizational culture; leadership; networks and communication; resources; evaluation, monitoring and feedback; and champions) were most commonly reported to influence implementation outcomes in the selected studies across a wide range of healthcare settings.
Abstract: Organizational contextual features have been recognized as important determinants for implementing evidence-based practices across healthcare settings for over a decade. However, implementation scientists have not reached consensus on which features are most important for implementing evidence-based practices. The aims of this review were to identify the most commonly reported organizational contextual features that influence the implementation of evidence-based practices across healthcare settings, and to describe how these features affect implementation. An integrative review was undertaken following literature searches in CINAHL, MEDLINE, PsycINFO, EMBASE, Web of Science, and Cochrane databases from January 2005 to June 2017. English language, peer-reviewed empirical studies exploring organizational context in at least one implementation initiative within a healthcare setting were included. Quality appraisal of the included studies was performed using the Mixed Methods Appraisal Tool. Inductive content analysis informed data extraction and reduction. The search generated 5152 citations. After removing duplicates and applying eligibility criteria, 36 journal articles were included. The majority (n = 20) of the study designs were qualitative, 11 were quantitative, and 5 used a mixed methods approach. Six main organizational contextual features (organizational culture; leadership; networks and communication; resources; evaluation, monitoring and feedback; and champions) were most commonly reported to influence implementation outcomes in the selected studies across a wide range of healthcare settings. We identified six organizational contextual features that appear to be interrelated and work synergistically to influence the implementation of evidence-based practices within an organization. Organizational contextual features did not influence implementation efforts independently from other features. Rather, features were interrelated and often influenced each other in complex, dynamic ways to effect change. These features corresponded to the constructs in the Consolidated Framework for Implementation Research (CFIR), which supports the use of CFIR as a guiding framework for studies that explore the relationship between organizational context and implementation. Organizational culture was most commonly reported to affect implementation. Leadership exerted influence on the five other features, indicating it may be a moderator or mediator that enhances or impedes the implementation of evidence-based practices. Future research should focus on how organizational features interact to influence implementation effectiveness.

183 citations


Journal ArticleDOI
TL;DR: This paper introduces different types of overviews and suggest common research questions addressed by these overviews, and briefly reflects on the key features and objectives of the example overviews discussed.
Abstract: Overviews of systematic reviews are a relatively new approach to synthesising evidence, and research methods and associated guidance are developing. Within this paper we aim to help readers understand key issues which are essential to consider when taking the first steps in planning an overview. These issues relate to the development of clear, relevant research questions and objectives prior to the development of an overview protocol. Initial discussions and key concepts for this paper were formed during a workshop on overview methods at the 2016 UK Cochrane Symposium, at which all members of this author group presented work and contributed to wider discussions. Detailed descriptions of the various key features of overviews and their different objectives were created by the author group based upon current evidence (Higgins J, Green S. Cochrane Handbook Syst Rev Interv. 2011;4:5, Pollock M, et al. Sys Rev. 2016;5:190-205, Pollock A, et al. Cochrane overviews of reviews: exploring the methods and challenges. UK and Ireland: Cochrane Symposium; 2016, Pieper D, et al. Res Syn Meth. 2014;5:187–99, Lunny C, et al. Sys Rev. 2016;5:4-12, Hartling L, et al. Comparing multiple treatments: an introduction to overviews of reviews. In 23rd Cochrane Colloquium; 2015, Hartling L, et al. Plos One. 2012;7:1-8, Ballard M, Montgomery P. Res Syn Meth. 2017;8:92-108) and author experiences conducting overviews. Within this paper we introduce different types of overviews and suggest common research questions addressed by these overviews. We briefly reflect on the key features and objectives of the example overviews discussed. Clear decisions relating to the research questions and objectives are a fundamental first step during the initial planning stages for an overview. Key stakeholders should be involved at the earliest opportunity to ensure that the planned overview is relevant and meaningful to the potential end users of the overview. Following best practice in common with other forms of systematic evidence synthesis, an overview protocol should be published, ensuring transparency and reducing opportunities for introduction of bias in the conduct of the overview.

170 citations


Journal ArticleDOI
TL;DR: The experience suggests that the ROBINS-E tool does not meet the need for an international standard for evaluating human observational studies for questions of harm relevant to public and environmental health, and is likely to meet the needs of the environmental and public health community.
Abstract: Systematic reviews, which assess the risk of bias in included studies, are increasingly used to develop environmental hazard assessments and public health guidelines. These research areas typically rely on evidence from human observational studies of exposures, yet there are currently no universally accepted standards for assessing risk of bias in such studies. The risk of bias in non-randomised studies of exposures (ROBINS-E) tool has been developed by building upon tools for risk of bias assessment of randomised trials, diagnostic test accuracy studies and observational studies of interventions. This paper reports our experience with the application of the ROBINS-E tool. We applied ROBINS-E to 74 exposure studies (60 cohort studies, 14 case-control studies) in 3 areas: environmental risk, dietary exposure and drug harm. All investigators provided written feedback, and we documented verbal discussion of the tool. We inductively and iteratively classified the feedback into 7 themes based on commonalities and differences until all the feedback was accounted for in the themes. We present a description of each theme. We identified practical concerns with the premise that ROBINS-E is a structured comparison of the observational study being rated to the ‘ideal’ randomised controlled trial. ROBINS-E assesses 7 domains of bias, but relevant questions related to some critical sources of bias, such as exposure and funding source, are not assessed. ROBINS-E fails to discriminate between studies with a single risk of bias or multiple risks of bias. ROBINS-E is severely limited at determining whether confounders will bias study outcomes. The construct of co-exposures was difficult to distinguish from confounders. Applying ROBINS-E was time-consuming and confusing. Our experience suggests that the ROBINS-E tool does not meet the need for an international standard for evaluating human observational studies for questions of harm relevant to public and environmental health. We propose that a simpler tool, based on empirical evidence of bias, would provide accurate measures of risk of bias and is more likely to meet the needs of the environmental and public health community.

129 citations


Journal ArticleDOI
TL;DR: The USA leads in all publication citations and specific publication types, except for meta-analysis where China publishes more, and collaborative publishing among international collaborators is also increasing.
Abstract: Evidence-based medicine relies on current best evidence from the medical literature, the patient’s history, and the clinician’s own experience to provide the best care for patients. Systematic reviews and meta-analysis are considered the highest levels of evidence for informing clinical decisions. Recently, reports have shown an increase in the number but a decrease in quality of meta-analysis publications. We reviewed publication trends and determined the countries with the most journal articles and types of publications in PubMed from 1995 to 2015. We examined journal entries in PubMed from 1995 to 2015 from top publishing countries for total number of publications and citations in core clinical journals and in specific publication types (systematic reviews, meta-analysis, randomized controlled trials). Yearly, only 30 countries generated 94.6% of all publications and 98.1% of core clinical journals worldwide. All publication types increased but with a significant increase in meta-analysis publications from China. Collaborative and co-authored papers among the 30 countries also showed an increasing trend. The USA leads in all publication citations and specific publication types, except for meta-analysis where China publishes more. Collaborative publishing among international collaborators is also increasing.

104 citations


Journal ArticleDOI
TL;DR: The ‘Vienna Principles’ set out in this paper aim to guide a more coordinated effort which will allow the integration of work by separate teams and build on the experience, code and evaluations done by the many teams working across the globe.
Abstract: Systematic reviews (SR) are vital to health care, but have become complicated and time-consuming, due to the rapid expansion of evidence to be synthesised. Fortunately, many tasks of systematic reviews have the potential to be automated or may be assisted by automation. Recent advances in natural language processing, text mining and machine learning have produced new algorithms that can accurately mimic human endeavour in systematic review activity, faster and more cheaply. Automation tools need to be able to work together, to exchange data and results. Therefore, we initiated the International Collaboration for the Automation of Systematic Reviews (ICASR), to successfully put all the parts of automation of systematic review production together. The first meeting was held in Vienna in October 2015. We established a set of principles to enable tools to be developed and integrated into toolkits. This paper sets out the principles devised at that meeting, which cover the need for improvement in efficiency of SR tasks, automation across the spectrum of SR tasks, continuous improvement, adherence to high quality standards, flexibility of use and combining components, the need for a collaboration and varied skills, the desire for open source, shared code and evaluation, and a requirement for replicability through rigorous and open evaluation. Automation has a great potential to improve the speed of systematic reviews. Considerable work is already being done on many of the steps involved in a review. The ‘Vienna Principles’ set out in this paper aim to guide a more coordinated effort which will allow the integration of work by separate teams and build on the experience, code and evaluations done by the many teams working across the globe.

94 citations


Journal ArticleDOI
TL;DR: This systematic review will present a detailed synthesis of the evidence for barriers to access and utilization of emergency obstetric care in sub-Saharan Africa over the last 7 years to provide clear information that can help in designing maternal health policy and interventions.
Abstract: Nearly 15% of pregnancies end in fatal perinatal obstetric complications including bleeding, infections, hypertension, obstructed labour and complications of abortion. Globally, an estimated 10.7 million women have died due to obstetric complications in the last two decades, and two thirds of these deaths occurred in sub-Saharan Africa. Though the majority of maternal mortalities can be prevented, different factors can hinder women’s access to emergency obstetric services. Therefore, this review is aimed at synthesizing current evidence on barriers to access and utilization of emergency obstetric care in sub-Saharan Africa. Articles were searched from MEDLINE, CINAHL, EMBASE, and Maternity and Infant Care databases using predefined search terms and strategies. Articles published in English, between 2010 and 2017, were included. Two reviewers (AG and AM) independently screened the articles, and data extraction was conducted using the Joanna Briggs Institute data extraction format. The quality of the included studies was assessed using the Mixed Methods Appraisal Tool. The identified barriers were qualitatively synthesized and reported using the Three Delays analytical framework. The PRISMA checklist was employed to present the findings. The search of the selected databases returned 3534 articles. After duplicates were removed and further screening undertaken, 37 studies fulfilled the inclusion criteria. The identified key barriers related to the first delay included younger age, illiteracy, lower income, unemployment, poor health service utilization, a lower level of assertiveness among women, poor knowledge about obstetric danger signs, and cultural beliefs. Poorly designed roads, lack of vehicles, transportation costs, and distance from facilities led to the second delay. Barriers related to the third delay included lack of emergency obstetric care services and supplies, shortage of trained staff, poor management of emergency obstetric care provision, cost of services, long waiting times, poor referral practices, and poor coordination among staff. A number of factors were found to hamper access to and utilization of emergency obstetric care among women in sub-Saharan Africa. These barriers are inter-dependent and occurred at multiple levels either at home, on the way to health facilities, or at the facilities. Therefore, country-specific holistic strategies including improvements to healthcare systems and the socio-economic status of women need to be strengthened. Further research should focus on the assessment of the third delay, as little is known about facility-readiness. PROSPERO CRD42017074102

92 citations


Journal ArticleDOI
TL;DR: This cross-sectional study included 100 Cochrane reviews irrespective of type of intervention with a key dichotomous outcome meta-analyzed and assessed by GRADE, finding that GRADE according to Handbook guidelines and TSA led to more severe judgment of imprecision than GRADE adopted by reviews’ authors.
Abstract: The evaluation of imprecision is a key dimension of the grading of the confidence in the estimate. Grading of Recommendations Assessment, Development and Evaluation (GRADE) gives recommendations on how to downgrade evidence for imprecision, but authors vary in their use. Trial Sequential Analysis (TSA) has been advocated for a more reliable assessment of imprecision. We aimed to evaluate reporting of and adherence to GRADE and to compare the assessment of imprecision of intervention effects assessed by GRADE and TSA in Cochrane systematic reviews. In this cross-sectional study, we included 100 Cochrane reviews irrespective of type of intervention with a key dichotomous outcome meta-analyzed and assessed by GRADE. The methods and results sections of each review were assessed for adequacy of imprecision evaluation. We re-analyzed imprecision following the GRADE Handbook and the TSA Manual. Overall, only 13.0% of reviews stated the criteria they applied to assess imprecision. The most common dimensions were the 95% width of the confidence intervals and the optimal information size. Review authors downgraded 48.0% of key outcomes due to imprecision. When imprecision was re-analyzed following the GRADE Handbook, 64% of outcomes were downgraded. Agreement between review authors’ assessment and assessment by the authors of this study was moderate (kappa 0.43, 95% confidence interval [CI] 0.23 to 0.58). TSA downgraded 69.0% outcomes due to imprecision. Agreement between review authors’ GRADE assessment and TSA, irrespective of downgrading levels, was moderate (kappa 0.43, 95% CI 0.21 to 0.57). Agreement between our GRADE assessment following the Handbook and TSA was substantial (kappa 0.66, 95% CI 0.49 to 0.79). In a sample of Cochrane reviews, methods for assessing imprecision were rarely reported. GRADE according to Handbook guidelines and TSA led to more severe judgment of imprecision rather than GRADE adopted by reviews’ authors. Cochrane initiatives to improve adherence to GRADE Handbook are warranted. TSA may transparently assist in such development.

90 citations


Journal ArticleDOI
TL;DR: For instance, Pollock et al. as discussed by the authors conducted a systematic review of the evidence-base relating to stakeholder involvement in systematic reviews and used this evidence to describe how stakeholders have been involved in systematic review.
Abstract: There is increasing recognition that it is good practice to involve stakeholders (meaning patients, the public, health professionals and others) in systematic reviews, but limited evidence about how best to do this. We aimed to document the evidence-base relating to stakeholder involvement in systematic reviews and to use this evidence to describe how stakeholders have been involved in systematic reviews. We carried out a scoping review, following a published protocol. We searched multiple electronic databases (2010–2016), using a stepwise searching approach, supplemented with hand searching. Two authors independently screened and discussed the first 500 abstracts and, after clarifying selection criteria, screened a further 500. Agreement on screening decisions was 97%, so screening was done by one reviewer only. Pre-planned data extraction was completed, and the comprehensiveness of the description of methods of involvement judged. Additional data extraction was completed for papers judged to have most comprehensive descriptions. Three stakeholder representatives were co-authors for this systematic review. We included 291 papers in which stakeholders were involved in a systematic review. Thirty percent involved patients and/or carers. Thirty-two percent were from the USA, 26% from the UK and 10% from Canada. Ten percent (32 reviews) were judged to provide a comprehensive description of methods of involving stakeholders. Sixty-nine percent (22/32) personally invited people to be involved; 22% (7/32) advertised opportunities to the general population. Eighty-one percent (26/32) had between 1 and 20 face-to-face meetings, with 83% of these holding ≤ 4 meetings. Meetings lasted 1 h to ½ day. Nineteen percent (6/32) used a Delphi method, most often involving three electronic rounds. Details of ethical approval were reported by 10/32. Expenses were reported to be paid to people involved in 8/32 systematic reviews. We identified a relatively large number (291) of papers reporting stakeholder involvement in systematic reviews, but the quality of reporting was generally very poor. Information from a subset of papers judged to provide the best descriptions of stakeholder involvement in systematic reviews provide examples of different ways in which stakeholders have been involved in systematic reviews. These examples arguably currently provide the best available information to inform and guide decisions around the planning of stakeholder involvement within future systematic reviews. This evidence has been used to develop online learning resources. The protocol for this systematic review was published on 21 April 2017. Publication reference: Pollock A, Campbell P, Struthers C, Synnot A, Nunn J, Hill S, Goodare H, Watts C, Morley R: Stakeholder involvement in systematic reviews: a protocol for a systematic review of methods, outcomes and effects. Research Involvement and Engagement 2017, 3:9. https://doi.org/10.1186/s40900-017-0060-4 .

88 citations


Journal ArticleDOI
TL;DR: The findings may indicate a connection between the limited inclusion of non-English studies and a lack of resources, which forces review teams to rely on their limited language skills rather than the support of professional translators.
Abstract: Studies published in languages other than English are often neglected when research teams conduct systematic reviews. Literature on how to deal with non-English studies when conducting reviews have focused on the importance of including such studies, while less attention has been paid to the practical challenges of locating and assessing relevant non-English studies. We investigated the factors which might predict the inclusion of non-English studies in systematic reviews in the social sciences, to better understand how, when and why these are included/excluded. We appraised all Campbell Collaboration systematic reviews (n = 123) published to July 2016, categorising each by its language inclusiveness. We sought additional information from review authors via a questionnaire and received responses concerning 47 reviews. Data were obtained for 17 factors and we explored correlations with the number of non-English studies in the reviews via statistical regression models. Additionally, we asked authors to identify factors that support or hinder the inclusion of non-English studies. Of 123 reviews, 108 did not explicitly exclude, and of these, 17 included non-English language studies. One factor correlated with the number of included non-English studies across all models: the number of countries in which the members of the review team work (B-value = 0.56; SE B = 0.24; 95% CI = 0.07–1.03; p = 0.02). This indicates that reviews which included non-English studies were more likely to be produced by international review teams. Our survey showed a dominance of researchers from English-speaking countries (52.9%) and review teams consisting only of team members from these countries (65.9%). The most frequently mentioned challenge to including non-English studies was a lack of resources (funding and time) followed by a lack of language resources (e.g. professional translators). Our findings may indicate a connection between the limited inclusion of non-English studies and a lack of resources, which forces review teams to rely on their limited language skills rather than the support of professional translators. If unaddressed, review teams risk ignoring key data and introduce bias in otherwise high-quality reviews. However, the validity and interpretation of our findings should be further assessed if we are to tackle the challenges of dealing with non-English studies.

79 citations


Journal ArticleDOI
TL;DR: Methods for a systematic review to explore the prevalence, antecedents, consequences, and treatments for depression and anxiety among undergraduate university students in LMICs and of appropriate and feasible interventions aimed at reducing the burden of psychological morbidity among them are detailed.
Abstract: Depression and anxiety symptoms are reported to be common among university students in many regions of the world and impact on quality of life and academic attainment. The extent of the problem of depression and anxiety among students in low- and middle-income countries (LMICs) is largely unknown. This paper details methods for a systematic review that will be conducted to explore the prevalence, antecedents, consequences, and treatments for depression and anxiety among undergraduate university students in LMICs. Studies reporting primary data on common mental disorders among students in universities and colleges within LMICs will be included. Quality assessment of retrieved articles will be conducted using four Joanna Briggs critical appraisal checklists for prevalence, randomized control/pseudo-randomized trials, descriptive case series, and comparable cohort/case control. Meta-analysis of the prevalence of depression and anxiety will be conducted using a random effects model which will generate pooled prevalence with their respective 95% confidence intervals. The results from this systematic review will help in informing and guiding healthcare practitioners, planners, and policymakers on the burden of common mental disorders in university students in LMICs and of appropriate and feasible interventions aimed at reducing the burden of psychological morbidity among them. The results will also point to gaps in research and help set priorities for future enquiries. PROSPERO CRD42017064148

Journal ArticleDOI
TL;DR: This paper reports the remaining steps: assessing risk of bias; synthesis, presentation and summary of the findings; and assessing certainty of the evidence arising from the overview, to create an evidence map of the methods used in overviews.
Abstract: Overviews of systematic reviews (SRs) attempt to systematically retrieve and summarise the results of multiple systematic reviews. This is the second of two papers from a study aiming to develop a comprehensive evidence map of the methods used in overviews. Our objectives were to (a) develop a framework of methods for conducting, interpreting and reporting overviews (stage I)—the Methods for Overviews of Reviews (MOoR) framework—and (b) to create an evidence map by mapping studies that have evaluated overview methods to the framework (stage II). In the first paper, we reported findings for the four initial steps of an overview (specification of purpose, objectives and scope; eligibility criteria; search methods; data extraction). In this paper, we report the remaining steps: assessing risk of bias; synthesis, presentation and summary of the findings; and assessing certainty of the evidence arising from the overview. In stage I, we identified cross-sectional studies, guidance documents and commentaries that described methods proposed for, or used in, overviews. Based on these studies, we developed a framework of possible methods for overviews, categorised by the steps in conducting an overview. Multiple iterations of the framework were discussed and refined by all authors. In stage II, we identified studies evaluating methods and mapped these evaluations to the framework. Forty-two stage I studies described methods relevant to one or more of the latter steps of an overview. Six studies evaluating methods were included in stage II. These mapped to steps involving (i) the assessment of risk of bias (RoB) in SRs (two SRs and three primary studies, all reporting evaluation of RoB tools) and (ii) the synthesis, presentation and summary of the findings (one primary study evaluating methods for measuring overlap). Many methods have been described for use in the latter steps in conducting an overview; however, evaluation and guidance for applying these methods is sparse. The exception is RoB assessment, for which a multitude of tools exist—several with sufficient evaluation and guidance to recommend their use. Evaluation of other methods is required to provide a comprehensive evidence map.

Journal ArticleDOI
TL;DR: A systematic review of the randomized control trials (RCTs) to evaluate the effectiveness of BoNTA injection on walking and QOL in PSLLS found the need for a well-designed RCT to adequately investigate the issues highlighted is identified.
Abstract: Improved walking is one of the highest priorities in people living with stroke. Post-stroke lower limb spasticity (PSLLS) impedes walking and quality of life (QOL). The understanding of the evidence of improved walking and QOL following botulinum toxin (BoNTA) injection is not clear. We performed a systematic review of the randomized control trials (RCT) to evaluate the effectiveness of BoNTA injection on walking and QOL in PSLLS. We searched PubMed, Web of Science, Embase, CINAHL, ProQuest Thesis and Dissertation checks, Google Scholar, WHO International Clinical Trial Registry Platform, ClinicalTrials.gov , Cochrane, and ANZ and EU Clinical Trials Register for RCTs looking at improvement in walking and QOL following injection of BoNTA in PSLLS. The original search was carried out prior to 16 September 2015. We conducted an additional verifying search on CINHAL, EMBASE, and MEDLINE (via PubMed) from 16 September 2015 to 6 June 2017 using the same clauses as the previous search. Methodological quality of the individual studies was critically appraised using Joanna Briggs Institute’s instrument. Only placebo-controlled RCTs looking at improvement in walking and QOL were included in the review. Of 2026 records, we found 107 full-text records. Amongst them, we found five RCTs qualifying our criteria. No new trials were found from the verifying search. Two independent reviewers assessed methodological validity prior to inclusion in the review using Joanna Briggs Institute’s appraisal instrument. Two studies reported significant improvement in gait velocity (p = 0.020) and < 0.05, respectively. One study showed significant improvement in 2-min-walking distance (p < 0.05). QOL was recorded in one study without any significant improvement. Meta-analysis of reviewed studies could not be performed because of different methods of assessing walking ability, small sample size with large confidence interval and issues such as lack of power calculations in some studies. Findings from our systematic and detailed study identify the need for a well-designed RCT to adequately investigate the issues highlighted. This review could not conclude there was sufficient evidence to support or refute improvement on walking or QOL following BoNTA injection. Reasons for this are discussed, and methods for future RCTs are developed.

Journal ArticleDOI
TL;DR: It is suggested that some interventions may positively impact on the health outcomes of older people, and identified mediating factors to health outcomes, the evidence is based on studies with heterogeneous methodologies.
Abstract: Many interventions have been developed to promote respect and social inclusion among older people, but the evidence on their impacts on health has not been synthesised. This systematic review aims to appraise the state of the evidence across the quantitative and qualitative literature. Eligible studies published between 1990 and 2015 were identified by scanning seven bibliographic databases using a pre-piloted strategy, searching grey literature and contacting experts. Studies were included if they assessed the impact (quantitatively) and/or perceived impact (qualitatively) of an intervention promoting respect and social inclusion on the physical or mental health of community-residing people aged 60 years and older. Titles and abstracts were screened for eligibility by one reviewer. A second reviewer independently screened a 10% random sample. Full texts were screened for eligibility by one reviewer, with verification by another reviewer. Risk of bias was assessed using standardised tools. Findings were summarised using narrative synthesis, harvest plots and logic models to depict the potential pathways to health outcomes. Of the 27,354 records retrieved, 40 studies (23 quantitative, 6 qualitative, 11 mixed methods) were included. All studies were conducted in high and upper middle-income countries. Interventions involved mentoring, intergenerational and multi-activity programmes, dancing, music and singing, art and culture and information-communication technology. Most studies (n = 24) were at high or moderate risk of bias. Music and singing, intergenerational interventions, art and culture and multi-activity interventions were associated with an overall positive impact on health outcomes. This included depression (n = 3), wellbeing (n = 3), subjective health (n = 2), quality of life (n = 2), perceived stress and mental health (n = 2) and physical health (n = 2). Qualitative studies offered explanations for mediating factors (e.g. improved self-esteem) that may lead to improved health outcomes and contributed to the assessment of causation. Whilst this review suggests that some interventions may positively impact on the health outcomes of older people, and identified mediating factors to health outcomes, the evidence is based on studies with heterogeneous methodologies. Many of the interventions were delivered as projects to selected groups, raising important questions about the feasibility of wider implementation and the potential for population-wide benefits. PROSPERO registration number CRD42014010107

Journal ArticleDOI
TL;DR: Abstrackr’s reliability and the workload savings varied by screening task, and how this might affect the results and conclusions of SRs needs to be evaluated.
Abstract: Machine learning tools can expedite systematic review (SR) processes by semi-automating citation screening. Abstrackr semi-automates citation screening by predicting relevant records. We evaluated its performance for four screening projects. We used a convenience sample of screening projects completed at the Alberta Research Centre for Health Evidence, Edmonton, Canada: three SRs and one descriptive analysis for which we had used SR screening methods. The projects were heterogeneous with respect to search yield (median 9328; range 5243 to 47,385 records; interquartile range (IQR) 15,688 records), topic (Antipsychotics, Bronchiolitis, Diabetes, Child Health SRs), and screening complexity. We uploaded the records to Abstrackr and screened until it made predictions about the relevance of the remaining records. Across three trials for each project, we compared the predictions to human reviewer decisions and calculated the sensitivity, specificity, precision, false negative rate, proportion missed, and workload savings. Abstrackr’s sensitivity was > 0.75 for all projects and the mean specificity ranged from 0.69 to 0.90 with the exception of Child Health SRs, for which it was 0.19. The precision (proportion of records correctly predicted as relevant) varied by screening task (median 26.6%; range 14.8 to 64.7%; IQR 29.7%). The median false negative rate (proportion of records incorrectly predicted as irrelevant) was 12.6% (range 3.5 to 21.2%; IQR 12.3%). The workload savings were often large (median 67.2%, range 9.5 to 88.4%; IQR 23.9%). The proportion missed (proportion of records predicted as irrelevant that were included in the final report, out of the total number predicted as irrelevant) was 0.1% for all SRs and 6.4% for the descriptive analysis. This equated to 4.2% (range 0 to 12.2%; IQR 7.8%) of the records in the final reports. Abstrackr’s reliability and the workload savings varied by screening task. Workload savings came at the expense of potentially missing relevant records. How this might affect the results and conclusions of SRs needs to be evaluated. Studies evaluating Abstrackr as the second reviewer in a pair would be of interest to determine if concerns for reliability would diminish. Further evaluations of Abstrackr’s performance and usability will inform its refinement and practical utility.

Journal ArticleDOI
TL;DR: It is demonstrated that CHE/impoverishment is pervasive in SSA, and the magnitude varies across and within countries and over time, with the poor being the most affected and they vary across countries.
Abstract: To assess the financial burden due to out of pocket (OOP) payments, two mutually exclusive approaches have been used: catastrophic health expenditure (CHE) and impoverishment Sub-Saharan African (SSA) countries primarily rely on OOP and are thus challenged with providing financial protection to the populations To understand the variations in CHE and impoverishment in SSA, and the underlying determinants of CHE, a scoping review of the existing evidence was conducted This review is guided by Arksey and O’Malley scoping review framework A search was conducted in several databases including PubMed, EBSCO (EconLit, PsychoInfo, CINAHL), Web of Science, Jstor and virtual libraries of the World Health Organizations (WHO) and the World Bank The primary outcome of interest was catastrophic health expenditure/impoverishment, while the secondary outcome was the associated risk factors Thirty-four (34) studies that met the inclusion criteria were fully assessed CHE was higher amongst West African countries and amongst patients receiving treatment for HIV/ART, TB, malaria and chronic illnesses Risk factors associated with CHE included household economic status, type of health provider, socio-demographic characteristics of household members, type of illness, social insurance schemes, geographical location and household size/composition The proportion of households that are impoverished has increased over time across countries and also within the countries This review demonstrated that CHE/impoverishment is pervasive in SSA, and the magnitude varies across and within countries and over time Socio-economic factors are seen to drive CHE with the poor being the most affected, and they vary across countries This calls for intensifying health policies and financing structures in SSA, to provide equitable access to all populations especially the most poor and vulnerable There is a need to innovate and draw lessons from the ‘informal’ social networks/schemes as they are reported to be more effective in cushioning the financial burden

Journal ArticleDOI
TL;DR: A systematic review of digital storytelling use in healthcare research to develop an in-depth understanding of how researchers have used this method, with an aim to refine and further inform future iterations of its use.
Abstract: Digital storytelling is an arts-based research method with potential to elucidate complex narratives in a compelling manner, increase participant engagement, and enhance the meaning of research findings. This method involves the creation of a 3- to 5-min video that integrates multimedia materials including photos, participant voices, drawings, and music. Given the significant potential of digital storytelling to meaningfully capture and share participants’ lived experiences, a systematic review of its use in healthcare research is crucial to develop an in-depth understanding of how researchers have used this method, with an aim to refine and further inform future iterations of its use. We aim to identify and synthesize evidence on the use, impact, and ethical considerations of using digital storytelling in health research. The review questions are as follows: (1) What is known about the purpose, definition, use (processes), and contexts of digital storytelling as part of the research process in health research? (2) What impact does digital storytelling have upon the research process, knowledge development, and healthcare practice? (3) What are the key ethical considerations when using digital storytelling within qualitative, quantitative, and mixed method research studies? Key databases and the grey literature will be searched from 1990 to the present for qualitative, quantitative, and mixed methods studies that utilized digital storytelling as part of the research process. Two independent reviewers will screen and critically appraise relevant articles with established quality appraisal tools. We will extract narrative data from all studies with a standardized data extraction form and conduct a thematic analysis of the data. To facilitate innovative dissemination through social media, we will develop a visual infographic and three digital stories to illustrate the review findings, as well as methodological and ethical implications. In collaboration with national and international experts in digital storytelling, we will synthesize key evidence about digital storytelling that is critical to the development of methodological and ethical expertise about arts-based research methods. We will also develop recommendations for incorporating digital storytelling in a meaningful and ethical manner into the research process. PROSPERO registry number CRD42017068002 .

Journal ArticleDOI
TL;DR: PET for surgical patients with gastrointestinal malignancies may improve physical fitness and aid in postoperative recovery, as PET was associated with more rapid recovery to baseline functional capacity after surgery.
Abstract: Gastrointestinal cancer patients are susceptible to significant postoperative morbidity. The aim of this systematic review was to examine the effects of preoperative exercise therapy (PET) on patients undergoing surgery for GI malignancies. In accordance with PRISMA statement, all prospective clinical trials of PET for patients diagnosed with GI cancer were identified by searching MEDLINE, Embase, Cochrane Library, ProQuest, PROSPERO, and DARE (March 8, 2017). The characteristics and outcomes of each study were extracted and reviewed. Risk of bias was evaluated using the Cochrane risk of bias tool by two independent reviewers. Nine studies (534 total patients) were included in the systematic review. All interventions involved aerobic training but varied in terms of frequency, duration, and intensity. PET was effective in reducing heart rate, as well as increasing oxygen consumption and peak power output. The postoperative course was also improved, as PET was associated with more rapid recovery to baseline functional capacity after surgery. PET for surgical patients with gastrointestinal malignancies may improve physical fitness and aid in postoperative recovery.

Journal ArticleDOI
TL;DR: This work will build a centralized, accessible, searchable repository through which researchers, practitioners, and other stakeholders can identify psychometrically and pragmatically strong measures of implementation contexts, processes, and outcomes to enhance the cumulativeness, reproducibility, and applicability of research findings in the rapidly growing field of implementation science.
Abstract: Implementation science is the study of strategies used to integrate evidence-based practices into real-world settings (Eccles and Mittman, Implement Sci. 1(1):1, 2006). Central to the identification of replicable, feasible, and effective implementation strategies is the ability to assess the impact of contextual constructs and intervention characteristics that may influence implementation, but several measurement issues make this work quite difficult. For instance, it is unclear which constructs have no measures and which measures have any evidence of psychometric properties like reliability and validity. As part of a larger set of studies to advance implementation science measurement (Lewis et al., Implement Sci. 10:102, 2015), we will complete systematic reviews of measures that map onto the Consolidated Framework for Implementation Research (Damschroder et al., Implement Sci. 4:50, 2009) and the Implementation Outcomes Framework (Proctor et al., Adm Policy Ment Health. 38(2):65-76, 2011), the protocol for which is described in this manuscript. Our primary databases will be PubMed and Embase. Our search strings will be comprised of five levels: (1) the outcome or construct term; (2) terms for measure; (3) terms for evidence-based practice; (4) terms for implementation; and (5) terms for mental health. Two trained research specialists will independently review all titles and abstracts followed by full-text review for inclusion. The research specialists will then conduct measure-forward searches using the “cited by” function to identify all published empirical studies using each measure. The measure and associated publications will be compiled in a packet for data extraction. Data relevant to our Psychometric and Pragmatic Evidence Rating Scale (PAPERS) will be independently extracted and then rated using a worst score counts methodology reflecting “poor” to “excellent” evidence. We will build a centralized, accessible, searchable repository through which researchers, practitioners, and other stakeholders can identify psychometrically and pragmatically strong measures of implementation contexts, processes, and outcomes. By facilitating the employment of psychometrically and pragmatically strong measures identified through this systematic review, the repository would enhance the cumulativeness, reproducibility, and applicability of research findings in the rapidly growing field of implementation science.

Journal ArticleDOI
TL;DR: Non-mydriatic two-field strategy could be a more pragmatic approach in starting DRS programmes for facility-based PwDM in low-income settings, with dilatation of the pupils of those who have ungradable images.
Abstract: Following publication of the original article [1], the authors reported an error in Fig. 4 in the PDF version. Figure 4 is the duplicate image of Fig. 3 and the correct figure is missing. The authors would like to apologize for this error. The correct figure is shown below.

Journal ArticleDOI
TL;DR: This work aims to systematically summarize existing primary studies finding to estimate the level and identify associated factors of psychotropic medication non-adherence among adult patients with major psychiatric disorders, and quantify the level using Comprehensive Meta-Analysis software.
Abstract: Evidence from the global burden of diseases show that psychiatric disorders are a growing public health concern. Maintaining adherence to medication is the most essential, but challenging course in the pharmacological treatment modality for major psychiatric disorders. Nevertheless, there is a paucity of abridged evidence on the level of psychotropic medication non-adherence and associated factors. Therefore, we aim to systematically summarize existing primary studies finding to estimate the level and identify associated factors of psychotropic medication non-adherence among adult patients with major psychiatric disorders. We will search studies using computerized search engines, main electronic databases and other relevant sources. PubMed (Medline), EMBASE, CINAHL, PsycINFO, Web of Science, WHO Global Health Library, and direct Google search will be searched to retrieve studies written in English language before December 2017. Observational studies (cross-sectional, case-control, cohort or longitudinal, survey and surveillance reports) on major psychiatric disorders (schizophrenia, major depressive and bipolar disorders) among adult patients will be eligible. Data will be extracted independently by two authors. Data synthesis and statistical analysis will be carried out. Pooled estimate will be done to quantify the level of psychotropic medication non-adherence using Comprehensive Meta-Analysis software. Psychiatric disorders remain a public health, social and economic concern worldwide. Management of major psychiatric disorders is highly affected by medication non-adherence. Thus, undertaking an integrated and multifaceted approach is necessary to reduce the burden of medication non-adherence, and enhance the quality of patients’ life. Evidence is required to design appropriate intervention to prevent psychotropic medication non-adherence. PROSPERO: 2017: CRD42017067436 .

Journal ArticleDOI
TL;DR: Despite a number of negative findings and the diversity of studies, multi-session ABM interventions, especially in the case of alcohol and when the Alcohol Attention Control Training Programme was used, appear to have positive effects on symptoms of addictive behaviour.
Abstract: Attentional bias modification (ABM) interventions have been developed to address addiction by reducing attentional bias for substance-related cues. This study provides a systematic review of the effectiveness of ABM interventions in decreasing symptoms of addictive behaviour, taking baseline levels of attentional bias and changes in attentional bias into account. We included randomised and non-randomised studies that investigated the effectiveness of ABM interventions in heavy-using adults and treatment-seeking individuals with symptoms of substance use disorder to manipulate attentional bias and to reduce substance use-related symptoms. We searched for relevant English peer-reviewed articles without any restriction for the year of publication using PsycINFO, PubMed, and ISI Web in August 2016. Study quality was assessed regarding reporting, external validity, internal validity, and power of the study. Eighteen studies were included: nine studies reported on ABM intervention effects in alcohol use, six studies on nicotine use, and three studies on opiate use. The included studies differed with regard to type of ABM intervention (modified dot probe task n = 14; Alcohol Attention Control Training Programme n = 4), outcome measures, amount and length of provided sessions, and context (clinic versus laboratory versus home environment). The study quality mostly ranged from low average to high average (one study scored below the quality cut-off). Ten studies reported significant changes of symptoms of addictive behaviour, whereas eight studies found no effect of ABM interventions on symptoms. However, when restricted to multi-session ABM intervention studies, eight out of ten studies found effects on symptoms of addiction. Surprisingly, these effects on symptoms of addictive behaviour showed no straightforward relationship with baseline attentional bias and its change from baseline to post-test. Despite a number of negative findings and the diversity of studies, multi-session ABM interventions, especially in the case of alcohol and when the Alcohol Attention Control Training Programme was used, appear to have positive effects on symptoms of addictive behaviour. However, more rigorous well-powered future research in clinical samples is needed before firm conclusions regarding the effectiveness of ABM interventions can be drawn. Registration number PROSPERO: CRD42016046823

Journal ArticleDOI
TL;DR: It was not possible to determine which self-management components and elements were more effective, but interventions that utilized provider reminders, patient education, and goal setting were associated with improved outcomes.
Abstract: Self-management support interventions may potentially delay kidney function decline and associated complications in patients with comorbid diabetes and chronic kidney disease. However, the effectiveness of these interventions remains unclear. We investigated the effectiveness of current self-management support interventions and their specific components and elements in improving patient outcomes. Electronic databases were systematically searched from January 1, 1994, to December 19, 2017. Eligible studies were randomized controlled trials on self-management support interventions for adults with comorbid diabetes and chronic kidney disease. Primary outcomes were systolic blood pressure, diastolic blood pressure, estimated glomerular filtration rate, and glycated hemoglobin. Secondary outcomes included self-management activity, health service utilization, health-related quality of life, medication adherence, and death. Of the 48 trials identified, eight studies (835 patients) were eligible. There was moderate-quality evidence that self-management support interventions improved self-management activity (standard mean difference 0.56, 95% CI 0.15 to 0.97, p < 0.007) compared to usual care. There was low-quality evidence that self-management support interventions reduced systolic blood pressure (mean difference − 4.26 mmHg, 95% CI − 7.81 to − 0.70, p = 0.02) and glycated hemoglobin (mean difference − 0.5%, 95% CI − 0.8 to − 0.1, p = 0.01) compared to usual care. Self-management support interventions may improve self-care activities, systolic blood pressure, and glycated hemoglobin in patients with comorbid diabetes and chronic kidney disease. It was not possible to determine which self-management components and elements were more effective, but interventions that utilized provider reminders, patient education, and goal setting were associated with improved outcomes. More evidence from high-quality studies is required to support future self-management programs. PROSPERO CRD42015017316 .

Journal ArticleDOI
TL;DR: This review constitutes the first systematic effort to synthesise existing literature on factors supporting and preventing evaluation by TSOs and suggests that many of the identified challenges may be met by applying evidence-based and stakeholder-inclusive strategies to develop shared evaluation requirements.
Abstract: The third sector is becoming a more common provider of social and health services, but little is known about how third sector organisations (TSOs) evaluate their activities. Past research has reported that the third sector is under increasing pressure to evaluate its impact and performance by government and other commissioning bodies. However, in responding to this increased pressure to undertake evaluation, research suggests that many TSOs struggle to evaluate their activities following the principles of evidence-based practice (EBP). Yet, there has been no systematic effort to investigate why the third sector is struggling to provide good quality evidence of its effects. This systematic review is reported following the PRISMA guidelines. Ten interdisciplinary databases were searched using a search string developed following best practice and in consultation with an information systems expert. Included studies were primary research of any research design investigating barriers to and facilitators of the evaluation process of TSOs as identified by practitioners. All studies were quality appraised, and the results were synthesised as a thematic summary. Twenty-four studies were included, which mainly investigated TSOs working within health and social services. The thematic summary identified the main barriers for TSOs to undertake evaluation to be related to the (1) lack of financial resources, (2) lack of technical capability and evaluation literacy and (3) challenges around identifying relevant evaluation systems and outcome indicators. Key facilitating factors involved (1) getting the appropriate support, (2) having an organisational culture that supports evaluation and (3) the motivation to be accountable to stakeholders. These findings were robust to study quality. This review constitutes the first systematic effort to synthesise existing literature on factors supporting and preventing evaluation by TSOs. The prevalence of factors revolving around the lack of support, resources and clarity on appropriate outcome indicators suggests that many of the identified challenges may be met by applying evidence-based and stakeholder-inclusive strategies to develop shared evaluation requirements. Future efforts should address the application of EBP as part of the commissioning process of TSOs.

Journal ArticleDOI
TL;DR: Avian influenza virus has been proved to be able to contaminate all types of avian species, including commercial poultry farms, wild birds, backyard domestic animals, live poultry, game birds and mixed poultry, in both developed and developing countries.
Abstract: We conducted a systematic review to investigate avian influenza outbreaks and to explore their distribution, upon avian influenza subtype, country, avian species and other relating details as no comprehensive epidemiological analysis of global avian influenza outbreaks from 2010 to 2016 exists. Data was collated from four databases (Scopus, Web of Science Core Correlation, PubMed and SpringerLink electronic journal) and a global electronic reporting system (ProMED mail), using PRISMA and ORION systematic approaches. One hundred seventy three avian influenza virus outbreaks were identified and included in this review, alongside 198 ProMED mail reports. Our research identified that the majority of the reported outbreaks occurred in 2016 (22.2%). These outbreaks were located in China (13.6%) and referred to commercial poultry farms (56.1%). The most common subtype reported in these outbreaks was H5N1 (38.2%), while almost 82.5% of the subtypes were highly pathogenic avian influenza viruses. There were differences noticed between ProMED mail and the scientific literature screened. Avian influenza virus has been proved to be able to contaminate all types of avian species, including commercial poultry farms, wild birds, backyard domestic animals, live poultry, game birds and mixed poultry. The study focused on wet markets, slaughterhouses, wild habitats, zoos and natural parks, in both developed and developing countries. The impact of avian influenza virus seems disproportionate and could potentially burden the already existing disparities in the public health domain. Therefore, a collaboration between all the involved health sectors is considered to be more than necessary.

Journal ArticleDOI
TL;DR: The finding of this systematic review and meta-analysis will be helpful to inform policy-makers, programmers, planners, clinician’s decision making, researchers, and women clients at large.
Abstract: Unsafe abortion is a neglected public health problem contributing for 13% of maternal death worldwide. In Africa, 99% of abortions are unsafe resulting in one maternal death per 150 cases. The prevalence of unsafe abortion is associated with restricted abortion law, poor quality of health service, and low community awareness. Hence, the aim of this systematic review and meta-analysis is to identify and summarize the available evidence to generate an abridged evidence on the prevalence of unsafe abortion and its associated factors in Sub-Saharan Africa. The development of the systematic review methodology has followed the procedural guideline depicted in the preferred reporting items for systematic review and meta-analysis protocol statement. Observational studies that have been conducted from January 1, 1994, up to December 31, 2017, in Sub-Saharan African countries will be included in the systematic review and meta-analysis. MEDLINE (via PubMed), EMBASE, CINAHL, and PopLine will be searched to retrieve available studies. Relevant studies will be retrieved using the search strings applied to different sources. The Joanna Briggs Institute quality assessment tool will be used to critically appraise the methodological robustness and validity of the finding to avoid erroneous data due to confounded or biased statistics. Data extraction template will be prepared to record abstracted information from selected studies. The selection of relevant studies, data extraction, and quality assessment of studies will be carried out by two authors. Meta-analysis using Mantel–Haenszel random effects model will be carried out. The presence of heterogeneity between studies will be checked using the I2 value. Unsafe abortion is not yet reduced significantly in Sub-Saharan Africa, and maternal death rate due to unsafe abortion remains high. Currently, there is a gap in availability of abridged evidence on unsafe abortion and this negatively influenced the current service delivery. This finding will help stakeholders to design appropriate strategy. The finding of this systematic review and meta-analysis will be helpful to inform policy-makers, programmers, planners, clinician’s decision making, researchers, and women clients at large. PROSPERO 2017: CRD42017081437 .

Journal ArticleDOI
TL;DR: There is a need to offer opportunistic and coordinated screening programmes that are provider-initiated to promote early identification of cervical precancerous lesions and HPV testing has shown better clinical performance in screening HIV-seropositive women.
Abstract: There is scanty or inconclusive evidence on which cervical cancer screening tool is effective and suitable for human immunodeficiency virus (HIV)-seropositive women. The aim of this review was to assess, synthesise and document published evidence relating to the available cervical cancer screening modalities for HIV-seropositive women in developing countries. This paper did not review the issue of human papillomavirus (HPV) prophylactic vaccine on HIV-seropositive women. Five electronic databases were systematically searched from inception to January 2018 for relevant published original research examining cervical cancer prevention modalities for HPV infection, abnormal cytology and direct visualisation of the cervix amongst HIV-seropositive women in developing countries. Extra studies were identified through reference list and citation tracking. Due to methodological and clinical heterogeneity, a narrative synthesis was presented. Of the 2559 articles, 149 underwent full-text screening and 25 were included in the review. Included studies were of moderate quality, and no exclusions were made based on quality or bias. There is no standard cervical cancer screening test or programme for HIV-seropositive women and countries screening according to available resources and expertise. The screening methods used for HIV-seropositive women are the same for HIV-negative women, with varying clinical performance and accuracy. The main cervical cancer screening methods described for HIV-seropositive women are HPV deoxyribonucleic acid/messenger RNA (DNA/mRNA) testing (n = 16, 64.0%), visual inspection with acetic acid (VIA) (n = 13, 52.0%) and Pap smear (n = 11, 44.0%). HPV testing has a better accuracy/efficiency than other methods with a sensitivity of 80.0–97.0% and specificity of 51.0–78.0%. Sequential screening using VIA or visual inspection with Lugol’s iodine (VILI) and HPV testing has shown better clinical performance in screening HIV-seropositive women. Although cervical cancer screening exists in almost all developing countries, what is missing is both opportunistic and systematic organised population-based screenings. Cervical cancer screening programmes need to be integrated into already existing HIV services to enable early detection and treatment. There is a need to offer opportunistic and coordinated screening programmes that are provider-initiated to promote early identification of cervical precancerous lesions. PROSPERO CRD42018095702

Journal ArticleDOI
TL;DR: The interrater reliability (IRR), usability, and applicability of A MeaSurement Tool to Assess systematic Reviews (AMSTAR), AMSTAR 2, and Risk Of Bias In Systematic reviews (ROBIS) for SRs in the fields of biomedicine and public health is investigated.
Abstract: Systematic reviews (SRs) of randomised controlled trials (RCTs) can provide the best evidence to inform decision-making, but their methodological and reporting quality varies. Tools exist to guide the critical appraisal of quality and risk of bias in SRs, but evaluations of their measurement properties are limited. We will investigate the interrater reliability (IRR), usability, and applicability of A MeaSurement Tool to Assess systematic Reviews (AMSTAR), AMSTAR 2, and Risk Of Bias In Systematic reviews (ROBIS) for SRs in the fields of biomedicine and public health. An international team of researchers at three collaborating centres will undertake the study. We will use a random sample of 30 SRs of RCTs investigating therapeutic interventions indexed in MEDLINE in February 2014. Two reviewers at each centre will appraise the quality and risk of bias in each SR using AMSTAR, AMSTAR 2, and ROBIS. We will record the time to complete each assessment and for the two reviewers to reach consensus for each SR. We will extract the descriptive characteristics of each SR, the included studies, participants, interventions, and comparators. We will also extract the direction and strength of the results and conclusions for the primary outcome. We will summarise the descriptive characteristics of the SRs using means and standard deviations, or frequencies and proportions. To test for interrater reliability between reviewers and between the consensus agreements of reviewer pairs, we will use Gwet’s AC1 statistic. For comparability to previous evaluations, we will also calculate weighted Cohen’s kappa and Fleiss’ kappa statistics. To estimate usability, we will calculate the mean time to complete the appraisal and to reach consensus for each tool. To inform applications of the tools, we will test for statistical associations between quality scores and risk of bias judgments, and the results and conclusions of the SRs. Appraising the methodological and reporting quality of SRs is necessary to determine the trustworthiness of their conclusions. Which tool may be most reliably applied and how the appraisals should be used is uncertain; the usability of newly developed tools is unknown. This investigation of common (AMSTAR) and newly developed (AMSTAR 2, ROBIS) tools will provide empiric data to inform their application, interpretation, and refinement.

Journal ArticleDOI
TL;DR: The second meeting of the International Collaboration for Automation of Systematic Reviews (ICASR) was held 3–4 October 2016 and provided a beneficial forum to foster focused discussion about tool development and resources and reconfirm ICASR members’ commitment toward systematic reviews’ automation.
Abstract: The second meeting of the International Collaboration for Automation of Systematic Reviews (ICASR) was held 3–4 October 2016 in Philadelphia, Pennsylvania, USA. ICASR is an interdisciplinary group whose aim is to maximize the use of technology for conducting rapid, accurate, and efficient systematic reviews of scientific evidence. Having automated tools for systematic review should enable more transparent and timely review, maximizing the potential for identifying and translating research findings to practical application. The meeting brought together multiple stakeholder groups including users of summarized research, methodologists who explore production processes and systematic review quality, and technologists such as software developers, statisticians, and vendors. This diversity of participants was intended to ensure effective communication with numerous stakeholders about progress toward automation of systematic reviews and stimulate discussion about potential solutions to identified challenges. The meeting highlighted challenges, both simple and complex, and raised awareness among participants about ongoing efforts by various stakeholders. An outcome of this forum was to identify several short-term projects that participants felt would advance the automation of tasks in the systematic review workflow including (1) fostering better understanding about available tools, (2) developing validated datasets for testing new tools, (3) determining a standard method to facilitate interoperability of tools such as through an application programming interface or API, and (4) establishing criteria to evaluate the quality of tools’ output. ICASR 2016 provided a beneficial forum to foster focused discussion about tool development and resources and reconfirm ICASR members’ commitment toward systematic reviews’ automation.

Journal ArticleDOI
TL;DR: There is currently insufficient evidence for enteric dysbiosis playing a significant role in the pathomechanism of CFS/ME, and Recommendations for future research in this field include the use of consistent criteria for the diagnosis of C FS/ME.
Abstract: Chronic fatigue syndrome or myalgic encephalomyelitis (CFS/ME) is an illness characterised by profound and pervasive fatigue in addition to a heterogeneous constellation of symptoms. The aetiology of this condition remains unknown; however, it has been previously suggested that enteric dysbiosis is implicated in the pathogenesis of CFS/ME. This review examines the evidence currently available for the presence of abnormal microbial ecology in CFS/ME in comparison to healthy controls, with one exception being probiotic-supplemented CFS/ME patients, and whether the composition of the microbiome plays a role in symptom causation. EMBASE, Medline (via EBSCOhost), Pubmed and Scopus were systematically searched from 1994 to March 2018. All studies that investigated the gut microbiome composition of CFS/ME patients were initially included prior to the application of specific exclusion criteria. The association between these findings and patient-centred outcomes (fatigue, quality of life, gastrointestinal symptoms, psychological wellbeing) are also reported. Seven studies that met the inclusion criteria were included in the review. The microbiome composition of CFS/ME patients was compared with healthy controls, with the exception of one study that compared to probiotic-supplemented CFS/ME patients. Differences were reported in each study; however, only three were considered statistically significant, and the findings across all studies were inconsistent. The quality of the studies included in this review scored between poor (< 54%), fair (54–72%) and good (94–100%) using the Downs and Black checklist. There is currently insufficient evidence for enteric dysbiosis playing a significant role in the pathomechanism of CFS/ME. Recommendations for future research in this field include the use of consistent criteria for the diagnosis of CFS/ME, reduction of confounding variables by controlling factors that influence microbiome composition prior to sample collection and including more severe cases of CFS/ME.