scispace - formally typeset
Search or ask a question
Journal ArticleDOI

How does the effectiveness of strategies to improve healthcare provider practices in low-income and middle-income countries change after implementation? Secondary analysis of a systematic review.

TL;DR: In this paper, a systematic review evaluated the effectiveness of strategies to improve healthcare provider (HCP) performance in low-income and middle-income countries, including in-service training, supervision and group problem-solving.
Abstract: Background A recent systematic review evaluated the effectiveness of strategies to improve healthcare provider (HCP) performance in low-income and middle-income countries. The review identified strategies with varying effects, including in-service training, supervision and group problem-solving. However, whether their effectiveness changed over time remained unclear. In particular, understanding whether effects decay over time is crucial to improve sustainability. Methods We conducted a secondary analysis of data from the aforementioned review to explore associations between time and effectiveness. We calculated effect sizes (defined as percentage-point (%-point) changes) for HCP practice outcomes (eg, percentage of patients correctly treated) at each follow-up time point after the strategy was implemented. We estimated the association between time and effectiveness using random-intercept linear regression models with time-specific effect sizes clustered within studies and adjusted for baseline performance. Results The primary analysis included 37 studies, and a sensitivity analysis included 77 additional studies. For training, every additional month of follow-up was associated with a 0.19 %-point decrease in effectiveness (95% CI: –0.36 to –0.03). For training combined with supervision, every additional month was associated with a 0.40 %-point decrease in effectiveness (95% CI: –0.68 to –0.12). Time trend results for supervision were inconclusive. For group problem-solving alone, time was positively associated with effectiveness, with a 0.50 %-point increase in effect per month (95% CI: 0.37 to 0.64). Group problem-solving combined with training was associated with large improvements, and its effect was not associated with time. Conclusions Time trends in the effectiveness of different strategies to improve HCP practices vary among strategies. Programmes relying solely on in-service training might need periodical refresher training or, better still, consider combining training with group problem-solving. Although more high-quality research is needed, these results, which are important for decision-makers as they choose which strategies to use, underscore the utility of studies with multiple post-implementation measurements so sustainability of the impact on HCP practices can be assessed.
Citations
More filters
Journal ArticleDOI
TL;DR: In this paper, the authors examined a multimodal approach to mentorship as part of a safe surgery intervention (Safe Surgery 2020) to improve surgical quality and found that 96% of mentees experienced the intervention as positive, 88% were satisfied, and 100% supported continuing the intervention in the future.
Abstract: Background Safe, high-quality surgical care in many African countries is a critical need. Challenges include availability of surgical providers, improving quality of care, and building workforce capacity. Despite growing evidence that mentoring is effective in African healthcare settings, less is known about its role in surgery. We examined a multimodal approach to mentorship as part of a safe surgery intervention (Safe Surgery 2020) to improve surgical quality. Our goal was to distill lessons for policy makers, intervention designers, and practitioners on key elements of a successful surgical mentorship program. Methods We used a convergent, mixed-methods design to examine the experiences of mentees, mentors, and facility leaders with mentorship at 10 health facilities in Tanzania's Lake Zone. A multidisciplinary team of mentors worked with surgical providers over 17 months using in-person mentorship, telementoring, and WhatsApp. We conducted surveys, in-depth interviews, and focus groups to capture data in four categories: (1) satisfaction with mentorship; (2) perceived impact; (3) elements of a successful mentoring program; and (4) challenges to implementing mentorship. We analyzed quantitative data using frequency analysis and qualitative data using the constant comparison method. Recurrent and unifying concepts were identified through merging the qualitative and quantitative data. Results Overall, 96% of mentees experienced the intervention as positive, 88% were satisfied, and 100% supported continuing the intervention in the future. Mentees, mentors, and facility leaders perceived improvements in surgical practice, the surgical ecosystem, and in reducing postsurgical infections. Several themes related to the intervention's success emerged: (1) the intervention's design, including its multimodality, side-by-side mentorship, and standardization of practices; (2) the mentee-mentor relationship, including a friendly, safe, non-hierarchical, team relationship, as well as mentors' understanding of the local context; and (3) mentorship characteristics, including non-judgmental feedback, experience, and accessibility. Challenges included resistance to change, shortage of providers, mentorship dose, and logistics. Conclusions Our study suggests a multimodal mentorship approach is promising in building the capacity of surgical providers. By distilling the experiences of the mentees, mentors, and facility leaders, our lessons provide a foundation for future efforts to establish effective surgical mentorship programs that build provider capacity and ultimately improve surgical quality.

7 citations

Journal ArticleDOI
TL;DR: In this paper , the effect of supervision strategies on health care provider practices in low and middle-income countries (LMICs) was investigated and attributes associated with greater effectiveness of routine supervision were identified.
Abstract: Abstract Background Although supervision is a ubiquitous approach to support health programs and improve health care provider (HCP) performance in low- and middle-income countries (LMICs), quantitative evidence of its effects is unclear. The objectives of this study are to describe the effect of supervision strategies on HCP practices in LMICs and to identify attributes associated with greater effectiveness of routine supervision. Methods We performed a secondary analysis of data on HCP practice outcomes (e.g., percentage of patients correctly treated) from a systematic review on improving HCP performance. The review included controlled trials and interrupted time series studies. We described distributions of effect sizes (defined as percentage-point [%-point] changes) for each supervision strategy. To identify attributes associated with supervision effectiveness, we performed random-effects linear regression modeling and examined studies that directly compared different approaches of routine supervision. Results We analyzed data from 81 studies from 36 countries. For professional HCPs, such as nurses and physicians, primarily working at health facilities, routine supervision (median improvement when compared to controls: 10.7%-points; IQR: 9.9, 27.9) had similar effects on HCP practices as audit with feedback (median improvement: 10.1%-points; IQR: 6.2, 23.7). Two attributes were associated with greater mean effectiveness of routine supervision ( p < 0.10): supervisors received supervision (by 8.8–11.5%-points), and supervisors participated in problem-solving with HCPs (by 14.2–20.8%-points). Training for supervisors and use of a checklist during supervision visits were not associated with effectiveness. The effects of supervision frequency (i.e., number of visits per year) and dose (i.e., the number of supervision visits during a study) were unclear. For lay HCPs, the effect of routine supervision was difficult to characterize because few studies existed, and effectiveness in those studies varied considerably. Evidence quality for all findings was low primarily because many studies had a high risk of bias. Conclusions Although evidence is limited, to promote more effective supervision, our study supports supervising supervisors and having supervisors engage in problem-solving with HCPs. Supervision’s integral role in health systems in LMICs justifies a more deliberate research agenda to identify how to deliver supervision to optimize its effect on HCP practices.

3 citations

Journal ArticleDOI
TL;DR: Hospital-level improvements to oxygen and pulse oximetry systems in Nigerian hospitals have been sustained over the medium-term and are a highly cost-effective child pneumonia intervention.
Abstract: Introduction Improving hospital oxygen systems can improve quality of care and reduce mortality for children, but we lack data on cost-effectiveness or sustainability. This study evaluated medium-term sustainability and cost-effectiveness of the Nigeria Oxygen Implementation programme. Methods Prospective follow-up of a stepped-wedge trial involving 12 secondary-level hospitals. Cross-sectional facility assessment, clinical audit (January–March 2021), summary admission data (January 2018–December 2020), programme cost data. Intervention: pulse oximetry introduction followed by solar-powered oxygen system installation with clinical and technical training and support. Primary outcomes: (i) proportion of children screened with pulse oximetry; (ii) proportion of hypoxaemic (SpO2 <90%) children who received oxygen. Comparison across three time periods: preintervention (2014–2015), intervention (2016–2017) and follow-up (2018–2020) using mixed-effects logistic regression. Calculated cost-effectiveness of the intervention on child pneumonia mortality using programme costs, recorded deaths and estimated counterfactual deaths using effectiveness estimates from our effectiveness study. Reported cost-effectiveness over the original 2-year intervention period (2016–2017) and extrapolated over 5 years (2016–2020). Results Pulse oximetry coverage for neonates and children remained high during follow-up (83% and 81%) compared with full oxygen system period (94% and 92%) and preintervention (3.9% and 2.9%). Oxygen coverage for hypoxaemic neonates/children was similarly high (94%/88%) compared with full oxygen system period (90%/82%). Functional oxygen sources were present in 11/12 (92%) paediatric areas and all (8/8) neonatal areas; three-quarters (15/20) of wards had a functional oximeter. Of 32 concentrators deployed, 23/32 (72%) passed technical testing and usage was high (median 10 797 hours). Estimated 5-year cost-effectiveness US$86 per patient treated, $2694–4382 per life saved and $82–125 per disability-adjusted life year-averted. We identified practical issues for hospitals and Ministries of Health wishing to adapt and scale up pulse oximetry and oxygen. Conclusion Hospital-level improvements to oxygen and pulse oximetry systems in Nigerian hospitals have been sustained over the medium-term and are a highly cost-effective child pneumonia intervention.

2 citations

Journal ArticleDOI
TL;DR: In this article , the authors investigated the experiences of health care providers who participated in process-oriented group reflections, which was one of the three pillars of a training intervention seeking to implement evidence-based care routines during labour and birth that could contribute to reduced mortality and improved maternal and newborn health in the Democratic Republic of Congo (DRC).
Posted ContentDOI
16 Jun 2023
TL;DR: In this article , the authors assessed healthcare provider knowledge and adherence to national guidelines for managing malaria in pregnancy in the context of the first-line therapies (MFT) pilot in Western Kenya, potentially exposing women of childbearing age (WOCBA) to antimalarials with unknown safety profiles in the first trimester.
Abstract: Abstract Background Concerns about emerging resistance to artemether-lumefantrine (AL) in Africa prompted the pilot introduction of multiple first-line therapies (MFT) in Western Kenya, potentially exposing women-of-childbearing-age (WOCBA) to antimalarials with unknown safety profiles in the first trimester. We assessed healthcare provider knowledge and adherence to national guidelines for managing malaria in pregnancy in the context of the MFT pilot. Methods From March to April 2022, we conducted a cross-sectional study in 50 health facilities (HF) and 40 drug outlets (DO) using structured questionnaires to assess pregnancy detection, malaria diagnosis, and treatment choices by trimester. Differences between HF and DO providers and between MFT and non-MFT HFs were assessed using Chi-square tests. Results Of 174 providers (77% HF, 23% DO), 56% were from MFT pilot facilities. Most providers had tertiary education; 5% HF and 20% DO had only primary or secondary education. More HF than DO providers had knowledge of malaria treatment guidelines (62% vs 40%, p=0.023), received training in malaria in pregnancy (49% vs 20%, p=0.002), and reported assessing for pregnancy in WOCBA (98% vs 78%, p<0.001). Most providers insisted on parasitological diagnosis, with 59% HF using microscopy and 85% DO using rapid diagnostic tests. More HF than DO providers could correctly name the drugs for treating uncomplicated malaria in the first trimester (oral quinine, or AL if quinine is unavailable) (90% vs 58%, p<0.001), second and third trimesters (artemisinin-based combination therapies) (84% vs 70%, p=0.07), and for severe malaria (parenteral artesunate/artemether) (94% vs 60%, p<0.001). Among HF providers, those in the MFT pilot had more knowledge of malaria treatment guidelines (67% vs 49%, p=0.08) and had received training on treatment of malaria in pregnancy (56% vs 32%, p=0.03). Few providers (10% HF and 12% DO) had adequate knowledge of malaria treatment in pregnancy, defined as the correct drug and dose for uncomplicated and severe malaria in all trimesters. Conclusions Knowledge of national malaria in pregnancy treatment guidelines among providers in western Kenya is suboptimal. Robust training on appropriate antimalarial and dosage is needed. Supervision of DO and HF practices is essential for correct treatment of malaria in pregnancy in the context of MFT programmes.
References
More filters
Journal ArticleDOI
17 Nov 2001-BMJ
TL;DR: Analyzing health care organizations as complex systems, Crossing the Quality Chasm also documents the causes of the quality gap, identifies current practices that impede quality care, and explores how systems approaches can be used to implement change.
Abstract: Crossing the Quality Chasm identifies and recommends improvements in six dimensions of health care in the U.S.: patient safety, care effectiveness, patient-centeredness, timeliness, care efficiency, and equity. Safety looks at reducing the likelihood that patients are harmed by medical errors. Effectiveness describes avoiding over and underuse of resources and services. Patient-centeredness relates both to customer service and to considering and accommodating individual patient needs when making care decisions. Timeliness emphasizes reducing wait times. Efficiency focuses on reducing waste and, as a result, total cost of care. Equity looks at closing racial and income gaps in health care.

15,046 citations

Journal ArticleDOI
TL;DR: The results indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, and the role of context and the targeted clinical behaviour was assessed.
Abstract: Background Audit and feedback continues to be widely used as a strategy to improve professional practice. It appears logical that healthcare professionals would be prompted to modify their practice if given feedback that their clinical practice was inconsistent with that of their peers or accepted guidelines. Yet, audit and feedback has not been found to be consistently effective. Objectives To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes. Search strategy We searched the Cochrane Effective Practice and Organisation of Care Group's register up to January 2001. This was supplemented with searches of MEDLINE and reference lists, which did not yield additional relevant studies. Selection criteria Randomised trials of audit and feedback (defined as any summary of clinical performance over a specified period of time) that reported objectively measured professional practice in a healthcare setting or healthcare outcomes. Data collection and analysis Two reviewers independently extracted data and assessed study quality. Quantitative (meta-regression), visual and qualitative analyses were undertaken. Main results We included 85 studies, 48 of which have been added to the previous version of this review. There were 52 comparisons of dichotomous outcomes from 47 trials with over 3500 health professionals that compared audit and feedback to no intervention. The adjusted RDs of non-compliance with desired practice varied from 0.09 (a 9% absolute increase in non-compliance) to 0.71 (a 71% decrease in non-compliance) (median = 0.07, inter-quartile range = 0.02 to 0.11). The one factor that appeared to predict the effectiveness of audit and feedback across studies was baseline non-compliance with recommended practice. Reviewer's conclusions Audit and feedback can be effective in improving professional practice. When it is effective, the effects are generally small to moderate. The absolute effects of audit and feedback are more likely to be larger when baseline adherence to recommended practice is low.

4,946 citations

Journal ArticleDOI
TL;DR: It is shown how segmented regression analysis can be used to evaluate policy and educational interventions intended to improve the quality of medication use and/or contain costs.
Abstract: Interrupted time series design is the strongest, quasi-experimental approach for evaluating longitudinal effects of interventions. Segmented regression analysis is a powerful statistical method for estimating intervention effects in interrupted time series studies. In this paper, we show how segmented regression analysis can be used to evaluate policy and educational interventions intended to improve the quality of medication use and/or contain costs.

2,513 citations

Journal ArticleDOI
TL;DR: Educational meetings alone or combined with other interventions, can improve professional practice and healthcare outcomes for the patients and is most likely to be small and similar to other types of continuing medical education, such as audit and feedback, and educational outreach visits.
Abstract: Background Educational meetings are widely used for continuing medical education. Previous reviews found that interactive workshops resulted in moderately large improvements in professional practice, whereas didactic sessions did not. Objectives To assess the effects of educational meetings on professional practice and healthcare outcomes. Search methods We updated previous searches by searching the Cochrane Effective Practice and Organisation of Care Group Trials Register and pending file, from 1999 to March 2006. Selection criteria Randomised controlled trials of educational meetings that reported an objective measure of professional practice or healthcare outcomes. Data collection and analysis Two authors independently extracted data and assessed study quality. Studies with a low or moderate risk of bias and that reported baseline data were included in the primary analysis. They were weighted according to the number of health professionals participating. For each comparison, we calculated the risk difference (RD) for dichotomous outcomes, adjusted for baseline compliance; and for continuous outcomes the percentage change relative to the control group average after the intervention, adjusted for baseline performance. Professional and patient outcomes were analysed separately. We considered 10 factors to explain heterogeneity of effect estimates using weighted meta-regression supplemented by visual analysis of bubble and box plots. Main results In updating the review, 49 new studies were identified for inclusion. A total of 81 trials involving more than 11,000 health professionals are now included in the review. Based on 30 trials (36 comparisons), the median adjusted RD in compliance with desired practice was 6% (interquartile range 1.8 to 15.9) when any intervention in which educational meetings were a component was compared to no intervention. Educational meetings alone had similar effects (median adjusted RD 6%, interquartile range 2.9 to 15.3; based on 21 comparisons in 19 trials). For continuous outcomes the median adjusted percentage change relative to control was 10% (interquartile range 8 to 32%; 5 trials). For patient outcomes the median adjusted RD in achievement of treatment goals was 3.0 (interquartile range 0.1 to 4.0; 5 trials). Based on univariate meta-regression analyses of the 36 comparisons with dichotomous outcomes for professional practice, higher attendance at the educational meetings was associated with larger adjusted RDs (P < 0.01); mixed interactive and didactic education meetings (median adjusted RD 13.6) were more effective than either didactic meetings (RD 6.9) or interactive meetings (RD 3.0). Educational meetings did not appear to be effective for complex behaviours (adjusted RD -0.3) compared to less complex behaviours; they appeared to be less effective for less serious outcomes (RD 2.9) than for more serious outcomes. Authors' conclusions Educational meetings alone or combined with other interventions, can improve professional practice and healthcare outcomes for the patients. The effect is most likely to be small and similar to other types of continuing medical education, such as audit and feedback, and educational outreach visits. Strategies to increase attendance at educational meetings, using mixed interactive and didactic formats, and focusing on outcomes that are likely to be perceived as serious may increase the effectiveness of educational meetings. Educational meetings alone are not likely to be effective for changing complex behaviours.

1,579 citations