How to ... be a reflective practitioner.

ContextDevelopers of health care software have attributed improvements in patient
care to these applications. As with any health care intervention, such claims
require confirmation in clinical trials.ObjectivesTo review controlled trials assessing the effects of computerized clinical
decision support systems (CDSSs) and to identify study characteristics predicting
benefit.Data SourcesWe updated our earlier reviews by searching the MEDLINE, EMBASE, Cochrane
Library, Inspec, and ISI databases and consulting reference lists through
September 2004. Authors of 64 primary studies confirmed data or provided additional
information.Study SelectionWe included randomized and nonrandomized controlled trials that evaluated
the effect of a CDSS compared with care provided without a CDSS on practitioner
performance or patient outcomes.Data ExtractionTeams of 2 reviewers independently abstracted data on methods, setting,
CDSS and patient characteristics, and outcomes.Data SynthesisOne hundred studies met our inclusion criteria. The number and methodologic
quality of studies improved over time. The CDSS improved practitioner performance
in 62 (64%) of the 97 studies assessing this outcome, including 4 (40%) of
10 diagnostic systems, 16 (76%) of 21 reminder systems, 23 (62%) of 37 disease
management systems, and 19 (66%) of 29 drug-dosing or prescribing systems.
Fifty-two trials assessed 1 or more patient outcomes, of which 7 trials (13%)
reported improvements. Improved practitioner performance was associated with
CDSSs that automatically prompted users compared with requiring users to activate
the system (success in 73% of trials vs 47%; P = .02)
and studies in which the authors also developed the CDSS software compared
with studies in which the authors were not the developers (74% success vs
28%; respectively, P = .001).ConclusionsMany CDSSs improve practitioner performance. To date, the effects on
patient outcomes remain understudied and, when studied, inconsistent.

Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review.

ContextCurrent assessment formats for physicians and trainees reliably test
core knowledge and basic skills. However, they may underemphasize some important
domains of professional medical practice, including interpersonal skills,
lifelong learning, professionalism, and integration of core knowledge into
clinical practice.ObjectivesTo propose a definition of professional competence, to review current
means for assessing it, and to suggest new approaches to assessment.Data SourcesWe searched the MEDLINE database from 1966 to 2001 and reference lists
of relevant articles for English-language studies of reliability or validity
of measures of competence of physicians, medical students, and residents.Study SelectionWe excluded articles of a purely descriptive nature, duplicate reports,
reviews, and opinions and position statements, which yielded 195 relevant
citations.Data ExtractionData were abstracted by 1 of us (R.M.E.). Quality criteria for inclusion
were broad, given the heterogeneity of interventions, complexity of outcome
measures, and paucity of randomized or longitudinal study designs.Data SynthesisWe generated an inclusive definition of competence: the habitual and
judicious use of communication, knowledge, technical skills, clinical reasoning,
emotions, values, and reflection in daily practice for the benefit of the
individual and the community being served. Aside from protecting the public
and limiting access to advanced training, assessments should foster habits
of learning and self-reflection and drive institutional change. Subjective,
multiple-choice, and standardized patient assessments, although reliable,
underemphasize important domains of professional competence: integration of
knowledge and skills, context of care, information management, teamwork, health
systems, and patient-physician relationships. Few assessments observe trainees
in real-life situations, incorporate the perspectives of peers and patients,
or use measures that predict clinical outcomes.ConclusionsIn addition to assessments of basic skills, new formats that assess
clinical reasoning, expert judgment, management of ambiguity, professionalism,
time management, learning strategies, and teamwork promise a multidimensional
assessment while maintaining adequate reliability and validity. Institutional
support, reflection, and mentoring must accompany the development of assessment
programs.

/pdf/defining-and-assessing-professional-competence-1sy606vpxu.pdf

Defining and Assessing Professional Competence

Background Medication toxic effects and drug-related problems can have profound medical and safety consequences for older adults and economically affect the health care system. The purpose of this initiative was to revise and update the Beers criteria for potentially inappropriate medication use in adults 65 years and older in the United States. Methods This study used a modified Delphi method, a set of procedures and methods for formulating a group judgment for a subject matter in which precise information is lacking. The criteria reviewed covered 2 types of statements: (1) medications or medication classes thatshould generally be avoidedin persons 65 years or older because they are either ineffective or they pose unnecessarily high risk for older persons and a safer alternative is available and (2) medications that should not be used in older persons known to havespecific medical conditions. Results This study identified 48 individual medications or classes of medications to avoid in older adults and their potential concerns and 20 diseases/conditions and medications to be avoided in older adults with these conditions. Of these potentially inappropriate drugs, 66 were considered by the panel to have adverse outcomes of high severity. Conclusions This study is an important update of previously established criteria that have been widely used and cited. The application of the Beers criteria and other tools for identifying potentially inappropriate medication use will continue to enable providers to plan interventions for decreasing both drug-related costs and overall costs and thus minimize drug-related problems.

https://jamanetwork.com/journals/jamainternalmedicine/articlepdf/757456/ioi20821.pdf

Updating the Beers criteria for potentially inappropriate medication use in older adults: results of a US consensus panel of experts.

Objective: The objective of this study was to evaluate the impact of medication adherence on healthcare utilization and cost for 4 chronic conditions that are major drivers of drug spending: diabetes, hypertension, hypercholesterolemia, and congestive heart failure. Research Design: The authors conducted a retrospective cohort observation of patients who were continuously enrolled in medical and prescription benefit plans from June 1997 through May 1999. Patients were identified for disease-specific analysis based on claims for outpatient, emergency room, or inpatient services during the first 12 months of the study. Using an integrated analysis of administrative claims data, medical and drug utilization were measured during the 12-month period after patient identification. Medication adherence was defined by days’ supply of maintenance medications for each condition. Patients: The study consisted of a population-based sample of 137,277 patients under age 65. Measures: Disease-related and all-cause medical costs, drug costs, and hospitalization risk were measured. Using regression analysis, these measures were modeled at varying levels of medication adherence. Results: For diabetes and hypercholesterolemia, a high level of medication adherence was associated with lower disease-related medical costs. For these conditions, higher medication costs were more than offset by medical cost reductions, producing a net reduction in overall healthcare costs. For diabetes, hypercholesterolemia, and hypertension, cost offsets were observed for all-cause medical costs at high levels of medication adherence. For all 4 conditions, hospitalization rates were significantly lower for patients with high medication adherence. Conclusions: For some chronic conditions, increased drug utilization can provide a net economic return when it is driven by improved adherence with guidelines-based therapy.

http://innovamedicaldesign.com/studies/Impact_of_Medication_Adherence.pdf

Impact of medication adherence on hospitalization risk and healthcare cost.

Background: Most university faculty members are expected to teach. Many would benefit from instruction designed to improve lecturing.Aims: To explore the impact of a program in which video-recorded...

https://www.tandfonline.com/doi/pdf/10.3109/0142159X.2012.733460

Peer review: an effective approach to cultivating lecturing virtuosity.

that the traditional event was more comfortable for participants. The Strongest Link project provides evidence that learning in a game-type format can be more interactive despite being a large-group activity. Therefore, innovative learning formats should be developed in a supportive environment that is both enjoyable and competitive. Such initiatives will breathe new life into tried and tested CME programmes.

Use of retrospective pre/post assessments in faculty development.

Objectives By the end of residency training, pediatric emergency medicine (PEM) residents are expected to have developed the confidence and abilities required to manage acutely ill children. Acquisition of competence requires exposure and/or supplemental formal education for critical and noncritical medical clinical presentations. Simulation can provide experiential learning and can improve trainees’ knowledge, skills, and attitudes. The primary objective of this project was to identify the content for a simulation-based national curriculum for PEM training. Methods We recruited participants for the Delphi study by contacting current PEM program directors and immediate past program directors as well as simulation experts at all of the Canadian PEM fellowship sites. We determined the appropriate core content for the Delphi study by combining the PEM core content requirements of the Royal College of Physicians and Surgeons of Canada (RCPSC) and the American Board of Pediatrics (ABP). Using the Delphi method, we achieved consensus amongst the national group of PEM and simulation experts. The participants completed a three-round Delphi (using a four-point Likert scale). Results Response rates for the Delphi were 85% for the first round and 77% for second and third rounds. From the initial 224 topics, 53 were eliminated (scored <2). Eighty-five topics scored between 2 and 3, and 87 scored between 3 and 4. The 48 topics, which were scored between 3.5 and 4.0, were labeled as “key curriculum topics.” Conclusion We have iteratively identified a consensus for the content of a national simulation-based curriculum.

/pdf/determining-content-for-a-simulation-based-curriculum-in-3g4khgl35c.pdf

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

OBJECTIVE: To compare the current status of faculty development practices in Canadian medical schools with the status of such practices in 1986. DESIGN: Mail survey. SETTING: All 16 Canadian medical schools. PARTICIPANTS: Faculty development coordinators at the medical schools. OUTCOME MEASURES: Existence of faculty development committees, funding for faculty development activities, types of activities and recognition of faculty participation in such activities. RESULTS: Completed responses were received from all schools. They indicated a significant, positive evolution in faculty development since the previous survey, conducted in 1986. Most schools have established a faculty development committee and provide funds for such activities as workshops, sabbatical leaves and conference attendance. Although traditional development practices are prevalent, there is now widespread emphasis on computer technology, information retrieval, management skills and research. Experienced faculty and other experts are more widely used for consultation on teaching. Very little has been done to evaluate the impact of faculty development. CONCLUSION: Faculty development in Canadian medical schools has undergone a major, positive transition during the last 10 years.

/pdf/faculty-development-in-canadian-medical-schools-a-10-year-2rzl8u1z2e.pdf

Peter J. McLeod

Papers

Peer review: an effective approach to cultivating lecturing virtuosity.

Use of retrospective pre/post assessments in faculty development.

Determining content for a simulation-based curriculum in pediatric emergency medicine: results from a national Delphi process.

Faculty development in Canadian medical schools: a 10-year update

Do medical education and practice characteristics predict inappropriate prescribing of sedative-hypnotics for the elderly?