How to ... be a reflective practitioner.

ContextDevelopers of health care software have attributed improvements in patient
care to these applications. As with any health care intervention, such claims
require confirmation in clinical trials.ObjectivesTo review controlled trials assessing the effects of computerized clinical
decision support systems (CDSSs) and to identify study characteristics predicting
benefit.Data SourcesWe updated our earlier reviews by searching the MEDLINE, EMBASE, Cochrane
Library, Inspec, and ISI databases and consulting reference lists through
September 2004. Authors of 64 primary studies confirmed data or provided additional
information.Study SelectionWe included randomized and nonrandomized controlled trials that evaluated
the effect of a CDSS compared with care provided without a CDSS on practitioner
performance or patient outcomes.Data ExtractionTeams of 2 reviewers independently abstracted data on methods, setting,
CDSS and patient characteristics, and outcomes.Data SynthesisOne hundred studies met our inclusion criteria. The number and methodologic
quality of studies improved over time. The CDSS improved practitioner performance
in 62 (64%) of the 97 studies assessing this outcome, including 4 (40%) of
10 diagnostic systems, 16 (76%) of 21 reminder systems, 23 (62%) of 37 disease
management systems, and 19 (66%) of 29 drug-dosing or prescribing systems.
Fifty-two trials assessed 1 or more patient outcomes, of which 7 trials (13%)
reported improvements. Improved practitioner performance was associated with
CDSSs that automatically prompted users compared with requiring users to activate
the system (success in 73% of trials vs 47%; P = .02)
and studies in which the authors also developed the CDSS software compared
with studies in which the authors were not the developers (74% success vs
28%; respectively, P = .001).ConclusionsMany CDSSs improve practitioner performance. To date, the effects on
patient outcomes remain understudied and, when studied, inconsistent.

Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review.

ContextCurrent assessment formats for physicians and trainees reliably test
core knowledge and basic skills. However, they may underemphasize some important
domains of professional medical practice, including interpersonal skills,
lifelong learning, professionalism, and integration of core knowledge into
clinical practice.ObjectivesTo propose a definition of professional competence, to review current
means for assessing it, and to suggest new approaches to assessment.Data SourcesWe searched the MEDLINE database from 1966 to 2001 and reference lists
of relevant articles for English-language studies of reliability or validity
of measures of competence of physicians, medical students, and residents.Study SelectionWe excluded articles of a purely descriptive nature, duplicate reports,
reviews, and opinions and position statements, which yielded 195 relevant
citations.Data ExtractionData were abstracted by 1 of us (R.M.E.). Quality criteria for inclusion
were broad, given the heterogeneity of interventions, complexity of outcome
measures, and paucity of randomized or longitudinal study designs.Data SynthesisWe generated an inclusive definition of competence: the habitual and
judicious use of communication, knowledge, technical skills, clinical reasoning,
emotions, values, and reflection in daily practice for the benefit of the
individual and the community being served. Aside from protecting the public
and limiting access to advanced training, assessments should foster habits
of learning and self-reflection and drive institutional change. Subjective,
multiple-choice, and standardized patient assessments, although reliable,
underemphasize important domains of professional competence: integration of
knowledge and skills, context of care, information management, teamwork, health
systems, and patient-physician relationships. Few assessments observe trainees
in real-life situations, incorporate the perspectives of peers and patients,
or use measures that predict clinical outcomes.ConclusionsIn addition to assessments of basic skills, new formats that assess
clinical reasoning, expert judgment, management of ambiguity, professionalism,
time management, learning strategies, and teamwork promise a multidimensional
assessment while maintaining adequate reliability and validity. Institutional
support, reflection, and mentoring must accompany the development of assessment
programs.

/pdf/defining-and-assessing-professional-competence-1sy606vpxu.pdf

Defining and Assessing Professional Competence

Background Medication toxic effects and drug-related problems can have profound medical and safety consequences for older adults and economically affect the health care system. The purpose of this initiative was to revise and update the Beers criteria for potentially inappropriate medication use in adults 65 years and older in the United States. Methods This study used a modified Delphi method, a set of procedures and methods for formulating a group judgment for a subject matter in which precise information is lacking. The criteria reviewed covered 2 types of statements: (1) medications or medication classes thatshould generally be avoidedin persons 65 years or older because they are either ineffective or they pose unnecessarily high risk for older persons and a safer alternative is available and (2) medications that should not be used in older persons known to havespecific medical conditions. Results This study identified 48 individual medications or classes of medications to avoid in older adults and their potential concerns and 20 diseases/conditions and medications to be avoided in older adults with these conditions. Of these potentially inappropriate drugs, 66 were considered by the panel to have adverse outcomes of high severity. Conclusions This study is an important update of previously established criteria that have been widely used and cited. The application of the Beers criteria and other tools for identifying potentially inappropriate medication use will continue to enable providers to plan interventions for decreasing both drug-related costs and overall costs and thus minimize drug-related problems.

https://jamanetwork.com/journals/jamainternalmedicine/articlepdf/757456/ioi20821.pdf

Updating the Beers criteria for potentially inappropriate medication use in older adults: results of a US consensus panel of experts.

Objective: The objective of this study was to evaluate the impact of medication adherence on healthcare utilization and cost for 4 chronic conditions that are major drivers of drug spending: diabetes, hypertension, hypercholesterolemia, and congestive heart failure. Research Design: The authors conducted a retrospective cohort observation of patients who were continuously enrolled in medical and prescription benefit plans from June 1997 through May 1999. Patients were identified for disease-specific analysis based on claims for outpatient, emergency room, or inpatient services during the first 12 months of the study. Using an integrated analysis of administrative claims data, medical and drug utilization were measured during the 12-month period after patient identification. Medication adherence was defined by days’ supply of maintenance medications for each condition. Patients: The study consisted of a population-based sample of 137,277 patients under age 65. Measures: Disease-related and all-cause medical costs, drug costs, and hospitalization risk were measured. Using regression analysis, these measures were modeled at varying levels of medication adherence. Results: For diabetes and hypercholesterolemia, a high level of medication adherence was associated with lower disease-related medical costs. For these conditions, higher medication costs were more than offset by medical cost reductions, producing a net reduction in overall healthcare costs. For diabetes, hypercholesterolemia, and hypertension, cost offsets were observed for all-cause medical costs at high levels of medication adherence. For all 4 conditions, hospitalization rates were significantly lower for patients with high medication adherence. Conclusions: For some chronic conditions, increased drug utilization can provide a net economic return when it is driven by improved adherence with guidelines-based therapy.

http://innovamedicaldesign.com/studies/Impact_of_Medication_Adherence.pdf

Impact of medication adherence on hospitalization risk and healthcare cost.

Medical Education 2010: 44: 900–907



Objectives  The goals of this study were three-fold: to explore the reasons why some clinical teachers regularly attend centralised faculty development activities; to compare their responses with those of colleagues who do not attend, and to learn how we can make faculty development programmes more pertinent to teachers’ needs.



Methods  In 2008–2009, we conducted focus groups with 23 clinical teachers who had participated in faculty development activities on a regular basis in order to ascertain their perceptions of faculty development, reasons for participation, and perceived barriers against involvement. Thematic analysis and research team consensus guided the data interpretation.



Results  Reasons for regular participation included the perceptions that: faculty development enables personal and professional growth; learning and self-improvement are valued; workshop topics are viewed as relevant to teachers’ needs; the opportunity to network with colleagues is appreciated, and initial positive experiences promote ongoing involvement. Barriers against participation mirrored those cited by non-attendees in an earlier study (e.g. volume of work, lack of time, logistical factors), but did not prevent participation. Suggestions for increasing participation included introducing a ‘buddy system’ for junior faculty members, an orientation workshop for new staff, and increased role-modelling and mentorship.



Conclusions  The conceptualisation of faculty development as a means to achieve specific objectives and the desire for relevant programming that addresses current needs (i.e., expectancies), together with an appreciation of learning, self-improvement and networking with colleagues (i.e., values), were highlighted as reasons for participation by regular attendees. Medical educators should consider these ‘lessons learned’ in the design and delivery of faculty development offerings. They should also continue to explore the notion of faculty development as a social practice and the application of motivational theories that include expectancy–value constructs to personal and professional development.

Faculty development: if you build it, they will come.

Objective: To determine the feasibility and value of using patient satisfaction ratings to evaluate the physician-patient relationship skills of medical residents.

The feasibility and value of using patient satisfaction ratings to evaluate internal medicine residents

Context. —As medical costs are increasingly being scrutinized, there is heightened interest in defining variations in physician behavior in clinical settings. Objective. —To evaluate if standardized patient (SP) technology is a reliable and feasible method of studying interphysician variations in test ordering, referral requests, prescribing behavior, and visit costs. Design. —The study was conducted with blinded SP visits to family medicine and internal medicine residents, university-affiliated family physicians, and community-based family physicians. Resource utilization and visit costs were assessed using test requisitions, consult requests, and prescriptions that were collected by the SPs. Setting. —Physicians' offices in ambulatory care, hospital-based clinics and in the community. Participants. —Four persons (aged 57-77 years) trained to simulate having osteoarthritis of the hip. In one simulation, the patient had gastropathy due to nonsteroidal anti-inflammatory drug use, and in the other, the patient sought therapy for hip discomfort. Main Outcome Measures. —Reliability of cost estimates of physician services, tests, consultations, prescriptions, and total visits and test-ordering behavior for nonsteroidal anti-inflammatory gastropathy. Results. —Overall, 112 (63%) of the physicians who were sent invitations to the study agreed to participate. Of 312 total SP visits conducted over a 1-year period, unblinding due to SP detection occurred on 36 occasions (11.5%). Reliable cost estimates of physician services, tests, and consultations, and moderately reliable estimates of total visit costs, were obtained with 4 visits per practicing physician and with 2 visits per resident. There were extreme variations in total visit costs generated by the study physicians. A small number of physicians had a major impact on this variability. Conclsion. —Standardized patient technology provides a reliable, feasible method to assess variations in resource utilization between physicians.

Use of standardized patients to assess between-physician variations in resource utilization

The authors developed a cognitive-theory-based checklist of seven important principles for teaching technical skills. They then used the checklist in a workshop for doctors who teach procedural and technical skills. Participants in the workshop found the principle-based approach to be more effective than the traditional "see one, do one, teach one" approach.

Seven principles for teaching procedural and technical skills.

Objective: To determine whether patient satisfaction ratings can be predicted by faculty ratings or self-ratings of resident humanism. Design: A prospective three-month collection of patient satisfaction ratings in two ambulatory care clinics and simultaneous acquisition of faculty ratings and self-ratings of resident humanism using ABIM questionnaires. Setting: Two teaching hospital ambulatory care internal medicine clinics. Participants: Forty-seven internal medicine residents and 17 faculty internists were sent questionnaires for evaluation of humanism of individual residents. One thousand one hundred ninety-four consecutive outpatients cared for by the residents were eligible for patient satisfaction questionnaires. Measurements and main results: Thirty-three residents and 13 faculty completed evaluations of resident humanism while 792 patients completed satisfaction questionnaires, which were used for analysis. The faculty ratings of resident humanism correlated strongly with patient satisfaction ratings, while the resident self-ratings did not. Conclusions: Faculty ratings of resident humanism were highly predictive of patient satisfaction with the care rendered by internal medicine residents in two ambulatory care clinics. This suggests that ambulatory care settings are useful for evaluation of noncognitive behavioral features of resident performance.

Peter J. McLeod

Papers

Faculty development: if you build it, they will come.

The feasibility and value of using patient satisfaction ratings to evaluate internal medicine residents

Use of standardized patients to assess between-physician variations in resource utilization

Seven principles for teaching procedural and technical skills.

Faculty ratings of resident humanism predict patient satisfaction ratings in ambulatory medical clinics