Showing papers in "BMC Medical Education in 2010"

Internet-based medical education: a realist review of what works, for whom and in what circumstances.

Abstract: Background: Educational courses for doctors and medical students are increasingly offered via the Internet. Despite much research, course developers remain unsure about what (if anything) to offer online and how. Prospective learners lack evidence-based guidance on how to choose between the options on offer. We aimed to produce theory driven criteria to guide the development and evaluation of Internet-based medical courses. Methods: Realist review - a qualitative systematic review method whose goal is to identify and explain the interaction between context, mechanism and outcome. We searched 15 electronic databases and references of included articles, seeking to identify theoretical models of how the Internet might support learning from empirical studies which (a) used the Internet to support learning, (b) involved doctors or medical students; and (c) reported a formal evaluation. All study designs and outcomes were considered. Using immersion and interpretation, we tested theories by considering how well they explained the different outcomes achieved in different educational contexts. Results: 249 papers met our inclusion criteria. We identified two main theories of the course-in-context that explained variation in learners’ satisfaction and outcomes: Davis’s Technology Acceptance Model and Laurillard’s model of interactive dialogue. Learners were more likely to accept a course if it offered a perceived advantage over available non-Internet alternatives, was easy to use technically, and compatible with their values and norms. ‘Interactivity’ led to effective learning only if learners were able to enter into a dialogue - with a tutor, fellow students or virtual tutorials - and gain formative feedback. Conclusions: Different modes of course delivery suit different learners in different contexts. When designing or choosing an Internet-based course, attention must be given to the fit between its technical attributes and learners’ needs and priorities; and to ways of providing meaningful interaction. We offer a preliminary set of questions to aid course developers and learners consider these issues.

Perceived Stress, Sources and Severity of Stress among medical undergraduates in a Pakistani Medical School

Abstract: Recently there is a growing concern about stress during undergraduate medical training. However, studies about the same are lacking from Pakistani medical schools. The objectives of our study were to assess perceived stress, sources of stress and their severity and to assess the determinants of stressed cases. A cross-sectional, questionnaire-based survey was carried out among undergraduate medical students of CMH Lahore Medical College, Pakistan during January to March 2009. Perceived stress was assessed using the perceived stress scale. A 33-item questionnaire was used to assess sources of stress and their severity. The overall response rate was 80.5% (161 out of 200 students). The overall mean perceived stress was 30.84 (SD = 7.01) and was significantly higher among female students. By logistic regression analysis, stressed cases were associated with occurrence of psychosocial (OR 5.01, 95% CI 2.44-10.29) and academic related stressors (OR 3.17 95% CI 1.52-6.68). The most common sources of stress were related to academic and psychosocial concerns. 'High parental expectations', 'frequency of examinations', 'vastness of academic curriculum', 'sleeping difficulties', 'worrying about the future', 'loneliness', 'becoming a doctor', 'performance in periodic examinations' were the most frequently and severely occurring sources of stress. There was a negative but insignificant correlation between perceived stress and academic performance (r = -0.099, p > 0.05). A higher level of perceived stress was reported by the students. The main stressors were related to academic and psychosocial domains. Further studies are required to test the association between stressed cases and gender, academic stressors and psychosocial stressors.

Mentoring programs for medical students - a review of the PubMed literature 2000 - 2008

Abstract: Although mentoring is acknowledged as a key to successful and satisfying careers in medicine, formal mentoring programs for medical students are lacking in most countries. Within the framework of planning a mentoring program for medical students at Zurich University, an investigation was carried out into what types of programs exist, what the objectives pursued by such programs are, and what effects are reported. A PubMed literature search was conducted for 2000 - 2008 using the following keywords or their combinations: mentoring, mentoring program, medical student, mentor, mentee, protege, mentorship. Although a total of 438 publications were identified, only 25 papers met the selection criteria for structured programs and student mentoring surveys. The mentoring programs reported in 14 papers aim to provide career counseling, develop professionalism, increase students' interest in research, and support them in their personal growth. There are both one-to-one and group mentorships, established in the first two years of medical school and continuing through graduation. The personal student-faculty relationship is important in that it helps students to feel that they are benefiting from individual advice and encourages them to give more thought to their career choices. Other benefits are an increase in research productivity and improved medical school performance in general. Mentored students also rate their overall well-being as higher. - The 11 surveys address the requirements for being an effective mentor as well as a successful mentee. A mentor should empower and encourage the mentee, be a role model, build a professional network, and assist in the mentee's personal development. A mentee should set agendas, follow through, accept criticism, and be able to assess performance and the benefits derived from the mentoring relationship. Mentoring is obviously an important career advancement tool for medical students. In Europe, more mentoring programs should be developed, but would need to be rigorously assessed based on evidence of their value in terms of both their impact on the career paths of juniors and their benefit for the mentors. Medical schools could then be monitored with respect to the provision of mentorships as a quality characteristic.

A survey on the attitudes towards research in medical school

Abstract: An observed decrease of physician scientists in medical practice has generated much recent interest in increasing the exposure of research programs in medical school. The aim of this study was to review the experience and attitudes regarding research by medical students in Canada. An anonymous, cross-sectional, self-report questionnaire was administered to second and fourth year students in three medical schools in Ontario between February and May of 2005. Questions were primarily closed-ended and consisted of Likert scales. Descriptive and correlative statistics were used to analyze the responses between students of different years and previous research experience. There was a 47% (327/699) overall response rate to the questionnaire. Despite 87% of respondents reporting that they had been involved in some degree of research prior to medical school, 43% report that they have not been significantly involved in research activity during medical school and 24% had no interest in any participation. There were significant differences in the attitudes towards research endeavors during medical school between students in their fourth year compared to second year. The greatest barriers to involvement in research in medical school appear to be time, availability of research mentors, formal teaching of research methodology and the perception that the student would not receive appropriate acknowledgement for work put towards a research project. The results of this self-report survey outline the significant differences in attitudes towards mandatory research as a component of critical inquiry and scholarship in the undergraduate curriculum in Ontario medical schools.

Live lecture versus video podcast in undergraduate medical education: A randomised controlled trial.

Abstract: Background Information technology is finding an increasing role in the training of medical students. We compared information recall and student experience and preference after live lectures and video podcasts in undergraduate medical education.

Global health competencies and approaches in medical education: a literature review

Abstract: Physicians today are increasingly faced with healthcare challenges that require an understanding of global health trends and practices, yet little is known about what constitutes appropriate global health training. A literature review was undertaken to identify competencies and educational approaches for teaching global health in medical schools. Using a pre-defined search strategy, 32 articles were identified; 11 articles describing 15 global health competencies for undergraduate medical training were found. The most frequently mentioned competencies included an understanding of: the global burden of disease, travel medicine, healthcare disparities between countries, immigrant health, primary care within diverse cultural settings and skills to better interface with different populations, cultures and healthcare systems. However, no consensus on global health competencies for medical students was apparent. Didactics and experiential learning were the most common educational methods used, mentioned in 12 and 13 articles respectively. Of the 11 articles discussing competencies, 8 linked competencies directly to educational approaches. This review highlights the imperative to document global health educational competencies and approaches used in medical schools and the need to facilitate greater consensus amongst medical educators on appropriate global health training for future physicians.

Job requirements compared to medical school education: differences between graduates from problem-based learning and conventional curricula

Abstract: Background: Problem-based Learning (PBL) has been suggested as a key educational method of knowledge acquisition to improve medical education. We sought to evaluate the differences in medical school education between graduates from PBL-based and conventional curricula and to what extent these curricula fit job requirements. Methods: Graduates from all German medical schools who graduated between 1996 and 2002 were eligible for this study. Graduates self-assessed nine competencies as required at their day-to-day work and as taught in medical school on a 6-point Likert scale. Results were compared between graduates from a PBL-based curriculum (University Witten/Herdecke) and conventional curricula. Results: Three schools were excluded because of low response rates. Baseline demographics between graduates of the PBL-based curriculum (n = 101, 49% female) and the conventional curricula (n = 4720, 49% female) were similar. No major differences were observed regarding job requirements with priorities for “Independent learning/ working” and “Practical medical skills”. All competencies were rated to be better taught in PBL-based curriculum compared to the conventional curricula (all p < 0.001), except for “Medical knowledge” and “Research competence”. Comparing competencies required at work and taught in medical school, PBL was associated with benefits in “Interdisciplinary thinking” (Δ + 0.88), “Independent learning/working” (Δ + 0.57), “Psycho-social competence” (Δ + 0.56), “Teamwork” (Δ + 0.39) and “Problem-solving skills” (Δ + 0.36), whereas “Research competence” (Δ - 1.23) and “Business competence” (Δ - 1.44) in the PBL-based curriculum needed improvement. Conclusion: Among medical graduates in Germany, PBL demonstrated benefits with regard to competencies which were highly required in the job of physicians. Research and business competence deserve closer attention in future curricular development. Background The framework of medical education has always been a controversial subject. In 1899, Sir William Osler claimed that the complex and growing structure of medical knowledge was associated with difficulties in imparting the necessary skill set for a well-trained physician. Osler concluded that one way to overcome this issue may be

Accreditation council for graduate medical education (ACGME) annual anesthesiology residency and fellowship program review: a "report card" model for continuous improvement

Abstract: Background: The Accreditation Council for Graduate Medical Education (ACGME) requires an annual evaluation of all ACGME-accredited residency and fellowship programs to assess program quality. The results of this evaluation must be used to improve the program. This manuscript describes a metric to be used in conducting ACGMEmandated annual program review of ACGME-accredited anesthesiology residencies and fellowships. Methods: A variety of metrics to assess anesthesiology residency and fellowship programs are identified by the authors through literature review and considered for use in constructing a program “report card.” Results: Metrics used to assess program quality include success in achieving American Board of Anesthesiology (ABA) certification, performance on the annual ABA/American Society of Anesthesiology In-Training Examination, performance on mock oral ABA certification examinations, trainee scholarly activities (publications and presentations), accreditation site visit and internal review results, ACGME and alumni survey results, National Resident Matching Program (NRMP) results, exit interview feedback, diversity data and extensive program/rotation/ faculty/curriculum evaluations by trainees and faculty. The results are used to construct a “report card” that provides a high-level review of program performance and can be used in a continuous quality improvement process. Conclusions: An annual program review is required to assess all ACGME-accredited residency and fellowship programs to monitor and improve program quality. We describe an annual review process based on metrics that can be used to focus attention on areas for improvement and track program performance year-to-year. A “report card” format is described as a high-level tool to track educational outcomes.

Attitudes of US medical trainees towards neurology education: "Neurophobia" - a global issue

Abstract: Several studies in the United Kingdom and Asia have suggested that medical students and residents have particular difficulty in diagnosing and managing patients with neurological problems. Little recent information is available for US trainees. We examined whether students and residents at a US university have difficulty in dealing with patients with neurological problems, identified the perceived sources of these difficulties and provide suggestions for the development of an effective educational experience in neurology. A questionnaire was administered to third and fourth year medical students at a US school of medicine and to residents of an internal medicine residency program affiliated with that school. Perceived difficulties with eight medical specialties, including neurology, were examined. Methods considered to be most useful for learning medicine were documented. Reasons why neurology is perceived as difficult and ways to improve neurological teaching were assessed. 152 surveys were completed. Participation rates varied, with medical students having higher response rates (> 50%) than medical residents (27%-48%). Respondents felt that neurology was the medical specialty they had least knowledge in (p < 0.001) and was most difficult (p < 0.001). Trainees also felt they had the least confidence when dealing with patients with neurological complaints (p < 0.001). Residents felt more competent in neurology than students (p < 0.001). The paramount reasons for perceived difficulties with neurology were the complexity of neuroanatomy, limited patient exposure and insufficient teaching. Transition from pre-clinical to clinical medicine led to a doubling of "poor" ratings for neurological teaching. Over 80% of the respondents felt that neurology teaching could be improved through greater exposure to patients and more bedside tutorials. Medical students and residents at this US medical university found neurology difficult. Although this is consistent with prior reports from Europe and Asia, studies in other universities are needed to confirm generalizability of these findings. The optimal opportunity for improvement is during the transition from preclinical to clinical years. Enhanced integration of basic neurosciences and clinical neurology with emphasis on increased bedside tutorials and patient exposure should improve teaching. Studies are needed to quantify the effect of these interventions on confidence of trainees when dealing with patients presenting with neurological complaints.

Medical student attitudes toward video games and related new media technologies in medical education.

Abstract: Studies in K-12 and college students show that their learning preferences have been strongly shaped by new media technologies like video games, virtual reality environments, the Internet, and social networks. However, there is no known research on medical students' game experiences or attitudes towards new media technologies in medical education. This investigation seeks to elucidate medical student experiences and attitudes, to see whether they warrant the development of new media teaching methods in medicine. Medical students from two American universities participated. An anonymous, 30-item, cross-sectional survey addressed demographics, game play experience and attitudes on using new media technologies in medical education. Statistical analysis identified: 1) demographic characteristics; 2) differences between the two universities; 3) how video game play differs across gender, age, degree program and familiarity with computers; and 4) characteristics of students who play most frequently. 217 medical students participated. About half were female (53%). Respondents liked the idea of using technology to enhance healthcare education (98%), felt that education should make better use of new media technologies (96%), and believed that video games can have educational value (80%). A majority (77%) would use a multiplayer online healthcare simulation on their own time, provided that it helped them to accomplish an important goal. Men and women agreed that they were most inclined to use multiplayer simulations if they were fun (97%), and if they helped to develop skill in patient interactions (90%). However, there was significant gender dissonance over types of favorite games, the educational value of video games, and the desire to participate in games that realistically replicated the experience of clinical practice. Overall, medical student respondents, including many who do not play video games, held highly favorable views about the use of video games and related new media technology in medical education. Significant gender differences in game play experience and attitudes may represent male video game design bias that stresses male cognitive aptitudes; medical educators hoping to create serious games that will appeal to both men and women must avoid this.

Medical students' perceptions of the educational environment at an Iranian Medical Sciences University.

Abstract: Background Students' perceptions of their educational environment have a significant impact on their behavior and academic progress. The aim of this study was to assess the perceptions of medical students concerning their educational environment at Hormozgan University of Medical Sciences in Iran.

Learning styles of medical students, general surgery residents, and general surgeons: implications for surgical education.

Abstract: Surgical education is evolving under the dual pressures of an enlarging body of knowledge required during residency and mounting work-hour restrictions. Changes in surgical residency training need to be based on available educational models and research to ensure successful training of surgeons. Experiential learning theory, developed by David Kolb, demonstrates the importance of individual learning styles in improving learning. This study helps elucidate the way in which medical students, surgical residents, and surgical faculty learn. The Kolb Learning Style Inventory, which divides individual learning styles into Accommodating, Diverging, Converging, and Assimilating categories, was administered to the second year undergraduate medical students, general surgery resident body, and general surgery faculty at the University of Alberta. A total of 241 faculty, residents, and students were surveyed with an overall response rate of 73%. The predominant learning style of the medical students was assimilating and this was statistically significant (p < 0.03) from the converging learning style found in the residents and faculty. The predominant learning styles of the residents and faculty were convergent and accommodative, with no statistically significant differences between the residents and the faculty. We conclude that medical students have a significantly different learning style from general surgical trainees and general surgeons. This has important implications in the education of general surgery residents.

Peer role-play and standardised patients in communication training: a comparative study on the student perspective on acceptability, realism, and perceived effect

Abstract: To assess the student perspective on acceptability, realism, and perceived effect of communication training with peer role play (RP) and standardised patients (SP). 69 prefinal year students from a large German medical faculty were randomly assigned to one of two groups receiving communication training with RP (N = 34) or SP (N = 35) in the course of their paediatric rotation. In both groups, training addressed major medical and communication problems encountered in the exploration and counselling of parents of sick children. Acceptability and realism of the training as well as perceived effects and applicability for future parent-physician encounters were assessed using six-point Likert scales. Both forms of training were highly accepted (RP 5.32 ± .41, SP 5.51 ± .44, n.s.; 6 = very good, 1 = very poor) and perceived to be highly realistic (RP 5.60 ± .38, SP 5.53 ± .36, n.s.; 6 = highly realistic, 1 = unrealistic). Regarding perceived effects, participation was seen to be significantly more worthwhile in the SP group (RP 5.17 ± .37, SP 5.50 ± .43; p < .003; 6 = totally agree, 1 = don't agree at all). Both training methods were perceived as useful for training communication skills (RP 5.01 ± .68, SP 5.34 ± .47; 6 = totally agree; 1 = don't agree at all) and were considered to be moderately applicable for future parent-physician encounters (RP 4.29 ± 1.08, SP 5.00 ± .89; 6 = well prepared, 1 = unprepared), with usefulness and applicability both being rated higher in the SP group (p < .032 and p < .009). RP and SP represent comparably valuable tools for the training of specific communication skills from the student perspective. Both provide highly realistic training scenarios and warrant inclusion in medical curricula. Given the expense of SP, deciding which method to employ should be carefully weighed up. From the perspective of the students in our study, SP were seen as a more useful and more applicable tool than RP. We discuss the potential of RP to foster a greater empathic appreciation of the patient perspective.

Views of junior doctors about whether their medical school prepared them well for work: questionnaire surveys.

Abstract: The transition from medical student to junior doctor in postgraduate training is a critical stage in career progression. We report junior doctors' views about the extent to which their medical school prepared them for their work in clinical practice. Postal questionnaires were used to survey the medical graduates of 1999, 2000, 2002 and 2005, from all UK medical schools, one year after graduation, and graduates of 2000, 2002 and 2005 three years after graduation. Summary statistics, chi-squared tests, and binary logistic regression were used to analyse the results. The main outcome measure was the level of agreement that medical school had prepared the responder well for work. Response rate was 63.7% (11610/18216) in year one and 60.2% (8427/13997) in year three. One year after graduation, 36.3% (95% CI: 34.6, 38.0) of 1999/2000 graduates, 50.3% (48.5, 52.2) of 2002 graduates, and 58.2% (56.5, 59.9) of 2005 graduates agreed their medical school had prepared them well. Conversely, in year three agreement fell from 48.9% (47.1, 50.7) to 38.0% (36.0, 40.0) to 28.0% (26.2, 29.7). Combining cohorts at year one, percentages who agreed that they had been well prepared ranged from 82% (95% CI: 79-87) at the medical school with the highest level of agreement to 30% (25-35) at the lowest. At year three the range was 70% to 27%. Ethnicity and sex were partial predictors of doctors' level of agreement; following adjustment for them, substantial differences between schools remained. In years one and three, 30% and 34% of doctors specified that feeling unprepared had been a serious or medium-sized problem for them (only 3% in each year regarded it as serious). The vast knowledge base of clinical practice makes full preparation impossible. Our statement about feeling prepared is simple yet discriminating and identified some substantial differences between medical schools. Medical schools need feedback from graduates about elements of training that could be improved.

Students' perceptions about the transition to the clinical phase of a medical curriculum with preclinical patient contacts; a focus group study

Abstract: Studies have shown that medical students experience the transition between preclinical and clinical training as a stressful period. They are generally frustrated by their inability to apply their knowledge to solve clinical problems in practice. Preclinical patient contacts may offer a solution to this 'shock of practice.' We studied how students who have had preclinical patient contacts perceive the transition from preclinical to clinical training and, more specifically, how they value these early patient contacts as preparation for learning in clinical practice. A purposive sample of 21 students participated in three focus groups which met twice during their first weeks of clinical clerkships. The interviews were recorded and transcribed literally. Qualitative content analysis of the transcriptions was performed. According to the students, working in clinical practice was enjoyable, motivated them to study and helped them to develop non-analytical reasoning skills. The students experienced stress due to increased working hours and work load, uncertainty as to what was expected of them and self-perceived lack of knowledge. They did not experience a major gap between the preclinical and clinical phase and felt well prepared for the clerkships. The preclinical patient contacts were considered to be instrumental in this. Early patient contacts seem to ameliorate the shock of practice and prepare students for clinical work. The problems mentioned by the students in this study are mainly related to the socialisation process. The results of this study have to be validated by quantitative research.

Does the mind map learning strategy facilitate information retrieval and critical thinking in medical students

Abstract: A learning strategy underutilized in medical education is mind mapping. Mind maps are multi-sensory tools that may help medical students organize, integrate, and retain information. Recent work suggests that using mind mapping as a note-taking strategy facilitates critical thinking. The purpose of this study was to investigate whether a relationship existed between mind mapping and critical thinking, as measured by the Health Sciences Reasoning Test (HSRT), and whether a relationship existed between mind mapping and recall of domain-based information. In this quasi-experimental study, 131 first-year medical students were randomly assigned to a standard note-taking (SNT) group or mind map (MM) group during orientation. Subjects were given a demographic survey and pre-HSRT. They were then given an unfamiliar text passage, a pre-quiz based upon the passage, and a 30-minute break, during which time subjects in the MM group were given a presentation on mind mapping. After the break, subjects were given the same passage and wrote notes based on their group (SNT or MM) assignment. A post-quiz based upon the passage was administered, followed by a post-HSRT. Differences in mean pre- and post-quiz scores between groups were analyzed using independent samples t-tests, whereas differences in mean pre- and post-HSRT total scores and subscores between groups were analyzed using ANOVA. Mind map depth was assessed using the Mind Map Assessment Rubric (MMAR). There were no significant differences in mean scores on both the pre- and post-quizzes between note-taking groups. And, no significant differences were found between pre- and post-HSRT mean total scores and subscores. Although mind mapping was not found to increase short-term recall of domain-based information or critical thinking compared to SNT, a brief introduction to mind mapping allowed novice MM subjects to perform similarly to SNT subjects. This demonstrates that medical students using mind maps can successfully retrieve information in the short term, and does not put them at a disadvantage compared to SNT students. Future studies should explore longitudinal effects of mind-map proficiency training on both short- and long-term information retrieval and critical thinking.

Introducing an online community into a clinical education setting: a pilot study of student and staff engagement and outcomes using blended learning

Abstract: There are growing reasons to use both information and communication functions of learning technologies as part of clinical education, but the literature offers few accounts of such implementations or evaluations of their impact. This paper details the process of implementing a blend of online and face-to-face learning and teaching in a clinical education setting and it reports on the educational impact of this innovation. This study designed an online community to complement a series of on-site workshops and monitored its use over a semester. Quantitative and qualitative data recording 43 final-year medical students' and 13 clinical educators' experiences with this blended approach to learning and teaching were analysed using access, adoption and quality criteria as measures of impact. The introduction of the online community produced high student ratings of the quality of learning and teaching and it produced student academic results that were equivalent to those from face-to-face-only learning and teaching. Staff had mixed views about using blended learning. Projects such as this take skilled effort and time. Strong incentives are required to encourage clinical staff and students to use a new mode of communication. A more synchronous or multi-channel communication feedback system might stimulate increased adoption. Cultural change in clinical teaching is also required before clinical education can benefit more widely from initiatives such as this.

Statistics teaching in medical school: Opinions of practising doctors

Abstract: The General Medical Council expects UK medical graduates to gain some statistical knowledge during their undergraduate education; but provides no specific guidance as to amount, content or teaching method. Published work on statistics teaching for medical undergraduates has been dominated by medical statisticians, with little input from the doctors who will actually be using this knowledge and these skills after graduation. Furthermore, doctor's statistical training needs may have changed due to advances in information technology and the increasing importance of evidence-based medicine. Thus there exists a need to investigate the views of practising medical doctors as to the statistical training required for undergraduate medical students, based on their own use of these skills in daily practice. A questionnaire was designed to investigate doctors' views about undergraduate training in statistics and the need for these skills in daily practice, with a view to informing future teaching. The questionnaire was emailed to all clinicians with a link to the University of East Anglia Medical School. Open ended questions were included to elicit doctors' opinions about both their own undergraduate training in statistics and recommendations for the training of current medical students. Content analysis was performed by two of the authors to systematically categorise and describe all the responses provided by participants. 130 doctors responded, including both hospital consultants and general practitioners. The findings indicated that most had not recognised the value of their undergraduate teaching in statistics and probability at the time, but had subsequently found the skills relevant to their career. Suggestions for improving undergraduate teaching in these areas included referring to actual research and ensuring relevance to, and integration with, clinical practice. Grounding the teaching of statistics in the context of real research studies and including examples of typical clinical work may better prepare medical students for their subsequent career.

Using standardized patients to assess communication skills in medical and nursing Students

Abstract: Background A number of recent developments in medical and nursing education have highlighted the importance of communication and consultation skills (CCS). Although such skills are taught in all medical and nursing undergraduate curriculums, there is no comprehensive screening or assessment programme of CCS using professionally trained Standardized Patients Educators (SPE's) in Ireland. This study was designed to test the content, process and acceptability of a screening programme in CCS with Irish medical and nursing students using trained SPE's and a previously validated global rating scale for CCS.

Undergraduate educational environment, perceived preparedness for postgraduate clinical training, and pass rate on the National Medical Licensure Examination in Japan

Abstract: We investigated the views of newly graduating physicians on their preparedness for postgraduate clinical training, and evaluated the relationship of preparedness with the educational environment and the pass rate on the National Medical Licensure Examination (NMLE). Data were obtained from 2429 PGY-1 physicians-in-training (response rate, 36%) using a mailed cross-sectional survey. The Dundee Ready Education Environment Measure (DREEM) inventory was used to assess the learning environment at 80 Japanese medical schools. Preparedness was assessed based on 6 clinical areas related to the Association of American Medical Colleges Graduation Questionnaire. Only 17% of the physicians-in-training felt prepared in the area of general clinical skills, 29% in basic knowledge of diagnosis and management of common conditions, 48% in communication skills, 19% in skills associated with evidence-based medicine, 54% in professionalism, and 37% in basic skills required for a physical examination. There were substantial differences among the medical schools in the perceived preparedness of their graduates. Significant positive correlations were found between preparedness for all clinical areas and a better educational environment (all p 0.05). Different educational environments among universities may be partly responsible for the differences in perceived preparedness of medical students for postgraduate clinical training. This study also highlights the poor correlation between self-assessed preparedness for practice and the NMLE.

Development and preliminary psychometric properties of a well-being index for medical students

Abstract: Psychological distress is common among medical students but manifests in a variety of forms. Currently, no brief, practical tool exists to simultaneously evaluate these domains of distress among medical students. The authors describe the development of a subject-reported assessment (Medical Student Well-Being Index, MSWBI) intended to screen for medical student distress across a variety of domains and examine its preliminary psychometric properties. Relevant domains of distress were identified, items generated, and a screening instrument formed using a process of literature review, nominal group technique, input from deans and medical students, and correlation analysis from previously administered assessments. Eleven experts judged the clarity, relevance, and representativeness of the items. A Content Validity Index (CVI) was calculated. Interrater agreement was assessed using pair-wise percent agreement adjusted for chance agreement. Data from 2248 medical students who completed the MSWBI along with validated full-length instruments assessing domains of interest was used to calculate reliability and explore internal structure validity. Burnout (emotional exhaustion and depersonalization), depression, mental quality of life (QOL), physical QOL, stress, and fatigue were domains identified for inclusion in the MSWBI. Six of 7 items received item CVI-relevance and CVI-representativeness of ≥0.82. Overall scale CVI-relevance and CVI-representativeness was 0.94 and 0.91. Overall pair-wise percent agreement between raters was ≥85% for clarity, relevance, and representativeness. Cronbach's alpha was 0.68. Item by item percent pair-wise agreements and Phi were low, suggesting little overlap between items. The majority of MSWBI items had a ≥74% sensitivity and specificity for detecting distress within the intended domain. The results of this study provide evidence of reliability and content-related validity of the MSWBI. Further research is needed to assess remaining psychometric properties and establish scores for which intervention is warranted.

The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: an analysis of MRCP(UK) examinations

Abstract: Cronbach's alpha is widely used as the preferred index of reliability for medical postgraduate examinations. A value of 0.8-0.9 is seen by providers and regulators alike as an adequate demonstration of acceptable reliability for any assessment. Of the other statistical parameters, Standard Error of Measurement (SEM) is mainly seen as useful only in determining the accuracy of a pass mark. However the alpha coefficient depends both on SEM and on the ability range (standard deviation, SD) of candidates taking an exam. This study investigated the extent to which the necessarily narrower ability range in candidates taking the second of the three part MRCP(UK) diploma examinations, biases assessment of reliability and SEM. a) The interrelationships of standard deviation (SD), SEM and reliability were investigated in a Monte Carlo simulation of 10,000 candidates taking a postgraduate examination. b) Reliability and SEM were studied in the MRCP(UK) Part 1 and Part 2 Written Examinations from 2002 to 2008. c) Reliability and SEM were studied in eight Specialty Certificate Examinations introduced in 2008-9. The Monte Carlo simulation showed, as expected, that restricting the range of an assessment only to those who had already passed it, dramatically reduced the reliability but did not affect the SEM of a simulated assessment. The analysis of the MRCP(UK) Part 1 and Part 2 written examinations showed that the MRCP(UK) Part 2 written examination had a lower reliability than the Part 1 examination, but, despite that lower reliability, the Part 2 examination also had a smaller SEM (indicating a more accurate assessment). The Specialty Certificate Examinations had small Ns, and as a result, wide variability in their reliabilities, but SEMs were comparable with MRCP(UK) Part 2. An emphasis upon assessing the quality of assessments primarily in terms of reliability alone can produce a paradoxical and distorted picture, particularly in the situation where a narrower range of candidate ability is an inevitable consequence of being able to take a second part examination only after passing the first part examination. Reliability also shows problems when numbers of candidates in examinations are low and sampling error affects the range of candidate ability. SEM is not subject to such problems; it is therefore a better measure of the quality of an assessment and is recommended for routine use.

Validation of the modified Fresno Test: assessing physical therapists' evidence based practice knowledge and skills

Abstract: Health care educators need valid and reliable tools to assess evidence based practice (EBP) knowledge and skills. Such instruments have yet to be developed for use among physical therapists. The Fresno Test (FT) has been validated only among general practitioners and occupational therapists and does not assess integration of research evidence with patient perspectives and clinical expertise. The purpose of this study was to develop and validate a modified FT to assess EBP knowledge and skills relevant to physical therapist (PT) practice. The FT was modified to include PT-specific content and two new questions to assess integration of patient perspectives and clinical expertise with research evidence. An expert panel reviewed the test for content validity. A cross-sectional cohort representing three training levels (EBP-novice students, EBP-trained students, EBP-expert faculty) completed the test. Two blinded raters, not involved in test development, independently scored each test. Construct validity was assessed through analysis of variance for linear trends among known groups. Inter and intra-rater reliability, internal consistency, item discrimination index, item total correlation, and difficulty were analyzed. Among 108 participants (31 EBP-novice students, 50 EBP-trained students, and 27 EBP-expert faculty), there was a statistically significant (p < 0.0001) difference in total score corresponding to training level. Total score reliability and psychometric properties of items modified for discipline-specific content were excellent [inter-rater (ICC (2,1)] = 0.91); intra-rater (ICC (2,1)] = 0.95, 0.96)]. Cronbach's α was 0.78. Of the two new items, only one had strong psychometric properties. The 13-item modified FT presented here is a valid, reliable assessment of physical therapists' EBP knowledge and skills. One new item assesses integration of patient perspective as part of the EBP model. Educators and researchers may use the 13-item modified FT to evaluate PT EBP curricula and physical therapists' EBP knowledge and skills.

Virtual patient simulation: what do students make of it? A focus group study.

Abstract: Background The learners' perspectives on Virtual Patient Simulation systems (VPS) are quintessential to their successful development and implementation. Focus group interviews were conducted in order to explore the opinions of medical students on the educational use of a VPS, the Web-based Simulation of Patients application (Web-SP).

Evaluation of resident attitudes and self-reported competencies in health advocacy.

Abstract: Background The CanMEDS Health Advocate role, one of seven roles mandated by the Royal College of Physicians and Surgeons Canada, pertains to a physician's responsibility to use their expertise and influence to advance the wellbeing of patients, communities, and populations. We conducted our study to examine resident attitudes and self-reported competencies related to health advocacy, due to limited information in the literature on this topic.

Gender differences in specialty preference and mismatch with real needs in Japanese medical students

Abstract: The shortage of doctors and maldistribution among specialties are of great concern in the Japanese health care system. This study investigated specialty preference in medical students of one university, and examined gender differences and compared their preference with real needs. We conducted a self-administered questionnaire including specialty preference in all students of one medical university. Preference was assessed by the five-level probability of their future choice: 1 = very low, 2 = low, 3 = moderate, 4 = high, and 5 = very high. The proportion of 4 or 5 was calculated as the preference rate. The real needs (magnitude of doctor shortage) in the prefecture were drawn from two different surveys. The relationship between the sex-specific preference rate by specialty and real needs was assessed by Spearman's correlation coefficient. Internal medicine showed the highest preference rate, followed by general surgery, pediatrics, and emergency medicine. There was no significant correlation between the preference rates of men and women (r = 0.27, p = 0.34). The preference rates for general surgery, orthopedics, neurosurgery, and emergency medicine were significantly higher in men than in women, while those of obstetrics & gynecology, pediatrics, and dermatology were significantly higher in women. The magnitude of doctor shortage by specialty from two surveys were significantly correlated with the total preference rate and men's preference rate (r = 0.54 to 0.74), but not with women's preference rate (r = 0.06 and 0.32). This study elucidated not only gender differences in specialty preference but also the relationship to real needs. Critical gender differences and mismatch with real needs were found in women. In addition to traditional gender roles and insufficient support for women's participation in Japan, gender differences and mismatch influence the current and future maldistribution of specialties. Systematic changes in the working environment in medical society are required to solve these problems.

Self-development groups reduce medical school stress: a controlled intervention study

Abstract: Background: High stress levels and mental health problems are common among medical students and there is a lack of studies on group interventions that aim to reduce such distress during medical school. Methods: A full class of students (n = 129) participated in group sessions during their third year of medical school in Bergen, Norway. The subsequent third-year class (n = 152) acted as control group, in order to create a quasiexperimental design. Two types of group intervention sessions were offered to the first class. One option was selfdevelopment groups led by trained group psychotherapists. Alternatively, students could choose discussion groups that focused on themes of special relevance to doctors, led by experienced general practitioners. The intervention comprised of 12 weekly group sessions each lasting 90 minutes. Data were gathered before the intervention (T1), and three months post intervention (T2). Distress was measured using the Perceived Medical School Stress (PMSS) and Symptom Check List-5 (SCL-5) assessments. Results: The intervention group showed a significant reduction in PMSS over the observation period. The subsequent year control group stayed on the same PMSS levels over the similar period. The intervention was a significant predictor of PMSS reduction in a multiple regression analysis adjusted for age and sex, β = -1.93 (-3.47 to -0.38), P = 0.02. When we analysed the effects of self-development and discussion groups with the control group as reference, selfdevelopment group was the only significant predictor of PMSS reduction, β = -2.18 (-4.03 to -0.33), P = 0.02. There was no interaction with gender in our analysis. This implicates no significant difference between men and women concerning the effect of the self-development group. There was no reduction in general mental distress (SCL-5) over this period. Conclusion: A three-month follow-up showed that the intervention had a positive effect on perceived medical school stress among the students, and further analyses showed this was due to participation in self-development groups.

A comparative evaluation of the effect of internet-based CME delivery format on satisfaction, knowledge and confidence

Abstract: Background Internet-based instruction in continuing medical education (CME) has been associated with favorable outcomes. However, more direct comparative studies of different Internet-based interventions, instructional methods, presentation formats, and approaches to implementation are needed. The purpose of this study was to conduct a comparative evaluation of two Internet-based CME delivery formats and the effect on satisfaction, knowledge and confidence outcomes.

Climate change: what competencies and which medical education and training approaches?

Abstract: Much research has been devoted to identifying healthcare needs in a climate-changing world. However, while there are now global and national policy statements about the importance of health workforce development for climate change, little has been published about what competencies might be demanded of practitioners in a climate-changing world. In such a context, this debate and discussion paper aims to explore the nature of key competencies and related opportunities for teaching climate change in medical education and training. Particular emphasis is made on preparation for practice in rural and remote regions likely to be greatly affected by climate change. The paper describes what kinds of competencies for climate change might be included in medical education and training. It explores which curricula, teaching, learning and assessment approaches might be involved. Rather than arguing for major changes to medical education and training, this paper explores well established precedents to offer practical suggestions for where a particular kind of literacy--eco-medical literacy--and related competencies could be naturally integrated into existing elements of medical education and training. The health effects of climate change have, generally, not yet been integrated into medical education and training systems. However, the necessary competencies could be taught by building on existing models, best practice and innovative traditions in medicine. Even in crowded curricula, climate change offers an opportunity to reinforce and extend understandings of how interactions between people and place affect health.

Undergraduate medical student perceptions and use of Evidence Based Medicine: A qualitative study

Abstract: Many medical schools teach the principles of Evidence Based Medicine (EBM) as a subject within their medical curriculum. Few studies have explored the barriers and enablers that students experience when studying medicine and attempting to integrate EBM in their clinical experience. The aim of this study was to identify undergraduate medical student perceptions of EBM, including their current use of its principles as students and perceived future use as clinicians. Third year medical students were recruited via email to participate in focus group discussions. Four focus groups were conducted separately across four hospital sites. All focus groups were conducted by the same facilitator. All discussions were transcribed verbatim, and analysed independently by the two authors according to the principles of thematic analysis. Focus group discussions were conducted with 23 third-year medical students, representing three metropolitan and one rural hospital sites. Five key themes emerged from the analysis of the transcripts: (1) Rationale and observed use of EBM in practice, (2) Current use of EBM as students, (3) Perceived use of EBM as future clinicians, (4) Barriers to practicing EBM, and (5) Enablers to facilitate the integration of EBM into clinical practice. Key facilitators for promoting EBM to students include competency in EBM, mentorship and application to clinical disciplines. Barriers to EBM implementation include lack of visible application by senior clinicians and constraints by poor resourcing. The principles and application of EBM is perceived by medical students to be important in both their current clinical training and perceived future work as clinicians. Future research is needed to identify how medical students incorporate EBM concepts into their clinical practice as they gain greater clinical exposure and competence.