การวจยเชงคณภาพ เปนเครองมอสำคญอยางหนงสำหรบทำความเขาใจสงคมและพฤตกรรมมนษย การวจยแบบการสรางทฤษฎจากขอมล กเปนหนงในหลายระเบยบวธการวจยเชงคณภาพทกำลงไดรบความสนใจ และเปนทนยมเพมสงขนเรอยๆ จากนกวชาการ และนกวจยในสาขาสงคมศาสตร และศาสตรอนๆ เชน พฤตกรรมศาสตร สงคมวทยา สาธารณสขศาสตร พยาบาลศาสตร จตวทยาสงคม ศกษาศาสตร รฐศาสตร และสารสนเทศศกษา ดงนน หนงสอเรอง “ConstructingGrounded Theory: A Practical Guide through Qualitative Analysis” หรอ “การสรางทฤษฎจากขอมล:แนวทางการปฏบตผานการวเคราะหเชงคณภาพ” จะชวยใหผอานมความรความเขาใจถงพฒนาการของปฏบตการวจยแบบสรางทฤษฎจากขอมล ตลอดจนแนวทาง และกระบวนการปฏบตการวจยอยางเปนระบบ จงเปนหนงสอทควรคาแกการอานโดยเฉพาะนกวจยรนใหม เพอเปนแนวทางในการนำความรความเขาใจไประยกตในงานวจยของตน อกทงนกวจยผเชยวชาญสามารถอานเพอขยายมโนทศนดานวจยใหกวางขวางขน

Constructing Grounded Theory: A Practical Guide through Qualitative Analysis

The power of feedback.

Pedagosko i psiholosko testiranje i procjenjivanje spadaju među najvažnije doprinose znanosti o ponasanju nasem drustvu i pružaju temeljna i znacajna poboljsanja u odnosu na ranije postupke. Iako se ne može ustvrditi da su svi testovi dovoljno usavrseni niti da su sva testiranja razborita i korisna, postoji velika kolicina informacija koje ukazuju na ucinkovitost kvalitetnih instrumenata u onim situacijama u kojima je njihovo koristenje potkrijepljeno validacijskim podacima. Pravilna upotreba testova može dovesti do boljih odluka o pojedincima i programima nego sto bi to bio slucaj bez njihovog koristenja, a također i ukazati na put za siri i pravedniji pristup obrazovanju i zaposljavanju. Međutim, losa upotreba testova može dovesti do zamjetne stete nanesene ispitanicima i drugim sudionicima u procesu donosenja odluka na temelju testovnih podataka. Cilj Standarda je promoviranje kvalitetne i eticne upotrebe testova te uspostavljanje osnovice za ocjenu kvalitete postupaka testiranja. Svrha objavljivanja Standarda je uspostavljanje kriterija za evaluaciju testova, provedbe testiranja i posljedica upotrebe testova. Iako bi evaluacija prikladnosti testa ili njegove primjene trebala ovisiti prvenstveno o strucnim misljenjima, Standardi pružaju okvir koji osigurava obuhvacanje svih relevantnih pitanja. Bilo bi poželjno da svi autori, sponzori, nakladnici i korisnici profesionalnih testova usvoje Standarde te da poticu druge da ih također prihvate.

Standards for educational and psychological testing

The culture of education

Doing qualitative research: a practical handbook, by David Silverman, Los Angeles, Sage, 2010, 456 pp., AU$65.00, ISBN 978-1-84860-033-1, ISBN 978-1-94960-034-8. Available in Australia and New Zeal...

Doing qualitative research: a practical handbook

Objectives Mounting evidence suggests that trainees acquire psychomotor skills better when they are allowed self-guided access to instructional material and when they set goals that are related to performance processes rather than performance outcomes. The present study assessed whether self-guided access to instruction and the setting of process goals lead to better acquisition of clinical technical skills.



Methods  To learn wound closure skills, 48 medical students were randomly assigned to one of four groups in a 2 × 2 study design. Self-guided participants were able to access the instructional video freely, whereas control participants were restricted to watching only those video segments accessed by their matched self-guided participant. Each group was further divided into two subgroups, comprising a process goal subgroup, where participants set goals focused on performance mechanisms, and an outcome goal subgroup, where participants set goals focused on performance products. Performance on pre-, post-, retention and transfer tests was assessed with hand motion measures and expert evaluations. Group differences were evaluated using one-way anovas.



Results  The self-guided group with process goals showed greater skill retention than its matched control group, whereas the self-guided group with outcome goals did not. Furthermore, the groups with process goals performed better on the transfer test than the outcome goal groups. Outcome goal participants accessed the instructional video most frequently.



Conclusions  Our findings advance the study of independent learning in medical education. Trainees used interactive and structured instructional materials to effectively self-guide their learning of clinical technical skills. However, a self-guided benefit was demonstrated only when trainees set process goals.

How effective is self‐guided learning of clinical technical skills? It’s all about process

Context

Self-regulated learning (SRL) requires an active learner who has developed a set of processes for managing the achievement of learning goals. Simulation-based training is one context in which trainees can safely practise learning how to learn.



Objectives

The purpose of the present study was to evaluate, in the simulation-based training context, the effectiveness of interventions designed to support trainees in SRL activities. We used the social-cognitive model of SRL to guide a systematic review and meta-analysis exploring the links between instructor supervision, supports or scaffolds for SRL, and educational outcomes.



Methods

We searched databases including MEDLINE and Scopus, and previous reviews, for material published until December 2011. Studies comparing simulation-based SRL interventions with another intervention for teaching health professionals were included. Reviewers worked independently and in duplicate to extract information on learners, study quality and educational outcomes. We used random-effects meta-analysis to compare the effects of supervision (instructor present or absent) and SRL educational supports (e.g. goal-setting study guides present or absent).



Results

From 11 064 articles, we included 32 studies enrolling 2482 trainees. Only eight of the 32 studies included educational supports for SRL. Compared with instructor-supervised interventions, unsupervised interventions were associated with poorer immediate post-test outcomes (pooled effect size: −0.34, p = 0.09; n = 19 studies) and negligible effects on delayed (i.e. > 1 week) retention tests (pooled effect size: 0.11, p = 0.63; n = 8 studies). Interventions including SRL supports were associated with small benefits compared with interventions without supports on both immediate post-tests (pooled effect size: 0.23, p = 0.22; n = 5 studies) and delayed retention tests (pooled effect size: 0.44, p = 0.067; n = 3 studies).



Conclusions

Few studies in the simulation literature have designed SRL training to explicitly support trainees’ capacity to self-regulate their learning. We recommend that educators and researchers shift from thinking about SRL as learning alone to thinking of SRL as comprising a shared responsibility between the trainee and the instructional designer (i.e. learning using designed supports that help prepare individuals for future learning).

Self-regulated learning in simulation-based training: a systematic review and meta-analysis.

Comparison of expert instruction and computer-based video training in teaching fundamental surgical skills to medical students

In order to construct and evaluate the validity argument for the Objective Structured Assessment of Technical Skills (OSATS), based on Kane’s framework, we conducted a systematic review We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus, and selected reference lists through February 2013 Working in duplicate, we selected original research articles in any language evaluating the OSATS as an assessment tool for any health professional We iteratively and collaboratively extracted validity evidence from included articles to construct and evaluate the validity argument for varied uses of the OSATS Twenty-nine articles met the inclusion criteria, all focussed on surgical technical skills assessment We identified three intended uses for the OSATS, namely formative feedback, high-stakes assessment and program evaluation Following Kane’s framework, four inferences in the validity argument were examined (scoring, generalization, extrapolation, decision) For formative feedback and high-stakes assessment, there was reasonable evidence for scoring and extrapolation However, for high-stakes assessment there was a dearth of evidence for generalization aside from inter-rater reliability data and an absence of evidence linking multi-station OSATS scores to performance in real clinical settings For program evaluation, the OSATS validity argument was supported by reasonable generalization and extrapolation evidence There was a complete lack of evidence regarding implications and decisions based on OSATS scores In general, validity evidence supported the use of the OSATS for formative feedback Research to provide support for decisions based on OSATS scores is required if the OSATS is to be used for higher-stakes decisions and program evaluation

/pdf/constructing-a-validity-argument-for-the-objective-z2r9nmtw12.pdf

Constructing a validity argument for the Objective Structured Assessment of Technical Skills (OSATS): a systematic review of validity evidence

Context

Evidence suggests that clinicians may not be learning effectively from all facets of their practice, potentially because their training has not fully prepared them to do so. To address this gap, we argue that there is a need to identify systems of instruction and assessment that enhance clinicians’ ‘preparation for future learning’. Preparation for future learning (PFL) is understood to be the capacity to learn new information, to use resources effectively and innovatively, and to invent new strategies for learning and problem solving in practice.



Current state

Education researchers have developed study designs that use dynamic assessments to measure what trainees have acquired in the past, as well as what they are able to learn in the present. More recently, researchers have also started to emphasise and measure whether and how trainees take action to gain the information they need to learn. Knowing that there are study designs and emerging metrics for assessing PFL, the next question is how to design instruction that helps trainees develop PFL capacities. Although research evidence is still accumulating, the current evidence base suggests training that encourages ‘productive failure’ through guided discovery learning (i.e. where trainees solve problems and perform tasks without direct instruction, though often with some form of feedback) creates challenging conditions that enhance learning and equip trainees with PFL-related behaviours.



Conclusions

Preparation for future learning and the associated capacity of being adaptive as one learns in and from training and clinical practice have been missed in most contemporary training and assessment systems. We propose a research agenda that (i) explores how real-world adaptive expert activity unfolds in the health care workplace to inform the design of instruction for developing PFL, (ii) identifies measures of behaviours that relate to PFL, and (iii) addresses potential sociocultural barriers that limit clinicians’ opportunities to learn from their daily practice.

Ryan Brydges

Papers

How effective is self‐guided learning of clinical technical skills? It’s all about process

Self-regulated learning in simulation-based training: a systematic review and meta-analysis.

Comparison of expert instruction and computer-based video training in teaching fundamental surgical skills to medical students

Constructing a validity argument for the Objective Structured Assessment of Technical Skills (OSATS): a systematic review of validity evidence

Preparation for future learning: a missing competency in health professions education?