Topic
Intra-rater reliability
About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.
Papers published on a yearly basis
Papers
More filters
TL;DR: Although ICC, SEM and MDC showed less between-session reproducibility than within-session and inter-rater comparisons, the limits of agreement were larger in inter- rater comparisons and in future studies care must be taken with variables collected on different days and with mandibular movements in the frontal and transversal planes.
8 citations
TL;DR: A valid, reliable and standardized assessment tool for evaluating the basic microsurgical skills of residents in a microsurgery laboratory, to get them well prepared before entering the surgical realm of ophthalmology.
Abstract: More and more concerns have been arisen about the ability of new medical graduates to meet the demands of today’s practice environment. In this study, we wanted to develop a valid, reliable and standardized assessment tool for evaluating the basic microsurgical skills of residents in a microsurgery laboratory, to get them well prepared before entering the surgical realm of ophthalmology. Twenty-three experts who have teaching experience reviewed the assessment scale. Constructive comments were incorporated to ensure face and content validity. Twenty-one attendings from different specialties then graded eight corneal rupture suturing videos with the scale to investigate interrater reliability. Fourteen of them graded the same videos 3 months later to investigate intrarater reliability (repeatability). A total of 280 assessment scales were completed. All the ICC values of interrater reliability were greater than 0.8 with 75% data greater than 0.9 (range 0.860–0.976). All the ICC values of intrarater reliability (repeatability) were also greater than 0.8 with 63% data greater than 0.9 (range 0.833–0.954). The assessment scale we developed is valid and reliable. This tool could be useful to ensure that junior residents achieve a certain level of microsurgical technique in a laboratory environment before training in the operation room. Hopefully, this tool will provide a structured template for other residency programs to assess their residents for basic microsurgical skills.
8 citations
TL;DR: The reliable and valid 4‐item symmetry score served for the diagnosis, evaluation, and follow‐up of infants aged 3 to 6 months with infantile postural and movement asymmetries and showed the positive effect of a single manual medical treatment session along with a home program focusing on “tummy time.”
8 citations
TL;DR: It is concluded that for case report assessment to be useful educationally ratings must be obtained from numerous examiners on repeated occasions.
Abstract: Summary. Assessment of a case report allows for evaluation of the student's information-collecting ability, clinical reasoning and written communication skills. Intrarater reliability of case report evaluation in second-year internal medicine was evaluated and found unacceptably low even after educational interventions. We conclude that for case report assessment to be useful educationally ratings must be obtained from numerous examiners on repeated occasions.
8 citations
TL;DR: It is suggested that GM is more reliable than VE is when used by experienced examiners, and these findings support the continued use of GM for first metatarsophalangeal joint dorsiflexion assessment.
Abstract: Visual estimation (VE) and goniometry measurements (GM) are commonly used to assess first metatarsophalangeal joint (MTPJt) dorsiflexion. The purpose of this study was to determine the intra and interrater reliability of VE and GM and to establish if reliability was influenced by the experience of an examiner. On two separate occasions, ten experienced and ten inexperienced examiners evaluated three clinical, real size photographs. Experienced examiners demonstrated excellent intra and interrater reliability for GM (Intraclass correlation coefficient [ICC] >0.953; standard error of measurement [SEM] 1.8° – 2.5°), compared to inexperienced examiners who showed fair-to-good intra and interrater reliability (ICC 0.322 - 0.597; SEM, 2° - 3°). For VE, inexperienced examiners demonstrated fair-to-good interrater and excellent intrarater reliability (ICC 0.666 – 0.808), and was higher compared to the experienced examiners (ICC 0.167 – 0.672). The SEM (2.8°- 4.4°) was less varied than that of experienced examiners (SEM 3.8° – 6.4°) for VE, but neither group’s SEM were clinically acceptable. Whilst minimal differences between intra and interrater reliability of GM and VE are noted, the study suggests that GM is more reliable than VE when used by experienced examiners. These findings support continued use of GM for first MTPJt dorsiflexion assessment.
8 citations