Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Inter and intra-rater reliability and minimal detectable difference of Movement Disorder-Childhood Rating Scale.

Abstract: BACKGROUND Movement Disorder-Childhood Rating Scales (MD-CRS) have been designed in two forms (0-3 and 4-18 years) to accurately evaluate various movement disorders in children. AIM The aim of this study is to evaluate the MD-CRS reliability when used by clinicians and professionals of rehabilitation after a one-day training on scoring it. DESIGN This is a measurement-focused study of video-recorded sessions. SETTING Video session carried out inpatient and outpatient. POPULATION Children with different types of movement disorders. METHODS After brief training in scoring MD-CRS, five health professionals (a resident doctor, a child neurologist and three physical therapists) independently scored 40 patient videotapes, of children with movement disorders for inter-rater reliability. In addition, the resident doctor scored 80 videos of 40 patients evaluated twice for intra-rater reliability. Reliability was assessed by Intraclass Correlation Coefficient (ICC) and was calculated separately for the two forms of the scale and for each score (Index I, Index II and Global Index). Standard Error of Measurement (SEM) and Minimal Detectable Difference (MDD) were also calculated. RESULTS For both forms, inter-rater reliability of Global Index and Index I were good with an ICC ranged between 0.83 and 0.95. Instead, results of Index II were substantially moderate for both forms, with an ICC of 0.53 and 0.57, respectively. Intra-rater reliability for all Indexes in both forms was substantial or almost perfect, with values of ICCs ranging from 0.74 to 0.99. MDD values were between 0.05 and 0.17. CONCLUSIONS MD-CRS 0-3 and MD-CRS 4-18 remain reliable clinical measurement tools for evaluation of movement disorders in developmental age when used by clinicians and professionals of rehabilitation after a specific short training. CLINICAL REHABILITATION IMPACT MD-CRS 0-3 and MD-CRS 4-18 appear to be a promising outcome measurement tool in large scale studies with children and adolescents affected by various movement disorders either to verify natural history of the disorder or to plan pharmacological and/or surgical intervention programs.

Limited intrarater and interrater reliability of acute ligamentous ankle injuries on 3 T MRI

Abstract: Objectives To determine the diagnostic reliability of the Schneck grading system for acute ligamentous injuries of (1) the three major ligamentous ankle complexes, (2) the individual ankle ligaments and (3) the Sikka classification for syndesmosis injury. Methods All acute ankle injuries in adult athletes (≥18 years), presenting to the outpatient department of a specialised Orthopaedic and Sports Medicine Hospital, within 7 days postinjury were screened for inclusion. Ankle injuries were excluded if imaging demonstrated a frank ankle fracture or if the 3 T MRI study could not be acquired within 10 days postinjury. Two radiologists graded the three major ligamentous complexes (lateral ankle complex, deltoid complex and syndesmosis complex) and their comprising individual ligaments according the four-grade Schneck grading system. Syndesmotic injuries were classified according the four-grade Sikka classification for consequent injury of the individual syndesmosis ligaments and the deltoid complex. Agreement and kappa (K) statistics were calculated to determine intrarater and interrater reliability. Results Between September 2016 and September 2018, a total of 92 MR scans were obtained (87 patients). Interrater and intrarater reliability of the Schneck grading system was moderate to substantial for the lateral ankle complex (K=0.47–0.76), fair to almost perfect for the syndesmosis complex (K=0.37–0.89) and fair to moderate for the deltoid complex (K=0.14–0.51). For the individual ligaments, kappa values ranged from moderate to substantial for the anterior talofibular ligament (ATFL) (K=0.55–0.73), fair to substantial for the calcaneofibular ligament (K=0.31–0.62) and fair to almost perfect for the anteroinferior tibiofibular ligament (AITFL) (K=0.36–0.89). Diagnostic reliability of the Sikka classification ranged from moderate to almost perfect (K=0.51–0.95). Conclusions Grading of the three major ligamentous complexes and of the individual ankle ligaments according the Schneck grading system resulted in limited diagnostic reliability. When dichotomised for the presence of complete discontinuity, the interrater reliability of the Schneck grading system improved to substantial and almost perfect for the ATFL and AITFL, respectively. Classification of syndesmosis injury according the Sikka classification resulted in moderate interrater reliability.

Intra-rater reliability of transversus abdominis measurement by a novice examiner: Comparison of “freehand” to “probe force device” method of real-time ultrasound imaging:

Abstract: A “free hand” real-time-ultrasound method is commonly applied to measure transversus abdominis. Potentially, this increases transversus abdominis measurement error due to uncontrolled variability i...

Reliabilität der transkutanen Sauerstoffpartialdruckmessung an der unteren Extremität

Abstract: AIM Measurement of transcutaneous oxygen tension is increasingly used to determine the appropriate level of amputation in patients with vascular disease. The purpose of the present study was to analyze the intra- and interrater reliability of transcutaneous oxygen [tcpO (2)] measurements in a homogeneous study group. METHOD Five investigators assessed the transcutaneous oxygen tension of both lower legs of seven persons in a fixed setting. Assessment was repeated with the same examiners and the same examinees after 24 hours. TcpO (2) was measured at the posterior aspect of the lower leg twenty centimeters below the knee joint line. The TCM 400 Monitoring System (Radiometer Medical AIS, Bronshoj, Denmark) was used. Statistical analysis of the intra- and interrater reliability was performed with the Spearman coefficient of correlation. RESULTS An overall mean of 56.2 +/- 10.6 mmHg was found. For the first examination, a mean of 55.3 +/- 10.6 mmHg was observed, whereas for the second examination it was 57.0 +/- 10.5 mmHg. Analysis of intrarater reliability showed a coefficient of correlation of r (s) = 0.56 (p < 0.0001). For interrater reliability, we found coefficients of correlation ranging from r (s) = 0.20 (p = 0.20) to r (s) = 0.69 (p = 0.0004). CONCLUSION Analysis of transcutaneous oxygen tension measurements performed by different investigators in a fixed setting revealed a non- homogeneous intra- and interrater reliability, which should be taken into account prior to initiating therapy.