Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Reliability of maximal voluntary isometric contraction testing in a multicenter study of patients with amyotrophic lateral sclerosis

Abstract: Maximal voluntary isometric contraction (MVIC) is becoming widely used for monitoring disease progression in amyotrophic lateral sclerosis (ALS). We evaluated the variability of MVIC in a large multicenter (29 sites) drug trial in ALS. Intra- and interrater variability were assessed twice during the 19-month study. Intrarater reliability increased from the first to the second test, approaching the reliability reported for a single experienced clinical evaluator, but interrater reliability did not. Multiple clinical evaluators in a single site increased the variability of MVIC measurements. Rigorous quality assurance standards and monitoring of clinical evaluators should be incorporated into the design of multicenter studies using MVIC, since low variability is necessary to detect a modest treatment effect.

Age-Related Vascularization and Ossification of Joints in Children: An International Pilot Study to Test Multiobserver Ultrasound Reliability.

Abstract: Objective To determine the intra- and inter-observer reliability of ultrasound (US)-detected age-related joint vascularization and ossification grading in healthy children. Methods Following standardized image acquisition and machine setting protocols, 10 international US experts examined four joints (wrist, second metacarpophalangeal joint, knee, and ankle) in 12 healthy children (divided into four age groups: 2–4, 5–8, 9–12, and 13–16 years). Grey-scale was used to detect the ossification grade, and power Doppler (PD) US was used to detect physiological vascularization. Ossification was graded from grade 0 (no ossification) to grade 3 (complete ossification). A positive PD signal was defined as any PD signal inside the joint. Kappa statistics were applied for intra- and inter-observer reliability. Results According to the specific joint and age, up to four solitary PD signals (mean, 1.5) were detected within each joint area with predominant localization of the physiological vascularization in specific anatomic positions: fat pad, epiphysis, physis, and short bone cartilage. The kappa values for ossification grading were 0.87 (range, 0.85–0.91) and 0.58 for intra- and inter-observer reliability, respectively. The bias-adjusted kappa values for intra- and inter-observer reliability were 0.71 (range, 0.44–1.00) and 0.69, respectively. Conclusion Detection of normal findings (i.e., grading of physiological ossification during skeletal maturation and identification of physiological vessels) can be highly reliable by using clear definitions and a standardized acquisition protocol. These data will permit development of a reliable and standardized US approach for evaluating paediatric joint pathologies. This article is protected by copyright. All rights reserved.

Interrater and Intrarater Reliability of Transverse Abdominal and Lumbar Multifidus Muscle Thickness in Subjects With and Without Low Back Pain

Abstract: Study Design Two-group, repeated-measures reliability study Objectives To determine interrater and intrarater reliability of ultrasound measurements of transverse abdominal (TrA) and lumbar multifidus (LM) muscle thickness, during rest and contraction, in subjects with low back pain (LBP) and healthy subjects over 3 consecutive days, performed by an experienced and a novice rater Background Previous reliability studies of TrA or LM thickness did not simultaneously account for muscle state, rater experience, and multiday assessment in large subject samples Methods The 2 raters measured TrA and LM thickness on 3 consecutive days in 42 healthy subjects and 56 subjects with LBP, during rest and contraction, and calculated the percent thickness change from rest to contraction Intraclass correlation coefficients (ICC2,k) and 95% minimal detectable change in thickness were derived for a single measure (day 1) and an average measure (days 1–3) Results The interrater ICC2,1 values for single-measure thickness

Interrater and intrarater reliability of common clinical standing balance tests for people with hip osteoarthritis.

Abstract: Background Hip osteoarthritis (OA) is a common musculoskeletal condition affecting older individuals. Clinical balance tests are frequently used to assess standing balance in these people. There is insufficient information regarding the reliability of these tests. Objective The aim of this study was to estimate reliability and measurement error of 4 common clinical standing balance tests in people with hip OA. Design A prospective study was conducted with repeated measures between 2 independent raters within 1 session and within 1 rater over a 1-week interval. Methods Thirty people with hip OA were evaluated. Reliability was estimated for the Four-Square Step Test, Step Test, Functional Reach Test, and Timed Single-Leg Stance Test using intraclass correlation coefficients (ICC [2,1]). Measurement error was expressed as standard error of measurement and minimal detectable change. Results The Four-Square Step Test, Step Test, and Timed Single-Leg Stance Test were sufficiently reliable between raters (ICC=.85–.94, lower 1-sided 95% confidence interval [95% CI]=.71–.89), whereas the Step Test (standing on study limb) and Timed Single-Leg Stance Test (standing on nonstudy limb) were sufficiently reliable within a rater over a 1-week interval (ICC=.91, lower 1-sided 95% CI=.80–.83). The Step Test (standing on study limb) and Timed Single-Leg Stance Test (standing on nonstudy limb) achieved optimal levels of reliability (ICC >.90, lower 1-sided 95% CI >.70), with acceptable measurement error (<10%) for clinical outcome measures. The Functional Reach Test was not sufficiently reliable. A ceiling effect was detected for the Timed Single-Leg Stance Test. Limitations Reliability was assessed only between 2 raters during a single session and within 1 rater over a 1-week interval, which limits generalizability. Conclusions The Step Test (standing on study limb) is recommended as a highly reliable test with acceptable measurement error for assessing standing balance in people with hip OA.