Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Walking Index for Spinal Cord Injury version II in acute spinal cord injury: reliability and reproducibility.

Abstract: Administration of the walking index for SCI (WISCI) II is recommended to assess walking in spinal cord injury (SCI) patients. Determining the reliability and reproducibility of the WISCI II in acute SCI would be invaluable. The objective of this study is to assess the reliability and reproducibility of the WISCI II in patients with traumatic, acute SCI. Test–retest analysis and calculation of reliability and smallest real difference (SRD). SCI unit of a rehabilitation hospital. Thirty-three patients, median age 44 years, median time since onset of SCI 40 days. Level: 20 cervical, 8 thoracic, 5 lumbar; ASIA (American Spinal Injury Association) impairment scale (AIS) grade: 32 D/1 C. Assessment of maximum WISCI II levels by two trained, blinded raters to evaluate interrater (IRR) and intrarater reliability. The intrarater reliability was 0.999 for therapists A and 0.979 for therapists B, for the maximum WISCI II level. The IRR for the maximum WISCI II score was 0.996 on day 1 and 0.975 on day 2. The SRD for the maximum WISCI II score was 1.147 for tetraplegics and 1.682 for paraplegics. These results suggest that a change of two WISCI II levels could be considered real. The WISCI II has high IRR and intrarater reliability and good reproducibility in the acute and subacute phase when administered by trained raters.

Evaluating the reliability of the human factors analysis and classification system

Abstract: INTRODUCTION: This paper examines the reliability of the Human Factors Analysis and Classification System (HFACS) as tool for coding human error and contributing factors associated with accidents and incidents. METHODS: A systematic review of articles published across a 13-yr period between 2001 and 2014 revealed a total of 14 peer-reviewed manuscripts that reported data concerning the reliability of HFACS. RESULTS: Results revealed that the majority of these papers reported acceptable levels of interrater and intrarater reliability. CONCLUSION: Reliability levels were higher with increased training and sample sizes. Likewise, when deviations from the original framework were minimized, reliability levels increased. Future applications of the framework should consider these factors to ensure the reliability and utility of HFACS as an accident analysis and classification tool. Cohen TN, Wiegmann DA, Shappell SA. Evaluating the reliability of the Human Factors Analysis and Classification System. Aerosp Med Hum Perform. 2015; 86(8):728-735. Language: en

Reproducibility and reference values of inclinometric balance and isometric trunk muscle strength measurements in Finnish young adults.

Abstract: The objectives of the study were to evaluate the reproducibility of the maximal isometric trunk muscle strength testing and inclinometric method to measure body sway and to establish reference values for these measurements in young Finnish adults. Reproducibility was assessed with 2 repeated measurements. Reference values are based on the cross-sectional cohort data. Maximal isometric trunk extension, flexion, and rotations were measured in standing posture. Body sway was measured with inclinometric method. The subjects (N = 874) belonged to a subcohort of the Northern Finland Birth Cohort 1986. Intrarater reliability was assessed with 19 volunteers from the birth cohort, and interrater reliability was assessed with 15 young healthy adults. Intrarater reliability intraclass correlation coefficients (ICCs) for body sway measurements ranged from 0.39 to 0.74 and for trunk muscle strength measurements from 0.84 to 0.94. Interrater reliability ICC for body sway ranged from 0.61 to 0.85 and for trunk muscle strength from 0.84 to 0.88. Maximal muscle strength was better in men than in women, but extensor to flexor ratio was higher in women. Women had significantly better values in all body sway measurements than men. Our study showed a remarkable biological variation in isometric trunk muscle strength and inclinometric body sway. Although ICC analysis indicated good reliability, the Bland and Altman analysis revealed quite wide range of measurement error. However, reproducibility of isometric trunk muscle testing is comparable to other measurements of trunk muscle function in use. Reference values collected in our study offer valuable normative data for future studies and can be used as a tool when assessing physical capacity of healthy subjects or patients with different pathological conditions.

Reliability assessment of the Biffl Scale for blunt traumatic cerebrovascular injury as detected on computer tomography angiography.

Abstract: OBJECTIVE Blunt traumatic cerebrovascular injury (TCVI) represents structural injury to a vessel due to high-energy trauma. The Biffl Scale is a widely accepted grading scheme for these injuries that was developed using digital subtraction angiography. In recent years, screening CT angiography (CTA) has been used to identify patients with TCVI. The reliability of this scale, with injuries assessed using CTA, has not yet been determined. METHODS Seven independent raters, including 2 neurosurgeons, 2 neuroradiologists, 2 neurosurgical residents, and 1 neurosurgical vascular fellow, independently reviewed each presenting CTA of the neck performed in 40 patients with confirmed TCVI and assigned a Biffl grade. Ten images were repeated to assess intrarater reliability, for a total of 50 CTAs. Fleiss' multirater kappa (κ) and interclass correlation were calculated as a measure of interrater reliability. Weighted Cohen's κ was used to assess intrarater reliability. RESULTS Fleiss' multirater κ was 0.65 (95% CI 0.61-0.69), indicating substantial agreement as to the Biffl grade assignment among the 7 raters. Interclass correlation was 0.82, demonstrating excellent agreement among the raters. Intrarater reliability was perfect (weighted Cohen's κ = 1) in 2 raters, and near perfect (weighted Cohen's κ > 0.8) in the remaining 5 raters. CONCLUSIONS Grading of TCVI with CTA using the Biffl Scale is reliable.