Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Inter-rater reliability, intra-rater reliability and internal consistency of the Brisbane Evidence-Based Language Test

Abstract: Purpose: To examine the inter-rater reliability, intra-rater reliability, internal consistency and practice effects associated with a new test, the Brisbane Evidence-Based Language TestMethods: Re

The Orthopaedic Research Institute-Ankle Strength Testing System: inter-rater and intra-rater reliability testing.

Abstract: Achilles tendinosis is a degenerative overuse tendinopathy involving the primary ankle plantarflexors, namely the soleus and gastrocnemius muscles forming the tendo Achilles. The Orthopaedic Research Institute-Ankle Strength Testing System (ORI-ASTS) was designed to record objective measurements of force generated with a resisted ankle plantarflexion test. Testing normal subjects (n=6) was used to establish the reliability of the ORI-ASTS for measuring ankle plantarflexion force. Testing patients with Achilles tendonitis (n=5) over time and comparing Achilles tendon analogue pain scores to ankle plantarflexion force measurements was used to assess the validity of the ORI-ASTS for monitoring progression of Achilles tendinopathy. Inter-rater reliability of the ORI-ASTS with normal subjects was excellent, with single measure intraclass correlation coefficients (ICC) for right mean peak force of 0.92, left mean peak force of 0.96, right mean total force of 0.89, left mean total force of 0.91. The ORI-ASTS also had excellent intra-rater reliability for normal subjects with the following single measure ICC scores: right mean force 0.96, left mean force 0.92, right mean total force 0.97, left mean total force 0.92. The relative technical errors of measurement were calculated from these results, and ranged from 1.0% to 2.7%. Testing patients with Achilles tendinosis (n=5), and comparing analogue activity pain scores to ORI-ASTS testing demonstrated a strong negative relationship between the two parameters (Spearman Rho -0.87 to -1.0, Kendall tau b -0.82 to -1.0). The relationship was statistically significant at the p=0.01 level for two of the five patients. The ORI-ASTS shows excellent reliability for testing ankle plantarflexor force, and appears valid for objectively assessing and monitoring patients with Achilles tendinosis.

Ultrasound Assessment of Weight-Bearing and Non–Weight-Bearing Meniscal Extrusion: A Reliability Study

Abstract: Background Ultrasound has become a useful instrument in evaluating musculoskeletal pathology. Recent studies suggest that ultrasound imaging of weight-bearing menisci may enhance the assessment of knee pathology, such as osteoarthritis (OA) and meniscal injuries. Objective The primary aim of this study was to determine the intrarater and interrater reliability of ultrasound measurements of medial meniscal extrusion (MME) after a brief training session. Design Prospective reliability study. Setting Physical medicine and rehabilitation (PM&R) department within a tertiary care institution. Participants Forty-five participants (29 female, 16 male) were recruited to serve as models, 24 of whom had healthy knees and 21 of whom had radiographically confirmed medial compartment knee OA. Three physician sonographers (1 = experienced, 1 = sports medicine fellow, 1 = post-graduate year [PGY]-4 PM&R resident) were recruited to serve as operators. Methods or interventions Operators received a brief training session on identifying and measuring MME. All operators measured bilateral MME in each model in the standing and supine positions on two separate days. Operators were blinded to all measurements. Main outcome measurements Primary outcomes were inter- and intrarater intraclass correlation coefficients (ICCs) of MME measurements among operators with different levels of ultrasound experience. Results Supine MME intrarater reliability ICCs were 0.927, 0.885, and 0.780 for the experienced physician, sports medicine fellow, and PGY-4 operators, respectively. Standing MME intrarater reliability ICCs were 0.941, 0.902, and 0.824 for the experienced physician, sports medicine fellow, and PGY-4 operators, respectively. Interrater reliability ICCs were 0.896 and 0.842 for supine and standing measurements, respectively. There was a statistically significant increase in intrarater reliability with experience between the PGY-4 resident and experienced physician operators. Conclusions Operators with different levels of ultrasound experience demonstrated good MME measurement intra- and interrater reliabilities in both supine and standing positions.