Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Estimating Test Reliability

Abstract: Formulas for parallel-form reliability coefficients are derived from two improved definitions of parallelism. One definition, based on randomly parallel test forms, leads to a new and useful derivation for the KR formula-21 coefficient. The other, based on matched test forms, leads to a formula for the least upper bound of the test reliability. A numerical example is given, showing how a standard error of measurement for each separate examinee is readily computed, and how the test reliability may be computed by averaging these standard errors.

Confiabilidade intra e interexaminadores de dois métodos de medida da amplitude ativa de dorsiflexão do tornozelo em indivíduos saudáveis

Abstract: BACKGROUND: Range of motion (ROM) measurements are an important parameter for physiotherapeutic assessment and follow-up. Consequently, the reliability of such measurements and the instruments utilized must be evaluated. OBJETIVE: To evaluate the intrarater and interrater reliability of active ROM measurements for ankle dorsiflexion using a goniometer and the more functional method of closed kinetic chains (CKC). METHOD: Two examiners measured both ankles of 22 healthy subjects, on two test days. The active ROM for dorsiflexion was first measured with the subject in the prone position using a universal goniometer and subsequently with the subject in the orthostatic position, with the foot to be tested in dorsiflexion on a measuring tape. The intraclass correlation coefficient (ICC) was used to analyze the reliability of the measurements, and Student's t test for paired and independent samples was used to investigate differences between the means for the two test days and between the two examiners, respectively. RESULTS: The ICC showed low to moderate intrarater reliability (ICC: 0.32-0.72) and moderate interrater reliability (ICC: 0.57-0.66) for the goniometer measurements. For the CKC measurements, both intrarater reliability and interrater reliability were high: intrarater ICC of 0.93 and 0.96 for the right and left ankles, respectively; interrater ICC of 0.98 and 0.99 for the right and left ankles, respectively. CONCLUSION: These results indicated that the reliability of the CKC evaluation was greater than the reliability of the universal goniometer. This shows that CKC is a reliable method for clinical application involving the same or different examiners.

Measuring the severity of infantile hemangiomas: Instrument development and reliability

Abstract: Objectives To develop instruments that measure the severity of infantile hemangiomas (Hemangioma Severity Scale [HSS]) and the complications of infantile hemangiomas for longitudinal use (Hemangioma Dynamic Complication Scale [HDCS]). Design Instrument development and reliability study. Setting Academic research. Participants The HSS and the HDCS were developed through the collaborative effort of members of the Hemangioma Investigator Group Research Core, an expert multi-institutional research group. After development of the scales, 13 pediatric dermatologists used the HSS to score 20 different hemangiomas. In addition, 12 pediatric dermatologists used the HDCS to score hemangioma-related complications for 24 clinical scenarios. Interrater and intrarater reliability was measured for both scales. Main Outcome Measures Interrater and intrarater reliability. Results For the HSS, interrater reliability and intrarater reliability exceeded 99%. Similarly, the HDCS had a high rate of interrater agreement; for individual items, agreement among raters was 67% to 100%, with most clinical scenarios demonstrating greater than 90% agreement. Intrarater reliability was excellent for all individual items of the HDCS. Conclusion The HSS and the HDCS are reliable scales that can be used to measure the severity of infantile hemangiomas, including the severity of complications for longitudinal use.

Reliability of the Perceive, Recall, Plan and Perform System of Task Analysis: A criterion-referenced assessment

Abstract: Objective: To conduct preliminary examination of the rater and test-reliability of the Perceive, Recall, Plan and Perform (PRPP) System of Task Analysis, an ecological measure designed to assess task-embedded information processing capacity during occupational therapy assessment of confused and agitated adults following traumatic brain injury. Methods: Occupational therapists observed and scored client performance using the PRPP System of Task Analysis. Correlational analysis and measures of agreement were performed to determine interrater and intrarater reliability. Test procedures were examined for reliability and internal consistency. Results: Interrater and test reliability considered three factors: therapists, clients and tasks. A moderate level of interrater reliability was achieved between trained therapists (intraclass correlation coefficient (ICC) = 0.60). Test procedures were highly reliable (ICC = 0.88). Across two measurement occasions, therapists showed a tendency towards harder rating on the second test occasion ( -4.5%; 95% confidence interval for : -10.67%→ 3.17%). Conclusion: The findings of this study support the use of criterion-referenced tests in the area of occupational performance measurement. Occupational therapists achieved moderate interrater reliability when measuring the performance of adults with brain injury on various activities of daily living. Test procedures were found to be highly reliable in measuring the occupational performance of adults demonstrating confusion and agitation typical to the stage of post-traumatic amnesia following head injury. Language: en