Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Reliability and validity of the Assessment of Daily Activity Performance (ADAP) in community-dwelling older women.

Abstract: Background and aims: The Assessment of Daily Activity Performance (ADAP) test was developed, and modeled after the Continuous-scale Physical Functional Performance (CS-PFP) test, to provide a quantitative assessment of older adults' physical functional performance. The aim of this study was to determine the intra-examiner reliability and construct validity of the ADAP in a community-living older population, and to identify the importance of tester experience. Methods: Forty-three community-dwelling, older women (mean age 75 yr ±4.3) were randomized to the test-retest reliability study (n=19) or validation study (n=24). The intra-examiner reliability of an experienced (tester 1) and an inexperienced tester (tester 2) was assessed by comparing test and retest scores of 19 participants. Construct validity was assessed by comparing the ADAP scores of 24 participants with self-perceived function by the SF-36 Health Survey, muscle function tests, and the Timed Up and Go test (TUG). Results: Tester 1 had good consistency and reliability scores (mean difference between test and retest scores (DIF), -1.05±1.99; 95% confidence interval (CI) -2.58 to 0.48; Cronbach's alpha (α) range, 0.83 to 0.98; intraclass correlation (ICC) range, 0.75 to 0.96; Limits of Agreement (LoA), -2.58 to 4.95). Tester 2 had lower reliability scores (DIF, -2.45±4.36; 95% CI, -5.56 to 0.67; α range, 0.53 to 0.94; ICC range, 0.36 to 0.90; LoA, -6.09 to 10.99), with a systematic difference between test and retest scores for the ADAP domain lower-body strength (-3.81; 95% CI, -6.09 to -1.54), ADAP correlated with SF-36 Physical Functioning scale (r=0.67), TUG test (r=-0.91) and with isometric knee extensor strength (r=0.80). Conclusions: The ADAP test is a reliable and valid instrument. Our results suggest that testers should practise using the test, to improve reliability, before applying it to clinical settings. © 2006, Editrice Kurtis.

MRI–Based Radiologic Scoring System for Extent of Brain Injury in Children with Hemiplegia

Abstract: BACKGROUND AND PURPOSE: Brain MR imaging is recommended in children with cerebral palsy. Descriptions of MR imaging findings lack uniformity, due to the absence of a validated quantitative approach. We developed a quantitative scoring method for brain injury based on anatomic MR imaging and examined the reliability and validity in correlation to motor function in children with hemiplegia. MATERIALS AND METHODS: Twenty-seven children with hemiplegia underwent MR imaging (T1, T2-weighted sequences, DTI) and motor assessment (Manual Ability Classification System, Gross Motor Functional Classification System, Assisting Hand Assessment, Jebsen Taylor Test of Hand Function, and Children9s Hand Experience Questionnaire). A scoring system devised in our center was applied to all scans. Radiologic score covered 4 domains: number of affected lobes, volume and type of white matter injury, extent of gray matter damage, and major white matter tract injury. Inter- and intrarater reliability was evaluated and the relationship between radiologic score and motor assessments determined. RESULTS: Mean total radiologic score was 11.3 ± 4.5 (range 4–18). Good inter- (ρ = 0.909, P CONCLUSIONS: We present a novel MR imaging–based scoring system that demonstrated high inter- and intrarater reliability and significant associations with manual ability classification systems and motor evaluations. This score provides a standardized radiologic assessment of brain injury extent in hemiplegic patients with predominantly unilateral injury, allowing comparison between groups, and providing an additional tool for counseling families.

Dental anatomy grading: comparison between conventional visual and a novel digital assessment technique.

Abstract: Conventional grading of dental students’ projects in preclinical courses has mainly relied on visual evaluation by experienced instructors. The purpose of this study was to compare conventional visual grading in a dental anatomy course at one U.S. dental school to a novel digital assessment technique. A total of sixty samples comprised of two sets of faculty wax-ups (n=30), student wax-ups (n=15), and dentoform teeth of tooth #14 (n=15) were used for this study. Two additional faculty members visually graded the samples according to a checklist and then repeated the grading after one week. The sample wax-up with the highest score based on the visual grading was selected as the master model for the digital grading, which was also performed twice with an interim period of one week. Descriptive statistics and signed rank tests for systematic bias were used for intra- and interrater comparisons. The intraclass correlation (ICC) was used as a measure of intra- and interrater reliability. None of the faculty members achieved the minimum acceptable intrarater agreement of 0.8. Interrater agreement was substantially less than intrarater agreement for the visual grading, whereas all measures of intrarater agreement were greater than 0.9 and considered excellent for the digital assessment technique. These results suggest that visual grading is limited by modest intrarater reliability and low interrater agreement. Digital grading is a promising evaluation method showing excellent intrarater reliability and correlation. Correlation for visual and digital grading was consistently modest, partly supporting the potential use of digital technology in dental anatomy grading.