Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Inter- and Intra-rater Reliability of the Athletic Ability Assessment in Subelite Australian Rules Football Players.

Abstract: The aim of this study was to determine the inter- and intra-rater rater reliability of the Athletic Ability Assessment (AAA) in subelite Australian Rules football (ARF) players. Eighteen male ARF players completed the AAA movement assessment (overhead squat, double lunge [left and right], single-leg Romanian deadlift [left and right], chin-up and push-up), on 2 occasions separated by 1 week. During the first movement assessment, players were filmed in the frontal and sagittal planes. Ten raters took part in the study (1 experienced rater and 9 novices) and were assigned in a quasirandom manner, to complete either (a) real-time assessment on 2 occasions, (b) real-time assessment on 1 occasion, or (c) video-based assessment on 2 occasions. When assessed in real-time, of the 7 component movements of the AAA, raters registered moderate or greater intrarater agreement on between 2 and 5 occasions. Intraclass correlation coefficients (ICCs) of between 0.50 and 0.61 for the AAA total score indicated poor real-time intrarater reliability for this variable. When assessed by video-recording, raters registered moderate or greater intrarater agreement on between 6 and 7 occasions. The ICC for total score ranged between 0.60 and 0.93. Overall poor interrater reliability was evident for AAA component movements regardless of whether it was assessed in real-time or from video. Findings suggest the AAA is most reliably used when assessed through video. It is recommended that if comparison between multiple raters is desired, a stringent training process be applied so that the interpretation of AAA scoring criteria is standardized across raters.

Inter-rater and Intra-rater Reliability of the Chinese Version of the Action Research Arm Test in People With Stroke.

Abstract: Purpose: To detect the inter-rater and intra-rater reliability of the Chinese version of the Action Research Arm Test (C-ARAT) in patients recovering from a first stroke. Methods: Fifty-five participants (45 men and 10 women) with a mean age of 58.67 ± 12.45 (range: 22-80) years and a mean post-stroke interval of 6.47 ± 12.00 (0.5-80) months were enrolled in this study. To determine the inter-rater reliability, the C-ARAT was administered to each participant by two raters (A and B) with varying levels of experience within 1 day. To determine intra-rater reliability, rater A re-administered the C-ARAT to 33 of the 55 participants on the second day. Intra-class correlation coefficients (ICCs) and Bland-Altman plots were used to analyse the inter-rater and intra-rater reliability. Results: Regarding inter-rater reliability, the total, grasping, gripping, pinching, and gross movement scores received respective ICCs of 0.998, 0.997, 0.995, 0.997, and 0.960 (all p < 0.001), indicating excellent inter-rater reliability in stroke patients. Regarding intra-rater reliability, the corresponding ICCs were 0.987, 0.980, 0.975, 0.944, and 0.954 (all p < 0.001), again indicating excellent intra-rater reliability. The Bland-Altman plots yielded a mean difference of 0.15 with 95% limits of agreement (95%LOA) ranging from -2.16 to 2.46 for the inter-rater measurements and a mean difference of -1.06 with 95%LOA ranging from -6.43 to 4.31 for the intra-rater measurement. The C-ARAT thus appeared to be a stable scoring method. Conclusions: The C-ARAT yielded excellent intra-rater and inter-rater reliability for evaluating the paretic upper extremities of stroke patients. Therefore, our results supported the use of the C-ARAT in this population.

Inter-rater and intra-rater reliability of the occupational therapy diagnosis.

Abstract: A registration form based on the International Classification of Impairments, Disabilities, and Handicaps (ICIDH) was developed and its reliability as a registration of occupational therapy (OT) diagnosis was assessed. Fifty patients from a psychiatric hospital and 57 patients from a rehabilitation center participated in this study. Reliability was determined using two measures: the percentage of agreement and Cohen's kappa. Findings of this study indicate that the reliability of the assessments of functional deficits of the patients by occupational therapists is satisfactory to very good. In the rehabilitation center all items, and in the psychiatric hospital 88% of the items, had a kappa value higher than .45. This implies that the registration form can be used in survey research.

Reliability and validity analysis of a proposed quality management measurement instrument.

Abstract: The development of battery of quality management summated scales is described, with a focus on reliability and validity issues. The scales are demonstrated to be robust with respect to both interna...

Multi-site reliability and validity of a diagnostic pattern-recognition knowledge-assessment instrument.

Abstract: No abstract available.