Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Reliability of the Respiratory Movement Measuring Instrument, RMMI.

Abstract: Summary Introduction: A new instrument to measure breathing movements, Respiratory Movement Measuring Instrument (RMMI), has been developed. There is still a lack of knowledge about the reliability of the instrument. Objectives: The aim was to investigate reliability of the RMMI. Methods: In this trial, RMMI (ReMo Inc. Keldnaholt, Reykjavik, Iceland) was used. Inter- and intrarater reliability was performed on 30 volunteers who were tested three times in the supine position. Two of the tests were performed by one of the authors and the third test by the other. Intrasubject reliability was tested on 10 volunteers 12 times randomly during 1 h. Intra-instrument reliability was performed by measuring 12 solid surfaces where the instrument was placed horizontally against a couch or vertically against a chair. Results: Intra-rater reliability: The correlations were moderate to strong (r = 0·54–0·94) except for the left lower thoracic position r = 0·35. Inter-rater reliability: The correlations were strong (r = 0·71–0·99) except for the left lower thoracic position r = 0·35. The strongest correlations were seen on the tests on abdominal breathing movements. Intra subject reliability: The over-all difference within and between the participants and test was non-significant (P = 0·98). The average difference between the tests was 1·4 mm. Intra instrument: The differences between the measurements were small (mean 0·15 mm). The over-all difference was non-significant (P = 0·79). Conclusion: The RMMI is a reliable instrument and usable in both clinical practice and research.

Smartphone technology: a reliable and valid measure of knee movement in knee replacement

Abstract: Knee range of motion (ROM) following a knee arthroplasty is an important clinical outcome that directly relates to the patient's physical function. Smartphone technology has led to the creation of applications that can measure ROM. The aim was to determine the concurrent reliability and validity of the photo-based application 'Dr Goniometer' (DrG) compared with a universal goniometer performed by a clinician. A smartphone camera was used to take photographs of the knee in full flexion and full extension, and the images were sent by participants to a study phone. Participants then rated the ease of participation. To assess validity, the patient's knee was measured by a clinician using a goniometer. To examine reliability, four clinicians assessed each image using DrG on four separate occasions spaced 1 week apart. A total of 60 images of knee ROM for 30 unicondylar or total knee arthroplasty were assessed. The goniometer and DrG showed strong correlations for flexion (r=0.94) and extension (r=0.90). DrG showed good intrarater reliability and excellent inter-rater reliability for flexion (intraclass correlation coefficient=0.990 and 0.990) and good reliability for extension (intraclass correlation coefficient=0.897 and 0.899). All participants found the process easy. DrG was proven to be a valid and reliable tool in measuring knee ROM following arthroplasty. Smartphone technology, in conjunction with patient-reported outcomes, offers an accurate and practical way to remotely monitor patients. Benefit may be found in differentiating those who need face-to-face clinical consult to those who do not.

Intra- and interrater reliability of Fugl-Meyer Assessment of Lower Extremity early after stroke.

Abstract: Background The Fugl-Meyer Assessment of Lower Extremity (FMA-LE) is a widely used and recommended scale for evaluation of post-stroke motor impairment. However, the reliability of the scale has only been established by using parametric statistical methods, which ignores the ordinal properties of the scale. Objective To determined intra- and inter-rater reliability of the FMA-LE at item and summed score level early after stroke. Methods Sixty patients (mean age 65.9 years, median FMA-LE 29 points) admitted to the hospital due to stroke were included. The FMA-LE was simultaneously, but independently, scored by three experienced and trained physical therapists randomly assigned into pairs, on two consecutive days, between 4 to 9 days post stroke. A rank-based statistical method for paired ordinal data was used to assess the level of agreement and systematic and random disagreements. Results The item-level reliability was high (percentage of agreement [PA] ≥75%). Two items (ankle dorsiflexion during flexor synergy and normal reflex activity) showed some systematic disagreement in intrarater analysis. A satisfactory intrarater reliability (PA ≥70%) was reached for all summed scores when a 1- or 2-point difference was accepted between ratings. Conclusion The FMA-LE is a reliable tool for assessment of motor impairment both within and between raters early after stroke. The scale can be recommended not only for use in Spanish speaking countries, but also internationally. A unified international use of FMA-LE would allow comparison of stroke recovery outcomes worldwide and thereby potentially improve the quality of stroke rehabilitation.

Laryngeal precursor lesions: Interrater and intrarater reliability of histopathological assessment

Abstract: OBJECTIVE The World Health Organization classification (WHOC) 2017 of low-grade versus high-grade laryngeal dysplasia recently replaced the previous WHOC 2005 of mild, moderate, and severe dysplasia and carcinoma in situ. Our objectives were to compare the interrater agreement of the WHOC 2017 with that of the WHOC 2005 and to test the intra-rater agreement of the WHOC 2005. METHODS Two expert head and neck pathologists rated 211 tissue samples that were initially diagnosed with laryngeal precursor lesions. The samples were rated twice according to the WHOC 2005 and once according to the WHOC 2017; estimates of interrater and intrarater agreements were calculated with kappa statistics. RESULTS The crude intrarater agreements using the WHOC 2005 were 0.93 for rater 1 and 0.62 for rater 2. The corresponding unweighted kappa values were 0.90 (95% confidence interval [CI], 0.86-0.95) for rater 1 and 0.43 (95% CI, 0.35-0.54) for rater 2, whereas the standard linear weighted kappa values were 0.93 (95% CI, 0.90-0.97) for rater 1 and 0.60 (95% CI, 0.53-0.69) for rater 2. The crude interrater agreement for the WHOC 2005 was 0.57, with a corresponding unweighted kappa value 0.38 (95% CI, 0.31-0.48) and a standard linear weighted kappa value 0.52 (95% CI, 0.42-0.60). The crude interrater agreement for the WHOC 2017 was 0.83, with a corresponding unweighted kappa value 0.45 (95% CI, 0.31-0.59) and a standard linear weighted kappa value 0.46 (95% CI, 0.30-0.60). CONCLUSION Our results indicate difficulties in providing reliable diagnosis of laryngeal precursor lesions, even with experienced head and neck pathologists and the application of a newly revised classification system. LEVEL OF EVIDENCE 4. Laryngoscope, 128:2375-2379, 2018.