Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Reliability and predictive validity of Inlow's 60-Second Diabetic Foot Screen Tool.

Abstract: Objective : The purpose of this study was to assess Inlow's 60-Second Diabetic Foot Screen Tool to ascertain consistency of risk recognition for development of ulceration independent of specific assessor and practice setting. Screening tools that assist clinicians in identifying risk require validation. The objectives were to determine the intrarater reliability, interrater reliability, and predictive validity of Inlow's 60-Second Diabetic Foot Screen Tool in 2 healthcare settings. Design : Following ethics board approval, a prospective observational study was completed. Setting and participants : A convenience sample of 69 persons with diabetes was recruited: n = 26 from an acute care setting (dialysis) and n = 43 from long-term-care (LTC) setting. Main outcome measures : The screening tool was administered by 2 assessors independently to determine interrater reliability and later the same day by one of the assessors to determine intrarater reliability. Occurrence of foot ulcers or amputation was noted 1 to 5 months later to determine predictive validity. Main results : Reliability is reported per setting using the intraclass correlation coefficient (2.1) and 95% confidence intervals. Intrarater reliability: LTC 0.96 (0.93-0.98) right foot, 0.97 (0.95-0.98) left foot; dialysis 1.00 right and 1.00 left foot. Interrater reliability: LTC 0.92 (0.86-0.96) right foot, 0.93 (0.87-0.96) left foot; dialysis 0.83 (0.65-0.92) right foot and left foot. Predictive validity: Two subjects had events-1 ulcer and 1 amputation-that were associated with high Inlow's screening tool scores. Conclusion : This study demonstrates excellent interrater and intrarater reliability and provides preliminary information about predictive validity.

Validation of a new device to measure postsurgical scar adherence.

Abstract: Background and Purpose Scarring after surgery can lead to a wide range of disorders. At present, the degree of scar adhesion is assessed manually and by ordinal scales. This article describes a new device (the Adheremeter) to measure scar adhesion and assesses its validity, reliability, and sensitivity to change. Design This was a reliability and validity study. Setting The study was conducted at the Scientific Institute of Veruno. Participants and Methods Two independent raters, a physical therapist and a physical therapist student, used the Adheremeter to measure scar mobility and contralateral normal skin in a sample of 25 patients with adherent postsurgical scars before (T1) and after (T2) physical therapy. Two indexes of scar mobility, the adherence's surface mobility index (SMA) and the adherence severity index (AS), were calculated. Their correlation with the Vancouver Scar Scale (VSS) and its pliability subscale (PL-VSS) was assessed for the validity analysis. Results Both the SMA and the AS showed good-to-excellent intrarater reliability (intraclass correlation coefficient [ICC]=.96) and interrater reliability (SMA: ICC=.97 and .99; AS: ICC=.87 and .87, respectively, at T1 and T2), correlated moderately with the VSS and PL-VSS only at T1 ( r s=−.58 to −.66), and were able to detect changes (physical therapist/physical therapist student): z score=−4.09/−3.88 for the SMA and −4.32/−4.24 for the AS; effect size=0.6/0.4 for the SMA and 1.4/1.2 for the AS; standard error of measurement=4.59/4.79 mm2 for the SMA and 0.05/0.06 for the AS; and minimum detectable change=12.68/13.23 mm2 for the SMA and 0.14/0.17 for the AS. Limitations The measurement is based on the rater's evaluation of force to stretch the skin and on the patient's judgment of comfort. Discussion and Conclusions The Adheremeter showed a good level of reliability, validity, and sensitivity to change. Further studies are needed to confirm these results in larger cohorts and to assess the device's validity for other types of scars.

Validity and reliability of nursing workload measurement systems: review of validity and reliability theory.

Abstract: Nursing workload measurement systems (WMSs) are used in inpatient and outpatient settings for staffing, scheduling, and budgeting. The nurse administrator can use WMS data to make wise decisions in these key areas providing the data are reliable and valid. Unfortunately, in most institutions, attention to issues of reliability and validity occurs only at system implementation and then the systems are left unattended. This article provides an overview of validity and reliability as it relates to WMSs. Part Two of this article will demonstrate how validity and reliability theory can be operationalized in an ongoing program for maintaining WMS reliability and validity.