Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Reliability Modeling and Prediction of Systems With Mixture of Units

Abstract: Traditional reliability analysis and prediction are performed by utilizing observed failure or degradation data of test units or field observations. Reliability testing is usually performed to predict reliability or performed as acceptance testing or reliability demonstration test. Moreover, in many cases, reliability tests are performed repeatedly during the entire life of the system by testing different samples with different characteristics in the system. At the end of each test, available data only show the number and combination of failed units which are then used for reliability estimation and prediction. This paper investigates several effective approaches to obtain expressions for system reliability metrics under different scenarios, considering the mixture characteristics of the units. The proposed approaches apply to general cases when the population size, as well as the mixture of units, increase over time. A simulation model is utilized to validate the proposed models.

Cognitive assessment in the acute care setting: reliability and validity of the Levels of Cognitive Functioning Assessment Scale (LOCFAS).

Abstract: Nurses have responsibility for accurate assessment of cognitive functioning for traumatic brain injured (TBI) patients early in the posttrauma period to enhance rehabilitation with appropriate care planning. To meet this need the Levels of Cognitive Functioning Assessment Scale (LOCFAS) was adapted from the Rancho Los Amigo Levels of Cognitive Functioning instrument. One validity and three reliability studies were conducted using videotapes of five TBI patients at different levels of cognitive functioning. Interrater and intrarater reliability was assessed using coefficient kappa. With raters experienced in assessing cognitive functioning, agreement among cognitive levels was 1.00 with a mean agreement of .997 (SD = .006) for individual items. With inexperienced raters in cognitive assessment, mean agreement for levels was .839 (SD = .120) and for individual items, .830 (SD = .052) Intrarater reliability, after a two-week interval, yielded a mean agreement of .860 (SD = .088) for levels. Criterion-related validity of the LOCFAS was demonstrated by correlating it with the Rancho Los Amigos Levels of Cognitive Functioning scale. The resultant Pearson r correlation was .929. Implications for nursing practice and nursing education are discussed.

A Comparative Analysis of 150 Thumb Polydactyly Cases from the CoULD Registry Using the Wassel-Flatt, Rotterdam, and Chung Classifications.

Abstract: Purpose Three commonly used classifications for thumb polydactyly are the Wassel-Flatt, Rotterdam, and Chung. The ideal classification system would have high validity and reliability and be descriptive of the thumb anomaly. The purposes of this investigation were to (1) compare the inter- and intrarater reliability of these 3 classifications when applied to a large sample of patients enrolled in the Congenital Upper Limb Differences (CoULD) Registry and (2) determine the prevalence of radial polydactyly types when using the various classifications in a North American population. Methods Inter- and intrarater reliability were determined using 150 cases of radial polydactyly presented in a Web-based format to 7 raters in 3 rounds, a preliminary training round and 2 observation rounds. Raters classified each case according to the Wassel-Flatt, Rotterdam, and Chung classifications. Inter- and intrarater reliability were evaluated with the intraclass correlation coefficient (ICC) calculated using 2-way random measures with perfect agreement. Results For Wassel-Flatt, both the interrater (ICC, 0.93) and the intrarater reliability (ICC, 0.91) were excellent. The Rotterdam classification had excellent reliability for both interrater reliability (ICC, 0.98) and intrarater reliability (ICC, 0.94), when considering type alone. Interrater analysis of the additional subtypes demonstrated a wide range of reliabilities. The Chung classification had good interrater (ICC, 0.88) and intrarater reliability (ICC, 0.77). Within the Wassel-Flatt classification, the most frequent unclassifiable thumb was a type IV hypoplastic thumb as classified by the Rotterdam classification. Conclusions The Wassel-Flatt and Rotterdam classifications for radial polydactyly have excellent inter- and intrarater reliability. Despite its simplicity, the Chung classification was less reliable in comparison. The Chung and Rotterdam classification systems capture the hypoplastic subtypes that are unclassifiable in the Wassel-Flatt system. Addition of the hypoplastic subtype to the Wassel-Flatt classification (eg, Wassel-Flatt type IVh) would maintain the highest reliability and classify over 90% of thumbs deemed unclassifiable in the Wassel-Flatt system. Clinical relevance The Wassel-Flatt and Rotterdam classifications have excellent inter-and intrarater reliability for the hand surgeon treating thumb polydactyly. Addition of a hypoplastic subtype to the Wassel-Flatt (Type 4h) allows classification of most previously unclassifiable thumbs.

Reliability and Validity of Data

Abstract: The reliability and validity of our data should be variously judged; a blanket challenging of subjective answers from patients is as out of place as an unthinking, uncritical acceptance of all data. The data in this study come from a variety of sources: Patients and their persons of reference Staff at the treatment centres Medical findings on physical examinations Doctors’ and social workers’ reports1 Interviewers’ reports at 6-month and 18-month follow-up