Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

The Craig Hospital Eye Evaluation Rating Scale (CHEERS)

Abstract: Background Oculomotor deficits in smooth pursuit, saccades, vestibular–ocular reflex (VOR), vergence, and fixation are common problems seen after moderate to severe traumatic brain injury (TBI). No scale currently exists to rate all of these together. The Craig Hospital Eye Evaluation Rating Scale (CHEERS) was designed to systematically quantify frequency and severity of eye movement deficits in TBI. Objective To assess the intra- and interrater reliability of a new rating scale for detecting the presence and degree of 5 oculomotor abnormalities after TBI. Design A reliability study. Setting This was an institution-based study at Craig Rehabilitation Hospital. Participants English-speaking patients between ages 18 and 65 years with a primary diagnosis of moderate to severe mechanical TBI and who were not blind in either eye were eligible. Methods Between October 2013 and March 2014, a total of 11 TBI patients and 9 non-TBI controls were enrolled in the study. The median age was 30 years (range, 18-74 years) for subjects and 52 years (range, 28-63 years) for controls. All patients were male, and 8 of 9 controls were female. Eye movements (fixation, smooth pursuit, saccade, convergence, and vestibular–ocular reflex) were recorded for each on digital video. They were rated on 2 separate occasions by each of the 2 raters. Main Outcome Measurements Inter- and intrarater reliability tests. Results Median elapsed time between the first and second ratings was 7 days (range, 5-44 days). Intrarater agreement was very strong (Spearman ρ ≥ 0.900) for pursuit, saccades, and VOR for both raters, and strong (Spearman ρ ≥ 0.710) for vergence and fixation. The interrater agreement for detecting presence of any oculomotor abnormality was substantial (unweighted κ = 0.63). The interrater concordance on the full range of scale scoring was strongest on the VOR test (weighted κ = 0.98), was substantial for vergence, pursuit, saccades, and total score (weighted κ > 0.60), and was moderate for fixation. For TBI patients, every eye movement rated was found to be more abnormal than compared to those in the controls. Conclusions CHEERS is a reliable scale for assessing and quantifying oculomotor deficits commonly observed in moderate to severe TBI. Further studies to validate the scale's utility in outcome prediction, and its applicability to broader brain injury populations, are warranted. Level of Evidence IV

Validity and interrater/intrarater reliability of the Turkish version of the postural assessment scale for stroke patients (PASS-Turk)

Abstract: Background: There is no Turkish version of the Postural Assessment Scale for Stroke patients (PASS).Objectives: To translate and make the cross-cultural adaptation of the PASS into the Turkish lang...

Validation of an instrument for injury data collection in strength training

Abstract: Purpose: To provide for the basis for collecting strength training data using a rigorously validated injury report form. Methods: A group of specialist designed a questionnaire of 45 item grouped into 4 dimensions. Six stages were used to assess face, content, and criterion validity of the weight training injury report form. A 13 members panel assessed the form for face validity, and an expert panel assessed it for content and criterion validity. Panel members were consulted until consensus was reached. A yardstick developed by an expert panel using Intraclass correlation technique was used to assess the reability of the form. Test-retest reliability was assessed with the intraclass correlation coefficient (ICC).The strength training injury report form was developed, and the face, content, and criterion validity successfully assessed. A six step protocol to create a yardstick was also developed to assist in the validation process. Both inter-rater and intra rater reliability results indicated a 98% agreement. Inter-rater reliability agreement of 98% for three injuries. Results: The Cronbach’s alpha of the questionnaire was 0.944 (p<0.01) and the ICC of the entire questionnaire was 0.894 (p<0.01). Conclusion: The questionnaire gathers together enough psychometric properties to be considered a valid and reliable tool for register injury data in strength training, and providing researchers with a basis for future studies in this area.

Impact of value of lost load on performance of reliability criteria and reliability management

Abstract: Evaluating the performance of various power system reliability criteria and their management is important in order to obtain a cost effective reliability level of the power system. However, the performance of reliability criteria depends on several parameters, of which one is value of lost load (VoLL). Value of lost load is typically difficult and complex to model, which hampers making a general conclusion about the most appropriate reliability criterion. This paper gives a methodology to assess the impact of VoLL on the performance of reliability criteria and their management. The assessment is made for a 5 node test system, based on the Roy Billinton reliability test system, using 4 different reliability criteria, i.e. 2 probabilistic and 2 deterministic approaches. The focus is on operational planning and real time operation.