scispace - formally typeset
Search or ask a question

Showing papers on "Intra-rater reliability published in 1993"


Journal ArticleDOI
TL;DR: In this paper, multifaceted Rasch techniques are used to investigate inter-and intrarater reliability in the assessment of two alternate versions of an oral interaction test - a direct version and a semi-direct version.
Abstract: In this article, multifaceted Rasch techniques are used to investigate inter- and intrarater reliability in the assessment of two alternate versions of an oral interaction test - a direct version and a semi-direct version. Following the rating of trial administration of both versions of the test, an analysis of the bias of each individual rater in respect to test type and particular criteria used in rating the test was undertaken. The results of these analyses were then presented to the rater. The raters then assessed a further administration of the test and their bias with respect to this administration was analysed. The results of the two bias analyses were compared to determine whether rater performance had improved as a result of the feedback. There was some evidence that performance had improved.

120 citations


Journal ArticleDOI
TL;DR: The Glasgow Coma Scale shows statistically significant reliability (i.e., significant agreement) between emergency physicians and emergency medical technician-paramedics and has a significant level of intrarater reliability.
Abstract: We sought to determine the reliability of the Glasgow Coma Scale (GCS) when used by emergency physicians and paramedics. We performed a prospective sequential trial in a classroom setting, with subjects blinded to others' scoring. Nineteen university-affiliated emergency physicians and 41 professional paramedics from an urban EMS system voluntarily participated. Participants viewed four videotaped scenes in which a patient is assessed by a paramedic. The first three scenes represented severe, intermediate, and no/mild alteration in level of consciousness (LOC). The findings in the fourth scene were identical to the first, allowing determination of intrarater reliability. The Kappa statistic was used to determine interrater reliability; the reliability coefficient determined intrarater reliability. Kappa was significant (p < 0.0001) for severe (kappa = 0.48), intermediate (kappa = 0.34), and no/mild (kappa = 0.85) conditions. Intrarater reliability (r1,2) for emergency physicians was 0.66 (p < 0.01) and for paramedics was 0.63 (p < 0.01). The GCS shows statistically significant reliability (i.e., significant agreement) between emergency physicians and emergency medical technician-paramedics. It also has a significant level of intrarater reliability.

105 citations


Journal ArticleDOI
TL;DR: The results show that the pressure threshold meter is highly reliable in measuring trigger point sensitivity, between and within experimenters, and may be useful in the diagnosis and monitoring of treatment of myofascial pain syndrome.
Abstract: This study was designed to establish the intra-rater and inter-rater reliability of measurements of trigger point sensitivity using a commercially available pressure threshold meter. Fifty healthy adult volunteers (25 men and 25 women, aged 20 to 51 years) underwent repeated pressure threshold readings from two separate trigger point locations in the trapezius muscle, TP2 (left) and TP3 (right) by two independent examiners. Pressure threshold readings, using a 1.0 kg/s application, were done alternately by each experimenter. Measurements from each trigger point were completed 5 minutes apart. Intraclass correlation coefficients (ICC) revealed the inter-rater reliability to be high for both the first (ICC = 0.82) and second trial (ICC = 0.90) of TP2 and for the first (ICC = 0.86) and second trial (ICC = 0.92) of TP3. Intra-rater reliabilities for TP3 (ICC = 0.91) were higher than for TP2 (ICC1 = 0.80; (ICC2 = 0.83). These results show that the pressure threshold meter is highly reliable in measuring trigger point sensitivity, between and within experimenters, and may be useful in the diagnosis and monitoring of treatment of myofascial pain syndrome.

81 citations


Journal ArticleDOI
TL;DR: The results indicate that physical therapists demonstrate low reliability in assessment of the presence of dysmetria and tremor using videotaped performances of the finger-to-nose test, and physical therapists should seek alternative methods of evaluation of UE coordination.
Abstract: Background and Purpose. The purpose of this study was to determine the intrarater and interrater reliability of measurements of three clinical features of coordination based on the performance of the “finger-to-nose” test. Subjects. Thirty-seven persons with traumatic brain injury (26 male, 11 female), aged 17 to 64 years (X=29.1, SD=9.9), participated in the study. Methods. Each subject's performance was videotaped and evaluated for the right and left upper extremities (UEs) (two trials each) with respect to the following variables: time of execution, degree of dysmetria, and degree of tremor (four-point ordinal ratings). One year later, five experienced physical therapists (including the original investigator) independently rated each patient's videotaped performance in the same manner as described above. Results. Intraclass correlation coefficients (ICC[3,1])for intrarater reliability were .971 and .986 and ICCs for interrater reliability were .920 and .913 for right and left UEs, respectively, for the time of execution. A generalized Kappa statistic of .54 was calculated for the scoring of dysmetria (both UEs), and Kappa statistics calculated for the scoring of tremor were .18 and .31 for right and left UEs, respectively. Interrater reliability was lower for the scoring of these variables and varied from .36 to .40 for dysmetria and from .27 to .26 for tremor (right and left UEs, respectively). Conclusion and Discussion. These results indicate that physical therapists demonstrate low reliability in assessment of the presence of dysmetria and tremor using videotaped performances of the finger-to-nose test. The results suggest, however, that therapists reliably measure the time of execution of this test. If the limitations associated with therapists' capacity for objective measurement of subjective phenomena cannot be overcome (eg, by establishment of more definitive scoring criteria for the measures of dysmetria and tremor), then therapists should seek alternative methods of evaluation of UE coordination.

65 citations


Book
01 Sep 1993
TL;DR: In this paper, the authors defined the principles of quality and reliability in manufacturing and maintenance of a product, including the meaning of quality product specification using continuous performance characteristics, and the reliability of the product.
Abstract: Part 1 Principles of quality and reliability: the quality of a product the meaning of quality product specification using continuous performance characteristics statistical analysis of continuous performance characteristics comparison of performance statistics with product specification the reliability of a product the meaning of reliability practical reliability definitions instantaneous failure rate and its relation to reliability typical forms of hazard rate function rules for combining probabilities. Part 2 Reliability of systems: series systems parallel systems general series-parallel system majority voting systems standby systems common mode failures availability of systems. Part 3 Failure rate data and models: failure rate data failures influencing failure rate failure rate models calculation of equipment failure rate from component failure rate data software reliability human reliability. Part 4 Quality and reliability in manufacture: the achievement of quality economics of quality and reliability design for quality and reliability quality and reliability in production testing of the finished product. Part 5: Reliability in maintenance: reliability and the total cost of ownership breakdown maintenance preventive maintenance on-condition maintenance. Part 6 Protective systems for hazardous processes: introduction the hazardous process target hazard rate for the protective system choice of trip initiating parameters design of the protective system hazard analysis of process and protective system.

62 citations


Journal ArticleDOI
TL;DR: This study highlights the limitations of clinical rating scales in Parkinson's disease when more than one rater is used and suggests that in designing clinical trials, every effort should be made to ensure that the same patient is always assessed by the same rater.
Abstract: Inter- and intrarater reliability in scoring the signs of Parkinson's disease using the original Columbia scale and a modified version of this, the Sydney scale, were assessed in five neurologists participating in a long-term study of Parkinson's disease. Scoring was done on video recordings of 41 patients whose disability ranged from mild to severe. Although all the neurologists were familiar with the scales and had received training designed to produce uniformity of scoring, interrater reliability was poor. The mean score for the Columbia scale varied from 18.6 to 30 and for the Sydney scale from 15.2 to 23.2. By contrast, intrarater reliability was good. This study highlights the limitations of clinical rating scales in Parkinson's disease when more than one rater is used. In designing clinical trials, every effort should be made to ensure that the same patient is always assessed by the same rater.

58 citations


Journal ArticleDOI
TL;DR: The results of this replication study suggest that only the anxiety‐depression subscale, the 10‐item psychotic disintegration scale and the BPRS‐18 global scale can be used reliably in unselected groups of psychiatric inpatients in acute distress.
Abstract: This study aimed to determine the replicability of the interrater reliability coefficients obtained with a standardized and expanded Brief Psychiatric Rating Scale (BPRS-E) in a 1991 psychometric evaluation. Furthermore, intrarater reliability was assessed. At item level, interrater concordance turned out to be satisfactory for most of the BPRS-E items. However, only a few of the items reached acceptable chance-corrected coefficients. In contrast to the previous study, the anxiety-depression subscale met the standard of acceptable interrater reliability in the present study. As in the 1991 study, the 10-item psychotic disintegration scale as well as BPRS-18 global scores met (or closely approximated) this standard. The 6 additional items of BPRS-E did not contribute to the scale's reliability. Joining the samples of the 1991 and replication studies (to cover the range of symptoms' severity and heterogeneity more fully) did not improve interrater reliability. Intrarater reliability coefficients were globally comparable to interrater reliability coefficients. In all, the results of this replication study suggest that only the anxiety-depression subscale, the 10-item psychotic disintegration scale and the BPRS-18 global scale can be used reliably in unselected groups of psychiatric inpatients in acute distress.

44 citations


Journal ArticleDOI
TL;DR: In this article, Validity, dependability, and reliability in National Curriculum assessment are discussed in the context of assessment of the English language arts curriculum in the United States.
Abstract: (1993). Validity, dependability and reliability in National Curriculum assessment. The Curriculum Journal: Vol. 4, No. 3, pp. 335-350.

32 citations


Journal Article
TL;DR: It is concluded that chest radiographs are a reliable and valid screening tool for the diagnosis of diffuse idiopathic skeletal hyperostosis (DISH).
Abstract: OBJECTIVE: To evaluate the sensitivity, specificity, predictive value, interrater reliability and intrarater reliability of using chest radiographs as a screening tool for the diagnosis of diffuse idiopathic skeletal hyperostosis (DISH). METHODS: After review of thoracic spine radiographs by 2 "gold standard" physicians, 45 patients with DISH meeting the criteria of Resnick and Niwayama were contrasted with 106 control patients consisting of 45 with thoracic spondylosis, 45 who lacked spondylosis and whose thoracic spine radiographs were otherwise normal for the age of the patient, and 16 with ankylosing spondylitis. The chest radiographs on the 151 subjects were placed in random order and read independently using an ordinal diagnostic certainty scale by 2 "test" radiologists, experienced in reading bone radiographs. Two months later the order of chest radiographs was rerandomized and the films reassessed by the same test radiologists. RESULTS: The averages for the diagnostic and population test characteristics were sensitivity = 77%; specificity = 97%; positive predictive value = 91%; and, negative predictive value = 91%. The area under the receiver operating characteristic curves was 0.975 and 0.976 for the radiologists, and kappa was 0.93, demonstrating that interrater reliability was high. On rereading the chest radiographs, intrarater reliability was exceptional (weighted kappa of 0.90 and 0.96 for the two test radiologists). DISH patients whose chest radiographs were read as not demonstrating DISH had significantly less extensive disease. CONCLUSIONS: We conclude that chest radiographs are a reliable and valid screening tool for the diagnosis of DISH.

25 citations


Journal ArticleDOI
TL;DR: This preliminary review was performed to determine the intra- and interrater reliability of TROM and resulted in moderate consistency of measures of intrarater reliability between trials, and between instruments used (digital and manual).

24 citations


Book ChapterDOI
01 Jan 1993
TL;DR: A number of simulation approaches for estimating hot-carrier reliability, ranging from two-dimensional device simulation, to circuit simulation, and to large-scale timing simulation, were examined in detail in Chapters 4 through 6.
Abstract: The importance and the advantages of accurate reliability assessment during the early phases of VLSI design have already been discussed in the previous chapters The development and use of accurate reliability simulation tools were recognized as crucial measures for early assessment and improvement of circuit reliability Once the long-term reliability of the circuit is estimated through simulation, the results can be compared with predetermined reliability specifications or limits If the predicted reliability does not satisfy the requirements, appropriate design modifications may be carried out to improve the resistance of the devices to degradation A number of simulation approaches for estimating hot-carrier reliability, ranging from two-dimensional device simulation, to circuit simulation, and to large-scale timing simulation, were examined in detail in Chapters 4 through 6

Journal ArticleDOI
TL;DR: The purpose of this study was to determine the interrater and intrarater reliability of two experienced physical therapists in the identification of the type of end feel for elbow flexion and extension when using the Paris classification system of normal end feel.
Abstract: Identification of the anatomic and pathoanatomic structure which limits the range of motion of a joint help to determine the need for and type of treatment approach. The purpose of this study was to determine the interrater and intrarater reliability of two experienced physical therapists in the identification of the type of end feel for elbow flexion and extension when using the Paris classification system of normal end feel. Four trials of flexion end feel and four trials of extension end feel were conducted for each of the twenty subjects by each blindfolded examiner. A total of 160 movements were performed by each examiner. The intertester Kappa value for interrater reliability for flexion was .40 and for extension was .73 with a significance of p < .0001 for both flexion and extension. Intrarater agreement was measured by percent comparison. Examiner A demonstrated 80% agreement for flexion and 79% for extension. Examiner B showed 75% agreement for flexion and 78% for extension. This study d...

Proceedings ArticleDOI
S.J. Keene1, C. Lane
26 Jan 1993
TL;DR: A reliability growth model is presented that translates quality measures to time-dependent MTBFs (mean times between failures) and should provide key guidance to make operational reliability decisions and determine the support analysis needs of fielded software.
Abstract: A reliability growth model is presented that translates quality measures to time-dependent MTBFs (mean times between failures). Software reliability growth stems from the detection and removal of faults that are latent in the code after delivery. The fielded reliability performance is measured over time; the 'noise' is smoothed; and a general form for the reliability growth profile is generated. The basic reliability growth profile is enhanced to include the impact of code updates, fault recurrence, and usage. It is concluded that the combination of theoretical analysis and actual field data presented should provide key guidance to make operational reliability decisions and determine the support analysis needs of fielded software. >


Proceedings ArticleDOI
17 May 1993
TL;DR: In this paper, the authors describe the evaluation of the worth or value of distribution system reliability using quantitative reliability analysis and customer interruption costs, which makes it possible to optimize the reliability of a system by comparing the reliability worth with the associated system investment costs.
Abstract: The authors describe the evaluation of the worth or value of distribution system reliability using quantitative reliability analysis and customer interruption costs. The ability to assess reliability worth makes it possible to optimize the reliability of a system by comparing the reliability worth with the associated system investment costs. The analyses include an evaluation of the reliability of different design/operating configurations of a distribution system and the corresponding reliability worths at the customer level. The reliability of each system configuration is evaluated in terms of the system performance indices and the expected customer outage costs due to power interruptions. >

Book ChapterDOI
01 Jan 1993




Proceedings ArticleDOI
26 Jan 1993
TL;DR: The author describes the reliability evaluation of such a module through all phases of the program-from the early reliability prediction, through the subsequent reliability testing, to the later analysis of the field reliability performance data.
Abstract: The author describes the reliability evaluation of such a module through all phases of the program-from the early reliability prediction, through the subsequent reliability testing, to the later analysis of the field reliability performance data. He also reviews and compares the mean-time-between-failure (MTBF) design prediction goals versus the Monte Carlo simulation results, as well as the actual field-performance data over a 24-month period using various reliability assessment methods and techniques. >