Topic
Intra-rater reliability
About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.
Papers published on a yearly basis
Papers
More filters
TL;DR: Scanning technology used in this study demonstrated good intra- and interrater reliability measurements of footprint indices, as demonstrated by high ICC values.
20 citations
TL;DR: The Italian version of Montreal Cognitive Assessment (MoCA) is validated, showing high levels of sensitivity and specificity and an accuracy of .96, with 95% confidence interval, and the optimal MoCA cut-off point was identified.
Abstract: Neuropsychological testing is a milestone of good practice to document cognitive deficits in a rapidly aging population. The aim of this paper is to validate the Italian version of Montreal Cognitive Assessment (MoCA). We compared subjects performance at the Italian version of MoCA with performance at standard Mini Mental State Examination (MMSE). The whole sample is composed of 287 subjects. All participants were administered three MoCA and a standard MMSE within 4 weeks. Through ROC analysis the optimal MoCA cut-off point was identified, showing high levels of sensitivity and specificity and an accuracy of .96, with 95% confidence interval. Intra rater reliability and intra rater reliability are highly significant with respect to the MMSE. Results highlight that MoCA is a valid instrument in clinical and research screening and monitoring of subjects affected by cognitive disorders. Further studies may be directed to the deepening of the reliability and validity of the test.
20 citations
20 citations
TL;DR: A high level of agreement on ADSD severity, with excellent interrater and intrarater reliability, is demonstrated, and telephone-filtered voices appear to convey adequate ADSD perceptual cues for expert listeners to judge the severity of spasmodic dysphonia.
Abstract: OBJECTIVES Although perceptual assessment by experienced voice clinicians remains the gold standard for the diagnosis and assessment of severity of adductor spasmodic dysphonia (ADSD), the interrater reliability of voice experts for this task has not been assessed. In addition, it is unknown whether telephone-recorded or -transmitted voice samples could be used for this task. The aims of this study were (1) to assess the reliability of perceptual analysis of ADSD severity by voice experts and (2) to compare the results between digitally recorded voice samples and those recorded over the telephone. METHODS Five laryngologists randomly selected voice samples from 46 ADSD patients and rated the severity of ADSD on a 5-point rating scale. A set of digital voice recordings and a set of telephone voice recordings made from filtering the digital set via the telephone were rated, and each voice set was rated twice. Measures of intrarater and interrater reliability, as well as a measure of the probability of agreement among the raters, were calculated. RESULTS There was a high level of agreement on ADSD severity, with excellent interrater and intrarater reliability (Cronbach's alpha, .93 to .96). The probabilities of rater agreement on the digitally recorded and telephone-filtered voice samples were similar (chi2, p = .07). The ratings of digital versus telephone voice samples were highly correlated (Pearson r, 0.99; p < .001). CONCLUSIONS These results demonstrate that voice experts are reliably able to judge and agree on the severity of ADSD. Telephone-filtered voices appear to convey adequate ADSD perceptual cues for expert listeners to judge the severity of spasmodic dysphonia.
20 citations