scispace - formally typeset
Search or ask a question
Topic

Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.


Papers
More filters
Journal ArticleDOI
TL;DR: In this article, the inter-and intrarater reliability of a DLJ scoring system for temporomandibular disorders (TMD) based upon radiological findings from magnetic resonance imaging (MRI) was assessed.
Abstract: Background The aim of this study was to assess the inter- and intrarater reliability of a recently proposed scoring system for temporomandibular disorders (TMD), based upon radiological findings from magnetic resonance imaging (MRI). Materials and methods Patients with clinically suspected uni- or bilateral TMD, and subsequently conducted MRI examination of both temporomandibular joints, were included in this study. MRI data were independently evaluated by two experienced radiologists according to the DLJ scoring system proposed by Wurm et al., which includes assessment of the following categories: articular disk (prefix ‘D’), direction of disk luxation (prefix ‘L’), and osseous joint alterations (prefix ‘J’). Results 60 patients (49 female and 11 male) were eligible for analysis. No significant differences were found between both observers regarding ‘D’ and ‘L’ scores (p = 0.13 and p = 0.59, respectively). Significant differences were found for the assessment of subtle osseous changes (‘J0’ category: p = 0.041; ‘J1’ category: p = 0.018). Almost perfect intra- and interrater agreements were found for ‘D’ and ‘L’ categories (intrarater and interrater agreements for ‘D’: κ = 0.92 and κ = 0.84, respectively; intrarater and interrater agreements for ‘L’: κ = 0.93 and κ = 0.89, respectively). However, the assessment of ‘J’ categories revealed only moderate interrater agreement (κ = 0.49). Conclusion The DLJ scoring system based upon MRI findings is feasible for routine clinical TMD assessment, and may help to simplify interdisciplinary communication between radiologists and clinicians.
Journal ArticleDOI
TL;DR: In this paper, a 5-step translation and adaptation process was performed to obtain the statistical characteristics of the Functional Oral Intake Scale (FOIS), which is an observer-rated dysphagia severity scale primarily developed for stroke patients, into the Slovenian language.
Abstract: Background: It is crucial that each and every stroke patient gets a systematic assessment of swallowing disorders, performed by a dysphagia specialist. Therefore, there is a need to use a standardized scale among professionals. The aim of this study was to translate, adapt, and obtain the statistical characteristics of the Functional Oral Intake Scale (FOIS), which is an observer-rated dysphagia severity scale primarily developed for stroke patients, into the Slovenian language. Methods: We performed a 5-step translation and adaptation process. Six speech and language pathologists had evaluated 30 clinical records of patients with an acute ischemic stroke in the carotid artery territory with the Slovenian translation of the Functional Oral Intake Scale (FOIS-SI). Every clinical record included a speech and language clinical bedside assessment of dysphagia, the sex, age, National Institutes of Health Stroke Scale (NIHSS), comorbidities of patients and lesion location. We examined interrater and intrarater reliability and additionally convergent validity of FOIS-SI with the theoretically related IDDSI-Functional Diet Scale (IDDSI-FDS). Results: The average measure Intraclass Correlation Coefficient (ICC) for the interrater reliability (ICC=0.959) and the intrarater reliability (ICC=0.979 and ICC=0.991) for both raters was excellent. The FOIS-SI scores correlated very high with the IDDSI-FDS (rs=0.927). Conclusion: The results of this study show that the Slovenian translation of the FOIS has an excellent interrater and intrarater reliability and very high validity, which implies the FOIS-SI can be used as a tool to quantitatively assess the severity of dysphagia in clinical practice and research in patients with stroke in carotid artery territory across the country in all medical and care settings.
Journal ArticleDOI
TL;DR: The FCT provides a reliable and valid instrument for measuring pain severity and loss of the function in patients with chronic mechanical back pain and is considered that FCT is a simple and easy test in Patients with low education and advanced age.
Abstract: OBJECTIVES This study aims to determine the validity and reliability of the full cup test (FCT), evaluating the pain severity in patients with chronic low back pain. METHODS A total of 100 patients (70 women and 30 men) aged over 18 years with mechanical low back pain were enrolled in the study. Demographic and clinical characteristics were recorded. Pain severity was evaluated using the visual analog scale (VAS) and FCT, the functional state was assessed by the Oswestry Disability Index (ODI), and the quality of life was assessed using the Nottingham Health Profile (NHP). FCT was performed on the 1st day by two independent observers (G1 and G2) and 3 days after the first application, patients were readministered the FCT by G1. RESULTS The mean age of participants was 56.04±12.33 years and mean body mass index was 27.7±4.3 kg/m². The reliability of the FCT and intraclass correlation coefficient (ICC) was found to be 0.989 for intrarater compliance, ICC was found to be 0.984 for inter-rater compliance, and Cronbach's alpha reliability coefficient was α=0.994. External construct validity of the scale was confirmed with expected correlations with all subgroups of NHP except for social isolation, VAS and ODI (p<0.01). CONCLUSION This study concludes that the FCT provides a reliable and valid instrument for measuring pain severity and loss of the function in patients with chronic mechanical back pain. We consider that FCT is a simple and easy test in patients with low education and advanced age.
Journal ArticleDOI
18 Oct 2022
TL;DR: In this paper , the authors evaluated the reliability of video-based versus physical assessments of novices' surgical performances on human cadavers and 3D-printed models-an emerging simulation modality.
Abstract: Reliability is pivotal in surgical skills assessment. Video-based assessment can be used for objective assessment without physical presence of assessors. However, its reliability for surgical assessments remains largely unexplored. In this study, we evaluated the reliability of video-based versus physical assessments of novices' surgical performances on human cadavers and 3D-printed models-an emerging simulation modality.Eighteen otorhinolaryngology residents performed 2 to 3 mastoidectomies on a 3D-printed model and 1 procedure on a human cadaver. Performances were rated by 3 experts evaluating the final surgical result using a well-known assessment tool. Performances were rated both hands-on/physically and by video recordings. Interrater reliability and intrarater reliability were explored using κ statistics and the optimal number of raters and performances required in either assessment modality was determined using generalizability theory.Interrater reliability was moderate with a mean κ score of 0.58 (range 0.53-0.62) for video-based assessment and 0.60 (range, 0.55-0.69) for physical assessment. Video-based and physical assessments were equally reliable (G coefficient 0.85 vs. 0.80 for 3D-printed models and 0.86 vs 0.87 for cadaver dissections). The interaction between rater and assessment modality contributed to 8.1% to 9.1% of the estimated variance. For the 3D-printed models, 2 raters evaluating 2 video-recorded performances or 3 raters physically assessing 2 performances yielded sufficient reliability for high-stakes assessment (G coefficient >0.8).Video-based and physical assessments were equally reliable. Some raters were affected by changing from physical to video-based assessment; consequently, assessment should be either physical or video based, not a combination.
Journal ArticleDOI
G Greene1, A Green1
TL;DR: The intrarater reliability of a novice operator to measure the thickness of transversus abdominis when using brightness (B) mode ultrasound imaging indicates that additional training is required to achieve clinically meaningful results.
Abstract: Background: Transversus Abdominis (TrA) has an important role in spinal stability contributing to both intraabdominal pressure and the formation of a muscular corset around the spine. Transversus Abdominis has been shown to be dysfunctional in patients with low back pain (LBP) and ultrasound (US) imaging is seen to have an increasing role in the assessment and management of these patients. This study assessed the intrarater reliability of a novice operator to measure the thickness of transversus abdominis when using brightness (B) mode ultrasound imaging. Method: Twenty normal subjects participated in an operator blinded study to assess the intra-rater reliability of US in measuring the thickness of TrA when contracted using the abdominal hollowing exercise (AHE). Brightness (B) mode US was used to image the TrA at the end of expiration. Subjects were then re-imaged in the standardized position. Results: An intraclass correlation coefficient of 0.96 with 95% confidence intervals of 0.93- 0.98 were obtained indicating excellent reliability. However, limits of agreement were ‐ 1.52 mm to +1.35mm (range 2.87mm) suggesting that clinically meaningful measurements may not reliably be measured by a novice operator. Conclusion: This study indicates that additional training is required to achieve clinically meaningful results. It also highlights the importance of using more than one method of establishing reliability.

Network Information
Related Topics (5)
Rehabilitation
46.2K papers, 776.3K citations
69% related
Ankle
30.4K papers, 687.4K citations
68% related
Systematic review
33.3K papers, 1.6M citations
68% related
Activities of daily living
18.2K papers, 592.8K citations
68% related
Validity
13.8K papers, 776K citations
67% related
Performance
Metrics
No. of papers in the topic in previous years
YearPapers
202342
202278
202186
202083
201986
201867