Intra-rater reliability

About: Intra-rater reliability is a research topic. Over the lifetime, 2073 publications have been published within this topic receiving 140968 citations.

Intra-rater reliability and diagnostic accuracy of a new vaginal dynamometer to measure pelvic floor muscle strength in women with urinary incontinence

Abstract: The first choice treatment in urinary incontinence (UI) is rehabilitation of the pelvic floor in order to improve muscle strength. However, no entirely reliable instruments for quantifying pelvic floor muscle (PFM) strength are currently available. Our aim was to test the intra-rater reliability and diagnostic accuracy of a new vaginal dynamometer for measuring PFM strength. Methods: Test-retest reliability study. One hundred and four women with stress urinary incontinence (SUI) were recruited. Patients were excluded if they had a history consistent with urge urinary incontinence or pelvic organ prolapse, pregnancy, previous urogynecological surgery, severe vaginal atrophy, or neurological conditions. The examination comprised digital palpation quantified by the modified Oxford scale and by two consecutive dynamometry measurements obtained using a new prototype dynamometer. This instrument comprises a speculum in which an inductive displacement sensor (LVDTSM210.10.2.KTmodel, Schreiber) is attached to a spring of known stiffness constant (k). The intraclass correlation coefficient (ICC) was calculated to assess intra-rater reliability. Diagnostic accuracy was assessed using Receiver Operating Characteristics (ROC) curves analysis. Results: Of the 104 subjects included, 59.6% presented scores between 0–2 on the Oxford scale. Intra-rater reliability was 0.98 (95%CI: 0.97– 0.99). In the Bland & Altman plot, the distribution of disagreements was similar in the lowest and the highest strength values. The diagnostic accuracy of the dynamometer with regard to digital palpation showed an area under the curve of 0.85 (95%CI: 0.77–0.93). Conclusions: Our results suggest that this new vaginal dynamometer is a reliable and valid instrument for quantifying PFM strength.

Inter- and intra-rater reliability of blood and cerebrospinal fluid flow quantification by phase-contrast MRI.

Abstract: Purpose: To evaluate the intra- and inter-rater reliability of the quantification of blood and CSF flow rates by phase contrast MRI. Materials and Methods: Blood and CSF flows in the upper cervical region were imaged with velocity-encoded cine-phase contrast using 3T scanners from different manufacturers at two centers. Data of 6 subjects scanned in center A and of 5 subjects in center B were analyzed by six readers at two levels of training. Each data set was analyzed three times in a randomized order for a total of 33 data sets. Intra-class correlation coefficients (ICC) were calculated for the primary measurements of areas and flow rates through the main cervical arteries, veins and the CSF space, and for secondary parameters derived from the individual flow rates. Results: ICC ranged from 0.80 to 0.96 for the lumen area and from 0.97 to 0.99 for the volumetric flow rate. The ICC for the derived secondary measures ranged from 0.85 to 0.99. Differences due to operator level of training were not statistically significant. Conclusion: High intra- and inter-rater reliability of volumetric flow rate measurements is currently achievable across manufacturers and users' skill levels with a pulsatility based automated lumen segmentation. J. Magn. Reson. Imaging 2013;38:655–662. © 2013 Wiley Periodicals, Inc.

Hypertonia Assessment Tool.

Abstract: The Hypertonia Assessment Tool is a 7-item instrument that discriminates spasticity, dystonia, and rigidity on 3 levels: item scores, subtype, and hypertonia diagnosis for each extremity. We quantified the inter- and intrarater reliability using Kappa statistics, Gwet's first-order agreement coefficient (both with 95% confidence interval), and percentage agreement for all levels. For validity, we compared the Hypertonia Assessment Tool subtype with the clinical diagnosis provided by the physicians. Two physiotherapists tested 45 children with neuromotor disorders. The interrater reliability (n = 45) of the Hypertonia Assessment Tool subtype was moderate to substantial whereas the intrarater reliability (n = 42) was almost perfect. The Hypertonia Assessment Tool showed good agreement in detecting spasticity. On the contrary, there was a higher presence of dystonia of 24% to 25% tested with the Hypertonia Assessment Tool compared to the clinical diagnosis. Even some individual items showed lower agreement between raters; the Hypertonia Assessment Tool subtypes and diagnosis were reliable. Validity of the Hypertonia Assessment Tool to test spasticity is confirmed, whereas, for dystonia and rigidity, further studies are needed.