Showing papers on "Intra-rater reliability published in 2021"

Interrater and Intrarater Reliability of the Beighton Score: A Systematic Review.

Abstract: Background:The Beighton score is commonly used to assess the degree of hypermobility in patients with hypermobility spectrum disorder. Since proper diagnosis and treatment in this challenging patie...

Objective and Subjective Clinical Swallowing Outcomes via Telehealth: Reliability in Outpatient Clinical Practice.

Abstract: Purpose The COVID-19 pandemic has drastically increased the use of telehealth Prior studies of telehealth clinical swallowing evaluations provide positive evidence for telemanagement of swallowing However, the reliability of these measures in clinical practice, as opposed to well-controlled research conditions, remains unknown This study aimed to investigate the reliability of outcome measures derived from clinical swallowing tele-evaluations in real-world clinical practice (eg, variability in devices and Internet connectivity, lack of in-person clinician assistance, or remote patient/caregiver training) Method Seven raters asynchronously judged clinical swallowing tele-evaluations of 12 movement disorders patients Outcomes included the Timed Water Swallow Test (TWST), Test of Masticating and Swallowing Solids (TOMASS), and common observations of oral intake Statistical analyses were performed to examine inter- and intrarater reliability, as well as qualitative analyses exploring patient and clinician-specific factors impacting reliability Results Forty-four trials were included for reliability analyses All rater dyads demonstrated "good" to "excellent" interrater reliability for measures of the TWST (intraclass correlation coefficients [ICCs] ≥ 93) and observations of oral intake (≥ 77% agreement) The majority of TOMASS outcomes demonstrated "good" to "excellent" interrater reliability (ICCs ≥ 84), with the exception of the number of bites (ICCs = 43-99) and swallows (ICCs = 21-85) Immediate and delayed intrarater reliability were "excellent" for most raters across all tasks, ranging between ICCs of 63 and 100 Exploratory factors potentially impacting reliability included infrequent instances of suboptimal video quality, reduced camera stability, camera distance, and obstruction of the patient's mouth during tasks Conclusions Subjective observations of oral intake and objective measures taken from the TWST and the TOMASS can be reliably measured via telehealth in clinical practice Our results provide support for the feasibility and reliability of telehealth for outpatient clinical swallowing evaluations during COVID-19 and beyond Supplemental Material https://doiorg/1023641/asha13661378

Intra-rater and inter-rater reliability of neutral and target lumbar positioning tests in subjects with and without non-specific lower back pain.

Abstract: Background Proprioception, one's sense of movement and position, is a common term used in back rehabilitation. Kinesthetic rehabilitation may be useful in managing lower back pain; however, reliable measures are required to quantify lumbar proprioception sense. Objective To investigate intrarater and interrater reliability of neutral lumbar positioning (NLP) and target lumbar positioning (TLP) tests and compare the position sense errors in subjects with non-specific low back pain and healthy controls. Methods Intrarater (between-day) and interrater (within-day) reliability of NLP and TLP tests were assessed in 30 subjects with low back pain and 30 healthy subjects using a digital inclinometer. NLP is evaluated when the subject is repositioned to neutral from flexion, while TLP is evaluated in lumbar flexion, by bending laterally left and right. Results Intrarater reliability for NLP tests had ICC values of 0.85 and 0.89 and TLP tests had 0.78 and 0.92. Likewise, interrater reliability for NLP had ICC values of 0.75 and 0.85, and for the TLP test, the interrater reliability had 0.78 and 0.93. Subjects with back pain had significantly larger neutral and target lumbar proprioceptive errors compared to healthy controls (p Conclusions Intrarater and interrater reliability showed good agreement for both NLP and TLP tests of lumbar proprioception. Subjects with nonspecific low back pain have impaired lumbar proprioceptive sense.

A Comparative Analysis of 150 Thumb Polydactyly Cases from the CoULD Registry Using the Wassel-Flatt, Rotterdam, and Chung Classifications.

Abstract: Purpose Three commonly used classifications for thumb polydactyly are the Wassel-Flatt, Rotterdam, and Chung. The ideal classification system would have high validity and reliability and be descriptive of the thumb anomaly. The purposes of this investigation were to (1) compare the inter- and intrarater reliability of these 3 classifications when applied to a large sample of patients enrolled in the Congenital Upper Limb Differences (CoULD) Registry and (2) determine the prevalence of radial polydactyly types when using the various classifications in a North American population. Methods Inter- and intrarater reliability were determined using 150 cases of radial polydactyly presented in a Web-based format to 7 raters in 3 rounds, a preliminary training round and 2 observation rounds. Raters classified each case according to the Wassel-Flatt, Rotterdam, and Chung classifications. Inter- and intrarater reliability were evaluated with the intraclass correlation coefficient (ICC) calculated using 2-way random measures with perfect agreement. Results For Wassel-Flatt, both the interrater (ICC, 0.93) and the intrarater reliability (ICC, 0.91) were excellent. The Rotterdam classification had excellent reliability for both interrater reliability (ICC, 0.98) and intrarater reliability (ICC, 0.94), when considering type alone. Interrater analysis of the additional subtypes demonstrated a wide range of reliabilities. The Chung classification had good interrater (ICC, 0.88) and intrarater reliability (ICC, 0.77). Within the Wassel-Flatt classification, the most frequent unclassifiable thumb was a type IV hypoplastic thumb as classified by the Rotterdam classification. Conclusions The Wassel-Flatt and Rotterdam classifications for radial polydactyly have excellent inter- and intrarater reliability. Despite its simplicity, the Chung classification was less reliable in comparison. The Chung and Rotterdam classification systems capture the hypoplastic subtypes that are unclassifiable in the Wassel-Flatt system. Addition of the hypoplastic subtype to the Wassel-Flatt classification (eg, Wassel-Flatt type IVh) would maintain the highest reliability and classify over 90% of thumbs deemed unclassifiable in the Wassel-Flatt system. Clinical relevance The Wassel-Flatt and Rotterdam classifications have excellent inter-and intrarater reliability for the hand surgeon treating thumb polydactyly. Addition of a hypoplastic subtype to the Wassel-Flatt (Type 4h) allows classification of most previously unclassifiable thumbs.

Assessment of Inter- and Intra-Rater Reliability of Tablet-Based Software to Measure Cochlear Duct Length.

Abstract: OBJECTIVE The objective of this study is to build upon previous work validating a tablet-based software to measure cochlear duct length (CDL). Here, we do so by greatly expanding the number of cochleae (n = 166) analyzed, and examined whether computed tomography (CT) slice thickness influences reliability of CDL measurements. STUDY DESIGN Retrospective chart review study. SETTING Tertiary referral center. PATIENTS Eighty-three adult cochlear implant recipients were included in the study. Both cochleae were measured for each patient (n = 166). INTERVENTIONS Three raters analyzed the scans of 166 cochleae at 2 different time points. Each rater individually identified anatomical landmarks that delineated the basal turn diameter and width. These coordinates were applied to the elliptic approximation method (ECA) to estimate CDL. The effect of CT scan slice thickness on the measurements was explored. MAIN OUTCOME MEASURES The primary outcome measure is the strength of the inter- and intra-rater reliability. RESULTS The mean CDL measured was 32.84 ± 2.03 mm, with a range of 29.03 to 38.07 mm. We observed no significant relationship between slice thickness and CDL measurement (F1,164 = 3.04; p = 0.08). The mean absolute difference in CDL estimations between raters was 1.76 ± 1.24 mm and within raters was 0.263 ± 0.200 mm. The intra-class correlation coefficient (ICC) between raters was 0.54 and ranged from 0.63 to 0.83 within raters. CONCLUSIONS This software produces reliable measurements of CDL between and within raters, regardless of CT scan thickness.

Modified Clavien-Dindo-sink classification system for adolescent idiopathic scoliosis.

Abstract: The Clavien–Dindosink (CDS) classification system provides more treatment-focused granularity than subjective methods of describing surgical complications; however, it has not been validated in posterior spinal fusion (PSF) for adolescent idiopathic scoliosis (AIS). The purpose of this study was to modify the CDS system for application in patients with AIS undergoing PSF to assess its inter- and intra-rater reliability for describing complications faced by this population. A review of all complications specific to patients with AIS captured in a large multicenter international database was performed. All complications were classified according to CDS, modified by addition of “prolonged initial hospital stay” as a criterion for Grade II. A survey of this complication list and an additional 20 clinical vignettes (sent out on two occasions) was sent to nine spinal deformity surgeons. Weighted kappa values were used to determine inter- and intra-rater reliability. The Fleiss κ value for interrater reliability among 5 respondents grading all AIS complications was 0.8 (very good). For each grade, interrater reliability was very good, with an overall range of 0.8–1. The overall kappa value for intrarater reliability among eight respondents grading 20 vignettes was between 0.6 (good) and 0.9 (very good). The modified CDS classification system has very good interrater and intrarater reliability in describing complications following PSF in patients with AIS. This system may be of greater utility for reporting outcomes than a “major” versus “minor” complication system and can serve as a valuable tool for improving surgical practices and patient outcomes in this population. IV case series.

Evaluating a Muscle Ultrasound Education Program: Theoretical Knowledge, Hands-on Skills, Reliability, and Satisfaction of Critical Care Physiotherapists.

Abstract: Objective To evaluate learning results of critical care physiotherapists participating in a muscle ultrasound (MUS) educational program. Design Cross-sectional study. Setting A custom-made 20-hour MUS course was performed over a 2-week time period, including knobs familiarization, patient positioning, anatomic landmarks, image acquisition, and limb muscle measurements. Participants Nineteen critical care physiotherapists with little to no prior experience in ultrasound (N=19). Interventions Not applicable. Main Outcome Measures Theoretical knowledge, hands-on skills acquisition, and satisfaction were assessed. Inter- and intrarater reliability on landmarks, thickness, and pennation angle of quadriceps between participants was evaluated using intraclass correlation coefficients (ICCs). Reliability among instructors measured prior to the course was also reported as a reference. Results The percentage score (mean±SD) of knowledge questionnaires was 69±11 (pre-course), 89±10 (post-course), and 92±9 (hands-on skills). Course satisfaction scores ranged from 90%-100%. Pooled interrater reliability of participants (median ICC [interquartile range]) was good (0.70 [0.59-0.79]) for thickness, moderate (0.47 [0.46-0.92]) for landmarks, and absent (0.00 [0.00-0.05]) for pennation angle and the intrarater reliability was good (0.76 [0.51-0.91]) for thickness and weak (0.35 [0.29-0.52]) for pennation angle. Interrater ICC values for instructors were excellent (0.90) for thickness, good (0.67) for landmarks, and moderate (0.41) for pennation angle and intrarater ICC values were excellent (0.94) for thickness and good (0.75) for pennation angle. Conclusions Although our sample was quite small and homogeneous, increased theoretical knowledge, high hands-on performance acquisition, and good satisfaction of physiotherapists were observed. Reliability was moderate to excellent for thickness and landmarks and absent to weak for pennation angle. Landmarking and pennation angle remain challenges for physiotherapist training in the application of MUS. Further studies are needed to identify variables that could modify reliability during MUS training.

Intrarater Reliability and Agreement of Recommended Performance-Based Tests and Common Muscle Function Tests in Knee Osteoarthritis.

Abstract: Background and purpose Some uncertainty persists regarding the reproducibility of the recommended core set of performance-based tests, as well as common muscle function tests, when applied in individuals with knee osteoarthritis (KOA). The purpose of this study was to investigate the intrarater reliability and agreement of the recommended core set of performance-based tests and common muscle function tests in KOA. Methods Participants (N=40) with radiographic and/or symptomatic KOA were evaluated twice with a 3-day interval between test sessions using the following tests: Leg extensor (LE) maximal muscle power measured in a Nottingham Power Rig; knee extensor (KE) peak isometric strength measured with a handheld dynamometer; 40-m walk test; 30-second chair-stand test; and 9-step stair climb test. Reliability was assessed using a 2-way, mixed-effects, single-measures model (3,1), absolute agreement-type intraclass correlation coefficient (ICC). Agreement was assessed using 95% limits of agreement (LOA) and LOA relative to the mean score from test and retest (LOA-%). Results Reliability for all tests was very high (ICC ≥ 0.97). LOA (LOA-%) was ±32.3 watt (W) (±22%) for LE power; ±22.7 N·m (±24%) for KE strength; ±0.2 m/s (±10%) for 40-m walk test; ±2.4 repetitions (±14%) for 30-second chair-stand test; and ±2 second (±20%) for stair climb test. A potential participant learning effect was found for all 3 performance-based tests, indicated by the significantly better scores at retest. Discussion The very high reliability found for the performance-based tests supports findings from previous studies and confirms discriminate reliability of these tests on a group level. Also, very high reliability estimates were demonstrated for both muscle function tests. This study also provided estimates of agreement for both performance-based and muscle function tests, which are important to consider when using these tests on an individual level in clinical practice. Conclusion When using these tests to monitor changes over time in the clinic, depending on the test, improvements of less than 10% to 24% could be a result of measurement error alone and therefore may not be considered an actual improvement after treatment.

Reliability and Validity of a New Toileting Assessment Form for Patients with Hemiparetic Stroke.

Abstract: BACKGROUND Acquiring toileting independence is an important target of stroke rehabilitation. In planning an intervention for acquiring toileting independence, developing an assessment for individual subtasks that comprise toileting would assist in identifying specific tasks that prevent independence in patients and would facilitate interventions to improve toileting independence. OBJECTIVE To examine the reliability and validity of a newly developed toileting assessment form, the Toileting Tasks Assessment Form (TTAF), for assessing toileting subtasks in hemiparetic stroke. DESIGN Validation and test-retest study. SETTING Subacute rehabilitation wards in Japan. PARTICIPANTS Eighty-two therapists verified the form's content validity; 30 stroke patients who were using a wheelchair participated in the validation and test-retest study. INTERVENTIONS Not applicable. MAIN OUTCOME MEASURES The content validity of the assessment form was initially assessed based on a questionnaire. Subsequently, four occupational therapists used the form to evaluate video-recorded toileting performances simulated by participants with hemiparetic stroke. Two assessors evaluated each video-recorded performance once and repeated the evaluation of the same performance at 2 weeks later. The interrater reliability, intrarater reliability, internal consistency, and concurrent validity of the form were examined. RESULTS Fleiss' κ coefficient for interrater reliability for each form item was 0.61 or more. Cohen's κ coefficient for intrarater reliability for each item was 0.60 or more. Cronbach's coefficient alpha ranged from 0.94 to 0.95. Spearman's rank correlation coefficients for the mean score on the form and the Functional Independence Measure (FIM) score for "toileting" ranged from 0.88 to 0.93 (P < .001). Spearman's rank correlation coefficients for the mean score on the form and the FIM score for "toilet transfer" ranged from 0.91 to 0.93 (P < .001). CONCLUSIONS The TTAF demonstrated good reliability and validity. Further multicenter studies involving patients at different stroke phases are required to verify the reliability and validity of TTAF and confirm the generalizability of these findings.

The Diagnostic Arthroscopy Skill Score (DASS): a reliable and suitable assessment tool for arthroscopic skill training

Abstract: To develop and validate a novel score to more objectively assess the performance of diagnostic knee arthroscopy using a simulator. A Diagnostic Arthroscopy Skill Score (DASS) was developed by ten AGA (AGA-Society for Arthroscopy and Joint-Surgery) instructors for the assessment of arthroscopic skills. DASS consists of two parts: the evaluation of standardized diagnostic knee arthroscopy (DASSpart1) and the evaluation of manual dexterity, including ambidexterity and triangulation, using objective measurement parameters (DASSpart2). Content validity was determined by the Delphi method. One hundred and eleven videos of diagnostic knee arthroscopies were recorded during simulator training courses and evaluated by six specially trained instructors using DASS. Construct validity, measurement error calculated by the minimum detectable change (MDC), internal consistency using Cronbach’s alpha and interrater and intrarater reliability were assessed. The Bland–Altman method was used to calculate the intrarater agreement. Six skill domains were identified and evaluated for each knee compartment. DASS, DASSpart1, and DASSpart2 showed construct validity, with experts achieving significantly higher scores than competents and novices. MDC was 4.5 ± 1.7 points for DASSpart1. There was high internal consistency for all domains in each compartment from 0.78 to 0.86. The interrater reliability showed high agreement between the six raters (ICC = 0.94). The evaluation of intrarater reliability demonstrated good and excellent agreement for five raters (ICC > 0.80) and moderate agreement for one rater (ICC = 0.68). The Bland–Altman comparison showed no difference between the first and second evaluations in five out of six raters. Precision, estimated by the regression analysis and comparison with the method of Bland and Altman, was excellent for four raters and moderate for two raters. The results of this study indicate good validity and reliability of DASS for the assessment of the surgical performance of diagnostic knee arthroscopy during simulator training. Standardized training is recommended before arthroscopy surgery is considered in patients. II.

Measuring the Acetabular Index: An Accurate and Reliable Alternative Method of Measurement.

Abstract: OBJECTIVE. In children (4 months to 8 years old), radiographic measurements of the acetabular index are the preferred method to assess developmental hip dysplasia. However, the acetabular index has been criticized as having variable reliability owing to difficulty identifying the correct anatomic landmarks. An alternative method of measuring the acetabular index using the ischium is being proposed to avoid the variability of the triradiate cartilage line as a reference point. With the alternative method, the acetabular index is derived by measuring the angle between a line connecting the ischial tuberosi-ties and a line connecting the inferomedial and superolateral edges of the acetabulum. The purpose of this study was to evaluate the accuracy and reliability of this alternative method of measuring the acetabular index compared with the traditional method. MATERIALS AND METHODS. Children 4 months to 8 years old who presented for evaluation of developmental dysplasia of the hip were included. Two physicians, each using both the traditional and the alternative method, measured acetabular indexes on all radiographs. Accuracy was defined as mean absolute error less than 6°. Reliability was calculated by means of intraclass correlation coefficient (ICC). RESULTS. Pelvic radiographs of 40 children (324 hips) were included. The mean age was 23.7 months (range, 4-96 months) and mean acetabular index was 24.2° (range, 8-50°). The alternative method was associated with mean absolute error of 2.50°, which is significantly below the threshold of 6° (t < 0.001). Intrarater reliability for the traditional method was high (ICC, 0.81) and for the alternative method was very high (ICC, 0.92). Interrater reliability for the traditional method was high (ICC, 0.89) and for the alternative method was very high (ICC, 0.91). CONCLUSION. Measuring the acetabular index using the alternative method has very high accuracy and intrarater and interrater reliability.

Inter-rater and Intrarater Reliabilities of the Identification of a "Gothic Arch" in the Acetabulum of Children With Cerebral Palsy.

Abstract: BACKGROUND Progressive hip displacement in children with cerebral palsy (CP) is monitored by measuring migration percentage (MP) on anteroposterior (AP) pelvis radiographs Accurate measurement of MP requires the lateral margin of the ossified acetabulum to be identified for the placement of Perkin's line It has been suggested that when there is an erosion of the acetabular rim, described as a gothic arch, the midpoint of the arch be used for the placement of Perkin's line However, this requires that there be agreement on what constitutes a gothic arch The purpose of this study was to evaluate the inter-rater and intrarater reliabilities of identifying a gothic arch on pelvis radiographs METHODS An online survey with 100 AP pelvis images (200 hips) of children with CP was sent to international experts Participants were asked to identify which hip(s) had a gothic arch (left, right, both, and neither) The Fleiss κ statistic for inter-rater reliability was calculated Eight weeks later, the images were shuffled and redistributed to calculate intrarater reliability RESULTS The initial survey was completed by 10 participants with 9 participants completing the second survey The average inter-rater κ value was 018 [95% confidence interval (CI), 014-023] and 019 (95% CI, 014-024) for the 2 surveys, respectively Among the pediatric orthopaedic surgeons subgroup, the κ values were 006 (95% CI, 002-01) and 008 (95% CI, 003-013) The average intrarater reliability κ value was 061 (95% CI, 02-1), ranging from 032 to 086 CONCLUSIONS There were poor inter-rater and moderate intrarater reliabilities in identifying a gothic arch on AP pelvis radiographs in children with CP Further characterization and clarification of what constitutes a gothic arch are required The lack of agreement on the identification of a gothic arch may negatively impact the measurement of MP and referrals to a pediatric orthopaedic surgeon

An assessment of the hopping strategy and inter-limb asymmetry during the triple hop test: a test–retest pilot study

Abstract: The aims of the present study are to: (1) determine within- and between-session reliability of multiple metrics obtained during the triple hop test; and (2) determine any systematic bias in both the test and inter-limb asymmetry scores for these metrics. Thirteen male young American football athletes performed three trials of a triple hop test on each leg on two separate occasions. In addition to the total distance hopped, manual detection of touch down and toe-off were calculated via video analysis, enabling flight time (for each hop), ground contact time (GCT), reactive strength index (RSI), and leg stiffness (between hops) to be calculated. Results showed all coefficient of variation (CV) values were ≤ 10.67% and intraclass correlation coefficients (ICC) ranged from moderate to excellent (0.53–0.95) in both test sessions. Intrarater reliability showed excellent reliability for all metrics (CV ≤ 3.60%, ICC ≥ 0.97). No systematic bias was evident between test sessions for raw test scores (g = −0.34 to 0.32) or the magnitude of asymmetry (g = −0.19 to 0.43). However, ‘real’ changes in asymmetry (i.e., greater than the CV in session 1) were evident on an individual level for all metrics. For the direction of asymmetry, kappa coefficients revealed poor-to-fair levels of agreement between test sessions for all metrics (K = −0.10 to 0.39), with the exception of the first hop (K = 0.69). These data show that, given the inherent limitations of distance jumped in the triple hop test, practitioners can confidently gather a range of reliable data when computed manually, provided sufficient test familiarization is conducted. In addition, although the magnitude of asymmetry appears to show only small changes between test sessions, limb dominance does appear to fluctuate between test sessions, highlighting the value of also monitoring the direction of the imbalance.

A new modular radiographic classification of adult idiopathic scoliosis as an extension of the Lenke classification of adolescent idiopathic scoliosis.

Abstract: To propose and test the reliability of a radiographic classification system for adult idiopathic scoliosis. A three-component radiographic classification for adult idiopathic scoliosis consisting of curve type, a lumbosacral modifier, and a global alignment modifier is presented. Twelve spine surgeons graded 30 pre-marked cases twice, approximately 1 week apart. Case order was randomized between sessions. The interrater reliability (Fleiss’ kappa coefficient) for curve type was 0.660 and 0.798, for the lumbosacral modifier 0.944 and 0.965, and for the global alignment modifier 0.922 and 0.916, for round 1 and 2 respectively. Mean intrarater reliability was 0.807. This new radiographic classification of adult idiopathic scoliosis maintains the curve types from the Lenke classification and introduces the lumbosacral and global alignment modifiers. The reliability of the lumbosacral modifier and global alignment modifier shows near perfect agreement, and sets the foundation for further studies to validate the reliability, utility, and applicability of this classification system.

Validity and Intrarater Reliability Using a Smartphone Clinometer Application to Measure Active Cervical Range of Motion Including Rotation Measurements in Supine

Abstract: CONTEXT Technological advances have given smartphones the capabilities of sensitive clinical measurement equipment at lesser cost and higher availability. The Clinometer is a smartphone application that can be used to measure the joint range of motion in a clinical setting, but psychometric properties of the tool's use measuring cervical range of motion (CROM) are not established. OBJECTIVES The purpose of this study was to examine the validity and intrarater reliability of the Clinometer application for the measurement of CROM (ie, flexion, extension, rotation, lateral flexion) and to determine the minimal detectable change and SEM. DESIGN A blinded, repeated-measures correlational design was employed. SETTING The study was conducted collaboratively between 2 athletic training clinics. PARTICIPANTS A convenience sample of healthy adults ages 18-30 years were recruited. Participants with any history in the last 3 months of cervical or thoracic pathology, pain, or any musculoskeletal injury were excluded. MAIN OUTCOME MEASURES Three repetitions of each motion were measured by a primary researcher with a goniometer. The same researcher then conducted 3 blinded measurements with the Clinometer application following the same procedure. A second researcher, blinded to the goniometer measurements, recorded the results. Thirty minutes later, testing was repeated with the application. The Pearson correlation was calculated to determine validity of the application compared with goniometry. RESULTS The measurements between devices had moderate to excellent concurrent validity, with the coefficients ranging between 0.544 and 0.888, P < .01. Test-retest reliability of the CROM measurement using the application was moderate to excellent, with intraclass correlation coefficients ranging between .774 and .928. Across all movements, the SEM ranged from 1.17° to 2.01°, and the minimal detectable change ranged from 1.18° to 2.02°. CONCLUSION The Clinometer application is a valid and reliable instrument for measuring active CROM. LEVEL OF EVIDENCE clinical measurement, level 1b.

Reliability of Quadriceps Femoris Muscle Strength Assessment Using a Portable Dynamometer and Protocol Tolerance in Patients With Chronic Obstructive Pulmonary Disease

Abstract: OBJECTIVE This study aimed to evaluate the intrarater and interrater reliability of isometric quadriceps strength (IQS) using a portable dynamometer in individuals with chronic obstructive pulmonary disease (COPD) and to verify their tolerance to the protocol. METHODS A cross-sectional reliability study was conducted with 50 individuals with stable COPD (34 men and 16 women; mean age = 70 years [SD = 8]). The main outcome measure was obtained using a portable dynamometer (Microfet 2) to assess IQS. Two masked raters performed 2 assessments in the dominant lower limb on 2 nonconsecutive days. The intraclass correlation coefficient (ICC) was used to verify the intrarater and interrater reliability and was considered excellent when >0.90, with a 5% significance level. RESULTS Rater 1 and 2 intrarater reliability was as follows: ICC = 0.96 (95% CI = 0.94 to 0.98) and ICC = 0.97 (95% CI = 0.95 to 0.98), respectively. The interrater reliability was as follows: ICC = 0.96 (95% CI = 0.93 to 0.98). The minimum detectable difference was 4 to 5 peak isometric strength, in mean, for intrarater and interrater reliability. Not all patients presented relevant changes in physiological responses, dyspnea, and lower limb fatigue. CONCLUSION There was an excellent intrarater and interrater reliability for IQS, and the participants tolerated the protocol. IMPACT This tool can be used to assess quadriceps strength in clinical practice in patients with COPD.

Visual assessment of movement quality: a study on intra- and interrater reliability of a multi-segmental single leg squat test.

Abstract: Background The Single Leg Squat test (SLS) is a common tool used in clinical examination to set and evaluate rehabilitation goals, but there is not one established SLS test used in the clinic. Based on previous scientific findings on the reliability of the SLS test and with a methodological rigorous setup, the aim of the present study was to investigate the intra- and interrater reliability of a standardised multi-segmental SLS test. Methods We performed a study of measurement properties to investigate the intra- and interrater reliability of a standardised multi-segmental SLS test including the assessment of the foot, knee, pelvis, and trunk. Novice and experienced physiotherapists rated 65 video recorded SLS tests from 34 test persons. We followed the Quality Appraisal for Reliability Studies checklist. Results Regardless of the raters experience, the interrater reliability varied between "moderate" for the knee variable (ĸ = 0.41, 95% CI 0.10-0.72) and "almost perfect" for the foot (ĸ = 1.00, 95% CI 1.00-1.00). The intrarater reliability varied between "slight" (pelvic variable; ĸ = 0.17, 95% CI -0.22-0.55) to "almost perfect" (foot variable; ĸ = 1.00, 95% CI 1.00-1.00; trunk variable; ĸ = 0.82, 95% CI 0.66-0.97). A generalised kappa coefficient including the values from all raters and segments reached "moderate" interrater reliability (ĸ = 0.52, 95% CI 0.43-0.61), the corresponding value for the intrarater reliability reached "almost perfect" (ĸ = 0.82, 95% CI 0.77-0.86). Conclusions The present study shows a "moderate" interrater reliability and an "almost perfect" intrarater reliability for the variable all segments regardless of the raters experience. Thus, we conclude that the proposed standardised multi-segmental SLS test is reliable enough to be used in an active population.

Concurrent Validity and Reliability of a Handheld Dynamometer in Measuring Isometric Shoulder Rotational Strength

Abstract: Context Measuring isometric shoulder rotational strength is clinically important for evaluating motor disability in athletes with shoulder injuries. Recent evidence suggests that handheld dynamometry may provide a low-cost and portable method for the clinical assessment of isometric shoulder strength. Objective To investigate the concurrent validity and the intrarater and interrater reliability of handheld dynamometry for measuring isometric shoulder rotational strength. Design Cross-sectional study. Setting Biomechanics laboratory. Participants Thirty-nine young, healthy participants. Main outcome measures The peak isometric strength of the internal rotators and external rotators, measured by handheld dynamometry (in newton) and isokinetic dynamometry (in newton meter). Interventions Maximal isometric shoulder rotational strength was measured as participants lay supine with 90° shoulder abduction, neutral rotation, 90° elbow flexion, and forearm pronation. Measurements were performed independently by 2 different physiotherapists and in 3 different sessions to evaluate interrater and intrarater reliability. The data obtained by handheld dynamometry were compared with those obtained by isokinetic testing to evaluate concurrent validity. Results The intraclass correlation coefficients for interrater reliability in measuring maximum isometric shoulder external and internal rotation strength were .914 (95% confidence interval [CI], .842-.954) and .842 (95% CI, .720-.914), respectively. The intrarater reliability values of the method for measuring maximal shoulder external and internal rotation strength were 0.865 (95% CI, 0.757-0.927) and 0.901 (95% CI, 0.820-0.947), respectively. The Pearson correlation coefficients between the handheld and isokinetic dynamometer measurements were .792 (95% CI, .575-.905) for external rotation strength and .664 (95% CI, .419-.839) for internal rotation strength. Conclusions The handheld dynamometer showed good to excellent reliability and moderate to good validity in measuring maximum isometric shoulder rotational strength. Therefore, handheld dynamometry could be acceptable for health and sports professionals in field situations to evaluate maximum isometric shoulder rotational strength.

Are visual inspection and digital palpation reliable methods to assess ability to perform a pelvic floor muscle contraction? An intra‐rater study

Abstract: AIMS To investigate the intrarater reliability of visual inspection and digital palpation to classify women's ability to perform a voluntary pelvic floor muscle (PFM) contraction and the association between the two methods. METHODS This was a test-retest clinical study including 44 women. The ability to perform a PFM voluntary contraction was evaluated two times in all participants using visual inspection and digital palpation. All analyzed participants were assessed with a 7-day interval between the two assessments and by the same examiner. Kappa's agreement coefficient was used to estimate the intrarater reliability, and Fisher's exact test was used to analyze association between the two methods. RESULTS This study found a substantial intrarater reliability of visual inspection (k = 0.73; p < .001) and digital palpation (k = 0.74; p < .001). A significant association between visual inspection and digital palpation was found at both time points (p < .001). CONCLUSION Both visual inspection and digital palpation have substantial intrarater reliability and visual inspection can be recommended when vaginal palpation is not tolerated.

Inter and intra-rater reliability of measuring photometric craniovertebral angle using a cloud-based video communication platform

Abstract: Objective: Due to social distancing guidelines during the Coronavirus (COVID-19) pandemic, most providers and patients have wanted to avoid close contact. This makes physical therapy (PT) assessments difficult because of the lack of empirical evidence about the reliability of various clinical measurements performed in a virtual environment. One such procedure is the photometric measurement of craniovertebral (CV) angle. Craniovertebral angle measurement is usually performed in an outpatient setting and is defined as the acute angle formed between a straight line connecting the spinous process of C7 to the tragus of the ear, and the horizontal line passing through the spinous process of the C7. Although the photometric measurement of CV angles is considered both valid and reliable in the clinics, no empirical evidence exists about the CV angle measurement reliability when performed in a virtual environment. Thus, the purpose of this study was to assess the inter- and intra-rater reliability of photometric CV angle measurement using a cloud-based video communication platform. Number of Subjects: 66 subjects (57 females). Methods: All measurements were performed by two final year PT students who had completed the musculoskeletal part of the curriculum and were blinded to each other’s measurements. Each subject was photographed in two postures over a HIPAA-compliant video-based telehealth platform: (1) normal/ relaxed posture and (2) ideal posture (posture the subject considered good). Student researcher 1 measured the CV angle in both the relaxed posture and ideal posture, while student researcher 2 measured the CV angle only in the relaxed posture. Each subject's CV angle measurement was performed three times on three separate days and the means were used for further analysis. The shape of the CV angle frequency distribution was assessed using kurtosis and skewness values. Rater reliability was assessed using intraclass correlation coefficients (ICC), and interpreted based on the guidelines provided by Portney and Watkins (2009). Results: The CV angles were normally distributed in both relaxed and ideal postures. The mean and standard deviation (SD) of relaxed posture was 50.7o ± 6.3o with kurtosis and skewness of 0.67 and -0.74 respectively. The mean and SD of ideal posture was 55.5o ± 5.4o, with kurtosis and skewness of 0.1 and -0.54 respectively. The ICC for inter-rater reliability in the relaxed posture was 0.88 and the ICC for intra-rater reliability for relaxed posture was 0.91. Conclusion: Craniovertebral angles were normally distributed in the sample. An acceptable level of inter- and intra-rater reliability can be attained when measuring CV angle using a cloud-based video communication platform.

Limited intrarater and interrater reliability of acute ligamentous ankle injuries on 3 T MRI

Abstract: Objectives To determine the diagnostic reliability of the Schneck grading system for acute ligamentous injuries of (1) the three major ligamentous ankle complexes, (2) the individual ankle ligaments and (3) the Sikka classification for syndesmosis injury. Methods All acute ankle injuries in adult athletes (≥18 years), presenting to the outpatient department of a specialised Orthopaedic and Sports Medicine Hospital, within 7 days postinjury were screened for inclusion. Ankle injuries were excluded if imaging demonstrated a frank ankle fracture or if the 3 T MRI study could not be acquired within 10 days postinjury. Two radiologists graded the three major ligamentous complexes (lateral ankle complex, deltoid complex and syndesmosis complex) and their comprising individual ligaments according the four-grade Schneck grading system. Syndesmotic injuries were classified according the four-grade Sikka classification for consequent injury of the individual syndesmosis ligaments and the deltoid complex. Agreement and kappa (K) statistics were calculated to determine intrarater and interrater reliability. Results Between September 2016 and September 2018, a total of 92 MR scans were obtained (87 patients). Interrater and intrarater reliability of the Schneck grading system was moderate to substantial for the lateral ankle complex (K=0.47–0.76), fair to almost perfect for the syndesmosis complex (K=0.37–0.89) and fair to moderate for the deltoid complex (K=0.14–0.51). For the individual ligaments, kappa values ranged from moderate to substantial for the anterior talofibular ligament (ATFL) (K=0.55–0.73), fair to substantial for the calcaneofibular ligament (K=0.31–0.62) and fair to almost perfect for the anteroinferior tibiofibular ligament (AITFL) (K=0.36–0.89). Diagnostic reliability of the Sikka classification ranged from moderate to almost perfect (K=0.51–0.95). Conclusions Grading of the three major ligamentous complexes and of the individual ankle ligaments according the Schneck grading system resulted in limited diagnostic reliability. When dichotomised for the presence of complete discontinuity, the interrater reliability of the Schneck grading system improved to substantial and almost perfect for the ATFL and AITFL, respectively. Classification of syndesmosis injury according the Sikka classification resulted in moderate interrater reliability.