Showing papers on "Reliability (statistics) published in 1990"
TL;DR: In this paper, a new adaptive interpolation scheme is proposed which enables fast and accurate representation of the system behavior by a response surface (RS), which utilizes elementary statistical information on the basic variables (mean values and standard deviations) to increase the efficiency and accuracy.
1,089 citations
TL;DR: In this paper, the reliability and validity of the typology of strategic orientations was evaluated using data collected at two points from over 400 organizations in the hospital industry, using both perceptual self-typing and archival data from multiple sources.
Abstract: Despite the widespread research use of Miles and Snow's typology of strategic orientations, there have been no systematic attempts to assess the reliability and validity of its various measures. The present work provides such an assessment using data collected at two points from over 400 organizations in the hospital industry. We examined dimensions of the typology using both perceptual self-typing and archival data from multiple sources. The results generally support predictions across a variety of measures. Implications for further testing and research are discussed.
672 citations
TL;DR: The reliability and trustworthiness of software remain among the most controversial issues facing this age of high technology as discussed by the authors and the authors present some of the crucial questions faced by software programmers and eventual users.
Abstract: Methods and approaches for testing the reliability and trustworthiness of software remain among the most controversial issues facing this age of high technology The authors present some of the crucial questions faced by software programmers and eventual users
340 citations
TL;DR: To contribute to further advances in family assessment, researchers need to use both conceptual and psychometric criteria rather than rely too heavily on the pursuit of internal consistency reliability and factor analytic approaches to scale construction and validation.
Abstract: This article focuses on the reliability and validity of the Family Environment Scale (FES). The FES subscales generally show adequate internal consistency reliability and stability over time when applied in samples that are diverse; the items also have good content and face validity. An extensive body of research supports the construct, concurrent, and predictive validity of the FES. More generally, reliability and validity are a joint function of scale items and response formats and of the characteristics and diversity of specific samples. To contribute to further advances in family assessment, researchers need to use both conceptual and psychometric criteria rather than rely too heavily on the pursuit of internal consistency reliability and factor analytic approaches to scale construction and validation.
331 citations
TL;DR: In this paper, the authors examine what characterizes their operations and how managers can know whether their organizations are hazardous or potentially hazardous, and explore the steps that can be taken to ameliorate the potentially negative effects of design strategies that might result in catastrophic outcomes.
Abstract: On a worldwide basis, a growing number of organizations operate in ways that can result in catastrophic consequences. Within this set of potentially hazardous organizations, there are a number that have operated nearly error free for long periods of time. This article examines what characterizes their operations and how managers can know whether their organizations are hazardous or potentially hazardous. The article also explores the steps that can be taken to ameliorate the potentially negative effects of design strategies that might result in catastrophic outcomes.
327 citations
Journal Article•
TL;DR: The POMS (Profile of Mood States) was translated into Japanese, and reliability and validity of the Japanese edition was assessed on 354 healthy males, indicating that the POMs had good criterion-related validity, except for "Anger-Hostility".
Abstract: The POMS (Profile of Mood States) was translated into Japanese, and reliability and validity of the Japanese edition was assessed on 354 healthy males aged 20 to 59 years (mean 42) The following findings were obtained 1) Reliability coefficients (Cronbach's alpha) were 0779-0926 for six mood scales measured by the Japanese edition, ie "Depression-Dejection", "Vigor", "Anger-Hostility", "Fatigue", "Tension-Anxiety" and "Confusion" 2) Five factors were extracted by factor analysis for the 65 items of the POMS "Vigor" and "Anger-Hostility" were solely explained by their respective factors, indicating that these two scales had the highest factorial validity "Fatigue" had the second highest factorial validity; and "Tension-Anxiety" was third "Confusion" and "Depression-Dejection" were related to the same one factor 3) In 33 of the subjects, the scores for mood measured by the POMS were significantly correlated to ratings by a psychiatrist, indicating that the POMS had good criterion-related validity, except for "Anger-Hostility"
268 citations
TL;DR: Modifications of previously published estimators appropriate for measurement of reliability in the case of stratified sampling frames are introduced and interpret these measures in view of standard errors computed using the jackknife.
Abstract: This paper reviews and critiques various approaches to the measurement of reliability among multiple raters in the case of nominal data. We consider measurement of the overall reliability of a group of raters (using kappa-like statistics) as well as the reliability of individual raters with respect to a group. We introduce modifications of previously published estimators appropriate for measurement of reliability in the case of stratified sampling frames and we interpret these measures in view of standard errors computed using the jackknife. Analyses of a set of 48 anaesthesia case histories in which 42 anaesthesiologists independently rated the appropriateness of care on a nominal scale serve as an example.
241 citations
TL;DR: A methodology is presented to estimate the nodal and system hydraulic reliabilities of water distribution systems that accounts for the uncertainties and can be used in the analysis or expansion of existing systems, or the design of new systems.
Abstract: The hydraulic reliability of a water distribution system can be defined as the probability that the system can provide the demanded flowrate at the required pressure head. Due to the random nature of future water demands, required pressure heads, and pipe roughness, the estimation of water distribution system reliability for the future is subject to uncertainty. A methodology is presented to estimate the nodal and system hydraulic reliabilities of water distribution systems that accounts for the uncertainties. The framework for the methodology is based upon a Monte Carlo simulation consisting of three major components: random number generation, hydraulic network simulation, and computation of reliability. For purposes of illustration, an example water distribution system consisting of 17 pipes and 12 demand nodes is used. This new methodology can be used in the analysis or expansion of existing systems, or the design of new systems.
204 citations
TL;DR: A review of estimation approaches for intercoder reliability reported in articles in leading marketing journals reveals that most marketing researchers are using inadequate measures, and recommends that marketing researchers report dependability indices based on generalizability theory for quantitative coding systems.
Abstract: A review of estimation approaches for intercoder reliability reported in articles in leading marketing journals reveals that most marketing researchers are using inadequate measures. The authors re...
181 citations
TL;DR: The authors found that assertiveness and responsiveness of 102 men and 122 women in college were internally reliable (88 and.93) and uncorrelated (−.027) factors of self-reported personality style.
Abstract: Assertiveness and responsiveness of 102 men and 122 women in college were internally reliable (.88 and .93) and uncorrelated (−.027) factors of self-reported personality style.
176 citations
TL;DR: The Approaches to Studying Questionnaire (ASQ) as mentioned in this paper was devised to measure individual differences in terms of four major study orientations and achieved satisfactory levels of reliability and the distinction between a meaning orientation and a reproducing orientation has been consistently demonstrated across a variety of student groups.
Abstract: The Approaches to Studying Questionnaire (ASQ) was devised to measure individual differences in terms of four major study orientations. It achieves satisfactory levels of reliability and the distinction between a meaning orientation and a reproducing orientation has been consistently demonstrated across a variety of student groups. However, the validity of the remaining study orientations and of the constituent subscales is open to question. A shorm form of the ASQ is described, based upon the eight subscales that have been consistently identified with meaning orientation and reproducing orientation. The reliability and replicability of this new questionnaire are considered in the light of a critical evaluation of the analytic methods employed in previous research. Satisfactory levels of internal consistency and test-retest reliability are demonstrated, and factor analysis successfully retrieves the two primary study orientations. While the validity of its constituent subscales is still rather un...
TL;DR: In this article, a fuzzy model of the reliability analysis is presented, which is based on the operation of dependence and operation of fuzziness which is contained in the qualitative expression, and the evaluation of the failure possibility and the error possibility.
TL;DR: The generality of this approach suggests its use whenever a software reliability model is used, and it is shown how this can be used to improve reliability predictions in a very general way by a process of recalibration.
Abstract: There is no universally applicable software reliability growth model which can be trusted to give accurate predictions of reliability in all circumstances. A technique of analyzing predictive accuracy called the u-plot allows a user to estimate the relationship between the predicted reliability and the true reliability. It is shown how this can be used to improve reliability predictions in a very general way by a process of recalibration. Simulation results show that the technique gives improved reliability predictions in a large proportion of cases. However, a user does not need to trust the efficacy of recalibration, since the new reliability estimates produced by the technique are truly predictive and their accuracy in a particular application can be judged using the earlier methods. The generality of this approach suggests its use whenever a software reliability model is used. Indeed, although this work arose from the need to address the poor performance of software reliability models, it is likely to have applicability in other areas such as reliability growth modeling for hardware. >
TL;DR: Human reliability analysis (HRA) can be used to estimate the quantitative or qualitative contribution of human performance to system reliability and safety as mentioned in this paper, which can be applied to various operations and production systems.
01 Jan 1990
TL;DR: A set of performance specifications that seem appropriate for real-time computer communication services is proposed, and various types of delay bounds, throughput bounds, and reliability bounds are proposed.
Abstract: A set of performance specifications that seem appropriate for real-time computer communication services is proposed. They include various types of delay bounds, throughput bounds, and reliability bounds. Other requirements and desirable properties are described from a client's viewpoint, and the ways in which each requirement is to be translated to make it suitable for lower levels in the protocol hierarchy are examined. Some examples of requirements specification are presented, and possible objections to the approach are discussed. >
TL;DR: The present experiment examined the test-retest reliability of sketch maps drawn by subjects who were asked to sketch the same route on two trials separated by a week and demonstrated that sketch maps are a reliable method of data collection.
TL;DR: In Cartesian coordinates importance sampling has been shown to be remarkably effective in improving the efficiency of Monte Carlo simulation techniques for reliability calculations in structural engineering as discussed by the authors, and this technique has been used in many applications.
Abstract: In Cartesian coordinates importance sampling has been remarkably effective in improving the efficiency of Monte Carlo simulation techniques for reliability calculations in structural engineering. T...
TL;DR: The results of this study suggest that measurements of forward bending obtained on patients with low back pain using the modified fingertip-to-floor method are highly reliable.
Abstract: The purpose of this study was to examine the intratherapist and intertherapist reliability of measurements obtained with a modified version of the fingertip-to-floor method of assessing forward bending. With the modified fingertip-to-floor (MFTF) method, patients stand on a stool and forward bend so that measurements can be taken on patients who are able to touch the floor or reach beyond the level of the floor. Randomly paired physical therapists took repeated MFTF measurements on 73 patients with low back pain. Intraclass correlation coefficients (ICCs) were calculated for intratherapist and intertherapist reliability. The ICC value for intratherapist reliability was .98, and the ICC value for intertherapist reliability was .95. The results of this study suggest that measurements of forward bending obtained on patients with low back pain using the MFTF method are highly reliable.
TL;DR: The results indicate that it is difficult to show either an improvement or worsening of a joint motion of less than 5° to 10° for most joints measured by the same tester.
Abstract: The purpose of this study was to determine the varia bility and reliability of joint measurements as carried out by three physician observers. The intratester variation and reliability of nine different joint measurements was determined in eight healthy subjects. The measure ments were taken in eight sessions by each tester. In this population also the intertester variation and relia bility was determined by the three observers. This was also done in a population of middle-aged athletes over a period of 2.5 years.The results indicate that it is difficult to show either an improvement or worsening of a joint motion of less than 5° to 10° for most joints measured by the same tester. The intertester variation is not consistent over a longer period of time, so differences between observers during long-term studies cannot be corrected on the basis of a single study at a single point in time. The reliability of all nine joint measurements is not very high, but is probably sufficient if the results are used to c...
TL;DR: A study was conducted to assess the reliability and validity of the Appropriateness Evaluation Protocol (AEF), the Standardized Medreview Instrument (SMI) and the Intensity-Severity-Discharge criteria set (ISD), three utilization review instruments used to determine whether inpatient care is required.
Abstract: A study was conducted to assess the reliability and validity of the Appropriateness Evaluation Protocol (AEP), the Standardized Medreview Instrument (SMI) and the Intensity-Severity-Discharge criteria set (ISD), three utilization review instruments used to determine whether inpatient care is required. Reliability and validity were assessed for retrospective application of these instruments to charts of a sample of 119 medical cases from 21 hospitals in the state of Michigan. The reliability of each instrument was determined by having the instrument applied by two different nurse reviewers to each hospital record. Results indicated that the AEP and ISD were moderately reliable, while the SMI had low reliability. The validity of each instrument was tested by comparing the judgments of nurse reviewers using the instruments with the judgment of a panel of physicians. The AEP and ISD were found to be moderately valid and the SMI was found to have low validity. Results suggested that the SMI should not be used. The modest level of validity of the other two instruments suggests that payment should never be denied on the basis of the instrument alone. Payment should be denied only if a physician confirms the judgment based on the instrument that inpatient care was not required.
TL;DR: In this paper, the internal consistency reliability of individual-level characteristics is assessed for several commonly used research designs, based on generalizability theory and requiring only the data that would normally be used to answer the substantive questions of a study.
Abstract: Social scientists often use the mean of individual-level characteristics to describe aggregates such as organizations, schools, or programs. They seldom, however, attempt to assess the reliability of these measures. This article indicates how the internal consistency reliability of such measures can be estimated for several commonly used research designs. The method is based on generalizability theory and requires only the data that would normally be used to answer the substantive questions of a study; for example retests or parallel forms are not necessary.
TL;DR: The state-of-the-art of reliability computation methods for structural engineering is outlined and evaluated in this article, where emphasis is given to random variable reliability models and also random process and random field reliability models are considered.
23 Jan 1990
TL;DR: In this article, the Weibull-Poisson process (WPP) is used for representing the reliability of complex repairable systems and other statistical methods for this model when data have been generated by multiple systems.
Abstract: The Weibull-Poisson process (WPP) for representing the reliability of complex repairable systems is discussed. The emphasis is on estimation and other statistical methods for this model when data have been generated by multiple systems. Examples and procedures specifically illustrating these methods are given for several real-world situations. In addition to maximum likelihood estimation methods, goodness-of-fit tests and confidence interval procedures are discussed and illustrated by numerical examples. It is noted that in the case of one system the model reduces to a model for reliability growth. Confidence intervals for the WPP shape parameter and growth rate are given. >
TL;DR: In this article, a reliability-based optimization model for water-distribution systems is developed, which is aimed at the following goals: (1) design of the pipe network including the number, location, and size of pumps and tanks; (2) designing of the pumping system using a reliabilitybased procedure considering both hydraulic failures of the entire network and mechanical failure of the pump system; and (3) determination of the optimal operation of the pumps.
Abstract: A reliability-based optimization model for water-distribution systems has been developed. The model is aimed at the following goals: (1) Design of the pipe network including the number, location, and size of pumps and tanks; (2) design of the pumping system using a reliability-based procedure considering both hydraulic failures of the entire network and mechanical failure of the pumping system; and (3) determination of the optimal operation of the pumps. The optimization problem is a large mixed-integer, nonlinear programming problem that is solved using a heuristic algorithm consisting of a master problem and a subproblem. The master problem is a pure 0–1 integer programming model, and the subproblem is a large nonlinear programming model solved in an optimal control framework. The conservation of flow and energy constraints are solved implicitly for each iteration of the nonlinear optimization procedure using a hydraulic simulation model, and the reliability constraints are also solved implicitly using a reliability model. The nonlinear programming problem is solved using a generalized reduced gradient code.
TL;DR: This article investigated the reliability of four widely used cross-national data sets by constructing an error framework that relates types of errors to uses of the data, and found that for studies seeking aggregate descriptions of world crime or analytic explanations of crossnational crime rates, differences in the data sets do not make a difference in the results.
Abstract: This study investigates the question of reliability among four widely used cross-national data sets by constructing an error framework that relates types of errors to uses of the data. The findings indicate that (1) for nation-by-nation point estimation, the four data sets differ by varying degrees, (2) for aggregate point estimation in cross-sectional descriptive and longitudinal descriptive studies, they are statistically similar, and (3) for analytic or explanatory cross-sectional purposes, they yield statistically and substantively similar results. In short, for studies seeking aggregate descriptions of world crime or analytic explanations of cross-national crime rates, differences in the data sets do not make a difference in the results.
TL;DR: In this paper, a methodology for incorporating reliability considerations directly into least-cost optimization design models for looped water distribution networks is presented, and the essence of the methodology is that reliability considerations can be incorporated directly into the optimization design model.
Abstract: A new methodology for incorporating reliability considerations directly into leastcost optimization design models for looped water distribution networks is presented. The essence of the methodology...
TL;DR: The results indicated that measurement of wrist motion by individual therapists is highly reliable and that intrarater reliability is higher than interrater reliability for all active and passive motions.
Abstract: A reliability study was conducted to determine (a) the intrarater and interrater reliability of goniometric measurement of active and passive wrist motions under clinical conditions and (b) the effect of a therapist's specialization on the reliability of measurement. Randomly paired therapists performed repeated measurements of active and passive wrist motions in 48 subjects who had been referred to one of four occupational therapy or hand management clinics for evaluation and treatment. The data were analyzed with an intraclass correlation coefficient. A posteriori data analyses were performed to determine the effects of identified sources of error on the reliability of measurement. The results indicated that measurement of wrist motion by individual therapists is highly reliable and that intrarater reliability is higher than interrater reliability for all active and passive motions. Interrater reliability was generally higher among specialized therapists for reasons not immediately apparent from this study. With the exception of pain, identified sources of error were found to have surprisingly little effect on the reliability of measurement.
TL;DR: In this article, a two-dimensional version of the consecutive k-out-of-n:F model is considered and bounds on system failure probabilities are determined by comparison with the usual one-dimensional model.
Abstract: A two-dimensional version of the consecutive-k-out-of-n:F model is considered. Bounds on system failure probabilities are determined by comparison with the usual one-dimensional model. Failure probabilities are determined by simulation for a variety of values of k and n. >