A large number of studies have been conducted during the last decade and a half attempting to identify those factors that contribute to information systems success. However, the dependent variable in these studies-I/S success-has been an elusive one to define. Different researchers have addressed different aspects of success, making comparisons difficult and the prospect of building a cumulative tradition for I/S research similarly elusive. To organize this diverse research, as well as to present a more integrated view of the concept of I/S success, a comprehensive taxonomy is introduced. This taxonomy posits six major dimensions or categories of I/S success-SYSTEM QUALITY, INFORMATION QUALITY, USE, USER SATISFACTION, INDIVIDUAL IMPACT, and ORGANIZATIONAL IMPACT. Using these dimensions, both conceptual and empirical studies are then reviewed a total of 180 articles are cited and organized according to the dimensions of the taxonomy. Finally, the many aspects of I/S success are drawn together into a descriptive model and its implications for future I/S research are discussed.

Information Systems Success: The Quest for the Dependent Variable

Ten years ago, we presented the DeLone and McLean Information Systems (IS) Success Model as a framework and model for measuring the complex-dependent variable in IS research. In this paper, we discuss many of the important IS success research contributions of the last decade, focusing especially on research efforts that apply, validate, challenge, and propose enhancements to our original model. Based on our evaluation of those contributions, we propose minor refinements to the model and propose an updated DeLone and McLean IS Success Model. We discuss the utility of the updated model for measuring e-commerce system success. Finally, we make a series of recommendations regarding current and future measurement of IS success.

/pdf/the-delone-and-mclean-model-of-information-systems-success-a-4qyq8geftq.pdf

The DeLone and McLean Model of Information Systems Success: A Ten-Year Update

According to W. Edwards Deming, American companies require nothing less than a transformation of management style and of governmental relations with industry. In Out of the Crisis, originally published in 1982, Deming offers a theory of management based on his famous 14 Points for Management. Management's failure to plan for the future, he claims, brings about loss of market, which brings about loss of jobs. Management must be judged not only by the quarterly dividend, but by innovative plans to stay in business, protect investment, ensure future dividends, and provide more jobs through improved product and service. In simple, direct language, he explains the principles of management transformation and how to apply them.

Out of the Crisis

This paper reports on the development of an instrument designed to measure the various perceptions that an individual may have of adopting an information technology IT innovation. This instrument is intended to be a tool for the study of the initial adoption and eventual diffusion of IT innovations within organizations. While the adoption of information technologies by individuals and organizations has been an area of substantial research interest since the early days of computerization, research efforts to date have led to mixed and inconclusive outcomes. The lack of a theoretical foundation for such research and inadequate definition and measurement of constructs have been identified as major causes for such outcomes. In a recent study examining the diffusion of new end-user IT, we decided to focus on measuring the potential adopters' perceptions of the technology. Measuring such perceptions has been termed a "classic issue" in the innovation diffusion literature, and a key to integrating the various findings of diffusion research. The perceptions of adopting were initially based on the five characteristics of innovations derived by Rogers 1983 from the diffusion of innovations literature, plus two developed specifically within this study. Of the existing scales for measuring these characteristics, very few had the requisite levels of validity and reliability. For this study, both newly created and existing items were placed in a common pool and subjected to four rounds of sorting by judges to establish which items should be in the various scales. The objective was to verify the convergent and discriminant validity of the scales by examining how the items were sorted into various construct categories. Analysis of inter-judge agreement about item placement identified both bad items as well as weaknesses in some of the constructs' original definitions. These were subsequently redefined. Scales for the resulting constructs were subjected to three separate field tests. Following the final test, the scales all demonstrated acceptable levels of reliability. Their validity was further checked using factor analysis, as well as conducting discriminant analysis comparing responses between adopters and nonadopters of the innovation. The result is a parsimonious, 38-item instrument comprising eight scales which provides a useful tool for the study of the initial adoption and diffusion of innovations. A short, 25 item, version of the instrument is also suggested.

https://www.jstor.org/stable/pdf/23010883.pdf

Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation

How has Japan become a major economic power, a world leader in the automotive and electronics industries? What is the secret of their success? The consensus has been that, though the Japanese are not particularly innovative, they are exceptionally skilful at imitation, at improving products that already exist. But now two leading Japanese business experts, Ikujiro Nonaka and Hiro Takeuchi, turn this conventional wisdom on its head: Japanese firms are successful, they contend, precisely because they are innovative, because they create new knowledge and use it to produce successful products and technologies. Examining case studies drawn from such firms as Honda, Canon, Matsushita, NEC, 3M, GE, and the U.S. Marines, this book reveals how Japanese companies translate tacit to explicit knowledge and use it to produce new processes, products, and services.

The knowledge-creating company : how Japanese companies create the dynamics of innovation

This article contrasts traditional versus end-user computing environments and report on the development of an instrument which merges ease of use and information product items to measure the satisfaction of users who directly interact with the computer for a specific application. Using a survey of 618 end users, the researchers conducted a factor analysis and modified the instrument. The results suggest a 12-item instrument that measures five components of end-user satisfaction - content, accuracy, format, ease of use, and timeliness. Evidence of the instrument's discriminant validity is presented. Reliability and validity is assessed by nature and type of application. Finally, standards for evaluating end-user applications are presented, and the instrument's usefulness for achieving more precision in research questions is explored.

https://www.jstor.org/stable/pdfplus/248851.pdf

The measurement of end-user computing satisfaction

The dimensionality of the user satisfaction construct is an important theoretical issue that has received considerable attention. Focusing on end users who directly interact with application software, Doll and Torkzadeah (1988) develop a 12-item application specific instrument for providing an overall assessment of end-user computing satisfaction (EUCS). They also contend that EUCS is comprised of five component measures (content, accuracy, format, ease of use, timeliness) that explain the construct and permit more precision in formulating and testing research hypotheses. The acceptance of the EUCS as a standardized instrument requires confirmation that it explains and measures the user satisfaction construct.Based on a sample of 409 respondents from 18 organizations, this research uses confirmatory factor analysis (LISREL) to test alternative models of underlying factor structure and assess the reliability and validity of factors and items. Without respecifying the model, the results provide some support for Doll and Torkzadeh's proposed model of the five first-order factors and one second-order (higher-order) factor. Thus the evidence supports the use of: (1) the 12-item instrument as an overall measure of EUCS; and (2) the five component factors for explaining the EUCS construct.

A confirmatory factor analysis of the end-user computing satisfaction instrument

The impact of information technology on work life has been one of the most talked about issues over the recent years. Chief executive officers spending millions of dollars on information technology face the critical issue of assessing the impact of this technology on work. Information system managers are increasingly required to justify technology investment in terms of its impact on the individual and his/her work. Measures of impact of information technology have narrowly focused on productivity impacts. This study uses a broader concept that is based on the impact of technology on the nature of work literature. This literature recognizes the multiple impacts of technology on work at the level of the individual. A review of the literature enabled us to generate thirty-nine items that were grouped into four constructs. In a pilot study, these constructs were assessed by observers in structured interviews with eighty-nine users to provide a criterion measure. Next, the users completed the thirty-nine item questionnaire. The unidimensionality, internal consistency and criterion-related validity of each construct were assessed. The pilot results suggest a four factor 12-item instrument that measures how extensively information technology applications impact task productivity, task innovation, customer satisfaction and management control. In a large scale study, a sample of 409 respondents was gathered to further explore this 12-item instrument and its relationships with other constructs (user involvement, user satisfaction, system usage). The results support the four factor model. Evidence of reliability and construct validity is presented for the hypothesized measurement model and future research is discussed.

The development of a tool for measuring the perceived impact of information technology on work

As key components of Davis's technology acceptance model (TAM), the perceived usefulness and perceived ease-of-use instruments are widely accepted among the MIS research community as tools for evaluating information system applications and predicting usage. Despite this wide acceptance, a series of incremental cross-validation studies have produced conflicting and equivocal results that do not provide guidance for researchers or practitioners who might use the TAM for decision making. Using a sample of 902 “initial exposure” responses, this research conducts: (1) a confirmatory factor analysis to assess the validity and reliability of the original instruments proposed by Davis, and (2) a multigroup invariance analysis to assess the equivalence of these instruments across subgroups based on type of application, experience with computing, and gender.

In contrast to the mixed results of prior cross-validation efforts, the results of this confirmatory study provide strong support for the validity and reliability of Davis's sixitem perceived usefulness and six-item ease-of-use instruments. The multigroup invariance analysis suggests the usefulness and ease-of-use instruments have invariant true scores across most, but not all, subgroups. With notable exemptions for word processing applications and users with no prior computing experience, this research provides evidence that the item-factor loadings (true scores) are invariant across spread sheet, database, and graphic applications. The implications of the results for managerial decision making are discussed.

William J. Doll

Papers

The measurement of end-user computing satisfaction

A confirmatory factor analysis of the end-user computing satisfaction instrument

The development of a tool for measuring the perceived impact of information technology on work

Using Davis's Perceived Usefulness and Ease-of-use Instruments for Decision Making: A Confirmatory and Multigroup Invariance Analysis

Developing a multidimensional measure of system-use in an organizational context