Craig Blackburn

Bio: Craig Blackburn is an academic researcher from Massachusetts Institute of Technology. The author has contributed to research in topics: Performance measurement & Enterprise systems engineering. The author has an hindex of 4, co-authored 5 publications receiving 48 citations.

Enterprises as systems: Context, boundaries, and practical implications

Abstract: The focus of this paper is to describe the domain of enterprise analysis. This is accomplished through an exploration of relevant definitions, a discussion on boundaries, and a summary of practical implications for researchers and practitioners. Specifically, we consider the perspectives of stakeholders involved in small- and large-scale enterprise transformation, be they executives in corner offices or line workers on the factory floor. Anecdotes derived from research experiences with enterprise transformation provide insight into current enterprise research opportunities. To illustrate the domain of enterprise analysis, we identify three critical enterprise attributes - structure, function and value delivery - and investigate how these attributes can be used to influence boundary analysis, a discussion which provides researchers and practitioners the ability to use enterprise thinking as an invaluable tool to transform enterprises.

Navigating the Metrics Landscape: An Introductory Literature Guide to Metric Selection, Implementation, & Decision Making

Abstract: The focus of this paper is to depict the vast landscape of literature related to enterprise performance measurement in a concise and comprehensible manner for researchers and practitioners. We focus particularly on the enterprise as the unit of analysis and consider measurement systems from stakeholders at all levels. A broad range of considerations will be explored, ranging from micro-level considerations such as employee performance measurement to macro-level considerations such as enterprise measurement systems. Moreover, we discuss measurement-related problems identified in practice and solutions proposed in academic literature. To illustrate this evolution of measurement knowledge over time, we discuss the effects of metrics from three distinct viewpoints: (1) selecting the right metrics, (2) creating and implementing measurement frameworks; and (3) metrics for decision making.

The Human Element of Decision Making in Systems Engineers: A Focus on Optimism

Abstract: Biases continue to be an important aspect of human judgment and decision making because they can lead to unfavorable outcomes. Optimism bias is one type of bias that is often overlooked because of its association with good health and positive outcomes. However, the existence of optimism bias in human judgment can be very damaging especially when it distorts a person's view of future events. In order to better understand optimism bias we explore the benefits and downsides of optimism as well as some empirically-based origins of both optimism and pessimism. This provides a backdrop for a methodology for quantifying optimism and pessimism using the Brier score developed for calibrating weather reporters and a discussion about how sports bookies make well-calibrated decisions. Results are explored from an optimism survey given to a cohort of eighty systems engineers, which ultimately portray the degree to which optimism bias influences decision making in large projects. Further exploration of the key differences in optimism across professions helps distinguish motivational factors and characteristics of well-calibrated professions. We also present results from a calibration exercise, designed to infer if such activities can be adopted to assist systems engineering estimation. Finally, we provide prescriptive advice on how individual decision makers can better manage their optimism and become more realistic.

Leveraging measurement systems to drive enterprise transformation: Two case studies from the U.S. aerospace industry

Abstract: The focus of this paper is to depict the role of measurement systems in driving enterprise behavior and guiding enterprise transformation. Although enterprise transformation and performance measurement are separate areas of study, few have made the connection to determine the role of measurement systems in transformation. To provide insight into this role, a brief review of performance measurement literature is considered followed by two detailed case studies that illustrate their connection. Both case studies come from ACME Aerospace, a large contractor engaged primarily with the United States Department of Defense, but provide differing perspectives. In particular, one portrays one business units' reactive transformation effort that relied on a bottom-up measurement system, whereas the second portrays how corporate leadership sets measurement strategy to drive behavior in a more proactive sense. In these case studies, three common themes are evident regarding the role of metrics and measurement systems in transformation: (1) the need for using metrics and measurement systems for driving the right behavior; (2) the need for the presence of formal and informal infrastructure for adoption and sustainment; and (3) the need for support from top management. After reviewing these two case studies, enterprise analysis techniques are employed in a discussion aimed at understanding the relationship between measurement systems and enterprises with the ultimate goal of changing behavior to enable transformation.

Measuring systems engineering success: Insights from baseball

Abstract: Optimizing the efficiency of socio-technical systems and determining accurate measurements of performance is a critical issue in many systems engineering enterprises. In our analysis we explore some of the recurring themes of Michael Lewis's study of baseball, depicted in the best selling book Moneyball, and we make the connection to corresponding systems engineering principles of interest. The paper will focus on the systems engineering roadmap inspired by Lewis' study for developing and refining a meaningful set of metrics for organizational transformation. The following steps are highlighted to convey this transformation with the assistance of metrics: identify and understand value in the enterprise and your organization; consider an integrated system focus in your organization; use cost analysis methods to implement a strategy for executing the transformation; and manage risk throughout operations and improve the process continuously.

Software engineering economics

Abstract: This paper summarizes the current state of the art and recent trends in software engineering economics. It provides an overview of economic analysis techniques and their applicability to software engineering and management. It surveys the field of software cost estimation, including the major estimation techniques available, the state of the art in algorithmic cost models, and the outstanding research issues in software cost estimation.

Enterprise Transformation: Why Are We Interested, What Is It, and What Are the Challenges?

Abstract: The concept of enterprise transformation has become increasingly popular as companies recognize the need to achieve an integrated perspective within and across organizational boundaries to address complex challenges. Yet, there is little clarity concerning what constitutes an “enterprise” or indeed “enterprise transformation.” This article is conceived as an initial step along the journey towards this clarity. There is considerable work to be done in delineating this area of interest and this article is offered as a stimulus for debate on what constitutes enterprise transformation. Drawing on themes from the management and systems engineering disciplines, the article will propose four characteristics of “enterprise” as a unit for transformation and look at why this holistic unit of analysis has become critical to businesses. The article will also ask what constitutes transformation, and offer characterizing criteria to distinguish this magnitude of change from more incremental changes. A recent empirical ...