Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact
TLDR
The infrastructure that is being designed and constructed to support controlled experimentation with testing and regression testing techniques is described and the impact that this infrastructure has had and can be expected to have.Abstract:
Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.read more
Citations
More filters
Book ChapterDOI
Must Fault Localization for Program Repair
TL;DR: A new algorithm for fault localization is developed and it is proved that it is must with respect to commonly used schemes in automated program repair, and is incorporated into an existing mutation-based program repair algorithm.
Proceedings ArticleDOI
Coincidental correctness: An interference or interface to successful fault localization?
TL;DR: This paper calculates the distribution overlapping of dynamic spectrum in failed runs and in non-failed runs to find out the fault-leading predicates, and reduces the region by referencing the inter-class distances of the spectra to suppress the less suspicious candidates.
Book ChapterDOI
Advances in Combinatorial Testing
TL;DR: This chapter reviews recent advances in combinatorial testing, with special focus on the research since 2011, and examines recent developments in advanced topics such as utilization of existing tests, test case prioritization, fault localization, and evolution of combinatorsial models.
Proceedings ArticleDOI
Replication Data Management: Needs and Solutions -- An Initial Evaluation of Conceptual Approaches for Integrating Heterogeneous Replication Study Data
Stefan Biffl,Estefanía Serral,Dietmar Winkler,Oscar Dieste,Natalia Juristo,Nelly Condori-Fernandez +5 more
TL;DR: While the central and local approaches have major issues that are hard to resolve in practice, the empirical ecosys-tem allows bridging current gaps in RDM from heterogeneous data sources.
Book ChapterDOI
Systolic Genetic Search for Software Engineering: The Test Suite Minimization Case
TL;DR: A Systolic Genetic Search (SGS) algorithm is proposed for solving the Test Suite Minimization Problem, using the global concept of SGS to derive a particular algorithm to explicitly exploit the high degree of parallelism available in modern GPU architectures.
References
More filters
Book
Case Study Research: Design and Methods
TL;DR: In this article, buku ini mencakup lebih dari 50 studi kasus, memberikan perhatian untuk analisis kuantitatif, membahas lebah lengkap penggunaan desain metode campuran penelitian, and termasuk wawasan metodologi baru.
Book Chapter
Case study research
TL;DR: The comprehensive and accessible nature of this collection will make it an essential and lasting handbook for researchers and students studying organizations.
Book
Research methods knowledge base
TL;DR: The Research Methods Knowledge Base is a comprehensive web-based textbook that addresses all of the topics in a typical introductory undergraduate or graduate course in social research methods and uses an informal, conversational style to engage both the newcomer and the more experienced student of research.
Book
Experimentation in Software Engineering: An Introduction
TL;DR: The purpose of Experimentation in Software Engineering: An Introduction is to introduce students, teachers, researchers, and practitioners to experimentation and experimental evaluation with a focus on software engineering, and to provide guidelines for performing experiments evaluating methods, techniques and tools in software engineering.
Related Papers (5)
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more