Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact
Reads0
Chats0
TLDR
The infrastructure that is being designed and constructed to support controlled experimentation with testing and regression testing techniques is described and the impact that this infrastructure has had and can be expected to have.Abstract:
Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.read more
Citations
More filters
Proceedings ArticleDOI
Improving Software Testing Cost-Effectiveness through Dynamic Partitioning
TL;DR: A dynamic partitioning strategy that selects test cases using online feedback information that achieves a significant saving in terms of total number of test cases executed to detect all faults is presented.
Proceedings ArticleDOI
MURE: Making Use of MUtations to REfine Spectrum-Based Fault Localization
TL;DR: A new approach to fault localization, MURE, which first drives a stateor-the-art SBFL technique Naish2 to output a list of suspicious statements, then picks out suspicious statement as candidates, generates mutates for them, and estimates their likelihood of relating to faults.
Proceedings ArticleDOI
FTMES: A Failed-Test-Oriented Mutant Execution Strategy for Mutation-Based Fault Localization
André Assis Lôbo de Oliveira,Celso G. Camilo-Junior,Eduardo Noronha de Andrade Freitas,Auri Marcelo Rizzo Vincenzi +3 more
TL;DR: This work proposes a novel mutation execution strategy named Failed-Test Oriented Mutant Execution Strategy (FTMES) for improving the efficacy of fault localization techniques and also reduce the computational cost of these techniques.
An Empirical Evaluation of Data Flow Testing of Java Classes
TL;DR: This paper proposes an efficient structural technique based on contextual data flow analysis to test state-dependent behavior of classes that aggregate other classes as part of their state.
Journal ArticleDOI
Fast test suite-driven model-based fault localisation with application to pinpointing defects in student programs
TL;DR: A fast model-based fault localisation algorithm that, given a test suite, uses symbolic execution methods to fully automatically identify a small subset of program locations where genuine program repairs exist, and is implemented for C programs and demonstrates its effectiveness on the Siemens TCAS variants.
References
More filters
Book
Case Study Research: Design and Methods
TL;DR: In this article, buku ini mencakup lebih dari 50 studi kasus, memberikan perhatian untuk analisis kuantitatif, membahas lebah lengkap penggunaan desain metode campuran penelitian, and termasuk wawasan metodologi baru.
Book Chapter
Case study research
TL;DR: The comprehensive and accessible nature of this collection will make it an essential and lasting handbook for researchers and students studying organizations.
Book
Research methods knowledge base
TL;DR: The Research Methods Knowledge Base is a comprehensive web-based textbook that addresses all of the topics in a typical introductory undergraduate or graduate course in social research methods and uses an informal, conversational style to engage both the newcomer and the more experienced student of research.
Book
Experimentation in Software Engineering: An Introduction
TL;DR: The purpose of Experimentation in Software Engineering: An Introduction is to introduce students, teachers, researchers, and practitioners to experimentation and experimental evaluation with a focus on software engineering, and to provide guidelines for performing experiments evaluating methods, techniques and tools in software engineering.
Related Papers (5)
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more