Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact
Reads0
Chats0
TLDR
The infrastructure that is being designed and constructed to support controlled experimentation with testing and regression testing techniques is described and the impact that this infrastructure has had and can be expected to have.Abstract:
Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.read more
Citations
More filters
Book ChapterDOI
A Resource-Based Logic for Termination and Non-termination Proofs
TL;DR: A new logical entailment system for temporal constraints is introduced and it is shown how Hoare logic can be seamlessly used to prove termination and non-termination in the authors' unified framework.
Proceedings ArticleDOI
Extracting Concise Bug-Fixing Patches from Human-Written Patches in Version Control Systems
TL;DR: BugBuilder as mentioned in this paper automatically extracts complete and concise bug-fixing patches from human-written patches in version control systems, and enumerates all subsets of the remaining part and validates them on test cases.
Book ChapterDOI
Bucketing Failing Tests via Symbolic Analysis
TL;DR: This work proposes a new symbolic analysis-based clustering algorithm that uses the semantic reason behind failures to group failing tests into more "meaningful" clusters and provides a semantic characterization of the fault represented by each cluster.
Proceedings ArticleDOI
A hybrid approach for test case prioritization and selection
Dennis Sávio Martins da Silva,Ricardo A. L. Rabelo,Matheus Campanha,Pedro de Alcântara dos Santos Neto,Pedro Almir Martins de Oliveira,Ricardo Britto +5 more
TL;DR: This work presents an approach for test case prioritization and selection, based in relevant inputs obtained from a software development environment, which uses Software Quality Function Deployment to deploy the features relevance among the system components, Mamdani fuzzy inference systems to infer the criticality of each class and Ant Colony Optimization to select test cases.
Journal ArticleDOI
A snowballing literature study on test amplification
Benjamin Danglot,Oscar Luis Vera-Pérez,Zhongxing Yu,Andy Zaidman,Martin Monperrus,Benoit Baudry,Benoit Baudry +6 more
TL;DR: Test Amplification as discussed by the authors surveys works that exploit this knowledge to enhance manually written tests with respect to an engineering goal (e.g., improve coverage or refine fault localization) while these works rely on various techniques and address various goals.
References
More filters
Book
Case Study Research: Design and Methods
TL;DR: In this article, buku ini mencakup lebih dari 50 studi kasus, memberikan perhatian untuk analisis kuantitatif, membahas lebah lengkap penggunaan desain metode campuran penelitian, and termasuk wawasan metodologi baru.
Book Chapter
Case study research
TL;DR: The comprehensive and accessible nature of this collection will make it an essential and lasting handbook for researchers and students studying organizations.
Book
Research methods knowledge base
TL;DR: The Research Methods Knowledge Base is a comprehensive web-based textbook that addresses all of the topics in a typical introductory undergraduate or graduate course in social research methods and uses an informal, conversational style to engage both the newcomer and the more experienced student of research.
Book
Experimentation in Software Engineering: An Introduction
TL;DR: The purpose of Experimentation in Software Engineering: An Introduction is to introduce students, teachers, researchers, and practitioners to experimentation and experimental evaluation with a focus on software engineering, and to provide guidelines for performing experiments evaluating methods, techniques and tools in software engineering.
Related Papers (5)
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more