Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact
Reads0
Chats0
TLDR
The infrastructure that is being designed and constructed to support controlled experimentation with testing and regression testing techniques is described and the impact that this infrastructure has had and can be expected to have.Abstract:
Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.read more
Citations
More filters
Journal ArticleDOI
Path-oriented test cases generation based adaptive genetic algorithm.
TL;DR: An improved adaptive genetic algorithm (IAGA) for test cases generation by maintaining population diversity is proposed that uses adaptive crossover rate and mutation rate in dynamic adjustment according to the differences between individual similarity and fitness values, which enhances the exploitation of searching global optimum.
Proceedings ArticleDOI
Jaguar: A Spectrum-Based Fault Localization Tool for Real-World Software
Henrique Lemos Ribeiro,Higor Amario de Souza,Roberto Paulo Andrioli de Araujo,Marcos Lordello Chaim,Fabio Kon +4 more
TL;DR: The Jaguar fault localization tool is presented, which uses Spectrum-based Fault Localization techniques (SFL) to indicate faulty code excerpts in Java programs using data-flow spectrum using a lightweight approach.
Journal ArticleDOI
Separating passing and failing test executions by clustering anomalies
Rafig Almaghairbe,Marc Roper +1 more
TL;DR: Evaluation on three systems with a range of faults demonstrates that Concentrating the failures in these small clusters substantially reduces the numbers of outputs that a developer would need to manually examine following a test run and illustrates that the approach has the potential to improve the effectiveness and efficiency of the testing process.
Proceedings ArticleDOI
A Novel Mask-Coding Representation for Set Cover Problems with Applications in Test Suite Minimisation
TL;DR: The results show that Mask-Coding representation can improve both the convergence and diversity of the Pareto-efficient solution set of the multi-objective set cover optimisation.
Proceedings ArticleDOI
Comparing developer-provided to user-provided tests for fault localization and automated program repair
TL;DR: Evidence that developer- provided tests are more targeted toward the defect and encode more information than user-provided tests is provided, and suggestions for improving the design and evaluation of fault localization and automated program repair techniques are provided.
References
More filters
Book
Case Study Research: Design and Methods
TL;DR: In this article, buku ini mencakup lebih dari 50 studi kasus, memberikan perhatian untuk analisis kuantitatif, membahas lebah lengkap penggunaan desain metode campuran penelitian, and termasuk wawasan metodologi baru.
Book Chapter
Case study research
TL;DR: The comprehensive and accessible nature of this collection will make it an essential and lasting handbook for researchers and students studying organizations.
Book
Research methods knowledge base
TL;DR: The Research Methods Knowledge Base is a comprehensive web-based textbook that addresses all of the topics in a typical introductory undergraduate or graduate course in social research methods and uses an informal, conversational style to engage both the newcomer and the more experienced student of research.
Book
Experimentation in Software Engineering: An Introduction
TL;DR: The purpose of Experimentation in Software Engineering: An Introduction is to introduce students, teachers, researchers, and practitioners to experimentation and experimental evaluation with a focus on software engineering, and to provide guidelines for performing experiments evaluating methods, techniques and tools in software engineering.
Related Papers (5)
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more