Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact
TLDR
The infrastructure that is being designed and constructed to support controlled experimentation with testing and regression testing techniques is described and the impact that this infrastructure has had and can be expected to have.Abstract:
Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.read more
Citations
More filters
Journal ArticleDOI
Search-based fault localisation: A systematic mapping study
Plinio S. Leitao-Junior,Plinio S. Leitao-Junior,Diogo M. de Freitas,Silvia Regina Vergilio,Celso G. Camilo-Junior,Rachel Harrison +5 more
TL;DR: Search-based fault localisation has seen a rise in interest in the past few years and the number of studies has been growing, and some research opportunities were identified such as exploring new sources of fault data, exploring multi-objective algorithms, analysing benchmarks according to some classes of faults, as well as, the use of a unique definition for evaluation measures.
Journal ArticleDOI
Rethinking Experiments in a Socio-Technical Perspective: The Case of Software Engineering
TL;DR: By analyzing some of the most significant experiments in the subfield of software engineering, this work aims at showing how the conceptual framework that supports experimental methodology in this context needs an extension in a socio-technical perspective.
Journal ArticleDOI
Embedding and classifying test execution traces using neural networks
Journal ArticleDOI
A Systematic Analysis of Regression Test Case Selection: A Multi-Criteria-Based Approach
Muhammad Rehan,Norhalina Senan,Muhammad Aamir,Ali Samad,Mujtaba Husnain,Noraini Ibrahim,Sikandar Ali,Hizbullah Khatak +7 more
TL;DR: A detailed and comprehensive review of the work related to regression testing is provided in a very distinct and principled way in this paper, where the authors explore the importance of the role of each metric in detail.
DissertationDOI
From software failure to explanation
TL;DR: This thesis attempts to answer the question why does my program crash by presenting two approaches which start off with only a dump of the memory at the moment of the crash (a core dump) and eventually give a full explanation of the failure in terms of the important runtime features of the program such as critical branches, state predicates or any other execution aspect that is deemed helpful for understanding the underlying problem.
References
More filters
Book
Case Study Research: Design and Methods
TL;DR: In this article, buku ini mencakup lebih dari 50 studi kasus, memberikan perhatian untuk analisis kuantitatif, membahas lebah lengkap penggunaan desain metode campuran penelitian, and termasuk wawasan metodologi baru.
Book Chapter
Case study research
TL;DR: The comprehensive and accessible nature of this collection will make it an essential and lasting handbook for researchers and students studying organizations.
Book
Research methods knowledge base
TL;DR: The Research Methods Knowledge Base is a comprehensive web-based textbook that addresses all of the topics in a typical introductory undergraduate or graduate course in social research methods and uses an informal, conversational style to engage both the newcomer and the more experienced student of research.
Book
Experimentation in Software Engineering: An Introduction
TL;DR: The purpose of Experimentation in Software Engineering: An Introduction is to introduce students, teachers, researchers, and practitioners to experimentation and experimental evaluation with a focus on software engineering, and to provide guidelines for performing experiments evaluating methods, techniques and tools in software engineering.
Related Papers (5)
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more