Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact
Reads0
Chats0
TLDR
The infrastructure that is being designed and constructed to support controlled experimentation with testing and regression testing techniques is described and the impact that this infrastructure has had and can be expected to have.Abstract:
Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.read more
Citations
More filters
Proceedings ArticleDOI
Test generation to expose changes in evolving programs
TL;DR: The technique identifies the common programming patterns that may prevent a given change from affecting the program's output and proposes methods to tune the change-reaching input into an input that reaches the change and propagates the effect of the change to the output.
Proceedings ArticleDOI
FAST approaches to scalable similarity-based test case prioritization
TL;DR: The FAST family of test case prioritization techniques are introduced that radically changes this landscape by borrowing algorithms commonly exploited in the big data domain to find similar items and outperform white-box approaches, including greedy ones, if preparation time is not counted.
Proceedings ArticleDOI
Selective mutation testing for concurrent code
TL;DR: The results identify several sets of concurrent mutation operators that can effectively reduce the number of mutants, show that operator-based selection is slightly better than random mutant selection, and show that sequential and concurrent mutations operators are independent, demonstrating the importance of studying concurrent mutation Operators.
Highly Scalable Multi-Objective Test Suite Minimisation Using Graphics Card
Shin Yoo,Mark Harman,Shmuel Ur +2 more
TL;DR: This paper develops a search based optimisation approach for multi objective regression test optimisation, evaluating it on benchmark problems as well as larger real world problems and indicating that speed-ups of over 25x are possible using widely available standard GPUs.
Proceedings ArticleDOI
An empirical investigation into the impact of refactoring on regression testing
Napol Rachatasumrit,Miryung Kim +1 more
TL;DR: The results on three open source projects, JMeter, XMLSecurity, and ANT, show that only 22% of refactored methods and fields are tested by existing regression tests and call for new automated regression test augmentation and selection techniques for validating refactoring edits.
References
More filters
Book
Case Study Research: Design and Methods
TL;DR: In this article, buku ini mencakup lebih dari 50 studi kasus, memberikan perhatian untuk analisis kuantitatif, membahas lebah lengkap penggunaan desain metode campuran penelitian, and termasuk wawasan metodologi baru.
Book Chapter
Case study research
TL;DR: The comprehensive and accessible nature of this collection will make it an essential and lasting handbook for researchers and students studying organizations.
Book
Research methods knowledge base
TL;DR: The Research Methods Knowledge Base is a comprehensive web-based textbook that addresses all of the topics in a typical introductory undergraduate or graduate course in social research methods and uses an informal, conversational style to engage both the newcomer and the more experienced student of research.
Book
Experimentation in Software Engineering: An Introduction
TL;DR: The purpose of Experimentation in Software Engineering: An Introduction is to introduce students, teachers, researchers, and practitioners to experimentation and experimental evaluation with a focus on software engineering, and to provide guidelines for performing experiments evaluating methods, techniques and tools in software engineering.
Related Papers (5)
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more