Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact
Reads0
Chats0
TLDR
The infrastructure that is being designed and constructed to support controlled experimentation with testing and regression testing techniques is described and the impact that this infrastructure has had and can be expected to have.Abstract:
Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.read more
Citations
More filters
Proceedings ArticleDOI
On FSM-Based Testing: An Empirical Study: Complete Round-Trip Versus Transition Trees
Hoda Khalil,Yvan Labiche +1 more
TL;DR: An empirical study is presented that aims at comparing the effectiveness of the complete round-trip paths test suites to the transition trees test suites, and comparing theeffectiveness of the different techniques used to generate transition trees (breadth first traversal, depth first traverseal, and random traversal).
Journal ArticleDOI
Regression Test Cases selection for Object-Oriented Programs based on Affected Statements
TL;DR: Modification revealing test case selection for regression testing of object-oriented software using dependence graph model analysis of the source code provides considerably better results for precision and inclusiveness compared to retest-all and random technique, and reducing the cost of regression testing.
Journal ArticleDOI
Maximising the information gained from a study of static analysis technologies for concurrent software
TL;DR: The paper presents the results of this controlled experiment and shows that the combination of automated static analysis and code inspection is cost-effective and contributes to the research on V&V technology evaluation.
Journal ArticleDOI
Adequate vs. inadequate test suite reduction approaches
Carmen Coviello,Simone Romano,Giuseppe Scanniello,Alessandro Marchetto,Anna Corazza,Giuliano Antoniol +5 more
TL;DR: These findings imply that inadequate TSR approaches and especially the CB approach might be appealing because they lead to a greater reduction in test suite size at the expense of a small loss in fault-detection capability.
Journal ArticleDOI
Hansie: Hybrid and consensus regression test prioritization
Shouvick Mondal,Rupesh Nasre +1 more
TL;DR: A two-flavored solution to the test-case prioritization as a rank aggregation problem from social choice theory, named Hansie, which shows the benefit of test-execution after prioritization and introduces a cost-cognizant metric (EPL) for quantifying overall timeline latency due to load-imbalance arising from uniform or non-uniform parallelization windows.
References
More filters
Book
Case Study Research: Design and Methods
TL;DR: In this article, buku ini mencakup lebih dari 50 studi kasus, memberikan perhatian untuk analisis kuantitatif, membahas lebah lengkap penggunaan desain metode campuran penelitian, and termasuk wawasan metodologi baru.
Book Chapter
Case study research
TL;DR: The comprehensive and accessible nature of this collection will make it an essential and lasting handbook for researchers and students studying organizations.
Book
Research methods knowledge base
TL;DR: The Research Methods Knowledge Base is a comprehensive web-based textbook that addresses all of the topics in a typical introductory undergraduate or graduate course in social research methods and uses an informal, conversational style to engage both the newcomer and the more experienced student of research.
Book
Experimentation in Software Engineering: An Introduction
TL;DR: The purpose of Experimentation in Software Engineering: An Introduction is to introduce students, teachers, researchers, and practitioners to experimentation and experimental evaluation with a focus on software engineering, and to provide guidelines for performing experiments evaluating methods, techniques and tools in software engineering.
Related Papers (5)
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more