Journal ArticleDOI
Test case selection using multi-criteria optimization for effective fault localization
Reads0
Chats0
TLDR
This paper proposes an approach for selecting a subset of the passed test suite when a failure revealed by a failed test case is revealed, and shows that the fault localization effectiveness can be significantly improved with less than 5% passed test cases.Abstract:Â
As spectra-based fault localization techniques report suspicious statements by analyzing the coverage of test cases, the effectiveness of the results is highly dependent on the composition of test suites. This paper proposes an approach for selecting a subset of the passed test suite when a failure revealed by a failed test case. The goal is to obtain a more effective fault localization using a minimal number of test cases than using the originally given large number of test cases. A novelty is that a prioritization criterion and a selection criterion are defined. Different from previous studies, the failed trace is fully considered. The prioritization criterion partitions statements in the failed trace into more suspicious and less suspicious, and then ranks passed test cases by their ability in distinguishing the more suspicious statements from the less suspicious ones. The selection criterion selects the minimal passed test suite which can maximize the number of coverage equivalent classes in the failed trace, so as to distinguish the suspicious statements and meanwhile reduce the size of the test suite. Another novelty is that our approach turns the test case selection into a multi-criteria optimization to make the prioritization and the selection criteria complement each other. This approach was evaluated with 5 fault localization techniques, 8 subject programs and 35,392 test cases. The results show that the fault localization effectiveness can be significantly improved with less than 5% passed test cases. Our approach has advantages over the statement- based and vector-based test suite reduction approaches in both fault localization effectiveness and test suite reduction rate.read more
Citations
More filters
Journal ArticleDOI
DeST 3.0: A new-generation building performance simulation platform
Di Yan,Xin Zhou,Jingjing An,Xuyuan Kang,Fan Bu,Yu-ming Chen,Yiqun Pan,Yanlin Gao,Qun-Bo Zhang,Hui Zhou,Kuining Qiu,Jing Li,Yan Long Liu,Honglian Li,Lei Zhang,Hong Dong,Song Pan,Xiang Zhao,Zhe Tian,Wenjun Zhang,Ruhong Wu,Hong Gang Sun,Yu Huang,X.G. Su,Yongwei Zhang,Rui Shen,Diankun Chen,Guangyuan Wei,Yixing Chen,Jinqing Peng +29 more
TL;DR: DeST 3.0 as discussed by the authors , a new generation building performance simulation platform, was developed and released, which includes four simulation engines, including building analysis and simulation (BAS), HVAC system engine, combined plant simulation (CPS) engine, and energy system (ES) engine.
Journal ArticleDOI
A Comprehensive Investigation of Modern Test Suite Optimization Trends, Tools and Techniques
TL;DR: A broad exploration of tools and techniques, in this article, will help researchers, practitioners, and developers to opt for adequate techniques, tools, or platforms as per requirements.
Journal ArticleDOI
Invariant based fault localization by analyzing error propagation
TL;DR: Results have shown that compared with the simple value range invariant based method, after performing the optimization strategies, the NScore value was increased by 75.2%, which means that the method can effectively localize more kinds of bugs.
Journal ArticleDOI
Fault localization based on wide & deep learning model by mining software behavior
TL;DR: Experiments on practical software defects benchmark Defects4J have shown that the proposed fault localization approach by wide & deep learning on multi-feature groups outperforms the traditional spectrum-based and mutation-based approaches on the capability of early fault detection.
Book
Multi-Criteria Optimization of System Integration Testing
TL;DR: Test optimization is typically seen as a multi-criteria decision making problem and one aspect of test optimi ...
References
More filters
Book
Statistical Power Analysis for the Behavioral Sciences
TL;DR: The concepts of power analysis are discussed in this paper, where Chi-square Tests for Goodness of Fit and Contingency Tables, t-Test for Means, and Sign Test are used.
Proceedings ArticleDOI
Empirical evaluation of the tarantula automatic fault-localization technique
James A. Jones,Mary Jean Harrold +1 more
TL;DR: The studies show that, on the same set of subjects, the Tarantula technique consistently outperforms the other four techniques in terms of effectiveness in fault localization, and is comparable in efficiency to the least expensive of the other five techniques.
Proceedings ArticleDOI
Visualization of test information to assist fault localization
TL;DR: A new technique that uses color to visually map the participation of each program statement in the outcome of the execution of the program with a test suite, consisting of both passed and failed test cases is presented.
Proceedings ArticleDOI
Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteria
TL;DR: An experimental study investigating the effectiveness of two code-based test adequacy criteria for identifying sets of test cases that detect faults found that tests based respectively on control-flow and dataflow criteria are frequency complementary in their effectiveness.