Artificial neural networks (ANNs) constitute a class of flexible nonlinear models designed to mimic biological neural systems. In this entry, we introduce ANN using familiar econometric terminology and provide an overview of ANN modeling approach and its implementation methods. † Correspondence: Chung-Ming Kuan, Institute of Economics, Academia Sinica, 128 Academia Road, Sec. 2, Taipei 115, Taiwan; ckuan@econ.sinica.edu.tw. †† I would like to express my sincere gratitude to the editor, Professor Steven Durlauf, for his patience and constructive comments on early drafts of this entry. I also thank Shih-Hsun Hsu and Yu-Lieh Huang for very helpful suggestions. The remaining errors are all mine.

Artificial neural networks

Mutation Testing is a fault-based software testing technique that has been widely studied for over three decades The literature on Mutation Testing has contributed a set of approaches, tools, developments, and empirical results This paper provides a comprehensive analysis and survey of Mutation Testing The paper also presents the results of several development trend analyses These analyses provide evidence that Mutation Testing techniques and tools are reaching a state of maturity and applicability, while the topic of Mutation Testing itself is the subject of increasing interest

An Analysis and Survey of the Development of Mutation Testing

Regression testing is a testing activity that is performed to provide confidence that changes do not harm the existing behaviour of the software. Test suites tend to grow in size as software evolves, often making it too costly to execute entire test suites. A number of different approaches have been studied to maximize the value of the accrued test suite: minimization, selection and prioritization. Test suite minimization seeks to eliminate redundant test cases in order to reduce the number of tests to run. Test case selection seeks to identify the test cases that are relevant to some set of recent changes. Test case prioritization seeks to order test cases in such a way that early fault detection is maximized. This paper surveys each area of minimization, selection and prioritization technique and discusses open problems and potential directions for future research. Copyright © 2010 John Wiley & Sons, Ltd.

Regression testing minimization, selection and prioritization: a survey

Where the creation, understanding, and assessment of software testing and regression testing techniques are concerned, controlled experimentation is an indispensable research methodology. Obtaining the infrastructure necessary to support such experimentation, however, is difficult and expensive. As a result, progress in experimentation with testing techniques has been slow, and empirical data on the costs and effectiveness of techniques remains relatively scarce. To help address this problem, we have been designing and constructing infrastructure to support controlled experimentation with testing and regression testing techniques. This paper reports on the challenges faced by researchers experimenting with testing techniques, including those that inform the design of our infrastructure. The paper then describes the infrastructure that we are creating in response to these challenges, and that we are now making available to other researchers, and discusses the impact that this infrastructure has had and can be expected to have.

/pdf/supporting-controlled-experimentation-with-testing-pe7sdxpo8h.pdf

Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact

Empirical studies in software testing research may not be comparable, reproducible, or characteristic of practice. One reason is that real bugs are too infrequently used in software testing research. Extracting and reproducing real bugs is challenging and as a result hand-seeded faults or mutants are commonly used as a substitute. This paper presents Defects4J, a database and extensible framework providing real bugs to enable reproducible studies in software testing research. The initial version of Defects4J contains 357 real bugs from 5 real-world open source pro- grams. Each real bug is accompanied by a comprehensive test suite that can expose (demonstrate) that bug. Defects4J is extensible and builds on top of each program’s version con- trol system. Once a program is configured in Defects4J, new bugs can be added to the database with little or no effort. Defects4J features a framework to easily access faulty and fixed program versions and corresponding test suites. This framework also provides a high-level interface to common tasks in software testing research, making it easy to con- duct and reproduce empirical studies. Defects4J is publicly available at http://defects4j.org.

/pdf/defects4j-a-database-of-existing-faults-to-enable-controlled-1x92gx1c9e.pdf

Defects4J: a database of existing faults to enable controlled testing studies for Java programs

Autonomous systems are susceptible to unknown safety issues due to overlooked dependencies among components of the system and the entities that are part of its operating environment. The current safety analysis techniques aids in identifying known safety issues but not overlooked/unknown safety issues. To identify unknown safety issues due to problematic interactions between components, in our previous work, we proposed safety assessment for concurrent components (SACC). Despite being more effective than FMEA and goal modeling, SACC suffers from some limitations such as not considering environmental entities and their properties, and a manual process for identifying associated components for the collective analysis. For a complex system with a large number of components, such an analysis can result in overlooking safety issues. To address these limitations, in this paper, we propose an association-driven safety analysis (ADSA) approach, which is extended and built on SACC. The approach uses a property-relation (PR) table and modified association rule mining algorithm to identify components and environmental entities that need to be considered together to detect overlooked or unknown safety issues. We evaluated our approach using four robotic systems and compared with SACC and systems theoretic process analysis (STPA). Our results show that our proposed approach, in particular using behavioral dependencies, is effective at exposing unknown safety issues. 

ADSA – Association-Driven Safety Analysis to Expose Unknown Safety Issues

The INAP(Intelligent Network Application Protocol) protocol test suite is the test procedures to conform that the implemented INAP protocol is equivalent to the standard specification of the INAP. The INAP test suite is generated automatically by using formal description technique. Before the generated test suite is applied to the real target system, it should be verified that this test suite has been correctly built according to the INAP specification. In this paper, we implemented the IUT(Implementation Under Test) simulator on the K1 197 tester to verify the generated INAP test suite. This method enabled us to correct the syntactic errors in the test suite and unexpected test sequence errors. It guarantees the reliability for verified results and reduces time and costs to verify the test suite than the manual method based on the protocol specification represented by natural language.

INAP Protocol Test Suite Verification Method Using the IUT Simulator for AIN System Conformance Testing

Often software in robotics systems is susceptible to unexpected and unforeseen behaviors called off-nominal behaviors (ONBs) and these ONBs can affect the reliability or safety of the systems. While some work is done on exposing ONBs in a system, there has been little research conducted on exposing ONBs when multiple robots perform a task together. In this paper, we propose a combinatorial based approach to expose ONBs in such multi-robot coordination tasks during the requirements engineering phase. Our approach separates system level analysis and coordination level analysis, and generates combinations that need to be manually analyzed for ONBs. To evaluate the effectiveness of our approach, we conducted an empirical study with a set of requirements that have three coordination tasks. The results of our study show that our approach offers a means for ONB knowledge acquisition and reduces significant human effort and time required for exposing ONBs.

Hyunsook Do

Papers

ADSA – Association-Driven Safety Analysis to Expose Unknown Safety Issues

INAP Protocol Test Suite Verification Method Using the IUT Simulator for AIN System Conformance Testing

Exposing off-nominal behaviors in multi-robot coordination