Showing papers on "Test harness published in 2023"
TL;DR: In this article , the authors proposed a method using AI to automatically generate test cases from the structure of the UI using a pipelined architecture of object detection, text detection and NLP models.
1 citations
01 Apr 2023
TL;DR: In this paper , the authors propose the use of Test Architecture (TA) as defined in the OMG UTP in place of STA and refines some earlier paper definitions and usage of STA to align with UTP and ISO concepts.
Abstract: The concept of software test architecture (STA) has been discussed within industry meetings with little universal agreement on its usage. This paper proposes the use of Test Architecture (TA) as defined in the OMG UTP in place of STA and refines some earlier paper definitions and usage of STA to align with UTP and ISO concepts. Further, the paper considers TA styles of test environments and how they can use UTP modeling, which can lead to test automation as well as to better testing outcomes.
[...]
01 Jan 2023
TL;DR: Test execution is the process of running the tests that have been designed and planned in the previous stages of the software testing life cycle as mentioned in this paper , and it is defined as the "process of running test cases".
Abstract: Test execution is the process of running the tests that have been designed and planned in the previous stages of the software testing life cycle. This chapter will cover the importance of test execution, the test execution process, and the various techniques and tools used in test execution. We will go through the test execution process, the needs of the environment setup, and the defect reporting and retesting. We will identify the needs for regression, how to report the status of the execution, and when to complete the activities. We will see some techniques and tools that we can assist us, and we will choose some quality metrics for our product.
21 Apr 2023
TL;DR: In this paper , a set of multi-way valve intelligent test system is designed in order to solve the problem that there are many multiway valve test items and the test steps are cumbersome.
Abstract: In order to solve the problem that there are many multi-way valve test items and the test steps are cumbersome, a set of multi-way valve intelligent test system is designed in this paper.According to the test requirements, the corresponding hydraulic system and electronic control system are designed, and the measurement and control software with multiple functional modules is developed based on Labview.The software has a login module, a sensor parameter setting module, a sub-menu module, a data query module, and a main menu module.The test results show that the function of the test system is perfect, and the test results meet the user's requirements.
[...]
01 Jan 2023
TL;DR: Test automation is the use of specialized software tools to control the execution of tests and compare the actual results with the expected results as mentioned in this paper , which can help reduce the time and cost associated with testing while also improving the accuracy and reliability of the test results.
Abstract: Test automation is the use of specialized software tools to control the execution of tests and compare the actual results with the expected results. The use of automation has become increasingly popular as it can help reduce the time and cost associated with testing while also improving the accuracy and reliability of the test results.
TL;DR: In this article , the authors developed a knowledge graph that aggregates all the test knowledge automatically and integrates it into the test processes, which is called test knowledge and is the key input for test automation and in turn essential for reducing the cost of product development.
Abstract: Heterogeneous test processes concerning test goals and test script languages are an integral part of mechatronic systems development in supply chains. Here, test cases are written in a multitude of different test script languages. The translation between test script languages is possible, a joint understanding and a holistic view of the mechatronic system as a system under test is only achieved in the minds of experienced test engineers. This joined-up information is called test knowledge and is the key input for test automation and in turn, it is essential for reducing the cost of product development. Persisted test knowledge enables the search for patterns semi-automatically without reading countless test cases and enables the auto-completion of essential parts of test cases. In this paper, we developed a knowledge graph that aggregates all the test knowledge automatically and integrates it into the test processes. We derived an explorative search that simplifies the test case creation. For that purpose, a corresponding user-friendly query language, and unidirectional translation capabilities were developed that translates a test case into a graph tailored to the target audience of test engineers. We demonstrated the usage and impact of this approach by evaluating it on test cases from aircraft cabin doors.
TL;DR: In this article , a test structure is defined as an object that carries the formal specifications of the system under test, and the test objective, which is specified by a test engineer, and then the algebra of assume-guarantee contracts is used to reason about constructing test specifications.
Abstract: We establish a framework to reason about test campaigns described formally. First, we introduce the notion of a test structure—an object that carries i) the formal specifications of the system under test, and ii) the test objective, which is specified by a test engineer. We build on test structures to define test campaigns and specifications for the tester. Secondly, we use the algebra of assume-guarantee contracts to reason about constructing tester specifications, comparing test structures and test campaigns, and combining and splitting test structures. Using the composition operator, we characterize the conditions on the constituent tester specifications and test objectives for feasibly combining test structures. We illustrate the different applications of the quotient operator to split the test objective, the system into subsystems, or both. Finally, we illustrate test executions corresponding to the combined and split test structures in a discrete autonomous driving example and an aircraft formation-flying example. We anticipate that reasoning over test specifications would aid in generating optimal test campaigns.
TL;DR: In this paper , an automated test site using a supervised machine learning algorithm for testing an ultra-high frequency (UHF) transceiver is presented, where the test site is designed in three steps.
Abstract: Electronic manufacturing and design companies maintain test sites for a range of products. These products are designed according to the end-user requirements. The end user requirement, then, determines which of the proof of design and manufacturing tests are needed. Test sites are designed to carry out two things, i.e., proof of design and manufacturing tests. The team responsible for designing test sites considers several parameters like deployment cost, test time, test coverage, etc. In this study, an automated test site using a supervised machine learning algorithm for testing an ultra-high frequency (UHF) transceiver is presented. The test site is designed in three steps. Firstly, an initial manual test site is designed. Secondly, the manual design is upgraded into a fully automated test site. And finally supervised machine learning is applied to the automated design to further enhance the capability. The manual test site setup is required to streamline the test sequence and validate the control and measurements taken from the test equipment and unit under test (UUT) performance. The manual test results showed a high test time, and some inconsistencies were observed when the test operator was required to change component values to tune the UUT. There was also a sudden increase in the UUT quantities and so, to cater for this, the test site is upgraded to an automated test site while the issue of inconsistencies is resolved through the application of machine learning. The automated test site significantly reduced test time per UUT. To support the test operator in selecting the correct component value the first time, a supervised machine learning algorithm is applied. The results show an overall improvement in terms of reduced test time, increased consistency, and improved quality through automation and machine learning.
01 Jan 2023
TL;DR: In this paper , the authors proposed a unified solution for best test case generation in an object-oriented model using UML behavioral diagrams and a hybrid approach called Spider Monkey Particle Swarm Optimization (SMPSO).
Abstract: Software testing offers re-utilization of the model for the operation of validation and this leverages the test case generation growth. It is a very crucial and complicated action in software establishment as it is very concise with software standards. The testing process is comprised of three main parts, such as test scenarios generation, test implementation, and test assessment. The process of test case generation serves a significant part in all three circumstances. The major components of the test case are input to the module, the state of the module and the targeted outcome. If the test case finds numerous faults with very few test cases, then it is stated as better coverage. During the software development mechanism, testing can be executed at any time and anywhere, but the testing is executed after the needs are described and the coding mechanism is completed. Automatic testing is utilized to occupy most resources, like cost, effort, and time. Usually, behavior illustration and Unified Modeling Language (UML) structural diagrams are used by researchers for test case generation at the early phase of evolution. This mechanism efficiently ensures the durability of the system with the assistance of improved test coverage. Software testing utilizing an object-oriented model is a challenging task among the research community in the modern period. In order to enhance the standard of the software, automation of testing has become a crucial part. Hence, this research provides a unified solution for best test case generation in an object-oriented model. In the first contribution, the method proposes an approach to generate the test scenarios from the integrated models of sequence and state machine diagrams with the help of a case study. This method is systematic and highly logical. The developed approach is very efficient in dealing with errors in the loop and inaccurate message responses. In our second contribution, we have proposed an algorithm to optimize the generated test sequences from UML behavioral diagrams. The sequences that enclose all the test probabilities are chosen by exploiting developed Fractional-SMO, which is newly devised by the amalgamation of Fractional calculus with SMO. Therefore, suitable test cases are selected depending on the optimization that utilizes the factors such as coverage and fault. Finally, in the third contribution, we proposed a hybrid approach called Spider Monkey Particle Swarm Optimization (SMPSO) to optimize the produced test cases from the developed models. Accordingly, the proposed algorithm efficiently produces the best test cases from UML by means of the framing of a control flow graph. However, the proposed algorithm attained a maximum coverage of 85% and is capable of generating maximum test scenarios.
TL;DR: In this paper , an Integration Test and Simulation for Engagement Control (ITSEC) bed using a bare-metal virtualization mechanism is proposed to meet the above test and simulation requirements, and it is applied and implemented for an air missile defense system.
Abstract: Modeling and Simulation(M&S) technology has been widely used to solve constraints such as time, space, safety, and cost when we implement the same development and test environments as real warfare environments to develop, test, and evaluate weapon systems for the last several decades. The integration and test environments employed for development and test & evaluation are required to provide Live Virtual Construction(LVC) simulation environments for carrying out requirement analysis, design, integration, test and verification. Additionally, they are needed to provide computing environments which are possible to reconfigure computing resources and software components easily according to test configuration changes, and to run legacy software components independently on specific hardware and software environments. In this paper, an Integration Test and Simulation for Engagement Control(ITSEC) bed using a bare-metal virtualization mechanism is proposed to meet the above test and simulation requirements, and it is applied and implemented for an air missile defense system. The engagement simulation experiment results conducted on air and missile defense environments demonstrate that the proposed bed is a sufficiently cost-effective and feasible solution to reconfigure and expand application software and computing resources in accordance with various integration and test environments.
01 Jan 2023
TL;DR: In this article , the authors presented a soft condition based on a full-digital test environment, achieving software test and hardware decoupling, realizes the parallel development of software and hardware, and shortens the development cycle.
Abstract: In order to realize satellite complex and flexible function, reduce the satellite development cycle and cost, and realize modular production, software in satellite occupies a pivotal role. Due to the powerful software function, flexible configuration and convenient update, the software test is more and more complex. The current star borne software test is mainly based on the real hardware environment, with software and hardware serial development, which consumes more resources. This paper presents a soft condition based on a full-digital test environment. The test method, achieving software test and hardware decoupling, realizes the parallel development of software and hardware, and shortens the development cycle. The test efficiency increases by more than 25%.
01 Apr 2023
TL;DR: In this paper , a simple software development workflow that seamlessly integrates requirements refinement, object-oriented design, and test-driven development is presented, and a step-by-step live-coding demonstration which resembles testdriven development tasks students will face in the industry is also provided.
Abstract: Test-driven development is an effective industrial practice. As educators of future software engineers, we need to effectively teach students test-driven development. Unfortunately, this topic is usually taught in a theoretical way. Students hardly use this approach in their projects. In this paper, we present a simple software development workflow that seamlessly integrates requirements refinement, object-oriented design, and test-driven development. A step-by-step live-coding demonstration which resembles test-driven development tasks students will face in the industry is also provided. By adopting the workflow and exemplary project in a programming class, we hope this provides students with some hands-on experience, thus helping develop good habit of programming.
20 Feb 2023
TL;DR: In this paper , the authors propose a test environment that can be quickly removed to verify the operation of automotive software and helps improve quality by quickly and easily checking errors not only in the software production process but also in the completed system.
Abstract: Embedded software for vehicles is becoming increasingly complex and huge, and the complexity of test evaluations and the amount of test cases are increasing exponentially. The hardware-based testing methods currently in use often involve some complex preparation and scheduling, making it difficult to determine the actual test results. Therefore, to build a hardware-independent test environment, this paper proposes a method to insert and test components into the port interface for communication between software components of AUTOSAR. This provides a test environment that can be quickly removed to verify the operation of automotive software and helps improve quality by quickly and easily checking errors not only in the software production process but also in the completed system.