Verification and validation of computer simulation models

About: Verification and validation of computer simulation models is a research topic. Over the lifetime, 1556 publications have been published within this topic receiving 43203 citations.

A Methodology For Partial Verification And Validation Of OPS5-based Al Applications

Abstract: Verification and validation of AI systems is an important problem. In this article, we present a methodology for partial verification and validation of production system applications, in particular, OPS5-based applications. This methodology has two main parts in it. The first part, termed Domain-Independent Verification, involves finding certain properties and relations of productions by compile-time analysis. The second part, termed Systematic Testing, consists of generating the data-dependency graph, finding the set of distinct data-paths, and generating test data for each distinct data-path. We discuss how these two parts of the methodology contribute towards the partial verification and validation of OPS5-based applications.

Numerical investigation and experimental verification of the proposed robot leg virtual model

Abstract: Modeling and simulation studies are significant in the early stages of the design process, since there is no prototype. For instance, dynamic systems such as control systems can be developed rapidly and effectively with the simulation studies. However, the validity of the results obtained from the simulation studies performed with the dynamic model should be verified before deepening the design studies. After all, the accuracy of the results of the performed simulations depends on the accuracy of the obtained model. In this paper, studies on the numerical analysis of the proposed leg model to be used in a quadruped robot, and experimental verification of the dynamic model obtained by this means are presented. In this context, a simulation model has been constructed by using the physical and mathematical model that includes all the major components of the proposed robot leg in order to evaluate the performances of different algorithms in the design studies. In order to evaluate the validity of the simulation model, a series of tests were carried out on the experimental setup and the obtained results were demonstrated both numerically and graphically. According to the obtained results, it was seen that the built simulation model was valid, and matched with the real system and its physical trends. Finally, after discussing the reliability and validity of the proposed robot leg experimental and simulation setup, low-level components affecting controller performance in hydraulically actuated robots are discussed and recommendations made.

Secure Systems Development -- The Evolving Integration of Validation and Verification

Abstract: The paper is aiming at a step towards a process model for the development of systems that are valid in the sense of meeting both specified security requirements and diverse user needs and expectations. The ultimate goal is to certify a system’s validity. Derived from IT security evaluation criteria, the paper is outlining a certain integration of two independently developed process models in a way that validation and verification are becoming truly dovetailed. The discussed evaluation process model is currently being developed and implemented in the authors’ IT security evaluation facility (ITSEF). It is one of the targets of this publication to bring academic research and development on validation and verification closer to the IT security evaluation practice.

Final Report for "Verification and Validation of Radiation Hydrodynamics for Astrophysical Applications"

Abstract: The motivation for this work is to gain experience in the methodology of verification and validation (V&V) of astrophysical radiation hydrodynamics codes In the first period of this work, we focused on building the infrastructure to test a single astrophysical application code, Castro, developed in collaboration between Lawrence Livermore National Laboratory (LLNL) and Lawrence Berkeley Laboratory (LBL) We delivered several hydrodynamic test problems, in the form of coded initial conditions and documentation for verification, routines to perform data analysis, and a generalized regression test suite to allow for continued automated testing Astrophysical simulation codes aim to model phenomena that elude direct experimentation Our only direct information about these systems comes from what we observe, and may be transient Simulation can help further our understanding by allowing virtual experimentation of these systems However, to have confidence in our simulations requires us to have confidence in the tools we use Verification and Validation is a process by which we work to build confidence that a simulation code is accurately representing reality V&V is a multistep process, and is never really complete Once a single test problem is working as desired (ie that problem is verified), one wants to ensure that subsequent code changes do not break that test At the same time, one must also search for new verification problems that test the code in a new way It can be rather tedious to manually retest each of the problems, so before going too far with V&V, it is desirable to have an automated test suite Our project aims to provide these basic tools for astrophysical radiation hydrodynamics codes

Improving simulation results with static models

Abstract: Effective simulation models require robust development methodologies. Planning, design, data, and testing are integral to ensure valuable answers to the model's customers. This paper discusses how supporting static models provide guidelines and directional correctness to simulation models. Static models can also provide supplemental answers which allow the reduction in simulation model complexity.