scispace - formally typeset
Open AccessJournal ArticleDOI

Software Verification and Validation of Safe Autonomous Cars: A Systematic Literature Review

TLDR
In this article, the relevant research literature in recent years has been systematically reviewed and classified in order to investigate the state-of-the-art in the software verification and validation (V&V) of autonomous cars.
Abstract
Autonomous, or self-driving, cars are emerging as the solution to several problems primarily caused by humans on roads, such as accidents and traffic congestion. However, those benefits come with great challenges in the verification and validation (V&V) for safety assessment. In fact, due to the possibly unpredictable nature of Artificial Intelligence (AI), its use in autonomous cars creates concerns that need to be addressed using appropriate V&V processes that can address trustworthy AI and safe autonomy. In this study, the relevant research literature in recent years has been systematically reviewed and classified in order to investigate the state-of-the-art in the software V&V of autonomous cars. By appropriate criteria, a subset of primary studies has been selected for more in-depth analysis. The first part of the review addresses certification issues against reference standards, challenges in assessing machine learning, as well as general V&V methodologies. The second part investigates more specific approaches, including simulation environments and mutation testing, corner cases and adversarial examples, fault injection, software safety cages, techniques for cyber-physical systems, and formal methods. Relevant approaches and related tools have been discussed and compared in order to highlight open issues and opportunities.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Virtual Testing of Automated Driving Systems. A Survey on Validation Methods

- 01 Jan 2022 - 
TL;DR: In this paper , the authors present a survey of state-of-the-art contributions supporting the validation of virtual testing toolchains for automated driving system (ADS) verification, which includes classic high-level validation approaches and modern specific computational tools that can be adopted depending on the type of data under analysis.
Journal ArticleDOI

How to certify machine learning based safety-critical systems? A systematic literature review

TL;DR: In this article , a Systematic Literature Review (SLR) of research papers published between 2015 to 2020, covering topics related to the certification of ML systems was conducted, which identified 217 papers covering topics considered to be the main pillars of ML certification: Robustness, Uncertainty, Explainability, Verification, Safe Reinforcement Learning, and Direct Certification.
Journal ArticleDOI

Virtual Testing of Automated Driving Systems. A Survey on Validation Methods

TL;DR: This paper surveys the state-of-the-art contributions supporting the validation of virtual testing toolchains for Automated Driving System (ADS) verification and finds that modeling and validating virtual sensors for ADS is the most lacking area from a subsystem-level approach.
Posted Content

How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review

TL;DR: In this paper, the authors conducted a systematic literature review (SLR) of research papers published between 2015 to 2020, covering topics related to the certification of ML systems, and identified 217 papers covering topics considered to be the main pillars of ML certification: Robustness, Uncertainty, Explainability, Verification, Safe Reinforcement Learning, and Direct Certification.
Journal ArticleDOI

Single-Image Reflection Removal Using Deep Learning: A Systematic Review

TL;DR: In this article , a systematic literature review on the topic of single-image reflection removal using deep learning methods which were published between the years 2015 to 2021 was proposed, where a total number of 1600 research papers were extracted from five different online databases and digital libraries (IEEE Xplore, Google Scholar, Science Direct, SpringerLink and ACM Digital Library).
References
More filters
Journal ArticleDOI

Lessons from applying the systematic literature review process within the software engineering domain

TL;DR: In this article, the authors report experiences with applying one such approach, the practice of systematic literature review, to the published studies relevant to topics within the software engineering domain, and some lessons about the applicability of this practice to software engineering are extracted.
Proceedings ArticleDOI

DeepXplore: Automated Whitebox Testing of Deep Learning Systems

TL;DR: DeepXplore efficiently finds thousands of incorrect corner case behaviors in state-of-the-art DL models with thousands of neurons trained on five popular datasets including ImageNet and Udacity self-driving challenge data.
Book ChapterDOI

Safety Verification of Deep Neural Networks

TL;DR: A novel automated verification framework for feed-forward multi-layer neural networks based on Satisfiability Modulo Theory (SMT) is developed, which defines safety for an individual decision in terms of invariance of the classification within a small neighbourhood of the original image.
Journal ArticleDOI

Challenges in Autonomous Vehicle Testing and Validation

TL;DR: Five major challenge areas in testing according to the V model for autonomous vehicles are identified: driver out of the loop, complex requirements, non-deterministic algorithms, inductive learning algorithms, and failoperational systems.
Proceedings ArticleDOI

DeepRoad: GAN-based metamorphic testing and input validation framework for autonomous driving systems

TL;DR: The experimental results demonstrate that DeepRoad can detect thousands of inconsistent behaviors for DNN-based autonomous driving systems, and effectively validate input images to potentially enhance the system robustness as well.
Related Papers (5)
Trending Questions (3)
What are some of the verification and validation problems related to ODD in an autonomous car?

The provided paper does not specifically mention the verification and validation problems related to ODD (Operational Design Domain) in autonomous cars.

What are the challenges in verifying and validating AI modules used for energy management in a car?

The provided paper does not specifically address the challenges in verifying and validating AI modules used for energy management in a car. The paper focuses on the verification and validation of software in autonomous cars in general.

What are the current research gaps in verification and validation of AI modules in cars?

The provided paper does not specifically mention the research gaps in verification and validation of AI modules in cars.