Due to the rise of autonomous vehicles like drones and cars anomaly detection for better and robust surveillance becomes prominent for real-time recognition of normal and abnormal states. But the whole system fails if the unmanned device is unable to detect its own device's anomaly in real-time. Considering the scenario, we can make use of various data of autonomous vehicles like images, video streams, and other digital or analog sensor data to detect device anomaly. In this paper, we have demonstrated a heterogeneous system that estimates the degree of an anomaly in unmanned surveillance drone by inspecting IMU (Inertial Measurement Unit) sensor data and real-time image in an unsupervised approach. We've used AngleNet for detecting images taken in an abnormal state. On top of that, an autoencoder fed by the IMU data has been ensembled with AngleNet for evaluating the final degree of the anomaly. This proposed method is based on the result of the IEEE SP Cup 2020 which achieved 97.3 percent accuracy on the provided dataset. Besides, this approach has been evaluated on an in-house setup for substantiating its robustness.

Chinmoy Kumer Roy

Papers

Unsupervised Abnormality Detection Using Heterogenous Autonomous System