Proceedings ArticleDOI
ViDAQ: A Framework for Monitoring Human Machine Interfaces
Harsh V. P. Singh,Qusay H. Mahmoud +1 more
- pp 141-149
TLDR
An expert supervisory framework for HMIs (EYE-on-HMI) utilizing ViDAQ is envisioned, that is scalable and extensible to various industrial applications with prospective safety improvement to next generation commercial automation especially those with "driverless" operational modes.Abstract:
A novel case for visual data acquisition (ViDAQ) as an non-intrusive, scalable and reliable means of monitoring Human Machine Interfaces (HMIs) is envisioned. ViDAQ is a step towards achieving real-time cross-validation of human operator commands with respect to HMI states in large scale industrial control room environments. HMIs are integral in allowing human operators to safely command and monitor various critical processes, such as in nuclear power plants, commercial aviation, public transit vehicles, etc. However, HMI related perceptual dynamics presents a challenge to the designed safeguards against human-in-the-loop errors, which, ultimately is dependent on operator situational awareness. We envision, an expert supervisory framework for HMIs (EYE-on-HMI) utilizing ViDAQ, that is scalable and extensible to various industrial applications with prospective safety improvement to next generation commercial automation especially those with "driverless" operational modes. To this end, we present the design, implementation and evaluation of the ViDAQ to visually read rotary multi-dial meters herein.read more
Citations
More filters
Proceedings ArticleDOI
EYE-on-HMI: A Framework for monitoring human machine interfaces in control rooms
TL;DR: While assessing the feasibility of the proposed framework, a novel framework of the EYE - Expert Supervisory System capable of visually monitoring human machine interfaces (HMI) in cyber physical system (CPS) is proposed with target application in NPP control room environment, key enabling state-of-the-art technologies are reviewed.
Journal ArticleDOI
Novel Human-in-the-Loop (HIL) Simulation Method to Study Synthetic Agents and Standardize Human–Machine Teams (HMT)
Praveen Damacharla,Parashar Dhakal,Jyothi Priyanka Bandreddi,Ahmad Y. Javaid,Jennie J. Gallimore,Colin Elkin,Vijay Devabhaktuni +6 more
TL;DR: The proposed HIL method was found to assist in standardization studies in the pursuit of HMT benchmarking for critical applications and guidelines for designing and benchmarking HMTs are presented.
Journal ArticleDOI
Evaluation of ARIMA Models for Human–Machine Interface State Sequence Prediction
TL;DR: In this article, auto-regressive integrated moving average (ARIMA) time series data forecast models are evaluated to ascertain their feasibility in predicting human-machine interface (HMI) state transitions, which are modeled as multivariate time-series patterns.
Proceedings ArticleDOI
LSTM-based Approach to Monitor Operator Situation Awareness via HMI State Prediction
TL;DR: A novel approach towards achieving non-intrusive real-time monitoring of operator situational awareness is framed as a supervised learning task suitable for applying deep recurrent neural network (RNN) models.
Journal ArticleDOI
ViDAQ: A computer vision based remote data acquisition system for reading multi-dial gauges
TL;DR: Design improvements to the Visual Data Acquisition (ViDAQ) system for reading multi-dial gauges are presented and evaluated, poised to assist in realizing an overarching design goal of a generic EYE-on-HMI (Expert supervisorY systEm) framework.
References
More filters
Proceedings ArticleDOI
ORB: An efficient alternative to SIFT or SURF
TL;DR: This paper proposes a very fast binary descriptor based on BRIEF, called ORB, which is rotation invariant and resistant to noise, and demonstrates through experiments how ORB is at two orders of magnitude faster than SIFT, while performing as well in many situations.
Journal ArticleDOI
Pattern recognition by affine moment invariants
Jan Flusser,Tomáš Suk +1 more
TL;DR: The invariants from second- and third-order moments are derived and shown to be complete and to be invariant under general affine transformation and used for recognition of affine-deformed objects.
Proceedings ArticleDOI
A Descriptive Algorithm for Sobel Image Edge Detection
O. R. Vincent,Olusegun Folorunso +1 more
TL;DR: The Sobel operator performs a 2-D spatial gradient measurement on images to enhance the removal of redundant data, as a result, reduction of the amount of data is required to represent a digital image.
Speeding Up the Douglas-Peucker Line-Simplification Algorithm
John Hershberger,Jack Snoeyink +1 more
TL;DR: A algorithm is given, based on path hulls, that uses the geometric structure of the problem to attain a worst-case running time proportional to n log_2(n), which is the best case of the Douglas algorithm.
Journal ArticleDOI
Human Performance Consequences of Automated Decision Aids: The Impact of Degree of Automation and System Experience
TL;DR: In this paper, the authors investigate to what extent performance consequences of automated aids are dependent on the distribution of functions between human and automation and on the experience of the human and the automation.