National Institute of Standards and Technology における超伝導研究及び生活

Fatigue and drowsiness of drivers are amongst the significant causes of road accidents. In this paper, we discuss a method for detecting drivers' drowsiness and subsequently alerting them. The aim is to reduce the number of accidents due to drivers fatigue and hence increase the transportation safety. Many special body and face gestures are used as sign of driver fatigue, including yawning, eye tiredness and eye movement, which indicate that the driver is no longer in a proper driving condition. Here, we propose a method of yawning detection based on the changes in the mouth geometric features.

/pdf/driver-drowsiness-monitoring-based-on-yawning-detection-48nlhy1tq6.pdf

Driver drowsiness monitoring based on yawning detection

Focus on Durability, PATH Research at the National Institute of Standards and Technology | NIST

Drowsy driver alert systems have been developed to minimize and prevent car accidents. Existing vision-based systems are usually restricted to using visual cues, depend on tedious parameter tuning, or cannot work under general conditions. One additional crucial issue is the lack of public datasets that can be used to evaluate the performance of different methods. In this paper, we introduce a novel hierarchical temporal Deep Belief Network (HTDBN) method for drowsy detection. Our scheme first extracts high-level facial and head feature representations and then use them to recognize drowsiness-related symptoms. Two continuous-hidden Markov models are constructed on top of the DBNs. These are used to model and capture the interactive relations between eyes, mouth and head motions. We also collect a large comprehensive dataset containing various ethnicities, genders, lighting conditions and driving scenarios in pursuit of wide variations of driver videos. Experimental results demonstrate the feasibility of the proposed HTDBN framework in detecting drowsiness based on different visual cues.

Driver Drowsiness Detection via a Hierarchical Temporal Deep Belief Network

Seat belt detection is one of the necessary task which are required in transportation system to reduce accidents due to abrupt stop or high speed accident with other vehicles. In this paper, a technique is proposed to detect whether the driver wears seat belt or not by using convolution neural networks. Convolution Neural Network is nothing but deep Neural Network. ConvNet automatically collects features using filters or kernels from images without human involvement to classify the output images. Compared to different classification algorithms, preprocessing required in ConvNet is least. In this proposed method, first ConvNet is built and trained using Seatbelt dataset of both standard and non-standard. ConvNet learns the features from the images of seat belt dataset and performed better with an accuracy of 91.4% over SVM with 87.17% and an error rate of 8.55% when compared with SVM with 12.83% in case of standard dataset.

/pdf/driver-s-seat-belt-detection-using-cnn-1fvgfpmknk.pdf

Driver’s Seat Belt Detection Using CNN

In this paper, we present two video datasets of drivers with various facial characteristics, to be used for designing and testing algorithms and models for yawning detection. For collecting these videos, male and female candidates were asked to sit in the driver's seat of a car. The videos are taken in real and varying illumination conditions. In the first dataset, the camera is installed under the front mirror of the car. Each participant has three or four videos and each video contains different mouth conditions such as normal, talking/singing, and yawning. In the second dataset, the camera is installed on the dash in front of the driver, and each participant has one video with the above-mentioned different mouth conditions all in the same video. The car was parked for both datasets to keep the environment safe for the participants. As a benchmark, we also present the results of our own yawning detection method, and show that we can achieve a much higher accuracy in the scenario with the camera installed on the dash in front of the driver.

/pdf/yawdd-a-yawning-detection-dataset-8307vtqftp.pdf

YawDD: a yawning detection dataset

Yawning detection has a variety of important applications in a driver fatigue detection, well-being assessment of humans, driving behavior monitoring, operator attentiveness detection, and understanding the intentions of a person with a tongue disability. In all of the above applications, an automatic detection of yawning is one important system component. In this paper, we design and implement such automatic system, using computer vision, which runs on a computationally limited embedded smart camera platform to detect yawning. We use a significantly modified implementation of the Viola-Jones algorithm for face and mouth detections and, then, use a backprojection theory for measuring both the rate and the amount of the changes in the mouth, in order to detect yawning. As proof-of-concept, we have also implemented and tested our system on top of an actual smart camera embedded platform, called APEX from CogniVue Corporation. In our design and implementations, we took into consideration the practical aspects that many existing works ignore, such as real-time requirements of the system, as well as the limited processing power, memory, and computing capabilities of the embedded platform. Comparisons with existing methods show significant improvements in the correct yawning detection rate obtained by our proposed method.

Yawning Detection Using Embedded Smart Cameras

Driver drowsiness is a major factor in most driving accidents In this paper we present a robust and intelligent scheme for driver drowsiness detection employing the fusion of eye closure and yawning detection methods In this approach, the driver's facial appearance is captured via a camera installed in the car In the first step, the face region is detected and tracked in the captured video sequence utilizing computer vision techniques Next, the eye and mouth areas are extracted from the face; and they are studied to find signs of driver fatigue Finally, in a fusion phase the driver state is determined and a warning message is sent to the driver if the drowsiness is detected Our experiments prove the high efficiency of the proposed idea

Intelligent driver drowsiness detection through fusion of yawning and eye closure

The imaging assessment of paraspinal muscle morphology and fatty infiltration has gained considerable attention in the past decades, with reports suggesting an association between muscle degenerative changes and low back pain (LBP). To date, qualitative and quantitative approaches have been used to assess paraspinal muscle composition. Though highly reliable, manual thresholding techniques are time consuming and not always feasible in a clinical setting. The tedious and rater-dependent nature of such manual thresholding techniques provides the impetus for the development of automated or semi-automated segmentation methods. The purpose of the present study was to develop and evaluate an automated thresholding algorithm for the assessment of paraspinal muscle composition. The reliability and validity of the muscle measurements using the new automated thresholding algorithm were investigated through repeated measurements and comparison with measurements from an established, highly reliable manual thresholding technique. Magnetic resonance images of 30 patients with LBP were randomly selected cohort of patients participating in a project on commonly diagnosed lumbar pathologies in patients attending spine surgeon clinics. A series of T2-weighted MR images were used to train the algorithm; preprocessing techniques including adaptive histogram equalization method image adjustment scheme were used to enhance the quality and contrast of the images. All muscle measurements were repeated twice using a manual thresholding technique and the novel automated thresholding algorithm, from axial T2-weigthed images, at least 5 days apart. The rater was blinded to all earlier measurements. Inter-method agreement and intra-rater reliability for each measurement method were assessed. The study did not received external funding and the authors have no disclosures. There was excellent agreement between the two methods with inter-method reliability coefficients (intraclass correlation coefficients) varying from 0.79 to 0.99. Bland and Altman plots further confirmed the agreement between the two methods. Intra-rater reliability and standard error of measurements were comparable between methods, with reliability coefficient varying between 0.95 and 0.99 for the manual thresholding and 0.97–0.99 for the automated algorithm. The proposed automated thresholding algorithm to assess paraspinal muscle size and composition measurements was highly reliable, with excellent agreement with the reference manual thresholding method.

/pdf/evaluation-of-an-automated-thresholding-algorithm-for-the-1wg68z93o2.pdf

Evaluation of an automated thresholding algorithm for the quantification of paraspinal muscle composition from MRI images

This paper addresses a new approach to the keyframe extraction problem employing generalized Gaussian density (GGD) parameters of wavelet transform subbands along with Kullback-Leibler distance (KLD) measurement. Shot and cluster boundaries are selected using KLDs between GGD feature vectors, and then keyframes are located based on similarity and dissimilarity criteria. Objective and subjective evaluations show the high accuracy of this new approach compared with traditional methods.

https://www.site.uottawa.ca/~shervin/pubs/VideoKeyFrame-IEEE-TIP.pdf

Mona Omidyeganeh

Papers

YawDD: a yawning detection dataset

Yawning Detection Using Embedded Smart Cameras

Intelligent driver drowsiness detection through fusion of yawning and eye closure

Evaluation of an automated thresholding algorithm for the quantification of paraspinal muscle composition from MRI images

Video Keyframe Analysis Using a Segment-Based Statistical Metric in a Visually Sensitive Parametric Space