Detection of Personal Protective Equipment (PPE) Compliance on Construction Site Using Computer Vision Based Deep Learning Techniques
Reads0
Chats0
TLDR
A framework to sense in real-time, the safety compliance of construction workers with respect to PPE is developed, intended to be integrated into the safety workflow of an organization, and provides evidence on the feasibility and utility of computer vision-based techniques in automating the safety-related compliance processes at construction sites.Abstract:
Construction safety is a matter of great concern for both practitioners and researchers world-wide. Even after enough risk assessments and implementations of adequate controls on the work environments, construction workers are still subject to safety hazards. The need for personal protective equipment (PPE) becomes important in this context. Automatic and real-time detection of non-compliance of workers towards PPE is an important concern. The developments in the field of computer vision and data analytics, especially using deep learning algorithms have the potential to address this challenge in construction. Through this study a framework is developed to sense in real time, the safety compliance of construction workers with respect to PPE, thereby allowing to integrate this framework into the safety workflow of an organization. The study makes use Convolutional Neural Networks model developed by applying transfer learning to a base version of YOLOv3 deep learning network. Based on the presence of hardhat and safety jacket, the model predicts the compliance in four categories such as NOT SAFE, SAFE, NoHardHat and NoJacket. A data set of 2509 images collected from video recordings from several construction sites and web-based collection has been used to train the model. The model reported an F1 score of 0.96 with an average precision and recall rates at 96% on test data set. Once a non “SAFE” category is detected by the model, an alarm and a time-stamped report are also incorporated to enable a real-time integration and adoption on the construction sites. Overall, the study provides evidence on the feasibility and utility of computer vision-based techniques in automating the safety related compliance processes at construction sites.read more
Citations
More filters
Journal ArticleDOI
Deep-learning-based visual data analytics for smart construction management
Aritra Pal,Shang-Hsien Hsieh +1 more
TL;DR: This in-depth review of state-of-the-art deep-learning applications on visual data analytics in the context of construction project management identifies six major fields and fifty-two subfields of construction management where deep- learning-based visual data Analytics methods have been applied and proposes a generalized workflow for applying these methods.
Journal ArticleDOI
Personal Protection Equipment detection system for embedded devices based on DNN and Fuzzy Logic
TL;DR: A PPE detection framework that combines DNN-based object detection with human judgement through fuzzy logic filtering is proposed that runs in near real-time on embedded devices and can be trained with a low number of images, still providing good accuracy results.
Journal ArticleDOI
Deep learning methods for object detection in smart manufacturing: A survey
TL;DR: A comprehensive survey of deep learning-based state-of-the-art object detection methods for industrial applications is presented in this article , where the current techniques for object detection algorithms and their deployment in industrial applications are also discussed.
Journal ArticleDOI
Development of YOLOv5-Based Real-Time Smart Monitoring System for Increasing Lab Safety Awareness in Educational Institutions
TL;DR: In this article , a real-time smart vision-based lab-safety monitoring system was proposed to verify the compliance of students using personal protective equipment (PPE) from image/video in real time.
Journal ArticleDOI
Generic compliance of industrial PPE by using deep learning techniques
Arso M. Vukicevic,Marko Djapan,Velibor Isailovic,Danko Milasinovic,Marija Savkovic,Pavle Milošević +5 more
TL;DR: In this paper , the authors proposed a procedure that reduces the problem of PPE compliance to the binary classification, and enables compliance of arbitrary type and number of personal protection equipment (PPE) that could be mounted on various body parts.
References
More filters
Proceedings Article
ImageNet Classification with Deep Convolutional Neural Networks
TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Proceedings ArticleDOI
You Only Look Once: Unified, Real-Time Object Detection
TL;DR: Compared to state-of-the-art detection systems, YOLO makes more localization errors but is less likely to predict false positives on background, and outperforms other detection methods, including DPM and R-CNN, when generalizing from natural images to other domains like artwork.
Book ChapterDOI
Visualizing and Understanding Convolutional Networks
Matthew D. Zeiler,Rob Fergus +1 more
TL;DR: A novel visualization technique is introduced that gives insight into the function of intermediate feature layers and the operation of the classifier in large Convolutional Network models, used in a diagnostic role to find model architectures that outperform Krizhevsky et al on the ImageNet classification benchmark.
Posted Content
YOLOv3: An Incremental Improvement.
Joseph Redmon,Ali Farhadi +1 more
TL;DR: The authors present some updates to YOLO!
Book
Computer Vision: Algorithms and Applications
TL;DR: Computer Vision: Algorithms and Applications explores the variety of techniques commonly used to analyze and interpret images and takes a scientific approach to basic vision problems, formulating physical models of the imaging process before inverting them to produce descriptions of a scene.