Image fire detection algorithms based on convolutional neural networks

Smoke detection plays an important role in industrial safety warning systems and fire prevention. Due to the complicated changes in the shape, texture, and color of smoke, identifying the smoke from a given image still remains a substantial challenge, and this has accordingly aroused a considerable amount of research attention recently. To address the problem, we devise a new deep dual-channel neural network (DCNN) for smoke detection. In contrast to popular deep convolutional networks (e.g., Alex-Net, VGG-Net, Res-Net, and Dense-Net and the DNCNN that is specifically devoted to detecting smoke), our proposed end-to-end network is mainly composed of dual channels of deep subnetworks. In the first subnetwork, we sequentially connect multiple convolutional layers and max-pooling layers. Then, we selectively append the batch normalization layer to each convolutional layer for overfitting reduction and training acceleration. The first subnetwork is shown to be good at extracting the detailed information of smoke, such as texture. In the second subnetwork, in addition to the convolutional, batch normalization, and max-pooling layers, we further introduce two important components. One is the skip connection for avoiding the vanishing gradient and improving the feature propagation. The other is the global average pooling for reducing the number of parameters and mitigating the overfitting issue. The second subnetwork can capture the base information of smoke, such as contours. We finally deploy a concatenation operation to combine the aforementioned two deep subnetworks to complement each other. Based on the augmented data obtained by rotating the training images, our proposed DCNN can promptly and stably converge to the perfect performance. Experimental results conducted on the publicly available smoke detection database verify that the proposed DCNN has attained a very high detection rate that exceeds 99.5% on average, superior to state-of-the-art relevant competitors. Furthermore, our DCNN only employs approximately one-third of the parameters needed by the comparatively tested deep neural networks. The source code of DCNN will be released at https://kegu.netlify.com/ .

Deep Dual-Channel Neural Network for Image-Based Smoke Detection

This review is focused on video flame and smoke based fire detection algorithms for both indoor and outdoor environments. It analyzes and discusses them in a taxonomical manner for the last two decades. These are mainly based on handcraft features with or without classifiers and deep learning approaches. The separate treatment is provided for detecting flames and smoke. Their static and dynamic characteristics are elaborated for the handcraft feature approach. The blending of the obtained features from these characteristics is the focus of most of the research and these concepts are analyzed critically. A fusion of both visible and thermal images leading to multi-fusion and multimodal approaches have conversed. It is a step towards obtaining accurate detection results and how the handcraft feature approach tackles the problems of flame and smoke detection, as well as their weaknesses are discussed which are still not solved. Some of these weaknesses can be tackled by developing a technology based on artificial intelligence named deep-learning. Its taxonomical literature study with a focus on the flame and smoke detection is presented. The strengths and weaknesses of this approach are discussed with possible solutions. The latest trend in literature which focuses on the hybrid approach utilizing both handcraft feature, and deep learning approaches is discussed. This approach aims to minimize the weaknesses still present in the current systems.

Video Flame and Smoke Based Fire Detection Algorithms: A Literature Review

Smoke detection in foggy surveillance environments is a challenging task and plays a key role in disaster management for industrial systems. The current smoke detection methods are applicable to only normal surveillance videos, providing unsatisfactory results for video streams captured from foggy environments, due to challenges related to clutter and unclear contents. In this paper, an energy-friendly edge intelligence-assisted smoke detection method is proposed using deep convolutional neural networks for foggy surveillance environments. Our method uses a light-weight architecture, considering all necessary requirements regarding accuracy, running time, and deployment feasibility for smoke detection in an industrial setting, compared to other complex and computationally expensive architectures including AlexNet, GoogleNet, and visual geometry group (VGG). Experiments are conducted on available benchmark smoke detection datasets, and the obtained results show better performance of the proposed method over state-of-the-art for early smoke detection in foggy surveillance.

Edge Intelligence-Assisted Smoke Detection in Foggy Surveillance Environments

With the installation of enormous public safety and transportation infrastructure cameras, video analytics has come to play an essential part in public safety. Typically, video analytics is to collectively leverage the advanced computer vision (CV) and artificial intelligence (AI) to solve the four-W problem. That is to identify Who has done something (What) at a specific place (Where) at some time (When). According to the difference of latency requirements, video analytics can be applied to postevent retrospective analysis, such as archive management, search, forensic investigation and real-time live video stream analysis, such as situation awareness, alerting, and interested object (criminal suspect/missing vehicle) detection. The latter is characterized as having higher requirements on hardware resources as the sophisticated image processing algorithms under the hood. However, analyzing large-scale live video streams on the Cloud is impractical as the edge solution that conducts the video analytics on (or close to) the camera provides a silvering light. Analyzing live video streams on the edge is not trivial due to the constrained hardware resources on edge. The AI-dominated video analytics requires higher bandwidth, consumes considerable CPU/GPU resources for processing, and demands larger memory for caching. In this paper, we review the applications, algorithms, and solutions that have been proposed recently to facilitate edge video analytics for public safety.

https://ieeexplore.ieee.org/ielaam/5/8789751/8781894-aam.pdf

Edge Video Analytics for Public Safety: A Review

It is a challenging task to recognize smoke from images due to large variance of smoke color, texture, and shapes. There are smoke detection methods that have been proposed, but most of them are based on hand-crafted features. To improve the performance of smoke detection, we propose a novel deep normalization and convolutional neural network (DNCNN) with 14 layers to implement automatic feature extraction and classification. In DNCNN, traditional convolutional layers are replaced with normalization and convolutional layers to accelerate the training process and boost the performance of smoke detection. To reduce overfitting caused by imbalanced and insufficient training samples, we generate more training samples from original training data sets by using a variety of data enhancement techniques. Experimental results show that our method achieved very low false alarm rates below 0.60% with detection rates above 96.37% on our smoke data sets.

A Deep Normalization and Convolutional Neural Network for Image Smoke Detection

In the field of small object detection, Yolov4-Tiny is inadequate in feature extraction and does not make best of multi-scale features. In this paper, an improved BiFPN framework is proposed based on Yolov4-Tiny to increase object detection precision. Moreover, the Yolov4-Tiny is taken as the backbone network and introduce spatial pyramid pooling (SPP) to connect and merge multi-scale regions. Finally, our method can achieve 79.53% map on Pascal VOC dataset, which is 2.12% higher than the original Yolov4-Tiny model.

https://doi.org/10.1088/1742-6596/2209/1/012023

Object detection based on Yolov4-Tiny and Improved Bidirectional feature pyramid network

Abstract Cancer is one of the serious diseases, recent studies reported that tumor homing peptides (THPs) play a key role in treatment of cancer. Due to the experimental methods are time-consuming and expensive, it is urgent to develop automatic computational approaches to identify THPs. Hence, in this study, we proposed a novel machine learning methods to distinguish THPs from non-THPs, in which the peptide sequences firstly encoded by pseudo residue pairwise energy content matrix (PseRECM) and pseudo physicochemical property (PsePC). Moreover, the least absolute shrinkage and selection operator (LAASO) was employed to select optimal features from the extracted features. All of these selected features were fed into support vector machine (SVM) for identifying THPs. We achieved 89.02%, 88.49%, and 94.58% classification accuracy on the Main, Small, and Main90 dataset, respectively. Experimental results showed that our proposed method outperforms the existing predictors on the same benchmark datasets. It indicates that the proposed method may be a useful tool in identifying THPs. The datasets and codes used in current study are available at https://figshare.com/articles/online_resource/iTHPs/16778770. Communicated by Ramaswamy H. Sarma

Identification of tumor homing peptides by utilizing hybrid feature representation

In the past ten years, deep learning has achieved remarkable results in the area of natural image segmentation, and has gradually turned to the field of medical image segmentation. The precise segmentation of spine images can be used for early screening of spondylopathy, which is convenient for early detection and treatment of patients. Aiming at the segmentation of the spine image by the U-Net network, which structure will lead to large model calculation, network overfitting, image size, noise information and other issues. This paper introduces a new method based on spatial pyramid pooling module ASpp on U-Net network and applies the proposed network structure to the segmentation of the spine image. The model is first enhanced by the Spp module and Densenet data; secondly, the U-Net encoding and decoding structure is adopted, and the deep separable convolution is used. This method greatly reduces the complexity and computation of the model, and uses a rectangular convolution kernel to increase the computation of the model in a small amount. Based on the volume, the receptive field of the convolution operation is expanded; finally, in order to effectively enhance the segmentation area of the image, the SE-Net attention mechanism module is added to the lateral connection. The method proposed in this paper conducts ablation experiments on a public dataset of spine images and compares it with the U-Net network. The method proposed IOU in this paper can reach 72%, and the F1-score can reach 0.92. The comparison of the experimental results of spine medical image datasets shows that the method proposed in this paper can effectively improve the accuracy and accuracy of spine image segmentation.

https://doi.org/10.1088/1742-6596/2209/1/012020

Zhijian Yin

Papers

A Deep Normalization and Convolutional Neural Network for Image Smoke Detection

Object detection based on Yolov4-Tiny and Improved Bidirectional feature pyramid network

Identification of tumor homing peptides by utilizing hybrid feature representation

Spine Image Segmentation Based on U-Net and Atrous spatial pyramid pooling

Integrating multiple sequence features for identifying anticancer peptides