Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector

Deep learning in video multi-object tracking: A survey

The key to solving fine-grained image categorization is finding discriminate and local regions that correspond to subtle visual traits. Great strides have been made, with complex networks designed specifically to learn part-level discriminate feature representations. In this paper, we show that it is possible to cultivate subtle details without the need for overly complicated network designs or training mechanisms – a single loss is all it takes. The main trick lies with how we delve into individual feature channels early on, as opposed to the convention of starting from a consolidated feature map. The proposed loss function, termed as mutual-channel loss (MC-Loss), consists of two channel-specific components: a discriminality component and a diversity component. The discriminality component forces all feature channels belonging to the same class to be discriminative, through a novel channel-wise attention mechanism. The diversity component additionally constraints channels so that they become mutually exclusive across the spatial dimension. The end result is therefore a set of feature channels, each of which reflects different locally discriminative regions for a specific class. The MC-Loss can be trained end-to-end, without the need for any bounding-box/part annotations, and yields highly discriminative regions during inference. Experimental results show our MC-Loss when implemented on top of common base networks can achieve state-of-the-art performance on all four fine-grained categorization datasets (CUB-Birds, FGVC-Aircraft, Flowers-102, and Stanford Cars). Ablative studies further demonstrate the superiority of the MC-Loss when compared with other recently proposed general-purpose losses for visual classification, on two different base networks. Codes are available at: https://github.com/dongliangchang/Mutual-Channel-Loss .

The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification

Falling is among the most damaging event elderly people may experience. With the ever-growing aging population, there is an urgent need for the development of fall detection systems. Thanks to the rapid development of sensor networks and the Internet of Things (IoT), human-computer interaction using sensor fusion has been regarded as an effective method to address the problem of fall detection. In this paper, we provide a literature survey of work conducted on elderly fall detection using sensor networks and IoT. Although there are various existing studies which focus on the fall detection with individual sensors, such as wearable ones and depth cameras, the performance of these systems are still not satisfying as they suffer mostly from high false alarms. Literature shows that fusing the signals of different sensors could result in higher accuracy and lower false alarms, while improving the robustness of such systems. We approach this survey from different perspectives, including data collection, data transmission, sensor fusion, data analysis, security, and privacy. We also review the benchmark data sets available that have been used to quantify the performance of the proposed methods. The survey is meant to provide researchers in the field of elderly fall detection using sensor networks with a summary of progress achieved up to date and to identify areas where further effort would be beneficial.

/pdf/elderly-fall-detection-systems-a-literature-survey-9nx87469di.pdf

Elderly Fall Detection Systems: A Literature Survey

The "You only look once v4"(YOLOv4) is one type of object detection methods in deep learning. YOLOv4-tiny is proposed based on YOLOv4 to simple the network structure and reduce parameters, which makes it be suitable for developing on the mobile and embedded devices. To improve the real-time of object detection, a fast object detection method is proposed based on YOLOv4-tiny. It firstly uses two ResBlock-D modules in ResNet-D network instead of two CSPBlock modules in Yolov4-tiny, which reduces the computation complexity. Secondly, it designs an auxiliary residual network block to extract more feature information of object to reduce detection error. In the design of auxiliary network, two consecutive 3x3 convolutions are used to obtain 5x5 receptive fields to extract global features, and channel attention and spatial attention are also used to extract more effective information. In the end, it merges the auxiliary network and backbone network to construct the whole network structure of improved YOLOv4-tiny. Simulation results show that the proposed method has faster object detection than YOLOv4-tiny and YOLOv3-tiny, and almost the same mean value of average precision as the YOLOv4-tiny. It is more suitable for real-time object detection.

Real-time object detection method based on improved YOLOv4-tiny.

It plays an important role to accurately track multiple vehicles in intelligent transportation, especially in intelligent vehicles. Due to complicated traffic environments it is difficult to track multiple vehicles accurately and robustly, especially when there are occlusions among vehicles. To alleviate these problems, a new approach is proposed to track multiple vehicles with the combination of robust detection and two classifiers. An improved ViBe algorithm is proposed for robust and accurate detection of multiple vehicles. It uses the gray-scale spatial information to build dictionary of pixel life length to make ghost shadows and object’s residual shadows quickly blended into the samples of the background. The improved algorithm takes good post-processing method to restrain dynamic noise. In this paper, we also design a method using two classifiers to further attack the problem of failure to track vehicles with occlusions and interference. It classifies tracking rectangles with confidence values between two thresholds through combining local binary pattern with support vector machine (SVM) classifier and then using a convolutional neural network (CNN) classifier for the second time to remove the interference areas between vehicles and other moving objects. The two classifiers method has both time efficiency advantage of SVM and high accuracy advantage of CNN. Comparing with several existing methods, the qualitative and quantitative analysis of our experiment results showed that the proposed method not only effectively removed the ghost shadows, and improved the detection accuracy and real-time performance, but also was robust to deal with the occlusion of multiple vehicles in various traffic scenes.

A New Approach to Track Multiple Vehicles With the Combination of Robust Detection and Two Classifiers

Extracting vehicle information is of great significance to the construction of the Internet of Vehicles (IoV). Vehicle logo detection (VLD) technology can effectively extract vehicle information. Due to the complex traffic environment, existing methods have difficulty to accurately detect the vehicle logo, especially when the vehicle logo has motion blur. To alleviate these problems, a new approach is proposed to detect vehicle logo under motion blur with the combination of Filter-DeblurGAN and VL-YOLO. Filter-DeblurGAN possesses a judgment mechanism, which can determine whether the image needs to be deblurred based on the degree of blur of each image. It can also deblur images with arbitrary resolution. Filter-DeblurGAN solves the defect that DeblurGAN lacks the judgment mechanism and is too harsh on resolution. It can be directly applied to the deblurring process of VLD. We also propose a method using VL-YOLO and Eliminate Outliers Cluster (EOC) algorithm to further improve the detection accuracy. VL-YOLO achieves accurate detection of the vehicle logo by constructing a deeper multi-scale detection network and using the initial candidate boxes provided by EOC algorithm. The EOC algorithm is not affected by outliers. In order to further promote the research of VLD, we have labeled a new vehicle logo dataset named LOGO-17, which contains 17 different categories of vehicle logos. The experimental results demonstrate that the proposed method achieves good detection accuracy in the environment of motion blur, and outperforms existing methods.

Detecting Motion Blurred Vehicle Logo in IoV Using Filter-DeblurGAN and VL-YOLO

The existing deep learning methods for human fall detection have difficulties to distinguish falls from similar daily activities such as lying down because of not using the 3D network. Meanwhile, they are not suitable for mobile devices because they are heavyweight methods and consume a large number of memories. In order to alleviate these problems, a two-stream approach to fall detection with the MobileVGG is proposed in this paper. One stream is based on the motion characteristics of the human body for detection of falls, while the other is an improved lightweight VGG network, named the MobileVGG, put forward in the paper. The MobileVGG is constructed as a lightweight network model through replacing the traditional convolution with a simplified and efficient combination of point convolution, depth convolution and point convolution. The residual connection between layers is designed to overcome the gradient disappeared and the obstruction of gradient reflux in the deep model. The experimental results show that the proposed two-stream lightweight fall classification model outperforms the existing methods in distinguishing falls from similar daily activities such as lying and reducing the occupied memory. Therefore, it is suitable for mobile devices.

/pdf/a-two-stream-approach-to-fall-detection-with-mobilevgg-23olyt73cu.pdf

A Two-Stream Approach to Fall Detection With MobileVGG

Behavior analysis through posture recognition is an essential research in robotic systems. Sitting with unhealthy sitting posture for a long time seriously harms human health and may even lead to lumbar disease, cervical disease and myopia. Automatic vision-based detection of unhealthy sitting posture, as an example of posture detection in robotic systems, has become a hot research topic. However, the existing methods only focus on extracting features of human themselves and lack understanding relevancies among objects in the scene, and henceforth fail to recognize some types of unhealthy sitting postures in complicated environments. To alleviate these problems, a scene recognition and semantic analysis approach to unhealthy sitting posture detection in screen-reading is proposed in this paper. The key skeletal points of human body are detected and tracked with a Microsoft Kinect sensor. Meanwhile, a deep learning method, Faster R-CNN, is used in the scene recognition of our method to accurately detect objects and extract relevant features. Then our method performs semantic analysis through Gaussian-Mixture behavioral clustering for scene understanding. The relevant features in the scene and the skeletal features extracted from human are fused into the semantic features to discriminate various types of sitting postures. Experimental results demonstrated that our method accurately and effectively detected various types of unhealthy sitting postures in screen-reading and avoided error detection in complicated environments. Compared with the existing methods, our proposed method detected more types of unhealthy sitting postures including those that the existing methods could not detect. Our method can be potentially applied and integrated as a medical assistance in robotic systems of health care and treatment.

https://www.mdpi.com/1424-8220/18/9/3119/pdf

Qing Han

Papers

A New Approach to Track Multiple Vehicles With the Combination of Robust Detection and Two Classifiers

Detecting Motion Blurred Vehicle Logo in IoV Using Filter-DeblurGAN and VL-YOLO

A Two-Stream Approach to Fall Detection With MobileVGG

A Scene Recognition and Semantic Analysis Approach to Unhealthy Sitting Posture Detection during Screen-Reading

Viewpoint Adaptation Learning with Cross-view Distance Metric for Robust Vehicle Re-Identification