scispace - formally typeset
Open AccessJournal ArticleDOI

Real-time people tracking for mobile robots using thermal vision

TLDR
The results show that the measurement model that was learned from local grey-scale features could improve on the performance of the elliptic contour model, and that both models could be combined to further improve performance with minimal extra computational cost.
About
This article is published in Robotics and Autonomous Systems.The article was published on 2006-09-30 and is currently open access. It has received 70 citations till now. The article focuses on the topics: Mobile robot & Particle filter.

read more

Citations
More filters
Journal ArticleDOI

Thermal cameras and applications: a survey

TL;DR: An overview of the current applications of thermal cameras is provided, and the nature of thermal radiation and the technology of thermal camera are described.
Journal ArticleDOI

Optical flow or image subtraction in human detection from infrared camera on mobile robot

TL;DR: A new approach to real-time human detection through processing video captured by a thermal infrared camera mounted on the autonomous mobile platform mSecurit^T^M is introduced and optical flow or image difference will emphasize the foreground hot spot areas obtained at the initial human candidates' detection.
Journal ArticleDOI

Pedestrian Tracking Using Online Boosted Random Ferns Learning in Far-Infrared Imagery for Safe Driving at Night

TL;DR: The proposed algorithm yields more accurate tracking performance than other existing methods and is successfully applied to various pedestrian video sequences of the Keimyung University tracking data set (KMUTD).
Journal ArticleDOI

Feature analysis for human recognition and discrimination: Application to a person-following behaviour in a mobile robot

TL;DR: An in-depth study of the possibilities of a colour camera placed on top of a robot to discriminate between humans, and thus get a reliable person-following behaviour on the robot.
Journal ArticleDOI

A Comparative Study of Vision Based Human Detection Techniques in People Counting Applications

TL;DR: The most commonly implemented Frame Differencing, Circular Hough Transform and Histogram of Oriented Gradient based methods are evaluated with respect to different factors like camera orientation, lighting, occlusion etc to demonstrate the need for more accurate and faster people counting algorithms.
References
More filters
Journal ArticleDOI

Robust Real-Time Face Detection

TL;DR: In this paper, a face detection framework that is capable of processing images extremely rapidly while achieving high detection rates is described. But the detection performance is limited to 15 frames per second.
Proceedings ArticleDOI

Robust real-time face detection

TL;DR: A new image representation called the “Integral Image” is introduced which allows the features used by the detector to be computed very quickly and a method for combining classifiers in a “cascade” which allows background regions of the image to be quickly discarded while spending more computation on promising face-like regions.
BookDOI

Sequential Monte Carlo methods in practice

TL;DR: This book presents the first comprehensive treatment of Monte Carlo techniques, including convergence results and applications to tracking, guidance, automated target recognition, aircraft navigation, robot navigation, econometrics, financial modeling, neural networks, optimal control, optimal filtering, communications, reinforcement learning, signal enhancement, model averaging and selection.
Journal ArticleDOI

C ONDENSATION —Conditional Density Propagation forVisual Tracking

TL;DR: The Condensation algorithm uses “factored sampling”, previously applied to the interpretation of static images, in which the probability distribution of possible interpretations is represented by a randomly generated set.
Related Papers (5)
Frequently Asked Questions (15)
Q1. What are the contributions in "Improved data association and occlusion handling for vision-based people tracking by mobile robots" ?

This paper presents an approach for tracking multiple persons using a combination of colour and thermal vision sensors on a mobile robot. 

Such a solution has obvious pitfalls that should be considered in future work such as proper handling of misclassification errors, wrong assignments after occlusions, uniformly dressed people, etc. 

The authors keep particles of the totally occluded tracker for a short time (we use a value of 8 frames here) in situations when quick occlusions occur and the velocity of particles may allow resolution of this occlusion. 

To obtain the ground truth data the authors used a flood-fill segmentation algorithm corrected afterwards by hand using the ViPER-GT tool [3]. 

To avoid multiple detections in the same or similar regions, the weight of detection particles is penalised by a factor ψd < 1 in cases where particles cross already detected areas. 

The authors use two kinds of metrics that indicate the quality of the tracking procedure: detection metrics (counting persons) and localisation metrics (area matching). 

The weight update equation for established tracking filters is changed to wit ∝ p(zt|xt = xit)ψ, where ψ = e(−ρgim) and gim expresses the amount of overlap between particle i and region m, which is multiplied by a factor ρ in the exponent of the penalty term. 

It takes about two times longer to calculate one step of the tracking procedure when using all three moments compared to the tracker based on thermal information only (around 30Hz on a 2.00 GHz processor when using 1000 samples). 

The weight update equation for the ith detection particle is modified to wit ∝ p(zt|xt = xit)ψ, where ψ = ψd if particle i overlaps with other detected regions and ψ = 1 otherwise. 

A fitness value f i for each sample i is then calculated as the sum of all gradients multiplied with individual weights αj for each region: f i = ∑m j=1 αj∆ i j . 

To calculate the importance weight wit of a sample i with state xit the authors divide the ellipses into m = 7 different regions (see Fig. 2) and for each region j the image gradient ∆ij between pixels in the inner and outer parts of the ellipse is calculated. 

By using the affine transformation the authors are able to determine the region corresponding to a person on the colour image (see Fig. 3). 

The order ofthe persons from front-to-back is then determined by a sort procedure requiring MO · log(MO) comparisons where MO specifies the number of overlapping persons. 

A good trade-off between time requirements and performance of the tracker for their setup is a representation using just the first moment of the colour distribution (46% more time compared to the gradient based tracker). 

There are several features that could indicate the order of overlapping persons in the image, from which the authors have chosen a set of three thermal and three colour features.