There is a large variety of trackers, which have been proposed in the literature during the last two decades with some mixed success. Object tracking in realistic scenarios is a difficult problem, therefore, it remains a most active area of research in computer vision. A good tracker should perform well in a large number of videos involving illumination changes, occlusion, clutter, camera motion, low contrast, specularities, and at least six more aspects. However, the performance of proposed trackers have been evaluated typically on less than ten videos, or on the special purpose datasets. In this paper, we aim to evaluate trackers systematically and experimentally on 315 video fragments covering above aspects. We selected a set of nineteen trackers to include a wide variety of algorithms often cited in literature, supplemented with trackers appearing in 2010 and 2011 for which the code was publicly available. We demonstrate that trackers can be evaluated objectively by survival curves, Kaplan Meier statistics, and Grubs testing. We find that in the evaluation practice the F-score is as effective as the object tracking accuracy (OTA) score. The analysis under a large variety of circumstances provides objective insight into the strengths and weaknesses of trackers.

/pdf/visual-tracking-an-experimental-survey-50w2t40998.pdf

Visual Tracking: An Experimental Survey

For the last two decades, intelligent transportation systems (ITS) have emerged as an efficient way of improving the performance of transportation systems, enhancing travel security, and providing more choices to travelers. A significant change in ITS in recent years is that much more data are collected from a variety of sources and can be processed into various forms for different stakeholders. The availability of a large amount of data can potentially lead to a revolution in ITS development, changing an ITS from a conventional technology-driven system into a more powerful multifunctional data-driven intelligent transportation system (D2ITS) : a system that is vision, multisource, and learning algorithm driven to optimize its performance. Furthermore, D2ITS is trending to become a privacy-aware people-centric more intelligent system. In this paper, we provide a survey on the development of D2ITS, discussing the functionality of its key components and some deployment issues associated with D2ITS Future research directions for the development of D2ITS is also presented.

Data-Driven Intelligent Transportation Systems: A Survey

Driver-assistance systems that monitor driver intent, warn drivers of lane departures, or assist in vehicle guidance are all being actively considered. It is therefore important to take a critical look at key aspects of these systems, one of which is lane-position tracking. It is for these driver-assistance objectives that motivate the development of the novel "video-based lane estimation and tracking" (VioLET) system. The system is designed using steerable filters for robust and accurate lane-marking detection. Steerable filters provide an efficient method for detecting circular-reflector markings, solid-line markings, and segmented-line markings under varying lighting and road conditions. They help in providing robustness to complex shadowing, lighting changes from overpasses and tunnels, and road-surface variations. They are efficient for lane-marking extraction because by computing only three separable convolutions, we can extract a wide variety of lane markings. Curvature detection is made more robust by incorporating both visual cues (lane markings and lane texture) and vehicle-state information. The experiment design and evaluation of the VioLET system is shown using multiple quantitative metrics over a wide variety of test conditions on a large test path using a unique instrumented vehicle. A justification for the choice of metrics based on a previous study with human-factors applications as well as extensive ground-truth testing from different times of day, road conditions, weather, and driving scenarios is also presented. In order to design the VioLET system, an up-to-date and comprehensive analysis of the current state of the art in lane-detection research was first performed. In doing so, a comparison of a wide variety of methods, pointing out the similarities and differences between methods as well as when and where various methods are most useful, is presented

/pdf/video-based-lane-estimation-and-tracking-for-driver-57a6ptp34w.pdf

Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation

Automated driving systems (ADSs) promise a safe, comfortable and efficient driving experience. However, fatalities involving vehicles equipped with ADSs are on the rise. The full potential of ADSs cannot be realized unless the robustness of state-of-the-art is improved further. This paper discusses unsolved problems and surveys the technical aspect of automated driving. Studies regarding present challenges, high-level system architectures, emerging methodologies and core functions including localization, mapping, perception, planning, and human machine interfaces, were thoroughly reviewed. Furthermore, many state-of-the-art algorithms were implemented and compared on our own platform in a real-world driving setting. The paper concludes with an overview of available datasets and tools for ADS development.

A Survey of Autonomous Driving: Common Practices and Emerging Technologies

The problem of road or lane perception is a crucial enabler for advanced driver assistance systems. As such, it has been an active field of research for the past two decades with considerable progress made in the past few years. The problem was confronted under various scenarios, with different task definitions, leading to usage of diverse sensing modalities and approaches. In this paper we survey the approaches and the algorithmic techniques devised for the various modalities over the last 5 years. We present a generic break down of the problem into its functional building blocks and elaborate the wide range of proposed methods within this scheme. For each functional block, we describe the possible implementations suggested and analyze their underlying assumptions. While impressive advancements were demonstrated at limited scenarios, inspection into the needs of next generation systems reveals significant gaps. We identify these gaps and suggest research directions that may bridge them.

Recent progress in road and lane detection: a survey

This paper presents investigations into the role of computer-vision technology in developing safer automobiles. We consider vision systems, which cannot only look out of the vehicle to detect and track roads and avoid hitting obstacles or pedestrians but simultaneously look inside the vehicle to monitor the attentiveness of the driver and even predict her intentions. In this paper, a systems-oriented framework for developing computer-vision technology for safer automobiles is presented. We will consider three main components of the system: environment, vehicle, and driver. We will discuss various issues and ideas for developing models for these main components as well as activities associated with the complex task of safe driving. This paper includes a discussion of novel sensory systems and algorithms for capturing not only the dynamic surround information of the vehicle but also the state, intent, and activity patterns of drivers

http://cvrr.ucsd.edu/publications/2007/MTrivedi_ITS07_LILO.pdf

Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety

This paper deals with the development of Human-Centric Intelligent Driver Assistance Systems. Rear-end collisions account for a large portion of traffic accidents. To help mitigate this problem, predictive braking systems and adaptive cruise control systems have been developed. However, these types of systems usually rely solely on the vehicle and vehicle surround sensors, either ignoring the human component of driving or learning the driver's control behavior using only these sensors. As with all human-computer interfaces, this has the potential to work against the driver, distract the driver further, or even annoy the driver so that the driver ignores or disables the system. It is, therefore, important to directly take the driver's intended actions into account when designing a driver assistance system. By using a probabilistic model for the system, warnings and preventative measures can be constructed based on varying levels of situational severity and driver attentiveness and intent. The research is based upon carefully conducted experimental trials involving a human subjects driving in natural manner and on typical freeways in the USA. The experiments, designed by inputs from cognitive scientist, were conducted in a specially designed instrumented vehicle to record important cues associated with driver's behavior, vehicle state, and vehicle surround in a synchronized manner. Quantitative results and analysis of the experimental trials are presented to show the feasibility and promise of this framework to predict the driver's intent to brake, the need for braking given the current situation, and at what level the driver should be warned

Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles

In this paper we demonstrate a driver intent inference system (DIIS) based on lane positional information, vehicle parameters, and driver head motion We present robust computer vision methods for identifying and tracking freeway lanes and driver head motion These algorithms are then applied and evaluated on real-world data collected in a modular intelligent vehicle test-bed Analysis of the data for lane change intent is performed using a sparse Bayesian learning methodology Finally, the system as a whole is evaluated using a novel metric and real-world data of vehicle parameters, lane position, and driver head motion

http://cvrr.ucsd.edu/publications/pdfs/McCall_Wipf_Trivedi_Rao_MVIV2005.pdf

Lane Change Intent Analysis Using Robust Operators and Sparse Bayesian Learning

Lane Detection is a difficult problem because of the varying road conditions that one can encounter while driving. We propose a method for lane detection using steerable filters. Steerable filters provide robustness to lighting changes and shadows and perform well in picking out both circular reflector road markings as well as painted line road markings. The filter results are then processed to eliminate outliers based on the expected road geometry and used to update a road and vehicular model along with data taken internally from the vehicles. Results are shown for a 9000-frame image sequence that include varying lane markings, lighting conditions, showing, and occlusion by other vehicles.

http://cvrr.ucsd.edu/publications/2004/IV2004-171.pdf

J.C. McCall

Papers

Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation

Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety

Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles

Lane Change Intent Analysis Using Robust Operators and Sparse Bayesian Learning

An integrated, robust approach to lane marking detection and lane tracking