scispace - formally typeset
Proceedings ArticleDOI

Are They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior

Reads0
Chats0
TLDR
A novel dataset is introduced which in addition to providing the bounding box information for pedestrian detection, also includes the behavioral and contextual annotations for the scenes, which allows combining visual and semantic information for better understanding of pedestrians' intentions in various traffic scenarios.
Abstract
Designing autonomous vehicles suitable for urban environments remains an unresolved problem. One of the major dilemmas faced by autonomous cars is how to understand the intention of other road users and communicate with them. The existing datasets do not provide the necessary means for such higher level analysis of traffic scenes. With this in mind, we introduce a novel dataset which in addition to providing the bounding box information for pedestrian detection, also includes the behavioral and contextual annotations for the scenes. This allows combining visual and semantic information for better understanding of pedestrians' intentions in various traffic scenarios. We establish baseline approaches for analyzing the data and show that combining visual and contextual information can improve prediction of pedestrian intention at the point of crossing by at least 20%.

read more

Content maybe subject to copyright    Report

Citations
More filters
Proceedings ArticleDOI

Pedestrian Stop and Go Forecasting with Hybrid Feature Fusion

TL;DR: TransML as discussed by the authors is a pedestrian stop-and-go dataset, which is built from several existing datasets annotated with pedestrians' walking motions, in order to have various scenarios and behaviors.
Patent

Method of pedestrian activity recognition using limited data and meta-learning

TL;DR: In this paper, a Siamese neural network is trained to recognize a plurality of pedestrian activities by training it recordings of the same pedestrian activity from two or more separate training image capture devices.
Journal ArticleDOI

DeepStep: Direct Detection of Walking Pedestrian From Motion by a Vehicle Camera

TL;DR: Zhang et al. as mentioned in this paper proposed a deep learning-based pedestrian detection method that only uses motion cues, where the pedestrian leg movement forms a chain-type trace in the motion profile images even if the ego-vehicle moves.
Journal ArticleDOI

STAF: Spatio-Temporal Attention Framework for Understanding Road Agents Behaviors

TL;DR: This paper proposes a new approach called STAF (Spatio- Temporal Attention Framework) through Long Short Term Memory (LSTM) layers that uses a multi-head attention mechanism on its past cell state to focus on attributes that are relevant over time.
References
More filters
Proceedings Article

ImageNet Classification with Deep Convolutional Neural Networks

TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Proceedings ArticleDOI

ImageNet: A large-scale hierarchical image database

TL;DR: A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Proceedings ArticleDOI

Histograms of oriented gradients for human detection

TL;DR: It is shown experimentally that grids of histograms of oriented gradient (HOG) descriptors significantly outperform existing feature sets for human detection, and the influence of each stage of the computation on performance is studied.
Journal ArticleDOI

Vision meets robotics: The KITTI dataset

TL;DR: A novel dataset captured from a VW station wagon for use in mobile robotics and autonomous driving research, using a variety of sensor modalities such as high-resolution color and grayscale stereo cameras and a high-precision GPS/IMU inertial navigation system.
Book ChapterDOI

Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition

TL;DR: This work equips the networks with another pooling strategy, “spatial pyramid pooling”, to eliminate the above requirement, and develops a new network structure, called SPP-net, which can generate a fixed-length representation regardless of image size/scale.
Related Papers (5)