scispace - formally typeset
Open AccessPosted Content

Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks.

TLDR
In this paper, a recurrent sequence-to-sequence model observes motion histories and predicts future behavior, using a novel pooling mechanism to aggregate information across people, and predicts socially plausible future by training adversarially against a recurrent discriminator, and encourage diverse predictions with a novel variety loss.
Abstract
Understanding human motion behavior is critical for autonomous moving platforms (like self-driving cars and social robots) if they are to navigate human-centric environments. This is challenging because human motion is inherently multimodal: given a history of human motion paths, there are many socially plausible ways that people could move in the future. We tackle this problem by combining tools from sequence prediction and generative adversarial networks: a recurrent sequence-to-sequence model observes motion histories and predicts future behavior, using a novel pooling mechanism to aggregate information across people. We predict socially plausible futures by training adversarially against a recurrent discriminator, and encourage diverse predictions with a novel variety loss. Through experiments on several datasets we demonstrate that our approach outperforms prior work in terms of accuracy, variety, collision avoidance, and computational complexity.

read more

Citations
More filters
Posted Content

Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies.

TL;DR: This survey of autonomous driving technologies with deep learning methods investigates the major fields of self-driving systems, such as perception, mapping and localization, prediction, planning and control, simulation, V2X and safety etc.
Posted Content

Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes.

TL;DR: This paper presents a hierarchical generative framework to synthesize long-term 3D human motion conditioning on the 3D scene structure and further enforce multiple geometry constraints between the human mesh and scene point clouds via optimization to improve realistic synthesis.
Posted Content

MultiXNet: Multiclass Multistage Multimodal Motion Prediction

TL;DR: The proposed MultiXNet approach for detection and motion prediction based directly on lidar sensor data builds on prior work by handling multiple classes of traffic actors, adding a jointly trained second-stage trajectory refinement step, and producing a multimodal probability distribution over future actor motion.
Posted Content

Looking to Relations for Future Trajectory Forecast

TL;DR: In this paper, a relation-aware framework for future trajectory forecast is proposed, which aims to infer relational information from the interactions of road users with each other and with the environment.
Posted Content

Finger-GAN: Generating Realistic Fingerprint Images Using Connectivity Imposed GAN.

TL;DR: This work presents a machine learning framework based on generative adversarial networks (GAN), which is able to generate fingerprint images sampled from a prior distribution (learned from a set of training images), and adds a suitable regularization term to the loss function, to impose the connectivity of generated fingerprint images.
References
More filters
Proceedings Article

Adam: A Method for Stochastic Optimization

TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
Journal ArticleDOI

Generative Adversarial Nets

TL;DR: A new framework for estimating generative models via an adversarial process, in which two models are simultaneously train: a generative model G that captures the data distribution and a discriminative model D that estimates the probability that a sample came from the training data rather than G.
Posted Content

Adam: A Method for Stochastic Optimization

TL;DR: In this article, the adaptive estimates of lower-order moments are used for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimate of lowerorder moments.
Proceedings Article

Auto-Encoding Variational Bayes

TL;DR: A stochastic variational inference and learning algorithm that scales to large datasets and, under some mild differentiability conditions, even works in the intractable case is introduced.
Posted Content

Image-to-Image Translation with Conditional Adversarial Networks

TL;DR: Conditional Adversarial Network (CA) as discussed by the authors is a general-purpose solution to image-to-image translation problems, which can be used to synthesize photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Related Papers (5)