scispace - formally typeset
Open AccessJournal ArticleDOI

Memory Augmented Deep Generative Models for Forecasting the Next Shot Location in Tennis

TLDR
In this article, a semi-supervised generative adversarial network (GAN) was proposed to predict shot location and type in tennis players based on their episodic and semantic memory components.
Abstract
This paper presents a novel framework for predicting shot location and type in tennis. Inspired by recent neuroscience discoveries, we incorporate neural memory modules to model the episodic and semantic memory components of a tennis player. We propose a Semi-Supervised Generative Adversarial Network architecture that couples these memory models with the automatic feature learning power of deep neural networks, and demonstrate methodologies for learning player level behavioral patterns with the proposed framework. We evaluate the effectiveness of the proposed model on tennis tracking data from the 2012 Australian Tennis Open and exhibit applications of the proposed method in discovering how players adapt their style depending on the match context.

read more

Citations
More filters
Posted Content

Vid2Player: Controllable Video Sprites that Behave and Appear like Professional Tennis Players

TL;DR: A system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players is presented, enabling new experiences, such as the creation of matchups between players that have not competed in real life or interactive control of players in the Wimbledon final.
Proceedings ArticleDOI

Neighbourhood Context Embeddings in Deep Inverse Reinforcement Learning for Predicting Pedestrian Motion Over Long Time Horizons

TL;DR: A novel recurrent neural network based method for embedding pedestrian dynamics in a D-IRL setting, where there are multiple moving agents through Long-Short-Term Memory networks, and exhibits robustness towards lengthier predictions into the distant future.
Journal ArticleDOI

A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directions

TL;DR: This work reviews a detailed discussion on some of the artificial intelligence (AI) applications in sports vision, GPU-based work stations, and embedded platforms, and identifies the research directions, probable challenges, and future trends in the area of visual recognition in sports.
Journal ArticleDOI

Vid2Player: Controllable Video Sprites That Behave and Appear Like Professional Tennis Players

TL;DR: In this article, Hou et al. present a system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players.
Journal ArticleDOI

Memory based fusion for multi-modal deep learning

TL;DR: In this paper, the authors propose a memory-based attentive fusion layer, which fuses modes by incorporating both the current features and long-term dependencies in the data, thus allowing the model to understand the relative importance of modes over time.
References
More filters
Proceedings Article

Adam: A Method for Stochastic Optimization

TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
Journal ArticleDOI

Long short-term memory

TL;DR: A novel, efficient, gradient based method called long short-term memory (LSTM) is introduced, which can learn to bridge minimal time lags in excess of 1000 discrete-time steps by enforcing constant error flow through constant error carousels within special units.
Journal ArticleDOI

Generative Adversarial Nets

TL;DR: A new framework for estimating generative models via an adversarial process, in which two models are simultaneously train: a generative model G that captures the data distribution and a discriminative model D that estimates the probability that a sample came from the training data rather than G.
Proceedings ArticleDOI

Image-to-Image Translation with Conditional Adversarial Networks

TL;DR: Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Posted Content

Image-to-Image Translation with Conditional Adversarial Networks

TL;DR: Conditional Adversarial Network (CA) as discussed by the authors is a general-purpose solution to image-to-image translation problems, which can be used to synthesize photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Related Papers (5)