Memory Augmented Deep Generative Models for Forecasting the Next Shot Location in Tennis
TLDR
In this article, a semi-supervised generative adversarial network (GAN) was proposed to predict shot location and type in tennis players based on their episodic and semantic memory components.Abstract:
This paper presents a novel framework for predicting shot location and type in tennis. Inspired by recent neuroscience discoveries, we incorporate neural memory modules to model the episodic and semantic memory components of a tennis player. We propose a Semi-Supervised Generative Adversarial Network architecture that couples these memory models with the automatic feature learning power of deep neural networks, and demonstrate methodologies for learning player level behavioral patterns with the proposed framework. We evaluate the effectiveness of the proposed model on tennis tracking data from the 2012 Australian Tennis Open and exhibit applications of the proposed method in discovering how players adapt their style depending on the match context.read more
Citations
More filters
Posted Content
Vid2Player: Controllable Video Sprites that Behave and Appear like Professional Tennis Players
TL;DR: A system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players is presented, enabling new experiences, such as the creation of matchups between players that have not competed in real life or interactive control of players in the Wimbledon final.
Proceedings ArticleDOI
Neighbourhood Context Embeddings in Deep Inverse Reinforcement Learning for Predicting Pedestrian Motion Over Long Time Horizons
TL;DR: A novel recurrent neural network based method for embedding pedestrian dynamics in a D-IRL setting, where there are multiple moving agents through Long-Short-Term Memory networks, and exhibits robustness towards lengthier predictions into the distant future.
Journal ArticleDOI
A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directions
TL;DR: This work reviews a detailed discussion on some of the artificial intelligence (AI) applications in sports vision, GPU-based work stations, and embedded platforms, and identifies the research directions, probable challenges, and future trends in the area of visual recognition in sports.
Journal ArticleDOI
Vid2Player: Controllable Video Sprites That Behave and Appear Like Professional Tennis Players
TL;DR: In this article, Hou et al. present a system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players.
Journal ArticleDOI
Memory based fusion for multi-modal deep learning
TL;DR: In this paper, the authors propose a memory-based attentive fusion layer, which fuses modes by incorporating both the current features and long-term dependencies in the data, thus allowing the model to understand the relative importance of modes over time.
References
More filters
Proceedings Article
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
Journal ArticleDOI
Long short-term memory
TL;DR: A novel, efficient, gradient based method called long short-term memory (LSTM) is introduced, which can learn to bridge minimal time lags in excess of 1000 discrete-time steps by enforcing constant error flow through constant error carousels within special units.
Journal ArticleDOI
Generative Adversarial Nets
Ian Goodfellow,Jean Pouget-Abadie,Mehdi Mirza,Bing Xu,David Warde-Farley,Sherjil Ozair,Aaron Courville,Yoshua Bengio +7 more
TL;DR: A new framework for estimating generative models via an adversarial process, in which two models are simultaneously train: a generative model G that captures the data distribution and a discriminative model D that estimates the probability that a sample came from the training data rather than G.
Proceedings ArticleDOI
Image-to-Image Translation with Conditional Adversarial Networks
TL;DR: Conditional adversarial networks are investigated as a general-purpose solution to image-to-image translation problems and it is demonstrated that this approach is effective at synthesizing photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Posted Content
Image-to-Image Translation with Conditional Adversarial Networks
TL;DR: Conditional Adversarial Network (CA) as discussed by the authors is a general-purpose solution to image-to-image translation problems, which can be used to synthesize photos from label maps, reconstructing objects from edge maps, and colorizing images, among other tasks.
Related Papers (5)
Generative Adversarial Networks for Generation and Classification of Physical Rehabilitation Movement Episodes.
Longze Li,Aleksandar Vakanski +1 more