scispace - formally typeset
Topic

Approximate inference

About: Approximate inference is a(n) research topic. Over the lifetime, 1795 publication(s) have been published within this topic receiving 193709 citation(s).

...read more

Papers
  More

Open accessJournal ArticleDOI: 10.3156/JSOFT.29.5_177_2
Ian Goodfellow1, Jean Pouget-Abadie1, Mehdi Mirza1, Bing Xu1  +4 moreInstitutions (2)
08 Dec 2014-
Abstract: We propose a new framework for estimating generative models via an adversarial process, in which we simultaneously train two models: a generative model G that captures the data distribution, and a discriminative model D that estimates the probability that a sample came from the training data rather than G. The training procedure for G is to maximize the probability of D making a mistake. This framework corresponds to a minimax two-player game. In the space of arbitrary functions G and D, a unique solution exists, with G recovering the training data distribution and D equal to ½ everywhere. In the case where G and D are defined by multilayer perceptrons, the entire system can be trained with backpropagation. There is no need for any Markov chains or unrolled approximate inference networks during either training or generation of samples. Experiments demonstrate the potential of the framework through qualitative and quantitative evaluation of the generated samples.

...read more

Topics: Generative model (64%), Discriminative model (54%), Approximate inference (53%) ...read more

29,410 Citations


Open accessBook
18 Nov 2016-
Abstract: Deep learning is a form of machine learning that enables computers to learn from experience and understand the world in terms of a hierarchy of concepts. Because the computer gathers knowledge from experience, there is no need for a human computer operator to formally specify all the knowledge that the computer needs. The hierarchy of concepts allows the computer to learn complicated concepts by building them out of simpler ones; a graph of these hierarchies would be many layers deep. This book introduces a broad range of topics in deep learning. The text offers mathematical and conceptual background, covering relevant concepts in linear algebra, probability theory and information theory, numerical computation, and machine learning. It describes deep learning techniques used by practitioners in industry, including deep feedforward networks, regularization, optimization algorithms, convolutional networks, sequence modeling, and practical methodology; and it surveys such applications as natural language processing, speech recognition, computer vision, online recommendation systems, bioinformatics, and videogames. Finally, the book offers research perspectives, covering such theoretical topics as linear factor models, autoencoders, representation learning, structured probabilistic models, Monte Carlo methods, the partition function, approximate inference, and deep generative models. Deep Learning can be used by undergraduate or graduate students planning careers in either industry or research, and by software engineers who want to begin using deep learning in their products or platforms. A website offers supplementary material for both readers and instructors.

...read more

Topics: Feature learning (61%), Deep learning (59%), Approximate inference (51%) ...read more

26,972 Citations


Open accessBook
Christopher M. Bishop1Institutions (1)
17 Aug 2006-
Abstract: Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

...read more

Topics: Kernel method (60%), Kernel (statistics) (60%), Graphical model (58%) ...read more

22,762 Citations


Open accessProceedings Article
Diederik P. Kingma1, Max Welling1Institutions (1)
01 Jan 2014-
Abstract: How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational inference and learning algorithm that scales to large datasets and, under some mild differentiability conditions, even works in the intractable case. Our contributions is two-fold. First, we show that a reparameterization of the variational lower bound yields a lower bound estimator that can be straightforwardly optimized using standard stochastic gradient methods. Second, we show that for i.i.d. datasets with continuous latent variables per datapoint, posterior inference can be made especially efficient by fitting an approximate inference model (also called a recognition model) to the intractable posterior using the proposed lower bound estimator. Theoretical advantages are reflected in experimental results.

...read more

Topics: Approximate inference (67%), Inference (55%), Estimator (53%) ...read more

14,546 Citations


Open access
Christopher M. Bishop1Institutions (1)
01 Jan 2006-
Abstract: Probability Distributions.- Linear Models for Regression.- Linear Models for Classification.- Neural Networks.- Kernel Methods.- Sparse Kernel Machines.- Graphical Models.- Mixture Models and EM.- Approximate Inference.- Sampling Methods.- Continuous Latent Variables.- Sequential Data.- Combining Models.

...read more

Topics: Kernel method (60%), Kernel (statistics) (60%), Graphical model (58%) ...read more

10,141 Citations


Performance
Metrics
No. of papers in the topic in previous years
YearPapers
20221
2021115
2020126
2019135
2018115
2017105

Top Attributes

Show by:

Topic's top 5 most impactful authors

Manfred Opper

21 papers, 743 citations

Michael I. Jordan

13 papers, 5.9K citations

Daniel Hernández-Lobato

12 papers, 433 citations

Tom Heskes

11 papers, 492 citations

Richard E. Turner

11 papers, 520 citations

Network Information
Related Topics (5)
Graphical model

10.4K papers, 415.6K citations

91% related
Inference

36.8K papers, 1.3M citations

88% related
Supervised learning

20.8K papers, 710.5K citations

87% related
Reinforcement learning

46K papers, 1M citations

86% related
Generative model

7.8K papers, 366.6K citations

86% related