scispace - formally typeset
Open AccessProceedings Article

Probabilistic latent semantic analysis

Reads0
Chats0
TLDR
This work proposes a widely applicable generalization of maximum likelihood model fitting by tempered EM, based on a mixture decomposition derived from a latent class model which results in a more principled approach which has a solid foundation in statistics.
Abstract
Probabilistic Latent Semantic Analysis is a novel statistical technique for the analysis of two-mode and co-occurrence data, which has applications in information retrieval and filtering, natural language processing, machine learning from text, and in related areas. Compared to standard Latent Semantic Analysis which stems from linear algebra and performs a Singular Value Decomposition of co-occurrence tables, the proposed method is based on a mixture decomposition derived from a latent class model. This results in a more principled approach which has a solid foundation in statistics. In order to avoid overfitting, we propose a widely applicable generalization of maximum likelihood model fitting by tempered EM. Our approach yields substantial and consistent improvements over Latent Semantic Analysis in a number of experiments.

read more

Content maybe subject to copyright    Report

Citations
More filters
Proceedings ArticleDOI

Persian text classification based on topic models

TL;DR: The main goal in this paper is to investigate the possibility of applying the topic models for Persian text classification and compare between the feature processing techniques of BOW and the topic model based approaches.

Image retrieval using visual attention

TL;DR: The use of computational models of visual attention to detect salient by design regions of interest in images is investigated and a content-based method of retrieving images using a computational model ofvisual attention was proposed, implemented, and evaluated.

A PAC-Bayesian Approach to Structure Learning

TL;DR: An important reason to learn structure in data is “to understand the world around us” for example, to understand biological processes or even how the authors' own brain works.
Proceedings Article

Transform-invariant Image Decomposition with Similarity Templates

TL;DR: This work seeks to expand transform-invariant modeling and clustering to sets of images of an object class that show considerable variation across individual instances using a representation based on pixel-wise similarities, similarity templates.
Proceedings ArticleDOI

Context-Specific Recommendation System for Predicting Similar PubMed Articles

TL;DR: This paper proposes a statistically rigorous method, called Context Specific Recommendation System (CSRS), along with associated algorithmic machinery to integrate structural and context-based sources of information to construct a single context-specific interaction network that significantly outperforms other methods based on either the citation networks or content similarity of articles.
References
More filters
Journal ArticleDOI

Indexing by Latent Semantic Analysis

TL;DR: A new method for automatic indexing and retrieval to take advantage of implicit higher-order structure in the association of terms with documents (“semantic structure”) in order to improve the detection of relevant documents on the basis of terms found in queries.
Book

Introduction to Modern Information Retrieval

TL;DR: Reading is a need and a hobby at once and this condition is the on that will make you feel that you must read.
Journal ArticleDOI

A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge.

TL;DR: A new general theory of acquired similarity and knowledge representation, latent semantic analysis (LSA), is presented and used to successfully simulate such learning and several other psycholinguistic phenomena.
Journal ArticleDOI

Probabilistic latent semantic indexing

TL;DR: Probabilistic Latent Semantic Indexing is a novel approach to automated document indexing which is based on a statistical latent class model for factor analysis of count data.
Related Papers (5)