COLLAPSED GIBBS SAMPLER FOR SPARSE TOPIC MODELS AND DISCRETE MATRIX FACTORIZATION
First Claim
1. A storage medium storing instructions executable by a processor to perform a method comprising:
- generating feature representations comprising distributions over a set of features corresponding to objects of a training corpus of objects; and
inferring a topic model defining a set of topics by performing latent Dirichlet allocation (LDA) with an Indian Buffet Process (IBP) compound Dirichlet prior probability distribution, the inferring being performed using a collapsed Gibbs sampling algorithm by iteratively sampling (1) topic allocation variables of the LDA and (2) binary activation variables of the IBP compound Dirichlet prior probability distribution.
7 Assignments
0 Petitions
Accused Products
Abstract
In an inference system for organizing a corpus of objects, feature representations are generated comprising distributions over a set of features corresponding to the objects. A topic model defining a set of topics is inferred by performing latent Dirichlet allocation (LDA) with an Indian Buffet Process (IBP) compound Dirichlet prior probability distribution. The inference is performed using a collapsed Gibbs sampling algorithm by iteratively sampling (1) topic allocation variables of the LDA and (2) binary activation variables of the IBP compound Dirichlet prior In some embodiments the inference is configured such that each inferred topic model is a clean topic model with topics defined as distributions over sub-sets of the set of features selected by the prior. In some embodiments the inference is configured such that the inferred topic model associates a focused sub-set of the set of topics to each object of the training corpus.
-
Citations
22 Claims
-
1. A storage medium storing instructions executable by a processor to perform a method comprising:
-
generating feature representations comprising distributions over a set of features corresponding to objects of a training corpus of objects; and inferring a topic model defining a set of topics by performing latent Dirichlet allocation (LDA) with an Indian Buffet Process (IBP) compound Dirichlet prior probability distribution, the inferring being performed using a collapsed Gibbs sampling algorithm by iteratively sampling (1) topic allocation variables of the LDA and (2) binary activation variables of the IBP compound Dirichlet prior probability distribution. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method comprising:
-
generating feature representations comprising distributions over a set of features corresponding to objects of a training corpus of objects; and inferring a generative topic model defining a set of topics by performing a latent generative topic model allocation using a collapsed Gibbs sampling algorithm with an Indian Buffet Process (IBP) compound prior probability distribution; wherein the inferring includes iterative sampling of (1) topic allocation variables of the generative topic model allocation and (2) binary activation variables of the IBP compound prior probability distribution; and wherein the generating and inferring are performed by a digital processor. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22)
-
Specification