Method of automated discovery of new topics
First Claim
1. A computer-implemented method comprising:
- identifying, by a computer, in one or more document corpora of a data source, a topic of interest based upon one or more concurring topics identified in the one or more document corpora;
automatically extracting, by the computer, from a document corpus, data associated with a plurality of co-occurring topics based on the topic of interest;
in response to automatically extracting the data associated with the plurality of co-occurring topics, extracting, by the computer, a plurality of topic identifiers from the plurality of co-occurring topics;
generating, by the computer, a periodic topic model comprising a set of one or more term vectors by comparing topic significance among the plurality of topic identifiers;
periodically creating, by the computer, new topic ID models using data content in the periodic topic model by identifying a similarity of topics, wherein the new topic ID models are stored in an in-memory database; and
linking, by the computer, data in the in-memory database for automated discovery of new topics.
2 Assignments
0 Petitions
Accused Products
Abstract
The present disclosure relates to a method for performing automated discovery of new topics from unlimited documents related to any subject domain, employing a multi-component extension of Latent Dirichlet Allocation (MC-LDA) topic models, to discover related topics in a corpus. The resulting data may contain millions of term vectors from any subject domain identifying the most distinguished co-occurring topics that users may be interested in, for periodically building new topic ID models using new content, which may be employed to compare one by one with existing model to measure the significance of changes, using term vectors differences with no correlation with a Periodic New Model, for periodic updates of automated discovery of new topics, which may be used to build a new topic ID model in-memory database to allow query-time linking on massive data-set for automated discovery of new topics.
129 Citations
18 Claims
-
1. A computer-implemented method comprising:
-
identifying, by a computer, in one or more document corpora of a data source, a topic of interest based upon one or more concurring topics identified in the one or more document corpora; automatically extracting, by the computer, from a document corpus, data associated with a plurality of co-occurring topics based on the topic of interest; in response to automatically extracting the data associated with the plurality of co-occurring topics, extracting, by the computer, a plurality of topic identifiers from the plurality of co-occurring topics; generating, by the computer, a periodic topic model comprising a set of one or more term vectors by comparing topic significance among the plurality of topic identifiers; periodically creating, by the computer, new topic ID models using data content in the periodic topic model by identifying a similarity of topics, wherein the new topic ID models are stored in an in-memory database; and linking, by the computer, data in the in-memory database for automated discovery of new topics. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system comprising:
-
a database source computer module configured to extract data associated with a plurality of co-occurring topics in a document corpus; and one or more computers comprising one or more processors configured to; identify, in the document corpus stored in the database source, an indication of a topic of interest; automatically extract from a document corpus, data associated with a plurality of co-occurring topics based on the topic of interest; extract a plurality of topic identifiers from the plurality of co-occurring topics in response to the extracting of the data associated with the plurality of co-occurring topics; create a periodic topic model comprising a set of one or more term vectors by comparing topic significance among the plurality of topic identifiers; periodically create new topic ID models using data content in the periodic topic model by identifying a similarity of topics, wherein the new topic ID models are stored in an in-memory database; and link data in the in-memory database for automated discovery of new topics. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
Specification