METHOD AND SYSTEM FOR CATEGORIZING TOPIC DATA WITH CHANGING SUBTOPICS

• US 20090150436A1
• Filed: 12/10/2007
• Published: 06/11/2009
• Est. Priority Date: 12/10/2007
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Krishnapuram, Raghuram, Roy, Shourya, Godbole, Shantanu
• Application Number:
  US11/953,198
• Publication Number:
  US 20090150436A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification

Abstract

The embodiments of the invention provide a method for the automatic identification of changing subtopics within topics. The method begins by receiving customer satisfaction data having unstructured data objects. Next, the data objects are automatically categorized into pre-defined topics, wherein the pre-defined topics do not change throughout the customer satisfaction analysis. The pre-defined topics can be automatically defined based on a history of customer satisfaction data. Following this, a clustering analysis is automatically performed to identify subtopics of the data objects within the pre-defined topics. The subtopics are more specific than the pre-defined topics, and the subtopics can change. Further, the clustering analysis can include extracting features from the data objects and grouping the features into the subtopics. Each of the subtopics includes features having a predetermined degree of similarity.

Claims

1. A method for categorizing data objects into at least one of relevant categories of topics and sub-topics, said method comprising:

receiving data comprising unstructured data objects;

categorizing said data objects into pre-defined topics;

performing a clustering analysis to identify subtopics of said data objects within said pre-defined topics, wherein said subtopics are more specific than said pre-defined topics;

periodically repeating said clustering analysis to identify at least one of a presence of a new subtopic and an absence of an old subtopic, wherein said new subtopic comprises a group of similar data objects unidentified during a previous clustering analysis and identified during a current clustering analysis, and wherein said old subtopic comprises a group of similar data objects identified during said previous clustering analysis and unidentified during said current clustering analysis;

performing at least one of adding said new subtopic to said subtopics and removing said old subtopic from said subtopics; and

after said adding and said removing, identifying said subtopics and classifying said subtopics into said pre-defined topics.

2. The method according to claim 1, all the limitations of which are incorporated herein by reference, further comprising defining said pre-defined topics based on a history within a history repository of said data.

3. The method according to claim 1, all the limitations of which are incorporated herein by reference, wherein said clustering analysis comprises:

extracting features, wherein said features comprise topics, concepts, and labels from said data objects; and

grouping said features into said subtopics, such that each of said subtopics comprises features comprising a predetermined degree of similarity.

4. The method according to claim 1, all the limitations of which are incorporated herein by reference, wherein at least one of said steps is performed without any human intervention.

5. The method according to claims 1, all the limitations of which are incorporated herein by reference, wherein said clustering analysis and said repeating of said clustering analysis are performed without any human intervention.

6. The method according to claim 1, all the limitations of which are incorporated herein by reference, wherein said pre-defined topics are based on training examples.

7. The method according to claim 1, all the limitations of which are incorporated herein by reference, wherein said subtopics change during said repeating of said clustering analysis.

8. A method for categorizing data objects into at least one of relevant categories of topics and sub-topics, said method comprising:

receiving data comprising unstructured data objects;

categorizing said data objects into pre-defined topics, wherein said pre-defined topics do not change;

performing a clustering analysis to identify subtopics of said data objects within said pre-defined topics, wherein said subtopics are more specific than said pre-defined topics;

periodically repeating said clustering analysis to identify at least one of a presence of a new subtopic and an absence of an old subtopic, wherein said new subtopic comprises a group of similar data objects unidentified during a previous clustering analysis and identified during a current clustering analysis, and wherein said old subtopic comprises a group of similar data objects identified during said previous clustering analysis and unidentified during said current clustering analysis;

performing at least one of adding said new subtopic to said subtopics and removing said old subtopic from said subtopics; and

after said adding and said removing, identifying said subtopics and classifying said subtopics into said pre-defined topics.

9. The method according to claim 8, all the limitations of which are incorporated herein by reference, further comprising defining said pre-defined topics based on a history within a history repository of said data.

10. The method according to claim 8, all the limitations of which are incorporated herein by reference, wherein said clustering analysis comprises:

extracting features, wherein said features comprise topics, concepts, and labels from said data objects; and

grouping said features into said subtopics, such that each of said subtopics comprises features comprising a predetermined degree of similarity.

11. The method according to claim 8, all the limitations of which are incorporated herein by reference, wherein at least one of said steps is performed without any human intervention.

12. The method according to claims 8, all the limitations of which are incorporated herein by reference, wherein said clustering analysis and said repeating of said clustering analysis are performed without any human intervention.

13. The method according to claim 8, all the limitations of which are incorporated herein by reference, wherein said pre-defined topics are based on training examples.

14. The method according to claim 8, all the limitations of which are incorporated herein by reference, wherein said subtopics change during said repeating of said clustering analysis.

15. A program storage device readable by computer, tangibly embodying a program of instructions executable by said computer to perform a method for categorizing data objects into at least one of relevant categories of topics and sub-topics, said method comprising:

receiving data comprising unstructured data objects;

categorizing said data objects into pre-defined topics;

performing a clustering analysis to identify subtopics of said data objects within said pre-defined topics, wherein said subtopics are more specific than said pre-defined topics;

periodically repeating said clustering analysis to identify at least one of a presence of a new subtopic and an absence of an old subtopic, wherein said new subtopic comprises a group of similar data objects unidentified during a previous clustering analysis and identified during a current clustering analysis, and wherein said old subtopic comprises a group of similar data objects identified during said previous clustering analysis and unidentified during said current clustering analysis;

performing at least one of adding said new subtopic to said subtopics and removing said old subtopic from said subtopics; and

after said adding and said removing, identifying said subtopics and classifying said subtopics into said pre-defined topics.

16. The method according to claim 15, all the limitations of which are incorporated herein by reference, further comprising defining said pre-defined topics based on a history within a history repository of said data.

17. The method according to claim 15, all the limitations of which are incorporated herein by reference, wherein said clustering analysis comprises:

extracting features, wherein said features comprise topics, concepts, and labels from said data objects; and

grouping said features into said subtopics, such that each of said subtopics comprises features comprising a predetermined degree of similarity.

18. The method according to claim 15, all the limitations of which are incorporated herein by reference, wherein at least one of said steps is performed without any human intervention.

19. The method according to claims 15, all the limitations of which are incorporated herein by reference, wherein said clustering analysis and said repeating of said clustering analysis are performed without any human intervention.

20. The method according to claim 15, all the limitations of which are incorporated herein by reference, wherein said pre-defined topics are based on training examples.