Lexicon-based new idea detector

• US 7,024,624 B2
• Filed: 01/07/2002
• Issued: 04/04/2006
• Est. Priority Date: 01/07/2002
• Status: Active Grant

• Current Assignee: Kenneth James Hintz
• Original Assignee: Kenneth James Hintz
• Inventors: Hintz, Kenneth James
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): Vaughn, Gregory J
• Application Number:
  US10/038,464
• Publication Number:
  US 20030131319A1
• Time in Patent Office: 1,548 Days
• Field of Search: 715/500, 715/530, 715/532, 715/538, 704/10, 714/10
• US Class Current: 715/205
• CPC Class Codes: G06F 40/242 Dictionaries
• CPC Class Codes: G06F 40/279 Recognition of textual entities

Abstract

A method and apparatus for detecting the occurrence of new ideas in documents or communications. The method is comprised of three processes. The first process lexiconizes all words or symbols in a set of documents. The second process compares all words in a second set of documents to the words in the lexicon. Words not already in the lexicon are presented to a user who takes one of two courses of action, 1) lexiconizes the word, or, 2) declares it a “fad” indicating that the word is to be further analyzed. The third process measures the spatial and temporal spread of said fad by searching a third set of documents and computing metrics based on additional occurrences of said fad, said metrics being used to determine when a fad has achieved a level of interest denoted as a category. When a category is detected, a user is notified.

Claims

1. A computer-implemented method for detecting new ideas within symbolic representations pertaining to a domain of endeavor, comprising:

accessing the symbolic representations pertaining to the domain of endeavor to detect a symbol contained within the symbolic representations that had been previously identified as not being found within a base lexicon of symbols associated with the domain of endeavor;

retrieving a symbol from the symbolic representations;

searching a base lexicon of symbols associated with the domain of endeavor for an instance of the symbol;

if the instance of the symbol is not found in the base lexicon of symbols associated with the domain of endeavor, then performing the steps of;

presenting the symbol to a user as a new symbol;

receiving input from the user indicative of whether the new symbol should be tracked;

if the input received from the user indicates that the new symbol should not be tracked, then adding the symbol to the base lexicon of symbols associated with the domain of endeavor; and

if the input received from the user indicates that the new symbol should be tracked, then performing the steps of;

accumulating data indicative of a spread of multiple instances of the symbol throughout the domain of endeavor;

determining whether the spread of multiple instances of the symbol throughout the domain of endeavor exceeds a threshold; and

if the spread of multiple instances of the symbol throughout the domain of endeavor exceeds a threshold, then outputting an indication based on the symbol to a user that a new idea within the domain of endeavor has been detected.

2. A method according to claim 1, wherein the symbol includes a word, a neologism, an acronym, an abbreviation, or a string of words with a separator.

3. A method according to claim 1, wherein the symbolic representations pertaining to the domain of endeavor include contents of an internet web site reachable within a specified number of indirections from an Internet Protocol (IP) address, contents of transcripts of verbal communications, or electronic representations of written communications.

4. A method according to claim 1, further comprising:

initializing the base lexicon of symbols associated with the domain of endeavor based on symbols contained within the symbolic representations pertaining to the domain of endeavor.

5. A method according to claim 1, further comprising:

receiving input from a user defining the threshold.

6. A method according to claim 1, wherein said accumulating the data indicative of the spread of multiple instances of the symbol throughout the domain of endeavor includes:

accumulating a date or time of a document containing the symbol, a Uniform Resource Locator (URL) of a document containing the symbol, or a context of the symbol.

7. A method according to claim 6, further comprising:

calculating the spread of multiple instances of the symbol based on respective dates or times of documents containing the symbol, respective Uniform Resource Locators (URLs) of document containing the symbol, or respective contexts of the symbol.

8. A method according to claim 1, further comprising:

receiving input from a user identifying the symbol to be detected.

9. A computer-readable medium bearing instructions for detecting new ideas within symbolic representations pertaining to a domain of endeavor, said instructions, when executed, arrange to cause a computer to perform the steps of:

accessing the symbolic representations pertaining to the domain of endeavor to detect a symbol contained within the symbolic representations that had been previously identified as not being found within a base lexicon of symbols associated with the domain of endeavor;

retrieving a symbol from the symbolic representations;

searching a base lexicon of symbols associated with the domain of endeavor for an instance of the symbol;

if the instance of the symbol is not found in the base lexicon of symbols associated with the domain of endeavor, then performing the steps of;

presenting the symbol to a user as a new symbol;

receiving input from the user indicative of whether the new symbol should be tracked;

if the input received from the user indicates that the new symbol should not be tracked, then adding the symbol to the base lexicon of symbols associated with the domain of endeavor; and

if the input received from the user indicates that the new symbol should be tracked, then performing the steps of;

accumulating data indicative of a spread of multiple instances of the symbol throughout the domain of endeavor;

determining whether the spread of multiple instances of the symbol throughout the domain of endeavor exceeds a threshold; and

if the spread of multiple instances of the symbol throughout the domain of endeavor exceeds a threshold, then outputting an indication based on the symbol to a user that a new idea within the domain of endeavor has been detected.

10. A computer-readable medium according to claim 9, wherein the symbol includes a word, a neologism, an acronym, an abbreviation, or a string of words with a separator.

11. A computer-readable medium according to claim 9, wherein the symbolic representations pertaining to the domain of endeavor include contents of an internet web site reachable within a specified number of indirections from an Internet Protocol (IP) address, contents of transcripts of verbal communications, or electronic representations of written communications.

12. A computer-readable medium according to claim 9, wherein said instructions are further arranged to cause the computer to perform the steps of:

initializing the base lexicon of symbols associated with the domain of endeavor based on symbols contained within the symbolic representations pertaining to the domain of endeavor.

13. A computer-readable medium according to claim 9, wherein said instructions are further arranged to cause the computer to perform the steps of:

receiving input from a user defining the threshold.

14. A computer-readable medium according to claim 9, wherein said accumulating the data indicative of the spread of multiple instances of the symbol throughout the domain of endeavor includes:

accumulating a date or time of a document containing the symbol, a Uniform Resource Locator (URL) of a document containing the symbol, or a context of the symbol.

15. A computer-readable medium according to claim 14, wherein said instructions are further arranged to cause the computer to perform the steps of:

calculating the spread of multiple instances of the symbol based on respective dates or times of documents containing the symbol, respective Uniform Resource Locators (URLs) of document containing the symbol, or respective contexts of the symbol.

16. A computer-readable medium according to claim 9, wherein said instructions are further arranged to cause the computer to perform the steps of:

receiving input from a user identifying the symbol to be detected.

17. A computer-implemented method for detecting new ideas within symbolic representations pertaining to a domain of endeavor, comprising:

accessing the symbolic representations pertaining to the domain of endeavor, wherein the symbolic representations pertaining to the domain of endeavor include contents of an internet web site reachable within a specified number of indirections from an Internet Protocol (IP) address, contents of transcripts of verbal communications, or electronic representations of written communications;

retrieving a symbol from the symbolic representations;

wherein the symbol includes a word, a neologism, an acronym, an abbreviation, or a string of words with a separator;

searching a base lexicon of symbols associated with the domain of endeavor for an instance of the symbol;

if the instance of the symbol is not found in the base lexicon of symbols associated with the domain of endeavor, then performing the steps of;

presenting the symbol to a user as a new symbol;

receiving input from the user indicative of whether the new symbol should be tracked;

if the input received from the user indicates that the new symbol should not be tracked, then adding the symbol to the base lexicon of symbols associated with the domain of endeavor; and

if the input received from the user indicates that the new symbol should be tracked, then performing the steps of;

accumulating data indicative of a spread of multiple instances of the symbol throughout the domain of endeavor;

determining whether the spread of multiple instances of the symbol throughout the domain of endeavor exceeds a threshold; and

if the spread of multiple instances of the symbol throughout the domain of endeavor exceeds a threshold, then outputting an indication based on the symbol to a user that a new idea within the domain of endeavor has been detected.

18. A computer-readable medium bearing instructions for detecting new ideas within symbolic representations pertaining to a domain of endeavor, said instructions, when executed, arranged to cause a computer to perform the steps of the method according to claim 17.