REAL TIME SINGLE-SWEEP DETECTION OF KEY WORDS AND CONTENT ANALYSIS

• US 20140095515A1
• Filed: 05/14/2012
• Published: 04/03/2014
• Est. Priority Date: 05/18/2011
• Status: Active Grant

• Current Assignee: Elyasaf Korenwaitz, Moshe Doron
• Original Assignee: Elyasaf Korenwaitz, Moshe Doron
• Inventors: Doron, Moshe, Korenwaitz, Elyasaf
• Granted Patent: US 9,519,704 B2
• Time in Patent Office: Days
• US Class Current: 707/748
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G06F 40/237 Lexical tools

Abstract

A system and method are provided for real-time analysis of text. During a single sweep through the text, a detection tree is used to identify a sequence of characters in the text from a large dictionary of keywords. When a keyword is detected a rule tally database is updated. An intermediate score may be available during the sweep and a final score of the text may be available substantially immediately upon finishing the single sweep. A second text may be analyzed immediately using the same score buffer and rule tally database without updating the rule tally database.

Claims

1. A method for content analysis of a text, the analysis depending on a presence of a plurality of keywords in the text, the method comprising:

A) providing an incidence database including at least a first counter and a second counter, said first counter for indicating an incidence of a first keyword of the plurality of keywords, said second counter for indicating an incidence of a second keyword of the plurality of keywords;

B) supplying a detection tree including a plurality of branches, each branch of said plurality of branches matching a string of characters, and said detection tree also including a plurality of sites on said plurality of branches, each site associated with a keyword of the plurality of keywords;

said plurality of sites including a first site associated with said first keyword and a second site associated with said second keyword;

C) reading at least one character from the text

D) selecting from said plurality of branches, a current branch matching said at least one character;

E) reading at least one more character from the text;

F) selecting a sub-branch of said current branch, said sub-branch of said current branch matching said at least one more character;

G) reaching said first site

H) incrementing said first counter upon said reaching said first site;

I) updating a score upon said incrementing, said updating being dependent on a condition, said condition including a limitation on a value of said first counter and said condition also including a limitation on a value of said second counter.

2. The method of claim 1, wherein said limitation includes a stipulation that said value of said second counter is less than a threshold value.

3. The method of claim 2, wherein said threshold value is one.

4. The method of claim 1, further comprising:

J) analyzing another text subsequent to the analysis of the text without resetting said incidence database.

5. The method of claim 1, wherein said selecting said current branch includes looking up a combination of at least two consecutive characters from the text in a lookup table.

6. The method of claim 1, wherein said reading at least one character starts at a start character and further comprising:

J) designating a new start character in the text;

K) reading at least one new character from the text starting at said new start character, and

L) selecting from said plurality of branches, a new branch matching said at least one new character subsequent to said updating of said score and subsequent to said designating.

7. The method of claim 6, wherein each character of the text is designated as a start character at most once.

8. The method of claim 1, further comprising:

J) supplying a rule tally and wherein a value of said rule tally depends on said value of said first counter and also on said value of said second counter and wherein said condition is expressed as a limitation on said value of said rule tally.

9. The method of claim 8, wherein said rule tally is associated with a tally identifier and further comprising:

K) reinitializing said rule tally upon reaching said first site when said tally identifier is not equal to a current scan identifier value, and

L) setting said rule tally value identifier to said current scan identifier value subsequent to said reinitializing.

10. The method of claim 8, wherein said value of said rule tally further depends on an intermediate rule.

11. The method of claim 1, further comprising:

J) further reading at least one even more character from the text, and

K) selecting, subsequent to said updating of said score, a further sub-branch of said first site, said further sub-branch matching said at least one even more character.

12. The method of claim 1, further comprising:

J) analyzing a second text simultaneously to the analysis of the text.

13. The method of claim 1, wherein said incidence database also includes a first identifier value associated with said first counter;

and further comprising;

J) reinitializing said first counter upon reaching said first site when said first identifier value is not equal to a current scan identifier value, and

K) setting said first identifier value to said current scan identifier value subsequent to said reinitializing.

14. A system for content analysis of a text, the analysis is depending on presence of a plurality of keywords in the text, the system comprising:

A) an incidence database including

a) a first counter configured for indicating an incidence of a first keyword of the plurality of keywords;

b) a second counter configured for indicating an incidence of a second keyword of the plurality of keywords;

B) a detection tree including;

a) a plurality of branches, each branch of said plurality of branches matching a string of characters;

b) a plurality of sites on said plurality of branches, each site of said plurality of sites associated with a keyword of the plurality of keywords;

c) said plurality of sites including a first site associated with said first keyword;

wherein said detection tree is configured for navigating to reach said first site upon reading said first keyword in the text and wherein said first counter is configured for incrementing upon said reaching said first site;

C) a score buffer configured for updating upon said incrementing, said updating being dependent on a condition, said condition including a limitation on a value of said first counter and said condition also including a limitation on a value of said second counter.

15. The system of claim 14, further comprising:

D) a first identifier value configured for indicating when said first counter was incremented during a current scan.

16. The system of claim 14, wherein said score buffer is configured to be updated upon said reaching of said first site only when said value of said second counter is less than a threshold value.

17. The system of claim 16, wherein said threshold value is one.

18. The system of claim 14, further comprising

D) a second score buffer and wherein said detection tree, said score buffer and said second score buffer are configured for simultaneously analyzing at least two texts.

19. The system of claim 14, further including

D) a lookup table configured for looking up at least two letters of the text simultaneously during said navigating.

20. The system of claim 14, further comprising

D) a sub-branch of said first site.

21. The system of claim 14, further comprising:

D) a rule tally and wherein a value of said rule tally depends on said value of said first counter and said value of said second counter and wherein said condition is expressed as a limitation on said value of said rule tally.

22. The system of claim 21, further comprising:

E) a tally identifier configured for indicating when said rule tally was updated during a current scan.

23. The system of claim 21 wherein, said score buffer is configured for updating upon said reaching said second site when said tally attains a threshold value.

24. The system of claim 21, further comprising:

E) an intermediate rule and wherein said rule tally value further depends on said intermediate rule.