Text segmentation

• US 8,849,852 B2
• Filed: 12/12/2011
• Issued: 09/30/2014
• Est. Priority Date: 09/30/2004
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Elbaz, Gilad Israel, Mandelson, Jacob L.
• Primary Examiner(s): LE, HUNG D
• Application Number:
  US13/323,664
• Publication Number:
  US 20120089398A1
• Time in Patent Office: 1,023 Days
• Field of Search: None
• US Class Current: 707/771
• CPC Class Codes: G06F 40/284 Lexical analysis, e.g. tokenisation or collocates

Abstract

Methods and systems for improving text segmentation are disclosed. In one embodiment, at least a first segmented result and a second segmented result are determined from a string of characters, a first frequency of occurrence for the first segmented result and a second frequency of occurrence for the second segmented result are determined, and an operable segmented result is identified from the first segmented result and the second segmented result based at least in part on the first frequency of occurrence and the second frequency of occurrence.

Claims

1. A computer-implemented method performed by data processing apparatus comprising:

receiving a string of characters;

identifying segmented results from the string of characters, wherein an identified segmented result includes one or more words that are formed from segmenting the string of characters into two or more sub-strings;

determining levels at which the identified segmented results occur in one or more corpora;

selecting one or more segmented results from the identified segmented results based on at least the determined levels; and

providing the selected one or more segmented results in association with the string of characters.

2. The computer-implemented method of claim 1, wherein the selected one or more segmented results are selected based on the selected one or more segmented results having a highest level of occurrence in the one or more corpora from among the segmented results.

3. The computer-implemented method of claim 1, wherein the one or more corpora include electronic documents.

4. The computer-implemented method of claim 3, wherein the level at which a particular segmented result of the segmented results occurs in the one or more corpora comprises a number of electronic documents from the one or more corpora in which the particular segmented result occurs at least once.

5. The computer-implemented method of claim 1, wherein the one or more corpora include search queries that were previously submitted by users to one or more search engines.

6. The computer-implemented method of claim 5, wherein the level at which a particular segmented result of the segmented results occurs in the one or more corpora comprises a number of times that at least a portion of the particular segmented result occurs in the search queries.

7. The computer-implemented method of claim 1, wherein the string of characters comprises a domain name;

and

the method further comprising determining whether to filter the domain name based at least in part on the selected one or more segmented results.

8. The computer-implemented method of claim 1, wherein the selected one or more segmented results is used to select content to provide in association with the string of characters.

9. The computer-implemented method of claim 8, wherein the content comprises one or more advertisements.

10. A computer-implemented system, comprising:

one or more computer processors; and

a computer-readable medium storing instructions that, when executed by the one or more computer processors, cause the one or more computer processors to perform operations comprising;

receiving a string of characters;

identifying segmented results from the string of characters, wherein an identified segmented result includes one or more words that are formed from segmenting the string of characters into two or more sub-strings;

determining levels at which the identified segmented results occur in one or more corpora;

selecting one or more segmented results from the identified segmented results based on at least the determined levels; and

providing the selected one or more segmented results in association with the string of characters.

11. The system of claim 10, wherein the selected one or more segmented results are selected based on the selected one or more segmented results having a highest level of occurrence in the one or more corpora from among the segmented results.

12. The system of claim 10, wherein the one or more corpora include electronic documents.

13. The system of claim 12, wherein the level at which a particular segmented result of the segmented results occurs in the one or more corpora comprises a number of electronic documents from the one or more corpora in which the particular segmented result occurs at least once.

14. The system of claim 10, wherein the one or more corpora include search queries that were previously submitted by users to one or more search engines.

15. The system of claim 14, wherein the level at which a particular segmented result of the segmented results occurs in the one or more corpora comprises a number of times that at least a portion of the particular segmented result occurs in the search queries.

16. The system of claim 10, wherein the string of characters comprises a domain name;

and

the operations further comprising determining whether to filter the domain name based at least in part on the selected one or more segmented results.

17. The system of claim 10, wherein the selected one or more segmented results is used to select content to provide in association with the string of characters.

18. The system of claim 17, wherein the content comprises one or more advertisements.