Word association method and apparatus

• US 8,521,509 B2
• Filed: 05/03/2010
• Issued: 08/27/2013
• Est. Priority Date: 03/16/2001
• Status: Expired due to Fees

• Current Assignee: Meaningful Machines LLC
• Original Assignee: Meaningful Machines LLC
• Inventors: Abir, Eli
• Primary Examiner(s): SAINT CYR, LEONARD
• Application Number:
  US12/772,614
• Publication Number:
  US 20100211567A1
• Time in Patent Office: 1,212 Days
• Field of Search: None
• US Class Current: 704/7
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 40/42 Data-driven translation

Abstract

A method for creating and using a cross-idea association database that includes a method for associating words and word strings in a language by analyzing word formations around a word or word string to identify other words or word strings that are equivalents or near equivalents semantically. One method for associating words and word strings includes querying a collection of documents with a user-supplied word or word string, determining a user-defined amount of words or word strings to the left and right of the query string, determining the frequency of occurrence of words or word strings located on the left and right of the query string, and ranking the located words.

Claims

1. A computer device including a processor, a memory coupled to the processor, and a program stored in the memory, wherein the computer is configured to execute the program and perform the steps of:

providing a collection of documents, wherein said collection includes at least one document;

receiving a word or word string query to be analyzed;

searching by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined amount of words or word strings or both to the left of said query to be analyzed in said returned documents based on their frequency and creating a Left Signature List comprising each of said words and word strings to the left of said query to be analyzed in said returned documents;

searching said collection of documents for the words and word strings on the Left Signature List and returning second documents containing said words and word strings on the Left Signature List;

determining a user-defined amount of words or word strings or both to the right of each of said words and word strings comprising said Left Signature List in said second returned documents and creating Left Anchor Lists comprising each of said words and word strings to the right of each of said words and word strings on the Left Signature List based on their frequency in said second returned documents;

determining a user-defined number of words or word strings or both to the right of said query to be analyzed in said returned documents and creating a Right Signature List comprising each of said words and word strings to the right of said query to be analyzed in said returned documents based on their frequency;

searching said collection of documents for each of said words and word strings on the Right Signature List and returning third documents containing said words and word strings on the Right Signature List;

determining a user-defined number of words or word strings or both to the left of each of said words and word strings comprising said Right Signature List in said third returned documents and creating Right Anchor Lists comprising each of said words and word strings to the left of each of said words and word strings on the Right Signature List based on their frequency in said third returned documents; and

ranking results based on the number of different Anchor Lists on which the result appears so long as the result appears on at least one Left Anchor List and one Right Anchor List.

2. The computer device of claim 1, wherein said ranking results includes multiplying a total frequency of each word or word string occurring in said Left Anchor Lists by a total frequency of said word or word string occurring in said Right Anchor Lists.

3. The computer device of claim 1, wherein said ranking results includes adding a total frequency of each word or word string occurring in said Left Anchor Lists to a total frequency of said word or word string occurring in said Right Anchor Lists, for each word or word string occurring in at least one Left Anchor List and one Right Anchor List.

4. The computer device of claim 1, wherein said ranking results are modified based on user defined criteria.

5. The computer device of claim 1, wherein said ranking results are used to aid a software application.

6. The computer device of claim 1, wherein the results are used to aid a machine translation application.

7. A computer device including a processor, a memory coupled to the processor, and a program stored in the memory, wherein the computer is configured to execute the program and perform the steps of:

providing a collection of documents, wherein said collection includes at least one document;

receiving a word or word string query to be analyzed;

searching by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined number of words or word strings or both to the left and right of the query in said returned documents containing the query to be analyzed;

returning a list with an entry or plurality of entries, wherein said entry or said plurality of entries contain said determined words and word strings to the left and right of the query in said returned documents;

searching said collection of documents for said entry or plurality of entries in said returned list and returning second documents containing said entry or one or more of said plurality of entries in said returned list; and

determining a user defined number of words or word strings that appear between words or word strings to the left and right of said query in said second returned documents;

returning a list of words or word strings or both that occur between said determined words and word strings to the left and right of said query in said second returned documents; and

ranking said returned list of words and word strings based on the number of different words and word strings to the left and right of said query that each returned word or word string appears between in said second returned documents.

8. The computer device of claim 7, wherein said ranking is used to aid a software application.

9. The computer device of claim 7, wherein said ranking is modified based on user defined criteria.

10. The computer device of claim 7, wherein the results are used to aid a machine translation application.

11. A non-volatile computer readable storage medium having stored thereon a program executable by a computer processor for performing the steps of:

providing a collection of documents, wherein said collection includes at least one document;

receiving a word or word string query to be analyzed;

searching by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined amount of words or word strings or both to the left of said query to be analyzed in said returned documents based on their frequency and creating a Left Signature List comprising each of said words and word strings to the left of said query to be analyzed in said returned documents;

searching said collection of documents for the words and word strings on the Left Signature List and returning second documents containing said words and word strings on the Left Signature List;

determining a user-defined amount of words or word strings or both to the right of each of said words and word strings comprising said Left Signature List in said second returned documents and creating Left Anchor Lists comprising each of said words and word strings to the right of each of said words and word strings on the Left Signature List based on their frequency in said second returned documents;

determining a user-defined number of words or word strings or both to the right of said query to be analyzed in said returned documents and creating a Right Signature List comprising each of said words and word strings to the right of said query to be analyzed in said returned documents based on their frequency;

searching said collection of documents for each of said words and word strings on the Right Signature List and returning third documents containing said words and word strings on the Right Signature List;

determining a user-defined number of words or word strings or both to the left of each of said words and word strings comprising said Right Signature List in said third returned documents and creating Right Anchor Lists comprising each of said words and word strings to the left of each of said words and word strings on the Right Signature List based on their frequency in said third returned documents; and

ranking results based on the number of different Anchor Lists on which the result appears so long as the result appears on at least one Left Anchor List and one Right Anchor List.

12. The non-volatile computer readable storage medium of claim 11, wherein said ranking results includes multiplying a total frequency of each word or word string occurring in said Left Anchor Lists by a total frequency of said word or word string occurring in said Right Anchor Lists.

13. The non-volatile computer readable storage medium of claim 11, wherein said ranking results includes adding a total frequency of each word or word string occurring in said Left Anchor Lists to a total frequency of said word or word string occurring in said Right Anchor Lists, for each word or word string occurring in at least one Left Anchor List and one Right Anchor List.

14. The non-volatile computer readable storage medium of claim 11, wherein said ranking results are modified based on user defined criteria.

15. The non-volatile computer readable storage medium of claim 11, wherein said ranking results are used to aid a software application.

16. The non-volatile computer readable storage medium of claim 11, wherein the results are used to aid a machine translation application.

17. A non-volatile computer readable storage medium having stored thereon a program executable by a computer processor for performing the steps of:

providing a collection of documents, wherein said collection includes at least one document;

receiving a word or word string query to be analyzed;

searching by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined number of words or word strings or both to the left and right of the query in said returned documents containing the query to be analyzed;

returning a list with an entry or plurality of entries, wherein said entry or said plurality of entries contain said determined words and word strings to the left and right of the query in said returned documents;

searching said collection of documents for said entry or plurality of entries in said returned list and returning second documents containing said entry or one or more of said plurality of entries in said returned list; and

determining a user defined number of words or word strings that appear between words or word strings to the left and right of said query in said second returned documents;

returning a list of words or word strings or both that occur between said determined words and word strings to the left and right of said query in said second returned documents; and

ranking said returned list of words and word strings based on the number of different words and word strings to the left and right of said query that each returned word or word string appears between in said second returned documents.

18. The non-volatile computer readable storage medium of claim 17, wherein said ranking is used to aid a software application.

19. The non-volatile computer readable storage medium of claim 17, wherein said ranking is modified based on user defined criteria.

20. The non-volatile computer readable storage medium of claim 17, wherein the results are used to aid a machine translation application.

21. A method for associating words and word strings in a language comprising:

providing a collection of documents, wherein said collection includes at least one document;

receiving a word or word string query to be analyzed;

searching by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined amount of words or word strings or both to the left of said query to be analyzed in said returned documents based on their frequency and creating a Left Signature List comprising each of said words and word strings to the left of said query to be analyzed in said returned documents;

searching said collection of documents for the words and word strings on the Left Signature List and returning second documents containing said words and word strings on the Left Signature List;

determining a user-defined amount of words or word strings or both to the right of each of said words and word strings comprising said Left Signature List in said second returned documents and creating Left Anchor Lists comprising each of said words and word strings to the right of each of said words and word strings on the Left Signature List based on their frequency in said second returned documents;

determining a user-defined number of words or word strings or both to the right of said query to be analyzed in said returned documents and creating a Right Signature List comprising each of said words and word strings to the right of said query to be analyzed in said returned documents based on their frequency;

searching said collection of documents for each of said words and word strings on the Right Signature List and returning third documents containing said words and word strings on the Right Signature List;

determining a user-defined number of words or word strings or both to the left of each of said words and word strings comprising said Right Signature List in said third returned documents and creating Right Anchor Lists comprising each of said words and word strings to the left of each of said words and word strings on the Right Signature List based on their frequency in said third returned documents;

ranking results based on the number of different Anchor Lists on which the result appears so long as the result appears on at least one Left Anchor List and one Right Anchor List; and

wherein said ranking results are modified based on user defined criteria.

22. A method for associating words and word strings in a language comprising:

providing a collection of documents, wherein said collection includes at least one document;

receiving a word or word string query to be analyzed;

searching by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined amount of words or word strings or both to the left of said query to be analyzed in said returned documents based on their frequency and creating a Left Signature List comprising each of said words and word strings to the left of said query to be analyzed in said returned documents;

searching said collection of documents for the words and word strings on the Left Signature List and returning second documents containing said words and word strings on the Left Signature List;

determining a user-defined amount of words or word strings or both to the right of each of said words and word strings comprising said Left Signature List in said second returned documents and creating Left Anchor Lists comprising each of said words and word strings to the right of each of said words and word strings on the Left Signature List based on their frequency in said second returned documents;

determining a user-defined number of words or word strings or both to the right of said query to be analyzed in said returned documents and creating a Right Signature List comprising each of said words and word strings to the right of said query to be analyzed in said returned documents based on their frequency;

searching said collection of documents for each of said words and word strings on the Right Signature List and returning third documents containing said words and word strings on the Right Signature List;

determining a user-defined number of words or word strings or both to the left of each of said words and word strings comprising said Right Signature List in said third returned documents and creating Right Anchor Lists comprising each of said words and word strings to the left of each of said words and word strings on the Right Signature List based on their frequency in said third returned documents;

ranking results based on the number of different Anchor Lists on which the result appears so long as the result appears on at least one Left Anchor List and one Right Anchor List; and

wherein said ranking results are used to aid a software application.

23. A method for associating words and word strings in a language comprising:

providing a collection of documents, wherein said collection includes at least one document;

receiving a word or word string query to be analyzed;

searching by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined number of words or word strings or both to the left and right of the query in said returned documents containing the query to be analyzed;

returning a list with an entry or plurality of entries, wherein said entry or said plurality of entries contain said determined words or word strings to the left and right of the query in said returned documents;

searching said collection of documents for said entry or plurality of entries in said returned list and returning second documents containing said entry or one or more of said plurality of entries in said returned list; and

determining a user defined number of words or word strings that appear between words or word strings to the left and right of said query in said second returned documents;

returning a list of words or word strings or both that occur between said determined words or word strings to the left and right of said query in said second returned documents; and

ranking said returned list of words and word strings based on the number of different words and word strings to the left and right of said query that each returned word or word string appears between in said second returned documents.

24. The method of claim 23, wherein said ranking is used to aid a software application.

25. The method of claim 23, wherein said ranking is modified based on user defined criteria.

26. The method of claim 23, wherein the results are used to aid a machine translation application.

27. A computer device for associating words and word strings in a language comprising:

providing a collection of documents, wherein said collection includes at least one document;

receiving from a user a word or word string query to be analyzed;

searching said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined number of words or word strings or both to the left and right of the query in said returned documents containing the query to be analyzed;

returning a list with an entry or plurality of entries, wherein said entry or said plurality of entries contain said determined words or word strings to the left and right of the query in said returned documents;

searching said collection of documents for said entry or plurality of entries in said returned list and returning second documents containing said entry or one of said plurality of entries in said returned list; and

determining a user defined number of words or word strings that appear between words and word strings to the left and right of said query in said second returned documents;

returning a list of words or word strings or both that occur between said determined words or word strings to the left and right of said query in said second returned documents; and

ranking said returned list of words or word strings based on the number of different words and word strings to the left and right of said query that each returned word and word string appears between in said second returned documents.

28. The computer device of claim 27, wherein the results are used to aid a machine translation application.

29. The computer device of claim 27, wherein said ranking results are modified based on user defined criteria.

30. The computer device of claim 27, wherein said ranking results are used to aid a software application.

31. A non-volatile computer readable storage medium for associating words and word strings in a language comprising:

providing a collection of documents, wherein said collection includes at least one document;

receiving from a user a word or word string query to be analyzed;

searching said collection of documents or the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined number of words or word strings or both to the left and right of the query in said returned documents containing the query to be analyzed;

returning a list with an entry or plurality of entries, wherein said entry or said plurality of entries contain said determined words or word strings to the left and right of the query in said returned documents;

searching said collection of documents for said entry or plurality of entries in said returned list and returning second documents containing said entry or one of said plurality of entries in said returned list; and

determining a user defined number of words or word strings that appear between words or word strings to the left and right of said query in said second returned documents;

returning a list of words and word strings or both that occur between said determined words and word strings to the left and right of said query in said second returned documents; and

ranking said returned list of words or word strings based on the number of different words or word strings to the left and right of said query that each returned word or word string appears between in said second returned documents.

32. The non-volatile computer storage medium of claim 31, wherein the results are used to aid a machine translation application.

33. The non-volatile computer storage medium of claim 31, wherein said ranking results are modified based on user defined criteria.

34. The non-volatile computer storage medium of claim 31, wherein said ranking results are used to aid a software application.

35. A method for associating words and word strings in a language comprising:

providing a collection of documents, wherein said collection includes at least one document;

receiving from a user a word or word string query to be analyzed;

searching, by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined number of words or word strings or both to the left and right of the query in said returned documents containing the query to be analyzed;

returning a list with an entry or plurality of entries, wherein said entry or said plurality of entries contain said determined words or word strings to the left and right of the query in said returned documents;

searching said collection of documents for said entry or plurality of entries in said returned list and returning second documents containing said entry or one of said plurality of entries in said returned list;

determining a user defined number of words or word strings that appear between words and word strings to the left and right of said query in said second returned documents;

returning a list of words or word strings or both that occur between said determined words and word strings to the left and right of said query in said second returned documents;

ranking said returned list of words or word strings based on the number of different words and word strings to the left and right of said query that each returned word and word string appears between in said second returned documents; and

wherein said ranking results are modified based on user defined criteria.

36. A method for associating words and word strings in a language comprising:

providing a collection of documents, wherein said collection includes at least one document;

receiving from a user a word or word string query to be analyzed;

searching, by a processor, said collection of documents for the query to be analyzed and returning documents containing the query to be analyzed;

determining a user-defined number of words or word strings or both to the left and right of the query in said returned documents containing the query to be analyzed;

returning a list with an entry or plurality of entries, wherein said entry or said plurality of entries contain said determined words or word strings to the left and right of the query in said returned documents;

searching said collection of documents for said entry or plurality of entries in said returned list and returning second documents containing said entry or one of said plurality of entries in said returned list;

determining a user defined number of words or word strings that appear between words and word strings to the left and right of said query in said second returned documents;

returning a list of words or word strings or both that occur between said determined words and word strings to the left and right of said query in said second returned documents;

ranking said returned list of words or word strings based on the number of different words or word strings to the left and right of said query that each returned word or word string appears between in said second returned documents; and

wherein said ranking results are used to aid a software application.