Information retrieval system and method

• US 20060253423A1
• Filed: 05/07/2005
• Published: 11/09/2006
• Est. Priority Date: 05/07/2005
• Status: Abandoned Application

• Current Assignee: NameProtect, Inc. (Corporation Service Company Incorporated)
• Original Assignee: NameProtect, Inc. (Corporation Service Company Incorporated)
• Inventors: Runde, Kevin, McLane, Mark, Sellek, Gregory
• Application Number:
  US11/124,623
• Publication Number:
  US 20060253423A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

An information retrieval system having a structured data store; and a signature generator configured to receive data from the structured data store, to create a category signature based on the data received from the structured data store, to receive search results from at least one crawler, and to generate a document signature based on the results from the at least one crawler. The system may also include a data store populated with a set of category signatures; and a search utility configured to receive a seed and to provide the seed to a plurality of search engines. Each search engine may be configured to generate a search result set, to parse each search result set, and to return a relevant data set. The crawler is configured to receive the relevant data set and to generate a second set of search results with a relevancy to a category. A signature comparator receives at least one document signature and at least one category signature and compares the two. The signature comparator generates flagged records based on the comparison and an indexed data store is populated with flagged records.

Claims

1. An information retrieval system comprising:

a structured data store;

a signature generator configured to receive data from the structured data store, to create a category signature based on the data received from the structured data store, to receive search results from at least one crawler, and to generate a document signature based on the results from the at least one crawler;

a data store populated with a set of category signatures;

a search utility configured to receive a seed, to provide the seed to a plurality of search engines, each search engine configured to generate a search result set, to parse each search result set, and to return a relevant data set;

a crawler configured to receive the relevant data set and to generate a second set of search results with a relevancy to a category, where the second set of results is larger than the first set of results;

a signature comparator configured to receive at least one document signature and at least one category signature, compare the at least one document signature and the at least one category signature, and generate flagged records; and

an indexed data store populated with flagged records from the signature comparator.

2. The system of claim 1 further comprising:

a workflow module configured to provide a user interface, the user interface configured to allow a user to query the indexed data store.

3. The system of claim 2 wherein the workflow module comprises a tool for sharing search results amongst a plurality of users.

4. The system of claim 1 further comprising a plurality of document data stores each separately searchable.

5. An information retrieval system comprising:

a structured data store;

a signature generator configured to receive groups of related data from the structured data store, to create a category signature based on the data received from the structured data store, to receive a document, and to generate a document signature based on the document;

a data store populated with a set of category signatures;

a signature comparator configured to receive at least one document signature and at least one category signature, compare the at least one document signature and the at least one category signature, and generate flagged records; and

an indexed data store populated with flagged records from the signature comparator.

6. The system of claim 5 further comprising a workflow module configured to provide a user interface, the user interface configured to allow a user to query the indexed data store.

7. The system of claim 6 wherein the workflow module comprises a tool for sharing search results amongst a plurality of users.

8. The system of claim 5 further comprising a plurality of document data stores each separately searchable.

9. A method of creating a structured data store from an unstructured data store, the method comprising:

generating search results from a search of the unstructured data store;

providing the search results to a signature generator to create a document signature;

generating a category signature based on information from a structured data store;

providing the document signature and the category signature to a signature comparator to generate a flagged record; and

populating a data store with the flagged record.

10. The method of claim 9 further comprising indexing the data store populated with the flagged record.

11. The method of claim 10 further comprising providing a workflow process that allows users to search the data store populated with the flagged record.

12. The method of claim 9 further comprising providing a workflow module having a tool that permits sharing of search results amongst a plurality of users.

13. A method of creating a structured data store from an unstructured data store, the method comprising:

generating search results from a search of an unstructured data store;

providing the search results to a signature generator to create a document signature;

generating a category signature from a structured data store;

providing the document signature and the category signature to a signature comparator to generate a relevancy index;

determining whether the relevancy index exceeds a threshold;

generating flagged records if the relevancy index exceeds the threshold; and

populating a first data store with flagged records.

14. The method of claim 13 further comprising indexing the data store populated with the flagged records.

15. The method of claim 14 further comprising providing a workflow process allowing users to search the data store populated with the flagged records.

16. The method of claim 13 further comprising sharing search results amongst a plurality of users.

23. The method of claim 13 further comprising:

storing a second result set in a data store.

17. A method of creating a structured data store from a group of documents, the method comprising:

providing documents to a signature generator to create a document signature;

generating a category signature from one or more related documents;

providing the document signature and the category signature to a signature comparator to generate a flagged record; and

populating a data store with the flagged record.

18. An apparatus for creating a data store of related documents, the apparatus comprising:

a set of documents segmented into related groups;

a signature generator to create a unique signature for each document group;

a data store populated with signatures for each group of documents;

a signature created by the signature generator for a document;

a signature comparator to flag related documents; and

a data store to hold related, flagged documents.

19. A system for creating a data store of related documents comprising:

a plurality of documents segmented into groups of related documents;

a device to compare the magnitude of the relationship between a document and each group of related documents and to flag documents where the relationship exceeds a threshold; and

a data store to hold the flagged documents.

20. A method to identify relevancy of documents, the method comprising:

generating a signature defining a first set of documents;

generating a second signature defining a second set of documents;

comparing the two signatures;

generating a relevancy index; and

determining the relevancy of the two sets of documents based on a threshold.

21. A system to remove irrelevant records from a query, the system comprising:

a structured data store including groups of related documents;

a signature generator configured to receive groups of related documents and generate a group signature;

a data store of group signatures;

a signature generator configured to receive documents and provide a signature identifying each document;

a signature comparator to compare the signature of a document to the group signatures in the data store of group signatures, flag documents with a high degree of relevancy to one or more groups, and provide the documents to an indexed data store;

a query module to query one or more groups; and

a search engine configured to search the indexed data store and return documents relevant to the chosen group.

22. A method to search a data store, the method comprising:

generating a list of terms descriptive of a category;

generating a set of search results from a plurality of search engines;

parsing the search result sets; and

crawling a data store based on the parsed search result set.

24. A system for crawling a data store, the system comprising:

a set of terms descriptive of a category;

a plurality of search engines configured to receive the set of terms and generate a first search result;

a parser to filter the first search results; and

a crawler configured to receive the parsed results and to generate a second set of results, where the second set of results is larger than the first set of results.

25. The system of claim 24 further comprising:

a data store for saving results.

26. An information retrieval system comprising:

an indexed data store containing data from a plurality of structured and unstructured data stores;

a query builder configured to

choose at least one of the plurality of structured and unstructured data stores to include in a query,

select fields related to the at least one data store chosen, and

accept criteria from a user interface for the selected fields; and

a search utility to search the indexed data store and return results matching the query built.

27. The system of claim 26 configured to operate on an Internet portal.

28. The system of claim 26 wherein results are grouped and displayed according to a data store origin.

29. The system of claim 26 wherein specific data for each result is displayed.

30. The system of claim 26 wherein categories are created based on correlated data in the results.

31. The system of claim 30 wherein results are displayed by category.

32. The system of claim 26 wherein each result is linked to a record in the indexed data store.

33. The system of claim 26 wherein each result is linked to a record in a data store of origin.

34. The system of claim 26 configured to allow a user to select zero or more results for entry in a data store.

35. The system of claim 34 wherein the results derive from a plurality of searches.

36. The system of claim 35 configured to allow a user to select results to be flagged.

37. The system of claim 36 configured to generate a report a report.

38. The system of claim 34 configured to allow a user to annotate zero or more selected results.

39. The system of claim 26 configured to allow a plurality of users to access the query.

40. The system of claim 26 configured to allow a plurality of users to access the results.

41. The system of claim 26 configured to accept criteria that include one or more terms and the terms include one or more wild card characters.

42. An information retrieval system comprising:

an indexed data store containing data from a plurality of structured and unstructured data stores;

a query builder configured to

choose at least one of the plurality of structured and unstructured data stores to include in a query,

select fields related to the at least one data store chosen, and

accept criteria from a user interface for the selected fields; and

a search utility to search the indexed data store and return results matching the query built;

the search utility configured to allow a user to select zero or more results for entry in a data store and to perform multiple searches.

43. The system of claim 42 configured to operate on an Internet portal.

44. The system of claim 42 configured to group and display results according to a data store origin.

45. The system of claim 42 configured to display data for each result.

46. The system of claim 42 configured to create categories based on correlated data in the results.

47. The system of claim 46 configured to display results by category.

48. The system of claim 42 wherein each result is linked to a record in the indexed data store.

49. The system of claim 42 wherein each result is linked to a record in a data store of origin.

50. The system of claim 42 configured to allow a user to select zero or more results for entry in a data store.

51. The system of claim 50 wherein the results derive from a plurality of searches.

52. The system of claim 51 configured to allow a user to select results to be flagged.

53. The system of claim 52 configured to generate a report.

54. The system of claim 50 configured to allow a user to annotate zero or more selected results.

55. The system of claim 42 configured to allow a plurality of users to access the query.

56. The system of claim 42 configured to allow a plurality of users to access the results.

57. The system of claim 42 configured to accept criteria that include one or more terms and the terms include one or more wild card characters.

58. An information retrieval system comprising:

an indexed data store containing data from a plurality of structured and unstructured data stores;

a query builder configured to

choose at least one of the plurality of structured and unstructured data stores to include in a query,

select fields related to the at least one data store chosen, and

accept criteria from a user interface for the selected fields, and

receive query input from a plurality of users; and

a search utility to search the indexed data store and return results matching the query built; and

59. The system of claim 58 configured to operate on an Internet portal.

60. The system of claim 58 configured to group and display results according to a data store origin.

61. The system of claim 58 configured to display data for each result.

62. The system of claim 58 configured to create categories based on correlated data in the results.

63. The system of claim 62 configured to display results by category.

64. The system of claim 58 wherein each result is linked to a record in the indexed data store.

65. The system of claim 58 wherein each result is linked to a record in a data store of origin.

66. The system of claim 58 configured to allow a user to select zero or more results for entry in a data store.

67. The system of claim 66 wherein the results derive from a plurality of searches.

68. The system of claim 67 configured to allow a user to select results to be flagged.

69. The system of claim 68 configured to generate a report.

70. The system of claim 66 configured to allow a user to annotate zero or more selected results.

71. The system of claim 58 configured to allow a plurality of users to access the query.

72. The system of claim 58 configured to allow a plurality of users to access the results.

73. The system of claim 58 configured to accept criteria that include one or more terms and the terms include one or more wild card characters.