Networked information indexing and search apparatus and method

• US 20070073894A1
• Filed: 09/13/2006
• Published: 03/29/2007
• Est. Priority Date: 09/14/2005
• Status: Abandoned Application

• Current Assignee: Deepdive Technologies, Inc.
• Original Assignee: O YA! Incorporated
• Inventors: Fox, David, Erickson, Robert
• Application Number:
  US11/520,968
• Publication Number:
  US 20070073894A1
• Time in Patent Office: Days
• US Class Current: 709/230
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 61/5014 using dynamic host configuration protocol [DHCP] or bootstrap protocol [BOOTP]
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

A networked information indexing and search apparatus and method provide access, including indexing and search access, to information located on one or more intranets, the Internet, or both. The networked search apparatus, also referred to herein as a network search device or network search appliance, and method comprise configuration, indexing, and searching capabilities to facilitate networked information search and retrieval.

Claims

1. A device connectable to a network, the device comprising:

an integrator configured to integrate the device on the network using dynamically-established network settings including a network address for the network device;

a resource identifier configured to;

traverse at least a portion of the network to discover one or more network devices connected to the network;

identify information sources associated with at least one of the discovered network devices;

generate at least one index of information items associated with the identified information sources;

an information retrieval engine configured to identify information items available from the identified information sources that satisfy a search criteria.

2. The apparatus of claim 1, wherein said resource identifier is further configured to maintain a list of discovered network devices.

3. The apparatus of claim 2, wherein said resource identifier is further configured to use the discovered network devices list to identify information sources.

4. The apparatus of claim 1, wherein the resource identifier is further configured to maintain a search repository which comprises a database, the database comprising domain, universal resource indicator (URI), and page tables used to store information corresponding to pages within documents stored as files at a location, or domain, on the network.

5. The apparatus of claim 4, wherein:

the domain table includes a name corresponding to each domain;

the URI table includes a URI for each document, together with a last modification date and an index time;

the page table has an entry for each page.

6. The apparatus of claim 5, wherein the page comprises a web page, an electronic mail page, or a page within a document.

7. The apparatus of claim 4, further comprising a database management system configured to update existing records in the database, and a data importer configured to import new records to the database.

8. The apparatus of claim 4, further comprising a dynamically-updatable lexicon of words, parts of speech of each word, and at least one stem word corresponding to a word stored in the lexicon.

9. The apparatus of claim 8, further comprising a buffer to store the lexicon, said buffer having an N-ary trie structure, where N represents a number of elements in a character set.

10. The apparatus of claim 9, wherein said resource identifier is further configured to identify updates to the lexicon while indexing the information items associated with the identified information sources, the updates being stored in said N-ary trie buffer structure prior to being written to the database.

11. The apparatus of claim 4, wherein the database further comprises a rank table, the rank table comprising one or more entries, each entry of which records a frequency of occurrence of a stem word in an information item.

12. The apparatus of claim 11, the frequency of occurrence is updated to reflect a change in the information item.

13. The apparatus of claim 11, wherein said information retrieval engine is further configure to rank the identified information items in accordance with a score determined for each information item identified by said information retrieval engine, the score being based at least in part on the frequency of occurrence of one or more stem words associated with the information item.

14. The apparatus of claim 1, wherein each of the information sources comprises a storage media, file system directory, file document, or page.

15. The apparatus of claim 1, wherein said information retrieval engine is further configured to determine a score for each of the information items identified by said information retrieval engine.

16. The apparatus of claim 15, wherein the search criteria comprises at least one stem word, said information retrieval engine further configured to determine a number of occurrences of each search criteria stem word in each of the identified information items and to determine the score for a given one of the identified information items based at least in part on an aggregate of the number of occurrences of each search criteria stem word found in the given information item.

17. The apparatus of claim 16, wherein said information retrieval engine is further configured to determine the score for the given information item based on the aggregate and a weighting which takes into account simultaneous occurrences of search criteria stem words associated with the given information item.

18. The apparatus of claim 1, wherein said integrator is configured to communicate configuration information to a network server and to receive the network settings in response.

19. The apparatus of claim 18, wherein said integrator is configured to authenticate the network server prior to communicating the configuration information to the network server or prior to using the network settings to integrate the device on the network.

20. The apparatus of claim 18, wherein said integrator is configured to use a user datagram protocol (UDP) client/server model to integrate the device on the network.

21. The apparatus of claim 1, wherein said resource identifier is further configured to identify network domains, identify servers in each of the identified network domains and shares on each of the identified servers.

22. The apparatus of claim 21, wherein said resource identifier is further configured to use a mount operation to access an identified server, a storage device associated with an identified server, and/or a file system associated with a storage device.

23. The apparatus of claim 22, wherein said resource identifier is further configured to supply authentication information for use with the mount operation.

24. A method for use with a device connectable to a network, the method comprising:

integrating the device on the network using dynamically-established network settings including a network address for the network device;

traversing at least a portion of the network to discover one or more network devices connected to the network;

identifying information sources associated with at least one of the discovered network devices;

generating at least one index of information items associated with the identified information sources;

identifying information items available from the identified information sources that satisfy a search criteria.

25. The method of claim 25, further comprising maintaining a list of discovered network devices.

27. The method of claim 25, further comprising maintaining a search repository which comprises a database, the database comprising domain, universal resource indicator (URI), and page tables used to store information corresponding to pages within documents stored as files at a location, or domain, on the network.

37. The method of claim 25, wherein each of the information sources comprises a storage media, file system directory, file document, or page.

38. The method of claim 25, further comprising determining a score for each of the identified information items.

39. The method of claim 38, wherein the search criteria comprises at least one stem word, said method further comprising:

determining a number of occurrences of each search criteria stem word in each of the identified information items; and

determining the score for a given one of the identified information items based at least in part on an aggregate of the number of occurrences of each search criteria stem word found in the given information item.

40. The method of claim 39, further comprising determining the score for the given information item based on the aggregate and a weighting which takes into account simultaneous occurrences of search criteria stem words associated with the given information item.

41. The method of claim 25, further comprising communicating configuration information to a network server and receiving the network settings in response.

42. The method of claim 41, further comprising authenticating the network server prior to communicating the configuration information to the network server or prior to using the network settings to integrate the device on the network.

43. The method of claim 41, further comprising integrating the device on the network using a user datagram protocol (UDP) client/server model.

44. The method of claim 25, further comprising identifying network domains, identifying servers in each of the identified network domains and identifying shares on each of the identified servers.

45. The method of claim 44, further comprising accessing an identified server, a storage device associated with an identified server, and/or a file system associated with a storage device using a mount operation.

46. The method of claim 45, further comprising supplying authentication information for use with the mount operation.

26. The method of claim 26, further comprising identifying information sources using the discovered network devices list.

28. The method of claim 28, wherein:

the domain table includes a name corresponding to each domain;

the URI table includes a URI for each document, together with a last modification date and an index time;

the page table has an entry for each page.

30. The method of claim 28, further comprising updating existing records in the database, and importing new records to the database.

31. The method of claim 28, further comprising maintaining a dynamically-updatable lexicon of words, parts of speech of each word, and at least one stem word corresponding to a word stored in the lexicon.

34. The method of claim 28, wherein the database further comprises a rank table, the rank table comprising one or more entries, each entry of which records a frequency of occurrence of a stem word in an information item.

35. The method of claim 34, further comprising updating the frequency of occurrence to reflect a change in the information item.

36. The method of claim 35, further comprising ranking the identified information items in accordance with a score determined for each information item identified by said information retrieval engine, the score being based at least in part on the frequency of occurrence of one or more stem words associated with the information item.

29. The method of claim 29, wherein the page comprises a web page, an electronic mail page, or a page within a document.

32. The method of claim 32, further comprising storing the lexicon in a buffer having an N-ary trie structure, where N represents a number of elements in a character set.

33. The method of claim 33, further comprising identifying updates to the lexicon while indexing the information items associated with the identified information sources, the updates being stored in the N-ary trie buffer structure prior to being written to the database.