Method for using agents to create a computer index corresponding to the contents of networked computers

• US 6,976,053 B1
• Filed: 05/23/2000
• Issued: 12/13/2005
• Est. Priority Date: 10/14/1999
• Status: Expired due to Term

• Current Assignee: MEC Management, LLC (Three Affiliated Tribes of the Fort Berthold Reservation, North Dakota)
• Original Assignee: Arcessa, Inc.
• Inventors: Tripp, Gary W., Meadway, Michael D., Duguay, Claude E.
• Primary Examiner(s): ROBINSON, GRETA LEE
• Application Number:
  US09/575,971
• Time in Patent Office: 2,030 Days
• Field of Search: 707/100, 707/102, 707/103.R, 707/103, 707/103.Y, 707/103.Z, 707/10, 709/202
• US Class Current: 709/202
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure

Abstract

A search engine utilizes a bottom-up approach to index the content of a network with agent programs running on each host computer instead of relying on a top-down approach as used by conventional search engines. A central catalog of object references is compiled on the central site or sites from the meta data reported from each web site. One or more brochure files may also be created and stored on each web site to provide conceptual or non-key-word data about the site, such as target demographics and categorization information. This conceptual information is then utilized in constructing the central catalog so that more accurate search results may be generated for search queries applied to the catalog.

Claims

1. A method for constructing a catalog of object references corresponding to objects stored within a network, the network including a plurality of interconnected computers with at least one computer storing the catalog, each computer storing the catalog being designated a cataloging site, and the other computers on the network storing a plurality of objects and being designated source sites, the method comprising:

running on each source site an agent program which processes the contents of objects stored on the source site and generates meta data for each processed object which describes the object;

transmitting the generated meta data from each host site to at least one cataloging site; and

aggregating the transmitted meta data at each cataloging site to generate the catalog of object references.

2. The method of claim 1 wherein at least one source site is also a cataloging site.

3. The method of claim 1 wherein the transmitted meta data further comprises a command to the cataloging site operable to instruct the cataloging site.

4. The method of claim 1 wherein transmitting the assembled meta data comprises transmitting differential meta data indicating changes in current meta data relative to previous meta data.

5. The method of claim 1 wherein the agent program creates meta data only for selected objects on the source site, the selected objects selected by user input.

6. The method of claim 1 wherein the agent program creates meta data only for selected objects on the source site, the selected objects selected by a computer algorithm.

7. The method of claim 1 wherein the contents of at least some of the objects stored on a source site comprises nontextual data and the meta data comprises one or more vectors extracted from the contents.

8. The method of claim 7 wherein the nontextual data comprise one or more digital image files and the vectors for each object stored on a source site correspond to features in the image file.

9. The method of claim 7 wherein the nontextual data comprise one or more digital audio files and the vectors for each object stored on a source site correspond to frequency domain analysis of the audio file.

10. The method of claim 1 wherein the agent program comprises a utility program that is resident in an operating system on the corresponding source site.

11. A method for constructing a catalog of object references on a cataloging computer on a computer network, the computer network further including a plurality of interconnected source computers, comprising:

running on each source computer an agent program which accesses a file system structure of the source computer and creates a data set which specifies the file system structure;

transmitting at the initiation of each source computer the data set from the source computer to the cataloging computer; and

processing the transmitted data sets at the cataloging computer to generate the catalog of object references that correspond to the transmitted data sets.

12. The method of claim 11 wherein the file system structure comprises a plurality of directory entries for files stored on the corresponding source computer.

13. The method of claim 11 wherein each source computer is also a cataloging computer.

14. The method of claim 11 wherein the transmitted data further comprises a command to the cataloging computer operable to instruct the cataloging computer.

15. The method of claim 11 wherein transmitting the data comprises transmitting differential data indicating changes in a current data set relative to a previous data set.

16. The method of claim 11 wherein only a portion of the file system structure is selected.

17. The method of claim 11 wherein only a portion of the file system structure is selected by user input.

18. The method of claim 11 wherein only a portion of the file system structure is selected by a computer algorithm.

19. The method of claim 11 wherein the agent program comprises a utility program that is resident in an operating system on the corresponding source computer.

20. A method for constructing a catalog of object references to objects on a site in a network, the network including a plurality of sites and the objects on the site not being accessible to other sites on the network, comprising;

running on the site a agent program that generates meta data from the contents of objects on the site, and

assembling the meta data to construct the catalog of object references that correspond to the contents of the objects.

21. The method of claim 20 wherein the catalog is stored on the same site as the objects.

22. The method of claim 20 wherein the catalog is assembled on a central site which is not the site where the objects are located.

23. The method of claim 20 wherein object references remain in the catalog although an object corresponding to an object reference no longer exists.

24. The method of claim 20 wherein the catalog comprises object references to objects stored on a plurality of sites, the object references aggregated and stored on a central site.

25. The method of claim 20 wherein the agent program creates meta data only for selected objects on the site, the selected objects being selected by user input.

26. The method of claim 20 wherein the meta data further comprises a command operable to instruct the site.

27. The method of claim 20 wherein the contents of at least some of the objects comprises nontextual data.

28. The method of claim 20 wherein the agent program comprises a utility program that is resident in an operating system on the site.

29. A method for constructing a catalog of object references from objects stored within a network, the network including a plurality of interconnected computers with one computer storing the catalog and being designated a cataloging site and each of the other computers storing a plurality of objects and being designated a source site, the method comprising:

receiving at the cataloging site, meta data about objects stored on each source site, the meta data generated by an agent program stored on each source site, the agent program processing objects stored on the host site and generating corresponding meta data; and

processing the received meta data at the cataloging site to generate the catalog of object references.

30. The method of claim 29 wherein the transmitted meta data further comprises a command to the cataloging site operable to instruct the cataloging site.

31. The method of claim 29 wherein the agent program creates meta data only for selected objects on the source site, the selected objects being selected by user input.

32. The method of claim 29 wherein the agent program comprises a utility program that is resident in an operating system on the corresponding source site.

33. A computer-readable medium containing computer-executable instructions for constructing a catalog of object references about objects stored on a source site in a network, the network including a plurality of sites, the objects on the source site not being accessible to other sites on the network, the computer-executable instructions operable for:

running an agent program for generating meta data corresponding to the contents of objects on the source site, and

assembling said meta data to construct a catalog of object references,

wherein the catalog is stored on the same site as the objects.

34. The computer-readable medium of claim 33 wherein object references remain in the catalog although an object relating to an object reference no longer exists.

35. The computer-readable medium of claim 33 wherein the catalog comprises object references to objects stored on a plurality of sites, these object references being aggregated and stored on a central site.

36. The computer-readable medium of claim 33 wherein the agent program creates meta data only for selected objects on the source site, the selected objects being selected by user input.

37. The computer-readable medium of claim 33 wherein the meta data further comprises a command operable to instruct the source site.