System and method for cataloguing digital information for searching and retrieval

• US 6,701,314 B1
• Filed: 01/21/2000
• Issued: 03/02/2004
• Est. Priority Date: 01/21/2000
• Status: Expired due to Term

• Current Assignee: Leidos, Inc. (Leidos Holdings, Inc.)
• Original Assignee: Science Applications International Corporation
• Inventors: Conover, Joan Evelyn, Anthony, Douglas McCoy
• Primary Examiner(s): Vu, Kim
• Assistant Examiner(s): PHAM, HUNG Q
• Application Number:
  US09/489,735
• Time in Patent Office: 1,502 Days
• Field of Search: 707/1-10, 707/104.1, 709/217, 715/506, 715/531
• US Class Current: 707/740
• CPC Class Codes: G06F 16/353 into predefined classes
• CPC Class Codes: G06F 16/38 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/383 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/956 Hierarchical
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99937 Sorting
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

The system and method for searching and retrieving information stored in heterogeneous information repositories. A portal server retrieves user requests through a computer network and looks up information stored in a metadata databases. For example, the metadata may be encoded in an XML/RDF format and stored in a directory server to facilitate effective searching and retrieval of information from an information repository. Metadata includes information including a classmark definition for each document. The classmark is determined through an automated cataloguing process.

Claims

1. A system for automatically cataloguing documents located in multiple heterogeneous repositories, the system comprising:

a scanning tool for scanning the multiple heterogeneous repositories to collect keywords for the documents located therein;

a keyword index to the documents built using the collected keywords;

a mapping toolfor mapping the documents using the keyword index to one or more classes, each of the one or more classes including keywords representative of that class; and

a computing device for creating metadata indicative of each of the documents as defined by each of the documents'"'"' keywords and one or more classes and

cataloguing each of the documents in an integrated library according to the metadata in a meta-index, wherein the meta-index retains the characteristics of each of the multiple heterogeneous repositories as applied to each of the documents such that a user may access one or more of the documents within the multiple heterogeneous repositories utilizing the meta-index; and

further wherein the characteristics of the multiple heterogeneous repositories are transparent to the user when one or more of the documents are accessed using the meta-index.

2. The system according to claim 1, wherein the scanning tool is at least one spider.

3. The system according to claim 1, wherein the mapping tool is a domain ontology.

4. The system according to claim 3, wherein the domain ontology is a classification hierarchy.

5. The system according to claim 1, wherein the mapping tool is a neural network.

6. A method for automatically cataloguing documents located in multiple heterogeneous repositories, comprising:

scanning the multiple heterogeneous repositories to collect keywords from the documents located therein;

building a keyword index to the documents stored in the multiple heterogeneous repositories using the collected keywords;

mapping the documents using the keyword index into predetermined classes, wherein the mapping is performed using at least one mapping tool;

creating metadata information, including identification of the predetermined class, for the documents; and

cataloguing each of the documents in an integrated library according to the metadata in a meta-index, wherein the meta-index retains the characteristics of each of the multiple heterogeneous repositories as applied to each of the documents such that a user may access one or more of the documents within the multiple heterogeneous repositories utilizing the meta-index.

7. The method of claim 6, wherein scanning the at least one information repository to collect keywords is performed by a spider.

8. The method of claim 6, wherein the metadata information is stored in the eXtensible Markup Language (XML) format.

9. The method of claim 6, wherein the metadata information is stored in the Resource Description Framework (RDF) format.

10. A system for automatically cataloguing documents located in multiple heterogeneous repositories, the system comprising:

means for scanning the multiple heterogeneous to collect keywords from the documents located therein;

means for building a keyword index to the documents stored in the multiple heterogeneous repositories using the collected keywords;

means for mapping the documents using the keyword index into predetermined classes, wherein the mapping is performed using at least one mapping tool;

means for creating metadata information, including identification of the predetermined class, for the documents; and

means for cataloguing each of the documents in an integrated library according to the metadata in a meta-index, wherein the meta-index retains the characteristics of each of the multiple heterogeneous repositories as applied to each of the documents such that a user accesses one or more of the documents within the multiple heterogeneous repositories utilizing the meta-index.

11. A method for automatically cataloguing electronic documents located in multiple digital heterogeneous libraries comprising:

scanning each of the multiple digital heterogeneous libraries to ascertain identifying characteristics of the electronic documents located therein;

building an index to each of the electronic documents based on the identifying characteristics;

mapping each of the electronic documents to at least one predetermined class based on a comparison of the index of identifying characteristics to the keywords of a classification hierarchy associated with the at least one predetermined class; and

cataloguing each of the electronic documents into at least one predetermined class within an integrated library according to the comparison, wherein the integrated library retains the characteristics of each of the multiple heterogeneous libraries as applied to each of the electronic documents such that a user accesses one or more of the electronic documents within the multiple heterogeneous libraries utilizing the integrated library.

12. The method according to claim 11, wherein the keywords of the classification hierarchy are weighted.

13. The method according to claim 11, wherein the comparison is performed using a neural network.

14. The method according to claim 11, further comprising:

creating metadata for each of the electronic documents, wherein the metadata identifies the at least one predetermined class associated therewith.