Semantics-bases indexing in a distributed data processing system

• US 20040249824A1
• Filed: 06/05/2003
• Published: 12/09/2004
• Est. Priority Date: 06/05/2003
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Malatras, Cheryl Louise, Durham, Tiffany Brooke, Roberts, Gregory Wayne, Brockway, Brandon
• Application Number:
  US10/455,168
• Publication Number:
  US 20040249824A1
• Time in Patent Office: Days
• US Class Current: 707/100
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/81 Indexing, e.g. XML tags; Data structures therefor; Storage structures

Abstract

Indexing information in a distributed data processing system, including providing document structure templates comprising model document structures and semantics for the model document structures; identifying the structure of a document; selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates; and storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template. Selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates typically further comprises comparing the structure of the document and the model document structures in the templates; and selecting a template whose model document structure matches the structure of the document.

Claims

1. A method for indexing information in a distributed data processing system, the method comprising:

providing document structure templates comprising model document structures and semantics for the model document structures;

identifying the structure of a document;

selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates; and

storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template.

2. The method of claim 1 wherein selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates further comprises:

comparing the structure of the document and the model document structures in the templates; and

selecting a template whose model document structure matches the structure of the document.

3. The method of claim 1 wherein storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises assigning, to keywords from the document, semantics from the selected document structure template.

4. The method of claim 1 wherein each search keyword has a structural location in the document and storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises storing with each search keyword semantics for the keyword'"'"'s structural location in the document.

5. The method of claim 1 wherein each search keyword has a structural location in the document and storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises storing with each search keyword an identification of the keyword'"'"'s structural location in the document.

6. The method of claim 1 further comprising assigning relevance to the records in the semantics-based search index in dependence upon the semantics.

7. The method of claim 1 further comprising retrieving documents from a multiplicity of computers coupled for data communications in the distributed data processing system.

8. The method of claim 1 wherein the distributed data processing system comprises a multiplicity of computers, including clients and servers, coupled for data communications through hyperlinking protocols.

9. The method of claim 1 wherein the documents comprise hyperlinks.

10. The method of claim 1 wherein identifying the structure of a document further comprises parsing a document having contents and structure into a document data structure representing the structure of the document.

11. A system for indexing information in a distributed data processing system, the system comprising:

means for providing document structure templates comprising model document structures and semantics for the model document structures;

means for identifying the structure of a document;

means for selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates; and

means for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template.

12. The system of claim 11 wherein means for selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates further comprises:

means for comparing the structure of the document and the model document structures in the templates; and

means for selecting a template whose model document structure matches the structure of the document.

13. The system of claim 11 wherein means for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises means for assigning, to keywords from the document, semantics from the selected document structure template.

14. The system of claim 11 wherein each search keyword has a structural location in the document and means for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises means for storing with each search keyword semantics for the keyword'"'"'s structural location in the document.

15. The system of claim 11 wherein each search keyword has a structural location in the document and means for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises means for storing with each search keyword an identification of the keyword'"'"'s structural location in the document.

16. The system of claim 11 further comprising means for assigning relevance to the records in the semantics-based search index in dependence upon the semantics.

17. The system of claim 11 further comprising means for retrieving documents from a multiplicity of computers coupled for data communications in the distributed data processing system.

18. The system of claim 11 wherein the distributed data processing system comprises a multiplicity of computers, including clients and servers, coupled for data communications through hyperlinking protocols.

19. The system of claim 11 wherein the documents comprise hyperlinks.

20. The system of claim 11 wherein means for identifying the structure of a document further comprises means for parsing a document having contents and structure into a document data structure representing the structure of the document.

21. A computer program product for indexing information in a distributed data processing system, the computer program product comprising:

a recording medium;

means, recorded on the recording medium, for providing document structure templates comprising model document structures and semantics for the model document structures;

means, recorded on the recording medium, for identifying the structure of a document;

means, recorded on the recording medium, for selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates; and

means, recorded on the recording medium, for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template.

22. The computer program product of claim 21 wherein means for selecting a document structure template in dependence upon the structure of the document and the model document structures in the document structure templates further comprises:

means, recorded on the recording medium, for comparing the structure of the document and the model document structures in the templates; and

means, recorded on the recording medium, for selecting a template whose model document structure matches the structure of the document.

23. The computer program product of claim 21 wherein means for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises means, recorded on the recording medium, for assigning, to keywords from the document, semantics from the selected document structure template.

24. The computer program product of claim 21 wherein each search keyword has a structural location in the document and means for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises means, recorded on the recording medium, for storing with each search keyword semantics for the keyword'"'"'s structural location in the document.

25. The computer program product of claim 21 wherein each search keyword has a structural location in the document and means for storing search keywords from the document in records in a semantics-based search index according to the semantics from the selected document structure template further comprises means, recorded on the recording medium, for storing with each search keyword an identification of the keyword'"'"'s structural location in the document.

26. The computer program product of claim 21 further comprising means, recorded on the recording medium, for assigning relevance to the records in the semantics-based search index in dependence upon the semantics.

27. The computer program product of claim 21 further comprising means, recorded on the recording medium, for retrieving documents from a multiplicity of computers coupled for data communications in the distributed data processing system.

28. The computer program product of claim 21 wherein the distributed data processing system comprises a multiplicity of computers, including clients and servers, coupled for data communications through hyperlinking protocols.

29. The computer program product of claim 21 wherein the documents comprise hyperlinks.

30. The computer program product of claim 21 wherein means for identifying the structure of a document further comprises means, recorded on the recording medium, for parsing a document having contents and structure into a document data structure representing the structure of the document.