Method and apparatus for maintaining and navigating a non-hierarchical personal spatial file system

• US 8,515,959 B2
• Filed: 04/25/2005
• Issued: 08/20/2013
• Est. Priority Date: 11/06/2000
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cofino, Thomas A., Lenchner, Jonathan
• Primary Examiner(s): Kerzhner, Aleksandr
• Application Number:
  US11/113,457
• Publication Number:
  US 20050187931A1
• Time in Patent Office: 3,039 Days
• Field of Search: 707/739, 707/999.205
• US Class Current: 707/739
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/3344 using natural language analysis

Abstract

A self-organizing personal file system is disclosed that evaluates the “importance” of terms and phrases in a document in a personal corpus relative to usage in a reference corpus. A personalized term weighting scheme assigns a weight to terms or phrases based on the frequency of occurrence of the corresponding term or phrase in a reference corpus. The personalized term weighting for a given term or phrase can be used to store and access documents containing the corresponding term or phrase in the spatial file system and provides coordinates in a spatial file system, for one or more documents containing the corresponding term or phrase. The location of a given document in a file space may be specified by the relative frequency distribution of the stems of its significant terms or phrases compared to the occurrence of such terms or phrases in a reference corpus.

Claims

1. A method for storing a document in a file system, comprising the steps of:

determining a term weight for terms appearing in said document, wherein a given term weight is based on a frequency of occurrence of said corresponding term in a reference corpus; and

storing said document in said file system with an indication of said term weights, wherein said given term weight is obtained by dividing a fractional frequency of said term in said document by a fractional frequency of said term in said reference corpus, wherein said fractional frequency of said term in said document is the number of occurrences of the term in the document divided by the total number of terms in the document and wherein said fractional frequency of said term in said reference corpus is the number of occurrences of the term in the reference corsus divided by the total number of words in the reference corpus.

2. The method of claim 1, further comprising the step of computing an overall document.

3. The method of claim 2, wherein said overall document weight indicates the total information content of a document.

4. The method of claim 2, wherein said overall document weight is the sum of the term weights for all terms in the document.

5. The method of claim 1, wherein said term weights are stored in a relational database.

6. The method of claim 1, wherein said term weights are stored in an inverted index.

7. The method of claim 1, wherein said term weights are stored in an array.

8. The method of claim 1, wherein said term weights are stored in a flat file.

9. The method of claim 1, wherein said document can be coordinatized by said term weights.

10. The method of claim 1, wherein said document can be indexed by said term weights.

11. A method for identifying one or more documents in a file system that are related to one or more specified words, comprising the steps of:

storing each of said documents in said file system with an indication of a term weight for terms appearing in said corresponding document, wherein a given term weight is based on a frequency of occurrence of said corresponding term in a reference corpus; and

evaluating a distance between each of said documents and said one or more specified words, wherein said distance is based on said term weights and wherein said given term weight is obtained by dividing a fractional frequency of said term in said document by a fractional frequency of said term in said reference corpus, wherein said fractional frequency of said term in said document is the number of occurrences of the term in the document divided by the total number of terms in the document and wherein said fractional frequency of said term in said reference corpus is the number of occurrences of the term in the reference corpus divided by the total number of words in the reference corpus.

12. The method of claim 11, wherein said distance is the square root of the sum of the squares of the differences between said one or more specified words and terms in said document, using said term weights.

13. A system for storing a document in a file system, comprising:

a memory that stores computer-readable code; and

a processor operatively coupled to said memory, said processor configured to implement said computer-readable code, said computer-readable code configured to;

determine a term weight for terms appearing in said document, wherein a given term weight is based on a frequency of occurrence of said corresponding term in a reference corpus; and

store said document in said file system with an indication of said term weights, wherein said given term weight is obtained by dividing a fractional frequency of said term in said document by a fractional frequency of said term in said reference corpus, wherein said fractional frequency of said term in said document is the number of occurrences of the term in the document divided by the total number of terms in the document and wherein said fractional frequency of said term in said reference corpus is the number of occurrences of the term in the reference corpus divided by the total number of words in the reference corpus.

14. A system for identifying one or more documents in a file system that are related to one or more specified words, comprising:

a memory that stores computer-readable code; and

a processor operatively coupled to said memory, said processor configured to implement said computer-readable code, said computer-readable code configured to;

store each of said documents in said file system with an indication of a term weight for terms appearing in said corresponding document, wherein a given term weight is based on a frequency of occurrence of said corresponding term in a reference corpus; and

evaluate a distance between each of said documents and said one or more specified words, wherein said distance is based on said term weights and wherein said given term weight is obtained by dividing a fractional frequency of said term in said document by a fractional frequency of said term in said reference corpus, wherein said fractional frequency of said term in said document is the number of occurrences of the term in the document divided by the total number of terms in the document and wherein said fractional frequency of said term in said reference corpus is the number of occurrences of the term in the reference corpus divided by the total number of words in the reference corpus.

15. An article of manufacture for storing a document in a file system, comprising:

a tangible computer readable recordable storage medium having computer readable code means embodied thereon, said computer readable program code means comprising;

a step to determine a term weight for terms appearing in said document, wherein a given term weight is based on a frequency of occurrence of said corresponding term in a reference corpus; and

a step to store said document in said file system with an indication of said term weights, wherein said oven term weight is obtained by dividing a fractional frequency of said term in said document by a fractional frequency of said term in said reference corpus, wherein said fractional frequency of said term in said document is the number of occurrences of the term in the document divided by the total number of terms in the document and wherein said fractional frequency of said term in said reference corpus is the number of occurrences of the term in the reference corpus divided by the total number of words in the reference corpus.

16. An article of manufacture for identifying one or more documents in a file system that are related to one or more specified words, comprising:

a tangible computer readable recordable storage medium having computer readable code means embodied thereon, said computer readable program code means comprising;

a step to store each of said documents in said file system with an indication of a term weight for terms appearing in said corresponding document, wherein a given term weight is based on a frequency of occurrence of said corresponding term in a reference corpus; and

a step to evaluate a distance between each of said documents and said one or more specified words, wherein said distance is based on said term weights and wherein said given term weight is obtained by dividing a fractional frequency of said term in said document by a fractional frequency of said term in said reference corpus, wherein said fractional frequency of said term in said document is the number of occurrences of the term in the document divided by the total number of terms in the document and wherein said fractional frequency of said term in said reference corpus is the number of occurrences of the term in the reference corpus divided by the total number of words in the reference corpus.