ORGANISING AND STORING DOCUMENTS

• US 20100070512A1
• Filed: 03/11/2008
• Published: 03/18/2010
• Est. Priority Date: 03/20/2007
• Status: Abandoned Application

• Current Assignee: British Telecommunications PLC (BT Group PLC)
• Original Assignee: British Telecommunications PLC (BT Group PLC)
• Inventors: Weeks, Richard, Lloyd, Barry Gw., Thurlow, Ian
• Application Number:
  US12/531,541
• Publication Number:
  US 20100070512A1
• Time in Patent Office: Days
• US Class Current: 707/750
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/353 into predefined classes

Abstract

A data handling device has access to a store of existing metadata pertaining to existing documents having associated metadata terms. It selects metadata assigned to documents deemed to be of interest to a user and analyses the metadata to generate statistical data as to the co-occurrence of pairs of terms in the metadata of one and the same document. When a fresh document is received, it is analysed to assign to it a set of terms and determine for each a measure of their strength of association with the document. Then, a score is generated for the document, for each term of the set, the score being a monotonically increasing function of (a) the strength of association with the document and of (b) the relative frequency of co-occurrence of that term and another term that occurs in the set. The score represents the relevance of the document to the users and can be used (following comparison with a threshold, or with the scores of other such documents) to determine whether the document is to be reported to the user, and/or retrieved.

Claims

1. A method of organising documents, the documents having associated metadata terms, the method comprising:

providing access to a store of existing metadata;

selecting from the existing metadata items assigned to documents deemed to be of interest to a user and generating for each of one of more terms occurring in the selected metadata values indicative of the frequency of co-occurrence of that term with a respective other term in the metadata of one and the same document;

analysing a fresh document to assign to it a set of terms and determine for each a measure (n_j) of their strength of association with the document; and

determining, for the fresh document, for each term (h) of the set a score that is a monotonically increasing function of a) the strength of association (n_j) with the document and of b) the relative frequency of co-occurrence (vh_j), in the selected existing metadata, of that term and another term (J) that occurs in the set.

2. A method according to claim 1, comprising, for the generation of the co-occurrence values, generating for each term a set of weights, each weight indicating the number of documents that have been assigned both the term in question and a respective other term, divided by the total number of documents to which the term in question has been assigned.

3. A method according to claim 1, in which the terms are terms of a predetermined set of terms.

4. A method according to claim 1, in which each term for which a set of cooccurrence values is generated is a term of a predetermined set of terms, but some at least of the values are values indicative of the frequency of co-occurrence of the term in question and a respective other term which is not a term of the predetermined set.

5. A method according to claim 1, in which the terms are words or phrases and the strength of association determined by the document analysis for each term is the number of occurrences of that term in the document.

6. A method according to claim 1, including comparing the score with a threshold and determining whether the document is to be reported and/or retrieved.

7. A method according to claim 1, including analysing a plurality of said fresh documents and determining a score for each, and analysing the scores to determine which of the documents is/are to be reported and/or retrieved.

8. A data handling device for organising documents, the documents having associated metadata terms, the device comprising:

means providing access to a store of existing metadata;

means operable to select from the existing metadata items assigned to documents deemed to be of interest to a user and to generate for each of one of more terms occurring in the selected metadata values indicative of the frequency of co-occurrence of that term with a respective other term in the metadata of one and the same document;

means for analysing a fresh document to assign to it a set of terms and determine for each a measure (n_j) of their strength of association with the document; and

means operable to determine, for the fresh document, for each term (h) of the set a score that is a monotonically increasing function of a) the strength of association (n_j) with the document and of b) the relative frequency of co-occurrence (vh_j), in the selected existing metadata, of that term and another term (j) that occurs in the set.

9. A data handling device according to claim 8, comprising, for the generation of the cooccurrence values, generating for each term a set of weights, each weight indicating the number of documents that have been assigned both the term in question and a respective other term, divided by the total number of documents to which the term in question has been assigned.

10. A data handling device according to claim 8, in which the terms are terms of a predetermined set of terms.

11. A data handling device according to claim 8, in which each term for which a set of co-occurrence values is generated is a term of a predetermined set of terms, but some at least of the values are values indicative of the frequency of co-occurrence of the term in question and a respective other term which is not a term of the predetermined set.

12. A data handling device according to claim 8, in which the terms are words or phrases and the strength of association determined by the document analysis for each term is the number of occurrences of that term in the document.