Information retrieval system, an information retrieval method, a program for executing information retrieval, and a storage medium wherein a program for executing information retrieval is stored

• US 20030159106A1
• Filed: 10/23/2002
• Published: 08/21/2003
• Est. Priority Date: 10/23/2001
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kobayashi, Mei, Takeuchi, Hironori, Aono, Masaki, Samukawa, Hikaru
• Granted Patent: US 6,965,898 B2
• Time in Patent Office: Days
• US Class Current: 715/500
• CPC Class Codes: G06F 16/3347 using vector based model
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

[Objective] To provide an information retrieval system, a method for information retrieval, a program for executing the information retrieval, and a storage medium comprising the program for executing the information retrieval

[Means to Solve Problems] The information retrieval system according to the present invention comprises: means for generating and storing a predetermined type matrix from said document-attribute matrix, means for generating said document-attribute submatrix from documents being added to said database during a specific time period, means for updating said predetermined type matrix using knowledge with respect to said document-attribute submatrix and for executing the singular value decomposition on updated said predetermined type matrix to execute dimension reduction of all document-attribute matrices stored within said database, and means for retrieving information with respect to a user input query using said dimension reduced document-attribute matrix.

Claims

1. An information retrieval system for retrieving documents added to a database with respect to time, said documents being converted into document-attribute matrix and stored within said information retrieval system, and said document-attribute matrix being constituted by document-attribute submatrices added in order with respect to time, said information retrieval system comprising:

means for generating and storing a predetermined type matrix from said document-attribute matrix,

means for generating said document-attribute submatrix from documents being added to said database during a specific time period,

means for updating said predetermined type matrix using knowledge with respect to said document-attribute submatrix and for executing singular value decomposition on updated said predetermined type matrix to execute dimension reduction of all document-attribute matrices stored within said database, and

means for retrieving information with respect to a user input query using said dimension reduced document-attribute matrix.

2. The information retrieval system according to claim 1 comprising a means of executing QR decomposition of said document-attribute submatrices and use only a matrix R as said predetermined matrix.

3. The information retrieval system according to claim 2 comprising a means of updating said stored matrix R by a Householder transformation related to said document-attribute submatrices.

4. The information retrieval system according to claim 1 comprising means of:

generating a covariance matrix as said predetermined matrix from said document-attribute submatrices; and

retaining a product sum matrix of document vectors (SUM(M)₁) a mean value of document vectors (MEAN(M)₁), a mean product matrix of document vectors (SUM(M)₂) and a total number of documents (M).

5. The information retrieval system according to claim 4 comprising a means of generating a covariance matrix C′

of all document-attribute matrices including said added submatrices from the following formula;

6. The information retrieval system according to claim 4 further comprising means of retrieving attributes contained in a document vector automatically and generating an attribute hash table for adding or deleting said attributes.

7. An information retrieval method for retrieving documents added to a database with respect to time, said documents being converted into document-attribute matrix and stored within said information retrieval system, and said document-attribute matrix being constituted by document-attribute submatrices added in order with respect to time, said information retrieval system comprising the steps of:

generating and storing a predetermined type matrix from said document-attribute matrix,

generating said document-attribute submatrix from documents being added to said database during a specific time period,

updating said predetermined type matrix using knowledge with respect to said document-attribute submatrix and for executing the singular value decomposition on updated said predetermined type matrix to execute dimension reduction of all document-attribute matrices stored within said database, and

retrieving information with respect to a user input query using said dimension reduced document-attribute matrix.

8. The information retrieval method according to claim 7 comprising a step of executing QR decomposition of said document-attribute submatrices and using only a matrix R as said predetermined matrix.

9. The information retrieval method according to claim 8 comprising a step of updating said stored matrix R by a Householder transformation related to said document-attribute submatrices.

10. The information retrieval method according to claim 7 comprising the steps of:

generating a covariance matrix as said predetermined matrix from said document-attribute submatrices; and

retaining a product sum matrix of document vectors (SUM(M)₁), a mean value of document vectors (MEAN (M)₁), a mean product matrix of document vectors (SUM(M)₂) and a total number of documents (M).

11. The information retrieval method according to claim 10 comprising a step of a generating covariance matrix C′

of all a document-attribute matrix including said added submatrices from the following formula;

12. The information retrieval method according to claim 10 further comprising the steps of:

retrieving attributes contained in a document vector automatically and

generating an attribute hash table for adding or deleting said attributes.

13. A program for retrieving documents, said documents being converted into document-attribute matrix and stored within said information retrieval system, and said document-attribute matrix being constituted by document-attribute submatrices added in order with respect to time, said program making a computer execute the steps of:

generating and storing a predetermined type matrix from said document-attribute matrix,

generating said document-attribute submatrix from documents being added to said database during a specific time period,

updating said predetermined type matrix using knowledge with respect to said document-attribute submatrix and for executing the singular value decomposition on updated said predetermined type matrix to execute dimension reduction of all document-attribute matrices stored within said database, and

retrieving information with respect to a user input query using said dimension reduced document-attribute matrix.

14. The program according to claim 13 for making a computer execute a step of executing the QR decomposition of said document-attribute submatrices and using only a matrix R as said predetermined matrix.

15. The program according to claim 14 for making a computer execute a step of updating said stored matrix R by a Householder transformation related to said document-attribute submatrices.

16. The program according to claim 13 for making a computer execute the steps of:

generating a covariance matrix as said predetermined matrix from said document-attribute submatrices, and

retaining a product sum matrix of document svectors (SUM(M)₁), a mean value of document vectors (MEAN (M)₁), a mean product matrix of document vectors (SUM(M)₂) and a total number of documents (M).

17. The program according to claim 16 for making a computer execute a step of generating a covariance matrix C′

of all a document-attribute matrix including said added submatrices from the following formula;

18. The program according to claim 17 for further making a computer execute steps of

retrieving an attribute contained in a document vector automatically;

and

generating an attribute hash table to add or delete said attribute.

19. A storage medium readable by a computer wherein a program for making a computer execute an information retrieval method to retrieve documents, said documents being converted into document-attribute matrix and stored within said information retrieval system, and said document-attribute matrix being constituted by document-attribute submatrices added in order with respect to time, said program making a computer execute said information retrieval method comprising the steps of:

generating and storing a predetermined type matrix from said document-attribute matrix,

generating said document-attribute submatrix from documents being added to said database during a specific time period,

updating said predetermined type matrix using knowledge with respect to said document-attribute submatrix and for executing the singular value decomposition on updated said predetermined type matrix to execute dimension reduction of all document-attribute matrices stored within said database, and

retrieving information with respect to a user input query using said dimension reduced document-attribute matrix.

20. The storage medium according to claim 19 making a computer execute a step of executing the QR decomposition of said document-attribute submatrices and using only a matrix R as said predetermined matrix.

21. The storage medium according to claim 20 making a computer execute a step of updating said stored matrix R by a Householder transformation related to said document-attribute submatrices.

22. The storage medium according to claim 19 making a computer execute a step of generating a covariance matrix as said predetermined matrix from said document-attribute submatrices and retaining a product sum matrix of document vectors (SUM(M)₁) a mean value of document vectors (MEAN(M)₁), a mean product matrix of document vectors (SUM(M)₂) and a total number of documents (M).

23. The storage medium according to claim 22 making a computer execute a step of generating a covariance matrix C′

of all a document-attribute matrix including added said submatrices from the following formula;

24. The storage medium according to claim 22 further making a computer execute the steps of:

retrieving an attribute contained in a document vector, and

generating an attribute hash table to add or delete said attribute.