Three-dimensional latent semantic analysis

• US 9,734,144 B2
• Filed: 09/18/2014
• Issued: 08/15/2017
• Est. Priority Date: 09/18/2014
• Status: Expired due to Fees

• Current Assignee: Streamline Licensing LLC (IP Edge LLC)
• Original Assignee: Empire Technology Development LLC (Allied Inventors Management, LLC)
• Inventors: Dasc{hacek over (a)}lu, Mihai, Ash, David Walter
• Primary Examiner(s): SPOONER, LAMONT M
• Application Number:
  US14/891,810
• Publication Number:
  US 20160283467A1
• Time in Patent Office: 1,062 Days
• Field of Search: 704 1, 704 9, 704 10
• CPC Class Codes: G06F 16/148 File search processing
• CPC Class Codes: G06F 16/3344 using natural language analysis
• CPC Class Codes: G06F 40/30 Semantic analysis

Abstract

In some examples, a computing system may access multiple information files, generate term-passage matrix data based on the multiple information files, and decompose the term-passage matrix data to generate a reduced-dimensional semantic space, which may be used for information retrieval.

Claims

1. A method, comprising:

accessing, by one or more processors, a plurality of information files;

generating, by the one or more processors, term-passage matrix data based on the plurality of information files;

decomposing the term-passage matrix data to generate a reduced-dimensional semantic space,

wherein a number of rows of the term-passage matrix data corresponds to a sum of a number of distinct words in the plurality of information files and a number of distinct word pairs in the plurality of information files,

wherein a number of columns of the term-passage matrix data corresponds to a number of passages in the plurality of information files, and

wherein the term-passage matrix data indicates a frequency of occurrence of each individual word of the distinct words in the plurality of information files and a frequency of occurrence of each individual word pair of the distinct word pairs in the plurality of information files;

responsive to a query, determining a pseudo object associated with the query in the reduced-dimensional semantic space;

examining one or more similarities between the pseudo object and words in the plurality of information files in the reduced-dimensional semantic space; and

determining a passage from the plurality of information files based on the one or more similarities.

2. The method of claim 1, wherein a semantic distance of an individual word pair of the distinct word pairs is selected based on a particular condition associated with computational complexity of decomposition of the term-passage matrix data.

3. The method of claim 1, wherein an individual word pair of the distinct word pairs is a non-consecutive word pair.

4. The method of claim 1, wherein the decomposing comprises decomposing using a singular value decomposition (SVD) approach.

5. The method of claim 4, further comprising:

determining the number of the distinct word pairs based on an application of an algorithm associated with the SVD approach using each value of 1, 2¹, 2², . . . 2ⁱ in turn such that the algorithm produces a set of eigenvalues that comprises a previous set of eigenvalues to a particular extent, wherein i is a non-zero integer.

6. The method of claim 5, wherein the algorithm comprises an algorithm associated with an iterative method or an eigenvalue algorithm.

7. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions executable by one or more processors to perform operations comprising:

generating term-passage matrix data to represent a plurality of information files, wherein the term-passage matrix data indicates a frequency of occurrence of each individual word of a plurality of distinct words in the plurality of information files and further indicates a frequency of occurrence of each individual word combination of a plurality of distinct word combinations in the plurality of information files;

decomposing the term-passage matrix data to generate a reduced-dimensional semantic space;

in response to a query, determining a pseudo object associated with the query in the reduced-dimensional semantic space;

examining one or more similarities between the pseudo object and words in the plurality of the information files in the reduced-dimensional semantic space; and

determining a passage from the plurality of information files based on the one or more similarities.

8. The non-transitory computer-readable storage medium of claim 7, wherein a number of rows of the term-passage matrix data corresponds to a sum of a number of the plurality distinct words in the plurality of information files and a number of the plurality of distinct word combinations in the plurality of information files, and wherein a number of columns of the term-passage matrix data corresponds to a number of passages in the plurality of information files.

9. The non-transitory computer-readable storage medium of claim 7, wherein the plurality of distinct word combinations comprises a plurality of distinct word pairs.

10. The non-transitory computer-readable storage medium of claim 7, further comprising:

responsive to the query, translating the query into a vector representation using the reduced-dimensional semantic space; and

comparing the vector representation of the query and vector representation of one or more passages in the plurality of information files in the reduced-dimensional semantic space.

11. The non-transitory computer-readable storage medium of claim 7, further comprising at least partially causing at least one of:

a summarization of the plurality of information files using the reduced-dimensional semantic space, a document comparison between a file and the plurality of information files using the reduced-dimensional semantic space, or a domain specific search using the reduced-dimensional semantic space.

12. An apparatus, comprising:

one or more processors; and

a memory configured to store a plurality of components executable by the one or more processors, the plurality of components comprising;

an information accessing module configured to access a plurality of information files;

a latent semantic analysis (LSA) module configured to;

generate term-passage matrix data based on the plurality of information files, wherein a number of rows of the term-passage matrix data corresponds to a sum of a number of distinct words in the plurality of information files and a number of distinct word pairs in the plurality of information files, wherein a number of columns of the term-passage matrix data corresponds to a number of passages in the plurality of information files, and wherein the term-passage matrix data indicates a frequency of occurrence of each individual word of the distinct words in the plurality of information files and a frequency of occurrence of each individual word pair of the distinct word pairs in the plurality of information files; and

generate a reduced-dimensional semantic space based on the term-passage matrix data; and

an information retrieval module configured to;

responsive to a query, determine a pseudo object associated with the query in the reduced-dimensional semantic space;

examine one or more similarities between the pseudo object and words in the plurality of information files in the reduced-dimensional semantic space; and

determine a passage in the plurality of information files based on the one or more similarities.

13. The apparatus of claim 12, wherein the LSA module is further configured to generate the reduced-dimensional semantic space based on the term-passage matrix data by decomposition of the term-passage matrix data to generate the reduced-dimensional semantic space by use of a singular value decomposition (SVD) approach.

14. The apparatus of claim 13, wherein the LSA module is further configured to determine the number of distinct word pairs based on an application of an algorithm associated with the SVD approach by use of each value of 1, 2¹, 2², . . . 2ⁱ in turn such that the algorithm produces a set of eigenvalues that comprises a previous set of eigenvalues to a particular extent, and wherein i is a non-zero integer.

15. The apparatus of claim 12, wherein a semantic distance of an individual word pair of the distinct word pairs is selected based on a particular condition associated with computational complexity of decomposition of the term-passage matrix data.

16. The apparatus of claim 12, wherein the plurality of components further comprises at least one of:

a summarizing module configured to at least partially cause a summarization of the plurality of information files by use of the reduced-dimensional semantic space, a document comparing module configured to at least partially cause a document comparison between a file and the plurality of information files by use of the reduced-dimensional semantic space, or a domain searching module configured to at least partially cause a domain specific search by use of the reduced-dimensional semantic space.