Subject-matter analysis of tabular data

• US 9,607,039 B2
• Filed: 07/18/2013
• Issued: 03/28/2017
• Est. Priority Date: 07/18/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Byron, Donna Karen, Gerard, Scott N., Pikovsky, Alexander, Sanchez, Matthew B.
• Primary Examiner(s): Nguyen, Maikhanh
• Application Number:
  US13/945,259
• Publication Number:
  US 20150026557A1
• Time in Patent Office: 1,349 Days
• Field of Search: 715/227
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/90 Details of database functions independent of the retrieved data types
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/177 of tables; using ruled lines
• CPC Class Codes: G06F 40/18 of spreadsheets form-filling G06F40/174

Abstract

A system, and computer program product for subject-matter analysis of tabular data are provided in the illustrative embodiments. A first document including the tabular data is received. A library of functional signatures for a first subject-matter domain is selected. A determination is made whether a threshold number of functional signatures from the selected library are applicable to the tabular data, wherein a functional signature is applicable to the tabular data when values in the tabular data correspond to an operation and a table structure specified in the functional signature. Responsive to the threshold number of functional signatures from the selected library being applicable to the tabular data, a processor and a memory process the first document according to a process for the first subject matter domain selected from a plurality of processes for respective subject matter domains.

Claims

1. A computer usable program product comprising a non-transitory computer usable storage device including computer usable code for subject-matter analysis of tabular data, the computer usable code comprising:

computer usable code for receiving a first document including the tabular data;

computer usable code for normalizing information specific to the tabular data in the document using references specific to a first subject-matter domain of the tabular data;

computer usable code for selecting a library of functional signatures for the first subject-matter domain, wherein a functional signature in the library of functional signatures for the first subject-matter domain comprises an expression, wherein the expression represents (i) a functional relationship of a first cell and a second cell and (ii) a semantic relationship of the first cell and the second cell, wherein the first cell is a cell in the tabular data, wherein the functional relationship describes a computation between a first value in the first cell and a second value in the second cell, and wherein the semantic relationship describes an organizational relationship between a first identifier associated with the first cell and a second identifier associated with the second cell;

computer usable code for determining whether a threshold number of functional signatures from the selected library are applicable to the tabular data, wherein a functional signature is applicable to the tabular data when values in the tabular data correspond to an operation and a table structure specified in the functional signature; and

computer usable code for processing, according to a process for the first subject matter domain selected from a plurality of processes for respective subject matter domains, using a processor and a memory, the first document responsive to the threshold number of functional signatures from the selected library being applicable to the tabular data,

wherein the first identifier associated with the first cell is a header and the second identifier associated with the second cell is an indentation in a placement of the second cell in the tabular data.

2. The computer usable program product of claim 1, further comprising:

computer usable code for selecting a portion of tabular data in a second document;

computer usable code for analyzing a functional relationship between at least two values in the portion;

computer usable code for representing table-specific information in the functional relationship using generic equivalent information from the first subject-matter domain, forming the functional signature; and

computer usable code for adding the functional signature to a collection of functional signatures corresponding to the second document, forming a first collection.

3. The computer usable program product of claim 2, further comprising:

computer usable code for selecting the first collection and a second collection of functional signatures corresponding to a third document;

computer usable code for clustering those functional signatures from the first and the second collections that are similar to each other within a threshold measure of similarity, forming a cluster of functional signatures; and

computer usable code for adding the cluster of functional signatures to the library of functional signatures.

4. The computer usable program product of claim 2, further comprising:

computer usable code for storing a combination of the table-specific information in the functional relationship and the generic equivalent information from the first subject-matter domain in a knowledge repository corresponding to the first subject-matter domain.

5. The computer usable program product of claim 2, further comprising:

computer usable code for discarding, as being document-specific functional signatures, those functional signatures from the first collection and a second collection of functional signatures that are not similar to each other within the threshold measure of similarity, the second collection of functional signatures corresponding to a third document.

6. The computer usable program product of claim 1, further comprising:

computer usable code for receiving a query to be answered using the first document;

computer usable code for parsing the query using a knowledge repository corresponding to the library of functional signatures for the first subject-matter domain;

computer usable code for selecting a functional signature that fits the query according to the parsing;

computer usable code for extracting data from a portion of the tabular data of the first document where the selected functional signature applies;

computer usable code for responding to the query using the extracted data.

7. The computer usable program product of claim 6, wherein the computer usable code for responding further comprises computer usable code for sending the extracted data to a natural language processing application where the extracted data is formed into a natural language response to the query.

8. The computer usable program product of claim 1, wherein the computer usable code for processing the first document comprises:

computer usable code for classifying the first document as belonging to the first subject-matter domain.

9. The computer usable program product of claim 1, wherein the computer usable code is stored in a computer readable storage device in a data processing system, and wherein the computer usable code is transferred over a network from a remote data processing system.

10. The computer usable program product of claim 1, wherein the computer usable code is stored in a computer readable storage device in a server data processing system, and wherein the computer usable code is downloaded over a network to a remote data processing system for use in a computer readable storage device associated with the remote data processing system.

11. The computer usable program product of claim 1, wherein the second cell is a cell outside the tabular data.

12. The computer usable program product of claim 1, wherein the first identifier associated with the first cell is a header and the second identifier associated with the second cell is a sub-header of the header.

13. The computer usable program product of claim 1, wherein the first cell and the second cell are in different rows of the tabular data.

14. A data processing system for subject-matter analysis of tabular data, the data processing system comprising:

a storage device including a storage medium, wherein the storage device stores computer usable program code; and

a processor, wherein the processor executes the computer usable program code, and wherein the computer usable program code comprises;

computer usable code for receiving a first document including the tabular data;

computer usable code for normalizing information specific to the tabular data in the document using references specific to a first subject-matter domain of the tabular data;

computer usable code for selecting a library of functional signatures for the first subject-matter domain, wherein a functional signature in the library of functional signatures for the first subject-matter domain comprises an expression, wherein the expression represents (i) a functional relationship of a first cell and a second cell and (ii) a semantic relationship of the first cell and the second cell, wherein the first cell is a cell in the tabular data, wherein the functional relationship describes a computation between a first value in the first cell and a second value in the second cell, and wherein the semantic relationship describes an organizational relationship between a first identifier associated with the first cell and a second identifier associated with the second cell;

computer usable code for determining whether a threshold number of functional signatures from the selected library are applicable to the tabular data, wherein a functional signature is applicable to the tabular data when values in the tabular data correspond to an operation and a table structure specified in the functional signature; and

computer usable code for processing, according to a process for the first subject matter domain selected from a plurality of processes for respective subject matter domains, using a processor and a memory, the first document responsive to the threshold number of functional signatures from the selected library being applicable to the tabular data,

wherein the first identifier associated with the first cell is a header and the second identifier associated with the second cell is an indentation in a placement of the second cell in the tabular data.