QUERY REWRITES FOR DATA-INTENSIVE APPLICATIONS IN PRESENCE OF RUN-TIME ERRORS

• US 20140281746A1
• Filed: 03/15/2013
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ercegovac, Vuk, Kanne, Carl-Christian
• Granted Patent: US 9,292,373 B2
• Time in Patent Office: Days
• US Class Current: 714/48
• CPC Class Codes: G06F 11/0727 in a storage system, e.g. in a DASD or network based storage system drivers for digital recording or reproducing units G06F3/06; circuits for error detection or correction within digital recording or reproducing units G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/0751 Error or fault detection not based on redundancy power supply failures G06F1/30; network fault management H04L41/06
• CPC Class Codes: G06F 11/0766 Error or fault reporting or storing
• CPC Class Codes: G06F 11/0775 Content or structure details of the error report, e.g. specific table structure, specific error fields
• CPC Class Codes: G06F 11/0778 Dumping, i.e. gathering error/state information after a fault for later diagnosis
• CPC Class Codes: G06F 11/079 Root cause analysis, i.e. error or fault diagnosis in a hardware test environment G06F11/22; in a software test environment G06F11/36
• CPC Class Codes: G06F 11/0793 Remedial or corrective actions recovery from an exception in an instruction pipeline G06F9/3861; by retry G06F11/1402; for recovering from a failure of a protocol instance or entity H04L69/40
• CPC Class Codes: G06F 16/156 Query results presentation
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 8/00 Arrangements for software engineering testing or debugging G06F11/36; administrative, planning or organisation aspects of software project management G06Q10/06

Abstract

Embodiments relate to a method and computer program product for error handling. The method includes performing at least one query operation. The processing of query operation also includes generating error information data based at least an error encountered during performance of the query operation and generating a data result relating to any portion of the query operation successfully completed. The data result is processed together with the error information data based on encountering any errors. The data result and error information are provided together in a package but separated by an indicator to distinguish between them.

Claims

1. A method comprising:

performing at least one query operation;

generating error information data based on at least an error encountered during performance of said query operation;

generating a data result relating to any portion of said query operation that has successfully completed; and

processing said data result together with any of said error information data based on encountering said error, said data result and said error information data being separated by an indicator to distinguish between them.

2. The method of claim 1, wherein said query operation performance continues after encountering said error and said query operation is performed using declarative reasoning.

3. The method of claim 2, wherein said data result includes information and data generated before and after encountering said error and in performance of said query operation;

said data result omitting data deemed affected due to encountering said error.

4. The method of claim 3, wherein said error is a nondeterministic error.

5. The method of claim 1, wherein said query operation is performed responsive to receiving a command request.

6. The method of claim 5, wherein a plurality of query operations are performed responsive to one or more command requests.

7. The method of claim 6, wherein said query operations are performed in parallel to one another.

8. The method of claim 7, wherein individual data packages are generated for each query operation including separate data result and error information based upon encountering one or more errors.

9. The method of claim 3, wherein an iterator is used to extract error information from other data received;

said other data being included in said data result.

10. The method of claim 9, wherein an operator is used to generate result of said query operation.

11. The method of claim 10, wherein occurrence of error encountered by an operator causes the return of an error container instead of other regular data portion included in said data result.

12. The method of claim 11, wherein said query operation uses declarative logic.

13. The method of claim 12, wherein said iterator implements an operator that extracts partial results from one or more error containers.

14. The method of claim 13, wherein said φ

operator extracts partial results from said error container(s) by consuming its input and passing through any non-error values as output.

15. A computer program product for error, the computer program product comprising a computer readable storage medium having computer readable program code embodied therewith, said computer readable program code being executable by a processor to:

perform at least one query operation;

generate error information data based at least an error encountered during performance of said query operation;

generate a data result relating to any portion of said query operation that has successfully completed;

process said data result together with said error information data based on encountering said error, said data result and said error information data being separated by an indicator to distinguish between them.

16. The program product of claim 15, wherein an error type is identified upon encountering said error.

17. The program product of claim 16, wherein said query operation performance continues after encountering said error and said data result includes all performable tasks relating to completing said query operation not relating to said error.

18-19. -19. (canceled)

20. A system comprising:

a parsing block for pre-processing of a document indexing application;

a filtering block for discarding irrelevant documents;

a transformation block to clean up and annotate input data by identifying at least one document language;

a processor configured for grouping inputs to collect documents for a same entity in a single spot;

said processor processing a query operation a data package including a data result component;

said data result component including data generated based on successful completion of at least a portion of said query operation;

said data package also including an error information data component based on one or more errors encountered during processing of said query operation;

an indicator to separate said error information data from said data result; and

a memory associated with a distributed file system for storing a final write output Relating to said query operation.