Replaying processing of a restarted application

• US 9,858,151 B1
• Filed: 10/03/2016
• Issued: 01/02/2018
• Est. Priority Date: 10/03/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dillenberger, Donna N., Frank, David C., Menendez, Terri A., Puchkoff, Gary S., Rhoten, Wayne E.
• Primary Examiner(s): TRUONG, LOAN
• Application Number:
  US15/284,409
• Time in Patent Office: 456 Days
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: G06F 2201/805 Real-time
• CPC Class Codes: G06F 2201/82 Solving problems relating to consistency ensuring consistency in mirrored systems G06F11/2064
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A computer-implemented method according to one embodiment includes establishing a predetermined checkpoint and storing duplicate read data in association with the predetermined checkpoint during a running of an application that is processing at least one data set, identifying a failure of the application, restarting the application in response to the failure, and enabling a replay of the processing of the at least one data set by the restarted application, utilizing the predetermined checkpoint and the duplicate read data.

Claims

1. A computer-implemented method, comprising:

establishing a predetermined checkpoint and storing a log of duplicate read data in association with the predetermined checkpoint during a running of an application that is processing at least one data set, the duplicate read data including an image of all data retrieved from the at least one data set in response to a plurality of data reads made by the application before the predetermined checkpoint;

identifying a first failure of the application;

restarting the application and performing a first replay of the application in response to the first failure;

identifying a second failure of the application during the first replay; and

restarting the application and performing a second replay of the application, utilizing the predetermined checkpoint and the log of duplicate read data, where the second failure of the application results in stale read data within the log that is skipped over, utilizing a filter.

2. The computer-implemented method of claim 1, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying a first plurality of data reads from the restarted application that occur before the predetermined checkpoint.

3. The computer-implemented method of claim 2, wherein performing the first replay of the processing of the at least one data set by the restarted application includes retrieving the duplicate read data, and returning the duplicate read data to the restarted application, in response to the first plurality of data reads.

4. The computer-implemented method of claim 3, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying a first plurality of data writes from the application, where the first plurality of data writes are associated with the duplicate read data.

5. The computer-implemented method of claim 4, wherein performing the first replay of the processing of the at least one data set by the restarted application includes discarding the first plurality of data writes.

6. The computer-implemented method of claim 1, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying a second plurality of data reads from the restarted application that occur after the predetermined checkpoint.

7. The computer-implemented method of claim 6, wherein performing the first replay of the processing of the at least one data set by the restarted application includes retrieving data from the at least one data set, and returning the data from the at least one data set to the restarted application, in response to the second plurality of data reads.

8. The computer-implemented method of claim 7, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying a second plurality of data writes from the restarted application, where the second plurality of data writes are associated with data of the at least one data set.

9. The computer-implemented method of claim 8, wherein performing the first replay of the processing of the at least one data set by the restarted application includes writing the second plurality of data writes to the at least one data set.

10. The computer-implemented method of claim 1, wherein the application holds a lock on a portion of the at least one data set during the processing of the portion of the at least one data set.

11. The computer-implemented method of claim 10, wherein performing the first replay of the application includes:

identifying a first plurality of data reads from the restarted application that occur before the predetermined checkpoint;

returning the duplicate read data to the restarted application, in response to the first plurality of data reads;

identifying a first plurality of data writes from the application, where the first plurality of data writes include writes made by the application before the predetermined checkpoint;

discarding the first plurality of data writes by writing the first plurality of data writes to a null device;

identifying a second plurality of data reads from the restarted application that occur after the predetermined checkpoint but before the first failure of the application, where the second plurality of data reads have been undone after the first failure of the application;

retrieving data from the at least one data set in response to the second plurality of data reads;

returning the data from the at least one data set to the restarted application, in response to the second plurality of data reads;

identifying a second plurality of data writes from the restarted application, where the second plurality of data writes are associated with the data from the at least one data set; and

writing the second plurality of data writes to the at least one data set.

12. A computer program product for enabling a replay of a processing of at least one data set by a restarted application, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:

establishing, utilizing the processor, a predetermined checkpoint and storing, utilizing the processor, a log of duplicate read data in association with the predetermined checkpoint during a running of an application that is processing at least one data set, the duplicate read data including an image of all data retrieved from the at least one data set in response to a plurality of data reads made by the application before the predetermined checkpoint;

identifying, utilizing the processor, a first failure of the application;

restarting, utilizing the processor, the application and performing a first replay of the application in response to the first failure;

identifying, utilizing the processor, a second failure of the application during the first replay; and

restarting the application, utilizing the processor, and performing a second replay of the application, utilizing the predetermined checkpoint and the log of duplicate read data, where the second failure of the application results in stale read data within the log that is skipped over, utilizing a filter.

13. The computer program product of claim 12, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying, utilizing the processor, a first plurality of data reads from the restarted application that occur before the predetermined checkpoint.

14. The computer program product of claim 13, wherein performing the first replay of the processing of the at least one data set by the restarted application includes retrieving, utilizing the processor, the duplicate read data, and returning the duplicate read data to the restarted application, in response to the first plurality of data reads.

15. The computer program product of claim 14, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying, utilizing the processor, a first plurality of data writes from the application, where the first plurality of data writes are associated with the duplicate read data.

16. The computer program product of claim 15, wherein performing the first replay of the processing of the at least one data set by the restarted application includes discarding, utilizing the processor, the first plurality of data writes.

17. The computer program product of claim 12, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying, utilizing the processor, a second plurality of data reads from the restarted application that occur after the predetermined checkpoint.

18. The computer program product of claim 17, wherein performing the first replay of the processing of the at least one data set by the restarted application includes retrieving data from the at least one data set, utilizing the processor, and returning, utilizing the processor, data from the at least one data set to the restarted application, in response to the second plurality of data reads.

19. The computer program product of claim 18, wherein performing the first replay of the processing of the at least one data set by the restarted application includes identifying, utilizing the processor, a second plurality of data writes from the restarted application, where the second plurality of data writes are associated with data of the at least one data set.

20. The computer program product of claim 19, wherein performing the first replay of the processing of the at least one data set by the restarted application includes writing, utilizing the processor, the second plurality of data writes to the at least one data set.

21. The computer program product of claim 12, wherein the application holds a lock on a portion of the at least one data set during the processing of the portion of the at least one data set, utilizing the processor.

22. The computer program product of claim 21, wherein performing the first replay of the application includes:

identifying a first plurality of data reads from the restarted application that occur before the predetermined checkpoint;

returning the duplicate read data to the restarted application, in response to the first plurality of data reads;

identifying a first plurality of data writes from the application, where the first plurality of data writes include writes made by the application before the predetermined checkpoint;

discarding the first plurality of data writes by writing the first plurality of data writes to a null device;

identifying a second plurality of data reads from the restarted application that occur after the predetermined checkpoint but before the first failure of the application, where the second plurality of data reads have been undone after the first failure of the application;

retrieving data from the at least one data set in response to the second plurality of data reads;

returning the data from the at least one data set to the restarted application, in response to the second plurality of data reads;

identifying a second plurality of data writes from the restarted application, where the second plurality of data writes are associated with the data from the at least one data set; and

writing the second plurality of data writes to the at least one data set, utilizing the processor.

23. A system, comprising:

a processor; and

logic integrated with the processor, executable by the processor, or integrated with and executable by the processor, the logic being configured to;

establish a predetermined checkpoint and storing a log of duplicate read data in association with the predetermined checkpoint during a running of an application that is processing at least one data set, the duplicate read data including an image of all data retrieved from the at least one data set in response to a plurality of data reads made by the application before the predetermined checkpoint;

identify a first failure of the application;

restart the application and perform a first replay of the application in response to the first failure;

identify a second failure of the application during the first replay; and

restart the application and perform a second replay of the application, utilizing the predetermined checkpoint and the log of duplicate read data, where the second failure of the application results in stale read data within the log that is skipped over, utilizing a filter.

24. A computer-implemented method, comprising:

identifying a first failure of an application, where the application is processing at least one data set at a first partition of a system;

restarting the application at a second partition of the system in response to the first failure;

identifying a first plurality of data reads from the restarted application at the second partition of the system, where the first plurality of data reads occur before a predetermined checkpoint;

in response to the first plurality of data reads, retrieving logged data from the first partition of the system and returned the logged data to the restarted application at the second partition of the system;

performing a first replay of the application at the second partition of the system in response to the first failure;

identifying a second failure of the application during the first replay; and

restarting the application and performing a second replay of the application, utilizing the predetermined checkpoint and the logged data, where the second failure of the application results in stale read data within the logged data that is skipped over, utilizing a filter.