System for judging an execution status of batch processing, and based on judgement result to send post-update data to terminal device

• US 8,595,728 B2
• Filed: 02/26/2010
• Issued: 11/26/2013
• Est. Priority Date: 08/10/2009
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Hamada, Shinsuke, Hara, Norihiro, Tahara, Yasuhiro
• Primary Examiner(s): An, Meng
• Assistant Examiner(s): GHAFFARI, ABU Z
• Application Number:
  US12/714,243
• Publication Number:
  US 20110035748A1
• Time in Patent Office: 1,369 Days
• Field of Search: 718/101, 718/106, 711/162, 714/6.3, 707/999.201, 707/999.204, 707/999.003
• US Class Current: 718/101
• CPC Class Codes: G06F 9/52 Program synchronisation; Mutual exclusion, e.g. by means of semaphores

Abstract

An execution system executes an update batch according to an update batch execution request from a terminal device and gives a batch execution command to each standby system. Each system stores the content of updated data in its update buffer; and subject to termination of the update batch by each system, the post-update data content is reflected in a database. While the above processing is performed, the execution system and the standby systems accept a reference request from the terminal device; and in a case of “batch not executed” or “batch in execution”, each system searches the database and then returns the pre-update data content to the terminal device; and in a case of “update content being reflected”, each system searches the database or the update buffer and then returns the post-update data content to the terminal device.

Claims

1. A data processing method for a plurality of units, each unit including a storage device having at least a first storage unit and a second storage unit as a plurality of storage units configured to store data, and a data processing apparatus configured to process the data in the storage units,

wherein the data processing apparatus belonging to at least one unit from among the plurality of units is configured to execute a first batch execution step of executing batch processing requiring an update on the data in the first storage device when receiving a batch execution request from a terminal device, which is configured to make the request for the processing;

and

wherein the data processing apparatus belonging to each unit executes;

a first storage step of storing post-update data, which are obtained as a result of the update in the first batch execution step, in the second storage unit for each storage device;

a first reflection step of, subject to completion of the processing for storing the post-update data in the second storage unit for each storage device, starting reflecting the post-update data, which have been stored in the second storage unit for each storage device, in the first storage unit for each storage device, thereby executing reflection;

a first judgment step of judging an execution status of the batch processing based on statuses of the post-update data stored and reflected in the first storage unit and the second storage unit in the first batch execution step when receiving a reference request from the terminal device after the batch execution request; and

a first transmission step of sending a corresponding content of the first storage unit for each storage device or a corresponding content of the second storage unit for each storage device as a reference result to the terminal device in accordance with a judgment result of the first judgment step;

wherein in the first judgment step, the data processing apparatus is configured to judge whether processing for storing the post-update data in the second storage unit for each storage device has been completed or not;

wherein when an affirmative judgment result is returned in the first judgment step, the data processing apparatus is configured to send the post-update data as the corresponding content of the second storage unit for each storage device to the terminal device in the first transmission step; and

wherein when a negative judgment result is returned in the first judgment step, the data processing apparatus is configured to send data before the update by the batch processing as the corresponding content of the first storage unit for each storage device to the terminal device in the first judgment step.

2. The data processing method according to claim 1, wherein in the first batch execution step, the data processing apparatus which has executed the batch processing from among the plurality of the data processing apparatuses, is configured to transfer the post-update data, which are obtained as a result of the update by the hatch processing, to the data processing apparatus which has not executed the batch processing;

and

wherein in the first storage step, when receiving the post-update data transferred from the data processing apparatus which has executed the batch processing, the data processing apparatus which has not executed the batch processing is configured to store the received post-update data in the second storage unit for the storage device belonging to the same unit as the data processing apparatus which has not executed the hatch processing.

3. The data processing method according to claim 1, wherein the data processing apparatus individually is configured to execute the hatch processing in the first hatch execution step;

and

the data processing apparatus is configured to store the post-update data, which are obtained as a result of the update by the batch processing individually executed, in the second storage unit for each storage device in the first storage step.

4. The data processing method according to claim 1, wherein the data processing apparatus is configured to execute a second storage step of storing the result of processing in the first storage step and the first reflection step as data indicating an execution status of the batch processing, in a third storage unit for each storage device;

and

wherein in the first judgment step, the data processing apparatus is configured to refer to the third storage unit for each storage device and to judge the execution status of the batch processing.

5. The data processing method according to claim 1, where in the first judgment step, the data processing apparatus is configured to judge whether processing for reflecting the post-update data in the first storage unit for each storage device has been completed or not, as processing after storing the post-update data, which are obtained as a result of the update by the batch processing, in the second storage unit for each storage device;

wherein when an affirmative judgment is returned in the first judgment step that the processing for reflecting the post-update data has been completed, the data processing apparatus is configured to send the post-update data as the corresponding content of the first storage unit or the second storage unit for each storage device to the terminal device in the first transmission step; and

wherein when a negative judgment is returned in the first judgment step that the processing for reflecting the post-update data in the first storage unit for each storage device has not been completed, the data processing apparatus is configured to send the post-update data as the corresponding content of the second storage unit for each storage device to the terminal device.

6. The data processing method according to claim 1, wherein on condition that the post-update data are stored in the second storage unit for each storage device, the data processing apparatus is configured to store data indicating that the relevant data have been updated, as a status of the update required by the batch processing, in the first storage unit for each storage device in the first storage step;

wherein prior to judgment of an execution status of the batch processing in the first judgment step, the data processing apparatus is configured to judge whether or not the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device; and

when an affirmative judgment result is returned that the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device, the data processing apparatus is configured to judge whether processing for storing the post-update data in the second storage unit for each storage device has been completed or not; and

wherein when an affirmative judgment is returned in the first judgment step that the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device, and the processing for storing the post-update data in the second storage unit for each storage device has been completed, the data processing apparatus is configured to send the post-update data as the corresponding content of the second storage unit for each storage device to the terminal device in the first transmission step; and

wherein when a negative judgment is returned in the first judgment step that the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are not stored in the first storage unit for each storage device, or that the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device, but the processing for storing the post-update data in the second storage unit for each storage device has not been completed, the data processing apparatus is configured to send data before the update by the batch processing as the corresponding content of the first storage unit for each storage device, to the terminal device.

7. The data processing method according to claim 1, wherein on condition that the post-update are stored in the second storage unit for each storage device, the data processing apparatus is configured to store data indicating that the relevant data have been updated, as a status of the required by the batch processing, in the first storage unit for each storage device in the first storage step;

wherein prior to judgment of an execution status of the batch processing in the first judgment step, the data processing apparatus is configured to judge whether or not the batch execution request requires that the reference results obtained from all the data processing apparatuses be made identical to each other; and

when an affirmative result is obtained for the above judgment that the batch execution request requires that the reference results obtained from all the data processing apparatuses be made identical to each other, the data processing apparatus is configured to judge whether or not the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device; and

when an affirmative result is obtained for the above judgment that the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device, the data processing apparatus is configured to judge whether processing for storing the post-update data in the second storage unit for each storage device has been completed or not; and

wherein when an affirmative judgment is returned in the first judgment step that the batch execution request requires that the reference results obtained from all the data processing apparatuses be made identical to each other, and the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device, and the processing for storing the post-update data in the second storage unit for each storage device has been completed, the data processing apparatus is configured to send the post-update data as the corresponding content of the second storage unit for each storage device to the terminal device in the first transmission step; and

wherein when a negative judgment is returned in the first judgment step that the batch execution request does not require that the reference results obtained from all the data processing apparatuses be made identical to each other, or that the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are not stored in the first storage unit for each storage device, or that the data indicating that the relevant data have been updated, as the status of the update required by the batch processing, are stored in the first storage unit for each storage device, but the processing for storing the post-update data in the second storage unit for each storage device has not been completed, the data processing apparatus is configured to send data before the update by the batch processing as the corresponding content of the first storage unit for each storage device, to the terminal device.

8. A non-transitory computer readable medium storing therein a program, which, when executed, causes a data processing apparatus of one of a plurality of storage devices to execute a data process method, wherein the data processing apparatus comprises a computer and at least one of the storage devices has a first storage unit and a second storage unit, the method comprising:

as a step executed by the data processing apparatus of a plurality of apparatuses of the respective plurality of storage devices, a first batch execution step of executing batch processing requiring an update on data in the first storage device when receiving a batch execution request from a terminal device configured to make the request for the processing; and

as steps executed by the data processing apparatus,

a first storage step of storing post-update data, which are obtained as a result of the update in the first batch execution step, in the second storage unit for each storage device;

a first reflection step of, subject to completion of the processing for storing the post-update data in the second storage unit for each storage device, starting reflecting the post-update data, which have been stored in the second storage unit for each storage device, in the first storage unit for each storage device, thereby executing reflection;

a first judgment step of judging an execution status of the batch processing based on statuses of the post-update data stored and reflected in the first storage unit and the second storage unit in the first batch execution step when receiving a reference request from the terminal device after the batch execution request; and

a first transmission step of sending a corresponding content of the first storage unit for each storage device or a corresponding content of the second storage unit for each storage device as a reference result to the terminal device in accordance with a judgment result of the first judgment step;

wherein in the first judgment step, the data processing apparatus is configured to judge whether processing for storing the post-update data in the second storage unit for each storage device has been completed or not;

wherein when an affirmative judgment result is returned in the first judgment step, the data processing apparatus is configured to send the post-update data as the corresponding content of the second storage unit for each storage device to the terminal device in the first transmission step; and

wherein when a negative judgment result is returned in the first judgment step, the data processing apparatus is configured to send data before the update by the batch processing as the corresponding content of the first storage unit for each storage device to the terminal device in the first judgment step.

9. A data processing system comprising at least one computer comprising a plurality of units, each unit including a storage device having at least a first storage unit and a second storage unit as a plurality of storage units configured to store data, and a data processing apparatus configured to process the data in the storage units,

wherein the data processing apparatus belonging to at least one unit from among the plurality of units includes a batch execution control unit configured to generate and output a command relating to batch processing when receiving a batch execution request from a terminal device configured to make the request for the processing;

wherein the data processing apparatus belonging to each unit includes;

a data update unit configured to execute processing on each storage device in accordance with a command from the batch execution control unit and to notify the batch execution control unit of a result of the processing on each storage unit; and

a data reference unit, when receiving a reference request from the terminal device, configured to refer to each storage device in accordance with the reference request and to send the reference result to the terminal device;

wherein when receiving the batch execution request from the terminal device, the batch execution control unit is configured to give a batch execution start command to each data update unit; and

subject to reception of batch execution completion notice from all the data update units, the batch execution control unit is configured to give an update content reflection command to each data update unit; and

subject to reception of update content reflection completion notice from all the data update units, the batch execution control unit is configured to give a batch termination command to each data update unit;

wherein at least one data update unit, from among the data update units which have received the batch execution start command from the batch execution control unit, is configured to execute batch processing on the data in the storage devices;

wherein when receiving the batch execution start command from the batch execution control unit, the data update unit is configured to store post-update data, which are obtained as a result of the update by the batch processing, in the second storage unit for each storage device and to notify the batch execution control unit of completion of the batch execution;

when receiving the update content reflection command from the batch execution control unit, the data update unit is configured to reflect the post-update data, which are stored in the second storage unit for each storage device, in the first storage unit for each storage device and to notify the batch execution control unit of completion of the update content reflection; and

the data update unit is configured to store data indicating an execution status of the batch processing in a third storage unit for each storage device in association with processing on the first storage unit or the second storage unit for each storage device; and

wherein when receiving the reference request from the terminal device, the data reference unit is configured to refer to the third storage unit for each storage device, to judge the execution status of the batch processing based on statuses of the post-update data stored and reflected in the first storage unit and the second storage unit, and to send a corresponding content of the first storage unit for each storage device or a corresponding content of the second storage unit for each storage device as a reference result to the terminal device;

wherein the data reference unit is configured to refer to the third storage unit for each storage device and to judge whether or not data indicating that the post-update data are in a state before being reflected in the first storage unit for each storage device and the post-update data are stored in the second storage unit for each storage device, exist in the third storage unit;

when an affirmative result is obtained for the above judgment, the data reference unit is configured to send the post-update data as the corresponding content of the second storage unit for each storage device to the terminal device;

when a negative result is obtained for the above judgment, the data reference unit is configured to send data before the update by the batch processing as the corresponding content of the first storage unit for each storage device to the terminal device.

10. The data processing system according to claim 9, wherein the data update unit which has executed the batch processing, from among the plurality of the data update units, is configured to transfer the post-update data, which are obtained as a result of the update by the batch processing, to the data update unit which has not executed the batch processing;

and

wherein when receiving the post-update data transferred from the data update unit which has executed the batch processing, the data update unit which has not executed the batch processing is configured to store the received post-update data in the second storage unit storage device.

11. The data processing system according to claim 9, wherein the data update unit is configured to execute the batch processing individually;

and

the data update unit is configured to store the post-update data, which are obtained as a result of the update by the batch processing individually executed, in the second storage unit for each storage device.

12. The data processing system according to claim 9, wherein the data reference unit is configured to refer to the third storage unit for each storage device and to judge whether or not data indicating that the post-update data are in a state after being stored in the second storage unit for each storage device and the post-update data are reflected in the first storage unit for each storage device, exist in the third storage unit;

when an affirmative result is obtained for the above judgment, the data reference unit is configured to send the post-update data as the corresponding content of the first storage unit or the second storage unit for each storage device to the terminal device;

when a negative result is obtained for the above judgment, the data reference unit is configured to send the post-update data as the corresponding content of the second storage unit for each storage device to the terminal device.

13. The data processing system according to claim 9, wherein the first storage unit for each storage device comprises a database.

14. The data processing system according to claim 9, wherein the first storage unit for each storage device comprises a memory database.