Systems and methods for intelligent batch processing of business events

• US 9,679,266 B2
• Filed: 02/28/2014
• Issued: 06/13/2017
• Est. Priority Date: 02/28/2014
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Brown, Gary
• Primary Examiner(s): Tang, Kenneth
• Application Number:
  US14/193,279
• Publication Number:
  US 20150248631A1
• Time in Patent Office: 1,201 Days
• Field of Search: None
• CPC Class Codes: G06Q 10/06316 Sequencing of tasks or work

Abstract

Systems and methods are provided for intelligent batch processing of business events. An exemplary method includes accessing a business process having a plurality of events for execution, determining, using one or more hardware processors, a batch group for processing comprising at least one of the plurality of events, wherein the batch group is determined using a time delay for collecting the at least one of the plurality of events to determine the batch group, and submitting the batch group for processing the at least one of the plurality of events. The method may further include processing the batch group as a first transaction. Processing the first transaction may include determining a resource required by the at least one of the plurality of events and attempting to lock the resource for use during the processing the batch group.

Claims

1. A method for batch processing of received business events, the method comprising:

accessing a business process comprising a plurality of events for execution by a system;

determining a processing load for the system based on available processing resources and incoming processing events;

determining a time delay for collecting a first number of business events into a batch group based on the processing load of the system and a second number of the plurality of events received per second;

determining a processing batch size based on the processing load and the time delay;

determining, using one or more hardware processors, the batch group for processing comprising at least a first event of the plurality of events using the processing batch size and the time delay;

determining that a second event of the plurality of events is unavailable for processing using a local resource manager for the second event;

submitting the batch group for processing the at least one of the plurality of events;

processing the second event in at least a second transaction;

establishing a retry timer on the second event, wherein the second event is determined to have failed processing if the processing the second event in the at least the second transaction reaches the retry timer; and

outputting the failure of the second event when the second event is determined to have failed the processing.

2. The method of claim 1, wherein the time delay increases to a set maximum time when the second number of the plurality of events received per second is over a set threshold of events per second.

3. The method of claim 2, wherein the time delay decreases when the second number of the plurality of events received per second is under the set threshold of events per second.

4. The method of claim 1 further comprising:

processing the batch group as a first transaction.

5. The method of claim 4, wherein prior to processing the batch group, the method further comprises:

determining a resource required by the first event of the plurality of events; and

attempting to lock the resource for use during the processing the batch group.

6. The method of claim 5, wherein prior to processing the batch group, the method further comprising:

removing the first event of the plurality of events from the batch group if the resource is not locked for use or the first event fails; and

adding the first event removed from the batch group to the second transaction.

7. The method of claim 6 further comprising:

processing the second transaction comprising the first event and the second event.

8. The method of claim 4, wherein the first transaction is an XA transaction.

9. A system for batch processing of received business events, the system comprising:

a non-transitory memory storing batch processing information for a business process; and

one or more hardware processors in communication with the non-transitory memory and configured to

access the business process comprising a plurality of events for execution by the system;

determine a processing load for the system based on available processing resources and incoming processing events;

determine a time delay for collecting a first number of business events into a batch group based on the processing load of the system and a second number of the plurality of events received per second;

determine a processing batch size based on the processing load and the time delay;

determine the batch group for processing comprising at least a first event of the plurality of events using the processing batch size and the time delay;

determine that a second event of the plurality of events is unavailable for processing using a local resource manager for the second event;

submit the batch group for processing the at least one of the plurality of events;

process the second event in at least a second transaction;

establish a retry timer on the second event, wherein the second event is determined to have failed processing if the processing the second event in the at least the second transaction reaches the retry timer; and

output the failure of the second event when the second event is determined to have failed the processing.

10. The system of claim 9, wherein the time delay increases to a set maximum time when the second number of the plurality of events received per second is over a set threshold of events per second.

11. The system of claim 10, wherein the time delay decreases when the second number of the plurality of events received per second is under the set threshold of events per second.

12. The system of claim 9, wherein the one or more hardware processors is further configured to:

determine a resource required by the first event of the plurality of events; and

attempt to lock the resource for use during the processing the batch group.

13. The system of claim 12, wherein the one or more hardware processors is further configured to:

process the batch group as a first transaction if the resource is locked.

14. The system of claim 13, wherein the one or more hardware processors is further configured to:

remove the first event of the plurality of events from the batch group if the resource is not locked for use or the first event fails; and

add the at least one of the plurality of events removed from the batch group to the second transaction; and

process the second transaction.

15. The system of claim 13, wherein the first transaction is an XA transaction.

16. A non-transitory computer readable medium comprising a plurality of machine-readable instructions which when executed by one or more processors of a server are adapted to cause the server to perform a method comprising:

accessing a business process comprising plurality of events for execution by a system;

determining a processing load for the system based on available processing resources and incoming processing events;

determining a time delay for collecting a first number of business events into a batch group based on the processing load of the system and a second number of the plurality of events received per second;

determining a processing batch size based on the processing load and the time delay;

determining the batch group for processing comprising at least a first event of the plurality of events using the processing batch size and the time delay;

determining that a second event of the plurality of events is unavailable for processing using a local resource manager for the second event;

submitting the batch group for processing the at least one of the plurality of events;

processing the second event in at least a second transaction;

establishing a retry timer on the second event, wherein the second event is determined to have failed processing if the processing the second event in the at least the second transaction reaches the retry timer; and

outputting the failure of the second event when the second event is determined to have failed the processing.

17. The non-transitory computer readable medium of claim 16, wherein the time delay increases to a set maximum time when the second number of the plurality of events received per second is over a set threshold of events per second, and wherein the time delay decreases when the second number of the plurality of events received per second is under the set threshold of events per second.

18. The non-transitory computer readable medium of claim 17, wherein the method further comprises:

determining a resource required by the first event of the plurality of events;

attempting to lock the resource for use during the processing the batch group; and

processing the batch group as a first XA transaction if the resource is locked.