System and method for supporting a sliding window for testing an event processing system

• US 9,892,009 B2
• Filed: 02/09/2015
• Issued: 02/13/2018
• Est. Priority Date: 06/04/2008
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: He, Guan Nan, Xi, Ying
• Primary Examiner(s): McCarthy, Christopher
• Application Number:
  US14/617,528
• Publication Number:
  US 20150278059A1
• Time in Patent Office: 1,100 Days
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
• CPC Class Codes: G06F 11/273 Tester hardware, i.e. output processing circuits G06F11/263 takes precedence
• CPC Class Codes: G06F 11/277 with comparison between actual response and known fault-free response

Abstract

Systems and methods can use a testing framework for testing an event processing system. The testing framework operates to apply a sliding window on a stream of input events that are sent to an event processing system, wherein said event processing system processes the stream of input events in a batch mode with one or more sliding cycles, and wherein said sliding window includes one or more input events in a sliding cycle that correspond to a plurality of expected output events. Furthermore, the testing framework can receive a plurality of actual output events at an end of said sliding cycle in the batch mode from the event processing system, and uses said one or more expected output events to verify said one or more actual output events.

Claims

1. A method for testing an event processing system, comprising:

declaring input data, output data, and a processing rule for a test in a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;

associating each input event of a stream of input events with a time stamp;

associating each of one or more expected output events with a shared timestamp;

sending the stream of input events to an event processing system;

applying a sliding window on the stream of input events that are sent to the event processing system;

processing, with said event processing system, the stream of input events in a batch mode with one or more sliding cycles, wherein said sliding window includes one or more input events from the stream of input events in a sliding cycle that corresponds to the one or more expected output events;

receiving one or more actual output events at an end of said sliding cycle in the batch mode from the event processing system, each of the one or more actual output events associated with a timestamp; and

using said one or more expected output events to verify said one or more actual output events, including;

verifying whether the timestamp associated with each said actual output event matches the shared timestamp associated with said one or more expected output events in the sliding window, and

determining that an assert fails when at least one timestamp associated with said one or more actual output events does not match the shared timestamp associated with said one or more expected output events in the sliding window.

2. The method of claim 1, wherein the test file is an XML file, and wherein the test schema is an XML schema.

3. The method of claim 1, further comprising:

defining the assert in an element of the test file.

4. The method of claim 3, further comprising:

defining the input events and the one or more expected output events within the assert.

5. The method of claim 4, wherein said one or more actual output events are received from the event processing system in different orders.

6. The method of claim 4, further comprising:

throwing an exception to indicate a failed test, the exception including details of the failure.

7. The method of claim 6, further comprising:

applying a tolerance on the shared timestamp.

8. The method of claim 1, wherein the sliding window is based on an application time, and wherein the application time is used as an attribute in each said event.

9. The method of claim 1, further comprising:

associating a length and a frequency with the sliding window.

10. The method of claim 9, further comprising:

moving the sliding window periodically, after receiving the one or more actual output events in a sliding cycle from the event processing system.

11. A system for testing an event processing system, comprising:

one or more microprocessors;

a testing framework, running on the one or more microprocessors, wherein input data, output data, and a processing rule for a test is declared in a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system, and wherein the testing framework operates to;

associate each input event in a stream of input events with a timestamp;

associate each of one or more expected output events with a shared timestamp;

apply a sliding window on a stream of input events that are sent to an event processing system, wherein said event processing system processes the stream of input events in a batch mode with one or more sliding cycles, and wherein said sliding window includes one or more input events in a sliding cycle that correspond to one or more expected output events, each expected output event associated with a timestamp;

receive one or more actual output events at an end of said sliding cycle in the batch mode from the event processing system; and

use said one or more expected output events to verify said one or more actual output events, including the framework being further configured to;

verify whether the timestamp associated with each said actual output event matches the shared timestamp associated with said one or more expected output events in the sliding window; and

determine that an assert fails when at least one timestamp associated with said one or more actual output events does not match the shared timestamp associated with said one or more expected output events in the sliding window.

12. The system according to claim 11, wherein:

the test file is an XML file, and wherein the test schema is an XML schema.

13. The system according to claim 11, wherein the assert is defined in the test file as an element of the test file.

14. The system according to claim 13, wherein the assert defines the input events and the one or more expected output events.

15. The system according to claim 14, wherein:

said one or more actual output events are received from the event processing system in different orders.

16. The system according to claim 14, wherein an exception is thrown to indicate a failed test, the exception including details of the failure.

17. The system according to claim 16, wherein:

the testing framework operates to apply a tolerance on the shared timestamp.

18. The system according to claim 14, wherein:

the sliding window is based on an application time, and wherein the application time is used as an attribute in each said event.

19. The system according to claim 11, wherein:

the sliding window is associated with a length and a frequency, and the testing framework operates to move the sliding window periodically, after receiving the one or more actual output events in a sliding cycle from the event processing system.

20. A non-transitory machine readable storage medium having instructions stored thereon that when executed cause a system to perform the steps comprising:

declaring input data, output data, and a processing rule for a test in a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;

associating each input event of a stream of input events with a time stamp;

associating each of one or more expected output events with a shared timestamp;

sending the stream of input events to an event processing system;

applying a sliding window on the stream of input events that are sent to the event processing system;

processing, with said event processing system, the stream of input events in a batch mode with one or more sliding cycles, wherein said sliding window includes one or more input events from the stream of input events in a sliding cycle that corresponds to the one or more expected output events;

receiving one or more actual output events at an end of said sliding cycle in the batch mode from the event processing system, each of the one or more actual output events associated with a timestamp; and

using said one or more expected output events to verify said one or more actual output events, including;

verifying whether the timestamp associated with each said actual output event matches the shared timestamp associated with said one or more expected output events in the sliding window, and

determining that an assert fails when at least one timestamp associated with said one or more actual output events does not match the shared timestamp associated with said one or more expected output events in the sliding window.