System and method for supporting a testing framework for an event processing system using multiple input event streams

• US 10,102,091 B2
• Filed: 02/09/2015
• Issued: 10/16/2018
• Est. Priority Date: 06/04/2008
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: He, Guan Nan, Xi, Ying
• Primary Examiner(s): Schell, Joseph O
• Application Number:
  US14/617,556
• Publication Number:
  US 20150278057A1
• Time in Patent Office: 1,345 Days
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
• CPC Class Codes: G06F 11/2635 using a storage for the test inputs, e.g. test ROM, script files
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 11/3684 for test design, e.g. generating new test cases
• CPC Class Codes: G06F 11/3688 for test execution, e.g. scheduling of test suites
• CPC Class Codes: H04L 43/14 using software, i.e. software packages network security related monitoring H04L63/1408
• CPC Class Codes: H04L 43/50 Testing arrangements

Abstract

Systems and methods can use a testing framework for testing an event processing system. The testing framework operates to send a plurality of input events in multiple event streams to an event processing system, wherein each said input event is associated with a timestamp. Also, the testing framework prescribes one or more expected output events that correspond to said plurality of input events in multiple event streams, wherein each said expected output event is associated with a timestamp. Furthermore, the testing framework can use said one or more expected output events to verify one or more actual output events that are received from the event processing system, wherein each said actual output event is associated with a timestamp.

Claims

1. A method for testing an event stream processing system with a testing framework, the testing framework operating on one or more processors and operably connected to the event processing system, the method comprising:

declaring input event data, expected output event data, and at least one processing rule for a test in an XML file, wherein the XML file is associated with an XML schema for testing the event processing system;

reading in, by the testing framework, and into a memory accessible by the testing framework, the input event data, output event data, and the processing rule;

sending, by the testing framework, a plurality of input events in multiple event streams to the event stream processing system, wherein each said input event is associated with a timestamp;

prescribing, by the testing framework, one or more expected output events that correspond to said plurality of input events in multiple event streams, wherein each said expected output event is associated with a timestamp; and

using, by the testing framework, said one or more expected output events to verify one or more actual output events that are received from the event processing system, wherein each said actual output event is associated with a timestamp.

2. The method of claim 1, further comprising:

converting the input event data into the plurality of input events; and

converting the expected output event data into the one or more expected output events.

3. The method of claim 1, further comprising:

using an attribute in an assert element in the XML file to indicate the multiple event streams.

4. The method of claim 1, further comprising:

configuring said multiple event streams with separate corresponding connections, event channels, and threads.

5. The method of claim 1, further comprising:

applying a plurality of event windows on the multiple event streams, wherein each event stream of the multiple event streams is applied with one event window of the plurality of event windows.

6. The method of claim 5, further comprising:

allowing said plurality of event windows to be in different types.

7. The method of claim 5, further comprising:

allowing said plurality of event windows applied on the multiple event streams to share a common base time.

8. The method of claim 7, further comprising:

using the common base time, when a first assert element of the XML file is processed, as a base time for an application timestamped event stream in a test.

9. The method of claim 7, further comprising:

using the common base time, when a first assert element of the XML file is processed and after a corresponding sliding point is obtained, as a base time for a system timestamped event stream in a test.

10. The method of claim 1, further comprising:

allowing the event stream processing system to use a query to correlate said plurality of input events in multiple event streams to generate said one or more actual output events.

11. A system for testing an event stream processing system, comprising:

one or more microprocessors;

a testing framework, running on the one or more microprocessors and operably connected to the event stream processing system, wherein the testing framework operates to;

declare input event data, expected output event data, and at least one processing rule for a test in an XML file, wherein the XML file is associated with an XML schema for testing the event processing system;

read, into a memory accessible by the testing framework, the input event data, output event data, and the processing rule;

send a plurality of input events in multiple event streams to the event stream processing system, wherein each said input event is associated with a timestamp;

prescribe one or more expected output events that correspond to said plurality of input events in multiple event streams, wherein each said expected output event is associated with a timestamp; and

use said one or more expected output events to verify one or more actual output events that are received from the event processing system, wherein each said actual output event is associated with a timestamp.

12. The system according to claim 11, wherein:

the testing framework operates to convert the input event data into the plurality of input events and convert the expected output event data into the one or more expected output events.

13. The system according to claim 11, wherein:

the testing framework operates to use an attribute in an assert element in the XML file to indicate multiple event streams.

14. The system according to claim 11, wherein:

the testing framework operates to configure said multiple event streams with separate corresponding connections, event channels, and threads.

15. The system according to claim 11, wherein:

the testing framework operates to apply a plurality of event windows on the multiple event streams, wherein each event stream of the multiple event streams is applied with a corresponding one event window of the plurality of event windows.

16. The system according to claim 15, wherein:

said plurality of event windows are in different types.

17. The system according to claim 15, wherein:

the testing framework allows said plurality of event windows applied on the multiple event streams to share a common base time.

18. The system according to claim 17, wherein:

the testing framework uses the common base time, when a first assert element of the XML file is processed, as a base time for an application timestamped event stream in a test, and

wherein the testing framework uses the common base time, when the first assert statement is processed and after a corresponding sliding point is obtained, as a base time for a system timestamped event stream in a test.

19. The system according to claim 11, wherein:

the testing framework allows the event processing system to use a query to correlate said plurality of input events in multiple event streams to generate said one or more actual output events.

20. A non-transitory machine readable storage medium having instructions stored thereon that when executed by one or more processors cause a testing framework that is operably connected to an event stream processing system to perform the steps comprising:

declaring input event data, expected output event data data, and at least one processing rule for a test in an XML file, wherein the XML file is associated with an XML schema for testing the event processing system;

reading into a memory accessible by the testing framework, the input event data, output event data, and the processing rule;

sending a plurality of input events in multiple event streams to the event stream processing system, wherein each said input event is associated with a timestamp;

prescribing one or more expected output events that correspond to said plurality of input events in multiple event streams, wherein each said expected output event is associated with a timestamp; and

using said one or more expected output events to verify one or more actual output events that are received from the event processing system, wherein each said actual output event is associated with a timestamp.

21. A method for testing an event stream processing system with a testing framework, the testing framework operating on one or more processors and operably connected to the event processing system, the method comprising:

reading in, by the testing framework, and into a memory accessible by the testing framework, input events data, expected output events data, and a processing rule;

converting, by the testing framework, the input events data into a plurality of input event objects;

configuring multiple event streams to the event stream processing system, each of the multiple event streams having separate corresponding connections, event channels, and threads;

sending the plurality of input event objects in the multiple event streams to the event stream processing system, wherein each said input event object is associated with a timestamp;

prescribing one or more expected output events that correspond to said plurality of input event objects in each of the multiple event streams, wherein each said expected output event is associated with a timestamp;

receiving, by the testing framework and from the event stream processing system, an actual output event, wherein the actual output event is associated with a timestamp; and

using said one or more expected output events to verify the actual output event.

22. The method of claim 21, further comprising:

applying a plurality of event windows on the multiple event streams, wherein each event stream of the multiple event streams is applied with one event window of the plurality of event windows.

23. The method of claim 22, wherein the plurality of event windows applied on the multiple event streams share a common base time.

24. The method of claim 23, further comprising:

using the common base time, when a first assert statement is processed, as a base time for an application timestamped event stream in a test.

25. The method of claim 23, further comprising:

using the common base time, when a first assert statement is processed and after a corresponding sliding point is obtained, as a base time for a system timestamped event stream in a test.

26. A method for testing an event stream processing system with a testing framework, the testing framework operating on one or more processors and operably connected to the event stream processing system, the method comprising:

reading in, by a testing framework, input events data, output events data, and a processing rule;

converting, by the testing framework, the input events data into a plurality of input event objects;

sending the plurality of input event objects in multiple event streams to the event stream processing system, wherein each said input event object is associated with a timestamp;

applying a plurality of event windows on the multiple event streams, wherein each event stream of the multiple event streams is applied with one event window of the plurality of event windows, and wherein the plurality of event windows applied on the multiple event streams share a common base time;

prescribing one or more expected output events that correspond to said plurality of input event objects in each of the multiple event streams, wherein each said expected output event is associated with a timestamp; and

receiving, by the testing framework and from the event stream processing system, an actual output event, wherein the actual output event is associated with a timestamp;

using said one or more expected output events to verify the actual output event ; and

using the common base time, when a first assert statement is processed, as a base time for an application timestamped event stream in a test.

27. A method for testing an event stream processing system with a testing framework, the testing framework operating on one or more processors and operably connected to the event stream processing system, the method comprising:

reading in, by a testing framework, input events data, output events data, and a processing rule;

converting, by the testing framework, the input events data into a plurality of input event objects;

sending the plurality of input event objects in multiple event streams to an event processing system, wherein each said input event object is associated with a timestamp;

applying a plurality of event windows on the multiple event streams, wherein each event stream of the multiple event streams is applied with one event window of the plurality of event windows, and wherein the plurality of event windows applied on the multiple event streams share a common base time;

prescribing one or more expected output events that correspond to said plurality of input event objects in each of the multiple event streams, wherein each said expected output event is associated with a timestamp; and

receiving, by the testing framework and from the event processing system, an actual output event, wherein the actual output event is associated with a timestamp; and

using said one or more expected output events to verify the actual output event; and

using the common base time, when a first assert statement is processed and after a corresponding sliding point is obtained, as a base time for a system timestamped event stream in a test.