System and method for using an event window for testing an event processing system

• US 9,753,825 B2
• Filed: 02/09/2015
• Issued: 09/05/2017
• Est. Priority Date: 06/04/2008
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: He, Guan Nan, Xi, Ying
• Primary Examiner(s): Bryan, Jason
• Application Number:
  US14/617,526
• Publication Number:
  US 20150278060A1
• Time in Patent Office: 939 Days
• CPC Class Codes: G06F 11/263 Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
• CPC Class Codes: G06F 11/273 Tester hardware, i.e. output processing circuits G06F11/263 takes precedence
• CPC Class Codes: G06F 11/277 with comparison between actual response and known fault-free response

Abstract

Systems and methods can use a testing framework for testing an event processing system. The testing framework operates to send one or more input events in an event stream to an event processing system, wherein each said input event is associated with a timestamp. Also, the testing framework can receive one or more actual output events from the event processing system, wherein each said actual output event is associated with a timestamp. Furthermore, the testing framework can compare said one or more actual output events in an event window with one or more expected output events for the event window.

Claims

1. A method for testing an event processing system, comprising:

reading in, by a testing framework, input events data, output events data, and a processing rule from a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;

converting, by the testing framework, the input events data into a plurality of input event objects, wherein an event type of the event objects is specified in the test file;

sending each of the input event objects in an event stream to an event processing system, wherein each said input event object is associated with a timestamp, and wherein the event stream is specified in the test file;

providing, by the testing framework and to the event processing system, logic specified in a rule section of the test file;

receiving, by the testing framework, an actual output event from the event processing system, wherein the actual output event is associated with a timestamp;

constructing a corresponding internal representation object for the actual output event, wherein the internal representation object includes, as properties, the actual output event and the timestamp associated with the actual output event; and

comparing the internal representation object in an event window with one or more expected output events for the event window.

2. The method of claim 1, further comprising:

organizing one or more tests in a tree structure.

3. The method of claim 1, wherein the input events data defines input events that are one of a class based event and a map based event, and wherein each input event is associated with one or more pseudo properties, which are used for input and verification.

4. The method of claim 1, wherein the event stream is one of an application timestamped stream and a system timestamped stream.

5. The method of claim 1, wherein at least one event in the event stream is a temporal event.

6. The method of claim 1, wherein the test file is an XML file, and wherein the test schema is an XML schema.

7. The method of claim 6, wherein the test file includes a plurality of asserts, wherein each assert defines one or more input events and an expected output event.

8. The method of claim 6, further comprising:

sharing data among different tests defined in the test file.

9. The method of claim 7, further comprising:

using an individual verification strategy to verify each said assert based on the one or more actual output events and the expected output event.

10. The method of claim 9, wherein the individual verification strategy is based on at least one of

input-output verification,

stepped input-output verification,

event-by-event verification,

prepared data in event window, and

multiple streams input.

11. A system for handling various database state notifications in a transactional middleware machine environment, comprising:

one or more microprocessors;

a testing framework, running on the one or more microprocessors, wherein the testing framework operates to

read in input events data, output events data, and a processing rule from a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;

convert the input events data into a plurality of input event objects, wherein an event type of the event objects is specified in the test file;

send each of the input event objects in an event stream to an event processing system, wherein each said input event object is associated with a timestamp, and wherein the event stream is specified in the test file;

providing, by the testing framework and to the event processing system, logic specified in a rule section of the test file;

receive one or more actual output events from the event processing system, wherein each said actual output event is associated with a timestamp; and

receive an actual output event from the event processing system, wherein the actual output event is associated with a timestamp;

construct a corresponding internal representation object for the actual output event, wherein the internal representation object includes, as properties, the actual output event and the timestamp associated with the actual output event; and

compare the internal representation object in an event window with one or more expected output events for the event window.

12. The system according to claim 11, wherein:

one or more tests are organized in a tree structure.

13. The system according to claim 11, wherein:

the input events data defines input events that are one of a class based event and a map based event, and wherein each input event is associated with one or more pseudo properties, which are used for input and verification.

14. The system according to claim 11, wherein:

the event stream is one of an application timestamped stream and a system timestamped stream.

15. The system according to claim 11, wherein:

at least one event in the event stream is a temporal event.

16. The system according to claim 11, wherein:

the test file is an XML file, and wherein the test schema is an XML schema.

17. The system according to claim 16, wherein:

the test file includes a plurality of asserts, wherein each assert defines one or more input events and an expected output event.

18. The system according to claim 16, wherein:

the testing framework operates to share data among different tests.

19. The system according to claim 17, wherein:

the testing framework operates to use an individual verification strategy to verify each said assert based on the one or more actual output events and the expected output event, wherein the individual verification strategy is based on at least one of

input-output verification,

stepped input-output verification,

event-by-event verification,

prepared data in event window, and

multiple streams input.

20. A non-transitory machine readable storage medium having instructions stored thereon that when executed cause a system to perform the steps comprising:

reading in, by a testing framework, input events data, output events data, and a processing rule from a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;

converting, by the testing framework, the input events data into a plurality of input event objects, wherein an event type of the event objects is specified in the test file;

sending each of the input event objects in an event stream to an event processing system, wherein each said input event object is associated with a timestamp, and wherein the event stream is specified in the test file;

providing, by the testing framework and to the event processing system, logic specified in a rule section of the test file;

receiving, by the testing framework, an actual output event from the event processing system, wherein the actual output event is associated with a timestamp;

constructing a corresponding internal representation object for the actual output event, wherein the internal representation object includes, as properties, the actual output event and the timestamp associated with the actual output event; and

comparing the internal representation object in an event window with one or more expected output events for the event window.