Logging framework for a data stream processing server

• US 8,527,458 B2
• Filed: 08/03/2009
• Issued: 09/03/2013
• Est. Priority Date: 08/03/2009
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Park, Hoyong, Jain, Parul, Jain, Namit, Srinivasan, Anand, Mishra, Shailendra
• Primary Examiner(s): Mahmoudi, Tony
• Assistant Examiner(s): NGUYEN, MERILYN P
• Application Number:
  US12/534,384
• Publication Number:
  US 20110029484A1
• Time in Patent Office: 1,492 Days
• Field of Search: 707/634, 707/713, 707/718
• US Class Current: 707/634
• CPC Class Codes: G06F 16/217 Database tuning G06F16/2282 takes precedence; database performance monitoring G06F11/3409
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries

Abstract

Techniques for logging data pertaining to the operation of a data stream processing server. In one set of embodiments, logging configuration information can be received specifying a functional area of a data stream processing server to be logged. Based on the logging configuration information, logging can be dynamically enabled for objects associated with the functional area that are instantiated by the data stream processing server, and logging can be dynamically disabled for objects associated with the functional area that are discarded (or no longer used) by the data stream processing server. In another set of embodiments, a tool can be provided for visualizing the data logged by the data stream processing server.

Claims

1. A method comprising:

receiving, at a computer system, logging configuration information specifying a functional area of a data stream processing server to be logged, the functional area to be logged corresponding to a type of query plan object;

identifying, by the computer system, an object associated with the functional area that has been instantiated by the data stream processing server, the identifying including traversing a query plan generated for a continuous query, and identifying a query plan object in the plurality of query plan objects having the type, the query plan including a plurality of query plan objects; and

enabling, by the computer system, logging for the object.

2. The method of claim 1 wherein enabling logging for the object comprises:

storing the logging configuration information for the object; and

generating one or more log records for the object based on the logging configuration information stored for the object.

3. The method of claim 2 wherein disabling logging for the object comprises deleting the logging configuration information stored for the object.

4. The method of claim 2 wherein the logging configuration information includes a first parameter identifying an event upon which to generate a log record and a second parameter identifying a level of detail for the log record, and

wherein generating one or more log records for the object comprises:

upon occurrence of a predefined event related to the object, retrieving the logging configuration information stored for the object;

determining if the predefined event corresponds to the event identified by first parameter; and

if the predefined event corresponds to the event identified by the first parameter, generating a log record for the object, the log record having the level of detail identified by the second parameter.

5. The method of claim 1 further comprising:

determining, by the computer system, if the object is no longer used by the data stream processing server; and

if the object is no longer used, disabling, by the computer system, logging for the object.

6. The method of claim 5 wherein determining if the object is no longer used comprises determining if the continuous query is dropped.

7. The method of claim 1 wherein the plurality of query plan objects include an operator object and one or more data structure objects associated with the operator object.

8. The method of claim 7 wherein, if logging is enabled for the operator object, logging is automatically enabled for the one or more data structure objects associated with the operator object.

9. The method of claim 1 further comprising:

identifying another object associated with the functional area, wherein the another object was instantiated by the data stream processing server subsequently to receiving the logging configuration information; and

enabling logging for the another object.

10. The method of claim 1 wherein the logging configuration information is received from a user and is expressed as a Continuous Query Language (CQL) statement.

11. The method of claim 1 wherein the logging configuration information is received via an invocation of a Java Management Extensions (JMX) Applications Programming Interface (API).

12. The method of claim 1, wherein the plurality of objects includes an additional object, and wherein logging is enabled for the object and logging is disabled for the additional object.

13. A non-transitory machine-readable storage medium having stored thereon program code executable by a computer system, the program code comprising:

code that causes the computer system to receive logging configuration information specifying a functional area of a data stream processing server to be logged, the functional area to be logged corresponding to a type of query plan object;

code that causes the computer system to identify an object associated with the functional area that has been instantiated by the data stream processing server, the code that causes the computer system to identify including code that causes the computer system to traverse a query plan generated for a continuous query, and code that causes the computer system to identify a query plan object in the plurality of query plan objects having the type, the query plan including a plurality of query plan objects; and

code that causes the computer system to enable logging for the object.

14. The machine-readable storage medium of claim 13 wherein the code that causes the computer system to enable logging for the object comprises:

code that causes the computer system to store the logging configuration information for the object; and

code that causes the computer system to generate one or more log records for the object based on the logging configuration information stored for the object.

15. The machine-readable storage medium of claim 14 wherein the logging configuration information includes a first parameter identifying an event upon which to generate a log record and a second parameter identifying a level of detail for the log record, and

wherein the code that causes the computer system to generate one or more log records for the object comprises:

code that causes the computer system to, upon occurrence of a predefined event related to the object, retrieve the logging configuration information stored for the object;

code that causes the computer system to determine if the predefined event corresponds to the event identified by first parameter; and

code that causes the computer system to, if the predefined event corresponds to the event identified by the first parameter, generate a log record for the object, the log record having the level of detail identified by the second parameter.

16. The machine-readable storage medium of claim 13 wherein identifying an object associated with the functional area comprises:

traversing a query plan generated for a continuous query, the query plan including a plurality of query plan objects; and

identifying a query plan object in the plurality of query plan objects having the type of query plan object.

17. The machine-readable storage medium of claim 13 wherein the program code further comprises:

code that causes the computer system to identify another object associated with the functional area, wherein the another object was instantiated by the data stream processing server subsequently to receiving the logging configuration information; and

code that causes the computer system to enable logging for the another object.

18. The machine-readable storage medium of claim 13 wherein the program code further comprises:

code that causes the computer system to determine if the object is no longer used by the data stream processing server; and

code that causes the computer system to, if the object is no longer used, disable logging for the object.

19. A system comprising:

a processor configured to;

receive logging configuration information specifying a functional area of a data stream processing server to be logged, the functional area to be logged corresponding to a type of query plan object;

identify an object associated with the functional area that has been instantiated by the data stream processing server, the identifying including traversing a query plan generated for a continuous query, and identifying a query plan object in the plurality of query plan objects having the type, the query plan including a plurality of query plan objects; and

enable logging for the object.

20. The system of claim 19 wherein the processing component is further configured to:

determine if the object is no longer used by the data stream processing server; and

if the object is no longer used, disable logging for the object.