SYSTEM AND METHOD FOR LOGSTREAM ARCHIVAL

• US 20090259700A1
• Filed: 04/14/2008
• Published: 10/15/2009
• Est. Priority Date: 04/14/2008
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Inventors: Livingston, Michael D., Waselewski, Charles F.
• Granted Patent: US 8,756,202 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 16/2477 Temporal data queries
• CPC Class Codes: G06F 16/9562 Bookmark management

Abstract

A method of archiving data from a logstream includes determining a begin time parameter earlier in time than a last record obtained from the logstream of data. A request is sent for records from the logstream of data starting at the begin time parameter. Records are received from the logstream of data and selected records are archived.

Claims

1. A machine implemented method of archiving data, the method comprising:

obtaining a timestamp corresponding to a last record obtained from a logstream of data;

modifying the timestamp to an earlier point in time;

requesting records from the logstream starting about the earlier point in time;

receiving records from the logstream;

determining a first record not previously archived; and

archiving such first record not previously archived, and succeeding records received.

2. The method of claim 1 and further comprising storing an end timestamp corresponding to the last record received from the logstream of data.

3. The method of claim 1 wherein requesting records from the logstream further includes specifying an end time, and wherein the end time is stored as the timestamp corresponding to a last record obtained from a logstream of data for a next request for records.

4. The method of claim 1, wherein determining a first record not previously archived comprises comparing received records to the last record stored from a previous request for records.

5. The method of claim 4 wherein comparing the records comprises comparing an amount of data in each record, including a timestamp associated with the records.

6. The method of claim 1 wherein the earlier point in time is a predetermined amount of time corresponding to temporal granularity limitations of the request for records.

7. The method of claim 6 wherein the predetermined amount of time is one minute.

8. The method of claim 7 wherein each record has an associated timestamp with a granularity of at least 0.01 seconds.

9. The method of claim 6 wherein multiple records may have the same timestamp.

10. The method of claim 1 and further comprising filtering received records prior to archiving.

11. The method of claim 10 wherein filtering records identifies system management facilities (SMF) records for archiving.

12. A machine implemented method comprising:

determining a begin time parameter earlier in time than a last record obtained from a logstream of data;

sending a request for records from the logstream starting at the begin time parameter;

receiving records from the logstream; and

archiving selected records received.

13. The method of claim 12 wherein a first request for records from the logstream requests all records in the logstream, and further comprising:

determining a timestamp of the last record received as a result of the first request; and

storing the determined timestamp.

14. The method of claim 12 wherein the begin time parameter is one minute earlier in time than the last record obtained from the logstream of data and wherein the selected records are received records not previously archived.

15. The method of claim 12 wherein requesting records from the logstream further includes specifying an end time, and wherein the end time is stored as a bookmark corresponding to a last record obtained from a logstream of data for a next request for records.

16. The method of claim 12 and further comprising filtering received records prior to archiving.

17. The method of claim 16 wherein filtering records identifies system management facilities (SMF) records for archiving.

18. A computer readable medium having instructions for causing a computer to execute a method comprising:

determining a begin time parameter earlier in time than a last record obtained from a logstream of data;

sending a request for records from the logstream starting at the begin time parameter;

receiving records from the logstream; and

archiving selected records received.

19. The computer readable medium of claim 18 wherein a first request for records from the logstream requests all records in the logstream, and wherein the method further comprises:

determining a timestamp of the last record received as a result of the first request; and

storing the determined timestamp.

20. The computer readable medium of claim 18 wherein the method further comprises filtering received records prior to archiving.