Virtual logging system and method

• US 20060053339A1
• Filed: 10/31/2005
• Published: 03/09/2006
• Est. Priority Date: 05/31/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Bradshaw, Dexter Paul, Miller, Thomas Jay
• Granted Patent: US 7,219,262 B2
• Time in Patent Office: Days
• US Class Current: 714/15
• CPC Class Codes: G06F 11/1471 involving logging of persistent data for recovery
• CPC Class Codes: Y10S 707/99938 Concurrency, e.g. lock management in shared database
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

A common transactional logging system (a “virtual logging system”) that presents to one or more log clients the appearance that each log client is interacting with a dedicated logging system. In reality, the virtual logging system is multiplexing multiple virtual log streams, including log records, for each log client into a single transactional log.

Claims

1. A computer-readable medium encoded with computer-executable components for performing transactional logging, comprising:

a plurality of distributed logging modules, a first one of the distributed logging modules being associated with a first computer application program and a second of the distributed logging modules being associated with a second computer application program, each of the distributed logging modules being further configured to receive log data from the distributed logging module'"'"'s associated computer application program, each of the distributed logging modules being programmed to marshal the log data sent by the associated computer application program;

a common logging engine in communication with each of the distributed logging modules and configured to receive log data from each of the distributed logging modules and to multiplex the received log data into a single physical log; and

a plurality of distributed logging module data stores (DLM data stores), each of the DLM data stores being associated with one of the distributed logging modules and containing information about the physical log for use by the associated distributed logging module in sending the log data to the common logging engine, the information about the physical log comprising an indication of an amount of pre-reserved space in the physical log available to the associated distributed logging module.

2. The computer-readable medium of claim 1, further comprising a plurality of buffers, each buffer being associated with at least one of the distributed logging modules and being configured to temporarily store the log data until the log data are sent to the common logging engine.

3. The computer-readable medium of claim 1, wherein the information about the physical log further comprises an indication of an amount of pre-reserved space that the distributed logging module prefers to have pre-reserved.

4. The computer-readable medium of claim 1, wherein the information about the physical log further comprises an indication of an amount of space required to store log data buffered by the distributed logging module.

5. The computer-readable medium of claim 1, wherein the common logging engine is implemented in a kernel mode of a computer system.

6. The computer-readable medium of claim 1, further comprising a flush queue, the flush queue being associated with the common logging engine and being configured to temporarily defer the multiplexed log data until the multiplexed log data is appended to the physical log.

7. The computer-readable medium of claim 1, further comprising a common logging engine data store (CLE data store), the CLE data store being associated with the common logging engine and containing information about the physical log.

8. The computer-readable medium of claim 7, wherein information about the physical log comprises an indication of an amount of pre-reserved space in the physical log available to the plurality of distributed logging modules.

9. The computer-readable medium of claim 7, wherein information about the physical log comprises an indication of an amount of space in the physical log allocated to log records.

10. The computer-readable medium of claim 1, further comprising an owner page cache associated with the common logging engine and containing data for retrieving log data.

11. The computer-readable medium of claim 10, wherein the data for retrieving log data comprises owner pages identifying a particular computer application program that owns a log record within the physical log.

12. A computer-implemented method of performing transactional logging for a computer application program, comprising:

receiving log records from each of a plurality of computer application programs;

marshalling the log records into a plurality of buffers;

storing the marshaled log records in a buffer before sending the virtual log streams;

receiving at least one instruction to retrieve a log record from at least one of the computer application programs;

if the log record is in the buffer, retrieving the log record in the buffer; and

transmitting the log record to the computer application program; and

sending the marshaled log records to a common logging engine in a plurality of virtual log streams, each of the virtual log streams being associated with a computer application program in the plurality of computer application programs.

13. A computer-implemented method for communicating between computer-executable components, comprising:

sending, by a distributed logging module, logging instructions to a common logging engine;

sending, by the distributed logging module, a first piggy back data along with the logging instructions, wherein the first piggy back data includes accounting information associated with pre-reserved space in a physical log available to the distributed logging module;

receiving, by a common logging engine, the logging instructions and piggy back data;

sending, by the common logging engine, a response and acknowledgment message to the distributed logging module in response to the logging instructions;

sending, by the common logging engine, a second piggy back data along with the response and acknowledgment message.

14. The computer-implemented method of claim 13, wherein the logging instructions include a virtual log stream.

15. The computer-implemented method of claim 14, wherein the response and acknowledgement message include a pointer to a memory location where the virtual log stream is stored in the physical log.

16. The computer-implemented method of claim 13, further comprising sending, by the common logging engine a next physical log sequence number to the distributed logging module in response to the logging instructions.

17. The computer-implemented method of claim 13, wherein the first piggy back data and the second piggy back data form a feedback loop for updating accounting information.