Parallel access virtual tape library and drives

• US 8,996,823 B2
• Filed: 12/23/2013
• Issued: 03/31/2015
• Est. Priority Date: 08/30/2007
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kottomtharayil, Rajiv, Vijayan, Manoj Kumar, Muller, Marcus S.
• Primary Examiner(s): Rigol, Yaima
• Assistant Examiner(s): GIARDINO JR, MARK A
• Application Number:
  US14/139,414
• Publication Number:
  US 20140115250A1
• Time in Patent Office: 463 Days
• Field of Search: 711/111, 711/112, 711/150, 711/162, 711/168, 709/225, 709/227, 707/639
• US Class Current: 711/150
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0619 in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/0622 in relation to access
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0686 Libraries, e.g. tape libraries, jukebox

Abstract

A system and method described herein allows a virtual tape library (VTL) to perform multiple simultaneous or parallel read/write or access sessions with disk drives or other storage media, particularly when subject to a sequential SCSI-compliant layer or traditional limitations of VTLs. In one embodiment, a virtualizing or transaction layer can establish multiple sessions with one or more clients to concurrently satisfy the read/write requests of those clients for physical storage resources. A table or other data structure tracks or maps the sessions associated with each client and the location of data on the physical storage devices.

Claims

1. A virtual tape library (VTL) system for storing data, the system comprising:

at least one data storage device driver to communicate with two or more non-sequential access data storage devices,

wherein the at least one data storage device driver is configured to provide read commands and write commands to the two or more non-sequential access data storage devices;

a disk subsystem to communicate with the at least one data storage device driver; and

,

an interface to receive sequential access read commands from two or more client computers, and to receive sequential access write commands from the two or more client computers,

wherein the interface is configured to pass to the disk subsystem a non-sequential access read command in response to a received sequential access read command from one of the client computers, even if a sequential data storage device identified by the received sequential access read command is currently occupied with a read or write operation, and even if a removable, sequential access, data storage medium identified in the received sequential access read command is currently being read from or written to by the VTL system,

wherein the interface is also configured to pass to the disk subsystem a non-sequential access write command in response to a received sequential access write command from one of the client computers, even if a sequential data storage device identified by the received sequential access write command is currently occupied with a read or write operation, and even if a removable, sequential access, data storage medium identified in the received sequential access write command is currently being written to by the VTL system,

wherein the disk subsystem is further configured to provide to the at least one data storage device driver a read command in response to the non-sequential access read command received from the interface,

wherein the disk subsystem is also configured to provide to the at least one data storage device driver a write command in response to the non-sequential access write command received from the interface,

wherein the interface is configured to store and manage a data structure, wherein the data structure tracks

received sequential access read commands from the two or more client computers,

received sequential access write commands from the two or more client computers,

non-sequential access read commands passed to the disk subsystem, and

non-sequential access write commands passed to the disk subsystem;

wherein the interface is further configured to;

generate multiple snapshots of the data structure, wherein each of the multiple snapshots is generated at a different time; and

provide a user interface for displaying and permitting user access to data associated with each of the multiple snapshots.

2. The system of claim 1, wherein the interface further comprises:

a client interface configured to receive sequential read commands and sequential write commands from the two or more client computers;

a session mapper configured to store and manage the data structure and, in response to each received sequential read command and each received sequential write command, to provide a session handle, wherein the client interface passes the session handle to one of the client computers;

wherein the data structure comprises one or more data object mapping tables, wherein the mapping tables are configured to track session handles with corresponding non-sequential access read and write commands passed to the disk subsystem, and to track physical locations of data read from and written to the at least two non-sequential access data storage devices associated with the VTL.

3. The system of claim 1, further comprising an intermediate cache to cache the received sequential access read commands and the received sequential access write commands, wherein the sequential access read commands and the sequential access write commands are sequential SCSI commands, wherein the least two non-sequential access data storage devices are magnetic disk drives, wherein the sequential data storage device is a magnetic tape drive, and wherein the removable, sequential access, data storage medium is a magnetic tape cartridge.

4. The system of claim 1, wherein the disk subsystem further comprises at least one media agent to execute at least one subroutine for performing further data manipulation, wherein the further data manipulation includes data encryption, data decryption, data compression, data decompression, error correction, or data de-duplication.

5. At least one non-transitory computer-readable memory carrying instructions, which when executed by at least one data processor, provides commands for a virtual tape library (VTL), comprising:

receiving sequential access write commands from two or more host computers,

wherein the sequential access write commands from the two or more host computers are commands to write data to sequential data storage media,

wherein the VTL reads data from, or writes data to, at least two random access data storage devices within the VTL,

wherein each sequential access write command includes associated parameters, and

wherein the associated parameters specify a particular sequential access data storage drive and a piece of removable, sequential access, data storage media;

in response to each received sequential access write command from the two or more host computers, returning a session identifier to each host computer,

wherein if the same piece of removable, sequential access, data storage media is requested by two different host computers, then a different session identifier is provided to each of the two different host computers, and

wherein if the same sequential access data storage drive is requested by two different host computers, then a different session identifier is provided to each of the two different host computers;

tracking, via a data structure, the session identifiers, the parameters, the at least two random access data storage devices within the VTL, and each received sequential access write command from the two or more host computers;

in response to each received sequential access write command from the two or more host computers, performing write commands with respect to the at least two random access data storage devices within the VTL;

releasing a corresponding session associated with a completed sequential access write command after any one of the received sequential access write commands has been completed;

causing multiple snapshots of the data structure to be created, wherein each of the multiple snapshots is to be created at a different time; and

providing a user interface for displaying and permitting user access to data associated with each of the multiple snapshots.

6. The at least one non-transitory computer-readable memory of claim 5, further comprising:

in response to received sequential access write commands, assigning one or more threads to manage different write requests from the same host computer.

7. The at least one non-transitory computer-readable memory of claim 5, further comprising:

performing at least one additional data storage operation on data to be written to the at least two random access data storage devices within the VTL, wherein the additional data storage operation is single instancing, classifying data, load balancing, or generating snapshots.

8. The at least one non-transitory computer-readable memory of claim 5, further comprising:

generating multiple snapshots of the at least two random access data storage devices within the VTL, wherein each of the multiple snapshots is generated at a different time; and

providing a user interface for displaying and permitting user access to data associated with each of the multiple snapshots.

9. A computer-implementable method, comprising:

intercepting sequential access write commands from two or more host computers,

wherein the sequential access write commands from the two or more host computers are commands to write data to sequential data storage media, and

wherein each sequential access write command includes associated parameters;

in response to each received sequential access write command from the two or more host computers, returning a session identifier to each host computer,

wherein if the same piece of removable, sequential access, data storage media is requested by two different host computers, then providing a different session identifier to each of the two different host computers, and

wherein if the same sequential access data storage drive is requested by two different host computers, then providing a different session identifier to each of the two different host computers;

in response to each received sequential access write command from the two or more host computers, causing write commands to be performed with respect to the at least two random access data storage devices within a virtual tape library (VTL);

releasing a session associated with a completed sequential access write command after any one of the received sequential access write commands has been completed; and

generating multiple snapshots of the data structure, wherein each of the multiple snapshots is generated at a different time; and

providing a user interface for displaying and permitting user access to data associated with each of the multiple snapshots.

10. The computer-implementable method of claim 9, further comprising:

generating multiple snapshots of the at least two random access data storage devices within the VTL, wherein each of the multiple snapshots is generated at a different time; and

providing a user interface for displaying and permitting user access to data associated with each of the multiple snapshots.

11. The computer-implementable method of claim 9, further comprises:

in response to each received sequential access write, assigning one or more threads to manage different write requests from the same host computer.

12. The computer-implementable method of claim 9, further comprises:

performing at least one additional data storage operation on data to be written to the at least two random access data storage devices within the VTL, wherein the additional data storage operation is single instancing, classifying data, load balancing, or generating snapshots.

13. The computer-implementable method of claim 9, further including:

providing a user interface for displaying a list of individual files associated with multiple snapshots, wherein user selection identifies an earlier version of a file associated with the selected multiple snapshots, and wherein presenting to the user data includes presenting the earlier version of a file associated with the selected snapshots.

14. The computer-implementable method of claim 9, further including:

caching data associated with the write commands in an intermediate cache wherein the sequential access write commands are sequential SCSI commands, wherein the sequential access write data storage device is magnetic disk drives, a magnetic tape drive, or a magnetic tape cartridge.

15. The computer-implementable method of claim 9, further including:

executing at least one subroutine in at least one media agent for performing further data manipulation, wherein the further data manipulation includes data encryption, data decryption, data decompression, error correction, or data de-duplication.

16. The computer-implementable method of claim 9, further including:

assigning, in response to received sequential access write commands, one or more threads to manage different write requests from the same host computer.