Object-level database restore

• US 10,223,211 B2
• Filed: 05/20/2015
• Issued: 03/05/2019
• Est. Priority Date: 01/21/2015
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kumarasamy, Paramasivam, Pawar, Rahul S., Dornemann, Henry Wallace, Ahn, Jun H., Vallabhaneni, Brahmaiah, Ramohalli Gopala Rao, Girish
• Primary Examiner(s): Pyo, Monica M
• Application Number:
  US14/717,816
• Publication Number:
  US 20160210194A1
• Time in Patent Office: 1,385 Days
• Field of Search: 707674-686
• CPC Class Codes: G06F 11/14 Error detection or correction of the data by redundancy in operation G06F11/16 takes precedence
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 11/3034 where the computing system component is a storage system, e.g. DASD based or network based digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 16/184 implemented as replicated file system
• CPC Class Codes: G06F 16/214 Database migration support
• CPC Class Codes: G06F 16/2282 Tablespace storage structures; Management thereof
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/275 Synchronous replication
• CPC Class Codes: G06F 2201/80 Database-specific techniques
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data
• CPC Class Codes: G06F 3/061 : Improving I/O performance
• CPC Class Codes: G06F 3/0619 : in relation to data integrity, e.g. data losses, bit errors
• CPC Class Codes: G06F 3/064 : Management of blocks
• CPC Class Codes: G06F 3/0643 : Management of files
• CPC Class Codes: G06F 3/065 : Replication mechanisms
• CPC Class Codes: G06F 3/067 : Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

According to certain aspects, a system may include a computing device configured to: intercept a request from a database application to read a portion of a database file, where a secondary copy of the database file resides on a secondary storage device(s) and is organized as a plurality of first blocks, wherein the request includes a database file offset(s) corresponding to the requested portion; and map the database file offset(s) to a subset of the first blocks that correspond to requested database object(s). The system may include a secondary storage controller computer(s) configured to: access a table that maps the plurality of first blocks to storage locations on the secondary storage device(s); using the table, locate and retrieve the subset of the first blocks on the secondary storage device(s); and forward the retrieved first blocks for storage in a primary storage device(s).

Claims

1. A system for backing up and restoring database data, the system comprising:

a computing device comprising computer hardware, the computing device having a data agent executing thereon configured to;

intercept a first request from a database application executing on the computing device to read a portion of a database file, wherein a secondary copy of the database file resides on one or more secondary storage devices in a secondary storage subsystem and is organized on the one or more secondary storage devices as a plurality of first blocks, wherein the database file is organized by the database application as a plurality of application-level blocks, and each block of the plurality of first blocks includes multiple ones of the application-level blocks, wherein the portion corresponds to a subset of one or more database objects of a plurality of database objects represented by the database file, wherein the first request includes at least one offset corresponding to the portion in the database file;

determine a subset of first blocks of the plurality of first blocks corresponding to the offset included in the request; and

issue a second request to restore the subset of first blocks from the one or more secondary storage devices; and

one or more secondary storage controller computers comprising computer hardware configured to;

in response to the second request;

access a table that maps the plurality of first blocks to one or more storage locations on the one or more secondary storage devices;

using the table, locate the subset of first blocks on the one or more secondary storage devices identified by the second request and retrieve the subset of first blocks from the one or more secondary storage devices;

forward the retrieved first blocks for storage in one or more primary storage devices associated with the computing device;

extract application-level blocks corresponding to the requested portion from the retrieved first blocks based on the one or more database file offsets; and

forward the extracted application-level blocks to the database application.

2. The system of claim 1, wherein the computing device is configured to map the one or more database file offsets to the subset of the first blocks that correspond to the one or more requested database objects at least in part by dividing the one or more database file offsets by the size of a block of the plurality of first blocks.

3. The system of claim 1, wherein the computing device is a client computing device residing in a primary storage subsystem.

4. The system of claim 1, wherein the computing device is one of the one or more secondary storage controller computers.

5. The system of claim 1, wherein the table is stored in one or more indexes associated with the one or more secondary storage controller computers.

6. The system of claim 1, wherein each block of the plurality of first blocks has a unique identifier (ID) associated with the block.

7. The system of claim 6, wherein the request for the subset of the first blocks includes the unique IDs of at least some blocks in the subset of the first blocks.

8. The system of claim 6, wherein the table includes the unique IDs of the plurality of first blocks.

9. The system of claim 1, wherein the size of a block of the plurality of the first blocks is based on the size of a read operation by the database application.

10. The system of claim 1, wherein the size of a block of the plurality of the first blocks is a multiple of the size of an application-level block of the plurality of application-level blocks.

11. The system of claim 1, wherein the computing device is further configured to present the secondary copy of the database file as a file system in a user interface, and wherein the request to read the portion is generated in response to selection of the one or more database objects that correspond to the portion within the user interface.

12. The system of claim 11, wherein the secondary copy is browsed using the database application.

13. The system of claim 11, wherein the one or more database objects that correspond to the portion are selected by a query.

14. A method of backing up and restoring database data, the method comprising:

using one or more computing devices comprising computer hardware;

intercepting a first request from a database application to read a portion of a database file, wherein a secondary copy of the database file resides on one or more secondary storage devices in a secondary storage subsystem and is organized on the one or more secondary storage devices as a plurality of first blocks, wherein the portion corresponds to a subset of one or more database objects of a plurality of database objects represented by the database file, wherein the database file is organized by the database application as a plurality of application-level blocks, and each block of the plurality of first blocks includes multiple ones of the application-level blocks, wherein the first request includes at least one offset corresponding to the portion in the database file;

determining a subset of first blocks of the plurality of first blocks corresponding to the offset included in the request;

issuing a second request to restore the subset of first blocks from the one or more secondary storage devices; and

in response to the second request;

accessing a table that maps the plurality of first blocks to one or more storage locations on the one or more secondary storage devices;

using the table, locate the subset of first blocks on the one or more secondary storage devices identified by the second request and retrieve the subset of first blocks from the one or more secondary storage devices; and

forwarding the retrieved first blocks for storage in one or more primary storage devices;

extract application-level blocks corresponding to the requested portion from the retrieved first blocks based on the one or more database file offsets; and

forward the extracted application-level blocks to the database application.

15. The method of claim 14, wherein said mapping the one or more database file offsets to the subset of the first blocks that correspond to the one or more requested database objects comprises dividing the one or more database file offsets by the size of a block of the plurality of first blocks.

16. The method of claim 14, wherein the table is stored in one or more indexes associated with one or more secondary storage controller computers.

17. The method of claim 14, further comprising presenting the secondary copy of the database file as a file system in a user interface, and wherein the request to read the portion is generated in response to selection of the one or more database objects that correspond to the portion within the user interface.