Systems and methods for database archiving

• US 9,659,076 B2
• Filed: 01/19/2016
• Issued: 05/23/2017
• Est. Priority Date: 07/20/2012
• Status: Active Grant

• Current Assignee: CommVault Systems Incorporated
• Original Assignee: CommVault Systems Incorporated
• Inventors: Kumarasamy, Paramasivam, Vallabhaneni, Brahmaiah
• Primary Examiner(s): Fan, Shiow-Jy
• Application Number:
  US15/001,057
• Publication Number:
  US 20160239555A1
• Time in Patent Office: 490 Days
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/2094 Redundant storage or storage space G06F11/2056 takes precedence
• CPC Class Codes: G06F 16/214 Database migration support
• CPC Class Codes: G06F 16/219 Managing data history or versioning querying versioned data G06F16/2474; querying temporal data G06F16/2477
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Abstract

A data storage system according to certain aspects can archive database data associated with different database applications. The data storage system according to certain aspects may provide database archiving modules that include logic incorporating and/or based on the native schema and/or native commands specific to particular database applications. The database archiving modules according to certain aspects may determine the relationship between tables associated with corresponding database applications and archive selected database data based on the native schema and native commands.

Claims

1. A method of archiving database data of a first database application in a networked data storage system, the method comprising:

with a first data agent separate from the first database application and executing on a first computing device comprising computer hardware;

receiving instructions to archive a first subset of data in the first database, the first database organized as a plurality of tables and stored in one or more first storage devices residing in a primary storage subsystem together with the first computing device, the first subset of data contained in one or more first tables of the plurality of tables, the first database generated by a first database application residing on the first computing device, wherein the primary storage subsystem stores an aggregated group of data of the first database designated for archiving prior to said receiving instructions to archive the first subset of data, the aggregated group of data being separate from the first database;

identifying a second subset of data in the first database, the second subset referenced by the first subset and contained in one or more second tables of the plurality of tables;

obtaining the first and second subsets of data from the first database;

adding the first and second subsets to the aggregated group of data of the first database, the aggregated group of data including data accumulated from a plurality of prior archiving requests such that archived data can be copied from the primary storage subsystem to a secondary storage subsystem more efficiently and with less storage operations than in a piecemeal manner;

deleting at least the first and second subsets of data from the first database; and

subsequent to said adding, determining that the aggregated group of data designated for archiving, including the first and second subsets, should be copied to one or more secondary storage devices in the secondary storage subsystem; and

with a secondary storage controller computer, copying the aggregated group of data from the primary storage subsystem to the one or more secondary storage devices, and

wherein the first subset includes at least a first data item and the second subset includes at least one data item referenced by the first data item.

2. The method of claim 1, wherein said identifying comprises using a native schema of the first database application to identify the second subset of data as being referenced by the first subset of data.

3. The method of claim 2, wherein said obtaining comprises using native commands of the first database application to obtain the first and second subsets of data.

4. The method of claim 3, wherein said deleting comprises using native commands of the first database application to delete at least the first and second subsets of data.

5. The method of claim 1, wherein the aggregated group of data resides in a temporary staging area.

6. The method of claim 5, wherein the temporary staging area resides on the one or more first storage devices.

7. The method of claim 1, wherein the secondary storage subsystem is in networked communication with the primary storage system.

8. A data storage system configured to archive data generated by one or more database applications, the data storage system comprising:

one or more first storage devices residing in a primary storage subsystem;

one or more secondary storage devices residing in a secondary storage subsystem;

one or more secondary storage controller computers; and

a plurality of client computing devices residing in the primary storage subsystem and including a first client computing device that is associated with the one or more first storage devices and comprises a first database application and a first data agent residing thereon, the first data agent being separate from the first database application and configured to;

receive instructions to archive a first subset of data in a first database, the first database organized as a plurality of tables and stored in the one or more first storage devices residing in the primary storage subsystem, the first subset of data contained in one or more first tables of the plurality of tables, the first database generated by the first database application, wherein the primary storage subsystem stores an aggregated group of data of the first database designated for archiving prior to said receiving instructions to archive the first subset of data, the aggregated group of data being separate from the first database;

identify a second subset of data in the first database, the second subset referenced by the first subset and contained in one or more second tables of the plurality of tables;

obtain the first and second subsets of data from the first database;

add the first and second subsets to the aggregated group of data of the first database, the aggregated group of data including data accumulated from a plurality of prior archiving requests such that archived data can be copied from the primary storage subsystem to the secondary storage subsystem more efficiently and with less storage operations than in a piecemeal manner;

delete at least the first and second subsets of data from the first database and

subsequent to the addition of the first and second subsets to the aggregated group of data designated for archiving, determine that the aggregated group of data designated for archiving, including the first and second subsets, should be copied to the one or more secondary storage devices in the secondary storage subsystem,

the one or more secondary storage controller computers configured to copy the aggregated group of data from the primary storage subsystem to the one or more secondary storage devices, and

wherein the first subset includes at least a first data item and the second subset includes at least one data item referenced by the first data item.

9. The system of claim 8, wherein the first data agent is configured to identify the second subset of data using a native schema of the first database application.

10. The system of claim 8, wherein the first data agent is configured to obtain the first and second subsets by interacting with the first database application using native commands of the first database application.

11. The system of claim 8, wherein the first data agent is configured to delete at least the first and second subsets by interacting with the first database application using native commands of the first database application.

12. The system of claim 8, wherein the aggregated group of data resides in a temporary staging area.

13. The system of claim 12, wherein the temporary staging area resides on the one or more first storage devices.

14. A non-transitory computer readable medium comprising instructions for archiving data generated by one or more database applications in a networked data storage system, where the instructions when executed by a computing system comprising one or more computing devices, cause the computing system to perform a method comprising:

receiving instructions to archive a first subset of data in a first database, the first database organized as a plurality of tables and stored in one or more first storage devices residing in a primary storage subsystem together with the first computing device, the first subset of data contained in one or more first tables of the plurality of tables, the first database generated by a first database application residing on the first computing device, wherein the primary storage subsystem stores an aggregated group of data of the first database designated for archiving prior to said receiving instructions to archive the first subset of data, the aggregated group of data being separate from the first database;

identifying a second subset of data in the first database, the second subset referenced by the first subset and contained in one or more second tables of the plurality of tables;

obtaining the first and second subsets of data from the first database;

adding the first and second subsets to the aggregated group of data, the aggregated group of data including data accumulated from a plurality of prior archiving requests, such that archived data can be copied from the primary storage subsystem to a secondary storage subsystem more efficiently and with less storage operations than in a piecemeal manner;

deleting at least the first and second subsets of data from the first database

subsequent to said adding, determining that the aggregated group of data designated for archiving, including the first and second subsets, should be copied to the one or more secondary storage devices in the secondary storage subsystem; and

copying the aggregated group of data from the primary storage subsystem to the one or more secondary storage devices, and

wherein the first subset includes at least a first data item and the second subset includes at least one data item referenced by the first data item.

15. The non-transitory computer readable medium of claim 14, wherein said identifying comprises using a native schema of the first database application to identify the second subset of data as being referenced by the first subset of data.

16. The non-transitory computer readable medium of claim 15, wherein said obtaining comprises using native commands of the first database application to obtain the first and second subsets of data.

17. The non-transitory computer readable medium of claim 14, wherein said deleting comprises using native commands of the first database application to delete at least the first and second subsets of data.

18. The non-transitory computer readable medium of claim 14, wherein the aggregated group of data resides in a temporary staging area.

19. The non-transitory computer readable medium of claim 18, wherein the temporary staging area resides on the one or more first storage devices.

20. The method of claim 15, wherein the secondary storage subsystem is in networked communication with the primary storage system.