Centralized content addressed storage

• US 9,317,222 B1
• Filed: 04/24/2007
• Issued: 04/19/2016
• Est. Priority Date: 04/24/2006
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Yueh, Jedidiah
• Primary Examiner(s): Tsai, Sheng-Jen
• Application Number:
  US11/739,311
• Time in Patent Office: 3,283 Days
• Field of Search: 711/162
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1469 Backup restoration techniques
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 2201/815 Virtual
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

A centralized content addressed storage (CAS) application and a method for providing data protection are implemented by running a CAS application on a virtualization layer of a computer platform. The virtualization layer presents to the CAS application a normalized representation of a hardware subsystem of the computer platform, shielding the CAS application from actual hardware devices of the computer platform. A storage device of the computer platform is used to store a raw data set and the CAS application generates a backup data set of the raw data set. The CAS application stores the backup data set to an archive mechanism of the computer platform and can also restore and recover the raw data set in the event it is lost, corrupted or otherwise destroyed. Multiple CAS applications can be operated separately or together and they may be the same or differ.

Claims

1. A method for providing data protection, comprising:

providing a virtualization layer on a computer architecture comprising a storage device storing a raw data set and a hardware subsystem;

running a first instance of a content addressed storage (CAS) application on the virtualization layer to create a backup data set from the raw data set, wherein the virtualization layer shields the content addressed storage application from the hardware subsystem by presenting a representation of a set of components of the hardware subsystem to the first instance of the CAS application;

running a second instance of the CAS application on the virtualization layer or on another virtualization layer, wherein both the first instance of the CAS application and the second instance of the CAS application are configured for backup operations and recovery operations; and

storing the backup data set to the representation of the set of components, wherein the backup data set is stored in an archive mechanism, and wherein data in the backup data set stored in the archive mechanism and created by the first instance of the CAS application can be recovered and restored by the second instance of the CAS application,

wherein the first instance of the CAS application and the second instance of the CAS application are configurable to operate as independent instances and are configurable to operate together as a single CAS system to backup the same raw data set.

2. The method of claim 1, further comprising running an additional CAS application on the virtualization layer to create an additional backup data set from the raw data set, wherein the virtualization later presents a representation of another set of components of the hardware subsystem to the additional CAS application.

3. The method of claim 2, wherein the CAS application and the additional CAS application differ from each other.

4. The method of claim 1, wherein the virtualization layer and the first instance of the CAS application constitute a virtual machine installed and run on the computer architecture as an application, and wherein the virtualization layer relies on a host operating system for device support and physical resource management of the computer architecture.

5. The method of claim 4, further comprising the virtualization layer presenting a guest operating system to at least one of the first CAS application and the additional CAS application.

6. The method of claim 1, wherein the computer architecture further comprises an archive mechanism, the method further comprising storing the backup data set to the archive mechanism.

7. The method of claim 6, wherein the archive mechanism comprises one or more of:

a tape device;

a disk device; and

an optical device.

8. The method of claim 1, further comprising using at least one of the first instance of the CAS application and the second instance of the CAS application to generate a recovered version of the raw data set on the hardware subsystem based on the backup data set.

9. The method of claim 8, further comprising, prior to generating the recovered version of the raw data set on the hardware subsystem, receiving a recovery request from a user.

10. A method for centralized content addressed storage, the method comprising:

providing a virtualization layer on a computer architecture that includes a storage device for storing raw data including point-in-time raw data;

operating a storage system that includes a first instance of a storage application and a second instance of the storage application, the first instance of the storage application including a first content storage addressed storage system on the virtualization layer;

operating a second instance of the storage application including a second content storage addressed storage system on the virtualization layer or on another virtualization layer, wherein the first and second instances of the storage application are configurable to operate independently in the computer architecture and are configurable to operate together as a single CAS system in the computer architecture, wherein both the first instance of the storage application and the second instance of the storage application are configured for backup operations and recovery operations;

presenting a virtualized representation of the computer architecture to the first instance of the storage application with the virtualization layer, wherein the first storage application is shielded from the computer architecture by the virtualization layer;

processing the raw data to create backup data that includes space efficient versions of the raw data with each of the first and second instances of the storage application;

storing the space efficient versions of the raw data to an archive mechanism in the computer architecture,

wherein both the first and the second instances of the storage application are operable to recover and restore the space efficient versions of the raw data stored in the archive mechanism created by either or both of the first and the second instances of the storage application when the first and second instances of the storage application operate independently and when the first and second instances of the storage application operate cooperatively as the single CAS application, and

wherein the storage system is configured to span both real and virtual environments.

11. The method of claim 10, wherein processing the raw data to create space efficient versions of the raw data further comprises:

storing a particular data object a single time;

matching a unique identifier with the particular data object; and

providing the data object with a content address.

12. The method of claim 10, wherein providing a virtualization layer on a computer architecture further comprises pooling the computer architecture.

13. The method of claim 10, wherein at least one of the first and second instances of the storage application comprises a virtual machine running on the virtualization layer and wherein the virtualization layer presents a virtualized representation of the computer architecture to an operating system of the virtual machine.

14. The method of claim 10, wherein at least one of the first and second instances of the storage application comprises a virtual machine that is installed as an application and relies on a host operating system of a host and presents a guest operating system to the virtual machine.

15. The method of claim 10, wherein the computer architecture comprises networks and/or network devices and wherein versions of a data set stored on the resources can be accessed by any of the one or more virtual machines.

16. The method of claim 15, wherein the virtualization layer comprises a virtual infrastructure that connects resources in the computer architecture to users and wherein the virtual infrastructure provides a dynamic mapping of the resources to one or more virtual machines.

17. The method of claim 15, wherein one instance of the storage application is ported to raw data that has been archived according to storage methods of that instance of the storage application.

18. The method of claim 15, further comprising recovering a particular version of a data set based on a request from a user.

19. A content addressed storage system, comprising:

a storage system that includes a first instance of a content addressed storage (CAS) application and a second instance of the CAS application;

the first instance of the CAS application provided on a virtualization layer on a first hardware subsystem, wherein the virtualization layer shields the first instance of the CAS application from the first hardware subsystem by presenting a set of components of the first hardware subsystem to the first instance of the CAS application; and

a second instance of the CAS application provided on a second virtualization layer on a second hardware subsystem, wherein the second virtualization layer shields the second instance of the CAS application from the second hardware subsystem by presenting a set of components of the second hardware subsystem to the second instance of the CAS application,

wherein the first hardware subsystem and the second hardware subsystem are subsystems of a hardware system,

wherein the first and second instances of the CAS system are configurable to operate as independent instances and are configurable to operate together as a single CAS system to create a backup data set from a raw data set, wherein the backup data set is a space efficient version of the raw data set and is associated with both the first and the second instances of the CAS application,

wherein the backup data set stored in storage includes data from both the first and the second instances of the CAS application and wherein the backup data set can be recovered and restored by either or both the first and second instances of the CAS application when the first and second instances of the CAS application are operating as the single CAS system and when the first and second instances of the CAS application are operating as independent instances,

wherein the first instance of the CAS application and the second instance of the CAS application are configured for backup operations and recovery operations and wherein the storage system is heterogeneous and configurable to span both real and virtual environments.