Primary array data dedup/compression using block backup statistics

• US 10,565,068 B1
• Filed: 04/19/2017
• Issued: 02/18/2020
• Est. Priority Date: 04/19/2017
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Don, Arieh, Benhanokh, Gabriel, Wigmore, Ian, Smaldone, Stephen
• Primary Examiner(s): Uddin, Mohammed R
• Application Number:
  US15/491,011
• Time in Patent Office: 1,035 Days
• Field of Search: 707654, 707801, 707831
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 2201/84 Using snapshots, i.e. a logical point-in-time copy of the data

Abstract

A backup copy of a production device is used to quantify suitability of host application data for placement on individual managed drives and virtualized managed drives based on storage capabilities associated with those drives. A data analysis program on a data backup storage array may generate block backup statistics to indicate that a production device or certain chunks, blocks or volumes of host application data are highly compressible or reducible via deduplication. The block backup statistics are sent from the data backup storage array to the primary storage array. The primary storage array uses the block backup statistics to select a particular storage resource with suitable storage capabilities for the data. Highly compressible data may be stored on a storage virtualization storage array with data compression capability, and data that is neither highly compressible nor reducible with deduplication may be stored on local resources.

Claims

1. A method comprising:

in a data storage system comprising a primary storage array with managed drives and a first storage virtualization storage array that maintains a first virtualized managed drive, where the first storage virtualization storage array has a first storage capability that the primary storage array lacks;

quantifying, for each extent of data of a plurality of extents of data, suitability for processing of that extent of data by the first storage capability;

selecting a most suitable extent of data based on quantified suitability; and

moving the selected most suitable extent of data to the first virtualized managed drive.

2. The method of claim 1 wherein the data storage system comprises a data backup storage array with a backup copy of a production device of the primary storage array, and comprising analyzing the backup copy with a data analysis program running on the data backup storage array to quantify suitability for processing each extent of data by the first storage capability.

3. The method of claim 2 comprising the data analysis program generating block backup statistics that represent quantified suitability for processing each extent of data by the first storage capability.

4. The method of claim 3 comprising the primary storage array selecting a set of possible drives from the virtualized managed drive and the managed drives based on performance tiering.

5. The method of claim 4 comprising selecting at least one drive of the set of possible drives based on the quantified suitability for processing each extent of data by the first storage capability.

6. The method of claim 5 wherein the data storage system comprises a second storage virtualization storage array that maintains a second virtualized managed drive, where the second storage virtualization storage array has a second storage capability that the primary storage array and the first storage virtualization storage array lack, and comprising the data analysis program running on the data backup storage array quantifying suitability for processing each extent of data by the second storage capability.

7. The method of claim 6 comprising the data analysis program generating block backup statistics that represent quantified suitability for processing each extent of data by the first storage capability and the second storage capability.

8. The method of claim 7 comprising selecting at least one drive of the set of possible drives based on the quantified suitability for processing each extent of data by the first storage capability and the second storage capability.

9. The method of claim 1 wherein the first storage capability is one of:

deduplication, compression, power conservation, performance tiering, remote replication, and support for a predetermined number of snaps, and comprising quantifying suitability of a production device with respect to the first storage capability.

10. The method of claim 1 wherein the second storage capability is one of:

deduplication, compression, power conservation, performance tiering, remote replication, and support for a predetermined number of snaps, and comprising quantifying suitability for of a production device with respect to the second storage capability.

19. The method of claim 1 wherein the first storage capability and the second storage capability are each one of:

deduplication, compression, power conservation, performance tiering, remote replication, and support for a predetermined number of snaps.

11. An apparatus comprising:

a primary storage array with managed drives;

a first storage virtualization storage array that maintains a first virtualized managed drive, where the first storage virtualization storage array has a first storage capability that the primary storage array lacks; and

an analysis program on non-transitory computer-readable memory that;

quantifies, for each extent of data of a plurality of extents of data, suitability for processing of that extent of data by the first storage capability;

selects a most suitable extent of data based on quantified suitability; and

moves the selected most suitable extent of data to the first virtualized managed drive.

12. The apparatus of claim 11 wherein the data storage system comprises a data backup storage array with a backup copy of a production device of the primary storage array, and wherein the analysis program runs on the data backup storage array and analyzes the backup copy to quantify suitability for processing each extent of data by the first storage capability.

13. The apparatus of claim 12 wherein the data analysis program generates block backup statistics that represent quantified suitability for processing each extent of data by the first storage capability.

14. The apparatus of claim 13 wherein the primary storage array comprises a tiering program on non-transitory computer-readable memory that selects a set of possible drives from the virtualized managed drive and the managed drives based on performance.

15. The apparatus of claim 14 wherein the primary storage array comprises a data placement program on non-transitory computer-readable memory that selects at least one drive of the set of possible drives based on the quantified suitability for processing each extent of data by the first storage capability.

16. The apparatus of claim 15 further comprising a second storage virtualization storage array that maintains a second virtualized managed drive, where the second storage virtualization storage array has a second storage capability that the primary storage array and the first storage virtualization storage array lack, and wherein the data analysis program running on the data backup storage array quantifies suitability for processing each extent of data by the second storage capability.

17. The apparatus of claim 16 wherein the data analysis program generates block backup statistics that represent quantified suitability for processing each extent of data by the first storage capability and the second storage capability.

18. The apparatus of claim 17 wherein the data placement program selects at least one drive of the set of possible drives based on the quantified suitability for processing each extent of data by the first storage capability and the second storage capability.

20. A system comprising:

a primary storage array with managed drives and a production device;

a data backup storage array with a backup copy of the production device;

a storage virtualization storage array that maintains a virtualized managed drive, where the storage virtualization storage array has a storage capability that the primary storage array lacks; and

an analysis program on non-transitory computer-readable memory of the data backup storage array that;

quantifies suitability for processing the production device with the storage capability; and

generates block backup statistics that represent quantified suitability for processing the production device with the storage capability; and

a data placement program on non-transitory computer-readable memory of the primary storage array that;

selects either the managed drives or the virtualized managed drive for storage of the production device based on the block backup statistics; and

moves the production device in accordance with the selection.