Power efficient data storage with data de-duplication

• US 7,870,409 B2
• Filed: 09/26/2007
• Issued: 01/11/2011
• Est. Priority Date: 09/26/2007
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Murase, Atsushi
• Primary Examiner(s): BUTLER, DENNIS
• Application Number:
  US11/902,824
• Publication Number:
  US 20090083563A1
• Time in Patent Office: 1,203 Days
• Field of Search: 713/300, 713/320, 713/324, 711/114, 711/162
• US Class Current: 713/324
• CPC Class Codes: G06F 1/3268 Power saving in hard disk drive
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 11/1456 Hardware arrangements for backup
• CPC Class Codes: G06F 11/1458 Management of the backup or restore process
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0625 Power saving in storage systems
• CPC Class Codes: G06F 3/0634 by changing the state or mode of one or more devices
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management
• CPC Class Codes: Y02D 30/50 in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

A storage system includes a first de-duplication scope comprising a first volume, a first table of hash values corresponding to first chunks of data stored on the first volume, and a first table of logical block addresses of where the chunks of data are stored on the first volume. A second de-duplication scope includes similar information for a second volume. The first scope is used for de-duplicating and storing first data from a first data source and the second scope is used for de-duplicating and storing second data from a second data source. First storage mediums that make up the first volume remain powered off while de-duplication and storage of the second data on the second volume takes place, and second storage mediums that make up the second volume remain powered off while de-duplication and storage of the first data takes place, thereby enabling data de-duplication while saving power.

Claims

1. A storage system comprising:

a controller in communication with one or more first storage mediums and one or more second storage mediums; and

a first volume having storage capacity allocated from the one or more first storage mediums,

wherein initially said one or more first storage mediums and said one or more second storage mediums are configured in a powered off condition,

wherein said controller is configured to receive an instruction for first data to be stored to said first volume, and place said one or more first storage mediums in a powered on condition while said one or more second storage mediums remain powered off,

wherein content of said first data received by said controller is compared with content of any existing data stored in said first volume, and

wherein when results of the comparison show that the content of said data does not match the content of said existing data in said first volume, said first data is stored to said first volume.

2. A storage system according to claim 1,

wherein when the results of the comparison show that the content of the first data matches the content of said existing data stored in said first volume, a first record is stored linking an identifier of the first data with an identifier of the existing data, and the first data is discarded.

3. A storage system according to claim 2,

wherein, following completion of storing of said first data to said first volume when the content of the first data does not match or storing of the record when the content of the first data does match, said one or more first storage mediums are powered off.

4. A storage system according to claim 3, further comprising:

a second volume having storage capacity allocated from said one or more second storage mediums,

wherein said controller receives an instruction for second data to be stored to said second volume,

wherein said controller configures said one or more second storage mediums in a powered on condition while said one or more first storage mediums remain powered off,

wherein content of said second data received by said controller is compared with content of any existing data stored in said second volume,

wherein, when results of the comparison show that the content of said second data does not match the content of said existing data in said second volume, said second data is stored to said second volume,

wherein, when the results of the comparison show that the content of the second data matches the content of said existing data stored in said second volume, a second record is stored linking an identifier of the second data with an identifier of the existing data stored in said second volume, and the second data is discarded, and

wherein, following completion of storing of said second data to said second volume when the content of said second data does not match or storing of the record when the content of said second data does match, said one or more second storage mediums are powered off.

5. A storage system according to claim 1,

wherein a first hash value is calculated for the content of said first data, and during said comparison, said first hash value is compared with second hash values calculated for the content of the existing data stored on said first volume to determine whether a direct comparison of the content of the first data with the content of the existing data on said first volume should be conducted.

6. A storage system according to claim 1,

wherein there are a plurality of said first storage mediums, said first storage mediums being configured in a first array group, said first volume having storage capacity allocated from said first array group,

wherein there are a plurality of said second storage mediums, said second storage mediums being configured in a second array group, a second volume having storage capacity allocated from said second array group, and

wherein said first and second array groups are configured to be powered on and off by said controller independently of each other.

7. A storage system according to claim 1, further comprising:

a first de-duplication scope including said first volume, a first table of hash values corresponding to first chunks of data stored on said first volume, and a first table of logical block addresses of where the chunks of data are stored on said first volume; and

a second de-duplication scope including said second volume, a second table of hash values corresponding to second chunks of data stored on said second volume, and a second table of logical block addresses of where the second chunks of data are stored on said second volume,

wherein said first scope is configured for use in de-duplicating and storing data from a first data source and said second scope is configured for use in de-duplicating and storing data from a second data source.

8. A storage system according to claim 7,

wherein a first application computer produces first application data stored in a first source volume as said first data source and a second application computer produces second application data stored in a second source volume as said second data source, and

wherein a management computer in communication with said storage system periodically instructs said storage system to backup said first source volume to said first volume using said first scope and said second source volume to said second volume using said second scope.

9. An information system comprising:

a storage system including a controller in communication with one or more first storage mediums and one or more second storage mediums;

a first volume having storage capacity allocated from said one or more first storage mediums;

a second volume having storage capacity allocated from said one or more second storage mediums,

a first de-duplication scope including said first volume, a first table of hash values corresponding to first chunks of data stored on said first volume, and a first table of logical block addresses of where the chunks of data are stored on said first volume; and

a second de-duplication scope including said second volume, a second table of hash values corresponding to second chunks of data stored on said second volume, and a second table of logical block addresses of where the second chunks of data are stored on said second volume,

wherein said first scope is configured for use in de-duplicating and storing first data from a first data source and said second scope is configured for use in de-duplicating and storing second data from a second data source.

10. An information system according to claim 9,

wherein said one or more first storage mediums and said one or more second storage mediums are initially configured in a powered off condition,

wherein said controller is configured to receive an instruction for storing said first data from said first data source, identify said first volume, said first table of hash values and said first table of logical block addresses corresponding to said first scope, and place said one or more first storage mediums in a powered on condition while said one or more second storage mediums remain powered off,

wherein said controller is configured to carry out said de-duplicating and storing said first data by comparing content of said first data received by said controller with content of any existing data stored in said first volume, and

wherein when results of the comparison show that the content of said data does not match the content of said existing data in said first volume, said first data is stored to said first volume.

11. An information system according to claim 10,

wherein when the results of the comparison show that the content of the first data matches the content of said existing data stored in said first volume, a first record is stored linking an identifier of the first data with an identifier of the existing data, and the first data is discarded.

12. An information system according to claim 11,

wherein, following completion of storing of said first data to said first volume when the content of the first data does not match or storing of the record when the content of the first data does match, said one or more first storage mediums are powered off.

13. An information system according to claim 10,

wherein a first hash value is calculated for the content of said first data, and during said comparison, said first hash value is compared with second hash values calculated for the content of the existing data stored on said first volume to determine whether a direct comparison of the content of the first data with the content of the existing data on said first volume should be conducted.

14. An information system according to claim 9,

wherein there are a plurality of said first storage mediums, said first storage mediums being configured in a first array group, said first volume having storage capacity allocated from said first array group,

wherein there are a plurality of said second storage mediums, said second storage mediums being configured in a second array group, said second volume having storage capacity allocated from said second array group, and

wherein said first and second array groups are configured to be powered on and off by said controller independently of each other.

15. An information system according to claim 9,

wherein a first application computer produces first application data stored in a first source volume as said first data source and a second application computer produces second application data stored in a second source volume as said second data source, and

wherein a management computer in communication with said storage system periodically instructs said storage system to backup said first source volume to said first volume using said first scope and said second source volume to said second volume using said second scope.

16. A method of operating a storage system having a controller in communication with one or more first storage mediums and one or more second storage mediums, the method comprising:

allocating a first volume from said one or more first storage mediums;

allocating a second volume from said one or more second storage mediums;

configuring said one or more first storage mediums and said one or more second storage mediums in a powered off condition;

receiving an instruction for storing first data to said first volume;

configuring said one or more first storage mediums in a powered on condition while said one or more second storage mediums remain powered off;

dividing said first data into divided portions of a predetermined size, wherein any existing data stored on said first volume is stored as chunks of the predetermined size;

comparing content of each divided portion with any existing chunks already stored on said first volume;

for each divided portion, storing said divided portion to said first volume as a new chunk when results of said comparison of said divided portion show that the content of said divided portion does not match the content of said existing chunks on said first volume; and

storing a record linking an identifier of the divided portion with an identifier of the existing data and discarding the divided portion of the first data when the results of the comparison of said divided portion show that the content of said divided portion does match the content of one of said existing chunks on said first volume.

17. A method according to claim 16, further including a step of

turning off the power to the one or more first storage mediums after the content of all of said divided portions has been compared with the content of said existing chunks and said divided portions have either been stored to said first volume as a new chunk, or the record is stored linking the identifier of the divided portion with the identifier of the existing data.

18. A method according to claim 16, further including steps of

calculating a first hash value for the content of each said divided portion;

and

the step of comparing the content of the divided portion includes comparing said first hash value with second hash values calculated for the content of any existing data stored on said first volume to determine whether a direct comparison of the content of any of the first divided portions with the existing data should be conducted.

19. A method according to claim 16, further including steps of

configuring a first de-duplication scope including said first volume, a first table of hash values corresponding to first chunks of data stored on said first volume, and a first table of logical block addresses of where the chunks of data are stored on said first volume;

and

configuring a second de-duplication scope including said second volume, a second table of hash values corresponding to second chunks of data stored on said second volume, and a second table of logical block addresses of where the second chunks of data are stored on said second volume,

wherein said first scope is configured for use in de-duplicating and storing said first data from a first data source and said second scope is configured for use in de-duplicating and storing second data from a second data source.

20. A method according to claim 19, further including steps of

producing first application data in a first application computer, said first application data being stored in a first source volume as said first data source;

producing second application data in a second computer, said second application data being stored in a second source volume as said second data source; and

periodically instructing said storage system to backup said first source volume to said first volume using said first scope and to backup said second source volume to said second volume using said second scope.