Disk scrubbing

• US 8,543,556 B2
• Filed: 05/29/2012
• Issued: 09/24/2013
• Est. Priority Date: 09/04/2010
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Nagpal, Abhinay R., Patil, Sandeep R., Shah, Dhaval K., Stein, Yan W.
• Primary Examiner(s): NGUYEN, PHONG H
• Application Number:
  US13/483,046
• Publication Number:
  US 20120239631A1
• Time in Patent Office: 483 Days
• Field of Search: 707/692, 707/693, 707/758
• US Class Current: 707/692
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 2211/1088 Scrubbing in RAID systems with parity
• CPC Class Codes: G06F 2212/7205 Cleaning, compaction, garbage collection, erase control
• CPC Class Codes: G06F 3/0652 Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket

Abstract

A method, a system, and a computer-readable storage medium are provided for data management. The method may comprise identifying a predefined set of data storage parameters and a predefined set of data scrubbing parameters. The method further may comprise determining the predefined set of data scrubbing parameters for first data in a first data storage based on the predefined set of data storage parameters for the first data and performing data scrubbing for the first data using the determined predefined set of data scrubbing parameters. Furthermore, the method may comprise comparing first data in the first data storage and corresponding second data in a second data storage. Upon determining a mismatch between the first data and the second data, the method further may comprise synchronizing the first data with the second data as a result of the comparison.

Claims

1. A computing device implemented method for data management, the method comprising:

determining, by operation of one or more processors, a predefined set of data scrubbing parameters for first data in a first data storage based on a predefined set of data storage parameters for the first data, wherein the predefined set of data scrubbing parameters comprises data scrubbing block size, and wherein the predefined set of data storage parameters comprises a cloud data storage topology;

comparing the first data in the first data storage and corresponding second data in a second data storage;

synchronizing the first data with the second data upon determining a mismatch between the first data and the second data; and

performing data scrubbing for the first data in accordance with the determined predefined set of data scrubbing parameters, wherein the first data is scrubbed at a finer granular level as a result of a smaller data scrubbing block size.

2. The method of claim 1, wherein the predefined set of data storage parameters further comprises at least one of data storage type and data storage configuration.

3. The method of claim 1, wherein the predefined set of data scrubbing parameters further comprises data scrubbing frequency.

4. The method of claim 2, wherein the data storage type comprises at least one of a solid state disk (SSD), a hard disk (HD), an optics-based storage, and a photonics-based storage.

5. The method of claim 2, wherein the data storage configuration comprises a redundant array of independent disks (RAID) configuration.

6. The method of claim 1, further comprising:

identifying the predefined set of data storage parameters; and

identifying the predefined set of data scrubbing parameters.

7. A non-transitory computer-readable medium storing an application, which, when executed on a processor, performs a data management operation, the operation comprising:

determining a predefined set of data scrubbing parameters for first data in a first data storage based on a predefined set of data storage parameters for the first data, wherein the predefined set of data scrubbing parameters comprises data scrubbing block size, and wherein the predefined set of data storage parameters comprises a cloud data storage topology;

comparing the first data in the first data storage and corresponding second data in a second data storage;

synchronizing the first data with the second data upon determining a mismatch between the first data and the second data; and

performing data scrubbing for the first data in accordance with the determined predefined set of data scrubbing parameters, wherein the first data is scrubbed at a finer granular level as a result of a smaller data scrubbing block size.

8. The computer-readable storage medium of claim 7, wherein the predefined set of data storage parameters further comprises at least one of data storage type and data storage configuration.

9. The computer-readable storage medium of claim 7, wherein the predefined set of data scrubbing parameters further comprises data scrubbing frequency.

10. The computer-readable storage medium of claim 8, wherein the data storage type comprises at least one of a solid state disk (SSD), a hard disk (HD), an optics-based storage, and a photonics-based storage.

11. The computer-readable storage medium of claim 8, wherein the data storage configuration comprises a redundant array of independent disks (RAID) configuration.

12. The computer-readable storage medium of claim 7, wherein the operation further comprises:

identifying the predefined set of data storage parameters; and

identifying the predefined set of data scrubbing parameters.

13. A system comprising:

a processor; and

a memory storing a program, which, when executed on the processor, performs a data management operation, the operation comprising;

determining a predefined set of data scrubbing parameters for first data in a first data storage based on a predefined set of data storage parameters for the first data, wherein the predefined set of data scrubbing parameters comprises data scrubbing block size, and wherein the predefined set of data storage parameters comprises a cloud data storage topology;

comparing the first data in the first data storage and corresponding second data in a second data storage;

synchronizing the first data with the second data upon determining a mismatch between the first data and the second data; and

performing data scrubbing for the first data in accordance with the determined predefined set of data scrubbing parameters, wherein the first data is scrubbed at a finer granular level as a result of a smaller data scrubbing block size.

14. The system of claim 13, wherein the predefined set of data storage parameters further comprises at least one of data storage type and data storage configuration.

15. The system of claim 13, wherein the predefined set of data scrubbing parameters further comprises data scrubbing frequency.

16. The system of claim 14, wherein the data storage type comprises at least one of a solid state disk (SSD), a hard disk (HD), an optics-based storage, and a photonics-based storage.

17. The system of claim 14, wherein the data storage configuration comprises a redundant array of independent disks (RAID) configuration.

18. The system of claim 13, wherein the operation further comprises:

identifying the predefined set of data storage parameters; and

identifying the predefined set of data scrubbing parameters.