Opportunistic fragmentation repair

• US 9,483,494 B1
• Filed: 03/14/2013
• Issued: 11/01/2016
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Pang, Hung Hing Anthony, Botelho, Fabiano, Ekambaram, Dhanabal, Garg, Nitin
• Primary Examiner(s): Ho, Binh V
• Application Number:
  US13/828,266
• Time in Patent Office: 1,328 Days
• Field of Search: 707/645
• US Class Current: 1/1
• CPC Class Codes: G06F 11/00 Error detection; Error correction; Monitoring error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00
• CPC Class Codes: G06F 11/1448 Management of the data involved in backup or backup restore
• CPC Class Codes: G06F 11/1453 using de-duplication of the data
• CPC Class Codes: G06F 16/1844 Management specifically adapted to replicated file systems

Abstract

Opportunistic repair of fragmentation in a synthetic backup is disclosed. In various embodiments, data generated to perform processing other than fragmentation repair is received. At least a portion of the received data is used to compute a locality measure with respect to a group of segments comprising a portion of a file. A decision whether to repair fragmentation of segments comprising the group is made based at least in part on the computed locality measure.

Claims

1. A method, comprising:

receiving data generated to perform processing other than fragmentation repair;

using at least a portion of the received data to compute a locality measure with respect to a group of segments comprising a portion of a file, wherein the locality measure is computed based at least in part on a comparison between a number of containers required to be loaded to access segments comprising the group and a reference number of containers associated with accessing segments comprising the group and wherein the locality measure is computed based at least in part on an extent to which containers that store segments comprising the group are utilized to store segments comprising the group; and

making, based at least in part on the computed locality measure and a threshold, a decision whether to repair fragmentation of the segments comprising the group, wherein to repair fragmentation of the segments comprising the group includes packing the segments into new containers to reduce a value of the computed locality measure.

2. The method of claim 1, wherein said processing other than fragmentation repair comprises file verification.

3. The method of claim 1, wherein said processing other than fragmentation repair comprises verifying that each segment comprising a synthetic backup is stored in a valid container.

4. The method of claim 1, wherein the received data includes metadata associated with a synthetic backup.

5. The method of claim 1, wherein the received data include index lookups on fingerprints of user data comprising a synthetic backup.

6. The method of claim 1, further comprising repairing fragmentation based at least in part on said decision whether to repair fragmentation.

7. The method of claim 6, wherein repairing fragmentation comprises reading segments comprising the group from one or more containers in which said segments are currently stored and packing said segments into one or more new containers.

8. The method of claim 1, further comprising detecting that a new synthetic back that uses said file as a base has been or is being generated.

9. The method of claim 8, further comprising stopping fragmentation repair processing with respect to the file based at least in part on detecting that a new synthetic back that uses said file as a base has been or is being generated.

10. The method of claim 9, wherein said file comprises a first file and further comprising beginning fragmentation repair processing with respect to a next file at a location within said next file that corresponds to a location within said first file at which location said fragmentation repair was stopped with respect to said first file.

17. The method of claim 1, wherein the received data corresponds to data received in connection with a synthetic backup process.

18. The method of claim 1, wherein the received data is received from one or more backup storage devices included a de-duplication storage system.

19. The method of claim 1, wherein locality measure is computed in connection with verification processing.

20. The method of claim 1, wherein the reference number of containers corresponds to a number of containers ideally loaded to access segments comprising the group.

11. A system, comprising:

a processor configured to;

receive data generated to perform processing other than fragmentation repair;

use at least a portion of the received data to compute a locality measure with respect to a group of segments comprising a portion of a file, wherein the locality measure is computed based at least in part on a comparison between a number of containers required to be loaded to access segments comprising the group and a reference number of containers associated with accessing segments comprising the group and wherein the locality measure is computed based at least in part on an extent to which containers that store segments comprising the group are utilized to store segments comprising the group; and

make, based at least in part on the computed locality measure and a threshold, a decision whether to repair fragmentation of the segments comprising the group, wherein to repair fragmentation of the segments comprising the group includes packing the segments into new containers to reduce a value of the computed locality measure; and

a memory coupled to the processor and configured to provide the processor with instructions.

12. The system of claim 11, wherein said processing other than fragmentation repair comprises file verification.

13. The system of claim 11, wherein the received data includes metadata associated with a synthetic backup.

14. The system of claim 11, wherein the received data include index lookups on fingerprints of user data comprising a synthetic backup.

15. The system of claim 11, wherein the processor is further configured to stop fragmentation repair processing with respect to the file based at least in part on an indication that a new synthetic back that uses said file as a base has been or is being generated.

16. A computer program product embodied in a tangible, non-transitory computer readable storage medium, comprising computer instructions for:

receiving data generated to perform processing other than fragmentation repair;

using at least a portion of the received data to compute a locality measure with respect to a group of segments comprising a portion of a file, wherein the locality measure is computed based at least in part on a comparison between a number of containers required to be loaded to access segments comprising the group and a reference number of containers associated with accessing segments comprising the group and wherein the locality measure is computed based at least in part on an extent to which containers that store segments comprising the group are utilized to store segments comprising the group; and

making, based at least in part on the computed locality measure and a threshold, a decision whether to repair fragmentation of the segments comprising the group, wherein to repair fragmentation of the segments comprising the group includes packing the segments into new containers to reduce a value of the computed locality measure.