Method for using redundant data elimination to accelerate storage system scanning

• US 10,089,308 B1
• Filed: 09/30/2008
• Issued: 10/02/2018
• Est. Priority Date: 09/30/2008
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Stacey, Christopher H. E., Cardente, John
• Primary Examiner(s): Harper, Eliyah S
• Application Number:
  US12/241,531
• Time in Patent Office: 3,654 Days
• Field of Search: 707636, 707652, 707999102, 707999104, 707783
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

Embodiments are directed to methods and apparatus for making available to at least one scanning tool, information about at least one data unit shared among multiple storage objects of a plurality of storage objects stored on a storage system. The at least one scanning tool can use the information to influence at least one scanning operation on the at least some of the plurality of storage objects. Embodiments may be implemented in a computer system comprising at least one application program, at least one mapping layer that makes available to the at least one application program a plurality of storage objects, and a storage system that stores data in each of the plurality of storage objects in one or more data units. The at least one computer system further comprises the at least one scanning tool that performs the at least one scanning operation on at least some of the plurality of storage objects, and at least one redundant data elimination tool that eliminates at least some redundant data by sharing at least one of the data units among multiple storage objects.

Claims

1. A method for use in a computer system comprising at least one mapping layer that makes available a plurality of storage objects, and a storage system that stores data in each of the plurality of storage objects in one or more data blocks, the method comprising:

reducing space usage on the storage system, using a redundant data elimination tool, of at least some redundant data by sharing at least one of the data blocks among multiple storage objects;

generating information about the at least one of the data blocks shared among multiple storage objects, wherein the information identifies the storage objects that include shared data blocks;

assigning to the plurality of storage objects a scanning priority based at least in part on the information about the at least one of the data blocks shared among multiple storage objects, wherein a higher scanning priority is assigned for storage objects having redundant data blocks shared among multiple storage objects over storage objects that do not include a shared data block; and

performing, using at least one scanning tool, at least one scanning operation on at least some of the plurality of storage objects wherein ones of the storage objects having a higher scanning priority are scanned prior to ones of the objects having a lower scanning priority.

2. The method of claim 1, further comprising:

receiving the information about the at least one of the data blocks shared among multiple storage objects at the at least one scanning tool.

3. The method of claim 1, wherein the information is used by the at least one scanning tool to reduce scanning of data blocks shared by multiple storage objects.

4. The method of claim 1, wherein the information is used to assign a higher priority to storage objects containing data blocks that are shared among multiple storage objects.

5. The method of claim 1, further comprising:

providing the information about the at least one of the data blocks shared among multiple storage objects to the at least one scanning tool.

6. The method of claim 5, wherein the at least one mapping layer provides the information to the at least one scanning tool.

7. The method of claim 6, wherein the at least one mapping layer comprises a file system.

8. At least one non-transitory computer readable medium encoded with a plurality of instructions that, when executed, perform a method for use in a computer system comprising at least one mapping layer that makes available a plurality of storage objects, and a storage system that stores data in each of the plurality of storage objects in one or more data blocks, the method comprising:

reducing space usage on the storage system, using a redundant data elimination tool, of at least some redundant data by sharing at least one of the data blocks among multiple storage objects;

generating information about the at least one of the data blocks shared among multiple storage objects, wherein the information identifies the storage objects that include shared data blocks;

assigning to the plurality of storage objects a scanning priority based at least in part on the information about the at least one of the data blocks shared among multiple storage objects, wherein a higher scanning priority is assigned for storage objects having redundant data blocks shared among multiple storage objects over storage objects that do not include a shared data block; and

performing, using at least one scanning tool, at least one scanning operation on at least some of the plurality of storage objects wherein ones of the storage objects having a higher scanning priority are scanned prior to ones of the objects having a lower scanning priority.

9. The at least one computer readable medium of claim 8, wherein the method further comprises:

receiving the information about the at least one of the data blocks shared among multiple storage objects at the at least one scanning tool.

10. The at least one computer readable medium of claim 9, wherein the information is used by the at least one scanning tool to reduce scanning of data blocks shared by multiple storage objects.

11. The at least one computer readable medium of claim 9, wherein the information is used to assign a higher priority to storage objects containing data blocks that are shared among multiple storage objects.

12. The at least one computer readable medium of claim 8, wherein the at least one mapping layer provides the information about the at least one of the data blocks shared among multiple storage objects to the at least one scanning tool, and wherein the at least one mapping layer is a file system.

13. At least one computer system, comprising:

at least one mapping layer that makes available a plurality of storage objects;

a storage system that stores data in each of the plurality of storage objects in one or more data blocks;

at least one scanning tool that performs at least one scanning operation on at least some of the plurality of storage objects;

at least one redundant data elimination tool, different from the at least one scanning tool, that reduces space usage on the storage system of at least some redundant data by sharing at least one of the data blocks among multiple storage objects; and

at least one processor programmed to;

generate information about the at least one of the data blocks shared among multiple storage objects, wherein the information identifies the storage objects that include shared data blocks;

assign to the plurality of storage objects a scanning priority based at least in part on the information about the at least one of the data blocks shared among multiple storage objects, wherein a higher scanning priority is assigned for storage objects having redundant data blocks shared among multiple storage objects over storage objects that do not include a shared data block; and

perform, using at least one scanning tool, at least one scanning operation on at least some of the plurality of storage objects wherein ones of the storage objects having a higher scanning priority are scanned prior to ones of the objects having a lower scanning priority.

14. The at least one computer of claim 13, wherein the at least one processor is programmed to receive the information about the at least one of the data blocks shared among multiple storage objects at the at least one scanning tool.

15. The at least one computer of claim 13, wherein the at least one processor is programmed to make available the information about the at least one of the data blocks shared among multiple storage objects to the at least one scanning tool.

16. The at least one computer of claim 15, wherein the at least one mapping layer comprises a file system and the making available to the at least one scanning tool information about the at least one of the data blocks shared among multiple storage objects is performed by the file system.