Removing invalid data from a dataset in advance of copying the dataset

• US 10,482,061 B1
• Filed: 08/22/2017
• Issued: 11/19/2019
• Est. Priority Date: 12/01/2014
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Golden, Christopher, Vachharajani, Neil, Grunwald, David, Smith, Scott, Cao, Jianting, Paulsen, Luke, Gonzalez, Ricardo
• Primary Examiner(s): Ly, Anh
• Application Number:
  US15/682,618
• Time in Patent Office: 819 Days
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 16/128 Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion use of snapshots for error detection or correction G06F11/14, G06F11/16
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0646 Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0652 Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD

Abstract

Systems, methods, and computer readable storage mediums for optimizing performance in a storage system. A volume may be mapped to an anchor medium through an indirection layer. When a snapshot is taken of the volume, the allocation of a new anchor medium is delayed until a write operation targeting the volume is received. When a write operation targeting the volume is received, a new anchor medium may be allocated for only a portion of the volume corresponding to the portion of the volume which is targeted by the write operation. Also, when a snapshot is taken of the volume, read optimization operations are performed only the portions of the volume which have changed since the previous snapshot.

Claims

1. A method comprising:

overwriting one or more first portions of a volume, wherein one or more second portions of the volume remain unchanged;

detecting a request to perform a first operation on the volume;

performing, by a storage controller, background operations on the one or more first portions of the volume that were overwritten;

preventing, by the storage controller, background operations from being performed on the one or more second portions of the volume that remain unchanged since the previous operation; and

performing the first operation on the volume.

2. The method of claim 1 wherein the request to perform the first operation on the volume includes a request to take a snapshot of the volume.

3. The method of claim 1 wherein the request to perform the first operation on the volume includes a request to perform an extended copy of the volume.

4. The method of claim 1 wherein the background operations include a read optimization operation.

5. The method of claim 1 wherein the background operations include a garbage collection operation.

6. The method of claim 1 wherein performing background operations on the one or more first portions of the volume causes invalid data to be removed from the volume and performing the first operation on the volume results in a copy of the volume being created, wherein the copy of the volume that is created does not include the invalid data that was removed from the volume.

7. A system comprising:

one or more storage devices; and

a storage controller coupled to the one or more storage devices, wherein the storage controller is configured to;

overwrite one or more first portions of a volume, wherein one or more second portions of the volume remain unchanged;

detect a request to perform a first operation on the volume;

perform background operations on the one or more first portions of the volume that were overwritten;

prevent background operations from being performed on the one or more second portions of the volume that remain unchanged since the previous operation; and

perform the first operation on the volume.

8. The system of claim 7 wherein the request to perform the first operation on the volume includes a request to take a snapshot of the volume.

9. The system of claim 7 wherein the request to perform the first operation on the volume includes a request to perform an extended copy of the volume.

10. The system of claim 7 wherein the background operations include a read optimization operation.

11. The system of claim 7 wherein the background operations include a garbage collection operation.

12. The system of claim 7 wherein performing background operations on the one or more first portions of the volume causes invalid data to be removed from the volume and performing the first operation on the volume results in a copy of the volume being created, wherein the copy of the volume that is created does not include the invalid data that was removed from the volume.

13. A non-transitory computer readable storage medium storing program instructions, wherein the program instructions are executable by a processor to:

overwrite one or more first portions of a volume, wherein one or more second portions of the volume remain unchanged;

detect a request to perform a first operation on the volume;

perform, by a storage controller, background operations on the one or more first portions of the volume that were overwritten;

prevent, by a storage controller, background operations from being performed on the one or more second portions of the volume that remain unchanged since the previous operation; and

perform the first operation on the volume.

14. The non-transitory computer readable storage medium of claim 13 wherein the request to perform the first operation on the volume includes a request to take a snapshot of the volume.

15. The non-transitory computer readable storage medium of claim 13 wherein the request to perform the first operation on the volume includes a request to perform an extended copy of the volume.

16. The non-transitory computer readable storage medium of claim 13 wherein the background operations include a read optimization operation.

17. The non-transitory computer readable storage medium of claim 13 wherein the background operations include a garbage collection operation.

18. The non-transitory computer readable storage medium of claim 13 wherein performing background operations on the one or more first portions of the volume causes invalid data to be removed from the volume and performing the first operation on the volume results in a copy of the volume being created, wherein the copy of the volume that is created does not include the invalid data that was removed from the volume.