Decreasing a site cache capacity in a distributed file system

• US 10,452,619 B1
• Filed: 12/22/2015
• Issued: 10/22/2019
• Est. Priority Date: 12/05/2014
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Panghal, Vijay, Quah, Kee Shen, Javadekar, Shrinand
• Primary Examiner(s): Dudek, Jr., Edward J
• Assistant Examiner(s): Russell, Andrew
• Application Number:
  US14/978,520
• Time in Patent Office: 1,400 Days
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/178 Techniques for file synchronisation in file systems
• CPC Class Codes: G06F 16/182 Distributed file systems

Abstract

An indication to retire a computer readable storage medium from the site cache is received. A plurality of data objects stored on the computer readable storage medium are replicated to at least one target computer readable storage medium in the site cache. The computer readable storage medium is removed from the site cache.

Claims

1. A method comprising:

decreasing a storage capacity of a site cache portion to which read and write operations of an external client are directed when the site cache is operating, by performing operations comprising;

receiving an indication to retire a computer readable storage medium from the site cache;

performing a first replication process by replicating a plurality of data objects stored on a first computer readable storage medium to a replication computer readable storage medium in the site cache, and replicating a plurality of data objects includes updating a local metadata store and/or a metadata server with information that identifies the replicated data objects; and

removing the first computer readable storage medium from the site cache; and

performing, after the first replication process, a second replication process that includes querying the local metadata store to identify the data objects to be replicated by the second replication process, and then transmitting the data objects identified in the query of the metadata store from the replication computer readable storage medium to a second computer readable storage medium in the site cache.

2. The method of claim 1, wherein the first computer readable storage medium is removed before replicating the plurality of data objects from that first computer readable storage medium to the replication computer readable storage medium.

3. The method of claim 1, wherein the second computer readable storage medium to which some of the plurality of data objects are replicated from the replication computer readable storage medium is an operational computer readable storage medium that has been added to the site cache.

4. The method of claim 1, wherein the first computer readable storage medium is removed after replicating the plurality of data objects from that first computer readable storage medium to the replication computer readable storage medium.

5. The method as recited in claim 1, wherein receiving an indication to retire a computer readable storage medium from the site cache comprises receiving an indication that the first computer readable storage medium is failing and should be removed from the site cache.

6. The method as recited in claim 1, further comprising periodically polling the process of replicating a plurality of data objects stored on the first computer readable storage medium to the replication computer readable storage medium to determine when that replication process is complete.

7. The method as recited in claim 1, wherein fewer than all of the plurality of objects stored on the replication computer readable storage medium are replicated to the second computer readable storage medium in the site cache.

8. The method as recited in claim 1, further comprising continuing to service client read and/or write requests while the site cache is being resized.

9. The method as recited in claim 1, wherein removing the computer readable storage medium from the site cache comprises physically removing the first computer readable storage medium from a physical system of the site cache.

10. A system comprising a non-transitory computer readable storage medium having stored therein computer-executable instructions, and a processor configured to execute the instructions and the instructions, when executed by the processor, perform operations comprising:

decreasing a storage capacity of a site cache portion to which read and write operations of an external client are directed when the site cache is operating, by;

receiving an indication to retire a computer readable storage medium from the site cache;

performing a first replication process by replicating a plurality of data objects stored on a first computer readable storage medium to a replication computer readable storage medium in the site cache, and replicating a plurality of data objects includes updating a local metadata store and/or a metadata server with information that identifies the replicated data objects; and

removing the first computer readable storage medium from the site cache; and

performing, after the first replication process, a second replication process that includes querying the local metadata store to identify the data objects to be replicated by the second replication process, and then transmitting the data objects identified in the query of the metadata store from the replication computer readable storage medium to a second computer readable storage medium in the site cache.

11. The system of claim 10, wherein the first computer readable storage medium is removed before replicating the plurality of data objects from that first computer readable storage medium to the replication computer readable storage medium.

12. The system of claim 10, wherein the second computer readable storage medium to which some of the plurality of data objects are replicated from the replication computer readable storage medium is an operational computer readable storage medium that has been added to the site cache.

13. The system of claim 10, wherein the first computer readable storage medium is removed after replicating the plurality of data objects from that first computer readable storage medium to the replication computer readable storage medium.

14. The system as recited in claim 10, wherein receiving an indication to retire a computer readable storage medium from the site cache comprises receiving an indication that the first computer readable storage medium is failing and should be removed from the site cache.

15. A non-transitory computer readable storage medium comprising computer-executable instructions which, when executed by a processor, perform operations comprising:

decreasing a storage capacity of a site cache portion to which read and write operations of an external client are directed when the site cache is operating, by;

receiving an indication to retire a computer readable storage medium from the site cache;

performing a first replication process by replicating a plurality of data objects stored on a first computer readable storage medium to a replication computer readable storage medium in the site cache, and replicating a plurality of data objects includes updating a local metadata store and/or a metadata server with information that identifies the replicated data objects; and

removing the first computer readable storage medium from the site cache; and

performing, after the first replication process, a second replication process that includes querying the local metadata store to identify the data objects to be replicated by the second replication process, and then transmitting the data objects identified in the query of the metadata store from the replication computer readable storage medium to a second computer readable storage medium in the site cache.

16. The non-transitory computer readable storage medium of claim 15, wherein the first computer readable storage medium is removed before replicating the plurality of data objects from that first computer readable storage medium to the replication computer readable storage medium.

17. The non-transitory computer readable storage medium of claim 15, wherein the second computer readable storage medium to which some of the plurality of data objects are replicated from the replication computer readable storage medium is an operational computer readable storage medium that has been added to the site cache.

18. The non-transitory computer readable storage medium of claim 15, wherein the first computer readable storage medium is removed after replicating the plurality of data objects from that first computer readable storage medium to the replication computer readable storage medium.

19. The computer readable storage medium as recited in claim 15, wherein the operations further comprise periodically polling the process of replicating a plurality of data objects stored on the first computer readable storage medium to the replication computer readable storage medium to determine when that replication process is complete.

20. The computer readable storage medium as recited in claim 15, wherein fewer than all of the plurality of objects stored on the replication computer readable storage medium are replicated to the second computer readable storage medium in the site cache.

21. The computer readable storage medium as recited in claim 15, wherein the operations further comprise continuing to service client read and/or write requests while the site cache is being resized.

22. The computer readable storage medium as recited in claim 15, wherein the operations further comprise continuing to service client read and/or write requests while the second replication process is being performed.

23. The computer readable storage medium as recited in claim 15, wherein the second replication process is performed after the first computer readable storage medium is removed from the site cache.