Distributed file systems on content delivery networks

• US 10,021,212 B1
• Filed: 03/27/2015
• Issued: 07/10/2018
• Est. Priority Date: 12/05/2014
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Desai, Rajiv
• Primary Examiner(s): Meky, Moustafa M
• Application Number:
  US14/671,675
• Time in Patent Office: 1,201 Days
• CPC Class Codes: G06F 12/0833 in combination with broadcast means (e.g. for invalidation or updating)
• CPC Class Codes: G06F 12/121 using replacement algorithms
• CPC Class Codes: G06F 16/182 Distributed file systems
• CPC Class Codes: G06F 16/1827 Management specifically adapted to NAS management of storage area networks [SAN] G06F3/067
• CPC Class Codes: G06F 2212/62 Details of cache specific to multiprocessor cache arrangements
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata

Abstract

A method, article of manufacture, and apparatus for accessing a distributed file system using a content delivery network is discussed. An IO request for an object is received at a metadata server comprising metadata mapping a plurality of objects to an object store. An object identifier associated with the object and a CDN domain associated with the object store are determined. A URL is generated from the object identifier and the CDN domain. The URL is then returned to the client.

Claims

1. A method for accessing data, at a client, using a content delivery network (CDN), the method comprising:

receiving a request associated with an object at a metadata server, wherein the metadata server comprises metadata mapping a plurality of objects to an object store, wherein the request includes a communication between the client and the metadata server;

determining an object identifier associated with the requested object and a CDN domain associated with the object store;

generating a URL from the object identifier and the CDN domain;

returning the URL to the client; and

performing an IO request, by the client, with the CDN or the object store, using the URL generated from the object identifier and the CDN domain, wherein the IO request includes a communication between the client and the CDN or the object store.

2. The method of claim 1, wherein the object store is a cloud storage provider physically separated from the metadata server.

3. The method of claim 1, wherein the IO request is a read request.

4. The method of claim 3, wherein the object comprises a plurality of data segments stored on the object store.

5. The method of claim 4, further comprising:

determining segment identifiers for each of the plurality of data segments;

generating a plurality of URLs from the segment identifiers and the CDN domain; and

returning the plurality of URLs to the client as the URL.

6. The method of claim 1, wherein the IO request is a write request.

7. The method of claim 6, wherein the write request comprises a plurality of data segment identifiers associated with a plurality of data segments to write to the object store, wherein the data segments are pieces of data forming the data object, and wherein the data segment identifiers collectively are the object identifier.

8. The method of claim 7, further comprising determining at the metadata server whether the object store contains each of the data segments.

9. The method of claim 8, wherein the URL comprises a plurality of write URLs for the data segments the object store does not contain.

10. A non-transitory computer readable storage medium comprising processor instructions for accessing data using a content delivery network (CDN), the instructions comprising:

receiving a request associated with an object at a metadata server from a client, wherein the metadata server comprises metadata mapping a plurality of objects to an object store, wherein the request includes a communication between the client and the metadata server;

determining an object identifier associated with the object and a CDN domain associated with the object store;

generating a URL from the object identifier and the CDN domain; and

returning the URL to the client; and

performing an IO request, by the client, with the CDN or the object store, using the URL generated from the object identifier and the CDN domain, wherein the IO request includes a communication between the client and the CDN or the object store.

11. The non-transitory computer readable storage medium of claim 10, wherein the IO request is a read request.

12. The non-transitory computer readable storage medium of claim 11, wherein the object comprises a plurality of data segments stored on the object store.

13. The non-transitory computer readable storage medium of claim 12, further comprising:

determining segment identifiers for each of the plurality of data segments;

generating a plurality of URLs from the segment identifiers and the CDN domain; and

returning the plurality of URLs to the client as the URL.

14. The non-transitory computer readable storage medium of claim 10, wherein the IO request is a write request.

15. The non-transitory computer readable storage medium of claim 14, wherein the write request comprises a plurality of data segment identifiers associated with a plurality of data segments to write to the object store, wherein the data segments are pieces of data forming the data object, and wherein the data segment identifiers collectively are the object identifier.

16. A system for accessing data using a content delivery network (CDN), the system comprising a non-transitory computer readable medium and processor enabled to execute instructions for:

receiving an IO request for an object at a metadata server from a client, wherein the metadata server comprises metadata mapping a plurality of objects to an object store;

determining an object identifier associated with the object and a CDN domain associated with the object store;

generating a URL from the object identifier and the CDN domain; and

returning the URL to the client; and

performing an IO request, by the client, with the CDN or the object store, using the URL generated from the object identifier and the CDN domain, wherein the IO request includes a communication between the client and the CDN or the object.

17. The system of claim 16, wherein the IO request is a read request.

18. The system of claim 17, wherein the object comprises a plurality of data segments stored on the object store.

19. The system of claim 16, wherein the IO request is a write request.

20. The system of claim 19, wherein the write request comprises a plurality of data segment identifiers associated with a plurality of data segments to write to the object store, wherein the data segments are pieces of data forming the data object, and wherein the data segment identifiers collectively are the object identifier.