SERVERLESS SOLUTION FOR OPTIMIZATION OF OBJECT VERSIONING

• US 20200134030A1
• Filed: 10/26/2018
• Published: 04/30/2020
• Est. Priority Date: 10/26/2018
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Natanzon, Assaf, Saad, Yossef
• Granted Patent: US 11,281,635 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/162 Delete operations erasing in storage systems G06F3/0652
• CPC Class Codes: G06F 16/1873 Versioning file systems, temporal file systems, e.g. file system supporting different historic versions of files
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0641 De-duplication techniques
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/5022 Mechanisms to release resources
• CPC Class Codes: G06F 9/54 Interprogram communication

Abstract

One example method includes implementing a function as a service (FaaS) at a datacenter by performing operations including receiving an application program interface (API) gateway call from a client application, wherein the API gateway call is associated with an object PUT request, and automatically triggering, with the API gateway call, performance of an object insertion function. The object insertion function includes retrieving, from backend object storage, a previous version of the object, differentially compressing the object relative to the previous version of the object so as to generate a differential, and storing the differential in the backend object storage.

Claims

1. A method, comprising:

implementing a function as a service (FaaS) at a datacenter by performing operations including;

receiving an application program interface (API) gateway call from a client application, wherein the API gateway call is associated with an object PUT request; and

automatically triggering, with the API gateway call, performance of an object insertion function that comprises;

retrieving, from backend object storage, a previous version of the object;

differentially compressing the object relative to the previous version of the object so as to generate a differential; and

storing the differential in the backend object storage.

2. The method as recited in claim 1, further comprising receiving an API gateway call associated with an object GET request, and automatically triggering, with the API gateway call associated with the object GET request, performance of an object read function that comprises:

retrieving, from the backend object storage, an object version identified in the GET request and, when the object version is a differential, also retrieving from the backend object storage, a prior full copy of the object version and any differentials created after the prior full copy was created;

when the object version is a differential, rebuilding the object version using the prior full copy and any differentials; and

returning the object version.

3. The method as recited in claim 1, wherein the differential is smaller in size than both the object and the previous version of the object.

4. The method as recited in claim 1, wherein when the size of the differential exceeds a defined threshold, the differential is not stored.

5. The method as recited in claim 1, further comprising decompressing the object prior to differentially compressing the object.

7. The method as recited in claim 1, further comprising receiving an API gateway call associated with an object DELETE request, and automatically triggering, with the API gateway call associated with the object DELETE request, performance of an object delete function that comprises:

when an object version identified in the DELETE request is not a base object, deleting, from the backend object storage, the object version identified in the DELETE request;

when the object version is a base object upon which one or more differential object versions are dependent, marking the object version as deleted, and deleting a corresponding differential object version; and

when all dependent copies of the base object are deleted, deleting the base object.

8. The method as recited in claim 1, wherein the operations further comprise forwarding the API gateway call to the backend object storage.

9. The method as recited in claim 1, further comprising provisioning any one or more of the retrieving process, differential compression process, and differential storage process.

14. The non-transitory storage medium as recited in claim 1, wherein the operations further comprise decompressing the object prior to differentially compressing the object.

15. The non-transitory storage medium as recited in claim 14, wherein the object is a file.

17. The non-transitory storage medium as recited in claim 1, wherein the operations further comprise forwarding the API gateway call to the backend object storage.

6. The method as recited in claim 6, wherein the object is a file.

10. A non-transitory storage medium having stored therein computer-executable instructions which, when executed by one or more hardware processors, perform the following:

implementing a function as a service (FaaS) at a datacenter by performing operations including;

receiving an application program interface (API) gateway call from a client application, wherein the API gateway call is associated with an object PUT request; and

automatically triggering, with the API gateway call, performance of an object insertion function that comprises;

retrieving, from backend object storage, a previous version of the object;

differentially compressing the object relative to the previous version of the object so as to generate a differential; and

storing the differential in the backend object storage.

11. The non-transitory storage medium as recited in claim 10, wherein the operations further comprise receiving an API gateway call associated with an object GET request, and automatically triggering, with the API gateway call associated with the object GET request, performance of an object read function that comprises:

retrieving, from the backend object storage, an object version identified in the GET request and, when the object version is a differential, also retrieving from the backend object storage, a prior full copy of the object version and any differentials created after the prior full copy was created;

when the object version is a differential, rebuilding the object version using the prior full copy and any differentials; and

returning the object version.

12. The non-transitory storage medium as recited in claim 10, wherein the differential is smaller in size than both the object and the previous version of the object.

13. The non-transitory storage medium as recited in claim 10, wherein when the size of the differential exceeds a defined threshold, the differential is not stored.

16. The non-transitory storage medium as recited in claim 10, wherein the operations further comprise receiving an API gateway call associated with an object DELETE request, and automatically triggering, with the API gateway call associated with the object DELETE request, performance of an object delete function that comprises:

when an object version identified in the DELETE request is not a base object, deleting, from the backend object storage, the object version identified in the DELETE request;

when the object version is a base object upon which one or more differential object versions are dependent, marking the object version as deleted, and deleting a corresponding differential object version; and

when all dependent copies of the base object are deleted, deleting the base object.

18. The non-transitory storage medium as recited in claim 10, wherein the operations further comprise provisioning any one or more of the retrieving process, differential compression process, and differential storage process.

19. The non-transitory storage medium as recited in claim 18, wherein the API gateway call is triggered by insertion of the object in an object store.

20. A physical computing system, comprising:

one or more hardware processors; and

the non-transitory storage medium as recited in claim 10.