Caching for data store clients

• US 10,320,933 B2
• Filed: 06/21/2018
• Issued: 06/11/2019
• Est. Priority Date: 12/31/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Iyengar, Arun
• Primary Examiner(s): Lazaro, David R
• Assistant Examiner(s): Shitayewoldetadik, Berhanu
• Application Number:
  US16/014,404
• Publication Number:
  US 20180302491A1
• Time in Patent Office: 355 Days
• Field of Search: 709213
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 21/602 Providing cryptographic facilities or services
• CPC Class Codes: G06F 2212/154 Networked environment
• CPC Class Codes: G06F 2212/62 Details of cache specific to multiprocessor cache arrangements
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

Methods, systems and computer program products for enhanced storage clients. An interface for using a storage service is provided. The interface for each storage service of a plurality of storage services can be implemented within a storage client. A cache can be integrated within the storage client for reducing a number of accesses to a storage service of the plurality of storage services. A compression method in the storage client can reduce a size of data objects. An encryption method in the storage client can preserve data privacy. An application can select at least one storage service of the plurality of storage services and use the at least one storage service via the storage client.

Claims

1. A computer-implemented method comprising:

providing an interface for using a storage service;

implementing the interface within a storage client, the interface implemented for each of a plurality of storage services;

integrating a cache within the storage client for reducing a number of accesses to a storage service of the plurality of storage services;

associating an object expiration time with at least one object stored in the cache;

keeping the at least one object in the cache after the object expiration time has passed;

selecting, by an application, through the interface via the storage client at least one storage service in the plurality of storage services and using the at least one storage service via the interface within the storage client;

monitoring a latency for data accesses from the storage client to the at least one storage service of the plurality of storage services;

increasing an amount of caching in response to determining based on the monitored latency for data accesses that the latency is increasing; and

decreasing the amount of caching in response to determining based on the monitored latency for data accesses that the latency is decreasing.

2. The computer-implemented method of claim 1, further comprising:

the storage client contacting a storage service to determine if the at least one object is current;

in response to determining that the at least one object is current, the storage client updating the expiration time with a new expiration time provided by the storage service; and

in response to determining that the at least one object is not current, updating the cache with a new version of the at least one object provided by the storage service.

3. The computer-implemented method of claim 1, further comprising:

in response to the at least one storage service being unresponsive or responding too slowly, the application using the cache to allow the application to continue without communicating with the at least one storage service.

4. The method of claim 1, further comprising:

providing a compression method in the storage client to reduce a size of data objects.

5. The computer-implemented method of claim 4, further comprising:

varying a frequency of compressing data from a computer program based on assessing costs and benefits of compressing the data.

6. The computer-implemented method of claim 1, further comprising:

storing a data object in the at least one storage service;

for each of a plurality of updates to the data object, storing a delta corresponding to each of the plurality of updates in the at least one storage service, wherein the delta encodes a difference between a new version of the data object and a previous version of the data object; and

storing a complete updated version of the data object in the at least one storage service in response to at least one of;

(1) a number of deltas from the previous version of the data object exceeds a first threshold;

(2) a total size of deltas from the previous version of the data object exceeds a second threshold;

or (3) the client determines that a cost of determining an updated version of the data object by applying deltas to the previous version exceeds a third threshold.

7. The computer-implemented method of claim 1, further comprising:

providing an encryption method in the storage client to preserve data privacy.

8. The computer-implemented method of claim 1, wherein the cache further comprises one of an in-process cache or a remote process cache.

9. The computer-implemented method of claim 1, wherein the cache further comprises one of Redis or memcached.

10. The computer-implemented method of claim 1, wherein the interface further comprises a key-value interface.

11. An information processing system comprising:

a storage client comprising an integrated cache for reducing a number of accesses to a storage service of a plurality of storage services;

a memory; and

a processor communicatively coupled to the memory and to the storage client, wherein the processor, responsive to executing computer instructions, performs operations comprising;

providing an interface for using a storage service via the storage client;

implementing the interface within the storage client, the interface implemented for each of a plurality of storage services;

associating an object expiration time with at least one object stored in the cache;

keeping the at least one object in the cache after the object expiration time has passed;

selecting, by an application, through the interface via the storage client at least one storage service in the plurality of storage services and using the at least one storage service via the interface within the storage client;

monitoring a latency for data accesses from the storage client to the at least one storage service of the plurality of storage services;

increasing an amount of caching in response to determining based on the monitored latency for data accesses that the latency is increasing; and

decreasing the amount of caching in response to determining based on the monitored latency for data accesses that the latency is decreasing.

12. The information processing system of claim 11, wherein the processor, responsive to executing the computer instructions, performs operations comprising:

the storage client contacting a storage service to determine if the at least one object is current;

in response to determining that the at least one object is current, the storage client updating the expiration time with a new expiration time provided by the storage service; and

in response to determining that the at least one object is not current, updating the cache with a new version of the at least one object provided by the storage service.

13. The information processing system of claim 11, wherein the processor, responsive to executing the computer instructions, performs operations comprising:

storing a data object in the at least one storage service;

for each of a plurality of updates to the data object, storing a delta corresponding to each of the plurality of updates in the at least one storage service, wherein the delta encodes a difference between a new version of the data object and a previous version of the data object; and

storing a complete updated version of the data object in the at least one storage service in response to at least one of;

(1) a number of deltas from the previous version of the data object exceeds a first threshold;

(2) a total size of deltas from the previous version of the data object exceeds a second threshold;

or (3) the client determines that a cost of determining an updated version of the data object by applying deltas to the previous version exceeds a third threshold.

14. A non-transitory computer readable storage medium, comprising computer instructions which, responsive to being executed by a processor cause the processor to perform operations, the processor being in an information processing system comprised of a memory communicatively coupled with the processor, and a storage client comprising an integrated cache for reducing a number of accesses to a storage service of a plurality of storage services, and wherein the processor, responsive to executing the computer instructions, performs operations comprising:

providing an interface for using a storage service via the storage client;

implementing the interface for each of a plurality of storage services;

associating an object expiration time with at least one object stored in the cache;

keeping the at least one object in the cache after the object expiration time has passed;

selecting, by an application, through the interface via the storage client at least one storage service in the plurality of storage services and using the at least one storage service via the interface within the storage client;

monitoring a latency for data accesses from the storage client to the at least one storage service of the plurality of storage services;

increasing an amount of caching in response to determining based on the monitored latency for data accesses that the latency is increasing; and

decreasing the amount of caching in response to determining based on the monitored latency for data accesses that the latency is decreasing.

15. The computer readable storage medium of claim 14, wherein the processor, responsive to executing the computer instructions, performs operations comprising:

the storage client contacting a storage service to determine if the at least one object is current;

in response to determining that the at least one object is current, the storage client updating the expiration time with a new expiration time provided by the storage service; and

in response to determining that the at least one object is not current, updating the cache with a new version of the at least one object provided by the storage service.

16. The computer readable storage medium of claim 14, wherein the processor, responsive to executing the computer instructions, performs operations comprising:

providing a compression method in the storage client to reduce a size of data objects; and

varying a frequency of compressing data from a computer program based on assessing costs and benefits of compressing the data.