Asynchronous data store operations including selectively returning a value from cache or a value determined by an asynchronous computation

• US 10,540,282 B2
• Filed: 05/02/2017
• Issued: 01/21/2020
• Est. Priority Date: 05/02/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Iyengar, Arun
• Primary Examiner(s): Gossage, Glenn
• Application Number:
  US15/584,345
• Publication Number:
  US 20180322055A1
• Time in Patent Office: 994 Days
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/084 with a shared cache
• CPC Class Codes: G06F 12/0868 Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
• CPC Class Codes: G06F 12/0893 Caches characterised by their organisation or structure
• CPC Class Codes: G06F 2212/1024 Latency reduction
• CPC Class Codes: G06F 2212/154 Networked environment
• CPC Class Codes: G06F 2212/163 Server or database system
• CPC Class Codes: G06F 2212/263 Network storage, e.g. SAN or NAS
• CPC Class Codes: G06F 2212/313 In storage device
• CPC Class Codes: G06F 2212/465 Structured object, e.g. database record

Abstract

A processing system server and methods for performing asynchronous data store operations. The server includes a processor which maintains a cache of objects in communication with the server. The processor executes an asynchronous computation to determine the value of a first object. In response to a request for the first object occurring before the asynchronous computation has determined the value of the first object, a value of the first object is returned from the cache. In response to a request for the first object occurring after the asynchronous computation has determined the value of the first object, a value of the first object determined by the asynchronous computation is returned. The asynchronous computation may comprise at least one future, such as a ListenableFuture, or at least one process or thread. Execution of an asynchronous computation may occur with a frequency correlated with how frequently the object changes or how important it is to have a current value of the object. The asynchronous computation may receive different values from at least two servers and may determine the value of an object based on time stamps.

Claims

1. In a processing system comprised of a server, a method for the server to provide data values, the method comprising:

the server maintaining a cache of objects communicatively coupled with the server;

the server executing an asynchronous computation to determine the value of a first object;

returning a value of the first object from the cache of objects in response to a request for the first object occurring before the asynchronous computation has determined the value of the first object;

returning a value of the first object determined by the asynchronous computation, in response to a request for the first object occurring after the asynchronous computation has determined the value of the first object;

providing a datatype which includes a field for a value and a field for a future; and

invoking computer code to lookup at least one data value corresponding to a key which returns an object of the datatype wherein the field for a value comprises a cached value corresponding to the key and the field for a future comprises a future which asynchronously calculates an updated value corresponding to the key.

2. The method of claim 1 wherein the asynchronous computation comprises at least one future.

3. The method of claim 1 wherein the asynchronous computation comprises at least one process or thread.

4. The method of claim 1, further comprising:

updating the cache of objects with the value of the first object determined by the asynchronous computation, in response to the asynchronous computation determining the value of the first object.

5. The method of claim 1 wherein the server executing an asynchronous computation occurs in response to a request for the first object.

6. The method of claim 1 wherein the server executing an asynchronous computation occurs periodically.

7. The method of claim 1 wherein the server executing an asynchronous computation occurs after a time interval has elapsed.

8. The method of claim 1 wherein the server executing an asynchronous computation occurs with a frequency correlated with how frequently the first object changes.

9. The method of claim 1 wherein the server executing an asynchronous computation occurs with a frequency correlated with how important it is to have a current value of the first object.

10. The method of claim 1 wherein the asynchronous computation determines the value of the first object by querying at least one additional server.

11. The method of claim 10 further comprising:

the server storing an object o2 in the cache of objects;

the server executing an asynchronous computation c2 to store object o2 on the at least one additional server; and

satisfying a request for object o2 from the cache of objects, in response to receiving the request for object o2 before the asynchronous computation c2 has finished executing.

12. The method of claim 10 wherein said at least one additional server comprises a plurality of servers and the asynchronous computation receives different values from at least two servers of the plurality of servers.

13. The method of claim 12 wherein the asynchronous computation determines the value of the first object from a value which appears most frequently in the different values received from the at least two servers of the plurality of servers.

14. The method of claim 12 wherein said different values have time stamps associated with them, and wherein the asynchronous computation determines the value of the first object based on the time stamps of the different values received from the at least two servers of the plurality of servers.

15. The method of claim 10 further comprising:

executing an asynchronous computation c2 to store an object o2 on the at least one additional server.

16. The method of claim 15 further comprising:

updating the cache of objects with the value of object o2, in response to the asynchronous computation c2 storing object o2 on the at least one additional server.

17. The method of claim 15 wherein the asynchronous computation c2 includes an error handling method, and wherein the method further comprises:

using the error handling method to retry storing object o2 on the at least one additional server, in response to the asynchronous computation c2 failing to store object o2.

18. The method of claim 1 wherein said computer code comprises a method or function to lookup the at least one data value.

19. A processing system comprising:

a server including at least one processor;

persistent memory;

a network interface device for communicating with one or more networks; and

wherein the at least one processor is communicatively coupled with the persistent memory and the network interface device, the at least one processor, responsive to executing computer instructions, performing operations comprising;

maintaining a cache of objects communicatively coupled with the server;

executing an asynchronous computation to determine the value of a first object;

providing a datatype which includes a field for a value and a field for a future;

invoking computer code to lookup at least one data value corresponding to a key which returns an object of the datatype wherein the field for a value comprises a cached value corresponding to the key and the field for a future comprises a future which asynchronously calculates an updated value corresponding to the key;

looking up, using the invoked computer code, a value of the first object and returning a value of the first object from the cache of objects, in response to receiving a key corresponding to the first object and a request for the first object occurring before the asynchronous computation has determined the value of the first object; and

looking up, using the invoked computer code, a value of the first object and returning a value of the first object determined by the asynchronous computation, in response to receiving a key corresponding to the first object and a request for the first object occurring after the asynchronous computation has determined the value of the first object.

20. The processing system of claim 19, wherein the asynchronous computation comprises at least one future.

21. The processing system of claim 19, the at least one processor, responsive to executing computer instructions, further performing operations comprising:

updating the cache of objects with the value of the first object determined by the asynchronous computation, in response to the asynchronous computation determining the value of the first object.

22. The processing system of claim 19, wherein the server executing the asynchronous computation occurs in response to a request for the first object.

23. The processing system of claim 19, wherein the server executing the asynchronous computation occurs periodically.

24. The processing system of claim 19, wherein the server executing the asynchronous computation occurs after a time interval has elapsed.

25. The processing system of claim 19, wherein the server executing the asynchronous computation occurs with a frequency correlated with how frequently the first object changes.