Speculative and coordinated data access in a hybrid memory server

• US 8,954,490 B2
• Filed: 06/24/2010
• Issued: 02/10/2015
• Est. Priority Date: 06/24/2010
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chan, Yuk Lung, Krishnamurthy, Rajaram B., Parris, Carl Joseph
• Primary Examiner(s): Zong, Ruolei
• Application Number:
  US12/822,790
• Publication Number:
  US 20110320523A1
• Time in Patent Office: 1,692 Days
• Field of Search: 709/203, 709/201, 709217-219, 711/117, 711/118, 711/137
• US Class Current: 709/203
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/172 Caching, prefetching or hoarding of files
• CPC Class Codes: G06F 16/182 Distributed file systems

Abstract

A method, accelerator system, and computer program product, for prefetching data from a server system in an out-of-order processing environment. A plurality of prefetch requests associated with one or more given data sets residing on the server system are received from an application on the server system. Each prefetch request is stored in a prefetch request queue. A score is assigned to each prefetch request. A set of the prefetch requests are selected from the prefetch queue that comprise a score above a given threshold. A set of data, for each prefetch request in the set of prefetch requests, is prefetched from the server system that satisfies each prefetch request, respectively.

Claims

1. A method, on a server system in an out-of-core processing environment comprising the server system, at least one accelerator system, and at least one user client, for speculatively managing data at the server system, the method comprising:

receiving a request to access a given data set from the at least one user client, wherein the given data set resides on one or more storage devices communicatively coupled to the server system, and wherein the server system manages the given data set;

identify, based on the request, at least a portion of the given data set that satisfies the request;

retrieving at least the portion of the given data set that has been identified; and

passing at least one of the request and at least the portion of the given data set that has been identified to the accelerator system, wherein the accelerator system is configured to generate a resulting data set based on processing the portion of the at least the portion of the given data set, and wherein the accelerator system is separate and distinct from the server system.

2. The method of claim 1, wherein the receiving further comprises:

establishing a tunnel protocol between the user client and the accelerator system.

3. The method of claim 1, further comprising:

receiving from the accelerator system a pull request for data associated with the given data set.

4. The method of claim 3, further comprising:

identifying at least a portion of the given data set that satisfies the pull request;

determining that at least the portion of the given data is associated with a set of related data; and

sending at least the portion of the given data and the set of related data to the accelerator system.

5. The method of claim 4, wherein determining that at least the portion of the given data is associated with a set of related data further comprises:

analyzing a set of semantic information associated with a current state of an application utilizing the given data set; and

selecting, in response to the analyzing, the set of related data from a larger set of related data.

6. The method of claim 1, further comprising:

determining that an amount of data to satisfy the request to access is above a given threshold; and

passing the request along with at least the portion of the given data set that has been identified to the accelerator system.

7. The method of claim 1, further comprising:

identifying at least one additional data set to be required by the user client a future point in time, wherein the identifying is based on requests to access other data sets associated with the given data set received from other user clients; and

passing the at least one additional data set to the accelerator system prior to the at least one additional data set being requested by the user client.

8. A server system in an out-of-core processing environment comprising the server system, at least one accelerator system, and at least one user client for speculatively managing data at the server system, the server system comprising:

a memory;

a processor communicatively coupled to the memory; and

a data access manager communicatively coupled to the memory and the processor, the data access manager configured to perform a method comprising;

receiving a request to access a given data set from the at least one user client, wherein the given data set resides on one or more storage devices communicatively coupled to the server system, and wherein the server system manages the given data set;

identify, based on the request, at least a portion of the given data set that satisfies the request;

retrieving at least the portion of the given data set that has been identified; and

passing at least one of the request and at least the portion of the given data set that has been identified to the accelerator system, wherein the accelerator system is configured to generate a resulting data set based on processing the portion of the at least the portion of the given data set, and wherein the accelerator system is separate and distinct from the server system.

9. The server system of claim 8, wherein the receiving further comprises:

establishing a tunnel protocol between the user client and the accelerator system.

10. The server system of claim 8, wherein the method further comprises:

receiving from the accelerator system a pull request for data associated with the given data set.

11. The server system of claim 10, wherein the method further comprises:

identifying at least a portion of the given data set that satisfies the pull request;

determining that at least the portion of the given data is associated with a set of related data; and

sending at least the portion of the given data and the set of related data to the accelerator system.

12. The server system of claim 11, wherein determining that at least the portion of the given data is associated with a set of related data further comprises:

analyzing a set of semantic information associated with a current state of an application utilizing the given data set; and

selecting, in response to the analyzing, the set of related data from a larger set of related data.

13. The server system of claim 8, wherein the method further comprises:

identifying at least one additional data set to be required by the user client a future point in time, wherein the identifying is based on requests to access other data sets associated with the given data set received from other user clients; and

passing the at least one additional data set to the accelerator system prior to the at least one additional data set being requested by the user client.

14. A method, on a server system in an out-of-core processing environment comprising the server system, at least one accelerator system, and at least one user client, for speculatively managing data at the server system, the method comprising:

receiving a request to access a given data set from the at least one user client, wherein the given data set resides on one or more storage devices communicatively coupled to the server system, and wherein the server system manages the given data set;

identifying, based on the request, at least a portion of the given data set that satisfies the request;

retrieving at least the portion of the given data set that has been identified; and

passing at least the portion of the given data set that has been identified to the user client, wherein the passing further comprises

determining that an amount of data to satisfy the request to access is below a given threshold; and

passing, based on determining that the amount of data to satisfy the request is below a given threshold, at least the portion of the given data set that has been identified to the user client.

15. A computer program product for speculatively managing data at a server system in an out-of-core processing environment comprising the server system, at least one accelerator system, and at least one user client, the computer program product comprising:

a non-transitory storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising;

receiving a request to access a given data set from the at least one user client, wherein the given data set resides on one or more storage devices communicatively coupled to the server system, and wherein the server system manages the given data set;

identify, based on the request, at least a portion of the given data set that satisfies the request;

retrieving at least the portion of the given data set that has been identified; and

passing at least one of the request and at least the portion of the given data set that has been identified to the accelerator system, wherein the accelerator system is configured to generate a resulting data set based on processing the portion of the at least the portion of the given data set, and wherein the accelerator system is separate and distinct from the server system.

16. The computer program product of claim 15, wherein the receiving further comprises:

establishing a tunnel protocol between the user client and the accelerator system.

17. The computer program product of claim 15, wherein the method further comprises:

receiving from the accelerator system a pull request for data associated with the given data set.

18. The computer program product of claim 17, wherein the method further comprises:

identifying at least a portion of the given data set that satisfies the pull request;

determining that at least the portion of the given data is associated with a set of related data; and

sending at least the portion of the given data and the set of related data to the accelerator system.

19. The computer program product of claim 18, wherein determining that at least the portion of the given data is associated with a set of related data further comprises:

analyzing a set of semantic information associated with a current state of an application utilizing the given data set; and

selecting, in response to the analyzing, the set of related data from a larger set of related data.

20. The computer program product of claim 15, wherein the method further comprises:

determining that an amount of data to satisfy the request to access is above a given threshold; and

passing the request along with at least the portion of the given data set that has been identified to the accelerator system.

21. The computer program product of claim 15, wherein the method further comprises:

identifying at least one additional data set to be required by the user client a future point in time, wherein the identifying is based on requests to access other data sets associated with the given data set received from other user clients; and

passing the at least one additional data set to the accelerator system prior to the at least one additional data set being requested by the user client.

22. A server system in an out-of-core processing environment comprising the server system, at least one accelerator system, and at least one user client for speculatively managing data at the server system, the server system comprising:

a memory;

a processor communicatively coupled to the memory; and

a data access manager communicatively coupled to the memory and the processor, the data access manager configured to perform a method comprising;

receiving a request to access a given data set from the at least one user client, wherein the given data set resides on one or more storage devices communicatively coupled to the server system, and wherein the server system manages the given data set;

identifying, based on the request, at least a portion of the given data set that satisfies the request;

retrieving at least the portion of the given data set that has been identified; and

passing at least the portion of the given data set that has been identified to the user client, wherein the passing further comprises

determining that an amount of data to satisfy the request to access is below a given threshold; and

passing, based on determining that the amount of data to satisfy the request is below a given threshold, at least the portion of the given data set that has been identified to the user client.

23. A computer program product for speculatively managing data at a server system in an out-of-core processing environment comprising the server system, at least one accelerator system, and at least one user client, the computer program product comprising:

a non-transitory storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising;

receiving a request to access a given data set from the at least one user client, wherein the given data set resides on one or more storage devices communicatively coupled to the server system, and wherein the server system manages the given data set;

identifying, based on the request, at least a portion of the given data set that satisfies the request;

retrieving at least the portion of the given data set that has been identified; and

passing at least the portion of the given data set that has been identified to the user client, wherein the passing further comprises

determining that an amount of data to satisfy the request to access is below a given threshold; and

passing, based on determining that the amount of data to satisfy the request is below a given threshold, at least the portion of the given data set that has been identified to the user client.