INTERACTIVE ANALYTICS PROCESSING

• US 20110145318A1
• Filed: 12/15/2009
• Published: 06/16/2011
• Est. Priority Date: 12/15/2009
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Parris, Carl J., Boice, Charles, Liu, Lurng-Kuo, Krishnamurthy, Rajaram B.
• Granted Patent: US 8,874,638 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals

Abstract

An end-to-end record, request, response token-based protocol is used to facilitate processing of client jobs. This allows the client to forward analytical tasks of a job directly to an analytics cluster and to record an indication of such at a server. The accelerators of the cluster to perform the tasks are specified in a token provided by the server to the client.

Claims

1. A computer program product for facilitating processing of jobs in a computing environment, the computer program product comprising:

a storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising;

determining, by a client processor, whether a compute token obtained by the client processor specifies a computing unit to be used by the client processor;

in response to determining that the compute token specifies the computing unit, forwarding by the client processor at least a portion of a job to the computing unit to perform analytics processing for the job; and

providing, by the client processor to a processor coupled to the client processor, an indication that analytics processing for the job has been requested by the client processor.

2. The computer program product of claim 1, wherein the forwarding and providing are performed substantially concurrently.

3. The computer program product of claim 1, wherein the method further comprises notifying the processor of a request to use a computing unit for analytics processing, in response to determining that the compute token does not specify the computing unit.

4. The computer program product of claim 3, wherein the method further comprises:

obtaining by the client processor an identification of the computing unit to use, in response to the notifying; and

submitting the at least a portion of the job to the computing unit corresponding to the identification.

5. The computer program product of claim 1, wherein the providing comprises sending a record request packet to the processor, the record request packet comprising at least one of an identifier of the job, an identifier of the client processor, a type of the computing unit, an identifier of the computing unit, an estimated completion time for the job, and a progress field.

6. The computer program product of claim 1, wherein the method further comprises responding by the processor to the client processor, in response to receiving the indication.

7. The computer program product of claim 6, wherein the responding comprises sending a record response packet to the client processor, the record response packet comprising at least one of an identifier of the job, an identifier of the client processor, an identifier of the computing unit, and a progress field.

8. The computer program product of claim 1, wherein the computing unit comprises an accelerator.

9. The computer program product of claim 1, wherein the method further comprises:

determining by the processor that the client processor has terminated prior to completion of one or more jobs of the client processor;

checking a proxy indicator; and

directing output of the one or more jobs to the processor, in response to determining the client processor has terminated prior to completion and in response to the proxy indicator having a first defined value.

10. The computer program product of claim 9, wherein the method further comprises performing cleanup on the computing unit of the one or more jobs, in response to determining the client processor has terminated prior to completion and in response to the proxy indicator having a second defined value.

11. A computer system for facilitating processing of jobs in a computing environment, the computer system comprising:

a memory; and

a processor in communications with the memory, wherein the computer system is capable of performing a method, said method comprising;

determining, by a client processor, whether a compute token obtained by the client processor specifies a computing unit to be used by the client processor;

in response to determining that the compute token specifies the computing unit, forwarding by the client processor at least a portion of a job to the computing unit to perform analytics processing for the job; and

providing, by the client processor to a processor coupled to the client processor, an indication that analytics processing for the job has been requested by the client processor.

12. The computer system of claim 11, wherein the method further comprises notifying the processor of a request to use a computing unit for analytics processing, in response to determining that the compute token does not specify the computing unit.

13. The computer system of claim 12, wherein the method further comprises:

obtaining by the client processor an identification of the computing unit to use, in response to the notifying; and

submitting the at least a portion of the job to the computing unit corresponding to the identification.

14. The computer system of claim 11, wherein the providing comprises sending a record request packet to the processor, the record request packet comprising at least one of an identifier of the job, an identifier of the client processor, a type of the computing unit, an identifier of the computing unit, an estimated completion time for the job, and a progress field.

15. The computer system of claim 11, wherein the method further comprises responding by the processor to the client processor, in response to receiving the indication, wherein the responding comprises sending a record response packet to the client processor, the record response packet comprising at least one of an identifier of the job, an identifier of the client processor, an identifier of the computing unit, and a progress field.

16. The computer system of claim 11, wherein the method further comprises:

determining by the processor that the client processor has terminated prior to completion of one or more jobs of the client processor;

checking a proxy indicator; and

directing output of the one or more jobs to the processor, in response to determining the client processor has terminated prior to completion and in response to the proxy indicator having a first defined value.

17. The computer system of claim 16, wherein the method further comprises performing cleanup on the computing unit of the one or more jobs, in response to determining the client processor has terminated prior to completion and in response to the proxy indicator having a second defined value.

18. A method of facilitating processing of jobs in a computing environment, said method comprising:

determining, by a client processor, whether a compute token obtained by the client processor specifies a computing unit to be used by the client processor;

in response to determining that the compute token specifies the computing unit, forwarding by the client processor at least a portion of a job to the computing unit to perform analytics processing for the job; and

providing, by the client processor to a processor coupled to the client processor, an indication that analytics processing for the job has been requested by the client processor.

19. The method of claim 18, further comprising notifying the processor of a request to use a computing unit for analytics processing, in response to determining that the compute token does not specify the computing unit.

20. The method of claim 18, further comprising:

determining by the processor that the client processor has terminated prior to completion of one or more jobs of the client processor;

checking a proxy indicator; and

directing output of the one or more jobs to the processor, in response to determining the client processor has terminated prior to completion and in response to the proxy indicator having a first defined value.