Managing internode data communications for an uninitialized process in a parallel computer

• US 8,732,726 B2
• Filed: 12/10/2012
• Issued: 05/20/2014
• Est. Priority Date: 11/09/2011
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Archer, Charles J., Blocksome, Michael A., Miller, Douglas R., Parker, Jeffrey J., Ratterman, Joseph D., Smith, Brian E.
• Primary Examiner(s): Cao, Diem
• Assistant Examiner(s): VERDI, KIMBLEANN C
• Application Number:
  US13/710,066
• Publication Number:
  US 20130124666A1
• Time in Patent Office: 526 Days
• Field of Search: 719/312, 719/314, 719/317
• US Class Current: 719/317
• CPC Class Codes: G06F 15/167 using a common memory, e.g. mailbox
• CPC Class Codes: G06F 15/17318 Parallel communications techniques, e.g. gather, scatter, reduce, roadcast, multicast, all to all
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes

Abstract

A parallel computer includes nodes, each having main memory and a messaging unit (MU). Each MU includes computer memory, which in turn includes, MU message buffers. Each MU message buffer is associated with an uninitialized process on the compute node. In the parallel computer, managing internode data communications for an uninitialized process includes: receiving, by an MU of a compute node, one or more data communications messages in an MU message buffer associated with an uninitialized process on the compute node; determining, by an application agent, that the MU message buffer associated with the uninitialized process is full prior to initialization of the uninitialized process; establishing, by the application agent, a temporary message buffer for the uninitialized process in main computer memory; and moving, by the application agent, data communications messages from the MU message buffer associated with the uninitialized process to the temporary message buffer in main computer memory.

Claims

1. A method of managing internode data communications in a parallel computer, the parallel computer comprising a plurality of compute nodes, each compute node comprising main computer memory and a messaging unit (MU), each MU comprising a module of automated computing machinery coupling the plurality of compute nodes for data communications, each MU comprising the main computer memory, the main computer memory of the MU comprising one or more MU message buffers, each MU message buffer associated with an uninitialized process on one of the plurality of compute nodes, the method comprising:

receiving, by the MU of the one of the plurality of compute nodes, one or more data communications messages in one of the one or more MU message buffers associated with the uninitialized process on the one of the plurality of compute nodes;

determining, by an application agent, that the one of the one or more MU message buffers associated with the uninitialized process is full prior to initialization of the uninitialized process;

establishing, by the application agent, a temporary message buffer for the uninitialized process in the main computer memory; and

moving, by the application agent, the one or more data communications messages from the one of the one or more MU message buffers associated with the uninitialized process to the temporary message buffer in the main computer memory, wherein;

the parallel computer comprises a parallel active messaging interface (‘

PAMI’

) and the plurality of compute nodes execute a parallel application, the PAMI comprises data communications endpoints, each data communications endpoint comprising a specification of data communications parameters for a thread of execution on one of the plurality of compute nodes, including specifications of a client, a context, and a task, the data communications endpoints coupled for data communications through the PAMI; and

the uninitialized process comprises one of the data communications endpoints;

each client comprises a collection of data communications resources dedicated to exclusive use of an application-level data processing entity;

each context comprises a subset of the collection of data processing resources of a client, context functions, and a work queue of data transfer instructions to be performed by use of the subset through the context functions operated by an assigned thread of execution; and

each task represents a process of execution of the parallel application.

2. The method of claim 1 further comprising:

upon initialization of the uninitialized process, providing, by the application agent to the initialized process, a pointer to the temporary message buffer; and

consuming, by the initialized process in dependence upon the pointer, the one or more data communications messages from the temporary message buffer prior to consuming the one or more data communications messages stored in the one of the one or more MU message buffers associated with the uninitialized process.

3. The method of claim 1 wherein the determining, by the application agent, that the one of the one or more MU message buffers associated with the uninitialized process is full prior to initialization of the uninitialized process further comprises:

periodically polling the MU for information describing the size of all data communications messages presently stored in the one of the one or more of the MU message buffers; and

determining whether the size of all data communications messages presently stored in the one of the one or more of the MU message buffers exceeds a predetermined threshold size.

4. The method of claim 1 wherein determining, by the application agent, that the one of the one or more MU message buffers associated with the uninitialized process is full prior to initialization of the uninitialized process further comprises receiving a notification from the MU that the one of the one or more MU message buffers is full.

5. The method of claim 1 wherein the moving, by the application agent, the one or more data communications messages from the one of the one or more MU message buffers associated with the uninitialized process to the temporary message buffer in the main computer memory further comprises:

periodically moving, by the application agent, one or more messages from the one of the one or more MU message buffer to the temporary message buffer prior to initialization of the uninitialized process.

6. The method of claim 1 wherein each compute node comprises a multi-core computer processor and one core of the multi-core processor executes only the application agent.

7. The method of claim 1 wherein the receiving, by the MU of the one of the plurality of compute nodes, one or more data communications messages in one of the one or more MU message buffers associated with the uninitialized process on the one of the plurality of compute nodes, further comprises:

allocating, at boot time of the one of the plurality of compute nodes by the MU, the one of the one or more MU message buffers in the main computer memory of the MU'"'"'s;

receiving, by the MU from a process on another one of the plurality of compute nodes, the one or more data communications message intended for the uninitialized process; and

storing the one or more data communications messages in the one of the one or more MU message buffers associated with the uninitialized process.

8. The method of claim 1 wherein each context carries out, through post and advance functions, data communications for the parallel application on data communications resources in the exclusive possession of that context.

9. The method of claim 1 wherein each context carries out data communications operations independently and in parallel with other contexts.