Administering registered virtual addresses in a hybrid computing environment including maintaining a cache of ranges of currently registered virtual addresses

• US 9,286,232 B2
• Filed: 01/26/2009
• Issued: 03/15/2016
• Est. Priority Date: 01/26/2009
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Archer, Charles J., Ricard, Gary R.
• Primary Examiner(s): PATEL, KAUSHIKKUMAR M
• Application Number:
  US12/359,383
• Publication Number:
  US 20100191909A1
• Time in Patent Office: 2,605 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 12/1027 using associative or pseudo-associative address translation means, e.g. translation look-aside buffer [TLB]
• CPC Class Codes: G06F 12/1072 Decentralised address translation, e.g. in distributed shared memory systems
• CPC Class Codes: G06F 12/1081 for peripheral access to main memory, e.g. direct memory access [DMA]

Abstract

Administering registered virtual addresses in a hybrid computing environment that includes a host computer, an accelerator, the accelerator architecture optimized, with respect to the host computer architecture, for speed of execution of a particular class of computing functions, the host computer and the accelerator adapted to one another for data communications by a system level message passing module, where administering registered virtual addresses includes maintaining a cache of ranges of currently registered virtual addresses, the cache including entries associating a range of currently registered virtual addresses, a handle representing physical addresses mapped to the range of currently registered virtual addresses, and a counter; determining whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses; and determining whether to deregister ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses.

Claims

1. A method of administering registered virtual addresses in a hybrid computing environment, the hybrid computing environment comprising a host computer having a host computer architecture, an accelerator having an accelerator architecture, the accelerator architecture optimized, with respect to the host computer architecture, for speed of execution of a particular class of computing functions, the host computer and the accelerator connected to one another for data communications by a system level message passing module, the method comprising:

maintaining, by the system level message passing module, a cache of ranges of currently registered virtual addresses, the cache comprising entries associating a range of currently registered virtual addresses, a handle representing physical addresses mapped to the range of currently registered virtual addresses, and a counter identifying the number of virtual addresses in the range of currently registered virtual addresses that are currently in use;

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses; and

determining, by the system level message passing module, whether to deregister ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses.

2. The method of claim 1 wherein:

the method further comprises intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that falls within a range of currently registered virtual addresses maintained in the cache;

maintaining a cache of ranges of currently registered virtual addresses further comprises incrementing the counter for the range of currently registered virtual addresses within which the particular range of virtual addresses falls; and

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises determining not to register the particular range of virtual addresses and returning, to the application, the handle associated with the range of currently registered virtual addresses within which the particular range of virtual addresses falls.

3. The method of claim 1 wherein:

the method further comprises intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that does not fall within a range of currently registered virtual addresses maintained in the cache;

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises registering the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

4. The method of claim 1 wherein:

the method further comprises intercepting, by the system level message passing module, an application level call to deregister a particular range of virtual addresses that falls within a range of currently registered virtual addresses maintained in the cache;

determining, by the system level message passing module, whether to deregister ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises determining not to deregister the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises decrementing the counter for the range of currently registered virtual addresses within which the particular range of virtual addresses falls.

5. The method of claim 1 wherein:

the method further comprises intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that does not fall within a range of currently registered virtual addresses maintained in the cache and determining that the cache is full;

determining whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises registering the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises;

evicting, from the cache, a least recently used and least recently added range of currently registered virtual addresses in dependence upon the counter for the least recently used and least recently added range of currently registered virtual addresses including deregistering the least recently used and least recently added range; and

adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

6. The method of claim 1 wherein maintaining a cache of ranges of currently registered virtual addresses further comprises:

receiving, from an operating system, a notification that the operating system is unable to register a particular range of virtual addresses;

evicting, from the cache, a least recently used and least recently added range of currently registered virtual addresses including deregistering the least recently used and least recently added range; and

registering the particular range of virtual addresses including adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

7. A hybrid computing environment for administering registered virtual addresses, the hybrid computing environment comprising a host computer having a host computer architecture, an accelerator having an accelerator architecture, the accelerator architecture optimized, with respect to the host computer architecture, for speed of execution of a particular class of computing functions, the host computer and the accelerator connected to one another for data communications by a system level message passing module, the hybrid computing environment further comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of:

maintaining, by the system level message passing module, a cache of ranges of currently registered virtual addresses, the cache comprising entries associating a range of currently registered virtual addresses, a handle representing physical addresses mapped to the range of currently registered virtual addresses, and a counter identifying the number of virtual addresses in the range of currently registered virtual addresses that are currently in use;

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses; and

determining, by the system level message passing module, whether to deregister ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses.

8. The hybrid computing environment of claim 7 wherein:

the hybrid computing environment further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that falls within a range of currently registered virtual addresses maintained in the cache;

maintaining a cache of ranges of currently registered virtual addresses further comprises incrementing the counter for the range of currently registered virtual addresses within which the particular range of virtual addresses falls; and

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises determining not to register the particular range of virtual addresses and returning, to the application, the handle associated with the range of currently registered virtual addresses within which the particular range of virtual addresses falls.

9. The hybrid computing environment of claim 7 wherein:

the hybrid computing environment further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that does not fall within a range of currently registered virtual addresses maintained in the cache;

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises registering the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

10. The hybrid computing environment of claim 7 wherein:

the hybrid computing environment further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to deregister a particular range of virtual addresses that falls within a range of currently registered virtual addresses maintained in the cache;

determining, by the system level message passing module, whether to deregister ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises determining not to deregister the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises decrementing the counter for the range of currently registered virtual addresses within which the particular range of virtual addresses falls.

11. The hybrid computing environment of claim 7 wherein:

the hybrid computing environment further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that does not fall within a range of currently registered virtual addresses maintained in the cache and determining that the cache is full;

determining whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises registering the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises;

evicting, from the cache, a least recently used and least recently added range of currently registered virtual addresses in dependence upon the counter for the least recently used and least recently added range of currently registered virtual addresses including deregistering the least recently used and least recently added range; and

adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

12. The hybrid computing environment of claim 7 wherein maintaining a cache of ranges of currently registered virtual addresses further comprises:

receiving, from an operating system, a notification that the operating system is unable to register a particular range of virtual addresses;

evicting, from the cache, a least recently used and least recently added range of currently registered virtual addresses including deregistering the least recently used and least recently added range; and

registering the particular range of virtual addresses including adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

13. A computer program product for administering registered virtual addresses in a hybrid computing environment, the hybrid computing environment comprising a host computer having a host computer architecture, an accelerator having an accelerator architecture, the accelerator architecture optimized, with respect to the host computer architecture, for speed of execution of a particular class of computing functions, the host computer and the accelerator to one another for data communications by a system level message passing module, the computer program product disposed in a non-transitory computer readable storage medium, the computer program product comprising computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of:

maintaining, by the system level message passing module, a cache of ranges of currently registered virtual addresses, the cache comprising entries associating a range of currently registered virtual addresses, a handle representing physical addresses mapped to the range of currently registered virtual addresses, and a counter identifying the number of virtual addresses in the range of currently registered virtual addresses that are currently in use;

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses; and

determining, by the system level message passing module, whether to deregister ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses.

14. The computer program product of claim 13 wherein:

the computer program product further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that falls within a range of currently registered virtual addresses maintained in the cache;

maintaining a cache of ranges of currently registered virtual addresses further comprises incrementing the counter for the range of currently registered virtual addresses within which the particular range of virtual addresses falls; and

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises determining not to register the particular range of virtual addresses and returning, to the application, the handle associated with the range of currently registered virtual addresses within which the particular range of virtual addresses falls.

15. The computer program product of claim 13 wherein:

the computer program product further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that does not fall within a range of currently registered virtual addresses maintained in the cache;

determining, by the system level message passing module, whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises registering the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

16. The computer program product of claim 13 wherein:

the computer program product further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to deregister a particular range of virtual addresses that falls within a range of currently registered virtual addresses maintained in the cache;

determining, by the system level message passing module, whether to deregister ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises determining not to deregister the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises decrementing the counter for the range of currently registered virtual addresses within which the particular range of virtual addresses falls.

17. The computer program product of claim 13 wherein:

the computer program product further comprises computer program instructions that, when executed, cause the hybrid computing environment to perform the steps of intercepting, by the system level message passing module, an application level call to register a particular range of virtual addresses that does not fall within a range of currently registered virtual addresses maintained in the cache and determining that the cache is full;

determining whether to register ranges of virtual addresses in dependence upon the cache of ranges of currently registered virtual addresses further comprises registering the particular range of virtual addresses; and

maintaining a cache of ranges of currently registered virtual addresses further comprises;

evicting, from the cache, a least recently used and least recently added range of currently registered virtual addresses in dependence upon the counter for the least recently used and least recently added range of currently registered virtual addresses including deregistering the least recently used and least recently added range; and

adding the particular range of virtual addresses to the cache of currently registered virtual addresses.

18. The computer program product of claim 13 wherein maintaining a cache of ranges of currently registered virtual addresses further comprises:

receiving, from an operating system, a notification that the operating system is unable to register a particular range of virtual addresses;

evicting, from the cache, a least recently used and least recently added range of currently registered virtual addresses including deregistering the least recently used and least recently added range; and

registering the particular range of virtual addresses including adding the particular range of virtual addresses to the cache of currently registered virtual addresses.