METHOD, APPARATUS, AND COMPUTER PROGRAM PRODUCT FOR MANAGING ADDRESSES IN DISTRIBUTED SYSTEM

• US 20190324917A1
• Filed: 04/12/2019
• Published: 10/24/2019
• Est. Priority Date: 04/20/2018
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Inventors: Cui, Wei, Wang, Kun
• Granted Patent: US 10,838,873 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 12/0284 Multiple user address space allocation, e.g. using different base addresses interprocessor communication G06F15/163
• CPC Class Codes: G06F 12/0857 by multiple requestors
• CPC Class Codes: G06F 12/10 Address translation
• CPC Class Codes: G06F 2212/657 Virtual address space management

Abstract

There is provided a method for managing addresses in a distributed system. The distributed system comprises a client and a resource pool, the resource pool comprising multiple hosts, a host among the multiple hosts comprising a computing node. The method comprises: receiving an access request from the client, the access request being for accessing first target data in a physical memory of the computing node via a first virtual address; determining the physical memory on the basis of the first virtual address; and determining a first physical address of the first target data in the physical memory on the basis of the first virtual address, wherein the computing node is a graphics processing unit, and the physical memory is a memory of the graphics processing unit.

Claims

1. A method for managing addresses in a distributed system, the distributed system comprising a client and a resource pool, the resource pool comprising multiple hosts, a host among the multiple hosts comprising a computing node, the method comprising:

receiving an access request from the client, the access request being for accessing first target data in a physical memory of the computing node via a first virtual address;

determining the physical memory on the basis of the first virtual address; and

determining a first physical address of the first target data in the physical memory on the basis of the first virtual address, wherein the computing node is a graphics processing unit, and the physical memory is a memory of the graphics processing unit.

2. The method of claim 1, wherein determining the physical memory on the basis of the first virtual address comprises:

determining, on the basis of a predefined address mapping, an address range to which the first virtual address belongs, the address mapping comprising a mapping relationship between the physical memory and the address range; and

determining the physical memory on the basis of the address range.

3. The method of claim 2, wherein determining the first physical address comprises:

determining the first physical address on the basis of an offset of the first virtual address within the address range.

4. The method of claim 3, further comprising:

receiving a feedback result from the physical memory, the feedback result defining second target data at a second physical address in the physical memory; and

determining a second virtual address on the basis of the predefined address mapping, the physical memory and the second physical address so as to be returned to the client.

5. The method of claim 4, wherein determining the second virtual address comprises:

determining a start address of an address range associated with the physical memory according to the address mapping; and

determining the second virtual address by offsetting the second physical address on the basis of the start address.

6. The method of claim 1, wherein the access request is a remote procedure call of the graphics processing unit from the client.

7. The method of claim 1, further comprising processing a copy request.

8. The method of claim 7, wherein processing the copy request further comprises:

in response to receiving a copy request from a client, determining a source virtual address and a destination virtual address which are associated with the copy request;

determining a source physical memory and a source physical address on the basis of the source virtual address and determining a destination physical memory and a destination physical address on the basis of the destination virtual address; and

processing the copy request on the basis of the source physical memory and the destination physical memory.

9. The method of claim 8, wherein processing the copy request on the basis of the source physical memory and the destination physical memory comprises:

in response to determining that the source physical memory and the destination physical memory are same, at the source physical memory copying target data associated with the copy request from the source physical address to the destination physical address.

10. The method of claim 7, wherein processing the copy request on the basis of the source physical memory and the destination physical memory comprises:

in response to determining that the source physical memory and the destination physical memory are different, determining a connection state between a source host where the source physical memory resides and a destination host where the destination physical memory resides; and

processing the copy request on the basis of the connection state.

11. The method of claim 10, wherein processing the copy request on the basis of the connection state comprises:

in response to determining that there exists a direct connection between the source host and the destination host,

copying target data associated with the copy request from the source physical address in the source physical memory to a memory in the source host so as to form first intermediate data;

copying the intermediate data via the direct connection to a memory in the destination host so as to form second intermediate data; and

copying the second intermediate data to the destination physical address in the destination physical memory.

12. The method according to claim 10, wherein processing the copy request on the basis of the connection state comprises:

in response to determining that there exists no direct connection between the source host and the destination host,

copying target data associated with the copy request from the source physical address in the source physical memory to the client so as to form intermediate data; and

copying the intermediate data to the destination physical address in the destination physical memory.

13. The method according to claim 12, wherein copying the target data from the source physical address in the source physical memory to the client so as to form intermediate data comprises:

copying the target data from the source physical address in the source physical memory to a memory in the source host so as to form first intermediate data; and

copying the first intermediate data to the client.

14. The method according to claim 12, wherein copying the intermediate data to the destination physical address in the destination physical memory comprises:

copying the intermediate data from the client to a memory in the destination host so as to form second intermediate data; and

copying the second intermediate data to the destination physical address in the destination physical memory.

15. A computer program product, tangibly stored on a computer readable medium and comprising machine executable instructions which, when executed, cause a machine to implement a method for managing addresses in a distributed system, the distributed system comprising a client and a resource pool, the resource pool comprising multiple hosts, a host among the multiple hosts comprising a computing node, the method comprising:

receiving an access request from the client, the access request being for accessing first target data in a physical memory of the computing node via a first virtual address;

determining the physical memory on the basis of the first virtual address; and

determining a first physical address of the first target data in the physical memory on the basis of the first virtual address, wherein the computing node is a graphics processing unit, and the physical memory is a memory of the graphics processing unit.

16. An apparatus for managing addresses in a distributed system, the distributed system comprising a client and a resource pool, the resource pool comprising multiple hosts, a host among the multiple hosts comprising a computing node, the apparatus comprising:

at least one processor;

a volatile memory; and

a memory coupled to the at least one processor and having instructions stored thereon, the instructions, when executed by the at least one processor, causing the apparatus to perform acts comprising;

receiving an access request from the client, the access request being for accessing first target data in a physical memory of the computing node via a first virtual address;

determining the physical memory on the basis of the first virtual address; and

determining a first physical address of the first target data in the physical memory on the basis of the first virtual address, wherein the computing node is a graphics processing unit, and the physical memory is a memory of the graphics processing unit.

17. The apparatus of claim 16, wherein determining the physical memory on the basis of the first virtual address comprises:

determining, on the basis of a predefined address mapping, an address range to which the first virtual address belongs, the address mapping comprising a mapping relationship between the physical memory and the address range; and

determining the physical memory on the basis of the address range.

18. The apparatus of claim 17, wherein determining the first physical address comprises:

determining the first physical address on the basis of an offset of the first virtual address within the address range.

19. The apparatus of claim 18, wherein the acts further comprise:

receiving a feedback result from the physical memory, the feedback result defining second target data at a second physical address in the physical memory; and

determining a second virtual address on the basis of the predefined address mapping, the physical memory and the second physical address so as to be returned to the client.

20. The apparatus of claim 16, wherein the apparatus further performs acts comprising processing a copy request.