Implicit locks in a shared virtual memory system

• US 7,409,525 B1
• Filed: 03/29/2006
• Issued: 08/05/2008
• Est. Priority Date: 03/29/2006
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: DesRoches, David W., Clark, Roy
• Primary Examiner(s): Elmore; Reba I
• Application Number:
  US11/393,063
• Time in Patent Office: 860 Days
• Field of Search: 711/206, 711/210, 711/247
• US Class Current: 711/206
• CPC Class Codes: G06F 12/1072 Decentralised address translation, e.g. in distributed shared memory systems

Abstract

A technique coordinates access to shared data on a remote device from a local device having local physical memory. The technique involves observing a page table entry (PTE) on the remote device. The PTE is stored in a page table used for managing virtual to physical address translations and handling page faults between semiconductor memory and magnetic disk drive memory on the remote device. The technique further involves blocking access to the shared data from the local device when the PTE indicates that shared data corresponding to the PTE is in use on the remote device. The technique further involves moving the shared data into the local physical memory from the semiconductor memory of the remote device, and providing access to the shared data in the local physical memory when the PTE indicates that shared data corresponding to the PTE is not in use on the remote device.

Claims

1. In a local computerized device having local physical memory, a method for coordinating access to shared data on a remote computerized device, the method comprising:

observing a page table entry on the remote computerized device, the page table entry being stored in a page table used for managing virtual to physical address translations and handling page faults between semiconductor memory and magnetic disk drive memory on the remote computerized device;

when the page table entry indicates that shared data corresponding to the page table entry is in use on the remote computerized device, blocking access to the shared data from the local computerized device; and

when the page table entry indicates that shared data corresponding to the page table entry is not in use on the remote computerized device, moving the shared data into the local physical memory from the semiconductor memory of the remote computerized device, and providing access to the shared data in the local physical memory.

2. A method as in claim 1 wherein the page table entry includes a valid bit indicating that the shared data is (i) in use on the remote computerized device when the valid bit is set to “

valid” and

(ii) not in use on the remote computerized device when the valid bit is set to “

invalid”

; and

wherein blocking access to the shared data from the local computerized device includes;

taking repeated observations of the page table entry on the remote computerized device to detect transition of the valid bit of the page table entry from “

valid”

to “

invalid”

to identify when the shared data becomes available.

3. A method as in claim 2, further comprising:

providing an error signal if a timeout period has elapsed while taking repeated observations of the page table entry on the remote computerized device.

4. A method as in claim 2 wherein the page table entry further includes metadata uniquely identifying the remote computerized device among multiple computerized devices;

and wherein the method further comprises;

confirming that the metadata in the page table entry uniquely identifies the remote computerized device.

5. A method as in claim 1 wherein moving and providing includes:

storing the shared data in an extent within the local physical memory of the local computerized device, the virtual address of the extent corresponding to a mapping within a page table entry of a page table of the local computerized device, the page table of the local computerized device being used for managing virtual to physical address translations and handling page faults between semiconductor memory and magnetic disk drive memory on the local computerized device and for managing virtual to physical address translations and handling page faults between local shared virtual memory and remote computerized device shared virtual memory;

configuring the page table entry of the page table of the local computerized device to indicate that the shared data in the extent within the local physical memory is (i) available to an application running within the local computerized device and (ii) unavailable to other computerized devices; and

enabling an application running on the local computerized device to access the shared data in the extent within the local physical memory.

6. A method as in claim 5 wherein configuring the page table entry of the page table of the local computerized device includes:

setting a valid bit of the page table entry of the page table of the local computerized device from “

invalid”

to “

valid”

.

7. A method as in claim 6, further comprising:

receiving a request from the application running on the local computerized device to change the valid bit of the page table entry of the page table of the local computerized device to from “

valid”

back to “

invalid”

when the application is finished accessing the shared data.

8. A method as in claim 6, further comprising:

setting metadata of the page table entry of the page table of the local computerized device to uniquely identify the local computerized device among multiple computerized devices.

9. A method as in claim 1, further comprising:

allowing observation to the page table entry of the page table of the local computerized device from another computerized device in response to a request from that other computerized device.

10. A method as in claim 9, further comprising:

allowing the other computerized device to move the shared data from the local physical memory to semiconductor memory of the other computerized device when a valid bit of the page table entry is set to “

invalid”

; and

preventing the other computerized device from moving the shared data from the local physical memory to the semiconductor memory of the other computerized device when a valid bit of the page table entry is set to “

valid”

.

11. A method as in claim 9 wherein allowing observation to the page table entry of the page table of the local computerized device includes:

performing a masked atomic compare-and-swap operation on the page table entry of the page table of the local computerized device to modify the contents of the page table entry on behalf of the remote computerized device.

12. A local computerized device, comprising:

local physical memory;

an interface to an internodal communication medium; and

a controller coupled to the local physical memory and the interface, the controller being configure to;

observe a page table entry on a remote computerized device through the interface, the page table entry being stored in a page table used for managing virtual to physical address translations and handling page faults between semiconductor memory and magnetic disk drive memory on the remote computerized device,

when the page table entry indicates that shared data corresponding to the page table entry is in use on the remote computerized device, block access to the shared data from the local computerized device, and

when the page table entry indicates that shared data corresponding to the page table entry is not in use on the remote computerized device, move the shared data into the local physical memory from the semiconductor memory of the remote computerized device through the interface, and provide access to the shared data in the local physical memory.

13. A local computerized device as in claim 12 wherein the page table entry includes a valid bit indicating that the shared data is (i) in use on the remote computerized device when the valid bit is set to “

valid” and

(ii) not in use on the remote computerized device when the valid bit is set to “

invalid”

; and

wherein the controller, when blocking access to the shared data from the local computerized device, is configured to;

take repeated observations of the page table entry on the remote computerized device to detect transition of the valid bit of the page table entry from “

valid”

to “

invalid”

to identify when the shared data becomes available.

14. A local computerized device as in claim 13 wherein the controller is further configured to:

provide an error signal if a timeout period has elapsed while taking repeated observations of the page table entry on the remote computerized device.

15. A local computerized device as in claim 13 wherein the page table entry further includes metadata uniquely identifying the remote computerized device among multiple computerized devices;

and wherein the controller is further configured to;

confirm that the metadata in the page table entry uniquely identifies the remote computerized device.

16. A local computerized device as in claim 12 wherein the controller, when moving and providing, is configured to:

store the shared data in an extent within the local physical memory of the local computerized device, the virtual address of the extent corresponding to a mapping within a page table entry of a page table of the local computerized device, the page table of the local computerized device being used for managing virtual to physical address translations and handling page faults between semiconductor memory and magnetic disk drive memory on the local computerized device and for managing virtual to physical address translations and handling page faults between local shared virtual memory and remote computerized device shared virtual memory;

configure the page table entry of the page table of the local computerized device to indicate that the shared data in the extent within the local physical memory is (i) available to an application running within the local computerized device and (ii) unavailable to other computerized devices; and

enable an application running on the local computerized device to access the shared data in the extent within the local physical memory.

17. A local computerized device as in claim 16 wherein the controller, when configuring the page table entry of the page table of the local computerized device, is configured to:

set a valid bit of the page table entry of the page table of the local computerized device from “

invalid”

to “

valid”

.

18. A local computerized device as in claim 17 wherein the controller is further configured to:

receive a request from the application running on the local computerized device to change the valid bit of the page table entry of the page table of the local computerized device to from “

valid”

back to “

invalid”

when the application is finished accessing the shared data.

19. A local computerized device as in claim 17 wherein the controller is further configured to:

set metadata of the page table entry of the page table of the local computerized device to uniquely identify the local computerized device among multiple computerized devices.

20. A local computerized device as in claim 12 wherein the controller is further configured to:

allow observation to the page table entry of the page table of the local computerized device from another computerized device in response to a request from that other computerized device.

21. A local computerized device as in claim 20 wherein the controller is further configured to:

allow the other computerized device to move the shared data from the local physical memory to semiconductor memory of the other computerized device when a valid bit of the page table entry is set to “

invalid”

; and

prevent the other computerized device from moving the shared data from the local physical memory to the semiconductor memory of the other computerized device when a valid bit of the page table entry is set to “

valid”

.

22. A local computerized device as in claim 20 wherein the controller, when allowing observation to the page table entry of the page table of the local computerized device, is configured to:

perform a masked atomic compare-and-swap operation on the page table entry of the page table of the local computerized device to modify the contents of the page table entry on behalf of the remote computerized device.