Forcing registered code into an execution context of guest software

• US 8,250,519 B2
• Filed: 08/08/2008
• Issued: 08/21/2012
• Est. Priority Date: 08/08/2007
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Budko, Dmitriy, Chen, Xiaoxin, Horovitz, Oded, Subrahmanyam, Pratap, Waldspurger, Carl
• Primary Examiner(s): Khatri, Anil
• Application Number:
  US12/188,973
• Publication Number:
  US 20090055571A1
• Time in Patent Office: 1,474 Days
• Field of Search: 717100-102, 717107-109, 717120-123
• US Class Current: 717/100
• CPC Class Codes: G06F 2009/45587 Isolation or security of virtual machine instances
• CPC Class Codes: G06F 2009/45591 Monitoring or debugging support
• CPC Class Codes: G06F 21/53 by executing in a restricted environment, e.g. sandbox or secure virtual machine
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects

Abstract

A method is provided for executing guest computations in a virtual machine of a virtualization system and forcing execution of registered code into an execution context of the guest. The forcing is performed from the virtualization system based on an execution trigger monitored without reliance on functionality of the guest software.

Claims

1. A method of operating a virtualization system, the method comprising:

executing guest software in a virtual machine of the virtualization system, the virtualization system including virtualization software configured to coordinate execution, on an underlying hardware machine, of instruction sequences that correspond to respective execution contexts of the guest software, the guest software being less privileged than the virtualization software;

performing an upcall from the virtualization software into an execution context of the guest software, the upcall causing a transfer of control to an instruction sequence of registered code from the virtualization software into the guest software;

forcing execution of the registered code into the execution context of the guest software; and

executing the registered code in the execution context of the guest software based on the upcall.

2. The method of claim 1,

wherein the transfer of control is within the virtual machine from a then-executing instruction sequence of the guest software.

3. The method of claim 2, further comprising:

selecting, based at least in part on a then-operative interrupt model, a suitable point in the then-executing instruction sequence for the upcall.

4. The method of claim 1,

wherein the transfer of control is to an another virtual machine that is idle, not running or is unscheduled.

5. The method of claim 1, further comprising:

returning control to a previously-executing instruction sequence of the guest software.

6. The method of claim 1, further comprising:

during the execution of the registered code, disabling, masking or buffering at least a subset of interrupts ordinarily supplied to the guest software by the virtual machine.

7. The method of claim 1, further comprising:

forking to create a second instance of the virtual machine, the second instance of the virtual machine including a duplicate instance of an original execution context of the guest software,

wherein the upcall is into the duplicate instance of the original execution context of the guess software and the registered code is executed therein; and

wherein state associated with the duplicate instance of the original execution context of the guest software is discarded after successful completion of the registered code, such that execution of the upcall is transparent to an original execution context of the guest software.

8. The method of claim 1, further comprising:

cloaking the registered code from other execution contexts of the guest software using a page mapping mechanism of the virtualization software.

9. The method of claim 1, further comprising:

instantiating the registered code in physical memory;

updating memory mapping information maintained by the virtualization software for the execution context of the guest software to include a mapping to the registered code;

executing the registered code under control of the guest software, and

thereafter, updating the memory mapping information maintained by the virtualization software for the execution context of the guest software to remove the mapping to the registered code.

10. The method of claim 1, further comprising:

forking to create a second instance of the virtual machine; and

executing the registered code in the second instance of the virtual machine.

11. The method of claim 10, further comprising:

performing an upcall into the execution context of the guest software of the second instance of the virtual machine and executing the registered code therein; and

upon completion of the registered code execution, exiting the second instance of the virtual machine and reverting to pre-fork virtual machine state.

12. The method of claim 10,

wherein the virtualization software manages state of the execution context of the guest software in the second instance of the virtual machine using a copy-on-write mechanism;

and

wherein, upon completion of the registered code execution, state of second instance of the virtual machine is discarded such that execution of the registered code is transparent to an original instance of the virtual machine.

13. The method of claim 1, wherein the execution trigger is specified in terms of one or more events selected from a set including:

a time- or timer-based event;

a memory access or access attempt;

an input or output event; and

execution of, or failure to execute, some particular code of computations of the guest software.

14. The method of claim 1, further comprising:

registering the registered code in response to a request from within the virtual machine.

15. The method of claim 1,

wherein the registered code is identified in connection with configuration information for the virtual machine.

16. The method of claim 1, wherein the registered code includes code associated with operation of one or more of:

an antivirus system;

a firewall or gateway;

an intrusion detection system;

a performance or uptime monitoring system;

a license monitoring, metering or enforcement system;

a copyright or digital rights management system; and

critical operating system functionality.

17. The method of claim 1,

wherein a guest operating system coordinates execution of plural execution contexts including that into which the registered code is forced.

18. The method of claim 1,

wherein the guest software includes a software appliance.

19. A computational system comprising:

a virtualization system that coordinates an execution, on an underlying hardware machine, of instruction sequences that correspond to respective execution contexts of guest software, the guest software being less privileged than the virtualization system, wherein the virtualization system performs an upcall into the execution context of the guest software, the upcall causing a transfer of control to an instruction sequence of registered code from the virtualization system into the guest software; and

executing, by a processor, the registered code in the execution context of the guest software based on the upcall that forces execution of the registered code into the execution context of the guest software executing on the virtual machine, wherein the forcing is performed from behind a virtualization barrier based on a monitored execution trigger.

20. The computational system of claim 19, further comprising:

a guest operating system instantiated in the virtual machine as the guest software,

wherein the guest operating system coordinates execution of plural execution contexts including that into which the registered code is forced.

21. The computational system of claim 19,

wherein the virtualization system maintains mapping information for memory pages exposed by the virtual machine, the mapping being from a guest memory space to a physical memory space addressable by the virtualization system, and

wherein the execution of the registered code is cloaked by updating memory mapping information maintained by the virtualization system for the execution context of the guest software to include a mapping to the registered code, executing the registered code under control of the guest software, and thereafter, updating the memory mapping information maintained by the virtualization system for the execution context of the guest software to remove the mapping to the registered code.

22. The computational system of claim 19,

wherein the virtualization system supports forking a duplicate instance of the virtual machine and which manages state of the execution context of the guest software in the forked duplicate virtual machine instance using a copy-on-write mechanism, and

wherein, upon completion of the registered code execution, state of the execution context of the guest software in the forked duplicate virtual machine instance is discarded such that the execution of the registered code is transparent to the guest software executing in an original instance of the virtual machine.

23. An apparatus comprising:

a hardware machine;

virtualization software encoded in one or more media accessible to the hardware machine and executable to expose at least one virtual machine using resources of the hardware machine; and

guest software encoded in one or more media accessible to the virtual machine, the guest software executable on an exposed virtual machine, the guest software being less privileged than the virtualization software,

wherein the virtualization software includes code executable on the hardware machine to perform an upcall into an execution context of the guest software, the upcall causing a transfer of control to an instruction sequence of registered code from the virtualization software into the guest software and force execution of the registered code into the execution context of the guest software, wherein the forcing is performed from behind a virtualization barrier based on a monitored execution trigger.

24. A computer-readable storage medium comprising computer-executable instructions, the computer-readable storage medium comprising:

one or more functional sequence executable by a processor as, or in conjunction with, a virtualization system to perform an upcall into an execution context of guest software, the guest software being less privileged than the virtualization system, the upcall causing a transfer of control to an instruction sequence of registered code from the virtualization system into the guest software and forcing execution of the registered code into the execution context of guest software executing on a virtual machine, wherein the forcing is performed from behind a virtualization barrier based on a monitored execution trigger.

25. The computer-readable storage medium of claim 24, further comprising:

an upcall interface by which the virtualization system initiates a transfer of control in the virtual machine from a then-executing instruction sequence of a guest execution context to an instruction sequence of the registered code.

26. The computer-readable storage medium of claim 24, further comprising:

memory management code executable by a processor to selectively update page table entries maintained by the virtualization system for the execution context of the guest software to include a mapping to the registered code and, after execution of the registered code in the execution context of the guest software, to update the page table entries to remove the mapping to the registered code.