Providing 3D graphics across partitions of computing device

• US 20070057953A1
• Filed: 09/15/2005
• Published: 03/15/2007
• Est. Priority Date: 09/15/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Green, Dustin
• Granted Patent: US 7,463,268 B2
• Time in Patent Office: Days
• US Class Current: 345/503
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2360/125 using unified memory architecture [UMA]
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

A computing device has a graphics hardware device employed to display graphics on a display, and is partitioned to include a video services partition (VSP) instantiated at least in part to provide graphics capabilities, and also to include a video client partition (VCP) instantiated at least in part to consume such graphics capabilities. The graphics hardware device is assigned to and controlled by the VSP. A shared video memory module is shared by the VCP and the VSP such that graphics information placed in the pages shared by the video memory module by the VCP is directly available to the VSP for further action such that graphics commands from the VCP are shunted by way of the pages shared by the video memory module across partitions from the VCP to the VSP to be acted upon by the graphics hardware device as controlled by the VSP.

Claims

1. A computing device having a hardware device employed to perform a hardware function, the computing device being partitioned to include a service partition (SP) instantiated at least in part to provide capabilities relating to the hardware device, and also to include a client partition (CP) instantiated at least in part to consume such capabilities, the hardware device being assigned to and controlled by the SP,

the CP having:

a user mode portion of a hardware device driver (UMD) in a user mode portion of such CP, the UMD corresponding to and being developed for the hardware device, the UMD for receiving commands from an application at a user mode portion of the CP and for processing such commands to produce actions to be taken by the hardware device; and

a user mode runtime module in the user mode portion of such CP for assisting the UMD in processing commands of a particular type; and

the SP having;

a partition hardware context object in a kernel mode portion of such SP, the partition hardware context object corresponding to the CP and representing a distinct instance of state for the hardware device with regard to the CP;

a kernel mode portion of the hardware device driver (KMD) in the kernel mode portion of such SP, the KMD corresponding to and being developed for the hardware device and also corresponding to the UMD, the KMD for directly controlling the hardware device;

a kernel mode runtime module in the kernel mode portion of such SP, the kernel mode runtime module corresponding to the user mode runtime module in the CP for assisting the KMD in processing commands and for maintaining state for the hardware device with regard to the CP in the partition hardware context object;

the computing device also including a shared memory module shared by the CP and the SP, with a portion in the CP and a portion in the SP, the portions sharing pages of memory between the CP and the SP and managing related cross-partition notifications, whereby hardware device information placed in the pages shared by the memory module by the CP is directly available to the SP for further action, wherein commands from the CP are shunted by way of the pages shared by the memory module across partitions from the CP to the SP to be acted upon by the hardware device as controlled by the SP.

2. The computing device of claim 1 having a graphics hardware device employed to display graphics on a display coupled to the computing device, the computing device being partitioned to include a video services partition (VSP) instantiated at least in part to provide graphics capabilities, and also to include a video client partition (VCP) instantiated at least in part to consume such graphics capabilities, the graphics hardware device being assigned to and controlled by the VSP,

the VCP having:

a user mode portion of a graphics driver (UMD) in a user mode portion of such VCP, the UMD corresponding to and being developed for the graphics hardware device, the UMD for receiving graphics commands from an application at a user mode portion of the VCP and for processing such commands to produce graphics commands interpretable by the graphics hardware device; and

a user mode runtime module in the user mode portion of such VCP for assisting the UMD in processing graphics commands; and

the VSP having;

a partition graphics context object in a kernel mode portion of such VSP, the partition graphics context object corresponding to the VCP and representing a distinct instance of state for the graphics hardware device with regard to the VCP;

a kernel mode portion of the graphics driver (KMD) in the kernel mode portion of such VSP, the KMD corresponding to and being developed for the graphics hardware device and also corresponding to the UMD, the KMD for directly controlling the graphics hardware device;

a kernel mode runtime module in the kernel mode portion of such VSP, the kernel mode runtime module corresponding to the user mode runtime module in the VCP for assisting the KMD in processing graphics commands and for maintaining state for the graphics hardware device with regard to the VCP in the partition graphics context object;

the computing device also including a shared video memory module shared by the VCP and the VSP, with a portion in the VCP and a portion in the VSP, the portions sharing pages of memory between the VCP and the VSP and managing graphics-related cross-partition notifications, whereby graphics information placed in the pages shared by the video memory module by the VCP is directly available to the VSP for further action, wherein graphics commands from the VCP are shunted by way of the pages shared by the video memory module across partitions from the VCP to the VSP to be acted upon by the graphics hardware device as controlled by the VSP.

3. The computing device of claim 2 partitioned to include a plurality of the VCPs, each VCP being instantiated at least in part to consume the graphics capabilities of the VSP, the VSP having a partition graphics context object corresponding to each VCP, each partition graphics context object representing a distinct instance of state for the graphics hardware device with regard to the corresponding VCP, whereby the state as represented by any particular partition graphics context object can be swapped in to become the corresponding real state of the graphics hardware device.

4. The computing device of claim 3 wherein the kernel mode runtime module of the VSP includes functionality necessary to address each of the plurality of partition graphics context objects, whereby such kernel mode runtime module treats each partition graphics context object as if a separate machine graphics context, with a separate corresponding set of active display surfaces.

5. The computing device of claim 3 wherein the kernel mode runtime module of the VSP includes a graphics memory manager and a graphics scheduler, such manager and such scheduler each being a single instance, the graphics memory manager for managing memory that is used to hold graphics-related allocations, the graphics scheduler for scheduling when individual rendering contexts from VCPs are allowed to run on the graphics hardware device.

6. The computing device of claim 2 wherein a user mode portion of the VSP also has an instance of the UMD to handle graphics commands from applications running at the user mode portion of such VSP.

7. The computing device of claim 2 wherein the VCP has a plurality of user mode runtime modules, each user mode run time module for assisting the UMD in processing graphics commands of a particular type, and wherein the VSP has a plurality of kernel mode runtime modules, each kernel mode runtime module in the VSP corresponding to a user mode runtime module in the VCP.

8. The computing device of claim 2 wherein the VSP owns the shared video memory module and shares same with the VCP so that the VCP can access such shared video memory module.

9. The computing device of claim 2 wherein the VCP and the VSP are each a trusted partition and form a trusted graphics path trusted not to divulge content flowing therethrough.

10. A computer-readable medium having stored thereon instructions for being implemented on a computing device having a hardware device employed to perform a hardware function, the instructions for partitioning the computing device to include a service partition (SP) instantiated at least in part to provide capabilities relating to the hardware device, and also to include a client partition (CP) instantiated at least in part to consume such capabilities, the hardware device being assigned to and controlled by the SP,

the CP having:

a user mode portion of a hardware device driver (UMD) in a user mode portion of such CP, the UMD corresponding to and being developed for the hardware device, the UMD for receiving commands from an application at a user mode portion of the CP and for processing such commands to produce actions to be taken by the hardware device; and

a user mode runtime module in the user mode portion of such CP for assisting the UMD in processing commands; and

the SP having;

a partition hardware context object in a kernel mode portion of such SP, the partition hardware context object corresponding to the CP and representing a distinct instance of state for the hardware device with regard to the CP;

a kernel mode portion of the hardware device driver (KMD) in the kernel mode portion of such SP, the KMD corresponding to and being developed for the hardware device and also corresponding to the UMD, the KMD for directly controlling the hardware device;

a kernel mode runtime module in the kernel mode portion of such SP, the kernel mode runtime module corresponding to the user mode runtime module in the CP for assisting the KMD in processing commands and for maintaining state for the hardware device with regard to the CP in the partition hardware context object;

the instructions also for instantiating on the computer device a shared memory module shared by the CP and the SP, with a portion in the CP and a portion in the SP, the portions sharing pages of memory between the CP and the SP and managing related cross-partition notifications, whereby hardware device information placed in the shared memory module by the CP is directly available to the SP for further action, wherein commands from the CP are shunted by way of the pages shared by memory module across partitions from the CP to the SP to be acted upon by the hardware device as controlled by the SP.

11. The medium of claim 10 wherein the computing device has a graphics hardware device employed to display graphics on a display coupled to the computing device, the instructions for partitioning the computing device to include a video services partition (VSP) instantiated at least in part to provide graphics capabilities, and also to include a video client partition (VCP) instantiated at least in part to consume such graphics capabilities, the graphics hardware device being assigned to and controlled by the VSP,

the VCP having:

a user mode portion of a graphics driver (UMD) in a user mode portion of such VCP, the UMD corresponding to and being developed for the graphics hardware device, the UMD for receiving graphics commands from an application at a user mode portion of the VCP and for processing such commands to produce graphics commands interpretable by the graphics hardware device; and

a user mode runtime module in the user mode portion of such VCP for assisting the UMD in processing graphics commands; and

the VSP having;

a partition graphics context object in a kernel mode portion of such VSP, the partition graphics context object corresponding to the VCP and representing a distinct instance of state for the graphics hardware device with regard to the VCP;

a kernel mode portion of the graphics driver (KMD) in the kernel mode portion of such VSP, the KMD corresponding to and being developed for the graphics hardware device and also corresponding to the UMD, the KMD for directly controlling the graphics hardware device;

a kernel mode runtime module in the kernel mode portion of such VSP, the kernel mode runtime module corresponding to the user mode runtime module in the VCP for assisting the KMD in processing graphics commands and for maintaining state for the graphics hardware device with regard to the VCP in the partition graphics context object;

the instructions also for instantiating on the computer device a shared video memory module shared by the VCP and the VSP, with a portion in the VCP and a portion in the VSP, the portions sharing pages of memory between the VCP and the VSP and managing graphics-related cross-partition notifications, whereby graphics information placed in the shared video memory module by the VCP is directly available to the VSP for further action, wherein graphics commands from the VCP are shunted by way of the pages shared by the video memory module across partitions from the VCP to the VSP to be acted upon by the graphics hardware device as controlled by the VSP.

12. The medium of claim 11 wherein the computing device is partitioned to include a plurality of the VCPs, each VCP being instantiated at least in part to consume the graphics capabilities of the VSP, the VSP having a partition graphics context object corresponding to each VCP, each partition graphics context object representing a distinct copy of state for the graphics hardware device with regard to the corresponding VCP, whereby the state as represented by any particular partition graphics context object can be swapped in to become the corresponding real state of the graphics hardware device.

13. The medium of claim 12 wherein the kernel mode runtime module of the VSP includes functionality necessary to address each of the plurality of partition graphics context objects, whereby such kernel mode runtime module treats each partition graphics context object as if a separate machine graphics context, with a separate corresponding set of active display surfaces.

14. The medium of claim 12 wherein the kernel mode runtime module of the VSP includes a graphics memory manager and a graphics scheduler, such manager and such scheduler each being a single instance, the graphics memory manager for managing memory that is used to hold graphics-related allocations, the graphics scheduler for scheduling when individual contexts from VCPs are allowed to run on the graphics hardware device.

15. The medium of claim 11 wherein a user mode portion of the VSP also has an instance of the UMD to handle graphics commands from applications running at the user mode portion of such VSP.

16. The medium of claim 11 wherein the VCP has a plurality of user mode runtime modules, each user mode run time module for assisting the UMD in processing graphics commands of a particular type, and wherein the VSP has a plurality of kernel mode runtime modules, each kernel mode runtime module in the VSP corresponding to a user mode runtime module in the VCP.

17. The medium of claim 11 wherein the VSP owns the shared video memory module and shares same with the VCP so that the VCP can access such shared video memory module.

18. The medium of claim 11 wherein the VCP and the VSP are each a trusted partition and form a trusted graphics path trusted not to divulge content flowing therethrough.