Integration of graphical application content into the graphical scene of another application

• US 8,314,804 B2
• Filed: 01/10/2011
• Issued: 11/20/2012
• Est. Priority Date: 03/07/2006
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Graphics Properties Holdings, Inc.
• Inventors: Feth, William J., Hughes, David William, Boccara, Michael
• Primary Examiner(s): Washburn, Daniel
• Application Number:
  US12/987,615
• Publication Number:
  US 20110141113A1
• Time in Patent Office: 680 Days
• Field of Search: 345/522, 345/419, 715/782, 715/848, 715/852
• US Class Current: 345/522
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics

Abstract

This application describes a system that captures 3D geometry commands from a first 3D graphics process and stores them in a shared memory. A second 3D environment process creates a 3D display environment using a display and display hardware. A third process obtains the 3D commands and supplies them to the hardware to place 3D objects in the 3D environment. The result is a fused display environment where 3D objects are displayed along with other display elements. Input events in the environment are analyzed and mapped to the 3D graphics process or the environment where they affect corresponding processing.

Claims

1. A method comprising:

combining intercepted buffer-based architecture three-dimensional (3D) graphics commands produced by an application program with a 3D graphics command stream of a fusion program in order to integrate a 3D object based on the intercepted 3D graphics commands into a 3D scene; and

providing an input received at the fusion program to the application program, comprising mapping an input event at the fusion program into an input event of the application program, where the 3D object is a target of the input event, based on a contextual difference of the 3D object between the fusion program and the application program by reverse-mapping the input from a context of the 3D object of the fusion program buck to the context of the application program.

2. The method of claim 1, further comprising:

intercepting the buffer-based architecture 3D graphics commands produced by the application program using a graphics intercept library.

3. The method of claim 1, wherein the providing further comprises determining whether the input event corresponds to the application program.

4. The method of claim 1, Wherein the combining further comprises modifying the intercepted 3D graphics commands in order to visually integrate the 3D object into the 3D scene.

5. The method of claim 4, wherein modifying the intercepted 3D graphics commands further comprises:

obtaining image information pertaining to a graphical scene of the 3D object;

obtaining viewpoint information pertaining to the 3D scene; and

drawing the 3D object at a corresponding depth in the 3D scene.

6. The method of claim 1, wherein the mapping further comprises:

mapping two-dimensional (2D) input coordinates of the input event at the fusion program into corresponding 2D coordinates of the application program.

7. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, if executed by a computing device, cause the computing device to perform a method comprising:

combining intercepted buffer-based architecture three-dimensional (3D) graphics commands produced by an application program with a 3D graphics command stream of a fusion program in order to integrate a 3D object based on the intercepted 3D graphics commands into a 3D scene; and

providing an input received at the fusion program to the application program, comprising mapping an input event at the fusion program into an input event of the application program, where the 3D object is a target of the input event, based on a contextual difference of the 3D object between the fusion program and the application program by reverse-mapping the input from a context of the 3D object of the fusion program back to the context of the application program.

8. The computer-readable medium of claim 7, the method further comprising:

intercepting the buffer-based architecture 3D graphics commands produced by the application program using a graphics intercept library.

9. The computer-readable medium of claim 7, wherein the providing further comprises determining whether the input event corresponds to the application program.

10. The computer-readable medium of claim 7, wherein the combining further comprises modifying the intercepted 3D graphics commands in order to visually integrate the 3D object into the 3D scene.

11. The computer-readable medium of claim 10, wherein modifying the intercepted 3D graphics commands further comprises:

obtaining image information pertaining to a graphical scene of the 3D object;

obtaining viewpoint information pertaining to the 3D scene; and

drawing the 3D object at a Corresponding depth in the 3D scene.

12. The computer-readable medium of claim 7, wherein the mapping further comprises:

mapping two-dimensional (2D) input coordinates of the input event at the fusion program into corresponding 2D coordinates of the application program.

13. A system comprising:

a fusion display environment, comprising display hardware, configured to combine intercepted buffer-based architecture three-dimensional (3D) graphics commands produced by an application program with a 3D graphics command stream of a fusion program in order to integrate a 3D object based on the intercepted 3D graphics commands into a 3D scene; and

an input daemon configured to provide an input received at the fusion program to the application program, comprising mapping an input event at the fusion program into an input event of the application program, where the 3D object is a target of the input event, based on a contextual difference of the 3D object between the fusion program and the application program by reverse-mapping the input from a context of the 3D object of the fusion program back to the context of the application program.

14. The system of claim 13, further comprising:

a graphics intercept library configured to intercept the buffer-based architecture 3D graphics commands produced by the application program.

15. The system of claim 13, wherein the input daemon is further configured to determine whether the input event corresponds to the application program.

16. The system of claim 13, wherein the fusion display environment is further configured to modify the intercepted 3D graphics commands in order to visually integrate the 3D object into the 3D scene.

17. The system of claim 13, wherein the fusion display environment is further configured to obtain image information pertaining to a graphical scene of the 3D object, obtain viewpoint information pertaining to the 3D scene, and draw the 3D object at a corresponding depth in the 3D scene.

18. The system of claim 13, wherein the input daemon is further configured to map two-dimensional (2D) input coordinates of the input event at the fusion program into corresponding 2D coordinates of the application program.