System and method for integrating multiple virtual rendering systems to provide an augmented reality

• US 8,907,941 B2
• Filed: 06/23/2009
• Issued: 12/09/2014
• Est. Priority Date: 06/23/2009
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Gay, Michael, Thiel, Aaron
• Primary Examiner(s): Tung, Kee M
• Assistant Examiner(s): Du, Haixia
• Application Number:
  US12/456,780
• Publication Number:
  US 20100321377A1
• Time in Patent Office: 1,995 Days
• Field of Search: 345/418, 345/633, 345/632, 345/419
• US Class Current: 345/419
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

There is provided a system and method for integrating multiple virtual rendering systems to provide an augmented reality. There is provided a method for integrating multiple virtual rendering systems for outputting a composite render to a display, comprising obtaining a first environment data from a first virtual rendering system using a first camera view, obtaining a second environment data from a second virtual rendering system using a second camera view, rendering the composite render by processing the first environment and the second environment, and outputting the composite render to the display. Additionally, the first environment data and second environment data may depend on synchronized or corresponding inputs, and display priority algorithms or masking algorithms may be used to determine virtual and real object display priority.

Claims

1. A method for integrating multiple virtual rendering systems for outputting a composite render to a display, the method comprising:

obtaining a first virtual environment data including first virtual objects from a first virtual rendering system using a first camera view;

storing the first virtual environment data in a memory;

obtaining a second virtual environment data including second virtual objects from a second virtual rendering system using a second camera view;

obtaining real environment data from a video capture system, wherein the real environment data includes a real life talent personality;

receiving positional data of the real life talent personality;

adjusting the second camera view based on the positional data to obtain an updated second virtual environment data including the second virtual objects;

storing the updated second virtual environment data in the memory;

creating the composite render by combining the first virtual objects from the first virtual environment data and the second virtual objects from the updated second virtual environment data to provide a virtual scene, and by combining the real life talent personality navigating the virtual scene, wherein the creating applies a display priority algorithm when a position of one or more of the first virtual objects is similar to a position of one or more of the second virtual objects; and

outputting the composite render to the display.

2. The method of claim 1, wherein the first camera view is the same as the second camera view.

3. The method of claim 1, wherein the first camera view is different from the second camera view.

4. The method of claim 1, wherein the rendering further applies a masking algorithm to hide the first virtual objects from the first virtual environment data or the second virtual objects from the updated second virtual environment data.

5. The method of claim 1, wherein the first virtual objects from the first virtual environment data and the second virtual objects from the updated second virtual environment data have corresponding locations.

6. The method of claim 5, wherein the first virtual rendering system and the second virtual rendering system use a shared input for determining a movement of the first virtual objects from the first virtual environment data and a movement of the second virtual objects from the updated second virtual environment data.

7. The method of claim 1 further comprising, prior to the rendering:

storing the real environment data in the memory.

8. The method of claim 1, wherein the rendering adjusts a rendered position of the real life talent personality in the composite render to avoid interference with the first virtual objects from the first virtual environment and the second virtual objects from the second virtual environment.

9. The method of claim 1, wherein the video capturing system uses a same camera view as the first camera view.

10. The method of claim 1, wherein the rendering is continuous.

11. A rendering device for integrating multiple virtual rendering systems for outputting a composite render to a display, the rendering device comprising:

a memory;

a processor in communication with the memory, the processor being configured to;

obtain a first virtual environment data including first virtual objects from a first virtual rendering system using a first camera view;

store the first virtual environment data in the memory;

obtain a second virtual environment data including second virtual objects from a second virtual rendering system using a second camera view;

obtain real environment data from a video capture system, wherein the real environment includes a real life talent personality;

receive positional data of a real life talent personality;

adjust the second camera view based on the positional data to obtain an updated second virtual environment data including the second virtual objects;

store the updated second virtual environment data in the memory;

creating the composite render by combining the first virtual objects from the first virtual environment data and the second virtual objects from the updated second virtual environment data to provide a virtual scene, and by combining the real life talent personality navigating the virtual scene, wherein the creating applies a display priority algorithm when a position of one or more of the first virtual objects is similar to a position of one or more of the second virtual objects; and

output the composite render to the display.

12. The rendering device of claim 11, wherein the first camera view is the same as the second camera view.

13. The rendering device of claim 11, wherein the first camera view is different from the second camera view.

14. The rendering device of claim 11, wherein the processor is further configured to apply a masking algorithm when rendering to hide the first virtual objects from the first virtual environment data or the second virtual objects from the updated second virtual environment data.

15. The rendering device of claim 11, wherein the first virtual objects from the first virtual environment data and the second virtual objects from the updated second virtual environment data have corresponding locations.

16. The rendering device of claim 15, wherein the first virtual rendering system and the second virtual rendering system use a shared input provided by the rendering device for determining a movement of the first virtual objects from the first virtual environment data and a movement of the objects from the second virtual updated second virtual environment data.

17. The rendering device of claim 11, wherein prior to the render the processor is further configured to:

store the real environment data in the memory.

18. The rendering device of claim 17, wherein the processor is further configured to adjust a rendered position of the real life personality in the composite render to avoid interference with the first virtual objects from the first virtual environment and the second virtual objects from the second virtual environment.