System and method for integrating multiple virtual rendering systems to provide an augmented reality

• US 9,430,861 B2
• Filed: 10/20/2014
• Issued: 08/30/2016
• Est. Priority Date: 06/23/2009
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Gay, Michael, Thiel, Aaron
• Primary Examiner(s): Du, Haixia
• Application Number:
  US14/519,013
• Publication Number:
  US 20150035863A1
• Time in Patent Office: 680 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

There is provided a system and method for integrating multiple virtual rendering systems to provide an augmented reality. There is provided a method for integrating multiple virtual rendering systems for outputting a composite render to a display, comprising obtaining a first environment data from a first virtual rendering system using a first camera view, obtaining a second environment data from a second virtual rendering system using a second camera view, rendering the composite render by processing the first environment and the second environment, and outputting the composite render to the display. Additionally, the first environment data and second environment data may depend on synchronized or corresponding inputs, and display priority algorithms or masking algorithms may be used to determine virtual and real object display priority.

Claims

1. A method of displaying a composite render, the method comprising:

obtaining a first virtual environment data, including one or more first virtual objects, from a first virtual rendering system using a first camera view;

obtaining a second virtual environment data, including one or more second virtual objects, from a second virtual rendering system using a second camera view;

creating the composite render by combining the one or more first virtual objects and the one or more second virtual objects to provide a virtual scene, wherein the creating applies a display priority algorithm when a first position of the one or more of the first virtual objects is similar to a second position of the one or more of the second virtual objects;

outputting the composite render to a display;

updating, after the outputting, the first virtual environment data from the first virtual rendering system at a first update rate;

updating the second virtual environment data from the second virtual rendering system at a second update rate;

re-creating the composite render using the updated first virtual environment data and the updated second virtual environment data; and

outputting the re-created composite render to the display.

2. The method of claim 1, wherein the first camera view is the same as the second camera view.

3. The method of claim 1, wherein the first camera view is different from the second camera view.

4. The method of claim 1 further comprising applying a masking algorithm to hide the one or more first virtual objects.

5. The method of claim 1, wherein the first virtual rendering system and the second virtual rendering system use a shared input for determining a first movement of the one or more first virtual objects from the first virtual environment data and a second movement of the one or more second virtual objects from the updated second virtual environment data.

6. A rendering device for displaying a composite render, rendering device comprising:

a processor configured to;

obtain a first virtual environment data, including one or more first virtual objects, from a first virtual rendering system using a first camera view;

obtain a second virtual environment data, including one or more second virtual objects, from a second virtual rendering system using a second camera view;

create the composite render by combining the one or more first virtual objects and the one or more second virtual objects to provide a virtual scene, wherein the creating applies a display priority algorithm when a first position of the one or more of the first virtual objects is similar to a second position of the one or more of the second virtual objects;

output the composite render to a display;

update, after the outputting, the first virtual environment data from the first virtual rendering system at a first update rate;

update the second virtual environment data from the second virtual rendering system at a second update rate;

re-create the composite render using the updated first virtual environment data and the updated second virtual environment data; and

output the re-created composite render to the display.

7. The rendering device of claim 6, wherein the first camera view is the same as the second camera view.

8. The rendering device of claim 6, wherein the first camera view is different from the second camera view.

9. The rendering device of claim 6, wherein the processor is further configured to apply a masking algorithm to hide the one or more first virtual objects.

10. The rendering device of claim 6, wherein the first virtual rendering system and the second virtual rendering system use a shared input for determining a first movement of the one or more first virtual objects from the first virtual environment data and a second movement of the one or more second virtual objects from the updated second virtual environment data.

11. A computer software program stored in a computer readable memory for displaying a composite render, wherein when the computer software program is executed by a processor, the computer software program performs a method comprising:

obtaining a first virtual environment data, including one or more first virtual objects, from a first virtual rendering system using a first camera view;

obtaining a second virtual environment data, including one or more second virtual objects, from a second virtual rendering system using a second camera view;

creating the composite render by combining the one or more first virtual objects and the one or more second virtual objects to provide a virtual scene, wherein the creating applies a display priority algorithm when a first position of the one or more of the first virtual objects is similar to a second position of the one or more of the second virtual objects; and

outputting the composite render to a display;

updating, after the outputting, the first virtual environment data from the first virtual rendering system at a first update rate;

updating the second virtual environment data from the second virtual rendering system at a second update rate;

re-creating the composite render using the updated first virtual environment data and the updated second virtual environment data; and

outputting the re-created composite render to the display.

12. The computer software program of claim 11, wherein the first camera view is the same as the second camera view.

13. The computer software program of claim 11, wherein the first camera view is different from the second camera view.

14. The computer software program of claim 11, wherein the method further comprising applying a masking algorithm to hide the one or more first virtual objects.

15. The computer software program of claim 11, wherein the first virtual rendering system and the second virtual rendering system use a shared input for determining a first movement of the one or more first virtual objects from the first virtual environment data and a second movement of the one or more second virtual objects from the updated second virtual environment data.