System and method for presenting virtual and augmented reality scenes to a user

• US 9,041,743 B2
• Filed: 03/01/2012
• Issued: 05/26/2015
• Est. Priority Date: 11/24/2010
• Status: Active Grant

• Current Assignee: Aria Glassworks, Inc. (Dropbox, Inc.)
• Original Assignee: Aria Glassworks, Inc. (Dropbox, Inc.)
• Inventors: McArdle, Terrence Edward, Newhouse, Benjamin Zeis
• Primary Examiner(s): Tung, Kee M
• Assistant Examiner(s): Gray, Ryan M
• Application Number:
  US13/410,176
• Publication Number:
  US 20120242656A1
• Time in Patent Office: 1,181 Days
• US Class Current: 345/660
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

A method of presenting a scene to a user according to a preferred embodiment includes determining a real orientation of a device relative to a projection matrix and determining a user orientation of the device relative to a nodal point. The method of the preferred embodiment can further include orienting a scene displayable on the device to the user in response to the real orientation and the user orientation; and displaying the scene on the device. Variations of the method can include a three-dimensional aspect of the scene with which the user can interact through manipulation of the real orientation and/or the user orientation of the device. The method of the preferred embodiment can be performed by an apparatus and/or embodied in computer program product including machine-readable code.

Claims

1. A method comprising:

determining a real orientation of a device relative to a three-dimensional frame of reference;

determining a user orientation of the device relative to a nodal point including a distance from the nodal point to the device;

orienting an augmented reality scene comprising a three dimensional aspect and a two dimensional aspect on the device in response to the user orientation and the real orientation;

adjusting a synthetic depth of the three dimensional aspect based on a change in the distance from the nodal point to the device, wherein in response to a reduction of linear distance between the nodal point and the device the synthetic depth is adjusted by changing a parallax setting associated with the three dimensional aspect to make the three dimensional aspect appear closer to the nodal point, and wherein in response to an increase of linear distance between the nodal point and the device the synthetic depth is adjusted by changing the parallax setting to make the three dimensional aspect appear farther from the nodal point;

displaying a first perspective of the three dimensional aspect of the scene on the device to the right eye; and

displaying a second perspective of the three dimensional aspect of the scene on the device to the left eye;

wherein the first perspective and the second perspective are not identical.

2. The method of claim 1, further comprising augmenting an appearance of the three dimensional aspect of the scene.

3. The method of claim 2, wherein augmenting the appearance of the three dimensional aspect of the scene comprises maintaining a synthetic distance between the three dimensional aspect and the user.

4. The method of claim 3 wherein maintaining a synthetic distance comprises maintaining a synthetic distance by maintaining a stereoscopic offset between the first perspective and the second perspective.

5. The method of claim 2, wherein augmenting the appearance of the three dimensional aspect of the scene comprises altering a depth intensity of the scene.

6. The method of claim 1, further comprising selecting the three dimensional aspect in response to a change in the real orientation.

7. The method of claim 1, further comprising selecting the three dimensional aspect in response to a change in the user orientation.

8. The method of claim 1, further comprising selecting the three dimensional aspect in response to a user input.

9. The method of claim 1 wherein the first perspective and the second perspective can be combined to form a stereogram.

10. The method of claim 1 wherein displaying the first perspective comprises displaying the first perspective when the left eye of the user is obstructed;

wherein displaying the second perspective comprises displaying the second perspective when the right eye of the user is obstructed.

11. The method of claim 1 wherein displaying the first perspective comprises displaying the first perspective in a first color;

wherein displaying the second perspective comprises displaying the second perspective in a second color;

wherein the first color is filtered from light visible to the left eye and the second color is filtered from light visible to the right eye.

12. The method of claim 1 wherein displaying the first perspective comprises displaying the first perspective in a first polarization;

wherein displaying the second perspective comprises displaying the second perspective in a second polarization;

wherein the first polarization is filtered from light visible to the left eye and the second polarization is filtered from light visible to the right eye.

13. A method of presenting an augmented reality scene to a user having a right eye and a left eye comprising:

determining a real orientation of a device relative to a three-dimensional frame of reference;

determining a user orientation of the device relative to a nodal point including a distance from the nodal point to the device;

selecting a three dimensional aspect based on the real orientation and the user orientation;

orienting an augmented reality scene comprising the three dimensional aspect and a two dimensional aspect on the device in response to the real orientation and the user orientation;

generating a first perspective of the three dimensional aspect of the scene on the device;

generating a second perspective of the three dimensional aspect of the scene on the device, wherein the second perspective is not identical to the first perspective;

displaying the first perspective and the second perspective such that a stereoscopic view, having a synthetic distance and a depth intensity, is provided to the user;

adjusting the synthetic distance in response to the real orientation and a change in the distance from the nodal point to the device, wherein the synthetic distance corresponds to an apparent distance between the nodal point and the three dimensional aspect; and

adjusting the depth intensity of the scene in response to the real orientation and the change in the distance from the nodal point to the device, wherein the depth intensity corresponds to a parallax setting associated with the three dimensional aspect.

14. The method of claim 13 wherein maintaining the synthetic distance comprises adjusting a parallax between the first perspective and the second perspective.

15. The method of claim 14 further comprising displaying a third perspective of the three dimensional aspect of the scene on the device in response to a change in the user orientation;

wherein the third perspective is displayed to both the right eye and the left eye.

16. A non-transitory computer readable storage medium including code stored thereon which, when executed by a processor, causes the processor to perform a method of:

determining a real orientation of a device relative to a three-dimensional frame of reference;

determining a user orientation of the device relative to a nodal point including a distance from the nodal point to the device;

orienting an augmented reality scene comprising a three dimensional aspect and a two dimensional aspect on the device in response to the user orientation and the real orientation;

adjusting a synthetic depth of the three dimensional aspect based on a change in the distance from the nodal point to the device, wherein in response to a reduction of linear distance between the nodal point and the device the synthetic depth is adjusted by changing a parallax setting associated with the three dimensional aspect to make the three dimensional aspect appear closer to the nodal point, and wherein in response to an increase of linear distance between the nodal point and the device the synthetic depth is adjusted by changing the parallax setting to make the three dimensional aspect appear farther from the nodal point;

displaying a first perspective of the three dimensional aspect of the scene on the device to the right eye;

displaying a second perspective of the three dimensional aspect of the scene on the device to the left eye; and

wherein the first perspective and the second perspective are not identical.

17. The non-transitory computer readable storage medium of claim 16 further comprising instructions stored thereon which, when executed by the processor, causes the processor to augment an appearance of the three dimensional aspect of the scene.

18. The non-transitory computer readable storage medium of claim 17, wherein augmenting the appearance of the three dimensional aspect of the scene comprises maintaining a synthetic distance between the three dimensional aspect and the user.

19. The non-transitory computer readable storage medium of claim 17, wherein augmenting the appearance of the three dimensional aspect of the scene comprises altering a depth intensity of the scene.

20. The non-transitory computer readable storage medium of claim 18, wherein maintaining a synthetic distance comprises maintaining a synthetic distance by maintaining a stereoscopic offset between the first perspective and the second perspective.