INTERACTIVE THREE DIMENSIONAL DISPLAYS ON HANDHELD DEVICES

• US 20110248987A1
• Filed: 04/08/2010
• Published: 10/13/2011
• Est. Priority Date: 04/08/2010
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: MITCHELL, KENNY
• Granted Patent: US 8,581,905 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Techniques are disclosed for rendering an anamorphic projection of 3D scene geometry on a handled device using a correct asymmetric perspective geometry projection. Once pose of the handheld device is determined, a relative eye position may be inferred when the device is tilted away from an initial or default pose, based on data supplied by accelerometers. Thus, embodiments of the invention result in a holographic style display without the need for glasses or external sensing attachments.

Claims

1. A computer-implemented method for rendering a set of three-dimensional (3D) geometry on a display of a handheld device, the method comprising:

receiving a set of accelerometer data determined by one or more accelerometers;

determining, based on the accelerometer data, a current pose of the handheld device; and

in response to changes in the current pose of the handheld device, rendering an anamorphic 3D display of the 3D geometry on the display of the handheld device.

2. The method of claim 1, further comprising, filtering the accelerometer data using a low-pass filter.

3. The method of claim 1, wherein each of the one or more accelerometers each measure acceleration of the handheld device relative to freefall in a distinct dimension.

4. The method of claim 1, wherein rendering an anamorphic 3D display of the 3D geometry on the display of the handheld device comprises:

generating an asymmetric anamorphic projection matrix;

generating a view matrix; and

transforming the 3D geometry using the asymmetric anamorphic projection matrix and the view matrix.

5. The method of claim 4, wherein the asymmetric anamorphic projection matrix distorts the rendered anamorphic 3D display to account for a relative tilting of the handheld device away from a default pose.

6. The method of claim 4, wherein the view matrix generally provides a transformation applied to world space geometry coordinates of three-dimensional (3D) geometry to generate a location and orientation relative to an offset eye position in view space.

7. The method of claim 1, further comprising:

determining a distortion present in the display based on the current pose; and

generating an image warp to transform the rendering of the anamorphic 3D display of the 3D geometry to correct a foreshortening effect resulting from the distortion.

8. The method of claim 1, wherein the handheld device includes a camera, and wherein the method further comprises:

tracking an eye position of a viewer using the camera; and

wherein the current pose and a position of the handheld device is determined based on the tracked eye position.

9. The method of claim 1, wherein the method further comprising,

determining whether the default pose of the handheld device is being viewed in one of a portrait viewing mode and a landscape viewing mode.

10. A computer-readable storage medium storing instructions that, when executed by a processor, cause a computer system to perform an operation for rendering a set of three-dimensional (3D) geometry on a display of a handheld device, the operation comprising:

receiving a set of accelerometer data determined by one or more accelerometers;

determining, based on the accelerometer data, a current pose of the handheld device; and

in response to changes in the current pose of the handheld device, rendering an anamorphic 3D display of the 3D geometry on the display of the handheld device.

11. The computer-readable storage medium of claim 10, further comprising, filtering the accelerometer data using a low-pass filter.

12. The computer-readable storage medium of claim 10, wherein each of the one or more accelerometers each measure acceleration of the handheld device relative to freefall in a distinct dimension.

13. The computer-readable storage medium of claim 10, wherein rendering an anamorphic 3D display of the 3D geometry on the display of the handheld device comprises:

generating an asymmetric anamorphic projection matrix;

generating a view matrix; and

transforming the 3D geometry using the asymmetric anamorphic projection matrix and the view matrix.

14. The computer-readable storage medium of claim 13, wherein the asymmetric anamorphic projection matrix distorts the rendered anamorphic 3D display to account for a relative tilting of the handheld device away from a default pose.

15. The computer-readable storage medium of claim 13, wherein the view matrix generally provides a transformation applied to world space geometry coordinates of three-dimensional (3D) geometry to generate a location and orientation relative to an offset eye position in view space.

16. The computer-readable storage medium of claim 10, wherein the operation further comprises:

determining a distortion present in the display based on the current pose; and

generating an image warp to transform the rendering of the anamorphic 3D display of the 3D geometry to correct a foreshortening effect resulting from the distortion.

17. The computer-readable storage medium of claim 10, wherein the handheld device includes a camera, and wherein the operation further comprises:

tracking an eye position of a viewer using the camera; and

wherein the current pose and a position of the handheld device is determined based on the tracked eye position.

18. The computer-readable storage medium of claim 10, wherein the operation further comprises:

determining whether the default pose of the handheld device is being viewed in one of a portrait viewing mode and a landscape viewing mode.

19. A system, comprising:

a processor; and

a memory configured to perform an operation for rendering a set of three-dimensional (3D) geometry on a display of a handheld device, the operation comprising;

receiving a set of accelerometer data determined by one or more accelerometers,

determining, based on the accelerometer data, a current pose of the handheld device, and

in response to changes in the current pose of the handheld device, rendering an anamorphic 3D display of the 3D geometry on the display of the handheld device.

20. The system of claim 19 further comprising, filtering the accelerometer data using a low-pass filter.

21. The system of claim 19 wherein each of the one or more accelerometers each measure acceleration of the handheld device relative to freefall in a distinct dimension.

22. The system of claim 19 wherein rendering an anamorphic 3D display of the 3D geometry on the display of the handheld device comprises:

generating an asymmetric anamorphic projection matrix;

generating a view matrix; and

transforming the 3D geometry using the asymmetric anamorphic projection matrix and the view matrix.

23. The system of claim 22, wherein the asymmetric anamorphic projection matrix distorts the rendered anamorphic 3D display to account for a relative tilting of the handheld device away from a default pose.

24. The system of claim 22, wherein the view matrix generally provides a transformation applied to world space geometry coordinates of three-dimensional (3D) geometry to generate a location and orientation relative to an offset eye position in view space.

25. The system of claim 19, wherein the operation further comprises:

determining a distortion present in the display based on the current pose; and

generating an image warp to transform the rendering of the anamorphic 3D display of the 3D geometry to correct a foreshortening effect resulting from the distortion.

26. The system of claim 19, wherein the handheld device includes a camera, and wherein the operation further comprises:

tracking an eye position of a viewer using the camera; and

wherein the current pose and a position of the handheld device is determined based on the tracked eye position.

27. The system of claim 19, wherein the operation further comprises:

determining whether the default pose of the handheld device is being viewed in one of a portrait viewing mode and a landscape viewing mode.