DISPLAY SURFACE TRACKING

• US 20100156907A1
• Filed: 12/23/2008
• Published: 06/24/2010
• Est. Priority Date: 12/23/2008
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mikolajczyk, Peter, VanderSpek, Paul J., Khawand, Charbel
• Application Number:
  US12/342,806
• Publication Number:
  US 20100156907A1
• Time in Patent Office: Days
• US Class Current: 345/427
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

Display surface tracking techniques are described in which a one or more modules may perform enhanced rendering techniques to output graphics based on tracking of a display device. In an embodiment, one or more tracking sensors may be used to track position of a display relative to a viewer. In at least some embodiments, the tracking sensors include a camera of the device that is used to monitor a position of the viewer relative to the display. Based on tracking performed via the one or more tracking sensors, projection planes used to render graphics on the display may be calculated and a graphics presentation may be output in accordance with the calculated projection planes.

Claims

1. A method comprising:

outputting graphics at a device using a projection plane determined based on a viewer'"'"'s face position, the viewer'"'"'s face position detected using a camera of the device;

detecting, using the camera, a change in the viewer'"'"'s face position;

calculating an updated projection plane based on the detected change; and

outputting the graphics at the device using the updated projection plane.

2. The method as recited in claim 1, wherein the projection plane is defined by one or more projection angles, the projection angles derived from the viewer'"'"'s face position.

3. The method as recited in claim 1, wherein outputting the graphics using the updated projection plane comprises rendering the graphics to maintain the same perspective before and after the change in the viewer'"'"'s face position.

4. The method as recited in claim 1, wherein the graphics include three-dimensional graphics (3D).

5. The method as recited in claim 4, wherein the projection plane defines which surfaces of the three-dimensional (3D) graphics are visible when the three-dimensional (3D) graphics are output.

6. The method as recited in claim 1, wherein the viewer'"'"'s face position comprises a position of the viewer'"'"'s face relative to a display of the device.

7. The method as recited in claim 1, wherein the detecting further comprises capturing a facial image of the viewer'"'"'s face.

8. The method as recited in claim 1, wherein the detecting and calculating occur responsive to manual manipulation of the device by the viewer.

9. The method as recited in claim 1, wherein the detecting and calculating occur responsive to movement of the viewer'"'"'s face relative to the device.

10. The method as recited in claim 1, wherein the device is configured as a mobile phone.

11. The method as recited in claim 1, wherein the device is configured as a mobile client device.

12. One or more computer-readable storage media comprising executable instructions that are stored thereon and executable via a processor of a mobile client device to output three-dimensional (3D) graphics at the mobile client device using a projection plane determined based on data obtained from multiple tracking sensors configured to track a position of a display of the mobile client device relative to a viewer.

13. One or more computer-readable storage media as recited in claim 12, wherein the multiple tracking sensors include a camera configured to detect a position of the viewer.

14. One or more computer-readable storage media as recited in claim 12, wherein the instructions are further executable to:

detect changes in the position of a display of the mobile client device relative to the viewer; and

responsive to each detected change in position, calculate a corresponding projection plane used to output the three-dimensional (3D) graphics.

15. A mobile client device comprising:

one or more processors;

memory;

a display device;

one or more tracking sensors including a camera; and

one or more modules stored in the memory and executable via the processor to;

determine an initial position of a viewer of the display device;

present three-dimensional (3D) graphics via the display device using a projection plane computed based on the initial position;

obtain data from the one or more tracking sensors regarding a position of the display device to detect a change in the initial position of the viewer relative to the display device; and

when a change in the initial position is detected;

calculate an updated projection plane based on the change; and

output the three-dimensional (3D) graphics via the display device using the updated projection plane.

16. The mobile client device as recited in claim 15, wherein the initial position is determined based on data obtained via the camera.

17. The mobile client device as recited in claim 16, wherein determining the initial position based on data obtained via the camera comprises:

capturing an image of a face of the viewer; and

processing the captured image to determine an angle at which the viewer is viewing the display device.

18. The mobile client device as recited in claim 15, wherein the initial position is set to a default position for the viewer.

19. The mobile client device as recited in claim 15, wherein to calculate an updated projection plane comprises determining one or more projection angles based on the change in the initial position of the viewer relative to the display device.

20. The mobile client device as recited in claim 15, wherein the tracking sensors further include an accelerometer, a gyroscope, and a distance sensor.