AUTOMATIC VIEW ADJUSTMENT

• US 20150102995A1
• Filed: 10/15/2013
• Published: 04/16/2015
• Est. Priority Date: 10/15/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Shen, Guobin, Li, Liqun
• Granted Patent: US 9,658,688 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A view adjustment system using information captured by one or more sensors on a client device determines a projection direction for content to be displayed on a display of the client device. Upon determining the projection direction, the view adjustment system transforms the content into a perspective view based on the determined projection direction and prompts the client device to present the content in the perspective view to a user. The view adjustment system may monitor changes in relative position and/or direction of the user with respect to the display, adjust the projection direction, and transform the content to reflect these changes.

Claims

1. A system comprising:

at least one processor;

memory operatively coupled to the at least one processor;

at least one sensor operatively coupled to the at least one processor;

a display operatively coupled to the at least one processor;

a detection module stored in the memory and executable by the at least one processor to;

detect a face of a user using the at least one sensor;

identify an eye of the user from the detected face; and

estimate an angle of view between the eye of the user and a surface of the display;

a transformation module stored in the memory and executable by the at least one processor to transform content for display by the display into a perspective view, the perspective view projecting the content into a plane perpendicular to a line of sight of the user based at least on the estimated angle of view; and

a display module stored in the memory and executable by the at least one processor to cause presentation of the content in the perspective view on the display.

2. The system of claim 1, wherein the image sensor comprises at least one of a fisheye camera, a wide field-of-view camera, or an array of cameras.

3. The system of claim 1, further comprising a determination module configured to determine whether to re-estimate the angle of view based at least on occurrence of a posture change or a device attitude change, and to trigger the detection module to re-estimate the angle of view based at least on the occurrence.

4. The system of claim 3, wherein occurrence of the posture change or the device attitude change comprises at least one of:

the display being turned on;

the user using the display;

the user being within a predefined proximity of the display;

or

a change in an amount of light incident on the display.

5. A computer-implemented method comprising:

estimating an angle of view between a user and a display of a device; and

transforming content displayed on the display of the device into a perspective view based at least on the estimated angle of view.

6. The computer-implemented method of claim 5, further comprising presenting the content in the perspective view to the user.

7. The computer-implemented method of claim 5, wherein the transforming comprises projecting the content on a two-dimensional plane that is perpendicular to a line of sight of the user that is determined based on the estimated angle of view.

8. The computer-implemented method of claim 5, wherein the device comprises a computing device, a mobile device, or a display device.

9. The computer-implemented method of claim 6, further comprising monitoring the angle of view between the user and the display of the device.

10. The computer-implemented method of claim 5, further comprising:

detecting a change in the angle of view between the user and the display of the device; and

adjusting the perspective view based on the change in the angle of view.

11. The computer-implemented method of claim 5, further comprising determining that a condition for estimating the angle of view is satisfied.

12. The computer-implemented method of claim 11, wherein the condition comprises at least one of:

the display being turned on;

the user using the device;

the user being within a predefined proximity of the device;

or

a change in an amount of light incident on the device.

13. The computer-implemented method of claim 5, wherein the estimating comprises:

detecting, by a sensor, a face of the user;

identifying an eye of the user from the detected face;

determining a line of sight from the eye of the user to the display of the device; and

determining the angle of view based on the estimated line of sight.

14. The computer-implemented method of claim 13, wherein the sensor comprises at least one of a fisheye camera, a wide field-of-view camera, or an array of cameras.

15. The computer-implemented method of claim 5, wherein the angle of view corresponds to an angle between a line of sight from the user and a plane parallel to a surface of the display of the device.

16. One or more computer-readable media storing executable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising:

receiving input from one or more sensors;

determining a line of sight from a user to a display based on the input; and

transforming content displayed on the display into a perspective view that projects the content into a plane substantially perpendicular to the line of sight from the user.

17. The one or more computer-readable media of claim 16, the acts further comprising providing the content in the perspective view for presentation to the user.

18. The one or more computer-readable media of claim 16, the acts further comprising:

detecting a change in the line of sight from the user to the display;

transforming the content displayed on the display to a new perspective view; and

presenting the content in the new perspective view to the user.

19. The one or more computer-readable media of claim 16, the acts further comprising determining that a condition for determining the line of sight is satisfied.

20. The one or more computer-readable media of claim 19, wherein the condition comprises at least one of:

the display being turned on;

the user using a device of the display;

the user being within a predefined proximity of the display;

or

a change in an amount of light incident on the device of the display.