User and device movement based display compensation with corrective action for displaying content on a device

• US 9,922,399 B2
• Filed: 07/25/2016
• Issued: 03/20/2018
• Est. Priority Date: 10/19/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Abraham, Robin, Fawcett, Andrew V.
• Primary Examiner(s): Drennan, Barry
• Assistant Examiner(s): PATEL, SHIVANG I
• Application Number:
  US15/218,595
• Publication Number:
  US 20160335739A1
• Time in Patent Office: 603 Days
• Field of Search: 345648
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A direction and distance of movement of a display device as well as of a user of the display device are determined. Based on these determined directions and distances of movement, compensation to apply to content displayed on the display device to compensate for movement of the user with respect to the device is determined and applied to the content. A portion of the display device at which the user is looking can also be detected. The compensation is applied to the content only if applying the compensation would not result in the portion being positioned beyond the display device. If applying the compensation would result in the portion being positioned beyond the display device then appropriate corrective action is taken, such as not applying the compensation to the content.

Claims

1. A method comprising:

determining compensation to apply to content displayed on a display device to compensate for movement of a user with respect to the display device;

determining whether applying the compensation would result in at least a portion of the content displayed on the display device being positioned beyond a perimeter of the display device;

responsive to determining that applying the compensation would result in at least the portion of the content displayed on the display device being positioned beyond the perimeter of the display device, taking corrective action to prevent at least the portion of the content displayed on the display device from being positioned beyond the perimeter of the display device; and

applying the compensation to the content displayed on the display device.

2. A method as recited in claim 1, wherein the determining whether applying the compensation would result in at least the portion of the content displayed on the display device being positioned beyond the perimeter of the display device comprises determining whether applying the compensation would result in a portion of the content at which the user is looking being positioned beyond the perimeter of the display device.

3. A method as recited in claim 2, wherein taking the corrective action is performed in response to determining that applying the compensation would result in the portion of the content at which the user is looking being positioned beyond the perimeter of the display device to prevent the portion of content at which the user is looking from being positioned beyond the perimeter of the display device.

4. A method as recited in claim 1, wherein determining the compensation to apply to the content displayed on the display device is further based on a distance of movement of the display device.

5. A method as recited in claim 1, wherein determining the compensation to apply to the content displayed on the display device is further based on a direction of movement of the user and a distance of movement of the user.

6. A method as recited in claim 1, the corrective action comprising not applying the compensation to the content displayed on the display device.

7. A method as recited in claim 1, the corrective action comprising applying only a part of the compensation to the content displayed on the display device.

8. A method as recited in claim 1, the compensation comprising shifting the content in a plane approximately parallel to a plane of the display device.

9. A method as recited in claim 1, the compensation comprising zooming in or zooming out the content.

10. A method as recited in claim 1, wherein determining the compensation to apply to the content displayed on the display device is based on data received from at least one of an image capture device or an accelerometer of the display device.

11. One or more computer-readable storage media having stored thereon multiple instructions that, when executed by one or more processors of a computing device, cause the one or more processors to:

determine compensation to apply to content displayed on a display device to compensate for movement of a user with respect to the display device;

determine whether applying the compensation would result in at least a portion of the content displayed on the display device being positioned beyond a display area of the display device;

responsive to determining that applying the compensation would result in at least the portion of the content displayed on the display device being positioned beyond the display area of the display device, take corrective action to prevent at least the portion of the content displayed on the display device from being positioned beyond the display area of the display device; and

apply the compensation to the content display on the display device.

12. One or more computer-readable storage media as recited in claim 11, wherein to determine whether applying the compensation would result in at least the portion of the content displayed on the display device being positioned beyond the display area of the display device comprises to determine whether applying the compensation would result in a portion of the content at which the user is looking being positioned beyond the display area of the display device.

13. One or more computer-readable storage media as recited in claim 12, wherein to take the corrective action is performed in response to determining that applying the compensation would result in the portion of the content at which the user is looking being positioned beyond the display area of the display device to prevent the portion of content at which the user is looking from being positioned beyond the display area of the display device.

14. One or more computer-readable storage media as recited in claim 11, wherein to determine the compensation to apply to the content displayed on the display device is further based on a distance of movement of the display device.

15. One or more computer-readable storage media as recited in claim 11, wherein to determine the compensation to apply to the content displayed on the display device is further based on a direction of movement of the user and a distance of movement of the user.

16. One or more computer-readable storage media as recited in claim 11, the corrective action comprising not applying the compensation to the content displayed on the display device.

17. One or more computer-readable storage media as recited in claim 11, the corrective action comprising applying only a part of the compensation to the content displayed on the display device.

18. One or more computer-readable storage media as recited in claim 11, the compensation comprising shifting the content in a plane approximately parallel to a plane of the display device.

19. One or more computer-readable storage media as recited in claim 11, the compensation comprising zooming in or zooming out the content.

20. A computing device comprising:

one or more processors; and

one or more computer-readable storage media having stored thereon multiple instructions of a movement compensation system that, when executed by the one or more processors, cause the one or more processors to;

determine compensation to apply to content displayed on a display device to compensate for movement of a user with respect to the display device;

determine whether applying the compensation would result in at least a portion of the content displayed on the display device being positioned beyond a display area of the display device;

responsive to determining that applying the compensation would result in at least the portion of the content displayed on the display device being positioned beyond the display area of the display device, take corrective action to prevent at least the portion of the content displayed on the display device from being positioned beyond the display area of the display device; and

apply the compensation to the content displayed on the display device.