User interface adaptation based on detected user location

• US 9,746,901 B2
• Filed: 07/31/2014
• Issued: 08/29/2017
• Est. Priority Date: 07/31/2014
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Ady, Roger W., Alameh, Rachid, Steuer, Paul R.
• Primary Examiner(s): Amini, Javid A
• Application Number:
  US14/447,649
• Publication Number:
  US 20160034050A1
• Time in Patent Office: 1,125 Days
• Field of Search: 345619
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A device (102) detects when a user is in close physical proximity to the device, such as within a few feet of the device. While the user is in close physical proximity to the device, the device also detects the location of the user relative to the device, and optionally a speed at which the user is moving. The user interface presented by the device is adapted to the location of the user relative to the device and optionally the speed at which the user is moving, but without needing physical manipulation of the device by the user. The adaptation can include, for example, orienting content presented on a display of the device based on the location of the user relative to the device so that the content appears “upright” or “right side up” for the user to view given their location.

Claims

1. A method comprising:

detecting, by a motion sensor of a computing device, motion proximate to the computing device, wherein the motion sensor is one or more of an infrared motion sensor, an ultrasonic motion sensor, or an infrared passive sensor;

determining, by the computing device and based on the motion, a speed at which the user is moving towards the computing device;

changing, based on the speed at which the user is moving towards the computing device, a size of at least a portion of content presented on the display;

determining, by the computing device, and based on the motion, a distance between the user and the computing device; and

responsive to determining, based on the distance, that the user is in close physical proximity to the computing device;

determining, by the computing device and based on the motion, a location of the user relative to the computing device; and

orienting, based on the location of the user relative to the computing device, the content presented on a display of the computing device.

2. The method of claim 1, further comprising:

changing, based on the distance between the user and the computing device, an appearance of the content presented on the display by at least changing one or more of a size of a portion of the content, a brightness of the display, or one or more colors of the content.

3. The method of claim 1, wherein orienting the content comprises changing the orientation of the content presented on the display in increments.

4. The method of claim 3, the increments comprising 1 degree increments.

5. The method of claim 3, the increments comprising 90 degree increments.

6. The method of claim 1, further comprising repeating the determining and orienting as the location of the user relative to the computing device changes.

7. The method of claim 6, further comprising imposing a time limit on orienting the content presented on the display so that the orientation of the content presented on the display is not changed at greater than a threshold frequency.

8. The method of claim 6, further comprising orienting the content presented on the display of the computing device only if movement of the user relative to the computing device exceeds an angular threshold.

9. The method of claim 1, wherein orienting the content comprises orienting the content presented on the display of the computing device in the absence of physical manipulation of the computing device by the user.

10. The method of claim 1, wherein determining that a user is in close physical proximity to the computing device comprises determining that multiple users are in close physical proximity to the computing device, the method further comprising:

selecting one of the multiple users,

wherein determining the location of the user relative to the computing device comprises determining the location of the selected user relative to the computing device, and

wherein orienting the content comprises orienting the content presented on the display of the computing device based on the location of the selected user relative to the computing device.

13. The method of claim 10, wherein selecting one of the multiple users includes one or more of:

selecting the one of the multiple users who is closest to the computing device;

selecting the one of the multiple users who is moving fastest;

selecting the one of the multiple users having a face recognized by the computing device;

or

selecting the one of the multiple users who is moving towards the computing device.

18. The method of claim 1, further comprising:

changing, based on the distance between the user and the computing device, a volume of audio being output by the computing device.

19. The method of claim 1, wherein changing, based on the speed at which the user is moving towards the computing device, a size of at least a portion of content presented on the display comprising:

determining, by the computing device, whether the speed at which the user is moving towards the computing device is less than a threshold speed;

responsive to determining that the speed is less than the threshold speed, enlarging the size of at least the portion of the content presented on the display.

20. The method of claim 19, wherein only the portion of the content that is enlarged is presented on the display.

11. A computing device comprising:

a display;

one or more sensors configured to detect motion proximate to the computing device, wherein the one or more sensors include one or more of an infrared motion sensor, an ultrasonic motion sensor, or an infrared passive sensor; and

a user interface adaptation system configured to;

determine, based on the motion, a speed at which the user is moving towards the computing device;

change based on the speed at which the user is moving towards the computing device, a size of at least a portion of content presented on the display;

determine, based on the motion, a distance between the user and the computing device;

responsive to determining, based on the distance, that the user is in close proximity to the computing device;

determine, based on the motion, a location of the user relative to the computing device; and

orient content presented on the display based on the location of the user relative to the computing device.

12. The computing device of claim 11, the user interface adaptation system being further configured to orient the content presented on the display in the absence of physical manipulation of the computing device by the user.

14. A non-transitory computer-readable storage medium encoded with instructions that, when executed, cause one or more processors of a computing device to:

detect, via a motion sensor of the computing device, motion proximate to the computing device, wherein the motion sensor is one or more of an infrared motion sensor, an ultrasonic motion sensor, or an infrared passive sensor;

determine, based on the motion, a speed at which the user is moving towards the computing device;

change based on the speed at which the user is moving towards the computing device, a size of at least a portion of content presented on the display;

determine, based on the motion, a distance between the user and the computing device; and

responsive to determining, based on the distance, that the user is in close physical proximity to the computing device;

determine, based on the motion, a location of the user relative to the computing device; and

orient, based on the location of the user relative to the computing device, content presented on a display of the computing device.

15. The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the one or more processors to:

change, based on the distance between the user and the computing device, an appearance of the content presented on the display by at least changing one or more of a size a portion of the content, a brightness of the display, or one or more colors of the content.

16. The non-transitory computer-readable storage medium of claim 14, wherein the instructions further cause the one or more processors to:

determine that multiple users are in close physical proximity to the computing device;

select one of the multiple users,

determine the location of the selected user relative to the computing device, and

orient the content presented on the display of the computing device based on the location of the selected user relative to the computing device.

17. The non-transitory computer-readable storage medium of claim 16, wherein the instructions that cause the one or more processors to select one of the multiple users includes instructions to cause the one or more processors to:

select the one of the multiple users who is closest to the computing device;

select the one of the multiple users who is moving fastest;

select the one of the multiple users having a face recognized by the computing device;

or

select the one of the multiple users who is moving towards the computing device.