Low distraction interfaces

• US 9,645,642 B2
• Filed: 02/16/2015
• Issued: 05/09/2017
• Est. Priority Date: 12/28/2010
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Karakotsios, Kenneth, Moy, Steven Ka Cheung, Noble, Isaac S., Selker, Edwin Joseph
• Primary Examiner(s): Tung, David
• Application Number:
  US14/623,453
• Publication Number:
  US 20150177834A1
• Time in Patent Office: 813 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user

Abstract

A low distraction interface can be provided for an electronic device by monitoring information such as a gaze direction of a user. A device can be configured to only display information to a user when the user is looking substantially toward the device, and can be configured to present that information in a way that is of minimal distraction to others nearby. The user can control aspects of the display by looking away from the device, continuing to look at the device for a period of time, or otherwise providing input without physically interacting with the device. Such an approach can be beneficial for settings such as business meetings where a user might want to obtain information from the device but does not want to appear inconsiderate by picking up and checking information on the device.

Claims

1. A computer-implemented method for enabling a user to interface with an electronic device, comprising:

receiving image data from at least one image capture element of the electronic device;

analyzing the image data to determine at least one period during which a viewing direction of a user is in a direction at least substantially toward a display element of the electronic device;

analyzing the image data to determine a relative orientation angle between the user and a plane of the display element of the electronic device;

determining information to be displayed on the display element based at least upon a movement or gesture represented in the image data;

determining an adjusted rendering angle and elongation based at least in part on the relative orientation angle between the user and the plane of the display element;

displaying, during the at least one period, the information on the display element according to the adjusted rendering angle and the elongation so that the information appears in a normal aspect ratio and at a normal angle to the user;

analyzing additional image data received from the at least one image capture element of the electronic device to determine one or more gestures; and

displaying additional information based at least upon the one or more gestures and the relative orientation angle between the user and the plane of the display element.

2. The computer-implemented method of claim 1, wherein determining the information to be displayed further comprises:

determining the information based at least in part on an identity of the user.

3. The computer-implemented method of claim 1, further comprising:

enabling the user to activate the display element based upon the viewing direction of the user being in the direction at least substantially toward the display element of the electronic device.

4. The computer-implemented method of claim 1, further comprising:

determining that the viewing direction of the user is in a direction away from the display element for a threshold period of time; and

adjusting the display element to prevent the information from being displayed on the display element.

5. The computer-implemented method of claim 1, further comprising:

determining the viewing direction of the user based upon at least one of a head position of the user, a gaze direction of the user, or the movement or the gesture.

6. The computer-implemented method of claim 1, further comprising:

determining, during at least one second period, that the viewing direction of the user is in the direction at least substantially towards the display element for at least a threshold amount of time; and

displaying additional information on the display element during the at least one second period.

7. The computer-implemented method of claim 1, further comprising:

determining a viewing direction of a person other than the user is in a direction that is substantially toward the display element; and

adjusting the display element to prevent the information from being displayed on the display element.

8. A computer system, comprising:

at least one processor;

at least one display element;

at least one image capture element; and

at least one memory device including instructions operable to be executed by the at least one processor to perform a set of actions, enabling the computer system to;

receive image data from the at least one image capture element of the computer system;

analyze the image data to determine at least one period during which a viewing direction of a user is in a direction at least substantially towards the at least one display element of the computer system;

analyze the image data to determine a relative orientation angle between the user and a plane of the at least one display element of the computer system;

determine information to be displayed on the at least one display element based at least upon a movement or gesture represented in the image data;

determine an adjusted rendering angle and elongation based at least in part on the relative orientation angle between the user and the plane of the at least one display element;

display, during the at least one period, the information on the at least one display element according to the adjusted rendering angle and the elongation;

analyze additional image data received from the at least one image capture element of the computer system to determine one or more gestures; and

display additional information based at least upon the one or more gestures and the relative orientation angle between the user and the plane of the at least one display element.

9. The computer system of claim 8, wherein the at least one image capture element includes one of an ambient light still camera, an ambient light video camera, an infrared imaging element, or a thermal imaging element.

10. The computer system of claim 8, wherein the at least one display element includes a filter for substantially blocking viewing the information on the at least one display element in at least one direction.

11. The computer system of claim 8, wherein the instructions when executed further cause the computer system to:

determine the information based at least in part on an identity of the user.

12. The computer system of claim 8, wherein the instructions when executed further cause the computer system to:

enable the user to activate the at least one display element based upon the viewing direction of the user being in a direction at least substantially toward the at least one display element of the computer system.

13. The computer system of claim 8, wherein the instructions when executed further cause the computer system to:

determine that the viewing direction of the user is in a direction away from the at least one display element for a threshold period of time; and

adjust the at least one display element to prevent the information from being displayed on the at least one display element.

14. The computer system of claim 8, wherein the viewing direction of the user is determined based upon at least one of a head position of the user, a gaze direction of the user, or the movement or the gesture.

15. A computing device including instructions that, upon being executed by a processor of a computing device, cause the computing device to:

determine at least one period during which a viewing direction of a user is in a direction that is at least substantially toward a display element of the computing device;

determine a relative orientation angle between the user and a plane of the display element of the computing device;

determine information to be displayed on the display element based at least upon a gesture;

determine an adjusted rendering angle and elongation based at least in part on the relative orientation angle between the user and the plane of the display element;

display, during the at least one period, the information on the display element according to the adjusted rendering angle and the elongation;

analyze additional image data received from at least one image capture element of the computing device to determine one or more gestures; and

display additional information based at least upon the one or more gestures and the relative orientation angle between the user and the plane of the display element.

16. The computing device of claim 15, wherein the instructions, upon being executed by the processor of the computing device, cause the computing device to:

determine, during at least one second period, that the viewing direction of the user is in the direction at least substantially towards the display element for at least a threshold amount of time; and

display additional information on the display element during the at least one second period.

17. The computing device of claim 15, wherein the instructions, upon being executed by the processor of the computing device, cause the computing device to:

determine a viewing direction of a person other than the user is in a direction that is substantially toward the display element; and

adjust the display element to prevent the information from being displayed on the display element.