NON-OCCLUDED DISPLAY FOR HOVER INTERACTIONS

• US 20140282269A1
• Filed: 03/13/2013
• Published: 09/18/2014
• Est. Priority Date: 03/13/2013
• Status: Abandoned Application

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Strutt, Guenael Thomas, Polansky, Stephen Michael, Weber, Jason Robert, Zhou, Dong, Bell, Matthew Paul, Noble, Isaac Scott
• Application Number:
  US13/799,960
• Publication Number:
  US 20140282269A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A computing device can be configured to recognize when a user hovers over or is within a determined distance of an element displayed on the computing device to perform certain tasks. Information associated with the element can be displayed when such a hover input is detected. This information may comprise a description of what tasks are performed by selection of the element. This information could also be an enlarged version of the element to help the user disambiguate selection of multiple elements. The information can be displayed in a manner such that at least substantive portions of the information would not be obscured or occluded by the user.

Claims

1. A computer-implemented method for displaying information on a computing device having a touchscreen, comprising:

under the control of one or more computer systems configured with executable instructions,

configuring an interface element to display data when a user'"'"'s finger hovers over the interface element, the interface element being displayed on the touchscreen of the computing device;

detecting, using a sensor of the computing device, that the user'"'"'s finger is hovering over the interface element;

estimating a region of the touchscreen that is occluded, with respect to the user viewing the touchscreen, by the user'"'"'s finger; and

displaying the data outside the region of the touchscreen.

2. The computer-implemented method of claim 1, further comprising:

detecting capacitive disturbance corresponding to the user'"'"'s finger over the touchscreen,

wherein the region estimated to be occluded is based at least in part upon a location of the capacitive disturbance over the touchscreen.

3. The computer-implemented method of claim 2, further comprising:

estimating an angle of incidence between a line of sight of the user and the touchscreen by analyzing one or more images corresponding to the user,

wherein the region estimated to be occluded is further based at least in part upon the angle of incidence.

4. The computer-implemented method of claim 1, wherein the interface element comprises a key of a virtual keyboard.

5. A computer-implemented method for displaying information, comprising:

under the control of one or more computer systems configured with executable instructions,

detecting an object hovering over an interface element displayed on a screen, the interface element configured to display data on the screen in response to detection of a physical object hovering over the interface element;

estimating a region of the screen that is occluded, with respect to a user viewing the screen, by the object; and

displaying at least a portion of the data outside the region of the screen.

6. The computer-implemented method of claim 5, wherein detecting the object hovering over the interface element comprises:

determining that a distance between the object and the interface element is within a threshold range of distances,

wherein the distance is based at least in part upon a line between the object and the interface element, the object is located above a plane of the interface element, and the line is normal to a plane of the interface element.

7. The computer-implemented method of claim 5, wherein detecting the object hovering over the interface element includes:

determining an angle of incidence between a line of sight of the user and the screen displaying the interface element; and

determining that a distance between the object and the interface element is within a threshold range of distances,

wherein the distance is based at least in part upon a line between the object and the interface element, the object is above a plane of the interface element, and the line corresponds to the angle of incidence.

8. The computer-implemented method of claim 5, further comprising:

detecting capacitive disturbance corresponding to the object over the screen,

wherein the region estimated to be occluded is based at least in part upon a location of the capacitive disturbance corresponding to the object over the screen.

9. The computer-implemented method of claim 5, further comprising:

capturing one or more images corresponding to the object; and

determining at least one of a position or an orientation of the object over the screen by analyzing the one or more images,

wherein the region estimated to be occluded is based at least in part upon the at least one of the position or the orientation of the object over the screen.

10. The computer-implemented method of claim 5, further comprising:

capturing one or more images corresponding to the user; and

determining an angle of incidence between a line of sight of the user and the screen by analyzing the one or more images corresponding to the user,

wherein the region estimated to be occluded is based at least in part upon the angle of incidence.

11. The computer-implemented method of claim 5, further comprising:

storing first image data corresponding to the object;

capturing second image data missing at least a portion of the object; and

registering the first image data with respect to the second image data to generate one or more composite images,

wherein the region estimated to be occluded is based at least in part upon the one or more composite images.

12. The computer-implemented method of claim 5, further comprising:

calibrating one or more cameras;

generating a camera model based at least in part upon the calibrated one or more cameras;

capturing one or more images corresponding to the object; and

updating the camera model based at least in part upon the one or more images corresponding to the object to correlate coordinates of the one or more cameras and world coordinates,

wherein the region estimated to be occluded is based at least in part upon analyzing the updated camera model.

13. The computer-implemented method of claim 5, wherein the interface element comprises a key of a virtual keyboard.

14. The computer-implemented method of claim 5, further comprising:

detecting a second object hovering over a second interface element displayed on the screen, the second interface element configured to display second data on the screen in response to detection of the physical object hovering over the second interface element;

estimating a second region of the screen that is occluded, with respect to the user viewing the screen, by the second object; and

displaying at least a portion of the second data outside the region and the second region of the screen.

15. The computer-implemented method of claim 14, wherein detecting the object hovering over the interface element and detecting the second object hovering over the second interface element occur at substantially the same time.

16. A computing device, comprising:

one or more processors;

a sensor;

a screen;

a memory device including instructions that, when executed by the one or more processors, cause the computing device to;

detect, using the sensor, an object hovering over an interface element displayed on the screen, the interface element configured to display data on the screen in response to detection of a physical object hovering over the interface element;

estimate a region of the screen that is occluded, with respect to a user viewing the screen, by the object; and

display at least a portion of the data outside the region of the screen.

17. The computing device of claim 16, wherein the sensor comprises a capacitive sensor and the instructions when executed further cause the computing device to:

detect, using the capacitive sensor, capacitive disturbance corresponding to the object over the screen,

wherein the region estimated to be occluded is based at least in part upon a location of the capacitive disturbance corresponding to the object over the screen.

18. The computing device of claim 16, wherein the sensor comprises a camera and the instructions when executed further cause the computing device to:

capture, using the camera, one or more images corresponding to the object;

determine at least one of a position or an orientation of the object over the screen by analyzing the one or more images,

wherein the region estimated to be occluded is based at least in part upon the at least one of the position or the orientation of the object over the screen.

19. The computing device of claim 16, wherein the sensor comprises a camera and the instructions when executed further cause the computing device to:

capture, using the camera, one or more images corresponding to the user; and

determine an angle of incidence between a line of sight of the user and the screen by analyzing the one or more images corresponding to the user,

wherein the region estimated to be occluded is based at least in part upon the angle of incidence.

20. The computing device of claim 16, wherein the interface element comprises a key of a virtual keyboard.

21. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a computing device, cause the computing device to:

detect an object hovering over an interface element displayed on a screen, the interface element configured to display data on the screen in response to detection of a physical object hovering over the interface element;

estimate a region of the screen that is occluded, with respect to a user viewing the screen, by the object; and

display at least a portion of the data outside the region of the screen.

22. The non-transitory computer-readable storage medium of claim 21, wherein the instructions when executed further cause the computing device to:

store first image data corresponding to the object;

capture second image data missing at least a portion of the object; and

register the first image data with respect to the second image data to generate one or more composite images,

wherein the region estimated to be occluded is based at least in part upon the one or more composite images.

24. The non-transitory computer-readable storage medium of claim 21, wherein the instructions, when executed, further cause the computing device to:

detect a second object hovering over a second interface element displayed on the screen, the second interface element configured to display second data on the screen in response to detection of the physical object hover over the second interface element;

estimate a second region of the screen that is occluded, with respect to the user viewing the screen, by the second object; and

display at least a portion of the second data outside the region and the second region of the screen.

25. The non-transitory computer-readable storage medium of claim 24, wherein the instructions, when executed, to cause the computing device to detect the object hovering over the interface element and to detect the second object hovering over the second interface element are processed by the one or more processors at substantially the same time.