Interface selection element display

• US 9,075,514 B1
• Filed: 12/13/2012
• Issued: 07/07/2015
• Est. Priority Date: 12/13/2012
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Karakotsios, Kenneth Mark, Gilmour, Nicholas Ryan
• Primary Examiner(s): Pesin, Boris
• Assistant Examiner(s): Brahmachari, Mandrita
• Application Number:
  US13/714,115
• Time in Patent Office: 936 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A finger of a user detected within a predetermined range from a surface of a display screen can be used to navigate through and select content in accordance with various embodiments. In response to detecting the finger within the predetermined range, a selection element can be positioned offset from the finger. The offset positioning keeps the selection element from being obscured by the finger and, thus, enabling it to remain visible to the user. In response to detecting the user'"'"'s finger approaching the surface of the display screen, the selection element becomes fixed in its current location when the finger reaches a threshold distance from the surface. Accordingly, as the finger gets closer to the surface, it starts to converge with the selection element. Finally, the finger converges with the selection element when the finger reaches the surface of the display screen to select the desired content.

Claims

1. A computer-implemented method, comprising:

under the control of one or more computer systems configured with executable instructions, displaying content on a display screen of a computing device, wherein the display screen is a touch screen;

detecting a location of a finger of a user within a predetermined range from a surface of the display screen;

positioning a selection element displayed on the display screen offset from the finger such that the selection element is visible from a point of view of the user when the finger is at the location;

detecting movement of the finger from the location and within the predetermined range from the display screen;

causing the selection element to move across the display screen based at least in part on the movement of the finger within the predetermined range from the display screen;

detecting the finger approaching the display screen;

prior to the finger touching the display screen, causing the selection element to become fixed to a graphical object on the display screen upon the finger reaching a threshold distance from the surface;

preventing movement of the selection element away from the graphical object to which the selection element is fixed, while the finger remains at or below the threshold distance from the surface;

detecting a touch event by the finger; and

selecting the graphical object to which the selection element is fixed.

2. The computer-implemented method of claim 1, further comprising:

upon detecting the finger above the threshold distance, causing the selection element to become unfixed to the a graphical object on the display screen to enable the movement.

3. The computer-implemented method of claim 1, wherein the selection element converges with the finger as the finger approaches the touch screen to select content.

4. The computer-implemented method of claim 1, further comprising:

capturing one or more images using a camera of the computing device;

analyzing image information obtained from the captured one or more images to determine a current relative position of a feature of the user with respect to the computing device; and

rendering the selection element on the display screen for the point of view based at least in part on the determined current relative position of the feature of the user.

5. The computer-implemented method of claim 4, further comprising:

rendering an expanded view of the content as the selection element moves across the display screen.

6. The computer-implemented method of claim 1, further comprising:

in response to detecting the finger approaching the display screen, causing the offset of the selection element from the finger to reduce.

7. The computer-implemented method of claim 6, further comprising:

capturing one or more images using a camera of the computing device;

analyzing image information captured by the one or more images to determine a current relative position of a feature of the user with respect to the computing device; and

rendering the selection element for a point of view consistent with the determined current relative position of the feature of the user.

8. The computer-implemented method of claim 7, further comprising:

monitoring an amount of movement of the computing device using at least one sensor of the computing device; and

analyzing the amount of movement to further determine the current relative position of the feature of the user with respect to the computing device.

9. The computer-implemented method of claim 7, further comprising:

monitoring an amount of movement of the computing device using at least one sensor of the computing device; and

in response to detecting an amount of motion greater than a threshold amount, increasing the offset between the selection element and the finger from the point of view of the user.

10. The computer-implemented method of claim 6, wherein the selection element is at least one of a pointer, a highlight applied to an item of content, or a visual identifier indicating an item of content for selection with respect to the finger of the user.

11. The computer-implemented method of claim 9, further comprising:

rendering an expanded view of the content as the selection element moves across the display screen.

12. A computing device, comprising:

a processor;

a display screen, wherein the display screen is a touch screen; and

memory including instructions that, when executed by the processor, cause the computing device to;

display content on the display screen;

control movement of a selection element across the display screen in response at least in part to movement of a finger a distance from the display screen, the selection element being displayed a distance offset based at least in part on a location of the finger such that the selection element is visible from a point of view of a user when the finger is at the location;

detect the location of the finger approaching the display screen;

in response to detecting the finger approaching the display screen, cause the distance offset to reduce;

detect the finger below a threshold distance from the display screen; and

prior to the finger touching the display screen, cause the selection element to become fixed on an object to become selected as the finger makes contact with the display screen.

13. The computing device of claim 12, wherein the instructions, when executed by the processor, further enable the computing device to:

upon detecting the finger above the threshold distance, cause the selection element to become unfixed to the graphical object.

14. The computing device of claim 12, wherein the display screen is a touch screen and the selection element converges with the finger as the finger approaches the touch screen to select content.

15. The computing device of claim 12, wherein the instructions, when executed by the processor, further enable the computing device to:

render an expanded view of the content as the selection element moves across the display screen.

16. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause a computing device to:

display content on a display screen, wherein the display screen is a touch screen;

detect a location of a finger of a user within a predetermined range from a surface of the touch screen;

positioning a selection element displayed on the display screen offset from the finger such that the selection element is visible from a point of view of the user when the finger is at the location;

detect movement of the finger from the location and within the predetermined range from the display screen;

cause a selection element to move across the display screen with movement of a finger within the predetermined range from the display screen;

detect the finger within a threshold distance of the display screen;

prior to the finger touching the display screen, cause the selection element to become fixed to a graphical object on the display screen;

prevent movement of the selection element away from the graphical object to which the selection element is fixed, unless the finger moves above the threshold distance from the surface;

detect a touch event by the finger;

select the graphical object to which the selection element is fixed.

17. The non-transitory computer-readable storage medium of claim 16, wherein the instructions that, when executed by the at least one processor of the computing device, further cause

the computing device to:

capture one or more images using a camera of the computing device;

analyze image information obtained from the captured one or more images to determine a current relative position of a feature of the user with respect to the computing device; and

render the selection element for a point view consistent with the determined current relative position of the feature of the user.

18. The non-transitory computer-readable storage medium of claim 17, wherein the instructions that, when executed by the at least one processor of the computing device, further cause the computing device to:

monitor an amount of movement of the computing device using at least one sensor of the computing device; and

analyze the amount of movement to further determine the current relative position of the feature of the user with respect to the computing device.

19. The non-transitory computer-readable storage medium of claim 16, wherein the instructions that, when executed by the at least one processor of the computing device, further cause the computing device to:

monitor an amount of movement of the computing device using at least one sensor of the computing device; and

in response to detecting an amount of motion greater than a threshold amount, increase the offset between the selection element and the finger from a point of view of the user.

20. The non-transitory computer-readable storage medium of claim 16, wherein the instructions that, when executed by the at least one processor of the computing device, further cause the computing device to:

render an expanded view of the content as the selection element moves across the display screen.