TOUCH SCREEN OPERATION USING ADDITIONAL INPUTS

• US 20140118268A1
• Filed: 11/01/2012
• Published: 05/01/2014
• Est. Priority Date: 11/01/2012
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: KUSCHER, Alexander Friedrich
• Application Number:
  US13/666,824
• Publication Number:
  US 20140118268A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Aspects of the subject technology relate to systems, methods, and machine-readable media for operating a touch-sensitive device using additional inputs. A system can be configured to detect a touch interaction at a location on a touch-sensitive device associated with a display, receive additional sensor input for the touch-sensitive device, the additional sensor input corresponding to the touch interaction, determine vision characteristics of a user of the touch-sensitive device based on the additional sensor input, and process the touch interaction based on location of the touch interaction and the vision characteristics of the user.

Claims

1. A method for responding to a touch interaction, the method comprising:

detecting a touch interaction at a location on a touch-sensitive device associated with a display;

receiving additional sensor input for the touch-sensitive device, the additional sensor input corresponding to the touch interaction;

determining vision characteristics of a user of the touch-sensitive device based on the additional sensor input; and

processing the touch interaction based on location of the touch interaction and the vision characteristics of the user.

2. The method of claim 1, wherein the additional sensor input comprises image data, from at least one camera coupled to the touch-sensitive device, associated with a time that the touch interaction occurred.

3. The method of claim 2, wherein the image data comprises at least one image taken by the at least one camera in response to detecting the touch interaction.

4. The method of claim 1, wherein the additional sensor input comprises proximity data, from a proximity sensor coupled to the touch-sensitive device, associated with a time that the touch interaction occurred.

5. The method of claim 1, wherein the vision characteristics comprise at least one of a position of the user'"'"'s eyes relative to the display and a direction in which the user'"'"'s eyes are looking, and wherein processing the touch interaction based on location of the touch interaction and the vision characteristics of the user comprises:

identifying a location of a focus area on the display;

determining whether an interface element on the display is located within a first threshold distance of the location of the focus area and within a second threshold distance of the location of the touch interface; and

processing the touch interaction if the interface element on the display is located within the first threshold distance of the location of the focus area and within the second threshold distance of the location of the touch interface.

6. The method of claim 5, wherein the processing of the touch interaction comprises receiving an instruction associated with the interface element.

7. The method of claim 1, wherein the vision characteristics comprise a location of an object relative to the display, and wherein processing the touch interaction based on location of the touch interaction and the vision characteristics of the user comprises:

determining, based on the vision characteristics, an object obscures the user'"'"'s view;

identifying an area on the touch screen display that is not obscured from the user'"'"'s view;

and providing for the display of at least one visual element in the area that is not obscured from the user'"'"'s view.

8. The method of claim 7, wherein the visual element is an additional interface element.

9. The method of claim 7, wherein the vision characteristics further comprise at least one of a position of the user'"'"'s eyes relative to a display and a direction in which the user'"'"'s eyes are looking

10. The method of claim 1, wherein the touch-sensitive device associated with the display is a touch screen.

11. A system for responding to a touch interaction, the system comprising:

one or more processors; and

a machine-readable medium comprising instructions stored therein, which when executed by the one or more processors, cause the one or more processors to perform operations comprising;

detecting a touch interaction at a location on a touch screen device associated with a display;

receiving additional sensor input from the touch screen device, the additional sensor input corresponding to the touch interaction;

determining vision characteristics of a user of the touch screen device based on the additional sensor input; and

processing the touch interaction based on location of the touch interaction and the vision characteristics of the user.

12. The system of claim 11, wherein the additional sensor input comprises image data, from at least one camera in communication with the touch screen device, associated with a time that the touch interaction occurred.

13. The system of claim 11, wherein the additional sensor input comprises proximity data, from a proximity sensor in communication with the touch screen device, associated with a time that the touch interaction occurred.

14. The system of claim 11, wherein the vision characteristics comprise at least one of a position of the user'"'"'s eyes relative to the display and a direction in which the user'"'"'s eyes are looking, and wherein processing the touch interaction based on location of the touch interaction and the vision characteristics of the user comprises:

identifying a location of a focus area on the display;

determining whether the focus area is located within a first threshold distance of the location of the touch interface; and

processing the touch interaction if the focus area is located within a first threshold distance of the location of the touch interface.

15. The system of claim 11, wherein the vision characteristics comprise a location of an object relative to the display, and wherein processing the touch interaction based on location of the touch interaction and the vision characteristics of the user comprises:

determining, based on the vision characteristics, an object obscures the user'"'"'s view;

identifying an area on the touch screen display that is not obscured from the user'"'"'s view; and

providing for the display of at least one visual element in the area that is not obscured from the user'"'"'s view.

16. A machine-readable medium comprising instructions stored therein, which when executed by a machine, cause the machine to perform operations comprising:

detecting a touch interaction at a location on a touch-sensitive device associated with a display;

receiving at least one image for the touch-sensitive device, the at least one image corresponding to the touch interaction;

determining vision characteristics of a user of the touch-sensitive device based on the at least one image; and

processing the touch interaction based on location of the touch interaction and the vision characteristics of the user.

17. The machine-readable medium of claim 16, wherein the vision characteristics comprise at least one of a position of the user'"'"'s eyes relative to a display and a direction in which the user'"'"'s eyes are looking, and wherein processing the touch interaction based on location of the touch interaction and the vision characteristics of the user comprises:

identifying a location of a focus area on the display;

determining whether the focus area is located within a first threshold distance of the location of the touch interface; and

processing the touch interaction if the focus area is located within a first threshold distance of the location of the touch interface.

18. The machine-readable medium of claim 16, wherein the vision characteristics comprise a location of an object relative to the display, and wherein processing the touch interaction based on location of the touch interaction and the vision characteristics of the user comprises:

identifying, based on the vision characteristics, an area on the touch screen display that is not obscured from the user'"'"'s view; and

providing for the display of at least one visual element in the area that is not obscured from the user'"'"'s view.

19. A method for arranging interface elements on a touch screen display, the method comprising:

receiving sensor input from a sensing device associated with a touch screen;

determining whether an object obscures the touch screen from a user'"'"'s view based on the sensor input;

identifying, if the object obscures the touch screen, an area on the touch screen display that is not obscured by the object; and

displaying one or more visual elements in the area on the touch screen that is not obscured by the object.

20. The method of claim 19, further comprising:

detecting a touch interaction on the touch screen; and

wherein the displaying of the one or more visual elements is in response to the detecting of the touch interaction.