FINGER IDENTIFICATION ON A TOUCHSCREEN

• US 20130201155A1
• Filed: 08/12/2010
• Published: 08/08/2013
• Est. Priority Date: 08/12/2010
• Status: Active Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Wu, Genqing, Su, Hua
• Application Number:
  US13/816,675
• Publication Number:
  US 20130201155A1
• Time in Patent Office: Days
• US Class Current: 345/174
• CPC Class Codes: G06F 2203/0338 Fingerprint track pad, i.e. fingerprint sensor used as pointing device tracking the fingertip image
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

In one implementation, a computer-implemented method includes receiving, at a mobile computing device, a first input that indicates a user touched a touchscreen display of the mobile computing device with a pointer, and determining a position of the mobile computing device with respect to the user based on information other than information from the user'"'"'s touching of the touchscreen display. The method also includes identifying the pointer as a particular finger or type of finger of the user based upon, at least, the determined position of the mobile computing device with respect to the user, and interpreting the received first input on the touchscreen display of the mobile computing device using the identified finger or type of finger.

Claims

1. A computer-implemented method comprising:

receiving, at a mobile computing device, a first input that indicates a user touched a touchscreen display of the mobile computing device with a pointer;

determining a position of the mobile computing device with respect to the user based on information other than information from the user'"'"'s touching of the touchscreen display;

identifying the pointer as a particular finger or type of finger of the user based upon, at least, the determined position of the mobile computing device with respect to the user; and

interpreting the received first input on the touchscreen display of the mobile computing device using the identified finger or type of finger.

2. The computer-implemented method of claim 1, wherein the information upon which determining the position of the mobile computing device is based includes, at least, information provided by one or more components of an input subsystem of the mobile computing device other than the touchscreen display.

3. The computer-implemented method of claim 1, wherein determining the position of the mobile computing device with respect to the user comprises determining how the user is holding the mobile computing device.

4. The computer-implemented method of claim 3, wherein the user is determined to be holding the mobile computing device in the user'"'"'s right hand, in the user'"'"'s left hand, in both the user'"'"'s right and left hands, or the user is determined to not be holding the mobile computing device.

5. The computer-implemented method of claim 4, wherein, when the user is determined to be holding the mobile computing device in one but not both of the user'"'"'s hands, the pointer is identified as a thumb of the user'"'"'s hand that is holding the mobile computing device or as a finger on the user'"'"'s other hand that is not holding the mobile computing device.

6. The computer-implemented method of claim 5, wherein, when the pointer is identified as the thumb of the user'"'"'s hand that is holding the mobile computing device, the received first input is interpreted as having a greater offset from an intended point of contact on the touchscreen display than when the pointer is identified as a finger on the user'"'"'s other hand that is not holding the mobile computing device.

7. The computer-implemented method of claim 1, further comprising determining a level of pressure with which the pointer touched the touchscreen display;

and

wherein the pointer is identified as the particular finger or type of finger additionally based upon a determined level of pressure with which the pointer touched the touchscreen display.

8. The computer-implemented method of claim 1, further comprising determining a contact area with which the pointer touched the touchscreen display;

and

wherein the pointer is identified as the particular finger or type of finger additionally based upon a determined level of pressure with which the pointer touched the touchscreen display.

9. The computer-implemented method of claim 1, further comprising accessing one or more models that each correspond to a finger or a type of finger;

and

wherein the pointer is identified as the particular finger or type of finger using the one or more accessed models.

10. The computer-implemented method of claim 9, further comprising:

receiving, at the mobile computing device, a second input provided by the user in response to interpretation of the first input using the identified finger or type of finger;

determining whether the pointer was correctly identified as the particular finger or type of finger using the one or more accessed models based on the second input; and

updating the one or more accessed models according to whether the pointer is determined to have been correctly identified as the particular finger or type of finger.

11. The computer-implemented method of claim 10, wherein, when the received second input causes the mobile computing device to undo or modify an action performed based on interpretation of the first input using the identified finger or type of finger, the second input is determined to indicate that the pointer was not correctly identified as the particular finger or type of finger.

12. The computer-implemented method of claim 10, wherein, when the received second input causes the mobile computing device to perform an action that does not undo or modify a previous action performed based on interpretation of the first input using the identified finger or type of finger, the second input is determined to indicate that the pointer was correctly identified as the particular finger or type of finger.

13. The computer-implemented method of claim 10, further comprising, when the mobile computing device is in a training mode, providing output on the mobile computing device that indicates the particular finger or type of finger has been identified from the first input and that asks the user whether identification of the particular finger or type of finger is correct;

and

wherein the second input is received in response to the provided output and comprises a response from the user indicating whether identification is correct.

14. The computer-implemented method of claim 1, wherein interpreting the received first input using the identified finger or type of finger comprises interpreting the first input using an offset from an intended point of contact on the touchscreen display that is associated with the identified finger or type of finger.

15. The computer-implemented method of claim 14, wherein the offset applied for the identified finger or type of finger is not uniform across the touchscreen display such that the offset is greater when the user touches the touchscreen with the identified finger or type of finger at a first location on the touchscreen display than when the user touches the touchscreen with the identified finger or type of finger at a second location on the touchscreen display.

16. The computer-implemented method of claim 1, wherein interpreting the received first input using the identified finger or type of finger comprises performing an action on the mobile computing device that is associated with the identified finger or type of finger.

17. A system for interpreting touchscreen input on a mobile computing device, the system comprising:

a mobile computing device;

a touchscreen display of the mobile computing device that is configured to receive input that indicates a user touched the touchscreen display with a pointer;

a position extraction module of the mobile computing device that is configured to determine a position of the mobile computing device with respect to the user based on information other than information from the user'"'"'s touching of the touchscreen display;

means for identifying the pointer as a particular finger or type of finger of the user based on, at least, the determined position of the mobile computing device with respect to the user; and

an input interpreter of the mobile computing device that is configured to interpret the received input on the touchscreen display of the mobile computing device using the particular finger or type of finger identified by the means for identifying.

18. The system of claim 17, further comprising:

a housing of the mobile computing device that includes one or more capacitive touch sensors that are configured to measure where the user is touching the housing of the mobile computing device; and

wherein the position extraction module of the mobile computing device that is configured to determine the position of the mobile computing device with respect to the user based on measurements from the capacitive touch sensors included in the housing.

19. A computer-implemented method comprising:

receiving, at a mobile computing device, a first input that indicates a user touched a touchscreen of the mobile computing device with a pointer;

identifying the first input as corresponding to a particular graphical element displayed on the touchscreen based on the first input and offset information associated with the particular graphical element,

wherein offset information associated with a graphical element indicates a distance and direction by which an input area for the graphical element is offset from a location at which the graphical element is displayed on the touchscreen;

wherein an input area for a graphical element comprises an area within which received input is registered by the mobile computing device as corresponding to the graphical element;

performing an action on the mobile computing device associated with the particular graphical element;

after performing the action, determining whether the user intended for the first input to correspond to the particular graphical element based on second input received at the mobile computing device from the user; and

adjusting the offset information associated with the particular graphical element based on the determination of whether the user intended for the first input to correspond to the particular graphical element.

20. The computer-implemented method of claim 19, further comprising:

identifying the pointer as a particular finger or type of finger of the user based upon, at least, a determined position of the mobile computing device with respect to the user; and

wherein the offset information associated with the particular graphical element is specific to the identified finger or type of finger.