Determining user handedness and orientation using a touchscreen device

• US 9,645,693 B2
• Filed: 12/14/2015
• Issued: 05/09/2017
• Est. Priority Date: 03/17/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Smus, Boris
• Primary Examiner(s): Bolotin, Dmitriy
• Application Number:
  US14/967,898
• Publication Number:
  US 20160098125A1
• Time in Patent Office: 512 Days
• Field of Search: 345173, 345174
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present disclosure provides techniques for determining the position and/or orientation of a pointing device relative to the screen on a touchscreen device. A method may include receiving first orientation data from a first device that may include a capacitive touch surface. A touch point may be received indicating a location of a touch by a user on the capacitive touch surface. Second orientation data may be received from a second device. The first and second orientation data may be correlated to determine a relative orientation of the first device to the second device. A position of a pointing device may be determined based on the touch point and the relative orientation of the first and second devices. Additionally, multiple distances relative to a capacitive touch surface may be received, and based on the multiple distances, a position of a user'"'"'s finger, hand, and/or arm may be determined.

Claims

1. A computer-implemented method comprising:

receiving a touch input through a proximity-sensitive display on a user device;

classifying the touch input as likely a left-handed touch input or a right-handed touch input;

identifying a particular portion of the user interface that is likely to not be visually obscured based on classifying the touch input as likely a left-handed touch input or a right-handed touch input;

determining to position a user interface element on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured; and

providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured.

2. The computer-implemented method of claim 1, wherein:

the particular portion of the user interface is a portion of the user interface determined to likely not be visually obscured by the touch input; and

classifying the touch input as likely a left-handed touch input or a right-handed touch input comprises;

generating a depth indicator of one or more distances associated, respectively, with one or more object surfaces, the one or more distances corresponding to respective distances of the one or more object surfaces from a capacitive touch surface of the user device; and

determining one or more locations associated, respectively, with the one or more object surfaces relative to an orientation of the user device.

3. The computer-implemented method of claim 2, wherein classifying the touch input as likely a left-handed touch input or a right-handed touch input further comprises one of:

determining that the touch input is likely to be a left-handed touch input based on (i) the depth indicator and (ii) a location of an object surface associated with the touch input relative to the orientation of the user device indicating a likely use of a left hand of a user; and

determining that the touch input is likely to be a right-handed touch input based on (i) the depth indicator and (ii) a location of an object surface associated with the touch input relative to the orientation of the user device indicating a likely use of a right hand of a user.

4. The computer-implemented method of claim 2, wherein classifying the touch input as likely a left-handed touch input or a right-handed touch input further comprises:

determining that an object surface of the one or more object surfaces corresponds to the touch input in response to determining that the object surface has a distance that satisfies a threshold distance.

5. The computer-implemented method of claim 1, wherein providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured comprises:

determining that the user interface element is positioned in a portion of the user interface that is determined to likely be visually obscured by the touch input; and

modifying a position of the user interface element to a position located in the particular portion of the user interface that is determined to likely not be visually obscured by the touch input.

6. The computer-implemented method of claim 1, wherein providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured comprises one or more of:

resizing the user interface;

relocating the user interface; and

rearranging one or more user interface elements in the user interface to the particular portion of the user interface that is determined to likely not be visually obscured by the touch input.

7. The computer-implemented method of claim 1, further comprising:

based on classifying the touch input as likely a left-handed input, generating a second user interface element positioned in the particular portion of the user interface that is determined to likely not be visually obscured by the left-handed input; and

based on classifying the touch input as likely a right-handed input, generating a second user interface element positioned in the particular portion of the user interface that is determined to likely not be visually obscured by the right-handed input.

8. A non-transitory computer-readable storage medium encoded with a computer program, the computer program comprising instructions that, upon execution by a computer, cause the computer to perform operations comprising:

receiving a touch input through a proximity-sensitive display on a user device;

classifying the touch input as likely a left-handed touch input or a right-handed touch input;

identifying a particular portion of the user interface that is likely to not be visually obscured based on classifying the touch input as likely a left-handed touch input or a right-handed touch input;

determining to position a user interface element on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured; and

providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured.

9. The non-transitory computer-readable storage medium of claim 8, wherein:

the particular portion of the user interface is a portion of the user interface determined to likely not be visually obscured by the touch input; and

classifying the touch input as likely a left-handed touch input or a right-handed touch input comprises;

generating a depth indicator of one or more distances associated, respectively, with one or more object surfaces, the one or more distances corresponding to respective distances of the one or more object surfaces from a capacitive touch surface of the user device; and

determining one or more locations associated, respectively, with the one or more object surfaces relative to an orientation of the user device.

10. The non-transitory computer-readable storage medium of claim 9, wherein classifying the touch input as likely a left-handed touch input or a right-handed touch input further comprises one of:

determining that the touch input is likely to be a left-handed touch input based on (i) the depth indicator and (ii) a location of an object surface associated with the touch input relative to the orientation of the user device indicating a likely use of a left hand of a user; and

determining that the touch input is likely to be a right-handed touch input based on (i) the depth indicator and (ii) a location of an object surface associated with the touch input relative to the orientation of the user device indicating a likely use of a right hand of a user.

11. The non-transitory computer-readable storage medium of claim 9, wherein classifying the touch input as likely a left-handed touch input or a right-handed touch input further comprises:

determining that an object surface of the one or more object surfaces corresponds to the touch input in response to determining that the object surface has a distance that satisfies a threshold distance.

12. The non-transitory computer-readable storage medium of claim 8, wherein providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured comprises:

determining that the user interface element is positioned in a portion of the user interface that is determined to likely be visually obscured by the touch input; and

modifying a position of the user interface element to a position located in the particular portion of the user interface that is determined to likely not be visually obscured by the touch input.

13. The non-transitory computer-readable storage medium of claim 8, wherein providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured comprises one or more of:

resizing the user interface;

relocating the user interface; and

rearranging one or more user interface elements in the user interface to the particular portion of the user interface that is determined to likely not be visually obscured by the touch input.

14. The non-transitory computer-readable storage medium of claim 8, further comprising:

based on classifying the touch input as likely a left-handed input, generating a second user interface element positioned in the particular portion of the user interface that is determined to likely not be visually obscured by the left-handed input; and

based on classifying the touch input as likely a right-handed input, generating a second user interface element positioned in the particular portion of the user interface that is determined to likely not be visually obscured by the right-handed input.

15. A system comprising:

one or more processors and one or more computer storage media storing instructions that are operable and when executed by the one or more processors, cause the one or more processors to perform operations comprising;

receiving a touch input through a proximity-sensitive display on a user device;

classifying the touch input as likely a left-handed touch input or a right-handed touch input;

identifying a particular portion of the user interface that is likely to not be visually obscured based on classifying the touch input as likely a left-handed touch input or a right-handed touch input;

determining to position a user interface element on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured; and

providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured.

16. The system of claim 15, wherein:

the particular portion of the user interface is a portion of the user interface determined to likely not be visually obscured by the touch input; and

classifying the touch input as likely a left-handed touch input or a right-handed touch input comprises;

generating a depth indicator of one or more distances associated, respectively, with one or more object surfaces, the one or more distances corresponding to respective distances of the one or more object surfaces from a capacitive touch surface of the user device; and

determining one or more locations associated, respectively, with the one or more object surfaces relative to an orientation of the user device.

17. The system of claim 16, wherein classifying the touch input as likely a left-handed touch input or a right-handed touch input further comprises one of:

determining that the touch input is likely to be a left-handed touch input based on (i) the depth indicator and (ii) a location of an object surface associated with the touch input relative to the orientation of the user device indicating a likely use of a left hand of a user; and

determining that the touch input is likely to be a right-handed touch input based on (i) the depth indicator and (ii) a location of an object surface associated with the touch input relative to the orientation of the user device indicating a likely use of a right hand of a user.

18. The system of claim 15, wherein providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured comprises:

determining that the user interface element is positioned in a portion of the user interface that is determined to likely be visually obscured by the touch input; and

modifying a position of the user interface element to a position located in the particular portion of the user interface that is determined to likely not be visually obscured by the touch input.

19. The system of claim 15, wherein providing, for display on the proximity-sensitive display on the user device, the user interface including the user interface element positioned on the particular portion of the user interface that, based on classifying the touch input as likely a left-handed touch input or a right-handed touch input, is identified as likely to not be visually obscured comprises one or more of:

resizing the user interface;

relocating the user interface; and

rearranging one or more user interface elements in the user interface to the particular portion of the user interface that is determined to likely not be visually obscured by the touch input.

20. The system of claim 15, further comprising:

based on classifying the touch input as likely a left-handed input, generating a second user interface element positioned in the particular portion of the user interface that is determined to likely not be visually obscured by the left-handed input; and

based on classifying the touch input as likely a right-handed input, generating a second user interface element positioned in the particular portion of the user interface that is determined to likely not be visually obscured by the right-handed input.