Adaptive virtual keyboard for handheld device

• US 10,133,482 B2
• Filed: 12/31/2016
• Issued: 11/20/2018
• Est. Priority Date: 06/16/2009
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Ferren, Bran
• Primary Examiner(s): Lee, Jr., Kenneth B
• Application Number:
  US15/396,603
• Publication Number:
  US 20170235482A1
• Time in Patent Office: 689 Days
• Field of Search: None
• CPC Class Codes: G02B 13/0065 having a beam-folding prism or mirror
• CPC Class Codes: G02B 13/009 having zoom function
• CPC Class Codes: G03B 3/00 Focusing arrangements of general interest for cameras, projectors or printers
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/40 by quorum, i.e. whereby two or more security principals are required
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06K 2207/1011 Aiming
• CPC Class Codes: G06K 7/10811 Focalisation
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06Q 20/4012 : Verifying personal identification numbers [PIN]
• CPC Class Codes: G06Q 20/40145 : Biometric identity checks
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/165 : using facial parts and geometric relationships
• CPC Class Codes: G06V 40/19 : Sensors therefor
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/45 : Detection of the body part being alive
• CPC Class Codes: H04L 63/083 : using passwords cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226
• CPC Class Codes: H04M 1/72448 : with means for adapting the functionality of the device according to specific conditions
• CPC Class Codes: H04M 2250/52 : including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 13/239 : using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 : using three or more 2D image sensors
• CPC Class Codes: H04N 23/45 : for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/67 : Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

In various embodiments, the size, shape, and arrangement of keys on a virtual keyboard may be determined based on touchscreen contacts made by the user. Further, the actual contact patch made by the user may be analyzed to interpret which point of contact was intended, and other factors such as spelling and context may also be considered. These factors may be determined based on a calibration session and/or on continuing inputs during operation of the keyboard, and applied to future operational interpretations of the touchscreen contacts.

Claims

1. An apparatus comprising:

a handheld electronic device having a touchscreen for displaying a virtual keyboard having three arc-shaped tiered rows of keys, including keys associated with respective characters, wherein the device is configured to;

enable a user to enter text content via the virtual keyboard with one hand while holding the handheld electronic device in the same hand; and

perform predictive text analysis to determine characters intended to be entered by the user as the user enters the text content via the virtual keyboard, wherein to perform predictive text analysis the device is further configured to,

in response to a user selection of a key that is part of a word in a sentence being entered by the user via the virtual keyboard,

compare characters for each of one or more adjacent keys proximate to a sensed input coordinate to a remaining portion of the word to determine whether using the character forms a real word; and

if more than one of the characters that are compared forms a real word, examine a context of a sentence that would be formed using that word to select which word and character was most likely intended.

2. The apparatus of claim 1, wherein the apparatus is configured to determine a key intended to be selected by the user based, in part, on a history of previous determinations of intended key selections.

3. The apparatus of claim 1, wherein the apparatus is configured to:

in response to a user selection of a key that is part of a word in a sentence being entered by the user via the virtual keyboard,

sense an area of the touchscreen a user'"'"'s finger or thumb is in contact with corresponding to the key selection,

detect that the user intended to select one of multiple adjacent keys proximate to the area of the touchscreen that is sensed; and

determine a key intended to be selected by the user based on at least one of the area of the touchscreen that the user'"'"'s finger or thumb is sensed to be in contact with and an active point detected via the touchscreen or determined as a function of the area; and

predictive text analysis that considers at least one of a context of the word and a context of the sentence.

4. The apparatus of claim 1, wherein the apparatus is configured to adapt active points relative to areas of the touchscreen that the user'"'"'s finger or thumb are sensed to be in contact with based on observation of intended keys over time.

5. The apparatus of claim 1, wherein the three arc-shaped tiered rows of keys are arranged to be selectively activated via a user'"'"'s thumb, and wherein the apparatus is configured to determine what key is selected is based on detecting areas of the touchscreen the user'"'"'s thumb is sensed to be in contact with corresponding to the key selection.

6. The apparatus of claim 1, wherein the three arc-shaped tiered rows of keys are arranged to be selectively activated via a user'"'"'s thumb when the user is holding the apparatus using one hand including the user'"'"'s thumb.

7. The apparatus of claim 1, wherein the apparatus is configured to enable a user to adjust a layout of the keyboard.

8. The apparatus of claim 1, wherein the apparatus is configured to:

detect whether a user is selecting keys using a finger or using a thumb; and

adjust a

location of an active point relative to a detected area of the touchscreen display that the user'"'"'s finger or thumb is sensed to be in contact with based on whether use of a finger or thumb for selecting keys is detected.

9. A method for implementing a virtual keyboard on a handheld electronic device having a touchscreen for displaying the virtual keyboard, the method comprising:

displaying three arc-shaped tiered rows of keys on the touchscreen display;

in response to a user selection of a key that is part of a word in a sentence being entered by the user via the virtual keyboard,

sensing an area of the touchscreen a user'"'"'s finger or thumb is in contact with corresponding to the key selection,

detecting that the user intended to select one of multiple adjacent keys proximate to the area of the touchscreen that is sensed; and

determining a key intended to be selected by the user based on at least one of the area of the touchscreen that the user'"'"'s finger or thumb is sensed to be in contact with and an active point detected via the touchscreen or determined as a function of the area;

performing predictive text analysis including,

comparing characters for each of the multiple adjacent keys to a remaining portion of the word to determine whether using the character in forms a real word; and

if more than one of the characters that are compared forms a real word, examining a context of a sentence that would be formed using that word to select which word and character was most likely intended.

10. The method of claim 9, wherein determining a key intended to be selected by the user further includes considering a history of previous determinations of intended key selections.

11. The method of claim 9, further comprising adapting active points relative to contact patches based on observation of intended keys over time.

12. The method of claim 9, wherein the three arc-shaped tiered rows of keys are arranged to be selectively activated via a user'"'"'s thumb, further comprising implementing logic to determine what key is selected by detecting areas of the touchscreen the user'"'"'s thumb is sensed to be in contact with corresponding to the key selection.

13. The method of claim 9, wherein the three arc-shaped tiered rows of keys are arranged to be selectively activated via a user'"'"'s thumb when the user is holding the apparatus using one hand including the user'"'"'s thumb.

14. The method of claim 9, further comprising enabling a user to adjust a layout of the keyboard.

15. The method of claim 9, further comprising:

detecting whether a user is selecting keys using a finger or using a thumb; and

adjusting a location of an active point relative to a detected area of the touchscreen display that the user'"'"'s finger or thumb is sensed to be in contact with based on whether use of a finger or thumb for selecting keys is detected.

16. A non-transitory machine-readable medium having instructions stored thereon configured to be executed on a processor of a handheld electronic device having a touchscreen display to implement a virtual keyboard on the touchscreen display, wherein execution of the instructions enables the handheld electronic device to:

display three arc-shaped tiered rows of keys on the touchscreen display;

in response to a user selection of a key that is part of a word in a sentence being entered by the user via the virtual keyboard,

sense an area of the touchscreen a user'"'"'s finger or thumb is in contact with corresponding to the key selection,

detect that the user intended to select one of multiple adjacent keys proximate to the area of the touchscreen that is sensed;

determine a key intended to be selected by the user based on at least one of the area of the touchscreen that the user'"'"'s finger or thumb is sensed to be in contact with and an active point detected via the touchscreen or determined as a function of the area; and

perform predictive text analysis including,

comparing characters for each of the multiple adjacent keys to a remaining portion of the word to determine whether using the character in forms a real word; and

if more than one of the characters that are compared forms a real word, examining a context of a sentence that would be formed using that word to select which word and character was most likely intended.

17. The non-transitory machine-readable medium of claim 16, wherein determining a key intended to be selected by the user further includes tracking a history of previous determinations of intended key selections.

18. The non-transitory machine-readable medium of claim 16, wherein execution of the instructions further enables the handheld electronic device to adapt active points relative to areas of the touchscreen display that the user'"'"'s finger or thumb is sensed to be in contact with based on observation of intended keys over time.

19. The non-transitory machine-readable medium of claim 16, wherein the three arc- shaped tiered rows of keys are arranged to be selectively activated via a user'"'"'s thumb, wherein execution of the instructions further enables the handheld electronic device to determine what key is intended to be selected based on a detection of contact patches formed using a user'"'"'s thumb.

20. The non-transitory machine-readable medium of claim 16, wherein the three arc- shaped tiered rows of keys are arranged to be selectively activated via a user'"'"'s thumb when the user is holding the apparatus using one hand including the user'"'"'s thumb.

21. The non-transitory machine-readable medium of claim 16, wherein execution of the instructions further enables the handheld electronic device to adjust a layout of the keyboard in response to user input.

22. The non-transitory machine-readable medium of claim 16, wherein execution of the instructions further enables the handheld electronic device to:

detect whether a user is selecting keys using a finger or using a thumb; and

adjust a

location of an active point relative to a detected area of the touchscreen display that the user'"'"'s finger or thumb is sensed to be in contact with based on whether use of a finger or thumb for selecting keys is detected.