VIRTUAL KEYPAD GENERATOR WITH LEARNING CAPABILITIES

• US 20100259561A1
• Filed: 04/10/2009
• Published: 10/14/2010
• Est. Priority Date: 04/10/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Forutanpour, Babak, Abrahamson, Kurt W.
• Granted Patent: US 8,300,023 B2
• Time in Patent Office: Days
• US Class Current: 345/660
• CPC Class Codes: G06F 3/0216 Arrangements for ergonomically adjusting the disposition of keys of a keyboard for keyboards integrated in a laptop computer G06F1/1664
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Methods and systems enable defining customized virtual keyboards on a touch sensitive surface, such as a touchscreen. Using learning algorithms, a computing device may learn the typing patterns of a user and “morph” the keys of a virtual keyboard into locations, sizes, and orientations that are comfortable for the user and which may reduce typing errors. A user may create a custom keypad layout by performing a series of key strokes on a touch sensitive surface. The computing device may correlate the touch locations to particular keys and generate keypad layout data that can be used to display the virtual keyboard and interpret touches on the touch sensitive surface. The computing device may monitor user typing activity and refine the keypad layout data based on detected or corrected typing errors. Keypad layout data may be exported to other devices to enable users to take their virtual keyboards with them.

Claims

1. A method for defining a keypad on a touch sensitive surface, comprising:

receiving a series of coordinates of a series of user touches on the touch sensitive surface;

correlating a plurality of keys with the received series of coordinates;

determining an average of received coordinates correlated with each of the plurality of keys;

saving the determined average coordinates for each of the plurality of keys in keypad layout data; and

generating an image of a virtual keypad using the keypad layout data.

2. The method of claim 1, further comprising:

prompting the user to enter a series of keystrokes,

wherein correlating a plurality of keys with the received series of coordinates comprises correlating the prompted series of keystrokes with the received coordinates.

3. The method of claim 1, further comprising:

determining a statistical envelope based upon received coordinates for each of the plurality of keys; and

saving the statistical envelope for each of the plurality of keys in the keypad layout data.

4. The method of claim 1, wherein generating an image of the virtual keypad using the keypad layout data comprises generating images of keys in the virtual keypad in locations based upon the average coordinates of each of the plurality of keys stored in the keypad layout data.

5. The method of claim 1, wherein generating an image of the virtual keypad using the keypad layout data further comprises generating images of the plurality of keys in the virtual keypad in which the size of each key image is based upon the statistical envelope for each of the plurality of keys in the keypad layout data.

6. The method of claim 1, further comprising:

monitoring typing on the virtual keypad on the touch sensitive surface;

identifying an adjacent key typing error;

determining a correct key associated with the adjacent key typing error;

updating the average coordinate for the correct key based upon received coordinates for the typed keystroke; and

saving the updated average coordinate with the correct key in the keypad layout data.

7. The method of claim 6, wherein identifying an adjacent key typing error comprises:

recognizing a misspelled word; and

determining whether the misspelling involves a switch of two keys that are adjacent to each other in the virtual keyboard.

8. The method of claim 6, wherein identifying an adjacent key typing error comprises:

recognizing a user correction of a letter associated with a key; and

determining whether the user correction involves a switch of two keys that are adjacent to each other in the virtual keyboard.

9. The method of claim 1, wherein the keypad layout data is saved in a network accessible database, the method further comprising:

transmitting the keypad layout data to a computing device via the network,

wherein generating an image of a virtual keypad using the keypad layout data comprises generating the image of the virtual keypad on a touch sensitive surface coupled to the computing device.

10. The method of claim 9, further comprising:

receiving a user touch on the touch sensitive surface coupled to the computing device; and

determining a location on the touch sensitive surface for display of the virtual keypad based upon the received user touch on the touch sensitive surface,

wherein generating an image of a virtual keypad using the keypad layout data comprises generating the image at the determined location on the touch sensitive surface for display.

11. A computing device, comprising:

a processor;

memory coupled to the processor; and

a touch sensitive surface coupled to the processor,

wherein the processor is configured with processor-executable instructions to perform processes comprising;

receiving a series of coordinates of a series of user touches on the touch sensitive surface;

correlating a plurality of keys with the received series of coordinates;

determining an average of received coordinates correlated with each of the plurality of keys;

saving the determined average coordinates for each of the plurality of keys in keypad layout data; and

generating an image of a virtual keypad using the keypad layout data.

12. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform further processes comprising:

prompting the user to enter a series of keystrokes,

wherein correlating a plurality of keys with the received series of coordinates comprises correlating the prompted series of keystrokes with the received coordinates.

13. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform further processes comprising:

determining a statistical envelope based upon received coordinates for each of the plurality of keys; and

saving the statistical envelope for each of the plurality of keys in the keypad layout data.

14. The computing device of claim 11, wherein the processor is configured with processor-executable instructions such that generating an image of the virtual keypad using the keypad layout data comprises generating images of keys in the virtual keypad in locations based upon the average coordinates of each of the plurality of keys stored in the keypad layout data.

15. The computing device of claim 11, wherein the processor is configured with processor-executable instructions such that generating an image of the virtual keypad using the keypad layout data further comprises generating images of the plurality of keys in the virtual keypad in which the size of each key image is based upon the statistical envelope for each of the plurality of keys in the keypad layout data.

16. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform further processes comprising:

monitoring typing on the virtual keypad on the touch sensitive surface;

identifying an adjacent key typing error;

determining a correct key associated with the adjacent key typing error;

updating the average coordinate for the correct key based upon received coordinates for the typed keystroke; and

saving the updated average coordinate with the correct key in the keypad layout data.

17. The computing device of claim 16, wherein the processor is configured with processor-executable instructions such that identifying an adjacent key typing error comprises:

recognizing a misspelled word; and

determining whether the misspelling involves a switch of two keys that are adjacent to each other in the virtual keyboard.

18. The computing device of claim 16, wherein the processor is configured with processor-executable instructions such that identifying an adjacent key typing error comprises:

recognizing a user correction of a letter associated with a key; and

determining whether the user correction involves a switch of two keys that are adjacent to each other in the virtual keyboard.

19. The computing device of claim 11, wherein the keypad layout data is saved in a network accessible database, wherein the processor is configured with processor-executable instructions to perform further processes comprising:

receiving the keypad layout data from the network accessible database via the network.

20. The computing device of claim 19, wherein the processor is configured with processor-executable instructions to perform further processes comprising:

receiving a user touch on the touch sensitive surface coupled to the computing device;

determining a location on the touch sensitive surface for display of the virtual keypad based upon the received user touch on the touch sensitive surface; and

generating the image of the virtual keypad using the keypad layout data at the determined location on the touch sensitive surface for display.

21. A computing device coupled to a touch sensitive surface, comprising:

means for receiving a series of coordinates of a series of user touches on the touch sensitive surface;

means for correlating a plurality of keys with the received series of coordinates;

means for determining an average of received coordinates correlated with each of the plurality of keys;

means for saving the determined average coordinates for each of the plurality of keys in keypad layout data; and

means for generating an image of a virtual keypad using the keypad layout data.

22. The computing device of claim 21, further comprising:

means for prompting the user to enter a series of keystrokes,

wherein means for correlating a plurality of keys with the received series of coordinates comprises means for correlating the prompted series of keystrokes with the received coordinates.

23. The computing device of claim 21, further comprising:

means for determining a statistical envelope based upon received coordinates for each of the plurality of keys; and

means for saving the statistical envelope for each of the plurality of keys in the keypad layout data.

24. The computing device of claim 21, wherein means for generating an image of the virtual keypad using the keypad layout data comprises means for generating images of keys in the virtual keypad in locations based upon the average coordinates of each of the plurality of keys stored in the keypad layout data.

25. The computing device of claim 21, wherein means for generating an image of the virtual keypad using the keypad layout data further comprises means for generating images of the plurality of keys in the virtual keypad in which the size of each key image is based upon the statistical envelope for each of the plurality of keys in the keypad layout data.

26. The computing device of claim 21, further comprising:

means for monitoring typing on the virtual keypad on the touch sensitive surface;

means for identifying an adjacent key typing error;

means for determining a correct key associated with the adjacent key typing error;

means for updating the average coordinate for the correct key based upon received coordinates for the typed keystroke; and

means for saving the updated average coordinate with the correct key in the keypad layout data.

27. The computing device of claim 26, wherein means for identifying an adjacent key typing error comprises:

means for recognizing a misspelled word; and

means for determining whether the misspelling involves a switch of two keys that are adjacent to each other in the virtual keyboard.

28. The computing device of claim 26, wherein means for identifying an adjacent key typing error comprises:

means for recognizing a user correction of a letter associated with a key; and

means for determining whether the user correction involves a switch of two keys that are adjacent to each other in the virtual keyboard.

29. The computing device of claim 21, wherein the keypad layout data is saved in a network accessible database, the computing device further comprising:

means for transmitting the keypad layout data to a computing device via the network,

wherein means for generating an image of a virtual keypad using the keypad layout data comprises means for generating the image of the virtual keypad on a touch sensitive surface coupled to the computing device.

30. The computing device of claim 29, further comprising:

means for receiving a user touch on the touch sensitive surface coupled to the computing device; and

means for determining a location on the touch sensitive surface for display of the virtual keypad based upon the received user touch on the touch sensitive surface,

wherein means for generating an image of a virtual keypad using the keypad layout data comprises means for generating the image at the determined location on the touch sensitive surface for display.

31. A computer program product, comprising:

a computer-readable medium, comprising;

at least one instruction for receiving a series of coordinates of a series of user touches on the touch sensitive surface;

at least one instruction for correlating a plurality of keys with the received series of coordinates;

at least one instruction for determining an average of received coordinates correlated with each of the plurality of keys;

at least one instruction for saving the determined average coordinates for each of the plurality of keys in keypad layout data; and

at least one instruction for generating an image of a virtual keypad using the keypad layout data.

32. The computer program product of claim 31, wherein the computer-readable medium further comprises:

at least one instruction for prompting the user to enter a series of keystrokes,

wherein the at least one instruction for correlating a plurality of keys with the received series of coordinates comprises at least one instruction for correlating the prompted series of keystrokes with the received coordinates.

33. The computer program product of claim 31, wherein the computer-readable medium further comprises:

at least one instruction for determining a statistical envelope based upon received coordinates for each of the plurality of keys; and

at least one instruction for saving the statistical envelope for each of the plurality of keys in the keypad layout data.

34. The computer program product of claim 31, wherein the at least one instruction for generating an image of the virtual keypad using the keypad layout data comprises at least one instruction for generating images of keys in the virtual keypad in locations based upon the average coordinates of each of the plurality of keys stored in the keypad layout data.

35. The computer program product of claim 31, wherein the at least one instruction for generating an image of the virtual keypad using the keypad layout data further comprises at least one instruction for generating images of the plurality of keys in the virtual keypad in which the size of each key image is based upon the statistical envelope for each of the plurality of keys in the keypad layout data.

36. The computer program product of claim 31, wherein the computer-readable medium further comprises:

at least one instruction for monitoring typing on the virtual keypad on the touch sensitive surface;

at least one instruction for identifying an adjacent key typing error;

at least one instruction for determining a correct key associated with the adjacent key typing error;

at least one instruction for the average coordinate for the correct key based upon received coordinates for the typed keystroke; and

at least one instruction for saving the updated average coordinates with the correct key in the keypad layout data.

37. The computer program product of claim 36, wherein the at least one instruction for identifying an adjacent key typing error comprises:

at least one instruction for recognizing a misspelled word; and

at least one instruction for determining whether the misspelling involves a switch of two keys that are adjacent to each other in the virtual keyboard.

38. The computer program product of claim 36, wherein the at least one instruction for identifying an adjacent key typing error comprises:

at least one instruction for recognizing a user correction of a letter associated with a key; and

at least one instruction for determining whether the user correction involves a switch of two keys that are adjacent to each other in the virtual keyboard.

39. The computer program product of claim 31, wherein the keypad layout data is saved in a network accessible database, and the computer-readable medium further comprises:

at least one instruction for transmitting the keypad layout data to a computing device via the network,

wherein the at least one instruction for generating an image of a virtual keypad using the keypad layout data comprises at least one instruction for generating the image of the virtual keypad on a touch sensitive surface coupled to the computing device.

40. The computer program product of claim 39, wherein the computer-readable medium further comprises:

at least one instruction for receiving a user touch on the touch sensitive surface coupled to the computing device; and

at least one instruction for determining a location on the touch sensitive surface for display of the virtual keypad based upon the received user touch on the touch sensitive surface,

wherein the at least one instruction for generating an image of a virtual keypad using the keypad layout data comprises at least one instruction for generating the image at the determined location on the touch sensitive surface for display.

41. A method for customizing a default keypad to a user'"'"'s hands, comprising:

receiving a plurality of coordinates of user touches on a touch sensitive surface;

measuring a dimension of the user'"'"'s hands based upon at least a portion of the received plurality of coordinates of user touches;

adjusting layout dimensions of a default keypad layout based upon the measured dimension of the user'"'"'s hands; and

generating an image of a virtual keypad using the adjusted layout dimensions of the default keypad layout.

42. A computing device, comprising:

a processor;

memory coupled to the processor; and

a touch sensitive surface coupled to the processor,

wherein the processor is configured with processor-executable instructions to perform processes comprising;

receiving a plurality of coordinates of user touches on the touch sensitive surface;

measuring a dimension of the user'"'"'s hands based upon at least a portion of the received plurality of coordinates of user touches;

adjusting layout dimensions of a default keypad layout based upon the measured dimension of the user'"'"'s hands; and

generating an image of a virtual keypad using the adjusted layout dimensions of the default keypad layout.

43. A computing device, comprising:

means for receiving a plurality of coordinates of user touches on a touch sensitive surface;

means for measuring a dimension of the user'"'"'s hands based upon at least a portion of the received plurality of coordinates of user touches;

means for adjusting layout dimensions of a default keypad layout based upon the measured dimension of the user'"'"'s hands; and

means for generating an image of a virtual keypad using the adjusted layout dimensions of the default keypad layout.

44. A computer program product, comprising:

a computer-readable medium, comprising;

at least one instruction for receiving a plurality of coordinates of user touches on a touch sensitive surface;

at least one instruction for measuring a dimension of the user'"'"'s hands based upon at least a portion of the received plurality of coordinates of user touches;

at least one instruction for adjusting layout dimensions of a default keypad layout based upon the measured dimension of the user'"'"'s hands; and

at least one instruction for generating an image of a virtual keypad using the adjusted layout dimensions of the default keypad layout.