Dynamically located onscreen keyboard

• US 8,390,572 B2
• Filed: 02/03/2012
• Issued: 03/05/2013
• Est. Priority Date: 09/19/2007
• Status: Active Grant

• Current Assignee: Typesoft Technologies Incorporated (Apple Inc.)
• Original Assignee: Cleankeys, Inc.
• Inventors: Marsden, Randal J., Hole, Steve
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Runkle, III, Nelson D
• Application Number:
  US13/365,719
• Publication Number:
  US 20120133589A1
• Time in Patent Office: 396 Days
• Field of Search: 345/168
• US Class Current: 345/168
• CPC Class Codes: G06F 1/1662 Details related to the integrated keyboard
• CPC Class Codes: G06F 1/1664 Arrangements for ergonomically adjusting the disposition of keys of the integrated keyboard
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/0202 Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/0216 Arrangements for ergonomically adjusting the disposition of keys of a keyboard for keyboards integrated in a laptop computer G06F1/1664
• CPC Class Codes: G06F 3/0219 Special purpose keyboards
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A touch-sensitive display surface having touch-capacitive and vibration sensors. This surface allows the user to rest their fingers on the keys of an onscreen keyboard and type as they would on a regular keyboard. As the user places their fingers on the touch screen, the system relocates the onscreen keyboard to the location where the fingers are resting. The touch sensors report the signal strength level of each key touched to a processor, but no keystroke is issued by the processor until a corresponding “tap” (i.e., vibration) is detected. When a tap is detected, the processor references the status of the touch capacitance sensors before, during, and/or immediately after the moment in time the tap occurred. The size, position, and orientation of the onscreen keyboard keys are dynamically set as determined by the user initiating a home-row definition event by resting their fingers momentarily on a virtual home-row.

Claims

1. A device comprising:

a display;

a plurality of touch sensors coupled to the display, the plurality of touch sensors configured to generate touch sense signals based on sensed user touches on the display;

one or more vibration sensors, the vibration sensors configured to generate vibration signals based on sensed vibrations of the housing;

a processor in signal communication with the display, the plurality of touch sensors, and the one or more vibration sensors, wherein the processor is configured to

determine a keyboard orientation gesture based on the generated touch sense signals and the vibration signals;

generate and present on the display an image of a keyboard having a plurality of keys based on the determined keyboard orientation gesture or the generated vibration signals determined to coincide with the location of the user'"'"'s fingers;

correlate the touch sensor signals with the vibration sensor signals to disambiguate between the user resting their fingers and the user actuating a key; and

output a pre-determined keyboard event when a key is determined to have been actuated by the user; and

a housing configured to contain the display the plurality of touch sensors, the one or more vibration sensors, and the processor.

2. The device of claim 1, wherein the processor is configured to determine location of the keyboard image on the display based on the generated sense signals.

3. The device of claim 1, wherein the processor is configured to determine location of the keyboard image on the display based on determination of existence of a home-row definition event.

4. The device of claim 3, wherein the processor determines an existence of the home-row definition event when two or more generated sense signals are determined to be active for a predefined amount time.

5. The device of claim 4, wherein the processor is configured to,

determine locations of home-row keys of the keyboard image based on determination of location of the generated two or more sense signals, and

determine locations of non-home-row keys of the keyboard image based on determined location of at least one of the home-row keys.

6. The device of claim 4, wherein the processor is configured to,

determine sizes of home-row keys of the keyboard image based on determination of location of the generated two or more sense signals, and

determine sizes of non-home-row keys of the keyboard image based on determined location of at least one of the home-row keys.

7. The device of claim 4, wherein the processor is configured to,

determine orientations of home-row keys of the keyboard image based on determination of location of the generated two or more sense signals, and

determine orientations of non-home-row keys of the keyboard image based on determined location of at least one of the home-row keys.

8. The device of claim 3, wherein the housing further comprises a vibration device configured to generate vibrations at one or more frequencies, wherein the processor is configured to cause the vibration device to activate at a predefined frequency based on the home-row definition event.

9. The device of claim 3, wherein the housing further comprises a vibration device configured to generate vibrations at one or more frequencies, wherein the processor is configured to:

determine location of at least one user finger based on the sensor signal; and

cause the vibration device to create a vibration at a predefined frequency when the determined location of the at least one user finger is within a threshold distance from the at least one home key.

10. The device of claim 9, wherein the vibration device is configured to alter intensity of the vibration based on distance of the at least one user finger from the corresponding home key.

11. The device of claim 3, wherein the housing further comprises an audio device configured to generate audio signals at one or more frequencies, wherein the processor is configured to:

determine location of at least one user finger based on the sensor signal; and

cause the audio device to create an audio signal at a predefined frequency when the determined location of the at least one user finger is within a threshold distance from the at least one home key.

12. The device of claim 11, wherein the audio device is configured to alter intensity of the audio signal based on distance of the at least one user finger from the corresponding home key.

13. The device of claim 1, wherein the processor is configured to,

periodically receive sense signals associated with continual user finger contact with the display,

determine if the received periodic sense signals indicate drift from locations of the sense signals used during the generation and presentation of the keyboard image, and

move at least one key of the keyboard image on the display based on a drift indicated of the at least one key.

14. The device of claim 13, further comprising an output device, wherein the processor is configured to,

determine if the periodically received sense signals indicate user finger contact drift is within a threshold distance of an edge of the display, and

output a signal to the output device if user finger contact drift was determined to be within the threshold distance.

15. The device of claim 1, wherein the processor is configured to,

sense a user typing action based on the generated sense signals and the generated motion signals, and

change the keyboard image to be at least one of semitransparent or invisible when the user typing action is not sensed for a predefined amount of time.

16. The device of claim 15, wherein after the keyboard image has been made at least one of semitransparent or invisible, the processor is configured to cause the keyboard image to appear at least less transparent when a user typing action has been sensed.

17. The device of claim 1, wherein the processor is configured to,

determine at least one next most likely key to be activated based one or more previous key activations, and

uniquely display the determined at least one next most likely key.

18. The device of claim 1, wherein the processor is configured to,

determine relative movement of one or more user fingers from the home-row keys based on the generated sense signals, and

generate a key activation event based on the generated motion signals and the determined relative movement.

19. The device of claim 1, wherein the processor is configured to,

generate one or more candidate keys based on at least a portion of the generated sense signals and the generated motion signals, and

generate a key activation event by disambiguating the generated one or more candidate keys using a statistical probability model.

20. The device of claim 19, wherein the processor is configured to,

determine a size value for at least one key based on statistical probability model and at least one previous key activation event, and

alter the keyboard image based on the determined size value for the at least one key.

21. The device of claim 1, wherein the processor is configured to,

cause the presented keyboard image to be invisible in a state based on a sensed first user action, and

cause the presented keyboard image to be invisible in an inactive state based on a sensed second user action.

22. The device of claim 1, wherein the generated at least one motion signal is associated with a location relative to the housing,

wherein the processor is configured to identify a function based on the location relative to the housing, when the at least one motion signal has been generated and no sense signals have been generated.