ON-SCREEN KEYBOARD WITH HAPTIC EFFECTS

• US 20120113008A1
• Filed: 11/03/2011
• Published: 05/10/2012
• Est. Priority Date: 11/08/2010
• Status: Abandoned Application

• Current Assignee: Senseg Ltd.
• Original Assignee: Senseg Ltd.
• Inventors: Makinen, Ville, Ahmed, Moaffak, Kari, Marianne, Linjama, Jukka
• Application Number:
  US13/288,749
• Publication Number:
  US 20120113008A1
• Time in Patent Office: Days
• US Class Current: 345/168
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A computer-implemented method is described for displaying an on-screen keyboard on a touch-sensitive display of an electronic device is described. The method may detect contact of a finger in a contact area of the display and monitor movement of the contact area on display in response to movement of the finger across the display. The method may determine that the contact area is proximate a region of the display that includes a key of the on-screen keyboard, and provide a haptic effect to indicate that the finger is proximate the at least one key. The haptic effect may be provided via the display and be provided proximate to the detected contact area. In an example embodiment, an anchor on one or more keys of the on-screen keyboard is provides a further haptic effect to the finger when the finger is proximate to the anchor.

Claims

1. A computer-implemented method comprising:

displaying an on-screen keyboard on a touch-sensitive display of an electronic device;

detecting contact of a finger in a contact area of the display;

monitoring movement of the contact area on display in response to movement of the finger across the display;

determining that the contact area is proximate a region of the display that includes a key of the on-screen keyboard; and

providing a haptic effect to indicate that the finger is proximate the at least one key.

2. The computer-implemented method of claim 1, wherein the haptic effect is provided via the display.

3. The computer-implemented method of claim 2, wherein the haptic effect is provided proximate to the detected contact area.

4. The computer-implemented method of claim 1, wherein the haptic effect provides haptic feedback to the finger to indicate that the finger is proximate the region of the touch-sensitive display including the key of the on-screen keyboard.

5. The computer-implemented method of claim 1, wherein providing the haptic effect on the display comprises:

determining that the contact area is moving across an edge of the key of the on-screen keyboard; and

generating the haptic effect to provide haptic feedback to the finger to indicate the edge of the key.

6. The computer-implemented method of claim 1, wherein the haptic effect is provided to the finger to simulate an edge of the key of the on-screen keyboard.

7. The computer-implemented method of claim 6, wherein the edge of the key is simulated by a raised shape generated via the on-screen keyboard.

8. The computer-implemented method of claim 1, wherein generating the haptic effect comprises:

determining that the contact area is moving across a central portion of the key of the on-screen keyboard; and

generating a haptic effect that provides haptic feedback to the finger to indicate the central portion of the key.

9. The computer-implemented method of claim 8, wherein the haptic effect that provides the haptic feedback to the finger to indicate the central portion of the key includes a rough texture.

10. The computer-implemented method of claim 1, wherein the on-screen keyboard includes a plurality of keys and the haptic effect associated with at least two keys of the plurality of keys differs.

11. The computer-implemented method of claim 1, wherein the haptic effect simulates touch by the finger of a convex shape.

12. The computer-implemented method of claim 1, wherein the haptic effect simulates touch by the finger of a concave shape.

13. The computer-implemented method claim 1, wherein the haptic effect is provided on the display in the area of the display corresponding to the contact area, the method including:

determining that the contact area covers at least a portion of two or more keys of the on-screen keyboard; and

generating a haptic effect that provides haptic feedback to the finger to indicate that the finger covers at least a portion of two or more keys of the on-screen keyboard.

14. The computer-implemented method of claim 13, wherein the haptic effect providing haptic feedback to the finger to indicate that the finger covers at least a portion of two or more keys of the on-screen keyboard comprises:

a haptic effect having a predetermined duration and a predetermined intensity, and wherein the predetermined duration and the predetermined intensity is greater than a duration and an intensity of a haptic effect that provides haptic feedback to the finger to indicate that the finger covers at least a portion of only a single key of the on-screen keyboard.

15. The computer-implemented method of claim 1, wherein determining that the contact area is proximate a region of the display that includes the key of the on-screen keyboard comprises determining that the contact area covers at least a portion of the key of the on-screen keyboard, the method further comprising:

generating a modified visual representation of the key to indicate that the finger is covering at least a portion of the key; and

generating a haptic effect corresponding to the modified visual representation of the key.

16. The computer-implemented method of claim 15, further comprising:

determining that a select gesture is performed by the finger on the modified visual representation of the key; and

generating a key selection event for the key.

17. The computer-implemented method of claim 16, wherein the keys of the on-screen keyboard are arranged in rows and the select gesture includes a downward swipe transverse to the rows and over the modified visual representation of the key.

18. The computer-implemented method of claim 16, further comprising generating a further haptic effect based on the modified visual representation of the key and the select gesture being performed on the modified visual representation of the key.

19. The computer-implemented method of claim 16, further comprising:

determining that the contact area covers at least a portion of a key of the on-screen keyboard;

determining that the finger is lifted off the touch-sensitive display over the modified visual representation of the key; and

generating a key selection event for the key.

20. The computer-implemented method of claim 19, wherein:

a tap operation is defined when the finger is lifted off the touch-sensitive display for at least 200 ms and then subsequently touches the key and the finger is then lifted; and

a seek operation is defined when a completed tap operation is not performed within about 300 ms to 700 ms.

21. The computer-implemented method of claim 1, further comprising:

providing an anchor on one or more keys of the on-screen keyboard; and

providing a further haptic effect to the finger when the finger is proximate to the anchor.

22. The computer-implemented method of claim 21, wherein an anchor is provided on each of the “

F” and

“

J”

keys of the on screen keyboard to simulate the anchors provided on the “

F” and

“

J”

keys of a physical keyboard.

23. The computer-implemented method of claim 1, further comprising:

generating a modified visual representation of at least one key proximate to the contact area; and

monitoring performance of a select gesture using the finger on the modified visual representation of the at least one key; and

generating a key selection event for the key that includes adding an alphanumeric letter to a content area.

24. The computer-implemented method of claim 23, wherein determining that the select gesture is performed on the modified visual representation of the key includes determining that the finger is lifted off of the display at a position over the modified visual representation of the key.

25. The computer-implemented method of claim 23, wherein the haptic effect corresponding to the modified visual representation of the key is generated.

26. The computer-implemented method of claim 23, wherein the haptic effect corresponding to the select gesture is generated.

27. The computer-implemented method of claim 23, wherein prior to determining that the select gesture is performed on the modified visual representation of the key, the method further comprises displaying a label of a selected key, at a text insertion point in the content area of the display.

28. The computer-implemented method of claim 23, wherein prior to determining that the select gesture is performed on the modified visual representation of the key, the method further comprises displaying a visual representation of the key below a text insertion point in the content area of the display.

29. The computer-implemented method of claim 23, wherein prior to determining that the select gesture is performed on the modified visual representation of the key, the method comprises displaying, below a text insertion point in the content area of the touch-sensitive display, at least a portion of the on-screen keyboard including the modified representation of key.

30. The computer-implemented method of claim 23, wherein prior to determining that the select gesture is performed on the modified visual representation of the key, the method comprises:

determining that the contact area covers at least the portion of the key for at least a predetermined period of time; and

displaying a key selector including a plurality of variants for the key.

31. The computer-implemented method of claim 30, further comprising:

determining that the contact area is moving over the key selector; and

generating a haptic effect in the area of the touch-sensitive display corresponding to a location of the contact area over the key selector.

32. The computer-implemented method of claim 30, wherein the key selector is a disc-shaped key selector.

33. The computer-implemented method of claim 30, wherein the key selector includes a plurality of variants arranged linearly in a key slider.

34. The computer-implemented method of claim 23, wherein prior to determining that the select gesture is performed on the modified visual representation of the key, the method comprises:

determining that the contact area covers at least the portion of the key for at least a predetermined period of time; and

displaying a scroll control slider.

35. The computer-implemented method of claim 34, further comprising:

determining that the contact area is moving over the scroll control slider; and

generating a haptic effect in the area of the touch-sensitive display corresponding to a location of the contact area over the scroll control slider.

36. A computer readable storage medium storing at least one program configured for execution by a computer, the at least one program comprising instructions to perform operations comprising:

displaying an on-screen keyboard on a touch-sensitive display of an electronic device;

detecting contact of a finger in a contact area of the display;

monitoring movement of the contact area on display in response to movement of the finger across the display;

determining that the contact area is proximate a region of the display that includes a key of the on-screen keyboard; and

providing a haptic effect to indicate that the finger is proximate the at least one key.

37. An electronic device comprising:

touch-sensitive display including haptic feedback functionality; and

a processing module configured to;

display an on-screen keyboard on the touch-sensitive display of the electronic device;

detect contact of a finger in a contact area of the display;

monitor movement of the contact area on display in response to movement of the finger across the display;

determine that the contact area is proximate a region of the display that includes a key of the on-screen keyboard; and

provide a haptic effect via the display to indicate that the finger is proximate the at least one key.