METHOD AND APPARATUS FOR TOUCHSCREEN GESTURE RECOGNITION OVERLAY

• US 20110320978A1
• Filed: 06/29/2010
• Published: 12/29/2011
• Est. Priority Date: 06/29/2010
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Horodezky, Samuel J., Tsoi, Kam-Cheong Anthony, Bruce, Kathleen M.
• Application Number:
  US12/825,992
• Publication Number:
  US 20110320978A1
• Time in Patent Office: Days
• US Class Current: 715/823
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Methods and devices provide a user interface featuring a gesture recognition overlay suitable for the small display of a mobile device equipped with a touchscreen user input/display. Such a gesture recognition overlay functionality may enable users to enter alphanumeric text and edit text by performing simple gestures on an overlay presented above other images on the touchscreen display. By providing a larger area for accepting user input touch gestures as well as presenting menus, the various embodiments facilitate text entry and editing operations on the relatively small area of most mobile device touchscreen displays. A variety of functions may be correlated to user inputs within the gesture recognition overlay, and various operating modes may be included in the functionality, such as a text selection mode and a toolbar menu mode.

Claims

1. A method of implementing a user interface function on a computing device equipped with a touchscreen display, comprising:

displaying a translucent gesture recognition overlay area on a portion of the touchscreen display;

detecting a first touch event on the touchscreen within the gesture recognition overlay;

determining an intended cursor movement within a displayed text string based on the detected first touch event;

determining a character adjacent to a current position of a cursor within the displayed text string after the determined intended cursor movement;

displaying, on the touchscreen, an enlarged portion of the character; and

updating the cursor position in the displayed text string.

2. The method of claim 1, wherein displaying a translucent gesture recognition overlay area on a portion of the touchscreen display is accomplished in response to detecting a user input corresponding to activation of a gesture recognition overlay functionality.

3. The method of claim 2, wherein the user input corresponding to activation of a gesture recognition overlay functionality comprises a press of a physical button on the computing device.

4. The method of claim 1, wherein determining an intended cursor movement within a displayed text string based on the detected touch event comprises:

determining from the first touch event whether a user has touched the gesture recognition overlay with a finger or stylus near an edge; and

determining from motion of the first touch event whether the user has dragged the finger or stylus towards the opposite edge of the gesture recognition overlay along a centerline.

5. The method of claim 4, wherein displaying, on the touchscreen, an enlarged portion of the character comprises:

displaying an enlarged portion of the character within the gesture recognition overlay; and

periodically updating the display of the enlarged portion based on movement of the first touch event across the gesture recognition overlay.

6. The method of claim 1, further comprising:

recognizing a character sketched in the gesture recognition overlay; and

adding the recognized character to the displayed text string at the updated cursor position.

7. The method of claim 1, further comprising:

detecting a user input corresponding to activation of a text selection mode; and

highlighting the character when the text selection mode is activated.

8. The method of claim 1, further comprising:

detecting a user input corresponding to activation of a text selection mode; and

highlighting a word in a direction of movement of the first touch event when the text selection mode is activated.

9. The method of claim 1, further comprising determining a speed of movement of the first user input,

wherein determining an intended cursor movement within a displayed text string based on the detected first touch event comprises determining that a single character movement of the cursor is intended when the speed of movement of the first user input is slow, and determining that a multi-character movement of the cursor is intended when the speed of the movement of the first user input is fast.

10. The method of claim 1, further comprising:

displaying a menu of functions comprising one or more menu icons within the gesture recognition overlay in response to detecting a user input corresponding to activation of a toolbar functionality;

detecting a user touch on one or more menu icons; and

implementing a function corresponding to the touch one or more menu icons.

11. A computing device, comprising:

a processor; and

a touchscreen display coupled to the processor,

wherein the processor is configured with processor-executable instructions to perform operations comprising;

displaying a translucent gesture recognition overlay area on a portion of the touchscreen display;

detecting a first touch event on the touchscreen within the gesture recognition overlay;

determining an intended cursor movement within a displayed text string based on the detected first touch event;

determining a character adjacent to a current position of a cursor within the displayed text string after the determined intended cursor movement;

displaying, on the touchscreen, an enlarged portion of the character; and

updating the cursor position in the displayed text string.

12. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations such that displaying a translucent gesture recognition overlay area on a portion of the touchscreen display is accomplished in response to detecting a user input corresponding to activation of a gesture recognition overlay functionality.

13. The computing device of claim 12, wherein the processor is configured with processor-executable instructions to perform operations such that the user input corresponding to activation of a gesture recognition overlay functionality comprises a press of a physical button on the computing device.

14. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations such that determining an intended cursor movement within a displayed text string based on the detected touch event comprises:

determining from the first touch event whether a user has touched the gesture recognition overlay with a finger or stylus near an edge; and

determining from motion of the first touch event whether the user has dragged the finger or stylus towards the opposite edge of the gesture recognition overlay along a centerline.

15. The computing device of claim 14, wherein the processor is configured with processor-executable instructions to perform operations such that displaying, on the touchscreen, an enlarged portion of the character comprises:

displaying an enlarged portion of the character within the gesture recognition overlay; and

periodically updating the display of the enlarged portion based on movement of the first touch event across the gesture recognition overlay.

16. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

recognizing a character sketched in the gesture recognition overlay; and

adding the recognized character to the displayed text string at the updated cursor position.

17. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

detecting a user input corresponding to activation of a text selection mode; and

highlighting the character when the text selection mode is activated.

18. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

detecting a user input corresponding to activation of a text selection mode; and

highlighting a word in a direction of movement of the first touch event when the text selection mode is activated.

19. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations further comprising determining a speed of movement of the first user input,

wherein the processor is configured with processor-executable instructions to perform operations such that determining an intended cursor movement within a displayed text string based on the detected first touch event comprises determining that a single character movement of the cursor is intended when the speed of movement of the first user input is slow, and determining that a multi-character movement of the cursor is intended when the speed of the movement of the first user input is fast.

20. The computing device of claim 11, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

displaying a menu of functions comprising one or more menu icons within the gesture recognition overlay in response to detecting a user input corresponding to activation of a toolbar functionality;

detecting a user touch on one or more menu icons; and

implementing a function corresponding to the touch one or more menu icons.

21. A computing device, comprising:

a touchscreen display;

means for displaying a translucent gesture recognition overlay area on a portion of the touchscreen display;

means for detecting a first touch event on the touchscreen within the gesture recognition overlay;

means for determining an intended cursor movement within a displayed text string based on the detected first touch event;

means for determining a character adjacent to a current position of a cursor within the displayed text string after the determined intended cursor movement;

means for displaying, on the touchscreen, an enlarged portion of the character; and

means for updating the cursor position in the displayed text string.

22. The computing device of claim 21, wherein means for displaying a translucent gesture recognition overlay area on a portion of the touchscreen display comprises means for displaying a translucent gesture recognition overlay area on a portion of the touchscreen display in response to detecting a user input corresponding to activation of a gesture recognition overlay functionality.

23. The method of claim 22, wherein the user input corresponding to activation of a gesture recognition overlay functionality comprises a press of a physical button on the computing device.

24. The computing device of claim 21, wherein means for determining an intended cursor movement within a displayed text string based on the detected touch event comprises:

means for determining from the first touch event whether a user has touched the gesture recognition overlay with a finger or stylus near an edge; and

means for determining from motion of the first touch event whether the user has dragged the finger or stylus towards the opposite edge of the gesture recognition overlay along a centerline.

25. The computing device of claim 24, wherein means for displaying, on the touchscreen, an enlarged portion of the character comprises:

means for displaying an enlarged portion of the character within the gesture recognition overlay; and

means for periodically updating the display of the enlarged portion based on movement of the first touch event across the gesture recognition overlay.

26. The computing device of claim 21, further comprising:

means for recognizing a character sketched in the gesture recognition overlay; and

means for adding the recognized character to the displayed text string at the updated cursor position.

27. The computing device of claim 21, further comprising:

means for detecting a user input corresponding to activation of a text selection mode; and

means for highlighting the character when the text selection mode is activated.

28. The computing device of claim 21, further comprising:

means for detecting a user input corresponding to activation of a text selection mode; and

means for highlighting a word in a direction of movement of the first touch event when the text selection mode is activated.

29. The computing device of claim 21, further comprising means for determining a speed of movement of the first user input,

wherein means for determining an intended cursor movement within a displayed text string based on the detected first touch event comprises means for determining that a single character movement of the cursor is intended when the speed of movement of the first user input is slow, and determining that a multi-character movement of the cursor is intended when the speed of the movement of the first user input is fast.

30. The computing device of claim 21, further comprising:

means for displaying a menu of functions comprising one or more menu icons within the gesture recognition overlay in response to detecting a user input corresponding to activation of a toolbar functionality;

means for detecting a user touch on one or more menu icons; and

means for implementing a function corresponding to the touch one or more menu icons.

31. A non-transitory computer-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a computing device equipped with a touchscreen display to perform operations comprising:

displaying a translucent gesture recognition overlay area on a portion of the touchscreen display;

detecting a first touch event on the touchscreen within the gesture recognition overlay;

determining an intended cursor movement within a displayed text string based on the detected first touch event;

determining a character adjacent to a current position of a cursor within the displayed text string after the determined intended cursor movement;

displaying, on the touchscreen, an enlarged portion of the character; and

updating the cursor position in the displayed text string.

32. The non-transitory computer-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations such that displaying a translucent gesture recognition overlay area on a portion of the touchscreen display is accomplished in response to detecting a user input corresponding to activation of a gesture recognition overlay functionality.

33. The method of claim 32, wherein the user input corresponding to activation of a gesture recognition overlay functionality comprises a press of a physical button on the computing device.

34. The non-transitory computer-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations such that determining an intended cursor movement within a displayed text string based on the detected touch event comprises:

determining from the first touch event whether a user has touched the gesture recognition overlay with a finger or stylus near an edge; and

determining from motion of the first touch event whether the user has dragged the finger or stylus towards the opposite edge of the gesture recognition overlay along a centerline.

35. The non-transitory computer-readable storage medium of claim 34, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations such that displaying, on the touchscreen, an enlarged portion of the character comprises:

displaying an enlarged portion of the character within the gesture recognition overlay; and

periodically updating the display of the enlarged portion based on movement of the first touch event across the gesture recognition overlay.

36. The non-transitory computer-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations further comprising:

recognizing a character sketched in the gesture recognition overlay; and

adding the recognized character to the displayed text string at the updated cursor position.

37. The non-transitory computer-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations further comprising:

detecting a user input corresponding to activation of a text selection mode; and

highlighting the character when the text selection mode is activated.

38. The non-transitory computer-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations further comprising:

detecting a user input corresponding to activation of a text selection mode; and

highlighting a word in a direction of movement of the first touch event when the text selection mode is activated.

39. The non-transitory computer-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations further comprising determining a speed of movement of the first user input,

wherein the stored processor-executable instructions are configured to cause a processor to perform operations such that determining an intended cursor movement within a displayed text string based on the detected first touch event comprises determining that a single character movement of the cursor is intended when the speed of movement of the first user input is slow, and determining that a multi-character movement of the cursor is intended when the speed of the movement of the first user input is fast.

40. The non-transitory computer-readable storage medium of claim 31, wherein the stored processor-executable instructions are configured to cause a computing device processor to perform operations further comprising:

displaying a menu of functions comprising one or more menu icons within the gesture recognition overlay in response to detecting a user input corresponding to activation of a toolbar functionality;

detecting a user touch on one or more menu icons; and

implementing a function corresponding to the touch one or more menu icons.