Virtual keyboard animation

• US 10,289,302 B1
• Filed: 01/22/2015
• Issued: 05/14/2019
• Est. Priority Date: 09/09/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Marsden, Randal J., Westerman, Wayne Carl
• Primary Examiner(s): Xia, Xuyang
• Application Number:
  US14/603,269
• Time in Patent Office: 1,573 Days
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

A keyboard image is displayed on the touchscreen of a computing device, with images of individual keys of the keyboard being rendered in respective locations on the touchscreen. User contact with the touchscreen is detected at a location corresponding to a first key of the keyboard image and interpreted as an intentional key selection with respect the first key. An animation is thereafter displayed on the touchscreen in response to the key selection, the animation including a visual effect emanating from the touchscreen location corresponding to the first key and moving substantially away from the keyboard image.

Claims

1. A method, comprising:

at a computing device that includes a touchscreen, one or more touch sensors coupled with the touchscreen, and one or more processors configured to receive signals generated by the one or more touch sensors;

displaying a keyboard image on the touchscreen, including rendering images of individual keys of the keyboard image in respective locations on the touchscreen, wherein each individual key of the individual keys is associated with a respective symbol;

displaying, on the touchscreen, a text-input field that is displayed outside of the keyboard image;

detecting, based on signals generated by the one or more touch sensors, user contact with the touchscreen at a location of a first individual key of the individual keys displayed on the keyboard image, wherein a respective rendered image of the first individual key includes a first symbol; and

in response to detecting the user contact at the location of the first individual key, displaying an animation on the touchscreen, the animation including a visual effect of the first symbol emanating from the location of the first individual key and moving substantially away from the first individual key and towards the text-input field, wherein the visual effect is selected from multiple different visual effects based at least in part on a characteristic of the signals generated by the one or more touch sensors.

2. The method of claim 1 wherein:

one characteristic of the signals generated by the one or more touch sensors indicates a magnitude of an impact force of the user contact, and

the selected visual effect conveys information based on the impact force magnitude.

3. The method of claim 1 wherein:

one characteristic of the signals generated by the one or more touch sensors indicates a contact pressure of the user contact, and

the selected visual effect conveys information based on the contact pressure.

4. The method of claim 1 wherein the visual effect comprises a visible circle that expands radially over time from the location of the first individual key.

5. The method of claim 4 wherein:

the first symbol moves across the touchscreen at a rate that corresponds to the radial expansion of the circle.

6. The method of claim 1 further comprising:

detecting that a user'"'"'s fingers are resting on the touchscreen above the displayed keyboard image; and

deforming the keyboard image to signal a selection of a key.

7. The method of claim 6 wherein deforming the keyboard image comprises bowing the keyboard image such that a first portion of the keyboard image disposed beneath a touchscreen region at which the key selection is made appears to be further away from the user than portions of the keyboard on either side of the first portion.

8. The method of claim 1, wherein displaying the keyboard image includes:

displaying a graphic image via the touchscreen; and

displaying at least a portion of the keyboard image on the touchscreen in a semi-transparent form over the graphic image such that the graphic image remains visible through the individual keys within the portion of the keyboard image.

9. The method of claim 8 wherein displaying at least the portion of the keyboard image comprises displaying a complete virtual keyboard.

10. The method of claim 8 further comprising determining one or more symbols most likely to be subsequently typed by the user based at least in part on the user contact interpreted as the intentional key selection, and

wherein displaying at least the portion of the keyboard image comprises displaying an incomplete virtual keyboard that includes a subset of the individual keys, the subset the symbols determined most likely to be subsequently typed by the user.

11. The method of claim 8 wherein displaying at least the portion of the keyboard image comprises displaying an incomplete virtual keyboard that includes respective individual keys immediately surrounding the first individual key.

12. The method of claim 8 further comprising, after displaying at least the portion of the keyboard image on the touchscreen, determining that the user has ceased typing operation with respect to the keyboard image and rendering a fade-effect such that the keyboard image becomes less visible over time, eventually becoming invisible.

13. The method of claim 1, wherein the visual effect lasts for an amount of time that is based on the characteristic of the signals generated by the one or more touch sensors.

14. The method of claim 13, further comprising:

detecting, based on new signals generated by the one or more touch sensors, a new user contact with the touchscreen at a new location of a different individual key of the individual keys, wherein a respective rendered image of the different individual key includes a second symbol;

in response to detecting the new user contact, displaying a new animation including a new visual effect of the second symbol moving from the new location and towards the text-input field,

wherein the new visual effect lasts for a new amount of time that is based on the characteristic of the new signals generated by the one or more touch sensors.

15. The method of claim 1, wherein:

the characteristic of the signals indicates a contact pressure of the user contact, and

the visual effect changes as the contact pressure of the user contact changes.

16. A computing device comprising:

a touchscreen including a display on which images may be rendered and one or more touch sensors to generate signals indicative of user contact with the touchscreen; and

control circuitry, including one or more processors, configured to;

render a keyboard image on the touchscreen, including rendering images of individual keys of the keyboard image in respective locations on the touchscreen, wherein each individual key of the individual keys is associated with a respective symbol,

display, on the touchscreen, a text-input field that is displayed outside of the keyboard image;

detect user contact with the touchscreen at a location of a first individual key of the individual keys displays on the keyboard image based on one or more signals generated by the one or more touch sensors, wherein a respective rendered image of the first individual key includes a first symbol, and

in response to detecting the user contact at the location of the first individual key, render an animation on the touchscreen, the animation including a visual effect of the first symbol emanating from the location of the first individual key and moving substantially away from the first individual key and towards the text-input field, wherein the visual effect is selected from multiple, different visual effects based at least in part on a characteristic of the signals generated by the one or more touch sensors.

17. The computing device of claim 16 wherein the visual effect comprises a visible circle that expands radially over time from the location of the first individual key.

18. The computing device of claim 17, wherein:

the first symbol moves across the touchscreen at a rate that corresponds to the radial expansion of the circle.

19. The computing device of claim 16 wherein the control circuitry comprises memory to store program code and the one or more processors to execute the program code in connection with rendering the keyboard image on the touchscreen, detecting the user contact with the touchscreen location of the first key, interpreting the user contact as the intentional key selection and rendering the animation on the touchscreen.

20. The computing device of claim 16, wherein:

one characteristic of the signals generated by the one or more touch sensors indicates a magnitude of an impact force of the user contact, and

the selected visual effect conveys information based on the impact force magnitude.

21. The computing device of claim 16, wherein:

one characteristic of the signals generated by the one or more touch sensors indicates a contact pressure of the user contact, and

the selected visual effect conveys information based on the contact pressure.

22. The computing device of claim 16, wherein the control circuitry is further configured to:

detect that a user'"'"'s fingers are resting on the touchscreen above the displayed keyboard image; and

deform the keyboard image to signal a selection of a key.

23. The computing device of claim 22, wherein deforming the keyboard image comprises bowing the keyboard image such that a first portion of the keyboard image disposed beneath a touchscreen region at which the key selection is made appears to be further away from the user than portions of the keyboard on either side of the first portion.

24. The computing device of claim 16, wherein displaying the keyboard image includes:

displaying a graphic image via the touchscreen; and

displaying at least a portion of the keyboard image on the touchscreen in a semi-transparent form over the graphic image such that the graphic image remains visible through the individual keys within the portion of the keyboard image.

25. The computing device of claim 24, wherein displaying at least the portion of the keyboard image comprises displaying a complete virtual keyboard.

26. The computing device of claim 24, wherein the control circuitry is further configured to:

determine one or more symbols most likely to be subsequently typed by the user based at least in part on the user contact interpreted as the intentional key selection, and

wherein displaying at least the portion of the keyboard image comprises displaying an incomplete virtual keyboard that includes a subset of the individual keys, the subset corresponding to the symbols determined most likely to be subsequently typed by the user.

27. The computing device of claim 24, wherein displaying at least the portion of the keyboard image comprises displaying an incomplete virtual keyboard that includes respective individual keys immediately surrounding the first individual key.

28. The computing device of claim 24, wherein the control circuitry is further configured to:

after displaying at least the portion of the keyboard image on the touchscreen, determine that the user has ceased typing operation with respect to the keyboard image and render a fade-effect such that the keyboard image becomes less visible over time, eventually becoming invisible.

29. The computing device of claim 16, wherein the visual effect lasts for an amount of time that is based on the characteristic of the signals generated by the one or more touch sensors.

30. The computing device of claim 29, wherein the control circuitry is further configured to:

detect, based on new signals generated by the one or more touch sensors, a new user contact with the touchscreen at a new location of a different individual key of the individual keys, wherein a respective rendered image of the different individual key includes a second symbol;

in response to detecting the new user contact, display a new animation including a new visual effect of the second symbol moving from the new location and towards the text-input field,

wherein the new visual effect lasts for a new amount of time that is based on the characteristic of the new signals generated by the one or more touch sensors.

31. The computing device of claim 16, wherein:

the characteristic of the signals indicates a contact pressure of the user contact, and

the visual effect changes as the contact pressure of the user contact changes.

32. A non-transitory computer-readable medium having one or more sequences of instructions embodied therein which, when executed by one or more processors disposed within a computing device, cause the one or more processors to:

render a keyboard image on a touchscreen of the computing device, including rendering images of individual keys of the keyboard image in respective locations on the touchscreen, each individual key of the individual keys associated with a respective symbol, wherein the computing device includes one or more touch sensors coupled with the touchscreen;

display, on the touchscreen, a text-input field that is displayed outside of the keyboard image;

detect user contact with the touchscreen at a location of a first individual key of the individual keys of the keyboard image based on one or more signals generated by the one or more touch sensors associated with the touchscreen, wherein a respective rendered image of the first individual key includes a first symbol; and

in response to detecting the user contact at the location of the first individual key, render an animation on the touchscreen, the animation including a visual effect of the first symbol emanating from the location of the first individual key and moving substantially away from the first individual key and towards the text-input field, wherein the visual effect is selected from multiple, different visual effects based at least in part on a characteristic of the signals generated by the one or more touch sensors.

33. The non-transitory computer-readable medium of claim 32, wherein the visual effect comprises a visible circle that expands radially over time from the location of the first individual key.

34. The non-transitory computer-readable medium of claim 32, wherein:

the first symbol moves across the touchscreen at a rate that corresponds to the radial expansion of the circle.

35. The non-transitory computer-readable medium of claim 32, wherein the one or more sequences of instructions, when executed by the one or more processors, further cause the one or more processors to:

detect that a user'"'"'s fingers are resting on the touchscreen above the displayed keyboard image; and

deform the keyboard image to signal a selection of a key.

36. The non-transitory computer-readable medium of claim 35, wherein deforming the keyboard image comprises bowing the keyboard image such that a first portion of the keyboard image disposed beneath a touchscreen region at which the key selection is made appears to be further away from the user than portions of the keyboard on either side of the first portion.

37. The non-transitory computer-readable medium of claim 32, wherein displaying the keyboard image includes:

displaying a graphic image via the touchscreen; and

displaying at least a portion of the keyboard image on the touchscreen in a semi-transparent form over the graphic image such that the graphic image remains visible through the individual keys within the portion of the keyboard image.

38. The non-transitory computer-readable medium of claim 37, wherein displaying at least the portion of the keyboard image comprises displaying a complete virtual keyboard.

39. The non-transitory computer-readable medium of claim 37, wherein the one or more sequences of instructions, when executed by the one or more processors, further cause the one or more processors to:

determine one or more symbols most likely to be subsequently typed by the user based at least in part on the user contact interpreted as the intentional key selection, and

wherein displaying at least the portion of the keyboard image comprises displaying an incomplete virtual keyboard that includes a subset of the individual keys, the subset corresponding to the symbols determined most likely to be subsequently typed by the user.

40. The non-transitory computer-readable medium of claim 37, wherein displaying at least the portion of the keyboard image comprises displaying an incomplete virtual keyboard that includes respective individual keys immediately surrounding the first individual key.

41. The non-transitory computer-readable medium of claim 37, wherein the one or more sequences of instructions, when executed by the one or more processors, further cause the one or more processors to:

after displaying at least the portion of the keyboard image on the touchscreen, determine that the user has ceased typing operation with respect to the keyboard image and render a fade-effect such that the keyboard image becomes less visible over time, eventually becoming invisible.

42. The non-transitory computer-readable medium of claim 37, wherein the visual effect lasts for an amount of time that is based on the characteristic of the signals generated by the one or more touch sensors.

43. The non-transitory computer-readable medium of claim 42, wherein the one or more sequences of instructions, when executed by the one or more processors, further cause the one or more processors to:

detect, based on new signals generated by the one or more touch sensors, a new user contact with the touchscreen at a new location of a different individual key of the individual keys, wherein a respective rendered image of the different individual key includes a second symbol;

in response to detecting the new user contact, display a new animation including a new visual effect of the second symbol moving from the new location and towards the text-input field,

wherein the new visual effect lasts for a new amount of time that is based on the characteristic of the new signals generated by the one or more touch sensors.

44. The non-transitory computer-readable medium of claim 32, wherein:

the characteristic of the signals indicates a contact pressure of the user contact, and

the visual effect changes as the contact pressure of the user contact changes.