Handwriting keyboard for screens

• US 10,228,846 B2
• Filed: 06/05/2017
• Issued: 03/12/2019
• Est. Priority Date: 06/12/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Dixon, Ryan S., Chaudhri, Imran, Griffin, Bradley W., Jon, Tiffany S.
• Primary Examiner(s): Thomas, Mia M
• Application Number:
  US15/614,276
• Publication Number:
  US 20170357438A1
• Time in Patent Office: 645 Days
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

The present disclosure generally relates to handwriting on touch sensitive surfaces. In some examples, text suggestions strokes entered on a touch sensitive surface are viewed and selected in response to a rotatable input mechanism. In some examples, text determined from a set of strokes on the touch sensitive surface is revised based on a subsequently entered stroke on the touch sensitive surface. In some examples, a determination is made whether to include a stroke in a set of strokes based a time between the stroke and the previous stroke. In some examples, determining text based on a set of stroke is interrupted to determined revised text based on the set of strokes and a second stroke.

Claims

1. A method, comprising:

at a portable electronic device having one or more processors, a touch sensitive surface, a display, and a rotatable input mechanism;

displaying a user input interface on the display including a message area and a stroke input area;

receiving a first set of strokes on the touch sensitive surface in the stroke input area;

determining first text based on the first set of strokes;

displaying the first text on the display in the message area;

determining one or more suggestions based on the first text, wherein the one or more suggestions include one or more changes to the first text;

after determining the one or more suggestions;

while not displaying suggestions in the stroke input area, receiving user input via the rotatable input mechanism;

in response to the user input;

displaying, in the stroke input area, at least one of the one or more suggestions; and

displaying, in the stroke input area, a selection indicator indicating a selected suggestion of the one or more suggestions; and

after displaying the at least one of the one or more suggestions and the selection indicator, replacing display of the first text with display of the selected suggestion.

2. The method of claim 1 further comprising:

in response to determining the one or more suggestions, displaying an indication that the one or more suggestions are available.

3. The method of claim 1 further comprising:

further in response to receiving the user input, determining whether a characteristic of the user input meets first criteria;

in accordance with a determination that the suggestion interface cessation criteria are met, ceasing to display the graphical interface corresponding to the one or more suggestions.

4. The method of claim 1 further comprising:

in response to continuing to receiving the user input via the rotatable input mechanism, moving the selection indicator from a first suggestion to a second suggestion of the one or more suggestions.

5. The method of claim 1, wherein the display of the one or more suggestions includes the first text and one or more capitalized suggestions above the first text and one or more lower case suggestions below the first text.

6. The method of claim 1, wherein the one or more suggestions include an auto-complete suggestion or an auto-correct suggestion.

7. The method of claim 1, wherein the one or more suggestions include an emoji identified based on the first text.

8. The method of claim 1, wherein the one or more suggestions are determined using an n-gram model.

9. The method of claim 1 further comprising:

prior to receiving the first set of strokes, receiving a second set of strokes in the stroke input area;

determining second text based on the second set of strokes, wherein determining the one or more suggestions is further based on the second text.

10. The method of claim 1 further comprising:

in response to receiving at least a portion of the first set of strokes, displaying, in the stroke input area, a graphical representation of the first set of strokes.

11. The method of claim 1 further comprising:

receiving a first stroke in the stroke input area;

after a time period has elapsed since receiving the first stroke, receiving a second stroke in the stroke input area;

in accordance with a determination that the time period does not exceed a threshold value, including the first stroke and the second stroke in the first set of strokes;

in accordance with a determination that the time period exceed a threshold, including the first stroke in the first set of strokes and excluding the second stroke from the first set of strokes.

12. The method of claim 1, wherein the first text includes multiple characters.

13. The method of claim 1, wherein the first text is a single character.

14. The method of claim 1 further comprising:

receiving a third stroke at a location in the stroke input area;

receiving a fourth stroke in the stroke input area at substantially the same location in the stroke input area, wherein both the third stroke and the fourth stroke are included in the first set of strokes.

15. The method of claim 1, wherein the first set of strokes is a single continuous stroke.

16. The method of claim 1, wherein the first set of strokes includes a plurality of discrete strokes.

17. The method of claim 1, wherein the user input interface includes a plurality of affordances, including an affordance corresponding to audio input, the method further comprising:

in response to receiving user input selecting the affordance corresponding to audio input, displaying an audio input interface to receive dictation input.

18. The method of claim 1 further comprising:

displaying a scroll indicator with the display of the at least one of the one or more suggestions and the display of the selection indicator, wherein a size of the scroll indicator is based on the number of one or more suggestions and a location of the scroll indicator is based on the position of the selection indicator within the number of one or more suggestions.

19. The method of claim 1 further comprising:

after replacing display of the first text with display of the selected suggestion;

ceasing to display the at least one of the one or more suggestions; and

after ceasing to display the at least one of the one or more suggestions, receiving additional user input via the rotatable input mechanism;

in response to receiving the additional user input;

displaying an at least additional one of the one or more suggestions; and

displaying the selection indicator.

20. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a portable electronic device with a touch sensitive surface, a display, and a rotatable input mechanism, the one or more programs including instructions for:

displaying a user input interface on the display including a message area and a stroke input area;

receiving a first set of strokes on the touch sensitive surface in the stroke input area;

determining first text based on the first set of strokes;

displaying the first text on the display in the message area;

determining one or more suggestions based on the first text, wherein the one or more suggestions include one or more changes to the first text;

after determining the one or more suggestions;

while not displaying suggestions in the stroke input area, receiving user input via the rotatable input mechanism;

in response to the user input;

displaying, in the stroke input area, at least one of the one or more suggestions; and

displaying, in the stroke input area, a selection indicator indicating a selected suggestion of the one or more suggestions; and

after displaying the at least one of the one or more suggestions and the selection indicator, replacing display of the first text with display of the selected suggestion.

21. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

in response to determining the one or more suggestions, displaying an indication that the one or more suggestions are available.

22. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

further in response to receiving the user input, determining whether a characteristic of the user input meets first criteria;

in accordance with a determination that the suggestion interface cessation criteria are met, ceasing to display the graphical interface corresponding to the one or more suggestions.

23. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

in response to continuing to receiving the user input via the rotatable input mechanism, moving the selection indicator from a first suggestion to a second suggestion of the one or more suggestions.

24. The non-transitory computer-readable storage medium of claim 20, wherein the display of the one or more suggestions includes the first text and one or more capitalized suggestions above the first text and one or more lower case suggestions below the first text.

25. The non-transitory computer-readable storage medium of claim 20, wherein the one or more suggestions include an auto-complete suggestion or an auto-correct suggestion.

26. The non-transitory computer-readable storage medium of claim 20, wherein the one or more suggestions include an emoji identified based on the first text.

27. The non-transitory computer-readable storage medium of claim 20, wherein the one or more suggestions are determined using an n-gram model.

28. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

prior to receiving the first set of strokes, receiving a second set of strokes in the stroke input area;

determining second text based on the second set of strokes, wherein determining the one or more suggestions is further based on the second text.

29. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

in response to receiving at least a portion of the first set of strokes, displaying, in the stroke input area, a graphical representation of the first set of strokes.

30. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

receiving a first stroke in the stroke input area;

after a time period has elapsed since receiving the first stroke, receiving a second stroke in the stroke input area;

in accordance with a determination that the time period does not exceed a threshold value, including the first stroke and the second stroke in the first set of strokes;

in accordance with a determination that the time period exceed a threshold, including the first stroke in the first set of strokes and excluding the second stroke from the first set of strokes.

31. The non-transitory computer-readable storage medium of claim 20, wherein the first text includes multiple characters.

32. The non-transitory computer-readable storage medium of claim 20, wherein the first text is a single character.

33. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

receiving a third stroke at a location in the stroke input area;

receiving a fourth stroke in the stroke input area at substantially the same location in the stroke input area, wherein both the third stroke and the fourth stroke are included in the first set of strokes.

34. The non-transitory computer-readable storage medium of claim 20, wherein the first set of strokes is a single continuous stroke.

35. The non-transitory computer-readable storage medium of claim 20, wherein the first set of strokes includes a plurality of discrete strokes.

36. The non-transitory computer-readable storage medium of claim 20, wherein the user input interface includes a plurality of affordances, including an affordance corresponding to audio input, the one or more programs further including instructions for:

in response to receiving user input selecting the affordance corresponding to audio input, displaying an audio input interface to receive dictation input.

37. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

displaying a scroll indicator with the display of the at least one of the one or more suggestions and the display of the selection indicator, wherein a size of the scroll indicator is based on the number of one or more suggestions and a location of the scroll indicator is based on the position of the selection indicator within the number of one or more suggestions.

38. The non-transitory computer-readable storage medium of claim 20, the one or more programs further including instructions for:

after replacing display of the first text with display of the selected suggestion;

ceasing to display the at least one of the one or more suggestions; and

after ceasing to display the at least one of the one or more suggestions, receiving additional user input via the rotatable input mechanism;

in response to receiving the additional user input;

displaying an at least additional one of the one or more suggestions; and

displaying the selection indicator.

39. A portable electronic device, comprising:

a touch sensitive surface;

a display;

a rotatable input mechanism;

one or more processors; and

a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a user input interface on the display including a message area and a stroke input area;

receiving a first set of strokes on the touch sensitive surface in the stroke input area;

determining first text based on the first set of strokes;

displaying the first text on the display in the message area;

determining one or more suggestions based on the first text, wherein the one or more suggestions include one or more changes to the first text;

after determining the one or more suggestions;

while not displaying suggestions in the stroke input area, receiving user input via the rotatable input mechanism;

in response to the user input;

displaying, in the stroke input area, at least one of the one or more suggestions; and

displaying, in the stroke input area, a selection indicator indicating a selected suggestion of the one or more suggestions; and

after displaying the at least one of the one or more suggestions and the selection indicator, replacing display of the first text with display of the selected suggestion.

40. The device of claim 39, the one or more programs further including instructions for:

in response to determining the one or more suggestions, displaying an indication that the one or more suggestions are available.

41. The device of claim 39, the one or more programs further including instructions for:

further in response to receiving the user input, determining whether a characteristic of the user input meets first criteria;

in accordance with a determination that the suggestion interface cessation criteria are met, ceasing to display the graphical interface corresponding to the one or more suggestions.

42. The device of claim 39, the one or more programs further including instructions for:

in response to continuing to receiving the user input via the rotatable input mechanism, moving the selection indicator from a first suggestion to a second suggestion of the one or more suggestions.

43. The device of claim 39, wherein the display of the one or more suggestions includes the first text and one or more capitalized suggestions above the first text and one or more lower case suggestions below the first text.

44. The device of claim 39, wherein the one or more suggestions include an auto-complete suggestion or an auto-correct suggestion.

45. The device of claim 39, wherein the one or more suggestions include an emoji identified based on the first text.

46. The device of claim 39, wherein the one or more suggestions are determined using an n-gram model.

47. The device of claim 39, the one or more programs further including instructions for:

prior to receiving the first set of strokes, receiving a second set of strokes in the stroke input area;

determining second text based on the second set of strokes, wherein determining the one or more suggestions is further based on the second text.

48. The device of claim 39, the one or more programs further including instructions for:

in response to receiving at least a portion of the first set of strokes, displaying, in the stroke input area, a graphical representation of the first set of strokes.

49. The device of claim 39, the one or more programs further including instructions for:

receiving a first stroke in the stroke input area;

after a time period has elapsed since receiving the first stroke, receiving a second stroke in the stroke input area;

in accordance with a determination that the time period does not exceed a threshold value, including the first stroke and the second stroke in the first set of strokes;

in accordance with a determination that the time period exceed a threshold, including the first stroke in the first set of strokes and excluding the second stroke from the first set of strokes.

50. The device of claim 39, wherein the first text includes multiple characters.

51. The device of claim 39, wherein the first text is a single character.

52. The device of claim 39, the one or more programs further including instructions for:

receiving a third stroke at a location in the stroke input area;

receiving a fourth stroke in the stroke input area at substantially the same location in the stroke input area, wherein both the third stroke and the fourth stroke are included in the first set of strokes.

53. The device of claim 39, wherein the first set of strokes is a single continuous stroke.

54. The device of claim 39, wherein the first set of strokes includes a plurality of discrete strokes.

55. The device of claim 39, wherein the user input interface includes a plurality of affordances, including an affordance corresponding to audio input, the one or more programs further including instructions for:

in response to receiving user input selecting the affordance corresponding to audio input, displaying an audio input interface to receive dictation input.

56. The device of claim 39, the one or more programs further including instructions for:

displaying a scroll indicator with the display of the at least one of the one or more suggestions and the display of the selection indicator, wherein a size of the scroll indicator is based on the number of one or more suggestions and a location of the scroll indicator is based on the position of the selection indicator within the number of one or more suggestions.

57. The device of claim 39, the one or more programs further including instructions for:

after replacing display of the first text with display of the selected suggestion;

ceasing to display the at least one of the one or more suggestions; and

after ceasing to display the at least one of the one or more suggestions, receiving additional user input via the rotatable input mechanism;

in response to receiving the additional user input;

displaying an at least additional one of the one or more suggestions; and

displaying the selection indicator.