Character recognition on a computing device

• US 9,864,509 B2
• Filed: 06/22/2015
• Issued: 01/09/2018
• Est. Priority Date: 06/24/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Howard, Joe, Dixon, Ryan S., McGlinn, Joshua, Lochhead, Jonathan, Keighran, Benjamin W., Bachman, William M., Chen, Elbert D., Robbin, Jeffrey L., Folse, Jennifer L. C., Kress, Lynne
• Primary Examiner(s): Lee, Jr., Kenneth B
• Application Number:
  US14/746,662
• Publication Number:
  US 20150370475A1
• Time in Patent Office: 932 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

In some embodiments, a device performs character recognition based on spatial and temporal components of touch input detected on a touch-sensitive surface. In some embodiments, a device provides feedback about handwritten input and its recognition by the device. In some embodiments, a device presents a user interface for changing previously-inputted characters.

Claims

1. An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

generating a user interface for display on a display device, wherein the user interface includes a candidate character region;

while the user interface is displayed on the display device, receiving an indication of a first input that includes movement of a contact detected on a touch-sensitive surface of a device;

in response to detecting the movement of the contact, identifying a first candidate character that corresponds to the movement, and updating the user interface to include the first candidate character in the candidate character region;

receiving a request to delete the first candidate character; and

in response to receiving the request to delete the first candidate character and prior to receiving an input to replace the first candidate character with a different candidate character from a first plurality of other candidate characters, updating the user interface by;

deleting the first candidate character in the candidate character region; and

displaying a first plurality of other candidate characters that correspond to the movement of the contact in place of the first candidate character.

2. The electronic device of claim 1, wherein:

a first region of the touch-sensitive surface of the device is associated with a first candidate character of the first plurality of other candidate characters,

a second region of the touch-sensitive surface of the device, different than the first region, is associated with a second candidate character of the first plurality of other candidate characters,

receiving the input to replace the first candidate character with a different candidate character from the first plurality of other candidate characters comprises receiving an indication of a second input detected on the touch-sensitive surface of the device; and

the one or more programs further include instructions for;

in response to receiving the indication of the second input;

in accordance with a determination that the second input was detected on the first region of the touch-sensitive surface of the device, inputting the first candidate character into the candidate character region; and

in accordance with a determination that the second input was detected on the second region of the touch-sensitive surface of the device, inputting the second candidate character into the candidate character region.

3. The electronic device of claim 1, wherein the request to delete the first candidate character comprises a first swipe detected on the touch-sensitive surface of the device, and the one or more programs further include instructions for:

receiving an indication of a second swipe detected on the touch-sensitive surface of the device; and

in response to the second swipe, ceasing display of the first plurality of other candidate characters in the user interface.

4. The electronic device of claim 3, wherein the one or more programs further include instructions for:

after ceasing display of the first plurality of other candidate characters in the user interface, receiving an indication of a third swipe detected on the touch-sensitive surface of the device; and

in response to the third swipe, updating the user interface by;

deleting a second candidate character in the candidate character region; and

displaying a second plurality of other candidate characters associated with the second candidate character in place of the second candidate character.

5. The electronic device of claim 1, wherein:

the request to delete the first candidate character comprises a first swipe detected on the touch-sensitive surface of the device, and

receiving the input to replace the first candidate character with a different candidate character from the first plurality of other candidate characters comprises receiving an indication of a second input that corresponds to selection of a respective one of the first plurality of other candidate characters; and

the one or more programs further include instructions for;

in response to the second input, updating the user interface to include the respective one of the first plurality of other candidate characters in the candidate character region.

6. The electronic device of claim 5, wherein the one or more programs further include instructions for:

after updating the user interface to include the respective one of the first plurality of other candidate characters in the candidate character region, receiving an indication of a second swipe detected on the touch-sensitive surface of the device, the swipe having a direction opposite the first swipe; and

in response to the second swipe, inputting a space next to the respective one of the first plurality of other candidate characters in the candidate character region.

7. The electronic device of claim 5, wherein the one or more programs further include instructions for:

while displaying the respective one of the first plurality of other candidate characters in the candidate character region, receiving an indication of a second swipe detected on the touch-sensitive surface of the device;

in accordance with a determination that the second swipe comprises a swipe having a same direction as the first swipe, updating the user interface by deleting the respective one of the first plurality of other candidate characters in the candidate character region; and

in accordance with a determination that the second swipe comprises a swipe and hold, the swipe having a same direction as the first swipe, updating the user interface by deleting the respective one of the first plurality of other candidate characters in the candidate character region and other candidate characters in the candidate character region until a release of the hold is detected.

8. The electronic device of claim 1, wherein the candidate character region in the user interface comprises a text entry field.

9. The electronic device of claim 8, wherein displaying the first plurality of other candidate characters comprises:

in accordance with a determination that a type of the text entry field comprises a first type, displaying a first set of candidate characters as the first plurality of other candidate characters, and

in accordance with a determination that the type of the text entry field comprises a second type, different from the first type, displaying a second set of candidate characters, different from the first set of candidate characters, as the first plurality of other candidate characters.

20. The electronic device of claim 1, wherein displaying the first plurality of other candidate characters that correspond to the movement of the contact in place of the first candidate character comprises displaying the first plurality of other candidate characters in the user interface without displaying the first candidate character in the user interface.

10. A method comprising:

at an electronic device with one or more processors and memory;

generating a user interface for display on a display device, wherein the user interface includes a candidate character region;

while the user interface is displayed on the display device, receiving an indication of a first input that includes movement of a contact detected on a touch-sensitive surface of a device;

in response to detecting the movement of the contact, identifying a first candidate character that corresponds to the movement, and updating the user interface to include the first candidate character in the candidate character region;

receiving a request to delete the first candidate character; and

in response to receiving the request to delete the first candidate character and prior to receiving an input to replace the first candidate character with a different candidate character from a first plurality of other candidate characters, updating the user interface by;

deleting the first candidate character in the candidate character region; and

displaying a first plurality of other candidate characters that correspond to the movement of the contact in place of the first candidate character.

11. The method of claim 10, wherein:

a first region of the touch-sensitive surface of the device is associated with a first candidate character of the first plurality of other candidate characters,

a second region of the touch-sensitive surface of the device, different than the first region, is associated with a second candidate character of the first plurality of other candidate characters, and

receiving the input to replace the first candidate character with a different candidate character from the first plurality of other candidate characters comprises receiving an indication of a second input detected on the touch-sensitive surface of the device, the method further comprising;

in response to receiving the indication of the second input;

in accordance with a determination that the second input was detected on the first region of the touch-sensitive surface of the device, inputting the first candidate character into the candidate character region; and

in accordance with a determination that the second input was detected on the second region of the touch-sensitive surface of the device, inputting the second candidate character into the candidate character region.

12. The method of claim 10, wherein the request to delete the first candidate character comprises a first swipe detected on the touch-sensitive surface of the device, the method further comprising:

receiving an indication of a second swipe detected on the touch-sensitive surface of the device; and

in response to the second swipe, ceasing display of the first plurality of other candidate characters in the user interface.

13. The method of claim 10, wherein the request to delete the first candidate character comprises a first swipe detected on the touch-sensitive surface of the device, and

receiving the input to replace the first candidate character with a different candidate character from the first plurality of other candidate characters comprises receiving an indication of a second input that corresponds to selection of a respective one of the first plurality of other candidate characters, the method further comprising:

in response to the second input, updating the user interface to include the respective one of the first plurality of other candidate characters in the candidate character region.

14. The method of claim 10, wherein the candidate character region in the user interface comprises a text entry field.

21. The method of claim 10, wherein displaying the first plurality of other candidate characters that correspond to the movement of the contact in place of the first candidate character comprises displaying the first plurality of other candidate characters in the user interface without displaying the first candidate character in the user interface.

23. The method of claim 12, further comprising:

after ceasing display of the first plurality of other candidate characters in the user interface, receiving an indication of a third swipe detected on the touch-sensitive surface of the device; and

in response to the third swipe, updating the user interface by;

deleting a second candidate character in the candidate character region; and

displaying a second plurality of other candidate characters associated with the second candidate character in place of the second candidate character.

24. The method of claim 13, further comprising:

after updating the user interface to include the respective one of the first plurality of other candidate characters in the candidate character region, receiving an indication of a second swipe detected on the touch-sensitive surface of the device, the swipe having a direction opposite the first swipe; and

in response to the second swipe, inputting a space next to the respective one of the first plurality of other candidate characters in the candidate character region.

25. The method of claim 13, further comprising:

while displaying the respective one of the first plurality of other candidate characters in the candidate character region, receiving an indication of a second swipe detected on the touch-sensitive surface of the device;

in accordance with a determination that the second swipe comprises a swipe having a same direction as the first swipe, updating the user interface by deleting the respective one of the first plurality of other candidate characters in the candidate character region; and

in accordance with a determination that the second swipe comprises a swipe and hold, the swipe having a same direction as the first swipe, updating the user interface by deleting the respective one of the first plurality of other candidate characters in the candidate character region and other candidate characters in the candidate character region until a release of the hold is detected.

26. The method of claim 14, wherein displaying the first plurality of other candidate characters comprises:

in accordance with a determination that a type of the text entry field comprises a first type, displaying a first set of candidate characters as the first plurality of other candidate characters, and

in accordance with a determination that the type of the text entry field comprises a second type, different from the first type, displaying a second set of candidate characters, different from the first set of candidate characters, as the first plurality of other candidate characters.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with one or more processors and memory, cause the device to:

generate a user interface for display on a display device, wherein the user interface includes a candidate character region;

while the user interface is displayed on the display device, receive an indication of a first input that includes movement of a contact detected on a touch-sensitive surface of a device;

in response to detecting the movement of the contact, identify a first candidate character that corresponds to the movement, and update the user interface to include the first candidate character in the candidate character region;

receive a request to delete the first candidate character; and

in response to receiving the request to delete the first candidate character and prior to receiving an input to replace the first candidate character with a different candidate character from a first plurality of other candidate characters, update the user interface by;

deleting the first candidate character in the candidate character region; and

displaying a first plurality of other candidate characters that correspond to the movement of the contact in place of the first candidate character.

16. The non-transitory computer readable storage medium of claim 15, wherein:

a first region of the touch-sensitive surface of the device is associated with a first candidate character of the first plurality of other candidate characters,

a second region of the touch-sensitive surface of the device, different than the first region, is associated with a second candidate character of the first plurality of other candidate characters,

receiving the input to replace the first candidate character with a different candidate character from the first plurality of other candidate characters comprises receiving an indication of a second input detected on the touch-sensitive surface of the device; and

the one or more programs further comprise instructions that cause the device to;

in response to receiving the indication of the second input;

in accordance with a determination that the second input was detected on the first region of the touch-sensitive surface of the device, input the first candidate character into the candidate character region; and

in accordance with a determination that the second input was detected on the second region of the touch-sensitive surface of the device, input the second candidate character into the candidate character region.

17. The non-transitory computer readable storage medium of claim 15, wherein the request to delete the first candidate character comprises a first swipe detected on the touch-sensitive surface of the device, and the one or more programs further comprise instructions that cause the device to:

receive an indication of a second swipe detected on the touch-sensitive surface of the device; and

in response to the second swipe, cease display of the first plurality of other candidate characters in the user interface.

18. The non-transitory computer readable storage medium of claim 15, wherein the request to delete the first candidate character comprises a first swipe detected on the touch-sensitive surface of the device, and

receiving the input to replace the first candidate character with a different candidate character from the first plurality of other candidate characters comprises receiving an indication of a second input that corresponds to selection of a respective one of the first plurality of other candidate characters;

and

the one or more programs further comprise instructions that cause the device to;

in response to the second input, update the user interface to include the respective one of the first plurality of other candidate characters in the candidate character region.

19. The non-transitory computer readable storage medium of claim 15, wherein the candidate character region in the user interface comprises a text entry field.

22. The non-transitory computer readable storage medium of claim 15, wherein displaying the first plurality of other candidate characters that correspond to the movement of the contact in place of the first candidate character comprises displaying the first plurality of other candidate characters in the user interface without displaying the first candidate character in the user interface.

27. The non-transitory computer readable storage medium of claim 17, wherein the one or more programs further comprise instructions that cause the device to:

after ceasing display of the first plurality of other candidate characters in the user interface, receive an indication of a third swipe detected on the touch-sensitive surface of the device; and

in response to the third swipe, update the user interface by;

deleting a second candidate character in the candidate character region; and

displaying a second plurality of other candidate characters associated with the second candidate character in place of the second candidate character.

28. The non-transitory computer readable storage medium of claim 18, wherein the one or more programs further comprise instructions that cause the device to:

after updating the user interface to include the respective one of the first plurality of other candidate characters in the candidate character region, receive an indication of a second swipe detected on the touch-sensitive surface of the device, the swipe having a direction opposite the first swipe; and

in response to the second swipe, input a space next to the respective one of the first plurality of other candidate characters in the candidate character region.

29. The non-transitory computer readable storage medium of claim 18, wherein the one or more programs further comprise instructions that cause the device to:

while displaying the respective one of the first plurality of other candidate characters in the candidate character region, receive an indication of a second swipe detected on the touch-sensitive surface of the device;

in accordance with a determination that the second swipe comprises a swipe having a same direction as the first swipe, update the user interface by deleting the respective one of the first plurality of other candidate characters in the candidate character region; and

in accordance with a determination that the second swipe comprises a swipe and hold, the swipe having a same direction as the first swipe, update the user interface by deleting the respective one of the first plurality of other candidate characters in the candidate character region and other candidate characters in the candidate character region until a release of the hold is detected.

30. The non-transitory computer readable storage medium of claim 19, wherein displaying the first plurality of other candidate characters comprises:

in accordance with a determination that a type of the text entry field comprises a first type, displaying a first set of candidate characters as the first plurality of other candidate characters, and

in accordance with a determination that the type of the text entry field comprises a second type, different from the first type, displaying a second set of candidate characters, different from the first set of candidate characters, as the first plurality of other candidate characters.