Character recognition on a computing device

• US 10,025,499 B2
• Filed: 12/06/2017
• Issued: 07/17/2018
• Est. Priority Date: 06/24/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Howard, Joe, Dixon, Ryan S., McGlinn, Joshua, Lochhead, Jonathan, Keighran, Benjamin W., Bachman, William M., Chen, Elbert D., Robbin, Jeffrey L., Folse, Jennifer L. C., Kress, Lynne
• Primary Examiner(s): Lee, Jr., Kenneth B
• Application Number:
  US15/833,618
• Publication Number:
  US 20180107376A1
• Time in Patent Office: 223 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

In some embodiments, a device performs character recognition based on spatial and temporal components of touch input detected on a touch-sensitive surface. In some embodiments, a device provides feedback about handwritten input and its recognition by the device. In some embodiments, a device presents a user interface for changing previously-inputted characters.

Claims

1. An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

generating a user interface for display on a display device, wherein the user interface includes a gesture display region;

while the user interface is displayed on the display device, receiving an indication of a first input that includes movement of a first contact detected on a touch-sensitive surface of a device; and

after receiving the indication of the first input;

displaying a visual representation of the movement of the first contact in the gesture display region;

determining a first candidate character that corresponds to the movement of the first contact; and

concurrently displaying the first candidate character with the visual representation of the movement of the first contact that fades over time while display of the first candidate character is maintained on the display.

2. The electronic device of claim 1, wherein the first candidate character is displayed in a text entry region of the touch-sensitive surface of the device, the text entry region different from the gesture display region.

3. The electronic device of claim 1, wherein the one or more programs further include instructions for:

after the visual representation of the movement of the first contact fades away and while the user interface is displayed on the display device, receiving an indication of a second input that includes movement of a second contact detected on the touch-sensitive surface of the device; and

after receiving the indication of the second input;

displaying a representation of the movement of the second contact in the gesture display region, the movement of the second contact overlapping with a location on the touch-sensitive surface of the device at which the movement of the first contact was detected;

determining a second candidate character that corresponds to the movement of the second contact; and

concurrently displaying the second candidate character next to the first candidate character with a visual representation of the movement of the second contact that fades away over time while display of the second candidate character is maintained on the display.

4. The electronic device of claim 1, wherein entering the first candidate character is in response to at least detecting liftoff of the first contact of the first input.

5. The electronic device of claim 4, wherein entering the first candidate character is in response to a threshold amount of time passing after liftoff of the first contact of the first input.

6. The electronic device of claim 1, wherein displaying the first candidate character in the gesture display region comprises displaying the first candidate character until a second candidate character is determined to be a most likely candidate character, and the one or more programs further include instructions for:

detecting further input following the first input;

determining that the second candidate character is the most likely candidate character;

ceasing display of the first candidate character; and

concurrently displaying the second candidate character with the visual representation of the movement of the first contact in the gesture display region.

7. The electronic device of claim 1, wherein the visual representation of the movement of the first contact is displayed in a region of a first text entry field that is visually distinguished from other regions of the first text entry field.

8. The electronic device of claim 1, wherein the gesture display region is displayed at a first location in the user interface at which the first candidate character is to be entered, and the one or more programs further include instructions for:

in response to a determination that the first candidate character is a final character, entering the first candidate character in the user interface.

9. A method comprising:

at an electronic device with one or more processors and memory;

generating a user interface for display on a display device, wherein the user interface includes a gesture display region;

while the user interface is displayed on the display device, receiving an indication of a first input that includes movement of a first contact detected on a touch-sensitive surface of a device; and

after receiving the indication of the first input;

displaying a representation of the movement of the first contact in the gesture display region;

determining a first candidate character that corresponds to the movement of the first contact; and

concurrently displaying the first candidate character with a visual representation of the movement of the first contact that fades over time while display of the first candidate character is maintained on the display.

10. The method of claim 9, wherein the first candidate character is displayed in a text entry region of the touch-sensitive surface of the device, the text entry region different from the gesture display region.

11. The method of claim 9, further comprising:

after the visual representation of the movement of the first contact fades away and while the user interface is displayed on the display device, receiving an indication of a second input that includes movement of a second contact detected on the touch-sensitive surface of the device; and

after receiving the indication of the second input;

displaying a representation of the movement of the second contact in the gesture display region, the movement of the second contact overlapping with a location on the touch-sensitive surface of the device at which the movement of the first contact was detected;

determining a second candidate character that corresponds to the movement of the second contact; and

concurrently displaying the second candidate character next to the first candidate character with a visual representation of the movement of the second contact that fades away over time while display of the second candidate character is maintained on the display.

12. The method of claim 9, wherein entering the first candidate character is in response to at least detecting liftoff of the first contact of the first input.

13. The method of claim 12, wherein entering the first candidate character is in response to a threshold amount of time passing after liftoff of the first contact of the first input.

14. The method of claim 9, wherein displaying the first candidate character in the gesture display region comprises displaying the first candidate character until a second candidate character is determined to be a most likely candidate character, and the method further comprises:

detecting further input following the first input;

determining that the second candidate character is the most likely candidate character;

ceasing display of the first candidate character; and

concurrently displaying the second candidate character with the visual representation of the movement of the first contact in the gesture display region.

15. The method of claim 9, wherein the visual representation of the movement of the first contact is displayed in a region of a first text entry field that is visually distinguished from other regions of the first text entry field.

16. The method of claim 9, wherein the gesture display region is displayed at a first location in the user interface at which the first candidate character is to be entered, and the one or more programs further include instructions for:

in response to a determination that the first candidate character is a final character, entering the first candidate character in the user interface.

17. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with one or more processors and memory, cause the device to:

generate a user interface for display on a display device, wherein the user interface includes a gesture display region;

while the user interface is displayed on the display device, receive an indication of a first input that includes movement of a first contact detected on a touch-sensitive surface of a device; and

after receiving the indication of the first input;

display a representation of the movement of the first contact in the gesture display region;

determine a first candidate character that corresponds to the movement of the first contact; and

concurrently display the first candidate character with a visual representation of the movement of the first contact that fades over time while display of the first candidate character is maintained on the display.

18. The non-transitory computer readable storage medium of claim 17, wherein the first candidate character is displayed in a text entry region of the touch-sensitive surface of the device, the text entry region different from the gesture display region.

19. The non-transitory computer readable storage medium of claim 17, wherein the one or more programs further cause the device to:

after the visual representation of the movement of the first contact fades away and while the user interface is displayed on the display device, receive an indication of a second input that includes movement of a second contact detected on the touch-sensitive surface of the device; and

after receiving the indication of the second input;

display a representation of the movement of the second contact in the gesture display region, the movement of the second contact overlapping with a location on the touch-sensitive surface of the device at which the movement of the first contact was detected;

determine a second candidate character that corresponds to the movement of the second contact; and

concurrently display the second candidate character next to the first candidate character with a visual representation of the movement of the second contact that fades away over time while display of the second candidate character is maintained on the display.

20. The non-transitory computer readable storage medium of claim 17, wherein entering the first candidate character is in response to at least detecting liftoff of the first contact of the first input.

21. The non-transitory computer readable storage medium of claim 20, wherein entering the first candidate character is in response to a threshold amount of time passing after liftoff of the first contact of the first input.

22. The non-transitory computer readable storage medium of claim 17, wherein displaying the first candidate character in the gesture display region comprises displaying the first candidate character until a second candidate character is determined to be a most likely candidate character, and the instructions further cause the device to:

detect further input following the first input;

determine that the second candidate character is the most likely candidate character;

cease display of the first candidate character; and

concurrently display the second candidate character with the visual representation of the movement of the first contact in the gesture display region.

23. The non-transitory computer readable storage medium of claim 17, wherein the visual representation of the movement of the contact is displayed in a region of a first text entry field that is visually distinguished from other regions of the first text entry field.

24. The non-transitory computer readable storage medium of claim 17, wherein the gesture display region is displayed at a first location in the user interface at which the first candidate character is to be entered, and the one or more programs further include instructions for:

in response to a determination that the first candidate character is a final character, entering the first candidate character in the user interface.