Method for inserting characters in a character string and the corresponding digital service

• US 10,248,635 B2
• Filed: 07/22/2016
• Issued: 04/02/2019
• Est. Priority Date: 02/29/2016
• Status: Active Grant

• Current Assignee: Myscript
• Original Assignee: Myscript
• Inventors: Couelier, Joel
• Primary Examiner(s): Nguyen, Maikhanh
• Application Number:
  US15/217,697
• Publication Number:
  US 20170249293A1
• Time in Patent Office: 984 Days
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction
• CPC Class Codes: G06V 30/387 using human interaction, e.g. selection of the best displayed recognition candidate

Abstract

The disclosure relates to a character input method and system, which may include a digital device including an input surface and an output surface. The method and system may include or perform operations including: displaying a character string using a recognition area and an insertion area of the output surface; selecting a position within the character string; displaying, in the recognition area, a part of the string ending with a first character while masking, in the insertion area, a part of the string starting with a second, succeeding character; detecting an input stroke entered manually in the insertion area; performing handwriting recognition; inserting, at the position within the string of characters, a recognised character(s); and scrolling the string in the recognition area so as to display, in the recognition area, the recognised character(s) that were inserted into the string of characters.

Claims

1. A character input method performed by a computing device comprising:

a processor; and

a touchscreen display device that is operably connected to the processor, the touchscreen display device comprising an interactive user interface including;

an input surface for inputting characters; and

an output surface for displaying characters, the output surface comprising a recognition area and an insertion area that are adjacent to each other, the method comprising;

firstly displaying, by the processor, a string of characters using the recognition area and the insertion area as a display region for the firstly displaying;

in response to detecting, by the touchscreen display device, an interaction of a user with the input surface, selecting a position within the string of characters between a first character and a second character displayed on the output surface, the second character being consecutive to the first character within the string of characters;

secondly displaying, by the processor, in the recognition area, a first part of the string of characters ending with the first character, while masking, in the insertion area, a second part of the string of characters starting with the second character;

detecting, by the touchscreen display device, at least one input stroke entered manually in the insertion area;

converting, by the processor and using handwriting recognition, the at least one input stroke into at least one recognised character;

inserting, at the selected position within the string of characters, the at least one recognised character; and

firstly scrolling, by the processor, the string of characters in the recognition area by moving the string of characters in a first direction to display, in the recognition area, at least part of the at least one recognised character that was inserted into the string of characters.

2. The method of claim 1, further comprising:

detecting, by the touchscreen display device, as the detected interaction, an interaction performed by a user by contacting the input surface.

3. The method of claim 2, wherein the detecting comprises:

comparing a pattern of the detected interaction with at least one predefined interaction pattern; and

if the pattern of the detected interaction matches one of the at least one predetermined interaction pattern, performing the selecting and the secondly displaying in response to the detected interaction.

4. The method of claim 1, wherein the selected position is determined based on a position of the detected interaction on the input surface relative to the string of characters displayed in the firstly displaying.

5. The method of claim 1, wherein the detected interaction occurs in at least one of:

the recognition area;

the insertion area; and

a content display field that displays, on the output surface, at least a portion of the string of characters that includes the first and second characters.

6. The method of claim 1, wherein the detected interaction is a predetermined gesture performed in contact with the input surface or a predetermined multi-tap interaction on the input surface.

7. The method of claim 6, wherein the detected interaction includes a substantially vertical gesture performed in contact with the input surface so as to intersect the string of characters as displayed in the display region during the firstly displaying.

8. The method of claim 1, wherein secondly displaying comprises:

automatically scrolling, by the processor, in response to the detected interaction, the string of characters so as to move the first character to a side of the recognition area adjacent to the insertion area.

9. The method of claim 1, wherein secondly displaying comprises:

if the first character is in the insertion area upon detection of the detected interaction, automatically scrolling the string of characters so as to move the first character from the insertion area into the recognition area.

10. The method of claim 1, wherein the string of characters comprises a plurality of words of at least one character each, the method comprising:

during the firstly displaying, displaying each word of the plurality of words that is positioned in the recognition area, and displaying each word of the plurality of words that is positioned in the recognition area.

11. The method of claim 1, wherein the firstly scrolling comprises:

scrolling the string of characters in the first direction from the insertion area to the recognition area so as to display, in the recognition area, the at least part of the at least one recognised character that was inserted into the string of characters.

12. The method of claim 1, wherein the firstly scrolling is performed automatically after the detecting of the at least one input stroke.

13. The method of claim 12 wherein the firstly scrolling is triggered automatically upon detection that the handwriting recognition is completed.

14. The method of claim 1, further comprising:

thirdly displaying, by the processor, in the insertion area, the detected at least one input stroke as digital ink while the handwriting recognition is being performed.

15. The method of claim 1, wherein the firstly scrolling comprises:

inserting, at the position within the string of characters, the at least one input stroke that was detected; and

scrolling the string of characters in the recognition area in the first direction so as to display, in the recognition area and while the handwriting recognition is being performed, at least part of the at least one input stroke that was inserted as digital ink.

16. The method of claim 15, wherein the first scrolling comprises:

replacing the inserted at least one input stroke that is being displayed in the recognition area as digital ink with the at least one recognised character when the handwriting recognition is completed.

17. The method of claim 1, wherein the firstly scrolling comprises:

displaying the at least one recognized character as typeset text in the recognition area.

18. The method according to claim 1, further comprising:

after the firstly scrolling, secondly scrolling, by the processor, to cause display of the string of characters to extend from the recognition area to the insertion area by moving the string of characters in a second direction opposite the first direction until entering into the insertion area.

19. A non-transitory computer readable medium having a computer readable program code embodied therein, the computer readable program code being adapted to be executed to implement a character input method in a computing device comprising:

a processor; and

a touchscreen display device that is operably connected to the processor, the touchscreen display device comprising an interactive user interface including;

an input surface for inputting characters; and

an output surface for displaying characters, the output surface comprising a recognition area and an insertion area that are adjacent to each other, the character input method comprising;

firstly displaying, by the processor, a string of characters using the recognition area and the insertion area as a display region for the firstly displaying;

in response to detecting, by the touchscreen display device, an interaction of a user with the input surface, selecting a position within the string of characters between a first character and a second character displayed on the output surface, the second character being consecutive to the first character within the string of characters;

secondly displaying, by the processor, in the recognition area, a first part of the string of characters ending with the first character, while masking, in the insertion area, a second part of the string of characters starting with the second character;

detecting, by the touchscreen display device, at least one input stroke entered manually in the insertion area;

converting, by the processor and using handwriting recognition, the at least one input stroke into at least one recognised character;

inserting, at the selected position within the string of characters, the at least one recognised character; and

firstly scrolling, by the processor, the string of characters in the recognition area by moving the string of characters in a first direction to display, in the recognition area, at least part of the at least one recognised character that was inserted into the string of characters.

20. A system for inputting characters, the system comprising:

a touchscreen display device comprising an interactive user interface including;

an input surface for inputting characters; and

an output surface for displaying characters, the output surface comprising a recognition area and an insertion area for accepting character input, the recognition area and the insertion area being adjacent to each other;

a non-transitory computer readable medium including instructions; and

a processor that is operably connected to the touchscreen display device and the non-transitory computer readable medium and that executes the instructions to perform operations comprising;

firstly displaying, by the processor, a string of characters using the recognition area and the insertion area of the output surface;

selecting, in response to detecting, by the touchscreen display device, an interaction of a user with the input surface, a position within the string of characters between a first character and a second character displayed on the output surface, the second character being consecutive to the first character within the string of characters;

secondly displaying, by the processor, in the recognition area, a first part of the string of characters ending with the first character, while masking, in the insertion area, a second part of the string of characters starting with the second character;

detecting, by the touchscreen display device, at least one input stroke entered manually in the insertion area;

converting, by the processor and using handwriting recognition, the at least one input stroke into at least one recognised character;

inserting, at the selected position within the string of characters, the at least one recognised character; and

firstly scrolling, by the processor, the string of characters in the recognition area by moving the string of characters in a first direction to display, in the recognition area, at least part of the at least one recognised character that was inserted into the string of characters.