Handwriting recognition with natural user input on multitouch surfaces

• US 9,665,769 B2
• Filed: 08/18/2015
• Issued: 05/30/2017
• Est. Priority Date: 08/18/2015
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bosnic, Jr., Cameron J., Harden, Derek M.
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US14/828,862
• Publication Number:
  US 20170053161A1
• Time in Patent Office: 651 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/36 Matching; Classification
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

The method includes receiving, by one or more computer processors, data indicating a hand is on a touch-sensitive surface. The method further includes identifying, by one or more computer processors, a position of the hand. The method further includes determining, by one or more computer processors, a change in the position of the hand. The method further includes characterizing, by one or more computer processors, the change in position of the hand on the touch-sensitive surface. The method further includes generating, by one or more computer processors, an alphanumeric character based upon the characterized change in the position of the hand.

Claims

1. A method for character identification on a multi-touch surface, the method comprising:

presenting, by one or more computer processors, a list of a plurality of general classifiers, and, in response to a user selecting one or more general classifiers from the list of the plurality of general classifiers, storing, by one or more computer processors, the one or more general classifiers in a profile associated with the user;

receiving, by one or more computer processors, data indicating a hand is on a touch-sensitive surface;

identifying, by one or more computer processors, a position of the hand;

determining, by one or more computer processors, a change in the position of the hand;

identifying, by one or more computer processors, the one or more general classifiers from the profile;

prompting, by one or more computer processors, the user to write a test character on the touch-sensitive surface;

selecting, by one or more computer processors, one or more additional general classifiers based, at least in part, on a written test character on the touch-sensitive surface;

identifying, by one or more computer processors, one or more specific classifiers from a plurality of specific classifiers based, at least in part, on a training phase;

modifying, by one or more computer processors, an algorithm based, at least in part, on the identified one or more general classifiers and the identified one or more specific classifiers;

the modified algorithm analyzing, by one or more computer processors, the change in the position of the hand;

the modified algorithm generating, by one or more computer processors, a list of characters that correspond to the analyzed change in the position of the hand, based, at least in part, on the one or more general classifiers; and

to refine a characterization of the change in the position of the hand, selecting, by one or more computer processors, a character from the generated list of characters, based, at least in part, on the analyzed change in the position of the hand and the one or more specific classifiers.

2. The method of claim 1, further comprising:

presenting, by one or more computer processors, a list of a plurality of specific classifiers, and, in response to a user selecting one or more specific classifiers from the list of the plurality of specific classifiers, storing, by one or more computer processors, the one or more specific classifiers in the profile associated with the user; and

identifying, by one or more computer processors, one or more additional specific classifiers based, at least in part, on the profile associated with the user, wherein the one or more additional specific classifiers further refine the characterization of the change in the position of the hand.

3. The method of claim 2, wherein the one or more general classifiers include a plurality of geographic location general classifiers, a plurality of language general classifiers, and a plurality of handedness general classifiers.

4. The method of claim 3, wherein the one or more specific classifiers includes a plurality of writing size specific classifiers, a plurality of writing style specific classifiers, and a plurality of writing font specific classifiers.

5. A computer program product for character identification on a multi-touch surface, the computer program product comprising:

one or more computer readable storage devices and program instructions stored on the one or more computer readable storage devices, the program instructions comprising;

program instructions to present, a list of a plurality of general classifiers, and, in response to a user selecting one or more general classifiers from the list of the plurality of general classifiers, and to execute program instructions to store the one or more general classifiers in a profile associated with the user;

program instructions to receive data indicating a hand is on a touch-sensitive surface;

program instructions to identify a position of the hand;

program instructions to determine a change in the position of the hand;

program instructions to identify the one or more general classifiers from the profile;

program instructions to prompt the user to write a test character on the touch-sensitive surface;

program instructions to select one or more additional general classifiers based, at least in part, on a written test character on the touch-sensitive surface;

program instructions to identify one or more specific classifiers from a plurality of specific classifiers based, at least in part, on a training phase;

program instructions to modify an algorithm based, at least in part, on the identified one or more general classifiers and the identified one or more specific classifiers;

program instructions to analyze, by the modified algorithm, the change in the position of the hand;

program instructions to generate, by the modified algorithm, a list of characters that correspond to the analyzed change in the position of the hand, based, at least in part, on the one or more general classifiers; and

to refine a characterization of the change in the position of the hand, program instructions to select a character from the generated list of characters, based, at least in part, on the analyzed change in the position of the hand and the one or more specific classifiers.

6. The computer program product of claim 5, further comprising:

program instructions to present a list of a plurality of specific classifiers, and, in response to a user selecting one or more specific classifiers from the list of the plurality of specific classifiers, execute program instructions to store, by one or more computer processors, the one or more specific classifiers in the profile associated with the user; and

program instructions to identify one or more additional specific classifiers based, at least in part, on the profile associated with the user, wherein the one or more additional specific classifiers further refine the characterization of the change in the position of the hand.

7. The computer program product of claim 6, wherein the one or more general classifiers include a plurality of geographic location general classifiers, a plurality of language general classifiers, and a plurality of handedness general classifiers.

8. The computer program product of claim 7, wherein the one or more specific classifiers includes a plurality of writing size specific classifiers, a plurality of writing style specific classifiers, and a plurality of writing font specific classifiers.

9. A computer system for character identification on a multi-touch surface, the computer system comprising:

one or more computer processors; and

one or more computer readable storage devices;

program instructions stored on the computer readable storage devices for execution by at least one of the one or more computer processors, the program instructions comprising;

program instructions to present, a list of a plurality of general classifiers, and, in response to a user selecting one or more general classifiers from the list of the plurality of general classifiers, and to execute program instructions to store the one or more general classifiers in a profile associated with the user;

program instructions to receive data indicating a hand is on a touch-sensitive surface;

program instructions to identify a position of the hand;

program instructions to determine a change in the position of the hand;

program instructions to identify the one or more general classifiers from the profile;

program instructions to prompt the user to write a test character on the touch-sensitive surface;

program instructions to select one or more additional general classifiers based, at least in part, on a written test character on the touch-sensitive surface;

program instructions to identify one or more specific classifiers from a plurality of specific classifiers based, at least in part, on a training phase;

program instructions to modify an algorithm based, at least in part, on the identified one or more general classifiers and the identified one or more specific classifiers;

program instructions to analyze, by the modified algorithm, the change in the position of the hand;

program instructions to generate, by the modified algorithm, a list of characters that correspond to the analyzed change in the position of the hand, based, at least in part, on the one or more general classifiers; and

to refine a characterization of the change in the position of the hand, program instructions to select a character from the generated list of characters, based, at least in part, on the analyzed change in the position of the hand and the one or more specific classifiers.

10. The computer system of claim 9, further comprising:

program instructions to present a list of a plurality of specific classifiers, and, in response to a user selecting one or more specific classifiers from the list of the plurality of specific classifiers, execute program instructions to store, by one or more computer processors, the one or more specific classifiers in the profile associated with the user; and

program instructions to identify one or more additional specific classifiers based, at least in part, on the profile associated with the user, wherein the one or more additional specific classifiers further refine the characterization of the change in the position of the hand.

11. The computer system of claim 10, wherein the one or more general classifiers include a plurality of geographic location general classifiers, a plurality of language general classifiers, and a plurality of handedness general classifiers.

12. The computer system of claim 11, wherein the one or more specific classifiers includes a plurality of writing size specific classifiers, a plurality of writing style specific classifiers, and a plurality of writing font specific classifiers.