Multi-modal entry of ideogrammatic languages

• US 7,174,288 B2
• Filed: 05/08/2002
• Issued: 02/06/2007
• Est. Priority Date: 05/08/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hon, Hsiao-Wuen, Ju, Yun-cheng
• Primary Examiner(s): Dorvil; Richemond
• Assistant Examiner(s): SAINT CYR, LEONARD
• Application Number:
  US10/142,572
• Publication Number:
  US 20030212563A1
• Time in Patent Office: 1,735 Days
• Field of Search: 704/8, 704/2, 704/10, 704/246, 704/251
• US Class Current: 704/2
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06F 3/018 Input/output arrangements for oriental characters
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

A method for inputting ideograms into a computer system includes receiving phonetic information related to a desired ideogram to be entered and forming a candidate list of possible ideograms as a function of the phonetic information received. Stroke information, comprising one or more strokes in the desired ideogram, is received in order to obtain the desired ideogram from the candidate list.

Claims

1. A computer-implemented method for inputting ideograms into a computer system, the method comprising:

receiving phonetic information from input speech related to a desired ideogram to be entered;

forming a candidate list of possible ideograms as a function of the phonetic information received;

receiving stroke information related to the desired ideogram, wherein the stroke information comprises at least one stroke present in the desired ideogram, wherein receiving stroke information comprises receiving stroke information from handwritten input;

using the stroke information to obtain the desired ideogram from the candidate list, wherein using the stroke information comprises removing from the candidate list ideograms not having a stroke corresponding to the stroke information;

rendering the ideograms of the candidate list to the user;

receiving input related to a selected ideogram from the candidate list as a function of the rendered ideograms, wherein the sequence of steps of receiving stroke information related to the desired ideogram, removing from the candidate list ideograms not having a stroke corresponding to the stroke information, and rendering the ideograms of the candidate list to the user are repeated until the input related to the selected ideogram is received; and

further comprising if the number of candidates in the candidate list is reduced to zero by repeated execution of the sequence of steps, adding at least one new ideogram candidate to the candidate list, wherein said at least one new ideogram candidate is obtained as a function of the stroke information.

2. The computer-implemented method of claim 1, wherein adding at least one new ideogram candidate to the candidate list comprises adding at least one new ideogram candidate to the candidate list only as a function of the stroke information.

3. A computer-implemented method for inputting ideograms into a computer system, the method comprising:

receiving phonetic information from input speech related to a desired ideogram to be entered;

forming a candidate list of possible ideograms as a function of the phonetic information received;

receiving stroke information related to the desired ideogram, wherein the stroke information comprises at least one stroke present in the desired ideogram, wherein receiving stroke information comprises receiving stroke information from handwritten input;

using the stroke information to obtain the desired ideogram from the candidate list, wherein using the stroke information comprises removing from the candidate list ideograms not having a stroke corresponding to the stroke information;

rendering the ideograms of the candidate list to the user;

receiving input related to a selected ideogram from the candidate list as a function of the rendered ideograms, wherein the sequence of steps of receiving stroke information related to the desired ideogram, removing from the candidate list ideograms not having a stroke corresponding to the stroke information, and rendering the ideograms of the candidate list to the user are repeated until the input related to the selected ideogram is received; and

further comprising if the number of candidates in the candidate list is reduced to zero by repeated execution of the sequence of steps, adding a plurality of new ideogram candidates to the candidate list, wherein each of the new ideogram candidates is obtained as a function of the stroke information.

4. The computer-implemented method of claim 3 wherein adding a plurality of ideogram candidates to the candidate list comprises adding each of the ideogram candidates to the candidate list only as a function of the stroke information.

5. The computer-implemented method of claim 3, wherein receiving phonetic information comprises recognizing audible speech of the user.

6. The computer-implemented method of claim 5 wherein receiving stroke information comprises recognizing individual strokes handwritten by the user.

7. A computer readable media having instructions, which when executed by a computer, cause the computer to perform steps comprising:

forming a candidate list of candidates related to ideograms as a function of phonetic information received from input speech;

reducing the number of candidates in the candidate list as a function of stroke information until a candidate is selected; and

if the number of candidates in the candidate list is reduced to zero, adding a plurality of new candidates to the candidate list, each candidate of the plurality of new candidates being selected as a function of the stroke information.

8. The computer readable media of claim 7, wherein reducing the number of candidates comprises receiving signals indicative of keys actuated on a keyboard, the keys being indicative of stokes used in ideograms.

9. The computer readable media of claim 7 and further comprising instructions, which when executed by a computer, cause the computer to perform a step comprising:

rendering candidates of the candidate list to the user.

10. The computer readable media of claim 9, wherein reducing the number of candidates in the candidate list comprises:

receiving handwritten stroke information; and

removing from the candidate list candidates of ideograms not having a stroke corresponding to the stroke information.

11. A computer readable media having instructions, which when executed by a computer, comprise:

a speech recognition module for receiving input speech and providing phonetic information related to a desired ideogram to be entered, the phonetic information being used to form a candidate list of a plurality of candidates, each candidate being a possible ideogram corresponding to the phonetic information;

a processing module receiving stroke information indicative of strokes contained in the desired ideogram, the processing module using the stroke information to reduce the number of candidates in the candidate list, wherein the processing module removes from the candidate list candidates corresponding to ideograms not having a stroke corresponding to the stroke information; and

a rendering module to render ideograms corresponding to the candidates in the candidate list and receiving an input corresponding to a selected candidate from the candidate list; and

instructions for receiving stroke information, wherein the processing module repeatedly removes from the candidate list candidates corresponding to ideograms not having individual strokes corresponding to the stroke information as the individual strokes are received, wherein the processing module adds a plurality of new candidates to the candidate list if the candidate list is reduced to zero, each candidate of the plurality of new candidates being selected as a function of the stroke information.

12. The computer readable media of claim 11, and further comprising instructions, which when executed by the computer, comprise a handwriting recognition module for recognizing strokes made by hand by the user.

13. The computer readable media of claim 11, and further comprising instructions, which when executed by the computer, comprise receiving data indicative of actuation of keys corresponding to strokes in ideograms.