Multi-modal entry of ideogrammatic languages

• US 20030212563A1
• Filed: 05/08/2002
• Published: 11/13/2003
• Est. Priority Date: 05/08/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ju, Yun-Cheng, Hon, Hsiao-Wuen
• Granted Patent: US 7,174,288 B2
• Time in Patent Office: Days
• US Class Current: 704/277
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06F 3/018 Input/output arrangements for oriental characters
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

A method for inputting ideograms into a computer system includes receiving phonetic information related to a desired ideogram to be entered and forming a candidate list of possible ideograms as a function of the phonetic information received. Stroke information, comprising one or more strokes in the desired ideogram, is received in order to obtain the desired ideogram from the candidate list.

Claims

1. A computer-implemented method for inputting ideograms into a computer system, the method comprising:

receiving phonetic information related to a desired ideogram to be entered;

forming a candidate list of possible ideograms as a function of the phonetic information received;

receiving stroke information related to the desired ideogram, wherein the stroke information comprises at least one stroke present in the desired ideogram; and

using the stroke information to obtain the desired ideogram from the candidate list.

2. The computer-implemented method of claim 1 wherein using the stroke information comprises removing from the candidate list ideograms not having a stroke corresponding to the stroke information.

3. The computer-implemented method of claim 2 and further comprising rendering the ideograms of the candidate list to the user.

4. The computer-implemented method of claim 3 and further comprising receiving input related to a selected ideogram from the candidate list as a function of the rendered ideograms.

5. The computer-implemented method of claim 4 wherein the sequence of steps of receiving stroke information related to the desired ideogram, removing from the candidate list ideograms not having a stroke corresponding to the stroke information, and rendering the ideograms of the candidate list to the user are repeated until the input related to the selected ideogram is received.

6. The computer-implemented method of claim 5 and further comprising if the number of candidates in the candidate list is reduced to zero by repeated execution of the sequence of steps, adding at least one new ideogram candidate to the candidate list, wherein said at least one new ideogram candidate is not obtained as a function of the phonetic information.

7. The computer-implemented method of claim 6 wherein adding at least one new ideogram candidate to the candidate list comprises adding at least one new ideogram candidate to the candidate list as a function of the stroke information.

8. The computer-implemented method of claim 5 and further comprising if the number of candidates in the candidate list is reduced to zero by repeated execution of the sequence of steps, adding a plurality of new ideogram candidates to the candidate list, wherein each of the new ideogram candidates is not obtained as a function of the phonetic information.

9. The computer-implemented method of claim 8 wherein adding a plurality of ideogram candidates to the candidate list comprises adding each of the ideogram candidates to the candidate list as a function of the stroke information.

10. The computer-implemented method of claim 1 wherein receiving phonetic information comprises recognizing audible speech of the user.

11. The computer-implemented method of claim 10 wherein receiving stroke information comprises recognizing individual strokes made by the user.

12. The computer-implemented method of claim 10 wherein receiving stroke information comprises receiving signals indicative of keys actuated on a keyboard, the keys being indicative of stokes used in ideograms.

13. A computer readable media having instructions, which when executed by a computer, cause the computer to perform steps comprising:

forming a candidate list of candidates related to ideograms as a function of phonetic information;

reducing the number of candidates in the candidate list as a function of stroke information until a candidate is selected; and

adding a plurality of new candidates to the candidate list if the candidate list is reduced to zero, each candidate of the plurality of new candidates being selected as a function of the stroke information.

14. The computer readable media of claim 13 and further comprising instructions, which when executed by a computer, cause the computer to perform a step comprising:

rendering candidates of the candidate list to the user.

15. The computer readable media of claim 14 wherein reducing the number of candidates in the candidate list includes removing from the candidate list candidates of ideograms not having a stroke corresponding to the stroke information.

16. A computer readable media having instructions, which when executed by a computer, comprise:

a speech recognition module for receiving input speech and providing phonetic information related to a desired ideogram to be entered, the phonetic information being used to form a candidate list of a plurality of candidates, each candidate being a possible ideogram corresponding to the phonetic information;

a processing module receiving stroke information indicative of strokes contained in the desired ideogram, the processing module using the stroke information to reduce the number of candidates in the candidate list; and

a rendering module to render ideograms corresponding to the candidates in the candidate list and receiving an input corresponding to a selected candidate from the candidate list.

17. The computer readable media of claim 16 wherein the processing module removes from the candidate list candidates corresponding to ideograms not having a stroke corresponding to the stroke information.

18. The computer readable media of claim 17 and further comprising instructions for receiving stroke information, and wherein the processing module repeatedly removes from the candidate list candidates corresponding to ideograms not having individual strokes corresponding to the stroke information as the individual strokes are received.

19. The computer readable media of claim 18 wherein the processing module adds a plurality of new candidates to the candidate list if the candidate list is reduced to zero, each candidate of the plurality of new candidates being selected as a function of the stroke information.

20. The computer readable media of claim 18 and further comprising instructions, which when executed by the computer, comprise a handwriting recognition module for recognizing strokes made by hand by the user.

21. The computer readable media of claim 18 and further comprising instructions, which when executed by the computer, comprise receiving data indicative of actuation of keys corresponding to strokes in ideograms.