MULTIMODAL INPUT USING SCRATCHPAD GRAPHICAL USER INTERFACE TO EDIT SPEECH TEXT INPUT WITH KEYBOARD INPUT
First Claim
1. A multimodal input system for use with an application program executed on a computing device, the system comprising:
- a dictation module configured to receive a recognized speech text input for insertion into a document that has keyboard focus, the recognized speech text input including text recognized from speech audio input by a speech recognition module; and
a scratchpad graphical user interface configured to display the recognized speech text input, to receive keyboard input to effect edits in the recognized speech text input without changing a keyboard focus from the document in the application program, and to generate an edited speech input for insertion into the document.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method for multimodal input into an application program. The method may include performing speech recognition on speech audio input to thereby produce recognized speech text input for insertion into a document of an application program, the document having keyboard focus. The method may also include identifying the document as being text service framework unaware. The method may further include displaying the recognized speech text input in a scratchpad graphical user interface for editing the recognized speech text input. The method may further include reflecting keyboard input bound for the document to the scratchpad graphical user interface, while preserving the keyboard focus of the document. The method may also include displaying the reflected keyboard input on the scratchpad graphical user interface, to thereby effect edits in the recognized speech text input.
-
Citations
20 Claims
-
1. A multimodal input system for use with an application program executed on a computing device, the system comprising:
-
a dictation module configured to receive a recognized speech text input for insertion into a document that has keyboard focus, the recognized speech text input including text recognized from speech audio input by a speech recognition module; and a scratchpad graphical user interface configured to display the recognized speech text input, to receive keyboard input to effect edits in the recognized speech text input without changing a keyboard focus from the document in the application program, and to generate an edited speech input for insertion into the document. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for multimodal input into an application program, comprising:
-
performing speech recognition on speech audio input to thereby produce recognized speech text input for insertion into a document of an application program, the document having keyboard focus; identifying the document as being text service framework unaware; displaying the recognized speech text input in a scratchpad graphical user interface for editing the recognized speech text input; and reflecting keyboard input bound for the document to the scratchpad graphical user interface, while preserving the keyboard focus of the document; and displaying the reflected keyboard input on the scratchpad graphical user interface, to thereby effect edits in the recognized speech text input. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
-
20. A method for multimodal input into an application program, comprising:
-
receiving recognized speech text input for insertion into a document of an application program, the document being text service framework unaware and having keyboard focus; displaying the recognized speech text input in a scratchpad graphical user interface for editing the recognized speech text input; and reflecting keyboard input bound for the document to the scratchpad graphical user interface, while preserving the keyboard focus of the document.
-
Specification