Multi-modal input on an electronic device
First Claim
Patent Images
1. A computer-implemented input-method editor process comprising:
- receiving a request from a user of an electronic device for an application-independent input method editor having written and spoken input capabilities, wherein the application-independent input method editor is configured to receive input for a plurality of applications executable by the electronic device;
identifying that the user is about to provide spoken input to the application-independent input method editor;
receiving a spoken input from the user, wherein the spoken input corresponds to an input to an application from the plurality of applications;
generating, with the electronic device, a correlation between the spoken input and the application, from the plurality of applications, to which the spoken input is determined to correspond, wherein generating the correlation comprises (i) determining an application type for the application that identifies a category of application to which the application is assigned, each category of application capable of including a plurality of different applications, and (ii) matching one or more utterances in the spoken input to one or more stored terms that are associated with the application type;
providing the spoken input and the generated correlation to a server, wherein the server is remote to the electronic device and includes a speech recognition system configured to access one or more language models for recognizing text based on the spoken input and the correlation;
receiving text from the server, wherein the text represents a translation of the spoken input;
selecting an application, from the plurality of applications, to receive the text, the selection using the generated correlation; and
providing the text as an input to the selected application.
2 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented input-method editor process includes receiving a request from a user for an application-independent input method editor having written and spoken input capabilities, identifying that the user is about to provide spoken input to the application-independent input method editor, and receiving a spoken input from the user. The spoken input corresponds to input to an application and is converted to text that represents the spoken input. The text is provided as input to the application.
196 Citations
22 Claims
-
1. A computer-implemented input-method editor process comprising:
-
receiving a request from a user of an electronic device for an application-independent input method editor having written and spoken input capabilities, wherein the application-independent input method editor is configured to receive input for a plurality of applications executable by the electronic device; identifying that the user is about to provide spoken input to the application-independent input method editor; receiving a spoken input from the user, wherein the spoken input corresponds to an input to an application from the plurality of applications; generating, with the electronic device, a correlation between the spoken input and the application, from the plurality of applications, to which the spoken input is determined to correspond, wherein generating the correlation comprises (i) determining an application type for the application that identifies a category of application to which the application is assigned, each category of application capable of including a plurality of different applications, and (ii) matching one or more utterances in the spoken input to one or more stored terms that are associated with the application type; providing the spoken input and the generated correlation to a server, wherein the server is remote to the electronic device and includes a speech recognition system configured to access one or more language models for recognizing text based on the spoken input and the correlation; receiving text from the server, wherein the text represents a translation of the spoken input; selecting an application, from the plurality of applications, to receive the text, the selection using the generated correlation; and providing the text as an input to the selected application. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system comprising:
-
a data processing apparatus; and a data store coupled to the data processing apparatus, in which is stored; an application-independent input method editor configured to receive input for a plurality of applications executable by an electronic device, the application-independent input method editor operable to; receive spoken input from a user of the electronic device that is directed to an application of the plurality of applications; generating, with the electronic device, a correlation between the spoken input and the application, from the plurality of applications, to which the spoken input is determined to correspond, wherein generating the correlation comprises (i) determining an application type for the application that identifies a category of application to which the application is assigned, each category of application capable of including a plurality of different applications, and (ii) matching one or more utterances in the spoken input to one or more stored terms that are associated with the application type; provide the spoken input and the generated correlation to a server, wherein the server is remote to the electronic device and includes a speech recognition system configured to access one or more language models for recognizing text based on the spoken input and the correlation; receive text from the server, wherein the text represents a translation of the spoken input; select an application, from the plurality of applications, to receive the text, the selection using the generated correlation; and provide the text as input to the selected application. - View Dependent Claims (14, 15, 16, 17)
-
-
18. A non-transitory computer-readable storage device encoded with a computer program product, the computer program product including instructions that, when executed, cause data processing apparatus to perform operations comprising:
-
receiving spoken input from a user of an electronic device in an application of the plurality of applications; generating, with the electronic device, a correlation between the spoken input and the application, from the plurality of applications, to which the spoken input is determined to correspond, wherein generating the correlation comprises (i) determining an application type for the application that identifies a category of application to which the application is assigned, each category of application capable of including a plurality of different applications, and (ii) matching one or more utterances in the spoken input to one or more stored terms that are associated with the application type; providing the spoken input and the generated correlation to a server, wherein the server is remote to the electronic device and includes a speech recognition system configured to access one or more language models for recognizing text based on the spoken input and the correlation; receiving text from the server, wherein the text represents a translation of the spoken input; selecting an application, from the plurality of applications, to receive the text, the selection using the generated correlation; and providing the text as input to the application. - View Dependent Claims (19, 20, 21, 22)
-
Specification