SYSTEM AND METHOD OF PROVIDING SPEECH PROCESSING IN USER INTERFACE

• US 20090187410A1
• Filed: 05/28/2008
• Published: 07/23/2009
• Est. Priority Date: 01/22/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Labs Incorporated (AT&T, Inc.)
• Inventors: WILPON, Jay, Di Fabbrizio, Giuseppe, Stern, Benjamin J.
• Granted Patent: US 9,177,551 B2
• Time in Patent Office: Days
• US Class Current: 704/270.100
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications

Abstract

Disclosed are systems, methods and computer-readable media for enabling speech processing in a user interface of a device. The method includes receiving an indication of a field and a user interface of a device, the indication also signaling that speech will follow, receiving the speech from the user at the device, the speech being associated with the field, transmitting the speech as a request to public, common network node that receives and processes speech, processing the transmitted speech and returning text associated with the speech to the device and inserting the text into the field. Upon a second indication from the user, the system processes the text in the field as programmed by the user interface. The present disclosure provides a speech mash up application for a user interface of a mobile or desktop device that does not require expensive speech processing technologies.

Claims

1. A method of enabling speech processing in a user interface of a device, the method comprising:

receiving an indication of a field in a user interface of a device, the indication also signaling that speech will follow;

receiving the speech from a user at the device, the speech being associated with the field;

transmitting the speech as a request to a public, common network node that receives speech, wherein the request comprises at least one standardized parameter to control a speech recognizer on the network node;

receiving text associated with the speech from the network node at the device; and

inserting the text into the field.

2. The method of claim 1, further comprising, upon a second indication from the user, processing the text in the field as programmed by the user interface.

3. The method of claim 1, further comprising receiving an instruction with the text that causes the user interface to process the inserted text without further user input.

4. The method of claim 3, wherein the instruction is only received if the recognition from the speech recognizer is above a threshold.

5. The method of claim 1, further comprising, after receiving the speech, receiving a second indication from the user that the speech intended for the field has ceased.

6. The method of claim 2, wherein processing the text in the field is performed as though the user typed in the text in the field

7. The method of claim 1, wherein the step of transmitting the speech as a request to the network node is performed using one of a REST protocol, a SOAP protocol or a web-based protocol.

8. The method of claim 1, wherein the request is transmitted in an HTTP protocol.

9. The method of claim 1, wherein the at least one standardized parameter comprises at least one of a command string, a control string and a grammar string.

10. The method of claim 9, wherein the command string comprises at least one of the following strings:

start, stop, button and compile grammar.

11. The method of claim 9, wherein the control string controls at least one of:

coding, a byte order, a sampling rate and n-best results.

12. The method of claim 10, wherein the comprise grammar string includes a pointer to a network location of a grammar for the speech recognizer to use in recognizing the speech.

13. The method of claim 1, further comprising presenting an action button associated with the text in the field only if a confidence level from the speech recognizer is below a threshold.

14. The method of claim 1, wherein if the speech recognizer returns two or more possible interpretations of the speech, then inserting each possible interpretations into a separate text field with an indication instructing the user to select which text field to process.

15. A system for enabling speech processing in a user interface of a device, the system comprising:

a processor;

a module configured to control the processor to receive an indication of a field in a user interface of a device, the indication also signaling that speech will follow;

a module configured to control the processor to receive the speech from the user at the device, the speech being associated with the field;

a module configured to transmit the speech as a request to a public, common network node that receives speech, wherein the request comprises at least one standardized parameter to control a speech recognizer on the network node;

a module configured to control the processor to receive text associated with the speech from the network nodes at the device; and

a module configured to control the processor to insert the text into the field.

16. The system of claim 15, further comprising:

a module configured to control the processor to, upon receiving a second indication from the user, process the text in the field as programmed by the user interface.

17. The system of claim 15, further comprising:

a module configured to control the processor to receive an instruction with the text that causes the user interface to process the inserted text without further user input.

18. The system of claim 15, wherein the instruction is only received with the text if the speech recognition is above a recognition threshold.

19. The system of claim 15, wherein the request is transmitted in an HTTP protocol.

20. The system of claim 15, wherein the at least one standardzed parameter comprises at least one of a command string, a control string and a grammar string.

21. The system of claim 15, further comprising:

a module configured to control the processor to present an action button associated with the text inserted into the field only if a confidence level from the speech recognizer is below a threshold.

22. The system of claim 15, further comprising:

a module configured to control the processor to present two possible interpretations in separate text fields if the speech recognizer returns two possible interpretations of the speech and presenting an indication instructing the user to select which text field to process.

23. A computer-readable medium storing a computer program having instructions for enabling speech processing in a user interface of a device, the instructions comprising:

receiving an indication of a field in a user interface of a device, the indication also signaling that speech will follow;

receiving the speech from the user at the device, the speech being associated with the field;

transmitting the speech as a request to a public, common network node that receives speech, wherein the request comprises at least one standardized parameter to control a speech recognizer on the network node;

receiving text associated with hteh speech from the network node at the device; and

inserting the text into the field