Web enabled recognition architecture

• US 20030009517A1
• Filed: 09/20/2001
• Published: 01/09/2003
• Est. Priority Date: 05/04/2001
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Kuansan, Hon, Hsiao-Wuen
• Granted Patent: US 7,506,022 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1698 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone details of antennas disposed inside a computer H01Q1/2266
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2207/40 terminals with audio html browser
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00

Abstract

A server/client system for processing data includes a network having a web server with information accessible remotely. A client device includes a microphone and a rendering component such as a speaker or display. The client device is configured to obtain the information from the web server and record input data associated with fields contained in the information. The client device is adapted to send the input data to a remote location with an indication of a grammar to use for recognition. A recognition server receives the input data and the indication of the grammar. The recognition server returns data indicative of what was recognized to at least one of the client and the web server.

Claims

1. A server/client system for processing data, the system comprising:

a network comprising;

a web server having information accessible remotely;

a client device having a rendering device to indicate fields to be entered, the client device configured to record input data associated with each of the fields upon an indication by the user of which field subsequent input is intended for, and wherein the client device is adapted to send the input data to a remote location; and

a recognition server configured to receive the input data and return data indicative of what was recognized to at least one of the client and the web server.

2. The system of claim 1 wherein the information received from the web server and provided to the client device is a markup language.

3. The system of claim 2 wherein the markup language received by the client device comprises one or several markup portions and one or several script portions.

4. The system of claim 3 wherein the markup language includes an indication associating a grammar with a field.

5. The system of claim 4 wherein the recognition server receives the input data and the indication of the grammar.

6. The system of claim 5 wherein the grammar is stored on the client device and transferred to the recognition server with the input data.

7. The system of claim 5 wherein the grammar is stored on the recognition server and wherein the indication of the grammar includes a reference to the grammar for the recognition server.

8. The system of claim 3 wherein the markup language comprises one of HTML, XHTML, cHTML, XML and WML.

9. The system of claim 1 wherein the client is adapted to normalize the input data prior to sending the input data to the remote server.

10. The system of claim 2 wherein the web server includes a server side plug-in module for dynamically generating a markup language page for the client device.

11. The system of claim 10 wherein the markup language comprises one of HTML, XHTML, cHTML, XML and WML.

12. The system of claim 1 and further comprising a second client device having a microphone and a speaker, the second client device configured to record speech data associated with each of a set of fields in response to prompts given to the user, and wherein the second client device is adapted to send the speech data to the recognition server.

13. The system of claim 12 wherein the second client device comprises a telephone and a voice browser capable of rendering the contents from the web server.

14. The system of claim 13 wherein the information received from the web server and provided to each of the client devices is a markup language.

15. The system of claim 14 wherein the markup language received by the client devices comprises one or several markup portions and one or several script portions.

16. The system of claim 15 wherein the markup language includes an indication associating a grammar with a field, the indication having the same form from each of the client devices.

17. The system of claim 16 wherein the recognition server receives the input data and the indication of the grammar.

18. The system of claim 17 wherein the grammar is stored on the client device and transferred to the recognition server with the input data.

19. The system of claim 17 wherein the grammar is stored on the recognition server and wherein the indication of the grammar includes a reference to the grammar for the recognition server.

20. The system of claim 12 wherein each of the clients is adapted to normalize the input data prior to sending the input data to the remote server.

21. The system of claim 12 wherein the web server includes a server side plug-in module for dynamically generating markup language for each of the client devices.

22. The system of claim 21 wherein the server side plug-in module dynamically generates markup language as a function of the type of client device.

23. The system of claim 22 wherein the server side plug-in module detects the type of client device.

24. The system of claim 21 wherein the web server includes a plurality of dialog modules accessible by the server side plug-in module, each dialog module pertaining to obtaining data using speech recognition, the server side plug-in module generating the markup language as a function a dialog module.

25. The system of claim 1 wherein the web server and the recognition server are located on a single machine.

27. The system of claim 26 wherein the information received from the web server and provided to the client device is a markup language.

28. The system of claim 27 wherein the markup language comprises one of HTML, XHTML, cHTML, XML and WML.

29. The system of claim 26 wherein the grammar is stored on the client device and transferred to the recognition server with the input data.

30. The system of claim 26 wherein the grammar is stored on the recognition server and wherein the indication of the grammar includes a reference to the grammar for the recognition server.

31. The system of claim 26 and wherein the client device comprises a telephone and the rendering component comprises a speaker.

32. The system of claim 26 wherein the rendering component comprises a display showing the fields.

33. The system of claim 26 wherein the client and the recognition server are located on a single machine.

35. The method of claim 34 wherein rendering the markup language includes displaying fields for data entry, and wherein obtaining input data includes receiving an indication from the user as to which field subsequent input is associated with.

36. The method of claim 34 wherein rendering the markup language includes audibly prompting the user.

37. The method of claim 34 wherein the markup language comprises one of HTML, XHTML, cHTML, XML and WML.

38. The method of claim 34 wherein transmitting the indication of the grammar comprises transmitting the grammar.

39. The method of claim 34 wherein transmitting the indication of the grammar comprises transmitting a reference to the recognition server as to where the grammar is located.

26. A server/client system for processing data, the system comprising:

a network comprising;

a web server having information accessible remotely;

a client device having a microphone and a rendering component, the client device configured to obtain the information from the web server, the information having corresponding fields, the client device further configured to record input data associated with each of the fields, and wherein the client device is adapted to send the input data to a remote location with an indication of a grammar to use for input recognition; and

a recognition server configured to receive the input data and the indication of the grammar, the recognition server returning data indicative of what was inputted to at at least one of the client and the web server.

34. A method for processing voice recognition in a client/server system comprising:

transmitting from a web server to a client device a markup language page having extensions configured to obtain input data from a user of the client device;

rendering the markup language page on the client device;

obtaining input data as a function of input from the user;

transmitting the input data and an indication of an associated grammar to a recognition server remote from the client device; and

receiving a recognition result from the recognition server indicative of what was inputted at at least one of the client device and web server.