Markup language extensions for web enabled recognition

• US 7,610,547 B2
• Filed: 04/05/2002
• Issued: 10/27/2009
• Est. Priority Date: 05/04/2001
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wang, Kuansan, Hon, Hsiao-Wuen
• Primary Examiner(s): RIES, LAURIE ANNE
• Application Number:
  US10/117,141
• Publication Number:
  US 20020169806A1
• Time in Patent Office: 2,762 Days
• Field of Search: 715/513, 715/500.1, 715/541, 715/501.1, 715/205, 715/234, 715/207, 715/208, 704/275, 704/270, 379/88.01
• US Class Current: 715/205
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2207/40 terminals with audio html browser
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00

Abstract

A markup language for execution on a client device in a client/server system includes extensions for recognition.

Claims

1. In combination with a remote recognition server, a client device including a computer readable storage medium having a markup language for execution on the client device in the client/server system, the markup language comprising an instruction to provide to the remote recognition server that is remote from the client device an indication of a grammar to associate with input entered through the client device and an instruction related to a mode of operation of the remote recognition server related to when recognition results are to be returned to the client device.

2. The computer readable storage medium of claim 1 wherein the instruction indicating a grammar provides a reference to a location of the grammar.

3. The computer readable storage medium of claim 1 wherein the markup language comprises one of HTML, XHTML, cHTML, XML, and WML.

4. The computer readable storage medium of claim 1 wherein the markup language comprises a scripting language.

5. The computer readable storage medium of claim 1 wherein the markup language comprises synchronized multimedia markup language.

6. The computer readable storage medium of claim 1 wherein the markup language includes an instruction to audibly render an indication when the speech was not recognized.

7. The computer readable storage medium of claim 1 wherein the markup language includes an instruction to visually render an indication when the speech was not recognized.

8. The computer readable storage medium of claim 1 wherein the instruction related to the mode of operation instructs the remote recognition server to provide recognition results when a time period related to speech recognition has lapsed.

9. The computer readable storage medium of claim 1 wherein the instruction related to the mode of operation instructs the remote recognition server to provide recognition results when a stop recognition indication is provided by the client device.

10. The computer readable storage medium of claim 1 wherein the instruction related to the mode of operation instructs the remote recognition server to start recognition when a start recognition indication is provided by the client device and to provide recognition results when a stop recognition indication is provided by the client device.

11. The computer readable storage medium of claim 1 wherein the instruction related to the mode of operation instructs the remote recognition server to start recognition when a start recognition indication is provided by the client device and to provide recognition results at intervals.

12. The computer readable storage medium of claim 1 wherein the markup language includes an instruction indicating a confidence measure to use for speech recognition.

13. The computer readable storage medium of claim 1 wherein the markup language includes an instruction for taking action based on a value previously received.

14. A computer readable storage medium including instructions readable by a computer which, when implemented, cause the computer to handle information by performing a method comprising:

receiving a markup language page from a web server having a field for input data;

receiving input from a user related to the field; and

sending to a remote recognition server markup language instructions for data indicative of the input, an indication of a grammar for recognition, a settable time period related to recognition to a remote recognition server, and an instruction related to a mode of operation of the remote recognition server related to when recognition results are to be returned.

15. The computer readable storage medium of claim 14 wherein the indication provides a reference to locations of the grammars.

16. The computer readable storage medium of claim 14 wherein the indication includes a reference to a language for speech recognition.

17. The computer readable storage medium of claim 14 wherein the markup language comprises one of HTML, XHTML, cHTML, XML and WML.

18. The computer readable storage medium of claim 14 wherein the markup language comprises a scripting language.

19. The computer readable storage medium of claim 14 wherein the markup language comprises a synchronized markup language.

20. The computer readable storage medium of claim 14 and wherein the input comprises speech, and further including instructions, which when implemented, comprise:

processing the input speech to provide data indicative of the input speech.

21. The computer readable storage medium of claim 20 wherein processing includes normalizing the data indicative of the input speech.

22. The computer readable storage medium of claim 20 wherein processing includes generating data indicative of parameters of the input speech.

23. The computer readable storage medium of claim 14 wherein the input comprises speech and the grammar comprises a speech recognition grammar.

24. The computer readable storage medium of claim 14 wherein the input comprises DTMF input and the grammar comprises a DTMF grammar.

25. The computer readable storage medium of claim 14 wherein the instruction related to the mode of operation instructs the remote recognition server to provide recognition results when the time period related to speech recognition has lapsed.

26. The computer readable storage medium of claim 14 wherein the instruction related to the mode of operation instructs the remote recognition server to provide recognition results when a stop recognition indication is provided by the computer.

27. The computer readable storage medium of claim 14 wherein the instruction related to the mode of operation instructs the remote recognition server to start recognition when a start recognition indication is provided by the computer and to provide recognition results when a stop recognition indication is provided by the computer.

28. The computer readable storage medium of claim 14 wherein the instruction related to the mode of operation instructs the remote recognition server to start recognition when a start recognition indication is provided by the computer and to provide recognition results at intervals.

29. In combination with a remote recognition server, a first client device and a second client device, each client device including a computer readable storage medium having a markup language for execution on the corresponding client device in the client/server system, the markup language comprising an instruction to provide to the remote recognition server that is remote from each of the client devices an indication of a grammar to associate with input entered through each client device, an instruction to set a time period related to speech recognition at the remote recognition server for the input provided from each client device, and an instruction related to a mode of operation of the remote recognition server related to when recognition results are to be returned to each of the client devices.

30. The computer readable storage medium of claim 29 wherein the instruction related to the mode of operation instructs the remote recognition server to provide recognition results when the time period related to speech recognition has lapsed.

31. The computer readable storage medium of claim 30 wherein the time period indicates a maximum period before a result must be returned after detection of speech.

32. The computer readable storage medium of claim 30 wherein the time period indicates a maximum period before a result must be returned after a start recognition instruction.

33. The computer readable storage medium of claim 30 wherein the time period indicates a minimum period of silence to indicate an end of speech.

34. The computer readable storage medium of claim 30 wherein the instruction related to the mode of operation instructs the remote recognition server to provide recognition results when a stop recognition indication is provided by the respective client device.

35. The computer readable storage medium of claim 30 wherein the instruction related to the mode of operation instructs the remote recognition server to start recognition when a start recognition indication is provided by the respective client device and to provide recognition results at intervals, wherein the time period related to speech recognition indicates a maximum time for providing recognition results.

36. The computer readable storage medium of claim 29 wherein the instruction related to the mode of operation instructs the remote recognition server to start recognition when a start recognition indication is provided by the respective client device and to provide recognition results when a stop recognition indication is provided by the respective client device.

37. In combination with a remote recognition server, a first client device and a second client device, each client device including a computer readable storage medium having a markup language for execution on the corresponding client device in the client/server system, the markup language comprising an instruction to provide to the remote recognition server that is remote from each of the client devices an indication of a grammar to associate with input entered through each client device, and an instruction related to a mode of operation of the remote recognition server related to when recognition results are to be returned to each of the client devices, wherein the instruction related to the mode of operation of the remote recognition server for the first client device instructs the recognition server to provide recognition results only when a time period related to speech recognition has lapsed, and wherein the instruction related to the mode of operation of the remote recognition server for the second client device instructs the recognition server to provide recognition results when a stop recognition indication is provided by the second client device.

38. The computer readable storage medium of claim 37 wherein the instruction related to the mode of operation for the second client device instructs the remote recognition server to start recognition when a start recognition indication is provided by the second client device.

39. The computer readable storage medium of claim 37 wherein the instruction related to the mode of operation of the first client device instructs the remote recognition server to start recognition when a start recognition indication is provided by the respective client device and to provide recognition results at intervals, wherein the time period related to speech recognition indicates a maximum time for providing recognition results.