Method and system for voice activating web pages

• US 20040153323A1
• Filed: 04/05/2004
• Published: 08/05/2004
• Est. Priority Date: 12/01/2000
• Status: Active Grant

• Current Assignee: Trustees Of Columbia University In The City Of New York (Columbia University)
• Original Assignee: Trustees Of Columbia University In The City Of New York (Columbia University)
• Inventors: Starren, Justin, Charney, Michael L
• Granted Patent: US 7,640,163 B2
• Time in Patent Office: Days
• US Class Current: 704/270.1
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks

Abstract

A method for providing a web page having an audio interface. The method including providing data specifying a web page, including in the data a first rule based grammar statement having a first phrase portion, a first command portion and a first tag portion, and including in the data a second rule based grammar statement having a second phrase portion, a second command portion, and a second tag portion.

Claims

1. A method for providing a visual web page having an audio interface, comprising:

providing data specifying the web page;

including in said data a first rule based grammar statement, the first rule based grammar statement having a first phrase portion, a first command portion and a first tag portion; and

including in said data a second rule based grammar statement, the second rule based grammar statement having a second phrase portion, a second command portion, and a second tag portion.

2. The method of claim 1, wherein the data specifying the web page includes markup language.

3. The method of claim 1, wherein the first rule based grammar statement is specified by markup language of the data specifying the web page.

4. The method of claim 1, wherein the second rule based grammar statement is specified within the markup language of the data specifying the web page.

5. The method of claim 1, further comprising the step of including in said data a first speech grammar statement, the first speech grammar having a first speech phrase portion.

6. The method of claim 5, wherein the first speech grammar statement is associated with the first rule based grammar statement.

7. The method of claim 1, wherein the first rule based grammar statement includes a first display priority portion.

8. The method of claim 7, wherein the second rule based grammar statement includes a second display priority portion.

9. A method for interacting with a visual web page having an audio interface, comprising:

receiving data specifying the web page, said data including a first rule based grammar statement, the first rule based grammar statement having a first phrase portion, a first command portion and a first tag portion, and a second rule based grammar statement, the second rule based grammar statement having a second phrase portion, a second command portion, and a second tag portion;

storing at least a portion of the first rule based grammar;

storing at least a portion of the second rule based grammar;

providing the data specifying the web page to a web browser;

providing the first phrase portion and the first tag portion as a first recognition grammar to an automated speech recognition engine; and

providing the second phrase portion and the second tag portion as a second recognition grammar to the automated speech recognition engine.

10. The method of claim 9, wherein the data specifying the web page includes markup language.

11. The method of claim 9, wherein the first rule based grammar statement is specified within the markup language of the data specifying the web page.

12. The method of claim 9, wherein the second rule based grammar statement is specified within the markup language of the data specifying the web page.

13. The method of claim 9, further comprising the step of creating a first speech grammar from a first speech grammar statement contained within the data specifying the web page, the first speech grammar having a first speech phrase portion;

14. The method of claim 13, wherein the first speech grammar statement is associated with the first rule based grammar.

15. The method of claim 14, further comprising the steps of:

receiving an indication that the first recognition grammar has been invoked; and

transmitting the first speech grammar to the automated speech recognition engine to be output as speech.

16. The method of claim 13, further comprising the step of transmitting the first speech grammar to the automated speech recognition engine to be output as speech.

17. The method of claim 9, further comprising the steps of:

receiving from the automated speech recognition engine an indication that the first recognition grammar has been invoked;

reading the first command portion of the first rule based grammar from the first record of the database; and

transmitting the first command portion to a web server.

18. The method of claim 9, further comprising the step of displaying an output audio level.

19. The method of claim 18, further comprising the step of receiving an indication that the first recognition grammar has been invoked, and displaying the first phrase portion of the first rule based grammar.

20. The method of claim 18, further comprising the step of receiving an indication that the second recognition grammar has been invoked, and displaying the second phrase portion of the second rule based grammar.

21. The method of claim 18, further comprising the step of displaying the first phrase portion of the first rule based grammar and the second phrase portion of the second rule based grammar.

22. The method of claim 18, wherein the first rule based grammar includes a first display priority portion.

23. The method of claim 22, wherein the second rule based grammar includes a second display priority portion.

24. The method of claim 23, further comprising the step of displaying the first phrase portion of the first rule based grammar because the first priority portion is greater than the second priority portion, and refraining from displaying the second phrase portion of the second rule based grammar.

25. A system for receiving a visual web page having an audio interface, comprising:

a first input for receiving data specifying the web page, said data including a first rule based grammar statement having a first phrase portion, a first command portion, and a first tag portion, and including a second rule based grammar statement having a second phrase portion, a second command portion, and a second tag portion;

a database for storing at least a portion of said first rule based grammar statement and for storing at least a portion of said second rule based grammar statement;

a web browser for receiving said data specifying the web page; and

an automated speech recognition engine for receiving the first phrase portion and the first tag portion as a first recognition grammar, and for receiving the second phrase portion and the second tag portion as a second recognition grammar.

26. The system of claim 25, wherein the data specifying the web page includes markup language.

27. The system of claim 25, wherein the first rule based grammar statement is specified within the markup language of the data specifying the web page.

28. The system of claim 25, wherein the second rule based grammar statement is specified within the markup language of the data specifying the web page.

29. The system of claim 25, wherein said data specifying the web page includes a first speech grammar statement, the first speech grammar statement having a first speech phrase portion.

30. The system of claim 29, wherein the first speech grammar statement is associated with the first rule based grammar.

31. The system of claim 30, further comprising an hyper-speech markup language processor responsive to the automated speech recognition engine invoking the first recognition grammar, the hyper-speech markup language processor providing the first speech phrase portion to the automated speech recognition engine to be output as speech.

32. The system of claim 29, wherein a hyper-speech markup language processing unit transmitting the first speech phrase portion to the automated speech recognition engine to be output as speech.

33. The system of claim 25, further comprising an hyper-speech markup language processor responsive to the automated speech recognition engine invoking the first recognition grammar, the hyper-speech markup language processor transmitting the first command portion to a web server.