Using speech recognition to access the internet, including access via a telephone

• US 6,101,473 A
• Filed: 08/08/1997
• Issued: 08/08/2000
• Est. Priority Date: 08/08/1997
• Status: Expired due to Fees

• Current Assignee: Board of Trustees of the Leland Stanford Junior University (Stanford Management Co.)
• Original Assignee: Board of Trustees of the Leland Stanford Junior University (Stanford Management Co.)
• Inventors: Scott, Brian L., Miller, Clint L.
• Primary Examiner(s): Knepper, David D.
• Application Number:
  US08/907,628
• Time in Patent Office: 1,096 Days
• Field of Search: 704/270, 704/275, 704/243, 345/302, 358/402, 455/445, 379/90.01, 379/88.13, 370/352, 709/201-204
• US Class Current: 704/275
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML
• CPC Class Codes: H04M 7/006 Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42
• CPC Class Codes: H04M 7/12 for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal

Abstract

Voice activation of functions on a network such as the Internet are accomplished using a speech recognition system running synchronously with standard desktop-based Internet functions. This synchronous operation allows voice-based control to be exercised for all operations on the Internet. System functions are based on a unique combination of a local web browser, a remotely-located speech/web server, and control links between a web browser and a speech/web server. The control links provide a mechanism for controlling a speech server from a web page and a mechanism for driving both the local, as well as a remote, web browser.

Claims

1. A remote server to enable a local user to increase the functionality of a local browser having a graphical user interface, comprising:

a remote web browser residing on the remote server;

a speech controller electronically coupled to said remote web browser, said controller being configured to form control links coupling the local browser to said remote browser via an Internet data communication link to enable said remote web browser and the local browser to function cooperatively; and

a speech server having a speech recognition function residing on the remote server, said speech server coupling said controller to a telephone network so that a telephonic voice communication link may be established between the user and said controller;

wherein voice commands to control browsing may be input via said telephonic voice communication link and wherein graphical user interface commands to control browsing may also be input via the local browser.

2. The server of claim 1, wherein said controller and said server are configured to form said telephonic voice communication link in response to the user accessing a web site via said Internet data communication link.

3. The server of claim 1 wherein said control links are configured to enable the local browser to control the telephonic function of said speech server.

4. The server of claim 1, wherein said controller is a software module contained in said remote browser.

5. The server of claim 4, wherein said controller is configured to download a software program to the local browser to form persistent control links.

6. A remote server to enable a local user to increase the functionality of a local browser, comprising:

a remote web browser residing on the remote server;

a speech controller electronically coupled to said remote web browser, said controller being configured to form control links coupling the local browser to said remote browser via an Internet data communication link to enable said remote web browser and the local browser to function cooperatively; and

a speech server having a speech recognition function residing on the remote server, said speech server coupling said controller to a telephone network so that a voice communication link may be established between the user and said controller;

wherein said control links are configured to enable voice commands to be uploaded to control the browsing function while information from the Internet is downloaded to a graphical user interface of the local browser.

7. The server of claim 6, wherein said control links are configured so that the user may browse by both voice commands and by inputting commands via said graphical user interface.

8. A network system, comprising:

a) a local browser disposed on a local computer; and

b) a remote server including;

i) a remote browser residing on said remote server;

ii) a speech controller software module electronically coupled to said remote browser; and

iii) a speech server having a speech recognition function residing on the remote server, said speech server coupling said speech controller software module to a telephone network so that a voice communication link may be established between the user and said speech controller software module;

said controller software module having an interface protocol for remotely controlling web browsers configured to form control links coupling said local browser to said remote browser via a network data link to enable said remote web browser and said local browser to function cooperatively, wherein said control links are configured so that auxiliary voice commands may be input by the user to control browsing of the network.

9. The system of claim 8, wherein said local browser includes a graphical user interface and said control links are configured so that the user may browse by both voice commands and by inputting commands via said graphical user interface.

10. A network system, comprising:

a) a local browser disposed on a local computer; and

b) a remote server including;

i) a remote browser residing on said remote server;

ii) a speech controller software module electronically coupled to said remote browser, said controller software module being configured to form control links coupling said local browser to said remote browser via a network data link to enable said remote web browser and said local browser to function cooperatively; and

iii) a speech server having a speech recognition function residing on the remote server, said speech server coupling said speech controller software module to a telephone network so that a voice communication link may be established between the user and said speech controller software module;

wherein said control links are configured to enable voice commands to be uploaded to control the browsing function while information from the network is downloaded to the graphical user interface of said local browser.

11. The system of claim 10 wherein said controller software module includes an interface protocol for remotely controlling a web browser.

12. A method for permitting a local user to link a local web browser to a remote speech recognition device, comprising the steps of:

a) electronically coupling the local browser to a web-site served by a remote server;

b) downloading a software program from a remote web browser residing on said remote server to form control links between the local web browser and a controller coupled to said remote web browser; and

c) telephoning the user to form a voice communication link between the user and said controller via a speech server coupling said controller to a telephone network;

whereby the user may input voice commands which are translated by said speech server to control browsing of a computer network while information from the network is downloaded to a graphical user interface of the local browser.

13. The method of claim 12, further comprising after step "b" the step of:

uploading the phone number of the local user.

14. The method of claim 12, wherein said controller software module is contained in said remote web browser.

15. A method for permitting a local user to use voice commands to perform functions on a network, comprising the steps of:

a) providing a remote server, the remote server having a controller for forming a first data communication link with a local user and a speech server for converting voice commands into control signals;

b) accessing said remote server to form a first electronic communication link to a local browser;

c) telephoning the user to form a voice transmission communication link coupling the user to the controller via said speech server;

d) translating voice commands into electronic data signals using said speech server; and

e) using said translated voice commands to perform functions on the network;

wherein said controller is configured to enable voice commands to be uploaded to control the browsing function while information from the network is downloaded to a graphical user interface of the local browser.

16. The method of claim 15, wherein the network comprises the Internet and further wherein the controller is contained in a remote browser residing on said remote server.

17. The method of claim 16, wherein said speech server is coupled to a telephone network and further comprising after step "b" the step of:

uploading a local telephone number.

18. The method of claim 15, further comprising the step of:

downloading a software program to said local browser to enable a persistent link to be formed between the controller and the local browser.

19. The method of claim 15, wherein said speech server is coupled to a telephone network and further comprising the step of:

accessing a hot-linked phone number on a web-site to initiate dialing of said phone number by said speech server.