Robust voice browser system and voice activated device controller

• US 7,076,431 B2
• Filed: 04/09/2004
• Issued: 07/11/2006
• Est. Priority Date: 02/04/2000
• Status: Expired due to Term

• Current Assignee: Parus Holdings, Inc.
• Original Assignee: Parus Holdings, Inc.
• Inventors: Zhukoff, Valery, Kurganov, Alexander
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US10/821,690
• Publication Number:
  US 20040193427A1
• Time in Patent Office: 823 Days
• Field of Search: 704/270, 704/275, 379/88.01, 379/88.02, 455/563
• US Class Current: 704/275
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/187 Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04M 2201/39 using speech synthesis speech synthesis per se G10L13/00
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

The present invention relates to a system for acquiring information from sources on a network, such as the Internet. A voice browsing system maintains a database containing a list of information sources, such as web sites, connected to a network. Each of the information sources is assigned a rank number which is listed in the database along with the record for the information source. In response to a speech command received from a user, a network interface system accesses the information source with the highest rank number in order to retrieve information requested by the user.

Claims

1. A system for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to users retrieved information in an audio form via said voice enabled device, said system comprising:

a computer, said computer operatively connected to the internet;

a voice enabled device operatively connected to said computer, said voice enabled device configured to receive speech commands from users;

at least one speaker-independent speech recognition device, said speaker-independent speech recognition device operatively connected to said computer and to said voice enabled device;

at least one speech synthesis device, said speech synthesis device operatively connected to said computer and to said voice enabled device;

at least one instruction set for identifying said information to be retrieved, said instruction set being associated with said computer, said instruction set comprising;

a plurality of pre-selected web site addresses, each said web site address identifying a web site containing said information to be retrieved;

at least one recognition grammar associated with said computer, each said recognition grammar corresponding to each said instruction set and corresponding to a speech command;

said speech command comprising an information request selectable by the user;

said speaker-independent speech recognition device configured to receive from users via said voice enabled device said speech command and to select the corresponding recognition grammar upon receiving said speech command;

said computer configured to retrieve said instruction set corresponding to said recognition grammar selected by said speaker-independent speech recognition device;

said computer further configured to access at least one of said plurality of web sites identified by said instruction set to obtain said information to be retrieved, said computer configured to first access said first web site of said plurality of web sites and, if said information to be retrieved is not found at said first web site, said computer configured to sequentially access said plurality of web sites until said information to be retrieved is found or until said plurality of web sites has been accessed;

said speech synthesis device configured to produce an audio message containing any retrieved information from said pre-selected web sites, and said speech synthesis device further configured to transmit said audio message to said users via said voice enabled device.

2. The system of claim 1 wherein said internet is the Internet.

3. The system of claim 1 wherein said internet is a local area network.

4. The system of claim 1 wherein said voice enabled device is a standard telephone, an IP telephone, a cellular phone, a PDA, a personal computer, a DVD player, a television or other video display device, a CD player, a MP3 player, or any other device capable of transmitting said audio message.

5. The system of claim 1 wherein said speaker-independent speech recognition device is configured to analyze phonemes to recognize said speech commands.

6. The system of claim 1 wherein said speaker-independent speech recognition device is configured to recognize naturally spoken speech commands.

7. The system of claim 1 wherein said instruction set further comprises a content descriptor associated with each said web site address, said content descriptor pre-defining a portion of said web site containing said information to be retrieved.

8. The system of claim 1 wherein said computer is further configured to periodically poll each of said web sites without being instructed by said user to determine the availability of each said web site, the duration of time for each said web site to respond to a request from said computer, and changes to the location of said information to be retrieved from each said web site, said computer further configured to create a ranking of said plurality of web sites based on said periodic polling.

9. The system of claim 1 wherein said computer is further configured to periodically search said internet to identify new web sites and to add said new web sites to said plurality of web sites.

10. The system of claim 1 wherein said instruction set further comprises a ranking associated with each said web site address, said ranking indicating the order in which the plurality of pre-selected web sites are accessed.

11. The system of claim 10 wherein said computer is configured to modify said rankings based upon at least one of a plurality of criteria, said plurality of criteria comprising:

the availability of each said web site;

the duration of time for each said web site to respond to a request from said computer; and

changes to the location of said information to be retrieved from each said web site.

12. The system of claim 11 wherein said computer is configured to weigh said criteria with respect to one another when modifications to said rankings are based on more than one of said plurality of criteria.

13. The system in claim 10 wherein said computer is configured to access said plurality of web sites in order of ranking to retrieve said information requested by said user, said computer further configured to first access said web site having the highest ranking.

14. The system of claim 1 further comprising a database operatively connected to said computer, said database configured to store said information gathered from said web sites in response to said information requests.

15. The system of claim 10 wherein said computer is further configured to modify said rankings associated with said plurality of web sites such that said web site having said information to be retrieved is associated the highest ranking and any web sites not having said information to be retrieved are assigned lower rankings.

16. The system of claim 14 wherein each said recognition grammar and each said instruction set are stored in said database.

17. The system of claim 9 wherein said computer is configured to search each of said new web sites without being instructed by said user to determine the availability of each said new web site, the duration of time for each said new web site to respond to a request from said computer, and changes to the location of said information to be retrieved from each said new web site, said computer further configured to create a ranking of said plurality of new web sites based on said periodic searches.

18. A method for retrieving information from pre-selected web sites by uttering speech commands into a voice enabled device and for providing to users retrieved information in an audio form via said voice enabled device, said method comprising the steps of:

providing a computer operatively connected to the internet, said computer further being operatively connected to at least one speaker-independent speech recognition engine and to at least one speech synthesis engine;

providing a voice enabled device operatively connected to said computer, said voice enabled device configured to receive speech commands from users;

providing at least one instruction set stored in a database operatively connected to said computer, said instruction set comprising;

a plurality of pre-selected web site addresses, each said web site address identifying a web site containing said information to be retrieved;

providing a speech command to said speaker-independent speech recognition engine, said speech command corresponding to said instruction set;

said speaker-independent speech recognition engine assigning said speech command to a recognition grammar, said speech command and said recognition grammar corresponding to said instruction set;

transmitting said speech command to said speaker-independent speech recognition engine;

said speaker-independent speech recognition engine receiving said speech command and selecting the corresponding recognition grammar upon receiving said speech command;

said computer retrieving said instruction set corresponding to said recognition grammar selected by said speaker-independent speech recognition engine;

said computer accessing at least one of said plurality of web sites identified by said instruction set to obtain said information to be retrieved, said computer first accessing said first web site of said plurality of web sites and, if said information to be retrieved is not found at said first web site, said computer sequentially accessing said plurality of web sites until said information to be retrieved is found or until said plurality of web sites has been accessed;

said speech synthesis engine producing an audio message containing any retrieved information from said pre-selected web sites; and

said speech synthesis engine transmitting said audio message to said users via said voice enabled device.

19. The method of claim 18 wherein said instruction set further comprises a content descriptor associated with each said web site address, said content descriptor pre-defining a portion of said web site containing said information to be retrieved.

20. The method of claim 18 wherein said instruction set further comprises a ranking from highest to lowest associated with each said web site, said ranking indicating the order in which the plurality of pre-selected web sites are accessed.

21. The method of claim 20 wherein said computer accesses said plurality of web sites based on said ranking, said computer first accessing said web site having the highest ranking.

22. The method of claim 21 further comprising the step of adjusting said rankings associated with said plurality of web sites such that said web site having said information to be retrieved is assigned the highest ranking and any web sites not having said information to be retrieved are assigned lower rankings.

23. The method of claim 18 further comprising the step of periodically polling each said web site to determine whether said web site contains said information to be retrieved.

24. The method of claim 23 wherein the computer periodically polls each said web site without being instructed by said user to determine the availability of each said web site, the duration of time for each said web site to respond to a request from said computer, and changes to the location of said information to be retrieved from each said web site, said computer creating a ranking of said plurality of web sites based on said periodic polling.

25. The method of claim 18 further comprising the step of periodically searching said internet to find new web sites containing said information to be retrieved, and adding said new web sites to said plurality of web sites.

26. A system for retrieving information from pre-selected web sites by uttering speech commands into a phone and for providing to users retrieved information in an audio form via said phone, said system comprising:

a computer, said computer operatively connected to the internet and to at least one phone;

at least one speaker-independent speech recognition engine, said speaker-independent speech recognition engine operatively connected to said computer;

at least one speech synthesis engine, said speech synthesis engine operatively connected to said computer;

a database, said database operatively connected to said computer;

at least one instruction set stored in said database for identifying said information to be retrieved, said instruction set comprising;

a plurality of pre-selected web site addresses, each said web site address identifying a web site containing said information to be retrieved;

a content descriptor associated with each said web site address, said content descriptor pre-defining a portion of said web site containing said information to be retrieved;

a ranking from highest to lowest associated with each said web site address, said ranking indicating the order in which the plurality of pre-selected web sites are accessed;

at least one recognition grammar stored in said database, each said recognition grammar corresponding to each said instruction set and corresponding to a speech command;

said speaker-independent speech recognition engine configured to receive from users via said phone a speech command and to select the corresponding recognition grammar upon receiving said speech command;

said computer configured to retrieve said instruction set corresponding to said recognition grammar selected by said speaker-independent speech recognition device;

said computer further configured to access at least one of said plurality of web sites identified by said instruction set to obtain said information to be retrieved, said computer configured to first access said web site having the highest ranking and, if said information to be retrieved is not found at said web site having the highest ranking, said computer configured to subsequently access said plurality of web sites in order of rankings until said information to be retrieved is found or until said plurality of web sites has been accessed;

said computer further configured to establish or adjust said rankings associated with said plurality of web sites such that said web site having said information to be retrieved is assigned the highest ranking and any web sites not having said information to be retrieved are assigned lower rankings;

said speech synthesis engine configured to produce an audio message containing any retrieved information from said pre-selected web sites, and said speech synthesis engine further configured to transmit said audio message to said users via said phone.

27. The system of claim 26 wherein said phone comprises a standard telephone, a cellular phone, or an IP phone.

28. The system of claim 26 wherein said internet is a local area network.

29. The system of claim 26 wherein said internet is a wide area network.

30. The system of claim 26 wherein said internet is the Internet.

31. The system of claim 26 wherein said computer is configured to establish or adjust said rankings associated with said plurality of web sites when instructed by said user to access said plurality of web sites to retrieve said information.

32. The system of claim 26 wherein said computer is configured to establish or adjust said rankings associated with said plurality of web sites based on periodic polling of each of said web sites without being instructed by said user to determine the availability of each said web site, the duration of time for each said web site to respond to a request from said computer, and changes to the location of said information to be retrieved from each said web site.