Voice interface for electronic documents

• US 6,349,132 B1
• Filed: 12/16/1999
• Issued: 02/19/2002
• Est. Priority Date: 12/16/1999
• Status: Expired due to Term

• Current Assignee: Intellisync Corporation (Nokia Corporation)
• Original Assignee: Talk2 Technology, Inc. (Nokia Corporation)
• Inventors: Nam, Dong-Kyun, Newton, Richard T., Wesemann, Darren L.
• Primary Examiner(s): Tsang, Fan
• Assistant Examiner(s): ESCALANTE, OVIDIO
• Application Number:
  US09/464,989
• Time in Patent Office: 796 Days
• Field of Search: 379/88.01, 379/88.11, 379/88.13, 379/88.14, 379/88.17, 379/88.22, 379/88.23, 379/900, 379/88.04, 704/270, 704/275
• US Class Current: 379/88.17
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML
• CPC Class Codes: Y10S 379/90 Internet, e.g. Internet phone, webphone, internet-based telephony

Abstract

Methods, systems, and computer program products for providing an audio interface to electronic documents. An audio interface receives a request for electronic content from a client and retrieves the requested document. Next, the document is parsed to identify various elements, such as title, text, and links included in the document. Many of those providing electronic content include hierarchical indices to aid clients in finding documents covering a particular topic. The audio interface includes a facility to preserve, enhance, or create this hierarchical organization by mapping a document'"'"'s text and links into a corresponding audio hierarchy. The client is then presented with various options from which to make a selection. Outside of this hierarchy, the client receives the document title, the number of links contained within the document, an audio representation of the document'"'"'s text, and may optionally chose to hear only the links included in the document. The audio interface also includes a number of global commands to facilitate navigation.

Claims

1. In a system that includes an information service and a telephone for interacting with the information service, a method of enabling a user of the telephone to access and navigate electronic documents by presenting to the user an audio representation of a hierarchy of links of the document so as to enhance the ability of the user to navigate the electronic documents, the method comprising the acts of:

obtaining an electronic document;

parsing the electronic document to identify any text and any links included in the content of the electronic document;

mapping content of the parsed electronic document by performing the acts of;

determining whether the text and links included in the content of the document represent categories, first-level links and second-level links in a hierarchical relationship one with another; and

to the extent that the text and links represent categories, first-level links and second level links, creating a hierarchical data structure that associates the text and links to the categories, the first-level links and the second-level links;

generating an audio representation of at least a portion of the parsed electronic document, the audio representation being communicated to a client; and

prompting the user to select a category from the hierarchical data structure and then successively prompting the user to select any first-level links and second-level links, such that the content of the electronic document is presented audibly to the user and the user can make verbal selections.

2. A method as recited in claim 1 further comprising the acts of:

obtaining at least two electronic documents, one of the at least two electronic documents being designated as a prior electronic document and one of the at least two electronic documents being designated as a subsequent electronic document;

parsing the at least two electronic documents to identify any text and any links included in the at least two electronic documents; and

making any links identified in the prior electronic document available in the subsequent electronic document.

3. A method as recited in claim 1 further comprising the acts of generating an audio representation of the one or more categories.

4. A method as recited in claim 3 further comprising the act of prompting the client to select one of the one or more categories.

5. A method as recited in claim 1 wherein the act of mapping includes creating a hierarchy of said any text and said any links.

6. A method as recited in claim 1 further comprising the act of receiving an instruction from the client.

7. A method as recited in claim 6 wherein the instruction received from the client is at least one of an instruction to email, fax, or voice mail at least a portion of the electronic document to a third party selected from the client'"'"'s contact list.

8. A method as recited in claim 6 wherein the instruction is spoken into the input/output device.

9. A method as recited in claim 6 wherein the audio representation includes at least one link and wherein the instruction from the client is to select the at least one link, further comprising the act of following the at least one link.

10. A method as recited in claim 1 wherein the audio representation includes only said links included in the electronic document.

11. A method as recited in claim 1 wherein the audio representation includes a count of said links and said text included in the electronic document.

12. A method as recited in claim 1 wherein the electronic document is written in a markup language.

13. A method as recited in claim 12 wherein the markup language includes elements that are only capable of describing the visual appearance of the electronic document.

14. A method as recited in claim 13 wherein the markup language is one of hypertext markup language and extensible markup language.

15. A method as recited in claim 1 further comprising the act of providing the user with a visual representation of the electronic document simultaneously with the act of generating the audio representation.

16. In an information system that has access, through the Internet, to electronic documents, wherein the electronic documents are written in a markup language having elements that are only capable of describing the visual appearance of the electronic documents, and the information system is connected to a client by a telephony infrastructure, a method for providing the user with telephone access to the electronic documents, the method comprising the acts of:

obtaining an electronic document through the Internet;

parsing the electronic document to identify any text and any links included in the content of the electronic document;

mapping content of the parsed electronic document by performing the acts of;

determining whether the text and links included in the content of the document represent categories, first-level links and second-level links in a hierarchical relationship one with another; and

to the extent that the text and links represent categories, first-level links and second level links, creating a hierarchical data structure that associates the text and links to the categories, the first-level links and the second-level links;

prompting the client to traverse the hierarchical data structure, including automatically selecting any category and any associated link when exactly one category and exactly one associated link is present;

receiving input from the client to traverse the hierarchical data structure, wherein the input includes instructions for selecting an electronic document with text; and

generating an audio representation of the parsed electronic document, including a count of any links and any text present in the electronic document, the audio representation being communicated to the client.

17. A method as recited in claim 16, wherein the instruction is spoken into the telephone.

18. A method as recited in claim 17, wherein the input further includes at least one of an instruction to email, fax, or voice mail at least a portion of the electronic document to a third party selected from a contact list of the client.

19. A method as recited in claim 17, wherein the audio representation includes information representing at least one link and wherein the input includes an instruction to select the at least one link, the method further comprising the act of following the at least one link.

20. A method as recited in claim 16 further comprising the act of providing the user with a visual representation of the electronic document simultaneously with the act of generating the audio representation.

21. A system providing access, through an audio interface, to electronic documents so as to enable a user of the audio interface to access and navigate the electronic documents by presenting to the user a hierarchy of links of the document, the system comprising:

processor means for obtaining an electronic document;

processor means for parsing the electronic document to identify any text and any links included in the content of the electronic document;

processor means for mapping content of the parsed electronic document by performing the acts of;

determining whether the text and links included in the content of the document represent categories, first-level links and second-level links in a hierarchical relationship one with another; and

to the extent that the text and links represent categories, first-level links and second level links, creating a hierarchical data structure that associates the text and links to the categories, the first-level links and the second-level links;

processor means for generating an audio representation of at least a portion of the parsed electronic document, the audio representation being communicated to a client; and

processor means for prompting the user to select a category from the hierarchical data structure and then successively prompting the user to select any first-level links and second-level links, such that the content of the electronic document is presented audibly to the user and the user can make verbal selections.

22. A system as recited in claim 21 further comprising processor means for receiving spoken input from the user.

23. A system as recited in claim 22 wherein the input comprises at least one of an instruction to email, fax, or voice mail at least a portion of the electronic document to a third party selected from a contact list of the client.

24. A system as recited in claim 22 wherein the audio representation includes information representing at least one link and wherein the input includes an instruction to select the at least one link, the system further comprising processor means for following the at least one link.

25. A computer program product for providing access, through an audio interface, to electronic documents so as to enable a user of the audio interface to access and navigate the electronic documents by presenting to the user a hierarchy of links of the document, the computer program product comprising:

a computer-readable medium carrying computer-executable instructions for implementing the method, the computer-executable instructions comprising;

program code means for obtaining an electronic document;

program code means for parsing the electronic document to identify any text and any links included in the content of the electronic document;

program code means for mapping content of the parsed electronic document by performing the acts of;

determining whether the text and links included in the content of the document represent categories, first-level links and second-level links in a hierarchical relationship one with another; and

to the extent that the text and links represent categories, first-level links and second level links, creating a hierarchical data structure that associates the text and links to the categories, the first-level links and the second-level links;

program code means for generating an audio representation of at least a portion of the parsed electronic document, the audio representation being communicated to a client; and

program code means for prompting the user to select a category from the hierarchical data structure and then successively prompting the user to select any first-level links and second-level links, such that the content of the electronic document is presented audibly to the user and the user can make verbal selections.

26. A computer-readable medium as recited in claim 25 wherein the computer-executable instruction further comprises program code means for receiving spoken input from the user.

27. A computer-readable medium as recited in claim 26 wherein the input comprises at least one of instruction to email, fax, or voice mail at least a portion of the electronic document to a third party selected from a contact list of the client.

28. A computer-readable medium as recited in claim 26 wherein the audio representaion includes information representing at least one link and wherein the input includes an instruction to select the at least one link, wherein the computer-executable instruction further comprise program code means for following the at least one link.