Conversational portal for providing conversational browsing and multimedia broadcast on demand

• US 7,415,537 B1
• Filed: 04/07/2000
• Issued: 08/19/2008
• Est. Priority Date: 04/07/2000
• Status: Expired due to Term

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Maes, Stephane H.
• Primary Examiner(s): Maung; Zarni
• Application Number:
  US09/545,078
• Time in Patent Office: 3,056 Days
• Field of Search: 709/246, 709/247, 709217-219, 715/501.1, 715/517, 715/516, 715/523, 715/530, 379/88.14, 707/10
• US Class Current: 709/246
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

A system and method for providing conversational (multi-modal) access to information over a communications network from any location, at any time, utilizing any type of client/access, through a conversational (multi-modal) portal. In one aspect, a conversational portal comprises a conversational (multi-modal) browser that is capable of conducting multi-modal dialog with client/access devices having varying input/output (I/O) modalities. The conversational browser retrieves information (such as content pages, applications) from an information source (e.g., content server) in response to a request from a requesting client/access device and then serves the retrieved information to the requesting client/access device in a format that is compatible with the I/O modalities of the requesting client/access device. In another aspect, the conversational portal provides multimedia access on demand. The conversational portal comprises an audio indexing system for segmenting and indexing audio and multimedia data obtained from an information source, as well as a multi-media database for storing the indexed audio and multi-media data. A subscribing user can compose and maintain a broadcast program wherein the user specifies which types, and in what order, different segments (news, radio, etc.) stored in the database are played back/broadcasted to the user.

Claims

1. A conversational portal system, comprising:

a computing system comprising a conversational browser to provide a user interface that adapts an interaction dialog between the conversational portal system and a client according to one more modalities supported by the client, and wherein the conversational browser can retrieve one or more pages from an information source in response to a request from the client and serve or present the retrieved pages to the client in at least one format that is compatible with the one or more modalities supported by the client,

an audio indexing system for segmenting and indexing audio and multimedia data obtained from an information source of a registered subscriber; and

a multimedia database for storing the indexed audio and multimedia data,

wherein the conversational portal maintains, for the registered subscriber, a program comprising multimedia segments in the multimedia database searchable by the client via a direct query of the indexed audio and multimedia data in the multimedia database.

2. The conversational portal of claim 1, wherein the multi-modal format is a modality-independent format.

3. The conversational portal of claim 1, wherein the computing system further comprises a transcoder, operatively associated with the conversational browser, for converting a page having a multi-modal format into at least one modality-specific format.

4. The conversational portal of claim 1, wherein the conversational portal detects a modality of the client.

5. The conversational portal of claim 4, wherein the conversational portal detects the modality of the client based on one of registration protocols and identification of an access channel.

6. The conversational portal of claim 1, wherein the computing system further comprises a portal directory database, accessible by the conversational browser, for storing one of an index of information sources, information associated with information sources, and a combination thereof.

7. The conversational portal of claim 6, wherein the information, which is stored in the portal directory database associated with the information sources, is maintained in a multi-modal format by a service provider of the conversational portal under business agreements between the service provider of the conversational portal and service providers of the information sources.

8. The conversational portal of claim 1, wherein the computing system further comprises a capture module for capturing a connection between the client and the conversational portal and holding the client captive during predetermined time periods.

9. The conversational portal of claim 8, wherein the client is held captive between a time period where a link provided by the conversational browser is selected by the client and one or rendered and served to the client.

10. The conversational portal of claim 9, wherein the client is released when a link is directly requested by the client.

11. The conversational portal of claim 8, wherein the computing system provides one of advertisements, services and a combination thereof to the client, during at least one predetermined time period in which the client is held captive.

12. The conversational portal of claim 11, wherein the at least one predetermined time period is a time period between fetching links between different information sources.

13. The conversational portal of claim 11, wherein the advertisements and services are multi-modal.

14. The conversational portal of claim 11, wherein the advertisements and services are provided on behalf of a third-party under a business agreement between a service provider of the conversational portal and the third-party.

15. The conversational portal of claim 14, wherein the conversational browser obtains desired segments from the multimedia database in response to a client request and presents such segments to the client based on a modality of the client.

16. The conversational portal of claim 14, wherein the conversational browser periodically downloads multimedia data from at least one information source to index and store the multimedia data in the multimedia database.

17. The conversational portal of claim 16, wherein the downloading and indexing of the multimedia data of the at least one information source is performed under a business agreement between a service provider of the conversational portal and a service provider of the at least one information source.

18. The conversational portal of claim 1, wherein the registered subscriber can use the client to conversationally navigate the program and select desired segments for broadcasting.

19. The conversational portal of claim 1, wherein the program comprises radio on demand service which the registered subscriber accesses via a wireless phone client.

20. A system for accessing information, comprising:

an access device;

a content server; and

a conversational portal system comprising;

a conversational browser that provides a conversational user interface to access the conversational portal system, wherein the conversational browser adapts an interaction dialog with the access device according to one or more modalities supported by the access device, and wherein the conversational browser can retrieve one or more pages from the content server in response to a request communicated from the access device and serve or present the retrieved pages to the access device in at least one format that is compatible with the one or more modalities supported by the access device;

an audio indexing system for segmenting and indexing audio and multimedia data obtained from an information source according to a program specified by a user; and

a multimedia database for storing the indexed audio and multimedia data,

wherein the conversational portal maintains, for the user the program, wherein the program comprises portions of the indexed audio and multimedia data in the multimedia database in a predetermined order specified in the program by the user.

21. The system of claim 20, wherein the multi-modal format is a modality-independent format.

22. The system of claim 20, wherein the conversational browser can render a multi-modal content page or multi-modal application into a presentation format that is compatible with the at least one modality of the access device.

23. The system of claim 20, wherein the conversational portal system comprises a portal transcoder for converting a multi-modal content page or multi-modal application into at least one modality-specific representation based on a detected modality of the access device.

24. The system of claim 20, further comprising a proxy transcoder, accessible by the conversational portal system, for converting modality-specific content into a multi-modal representation.

25. The system of claim 24, wherein the proxy transcoder provides a transcoding service that is offered by a provider of the content or by a third-party under a business agreement with the provider of the content.

26. The system of claim 20, wherein the access device is a multi-modal device that executes a local conversational browser for processing and presenting one of a multi-modal content page and application received from the conversational portal.

27. The system of claim 20, wherein the conversational portal is accessed by calling a predesignated telephone number.

28. The system of claim 20, wherein the conversational portal comprises a portal directory database comprising a directory of content server addresses.

29. The system of claim 28, wherein the portal directory database comprises one of multi-modal content pages, multi-modal applications, and both associated with at least one content provider, which are hosted by the conversational portal.

30. A method for providing access to information over a communications network, comprising the steps of:

establishing communication with a conversational portal using an access device having at least one modality associated therewith;

the conversational portal adapting an interaction dialog with the access device based on the at least one modality of the access device, wherein adapting the interaction dialog includes adapting the interaction dialog to an audio modality and a non-audio modality;

maintaining, in a multimedia database of the conversational portal, indexed audio and multimedia data corresponding to a content page of a registered subscriber;

retrieving, by the conversational portal, the indexed audio and multimedia data of the content page from the multimedia database according to a user specified program specifying an order in which portions of the indexed audio and multimedia data are played; and

presenting or serving, by the conversational portal, the content page to the user in at least one format that is compatible with the at least one modality of the access device, wherein the at least one format comprises a multi-modal format that can be rendered in two or more synchronized modalities.

31. The method of claim 30, further comprising the steps of:

detecting, by the conversational portal, at least one modality of the access device; and

transcoding the retrieved content page into at least one modality-specific format corresponding to the at least one detected modality.

32. The method of claim 30, further comprising the steps of:

holding the user captive during a period in which the retrieving step is executed; and

presenting one of advertisements, services and a combination thereof to the user during a predetermined time period in which the user is held captive.