Multi-modal information delivery system

• US 20060168095A1
• Filed: 01/22/2003
• Published: 07/27/2006
• Est. Priority Date: 01/22/2002
• Status: Abandoned Application

• Current Assignee: xAd, Inc
• Original Assignee: xAd, Inc
• Inventors: Kumar, Sunil, Sharma, Dipanshu, Kholia, Chandra
• Application Number:
  US10/349,345
• Publication Number:
  US 20060168095A1
• Time in Patent Office: Days
• US Class Current: 709/217
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/55 Push-based network services
• CPC Class Codes: H04L 69/08 Protocols for interworking; Protocol conversion
• CPC Class Codes: H04L 69/18 Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

A system and method for multi-modal information delivery is disclosed herein. The method involves receiving a first user request at a browser module operative in accordance with a first protocol applicable to a first mode of information delivery. The method further includes generating a browsing request in response to the first user request, wherein the browsing request identifies information available within a network. Multi-modal content is then created on the basis of the information identified by the browsing request and provided to the browser module. The multi-modal content is formatted in compliance with the first protocol and incorporates a reference to content formatted in accordance with a second protocol applicable to a second mode of information delivery.

Claims

1. A method for browsing a network comprising:

receiving a first user request at a voice browser, said voice browser operating in accordance with a voice-based protocol;

generating a browsing request in response to said first user request, said browsing request identifying information available within said network;

creating multi-modal content on the basis of said information, said multi-modal content being formatted in compliance with said voice-based protocol and incorporating a reference to visual-based content formatted in accordance with a visual-based protocol; and

providing said multi-modal content to said voice browser.

2. The method of claim 1 further including receiving a switch instruction associated with said reference and, in response, switching a context of user interaction from voice to visual and retrieving said visual-based content from within said network.

3. The method of claim 2 wherein said switching is performed by a switching server, said switching server utilizing a messaging server in delivering said visual-based content to an end user device.

4. The method of claim 3 further including rendering said multi-modal content based upon a protocol compatible with a rendering capability of said end user device.

5. The method of claim 4 wherein said protocol is selected from the group consisting of:

push protocol, SMS protocol, any visual-based protocol.

6. The method of claim 1 further including receiving a show instruction associated with said reference and, in response, establishing a visual session with an end user device.

7. The method of claim 6 further including also establishing a voice session with said end user device.

8. The method of claim 7 further including engaging in dual channel operation with said end user device through said voice session and said visual session, said dual channel operation including sending an SMS message to said end user device during said voice session.

9. The method of claim 7 further including engaging in dual channel operation with said end user device through said voice session and said visual session, said dual channel operation including sending a visual alert to said end user device via a WAP gateway during said voice session.

10. The method of claim 7 further including engaging in dual channel operation with said end user device through said voice session and said visual session, said dual channel operation including sending a visual alert to said end user device via a visual gateway during said voice session.

11. The method of claim 7 further including coordinating simultaneous operation of said voice session and said visual session.

12. The method of claim 2 further including creating additional multi-modal content on the basis of said visual-based web content, said additional multi-modal content incorporating a reference to voice-based content within said network.

13. The method of claim 2 further including:

establishing a voice-based connection over said communication link, said voice-based connection carrying said first user request from a first user device, terminating, in response to receipt of said switch instruction, said voice-based connection, and communicating said visual-based content to said first user device.

14. The method of claim 12 further including:

establishing a voice-based connection over said communication link, said voice-based connection carrying said first user request from a first user device, terminating, in response to receipt of said switch instruction, said voice-based connection, and communicating said additional multi-modal content to said first user device.

15. A method for browsing a network comprising:

receiving a first user request at a gateway unit, said gateway unit operating in accordance with a visual-based protocol;

generating a browsing request in response to said first user request, said browsing request identifying information available within said network;

creating multi-modal content on the basis of said information, said multi-modal content being formatted in compliance with said visual-based protocol and incorporating a reference to voice-based content formatted in accordance with a voice-based protocol; and

providing said multi-modal content to said gateway unit.

16. The method of claim 15 further including receiving a switch instruction associated with said reference and, in response, switching a context of user interaction from visual to voice and retrieving said voice-based content from within said network.

17. The method of claim 15 further including receiving a voice instruction associated with said reference and, in response, initiating a voice session without interrupting a current visual session.

18. The method of claim 15 further including receiving a voice instruction associated with said reference and, in response, sending a voice instruction without interrupting a current voice and visual sessions.

19. The method of claim 17 further including concurrently coordinating between the voice and visual sessions.

20. The method of claim 16 further including creating additional multi-modal content on the basis of said voice-based content, said additional multi-modal content incorporating a reference to visual-based content available within said network.

21. The method of claim 16 further including:

establishing a visual-based connection over said communication link, said visual-based connection carrying said first user request from a first user device, terminating, in response to receipt of said switch instruction, said visual-based connection, and communicating said voice-based content to said first user device.

22. The method of claim 20 further including:

establishing a visual-based connection over said communication link, said visual-based connection carrying said first user request from a first user device, terminating, in response to receipt of said switch instruction, said visual-based connection, and communicating said voice-based multi-modal content to said first user device.

26. The system of claim 22 wherein said multi-mode gateway controller includes a switching module for switching a context of user interaction from visual to voice and invoking said voice-based multi-modal converter in response to a switch instruction received from said visual-based gateway.

28. The system of claim 26 wherein said switching module terminates, in response to said switch instruction, a data connection through said visual-based gateway to a first user device and initiates establishment of a voice-based connection to said first user device for transporting said voice-based multi-modal content.

23. A system for browsing a network comprising:

a voice browser operating in accordance with a voice-based protocol, said voice browser receiving a first user request and generating a first browsing request in response to said first user request;

a visual-based gateway operating in accordance with a visual-based protocol, said visual-based gateway receiving a second user request and generating a second browsing request in response to said first user request; and

a multi-mode gateway controller in communication with said voice browser and said visual-based gateway, said multi-mode gateway controller including a voice-based multi-modal converter for generating voice-based multi-modal content in response to said first browsing request.

24. The system of claim 23 wherein said multi-mode gateway controller further includes a visual-based multi-modal converter for generating visual-based multi-modal content in response to said second browsing request.

25. The system of claim 24 wherein said multi-mode gateway controller includes a switching module for switching a context of user interaction from voice to visual and invoking said visual-based multi-modal converter in response to a switch instruction received from said voice browser.

27. The system of claim 24 wherein said switching module terminates, in response to said switch instruction, a voice connection through said voice browser to a first user device and initiates establishment of a data connection to said first user device for transporting said visual-based multi-modal content.

29. A system for browsing a network comprising:

a voice browser operating in accordance with a voice-based protocol, said voice browser receiving a first user request and generating a first browsing request in response to said first user request;

a visual-based gateway operating in accordance with a visual-based protocol, said visual-based gateway receiving a second user request and generating a second browsing request in response to said second user request;

a multi-mode gateway controller in communication with said voice browser and said visual-based gateway, said multi-mode gateway controller including a visual-based multi-modal converter for generating visual-based multi-modal content in response to said second browsing request.

30. The system of claim 29 wherein said multi-mode gateway controller further includes a voice-based multi-modal converter for generating voice-based multi-modal content in response to said first browsing request.

31. A multi-mode gateway controller for facilitating browsing of a network, said gateway controller comprising:

a first port for receiving a first browsing request over a voice-based connection established through said first port, said first browsing request identifying information available within said network;

a voice-based multi-modal converter for creating voice-based multi-modal content on the basis of said information, said voice-based multi-modal content being formatted in compliance with a voice-based protocol and incorporating a reference to a location within said network storing visual-based content formatted in accordance with a visual-based protocol; and

a switching module for retrieving said visual-based content upon receipt of a switch instruction over said voice-based connection.

32. The multi-mode gateway controller of claim 31 further including:

a second port for receiving a second browsing request identifying additional information available within said network; and

a visual-based multi-modal converter for creating visual-based multi-modal content on the basis of said additional information, said visual-based multi-modal content being formatted in compliance with said visual-based protocol and incorporating a reference to a location within said network storing voice-based content formatted in accordance with a voice-based protocol.

33. The multi-mode gateway controller of claim 31 wherein said switching module, in response to said receipt of said switch instruction, terminates said voice-based connection and establishes a data connection through a second port of said multi-mode gateway controller wherein said visual-based content is transported over said data connection.

36. The multi-mode gateway controller of claim 33 wherein said switching module, in response to said receipt of said switch instruction, terminates said visual-based connection and establishes a voice-based connection through a second port of said multi-mode gateway controller wherein said voice-based content is transported over said voice-based connection.

34. A multi-mode gateway controller for facilitating browsing of a network, said gateway controller comprising:

a first port for receiving a first browsing request over a visual-based connection established through said first port, said first browsing request identifying information available within said network;

a visual-based multi-modal converter for creating visual-based multi-modal content on the basis of said information, said visual-based multi-modal content being formatted in compliance with a visual-based protocol and incorporating a reference to a location within said network storing voice-based content formatted in accordance with a voice-based protocol; and

a switching module for retrieving said voice-based content upon receipt of a switch instruction over said visual-based connection.

35. The multi-mode gateway controller of claim 34 further including:

a second port for receiving a second browsing request identifying additional information available within said network; and

a voice-based multi-modal converter for creating voice-based multi-modal content on the basis of said additional information, said voice-based multi-modal content being formatted in compliance with said voice-based protocol and incorporating a reference to a location within said network storing visual-based content formatted in accordance with a visual-based protocol.

37. A method for multi-modal information delivery comprising:

receiving a first user request at a browser module, said browser module operating in accordance with a first protocol applicable to a first mode of information delivery;

generating a browsing request in response to said first user request, said browsing request identifying information available within a network;

creating multi-modal content on the basis of said information, said multi-modal content being formatted in compliance with said first protocol and incorporating a reference to content formatted in accordance with a second protocol applicable to a second mode of information delivery; and

providing said multi-modal content to said browser module.

38. The method of claim 37 further including receiving a switch instruction associated with said reference and, in response, (i) switching a context of user interaction from being compliant with said first protocol to being compliant with said second protocol, and (ii) retrieving said content from within said network.