Providing access to information of multiple types via coordination of distinct information services

• US 7,233,786 B1
• Filed: 08/06/2003
• Issued: 06/19/2007
• Est. Priority Date: 08/06/2002
• Status: Active Grant

• Current Assignee: Ip Ot Sub Ulc
• Original Assignee: Captaris, Inc. (Open Text Corporation)
• Inventors: Murray, Douglas G., Harris, Paul Evert, Deckert, David Grant, Denny, Thomas W.
• Primary Examiner(s): Trinh; Sonny
• Application Number:
  US10/635,385
• Time in Patent Office: 1,413 Days
• Field of Search: 370/328, 370/338, 370/270, 370/352, 455/412.1, 455/412.2, 455/413, 455/414.1, 455/414.2, 455/414.4, 704/258, 704/260, 709/206, 709/246, 379/67.1, 379/88.14
• US Class Current: 455/412.1
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/401 wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/00 Network arrangements or protocols for supporting network services or applications user-to-user messaging H04L51/00; network arrangements, protocols or services for supporting real-time applications in data packet communications networks H04L65/00
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04W 4/00 Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 74/00 Wireless channel access
• CPC Class Codes: H04W 76/10 Connection setup
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals
• CPC Class Codes: H04W 92/24 between backbone network devices

Abstract

Techniques are described for providing users of client devices with coordinated access to information and/or functionality of multiple types, such as by using multiple types of connections to multiple information services of distinct types that exchange context information related to activities of the users and/or clients. The client devices can be, for example, wireless devices with multiple distinct modes (e.g., voice and data modes) for different types of connections with different types of servers (e.g., voice servers and data servers). In some situations, coordination between different servers allows multiple distinct interaction sessions of different types with different servers to remain synchronized or otherwise coordinated over time as the user performs interactions via the different sessions. This abstract is provided to comply with rules requiring an abstract, and is not intended to be used to interpret or limit the scope or meaning of the claims.

Claims

1. A computer-implemented method for providing voice-based and text-based functionality to a mobile wireless client computing device from multiple remote servers in a coordinated manner, the client device having a current user and supporting a data mode for exchanging text-based information with a remote data server system and supporting a voice mode for exchanging voice-based information with a remote voice server system, the method comprising:

under control of the mobile wireless client computing device,

establishing a data connection with the data server using the data mode of the client device, and receiving multiple text-based documents from the data server over the established data connection;

receiving an indication from the current user of a selection of one of multiple voice-based actions for a selected one of the text-based documents,

automatically sending to the data server over the established data connection an indication of the selected document and of the selected action; and

without further indication by the client device of the selected action or the selected document, automatically establishing a voice connection with the voice server using the voice mode of the client device and receiving voice-based information from the voice server over the established voice connection to effect the selected voice-based action for the selected text-based document;

under control of the remote data server system and after receiving the indication from the client device of the selected text-based document and of the selected voice-based action, automatically sending context information for the current user to the voice server, the context information including an indication of the selected text-based document and of the selected voice-based action; and

under control of the remote voice server system and after receiving the context information for the current user from the data server and after the establishment of the voice connection with the client device,

identifying that the current user is using the client device;

automatically associating the received context information for the current user with the established voice connection with the client device; and

providing the selected voice-based action for the selected text-based document to the current user based at least in part on the associated context information, the providing including automatically sending the voice-based information to the client device over the established voice connection,

so that a user of a mobile wireless client computing device can automatically receive voice-based functionality for a selected text-based document based at least in part on context information for the user that is automatically provided by a data server to a distinct voice server.

2. The method of claim 1 including, under the control of the remote voice server system and after the providing of the selected voice-based action to the current user of the client device:

sending multiple groups of voice-based information to the client device over the established voice connection;

receiving an indication from the client device of a selected voice-based information group and of a selected text-based action for the selected voice-based information group; and

automatically sending context information for the current user to the data server, the context information including an indication of the selected voice-based information group and of the selected text-based action, so that the data server can automatically provide the selected text-based action for the selected voice-based information group to the client device over the established data connection.

3. The method of claim 1 wherein the automatic establishing by the client device of the voice connection with the voice server using the voice mode of the client device includes ending the established data connection with the data server using the data mode of the client device, and including, after the providing of the selected voice-based action for the selected text-based document to the current user of the client device, automatically re-establishing the data connection between the data server and the client device using the data mode in such a manner as to return the current user to a previous state of interaction with the data server based on the context information for the current user.

4. The method of claim 1 including, after the providing of the selected voice-based action for the selected text-based document to the current user of the client device, repeatedly exchanging updated context information for the current user between the voice server and the data server so that interactions by the data server with the current user of the client device over the established data connection can be maintained in a synchronous manner with interactions by the voice server with the current user of the client device over the established voice connection.

5. The method of claim 1 wherein the data server is an email server and the voice server is a unified messaging system, wherein the data connection is based on TCP/IP protocol and the voice connection is a digital audio protocol for cellular telephones, wherein the selected text-based document is an email message to the current user from a sender, and wherein the selected voice-based action is to record a voice reply message to the email message for forwarding to the sender.

6. The method of claim 1 wherein the data server is an email server and the voice server is a voice messaging system, wherein the selected text-based document is an email message having a header and contents, and wherein the selected voice-based action is to audibly read to the current user at least the contents of the email message.

7. The method of claim 1 wherein the selected text-based document includes one or more records from a database, and wherein the selected voice-based action is to record a voice annotation to be stored in the database in a manner associated with the records.

8. The method of claim 1 wherein the context information for the current user sent by the data server to the voice server further includes an indication of the current user and of a manner of the establishing of the voice connection between the client device and the voice server.

9. The method of claim 1 wherein the automatic establishing by the client device of the voice connection with the voice server includes, under the control of the client device, receiving an instruction from the data server to initiate the establishment of the voice connection with the voice server and automatically contacting the voice server to initiate the voice connection in response to the received instruction.

10. The method of claim 1 including:

under control of a second client device of the current user that is distinct from the mobile wireless client computing device,

establishing a second data connection with the data server and receiving information from the data server over the established second data connection that is non-text and non-voice, the established second data connection occurring concurrently with the established data connection with the mobile wireless client computing device; and

sending to the data server over the established second data connection an indication of a second voice-based action selected by the current user for the information received by the second client device; and

under the control of the data server and after receiving the indication of the second voice-based action, sending to the voice server a second set of context information for the current user that includes an indication of the second voice-based action and of the second client device and of the information received by the second client device, so that the voice server can provide to the current user based on the second set of context information the second voice-based action over a voice connection established with the mobile wireless client computing device.

11. The method of claim 1 including, under the control of the data server:

receiving a request from a second user of the client device for a voice-based action related to indicated non-voice information;

updating context information for the second user to reflect the received request, the updated context information including an indication of the requested voice-based action and of the indicated non-voice information; and

sending the updated context information for the second user to the voice server, so that the voice server can provide the requested voice-based action based on the updated context information over a voice connection established with the client computing device.

12. A computer-implemented method for providing functionality from a voice server system and a data server system in a coordinated manner, the voice server system able to exchange voice-based information with multiple client devices using a voice transmission protocol designed for transmitting voice-based data, the data server system able to exchange text-based information with multiple client devices using a distinct data transmission protocol, the method comprising, under control of the data server system:

providing multiple predefined text-based groups of information to a client device, the providing part of a data session with the client device using the data transmission protocol;

receiving from the client device an indication of one of the text-based groups of information and an indication of one of multiple voice-based types of functionality related to the indicated text-based group of information, the receiving part of the data session; and

automatically providing to the voice server system context information that includes an indication of the indicated text-based group of information and of the indicated voice-based type of functionality,

so that the voice server system can automatically provide the indicated voice-based type of functionality for the indicated text-based group of information as part of a voice session with the client device using the voice transmission protocol.

13. The method of claim 12 including, under control of the voice server:

receiving the provided context information from the data server system; and

providing to the client device the indicated voice-based type of functionality related to the indicated text-based group of information, the providing part of the voice session with the client device using the voice transmission protocol and based on the provided context information.

14. The method of claim 13 wherein the providing of the indicated voice-based type of functionality to the client device under the control of the voice server includes initiating the voice session with the client device.

15. The method of claim 12 including, under control of the client device, receiving the indicated voice-based type of functionality for the indicated text-based group of information as part of the voice session with the voice server system using the voice transmission protocol.

16. The method of claim 12 including, under control of the client device and after providing the indication to the data server system of the one text-based group of information and of the one voice-based type of functionality, initiating the voice session with the voice server system in order to receive the provided voice-based type of functionality from the voice server system, the initiating based at least in part on an instruction received from the data server system in response to the providing of the indication to the data server system.

17. The method of claim 12 wherein the voice session between the client device and the voice server system is established before an indication is received from a user of the client device of the one text-based group of information and the one voice-based type of functionality, and wherein that previously established voice session is used for the providing of the indicated voice-based type of functionality to the client device from the voice server system.

18. The method of claim 12 wherein the context information provided to the voice server system further includes indications of one or more of the client device, a user of the client device, preference information associated with the user of the client device, preference information associated with the client device, an application executing on the data server system with which the indicated one text-based group of information is associated, and information related to establishing of the voice session between the client device and the voice server system.

19. The method of claim 12 wherein the data session is based on a connection between the data server system and the client device using a data mode of the client device, and wherein the voice session is based on a connection between the voice server system and the client device using a voice mode of the client device.

20. The method of claim 19 wherein providing to the client device the indicated voice-based type of functionality for the indicated text-based group of information includes automatically switching from the data mode of the client device to the voice mode of the client device for interactions between the client device and the voice server system that are part of the voice session.

21. The method of claim 20 including, after the providing to the client device of the indicated voice-based type of functionality for the indicated text-based group of information, automatically switching from the voice mode of the client device back to the data mode of the client device for further interactions between the client device and the data server system that are part of the data session.

22. The method of claim 20 including, after the providing to the client device of the indicated voice-based type of functionality for the indicated text-based group of information, maintaining the voice session with the voice server system to allow further interactions between the client device and the voice server system that are part of the voice session.

23. The method of claim 19 wherein the client device has one or more additional modes other than the voice and data modes, and including establishing communications between the client device and one or more remote server systems using one or more of the additional modes.

24. The method of claim 12 wherein the indicated text-based group of information is an email message.

25. The method of claim 12 wherein the indicated text-based group of information is one or more records from a database.

26. The method of claim 12 wherein the indicated voice-based type of functionality provided by the voice server system is storing voice-based information received from a user of the client device.

27. The method of claim 12 wherein the indicated voice-based type of functionality provided by the voice server system is providing voice-based information to the client device.

28. The method of claim 12 including:

providing one or more additional groups of information to the client device as part of the data session with the data server system using the data transmission protocol, the additional groups of information representing information other than text or audio; and

after receiving from the client device an indication of one of the additional groups of information and an indication of one of multiple voice-based types of functionality related to the indicated one group of information, providing to the voice server system context information that includes an indication of the indicated one group of information and of the indicated voice-based type of functionality.

29. The method of claim 28 wherein the additional groups of information each represent one of an image, a video clip, or a graphic.

30. The method of claim 12 including repeatedly providing context information to the voice server system from the data server system to enable ongoing coordination of interactions between the client device and the voice server system over the voice session with interactions between the client device and the data server system over the data session.

31. The method of claim 12 wherein the indicated voice-based type of functionality for the indicated text-based group of information includes providing voice-based information to the client device that is related to the indicated text-based group of information.

32. A computer-readable medium whose contents cause a server computing device of a first type to provide functionality in a coordinated manner from one or more other servers, communications between the server computing device of the first type and one or more clients occurring in a distinct manner than communications between the other servers and one or more clients, the providing of the functionality under control of the server computing device by performing a method comprising:

receiving from a client an indication of a group of information indicated by a user and an indication of a selected functionality related to the indicated group of information, the receiving of the information based on a first manner of communication between the client and the server computing device, the selected functionality available from one or more of the other servers when a client communicates with at least one of those other servers in a second manner that is associated with the selected functionality and that is distinct from the first manner of communication; and

automatically providing context information to at least one of the one or more other servers that includes an indication of the indicated group of information and of the selected functionality,

so that the one or more other servers can automatically provide the selected functionality for the indicated group of information when a client of the user and those other servers communicate in the distinct second manner of communication associated with the selected functionality.

33. The computer-readable medium of claim 32 wherein the server computing device is a voice server and the other servers are data servers, wherein the first manner of communication between the client and the server computing device is based on a voice session using a voice mode of the client, wherein the second manner of communication between the client and the one or more other servers is based on one or more data sessions using a data mode of the client, wherein the indicated group of information is voice-based information selected by the user, and wherein the selected functionality is non-voice-based functionality.

34. The computer-readable medium of claim 32 wherein the server computing device is a data server and the other servers are voice servers, wherein the first manner of communication between the client and the server computing device is based on a data session using a data mode of the client, wherein the second manner of communication between the client and the one or more other servers is based on one or more voice sessions using a voice mode of the client, wherein the indicated group of information is non-voice-based information selected by the user, and wherein the selected functionality is voice-based functionality.

35. The computer-readable medium of claim 32 wherein the indicated group of information is an email message.

36. The computer-readable medium of claim 32 wherein the first and second manners of communication by the client device use two distinct communication modes of the client device.

37. The computer-readable medium of claim 32 wherein the computer-readable medium is a memory of a computing device.

38. The computer-readable medium of claim 32 wherein the computer-readable medium is a data transmission medium transmitting a generated data signal containing the contents.

39. The computer-readable medium of claim 32 wherein the contents are instructions that when executed cause the computing device to perform the method.

40. The computer-readable medium of claim 32 wherein the indicated group of information is of a first type that is selected by the user and/or provided by the user for storage, and wherein the related selected functionality available from one or more of the other servers via the distinct manner of communication includes storing and/or providing a distinct group of information of a second type that is associated with the indicated group of information.

41. A computing system for providing functionality in a coordinated manner from multiple servers of distinct types, comprising:

a voice server that is capable of exchanging voice-based information with client devices using a voice-based transmission protocol;

a data server that is capable of exchanging non-voice-based information with client devices using a data-based transmission protocol; and

a context provider component that is capable of at least one of,

A) after the data server has received an indication from a client device using the data-based transmission protocol of a selected type of functionality that is available from the voice server using the voice-based transmission protocol, providing information to the voice server indicating the selected type of functionality and at least one of the client device and a user of the client device, the information provided to the voice server enabling the voice server to automatically provide the selected type of functionality using the voice-based transmission protocol without the client device and/or the user having to further indicate the selected type of functionality to the voice server; and

B) after the voice server has received an indication from a client device using the voice-based transmission protocol of a selected type of functionality that is available from the data server using the data-based transmission protocol, providing information to the data server indicating the selected type of functionality and at least one of the client device and a user of the client device, the information provided to the data server enabling the data server to automatically provide the selected type of functionality using the data-based transmission protocol without the client device or the user having to further indicate the selected type of functionality to the data server.

42. The computing device of claim 41 wherein the context provider component is executing in memory of the computing device.

43. A computing system for providing functionality in a coordinated manner from a voice server and a data server, the voice server capable of exchanging voice-based information with clients using a voice transmission protocol, the data server capable of exchanging other types of information with clients using a distinct data transmission protocol, comprising:

means for, after one of the servers has provided information to a client using the transmission protocol for that server, receiving from the client using that transmission protocol an indication of a selected type of functionality related to the information, the selected functionality type available from the other server using the transmission protocol for that other server; and

means for automatically providing context information to that other server that includes an indication of the selected type of functionality and of the related information and of an identifier associated with the client,

so that the other server can automatically provide to the client the selected type of functionality for the related information using the transmission protocol for that other server.

44. A method for providing information to client devices from a voice server system and a data server system in a coordinated manner, the voice server capable of exchanging voice-based information with client devices using a voice mode, the data server capable of exchanging text-based information with client devices using a distinct data mode, the method comprising:

under control of the data server, repeatedly,

exchanging text-based information as part of a data session with a client device of a user using the data mode;

providing information to the voice server that indicates at least some of the exchanged text-based information;

receiving information from the voice server that indicates voice-based information exchanged by the voice server with a client device of the user using the voice mode as part of a simultaneous voice session; and

selecting additional text-based information to be provided as part of the data session with the client device using the data mode, the selecting based at least in part on the received information from the voice server; and

under control of the voice server, repeatedly,

exchanging voice-based information as part of the voice session with the client device of the user using the voice mode;

providing information to the data server that indicates at least some of the exchanged voice-based information;

receiving information from the data server that indicates text-based information exchanged by the data server with the client device using the data mode as part of the data session; and

selecting additional voice-based information to be provided as part of the voice session with the client device using the voice mode, the selecting based at least in part on the received information from the data server.