Multi-modality communication participation

• US 9,762,524 B2
• Filed: 09/30/2011
• Issued: 09/12/2017
• Est. Priority Date: 09/28/2011
• Status: Expired due to Fees

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A., Rinaldo, Jr., John D.
• Primary Examiner(s): Parry, Chris
• Assistant Examiner(s): Stiltner, Weiwei
• Application Number:
  US13/200,805
• Publication Number:
  US 20130080519A1
• Time in Patent Office: 2,174 Days
• Field of Search: 709204-206, 455563-565
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]

Abstract

Disclosed herein are example embodiments for multi-modality communication participation. By way of example but not limitation, for a given communication, a remote user may interact with a remote communication device via a remote communication modality, and a local user may interact with a local communication device via a local communication modality. Described embodiments include, but are not limited to, conversion of communication data that corresponds to a remote communication modality to communication data that corresponds to a local communication modality, or vice versa. By way of further example but not limitation, for a given communication, a local user may interact with a local communication device via a user input interface in accordance with one communication modality and may interact with the local communication device via a user output interface in accordance with another communication modality.

Claims

1. A system comprising:

(a) circuitry for receiving at least one notification of a communication from a remote communication device that corresponds to a first communication modality, including at least;

(1) circuitry for receiving the at least one notification of the communication, the at least one notification including at least an incoming voice call notification; and

(b) circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, including at least;

(1) circuitry for determining if at least one environmental condition exists with respect to the local communication device, including at least;

(A) circuitry for determining if the local communication device is traveling in a moving vehicle;

(2) circuitry for determining if an identity of a remote user associated with the remote communication modality matches that of one or more particular persons; and

(3) circuitry for transmitting as the at least one message, if the circuitry for determining if at least one environmental condition exists with respect to the local communication device determines that the at least one environmental condition exists with respect to the local communication device, at least one message indicating that local user interaction with respect to the local communication device will be (a) at least partly via a textual communication modality if the circuitry for determining if the identity of the remote user determines that the identity of the remote user does not match that of one or more particular persons; and

(b) at least partly via a video communication modality if the circuitry for determining if the identity of the remote user determines that the identity of the remote user is a match for that of one or more particular persons;

including at least;

(A) circuitry for transmitting as the at least one message, if the circuitry for determining if the local communication device is traveling in a moving vehicle determines that the local communication device is traveling in a moving vehicle, at least one message indicating that local user interaction with respect to the local communication device will be (a) at least partly via a textual communication modality if the circuitry for determining if the identity of the remote user determines that the identity of the remote user does not match that of one or more particular persons; and

(b) at least partly via a video communication modality if the circuitry for determining if the identity of the remote user determines that the identity of the remote user is a match for that of one or more particular persons.

2. The system of claim 1, wherein the first communication modality includes at least a voice communication modality and the second communication modality includes at least one of a textual communication modality, a voice communication modality, or a video communication modality.

3. The system of claim 1, wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, comprises:

at least one of;

circuitry for transmitting the at least one message to continue the communication using voice connection signaling;

or

circuitry for transmitting the at least one message to accept an initial communication request, the circuitry for transmitting operational responsive at least partly to the at least one notification.

4. The system of claim 1, further comprising:

circuitry for accepting local user interaction via the first communication modality; and

circuitry for participating in at least part of the communication by transmitting user communication data derived from the local user interaction accepted via the first communication modality,

wherein transmission of the at least one message to continue the communication is performed by the circuitry for transmitting after operation of the circuitry for accepting and the circuitry for participating.

5. The system of claim 1, wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, comprises:

circuitry for transmitting the at least one message to continue the communication, the at least one message indicating that local user input interaction is to occur via the first communication modality and that local user output interaction is to occur via the second communication modality.

6. The system of claim 1, wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, comprises:

circuitry for transmitting the at least one message to continue the communication, the at least one message indicating that local user input interaction is to occur via the second communication modality and that local user output interaction is to occur via the first communication modality.

7. The system of claim 1, wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, comprises:

circuitry for transmitting the at least one message to continue the communication, the at least one message indicating that local user input interaction is to occur via the second communication modality and that local user output interaction is to occur via the second communication modality.

8. The system of claim 1, wherein the first communication modality includes at least voice communication, and the second communication modality includes at least textual communication;

and wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, comprises;

circuitry for transmitting the at least one message to continue the communication, the at least one message indicating that a remote user is to be presented communication output including at least partially artificial speech that is derived from text entered by a local user.

9. The system of claim 1, further comprising:

circuitry for ascertaining at least one intimacy setting that is established prior to receipt of the at least one notification,

wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, is operational responsive at least partly to the circuitry for ascertaining.

10. The system of claim 9, wherein the circuitry for ascertaining at least one intimacy setting that is established prior to receipt of the at least one notification comprises:

circuitry for detecting that the at least one intimacy setting indicates that a local user is willing to expose textual communications in response to voice communications.

11. The system of claim 1, further comprising:

circuitry for presenting a local user an option to select to participate in the communication with local user interaction via the first communication modality or with local user interaction at least partially via the second communication modality, the circuitry for presenting operational responsive at least partly to receipt of the at least one notification,

wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, is operational at least partially responsive to a selected option of the local user.

12. The system of claim 1, further comprising:

circuitry for presenting to a local user converted user communication data that is converted from corresponding to the first communication modality to corresponding to the second communication modality.

13. The system of claim 12, further comprising:

circuitry for causing user communication data to be converted from corresponding to the first communication modality to corresponding to the second communication modality to produce the converted user communication data.

14. The system of claim 12, further comprising:

circuitry for receiving the converted user communication data from an external source.

15. The system of claim 14, wherein the circuitry for receiving the converted user communication data from an external source comprises:

circuitry for receiving the converted user communication data from the external source, the external source including at least a remote communication device associated with a remote user that is participating in the communication.

16. The system of claim 14, wherein the circuitry for receiving the converted user communication data from an external source comprises:

circuitry for receiving the converted user communication data from the external source, the external source including at least an external communication node.

17. The system of claim 1, further comprising:

circuitry for receiving from a remote communication device at least one other message to continue the communication, the at least one other message offering to alter at least one communication modality for the communication.

18. The system of claim 1, further comprising:

circuitry for negotiating a location or a communication device to perform a conversion of communication data based, at least in part, on bandwidth consumed by communication data corresponding to the first communication modality and bandwidth consumed by communication data corresponding to the second communication modality.

19. The system of claim 1, further comprising:

circuitry for accepting user communication data via the second communication modality to obtain user communication data corresponding to the second communication modality; and

circuitry for causing the user communication data corresponding to the second communication modality to be converted to converted user communication data corresponding to the first communication modality.

20. The system of claim 1, further comprising:

circuitry for accepting user communication data via at least one user input interface in accordance with the second communication modality for the communication; and

circuitry for presenting user communication data via at least one user output interface in accordance with the first communication modality for the communication.

21. The system of claim 1, further comprising:

circuitry for accepting user communication data via at least one user input interface in accordance with the first communication modality for the communication; and

circuitry for presenting user communication data via at least one user output interface in accordance with the second communication modality for the communication.

22. The system of claim 1, further comprising:

circuitry for accepting user communication data via at least one user input interface in accordance with the second communication modality for the communication; and

circuitry for presenting user communication data via at least one user output interface in accordance with the second communication modality for the communication.

23. The system of claim 1, further comprising:

circuitry for receiving converted remote user communication data that has been converted from corresponding to the first communication modality to corresponding to the second communication modality by a remote communication device associated with a remote user that is participating in the communication.

24. The system of claim 23, further comprising:

circuitry for accepting local user communication data via the second communication modality to obtain local user communication data corresponding to the second communication modality;

circuitry for causing the local user communication data corresponding to the second communication modality to be converted to converted local user communication data corresponding to the first communication modality; and

circuitry for transmitting the converted local user communication data corresponding to the first communication modality to the remote communication device.

25. The system of claim 1, further comprising:

circuitry for receiving remote user communication data corresponding to the first communication modality;

circuitry for causing the remote user communication data corresponding to the first communication modality to be converted to converted remote user communication data corresponding to the second communication modality; and

circuitry for presenting the converted remote user communication data corresponding to the second communication modality to a local user via at least one user output interface in accordance with the second communication modality.

26. The system of claim 1, wherein the first communication modality includes at least voice communication, and the second communication modality includes at least textual communication;

and wherein the circuitry for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, comprises;

circuitry for transmitting a first message to accept the communication; and

circuitry for transmitting a second message to indicate that the local user interaction is to occur at least partially in accordance with the textual communication.

27. The system of claim 26, wherein:

the circuitry for transmitting a first message to accept the communication includes at least;

circuitry for transmitting the first message to answer a voice call or establish a voice connection; and

the circuitry for transmitting a second message to indicate that the local user interaction is to occur at least partially in accordance with the textual communication includes at least;

circuitry for transmitting the second message to cause a remote communication device to play an audible message to a remote user to indicate that the local user interaction is to occur at least partially in accordance with the textual communication.

28. The system of claim 27, wherein the second message includes at least the audible message, and the audible message includes at least sounds in a voice of a local user for the remote user to hear.

29. The system of claim 1, wherein the circuitry for transmitting as the at least one message, if the circuitry for determining if at least one environmental condition exists with respect to the local communication device determines that the at least one environmental condition exists with respect to the local communication device, at least one message indicating that local user interaction with respect to the local communication device will be (a) at least partly via a textual communication modality if the circuitry for determining if the identity of the remote user determines that the identity of the remote user does not match that of one or more particular persons;

and (b) at least partly via a video communication modality if the circuitry for determining if the identity of the remote user determines that the identity of the remote user is a match for that of one or more particular persons comprises;

circuitry for transmitting as the at least one message, if the circuitry for determining if at least one environmental condition exists with respect to the local communication device determines that the at least one environmental condition exists, at least one message requesting to the remote communication device that the communication be migrated fully to a single modality communication using the second communication modality.

30. A computer program product, comprising:

at least one non-transitory computer readable medium including at least;

(a) one or more instructions for receiving at least one notification of a communication from a remote communication device that corresponds to a first communication modality, the at least one notification including at least an incoming voice call notification; and

(b) one or more instructions for transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, including at least;

(1) one or more instructions for determining if at least one environmental condition exists with respect to the local communication device, including at least;

(A) one or more instructions for determining if the local communication device is traveling in a moving vehicle;

(2) one or more instructions for determining if an identity of a remote user associated with the remote communication modality matches that of one or more particular persons; and

(3) one or more instructions for transmitting as the at least one message, if the one or more instructions for determining if at least one environmental condition exists with respect to the local communication device determine that the at least one environmental condition exists with respect to the local communication device, at least one message indicating that local user interaction with respect to the local communication device will be (a) at least partly via a textual communication modality if the one or more instructions for determining if the identity of the remote user determine that the identity of the remote user does not match that of one or more particular persons; and

(b) at least partly via a video communication modality if the one or more instructions for determining if the identity of the remote user determine that the identity of the remote user is a match for that of one or more particular persons;

including at least;

(A) one or more instructions for transmitting as the at least one message, if the one or more instructions for determining if the local communication device is traveling in a moving vehicle determine that the local communication device is traveling in a moving vehicle, at least one message indicating that local user interaction with respect to the local communication device will be (a) at least partly via a textual communication modality if the one or more instructions for determining if an identity of a remote user determine that the identity of the remote user does not match that of one or more particular persons; and

(b) at least partly via a video communication modality if the one or more instructions for determining if an identity of a remote user determine that the identity of the remote user is a match for that of one or more particular persons.

31. A method comprising:

(a) receiving at least one notification of a communication from a remote communication device that corresponds to a first communication modality, the at least one notification including at least an incoming voice call notification;

(b) transmitting at least one message to continue the communication, the at least one message indicating that local user interaction with a local communication device during a continuation of the communication is to occur at least partially via a second communication modality, including at least;

(1) determining if at least one environmental condition exists with respect to the local communication device, including at least;

(A) determining if the local communication device is traveling in a moving vehicle;

(2) determining if an identity of a remote user associated with the remote communication modality matches that of one or more particular persons; and

(3) transmitting as the at least one message, if it is determined that the at least one environmental condition exists with respect to the local communication device, at least one message indicating that local user interaction with respect to the local communication device will be (a) at least partly a textual communication modality based at least in part on a determination that the identity of the remote user does not match that of one or more particular persons; and

(b) at least partly a video communication modality based at least in part on a determination that the identity of the remote user is a match for that of the one or more particular persons;

including at least;

(A) transmitting as the at least one message, if there is a determination that the local communication device is traveling in a moving vehicle, at least one message indicating that local user interaction with respect to the local communication device will be (a) at least partly via a textual communication modality if there is a determination that the identity of the remote user does not match that of one or more particular persons; and

(b) at least partly via a video communication modality if there is a determination that the identity of the remote user is a match for that of one or more particular persons; and

wherein at least one of the receiving at least one notification of a communication or the transmitting at least one message to continue the communication is performed at least in part with one or more processing devices.