CONTEXTUAL INFORMATION DEPENDENT MODALITY SELECTION

• US 20110302247A1
• Filed: 06/02/2010
• Published: 12/08/2011
• Est. Priority Date: 06/02/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ramanathan, Rajesh, Srinivasan, Srivatsa K., Koppolu, Lokesh Srinivas, Narayanan, Giridhar Kalpathy
• Application Number:
  US12/792,033
• Publication Number:
  US 20110302247A1
• Time in Patent Office: Days
• US Class Current: 709/205
• CPC Class Codes: H04L 51/214 using selective forwarding
• CPC Class Codes: H04L 65/1094 Inter-user-equipment sessions transfer or sharing
• CPC Class Codes: H04L 65/401 wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/30 Profiles
• CPC Class Codes: H04M 3/42365 Presence services providing information on the willingness to communicate or the ability to communicate in terms of media capability or network connectivity
• CPC Class Codes: H04W 4/16 Communication-related supplementary services, e.g. call-transfer or call-hold

Abstract

Modality selection in establishing multimodal conversations is performed automatically based on contextual information in enhanced communication platforms. Automata in client machines determine how a client machine chooses one or more modalities of a conversation invite based on contextual information such as computing device environment, network environment, user presence state, and comparable factors. Executed automata automatically join the user to a selected modality of a conversation or reject one.

Claims

1. A method executed at least in part in a computing device for providing contextual information dependent call modality selection, the method comprising:

receiving a multimodal call request;

determining a state of a user based on known information associated with at least one from a set of;

a client device characteristic, a network characteristic, a user characteristic, and a call characteristic;

determining a rule applicable to the state of the user; and

one of;

accepting and rejecting at least one modality of the requested call based on the applicable rule.

2. The method of claim 1, wherein the client device characteristic includes at least one from a set of:

available memory, available processing capacity, a video display capability, and an audio capability.

3. The method of claim 1, wherein the network characteristic includes at least one from a set of:

available bandwidth and supported modalities.

4. The method of claim 1, wherein the call characteristic includes at least one from a set of:

an importance level of a subject matter of the call, identities of participants in the call, and modalities of the call.

5. The method of claim 1, wherein the user characteristic includes at least one from a set of:

user'"'"'s presence, user'"'"'s relationship with a requesting party for the call, user'"'"'s currently active conversations through other client devices, user'"'"'s currently active conversations through the client device, and user'"'"'s currently active applications on the client device.

6. The method of claim 5, wherein the user characteristic further includes a type of, a number of, and an interaction of the user with the currently active applications on the client device.

7. The method of claim 5, wherein the client device and the other client devices include one from a set of:

a cellular phone, a desktop phone, a desktop computer, a laptop computer, and a smart phone.

8. The method of claim 1, wherein the rule is defined by a user specified condition and at least one automatically determined data point.

9. The method of claim 8, wherein the condition specifies when a particular modality is to be accepted.

10. The method of claim 1, further comprising evaluating a plurality of applicable rules for the state of the user.

11. A computing device for facilitating multimodal conversations with contextual information dependent call modality selection, the computing device comprising:

a memory;

a processor coupled to the memory, the processor executing a communication application, wherein the communication application includes;

a rule engine configured to receive a plurality of conditions and corresponding data points to be interpreted as rules applicable to distinct states of the user;

a plurality of media sessions, each corresponding to a modality, configured to create rules for corresponding modalities and interpret the rules as properties;

a conversation model configured to create rules for the entire call and interpret the rules as properties such that at least one modality of the requested call is one of accepted and rejected based on one or more applicable rules.

12. The computing device of claim 11, wherein the states of the user are based on at least one from a set of:

available memory, available processing capacity, a video display capability, and an audio capability of the client device;

available bandwidth and supported modalities of a network;

an importance level of a subject matter, identities of participants, and modalities of the call; and

user'"'"'s presence, currently active conversations through other client devices, currently active conversations through the client device, and currently active applications on the client device.

13. The computing device of claim 11, further comprising a configuration data store adapted to store sets of key value pairs for determining the conditions that affect an automatic acceptance behavior of the communication application.

14. The computing device of claim 11, the communication application is configured to enable a user to at least one of:

accept a new modality for an established conversation through a new end point and move existing modalities to the new end point.

15. The computing device of claim 11, wherein the communication application is configured to enable a third party application to modify at least one rule by connecting to the rule engine through an interface.

16. The computing device of claim 11, wherein the rules created by the conversation model trump the rules created by the media sessions.

17. The computing device of claim 11, wherein an action decided based on evaluating the applicable rules is queued as one of a deferred action and an asynchronous action to be invoked subsequently on a media session.

18. A computer-readable storage medium with instructions stored thereon for managing contextual information dependent call modality selection, the instructions comprising:

receiving a multimodal call request;

determining a state of a user based on known information associated with at least one from a set of;

a client device characteristic comprising one or more of;

available memory, available processing capacity, a video display capability, and an audio capability,

a network characteristic comprising one or more of;

available bandwidth and supported modalities,

a user characteristic comprising one or more of;

user'"'"'s presence, user'"'"'s currently active conversations through other client devices, user'"'"'s currently active conversations through the client device, and user'"'"'s currently active applications on the client device, and

a call characteristic comprising one or more of;

an importance level of a subject matter of the call, identities of participants in the call, and modalities of the call;

determining a rule applicable to the state of the user; and

one of;

accepting and rejecting at least one modality of the requested call based on the applicable rule.

19. The computer-readable storage medium of claim 18, wherein the instructions further comprise:

providing a notification to the user through a user interface such that the user is enabled to overrule automatic selection of at least one of the modalities of the requested call.

20. The computer-readable storage medium of claim 18, wherein the rules are specified as corresponding pairs of conditions and data points, and the user is enabled to define a portion of the conditions.