PROVIDING DESCRIPTIONS OF NON-VERBAL COMMUNICATIONS TO VIDEO TELEPHONY PARTICIPANTS WHO ARE NOT VIDEO-ENABLED

• US 20100253689A1
• Filed: 04/07/2009
• Published: 10/07/2010
• Est. Priority Date: 04/07/2009
• Status: Abandoned Application

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: Michaelis, Paul Roller, Dinicola, Brian K.
• Application Number:
  US12/419,705
• Publication Number:
  US 20100253689A1
• Time in Patent Office: Days
• US Class Current: 345/467
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

The use of detected non-verbal communications cues, and summaries thereof, are used to provide audible, textual and/or graphical input to listeners who for any reason do not have the benefit of being able to see the non-verbal communications cues, or speakers about mannerisms or other non-verbal signals they are sending to other parties. This includes cues that are given while speaking or listening. The detection of one or more of an emotion and gesture could also trigger a dynamic behavior. For example, certain emotions and gestures could be characterized as “key emotions” or “key gestures” and a particular action associated with the detection of one of these “key emotions” or “key gestures.”

Claims

1. A method for providing non-verbal communications to non-video enabled video conference participants comprising:

recognizing one or more of a gesture and an emotion;

determining information describing the one or more of the gesture and the emotion; and

forwarding, based on preference information, the information to one or more destinations, wherein the one or more destinations are video conference endpoints.

2. The method of claim 1, wherein the one or more destinations are non-video enabled conference endpoints.

3. The method of claim 1, further comprising determining if one or more gestures are a key gesture.

4. The method of claim 3, further comprising performing one or more actions based on the key gesture.

5. The method of claim 1, further comprising determining if one or more emotions are a key gesture.

6. The method of claim 5, further comprising performing one or more actions based on the key gesture.

7. The method of claim 1, further comprising generating a transcript including the information.

8. The method of claim 1, where the information is one or more of text, an emoticon, a message, an audio description and a graphic.

9. The method of claim 1, further comprising associating a profile with a video conference, the profile specifying one or more types of the one or more of a gesture and an emotion that are to be described and the modality for providing the description.

10. The method of claim 1, further comprising:

for conference participants who have a single monaural audio-only endpoint, providing the information as audio descriptions via a “

whisper”

announcement;

for conference participants who have more than one monaural audio-only endpoint, using one of the endpoints for listening to a conference and utilizing the other endpoint to receive audio descriptions of the information;

for conference participants who have a binaural audio-only endpoint, using one of the channels for listening to conference discussions, and utilizing the other endpoint to receive audio descriptions of the information;

for conference participants who have an audio endpoint that is email capable, SMS capable, or IM capable, sending the information via one or more of these respective interfaces; and

for conference participants who have an audio endpoint that is capable of receiving and displaying streaming text, scrolling the information across an endpoint'"'"'s display.

11. A computer-readable storage media having stored thereon instructions that, when executed, perform the steps of claim 1.

12. One or more means for performing the steps of claim 1.

13. A system that provides non-verbal communications to non-video enabled video conference participants comprising:

a gesture recognition module that recognizes one or more of a gesture and an emotion;

a messaging module that determines information describing the one or more of the gesture and the emotion and forwards, based on preference information, the information to one or more destinations, wherein the one or more destinations are video conference endpoints.

14. The system of claim 13, wherein the one or more destinations are non-video enabled conference endpoints.

15. The system of claim 13, further comprising a gesture reaction module that determines if one or more gestures are a key gesture and performs one or more actions based on the key gesture.

16. The system of claim 13, further comprising a gesture reaction module that determines if one or more emotions are a key gesture and performs one or more actions based on the key gesture.

17. The system of claim 13, further comprising a transcript module that generates a transcript including the information.

18. The system of claim 13, where the information is one or more of text, an emoticon, a message, an audio description and a graphic.

19. The system of claim 13, further comprising a profile, the profile associated with a video conference, the profile specifying one or more types of the one or more of a gesture and an emotion that are to be described and the modality for providing the description.

20. The system of claim 13, wherein:

for conference participants who have a single monaural audio-only endpoint, providing the information as audio descriptions via a “

whisper”

announcement;

for conference participants who have more than one monaural audio-only endpoint, using one of the endpoints for listening to a conference and utilizing the other endpoint to receive audio descriptions of the information;

for conference participants who have a binaural audio-only endpoint, using one of the channels for listening to conference discussions, and utilizing the other endpoint to receive audio descriptions of the information;

for conference participants who have an audio endpoint that is email capable, SMS capable, or IM capable, sending the information via one or more of these respective interfaces; and

for conference participants who have an audio endpoint that is capable of receiving and displaying streaming text, scrolling the information across an endpoint'"'"'s display.