INTERPRETATION OF GESTURES TO PROVIDE VISUAL QUEUES

• US 20100257462A1
• Filed: 04/01/2009
• Published: 10/07/2010
• Est. Priority Date: 04/01/2009
• Status: Abandoned Application

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: Minhazuddin, Muneyb, Barrett, Karen L., Iles, Verna L., Yazbek, Daniel
• Application Number:
  US12/416,702
• Publication Number:
  US 20100257462A1
• Time in Patent Office: Days
• US Class Current: 715/756
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

The present invention provides systems, devices, and methods for obtaining, analyzing, and sharing gesture information between participants of a communication session. The present invention is particularly well suited for use in video communication sessions where participants may want to be aware of the indications that their gestures are giving to other participants. The present invention is also capable of being employed in non-video communication sessions to share gesture information and other visual indicia to other participants that cannot otherwise view the speaking/acting participant.

Claims

1. A method, comprising:

receiving video input of a first participant while the first participant is engaged in a communication session with at least a second participant;

analyzing the video input of the first participant for gesture information; and

providing the gesture information to at least one participant engaged in the communication session.

2. The method of claim 1, further comprising:

interpreting the gesture information based on a known culture of the at least a second participant; and

associating the interpretation of the gesture information with the gesture information.

3. The method of claim 2, further comprising providing the gesture information and the interpretation of the gesture information to the first participant.

4. The method of claim 3, wherein the interpretation of the gesture information is provided to the first participant via a graphical user interface associated with the first participant.

5. The method of claim 3, wherein the interpretation of the gesture information is provided to the first participant via an audible mechanism.

6. The method of claim 2, wherein interpreting comprises:

determining a culture associated with the at least a second participant;

mapping the gesture information received from the video input with selected gesture information for the culture associated with the at least a second participant; and

wherein the interpretation of the gesture information comprises the mapping information and the selected gesture information.

7. The method of claim 1, further comprising:

determining a possible meaning of the gesture information based on a known culture of the first participant;

associating the possible meaning of the gesture information with the gesture information; and

providing the gesture information and the possible meaning of the gesture information to the at least a second participant.

8. The method of claim 7, wherein determining a the possible meaning of the gesture information comprises:

determining a culture associated with the first participant;

mapping the gesture information received from the video input with selected gesture information for the culture associated with the first participant; and

wherein the interpretation of the gesture information comprises the mapping information and the selected gesture information.

9. The method of claim 7, wherein determining a the possible meaning of the gesture information comprises:

querying the first user for an intended meaning of their gesture;

receiving a response to the query from the first user; and

including at least a portion of the response in the possible meaning of the gesture information.

10. A computer readable storage medium comprising processor executable instruction operable to perform, when execute, the method of claim 1.

11. A communication device, comprising:

a user input operable to capture video images of a first participant during a communication session with at least a second participant; and

a gesture monitoring module operable to analyze the captured video images of the first participant for gesture information and provide the gesture information to at least one participant of the communication session.

12. The device of claim 11, further comprising a behavioral suggestion module operable to interpret the gesture information based on a known culture of the at least a second participant and associate the interpretation of the gesture information with the gesture information.

13. The device of claim 12, further comprising a user output operable to provide the gesture information and the interpretation of the gesture information to the first participant.

14. The device of claim 13, wherein the user output comprises at least one of a graphical user interface and an audible user interface.

15. The device of claim 12, further comprising a participant datastore, wherein the behavioral suggestion module is operable to reference the participant datastore to determine a culture associated with the at least a second participant and then map the gesture information received from the video images with selected gesture information for the culture associated with the at least a second participant and then include the mapping information and the selected gesture information in the interpretation of the gesture information.

16. The device of claim 11, further comprising a behavioral suggestion module operable to determine a possible meaning of the gesture information based on a known culture of the first participant, associate the possible meaning of the gesture information with the gesture information, and then provide the gesture information and the possible meaning of the gesture information to the at least a second participant.

17. The device of claim 16, comprising a participant datastore, wherein the behavioral suggestion module is operable to reference the participant datastore to determine a culture associated with the first participant, map the gesture information received from the video input with selected gesture information for the culture associated with the first participant, and include the mapping information and the selected gesture information in the interpretation of the gesture information.

18. The device of claim 17, wherein the behavioral suggestion module is operable to determine a possible meaning of the gesture information by preparing and sending a query to the first user for an intended meaning of their gesture, receive a response to the query from the first user, and then include at least a portion of the response in the possible meaning of the gesture information.

19. A communication system including a first communication device in communication with a second communication device via a communication network, the communication system comprising:

a communication application operable to capture video images of a first participant associated with the first communication device during a communication session with at least a second participant, analyze the captured video images of the first participant for gesture information and provide the gesture information to at least one participant of the communication session.

20. The system of claim 19, wherein the communication application is further operable to interpret the gesture information based on a known culture of the at least a second participant and associate the interpretation of the gesture information with the gesture information and provide the gesture information and the interpretation of the gesture information to the first participant.

21. The system of claim 19, wherein the communication application is further operable to determine a possible meaning of the gesture information based on a known culture of the first participant, associate the possible meaning of the gesture information with the gesture information, and then provide the gesture information and the possible meaning of the gesture information to the at least a second participant.