Recognition of human gestures by a mobile phone

• US 8,817,061 B2
• Filed: 07/02/2007
• Issued: 08/26/2014
• Est. Priority Date: 07/02/2007
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Shaffer, Shmuel, Jain, Mukul, Patel, Labhesh, Kumar, Sanjeev
• Primary Examiner(s): MILLER, BRANDON J
• Application Number:
  US11/824,655
• Publication Number:
  US 20090009588A1
• Time in Patent Office: 2,612 Days
• Field of Search: 348/14.01, 348/14.02, 348/14.03, 348/14.05, 348 1407- 1409, 348/14.1, 348/14.16
• US Class Current: 348/14.01
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/62 user interface aspects of conference calls
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

In one embodiment, a method includes electronically detecting a gesture of a user listening to a speaker via a communication device, and generating an audible and/or visual response that corresponds to the gesture. The audible and/or visual response is then communicated to the speaker. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

Claims

1. A method comprising:

receiving affirmative and negative gesture responses from a plurality of audio-only participants of a conference system listening, via a plurality of endpoint devices, to a remote participant of the conference system, the affirmative and negative gesture responses being made in response to one or more statements of the remote participant and electronically detected using the endpoint devices;

generating statistics based on a percentage or number of affirmative gesture responses and a percentage or number of negative gesture responses received from the plurality of audio-only participants;

communicating the statistics to the remote participant via a sensory output.

2. The method of claim 1 wherein the sensory output comprises an audible and/or visual response.

3. The method of claim 1 wherein the detecting occurs during a sampling period.

4. The method of claim 1 wherein the remote participant is connected to the conference session via a communication device having a display screen, and further wherein the communicating of the statistics comprises graphically displaying on the display screen the percentage or number of the affirmative responses and a percentage or number of the negative responses.

5. The method of claim 1 wherein the affirmative and negative gesture responses are detected by sensing head movements of the one or more audio-only participant utilizing motion detectors respectively attached to or incorporated within the endpoint devices of the participants.

6. The method of claim 1 wherein the endpoint devices comprise at least one mobile phone.

7. The method of claim 1 wherein the endpoint devices comprise at least one headset or earpiece device communicatively coupled with a mobile phone.

8. The method of claim 1 wherein the affirmative and negative responses are received via a data or control channel of a network, the data or control channel being separate from a voice channel utilized for communication of the one or more statements to the participants.

9. The method of claim 1 wherein each of the affirmative responses corresponds to an up-and-down head movement and each of the negative responses corresponds to a side-to-side head movement.

10. A system comprising:

a first server that connects with a plurality of endpoint devices each configured with a motion detector for detecting gestures of an audio-only participant of a conference system, the conference system comprising a plurality of audio-only participants, the motion detector producing an affirmative output responsive to an up-and-down gesture and a negative output responsive to a side-to-side gesture, the first server connecting with the endpoint devices over a network; and

a second server coupled over the network with the endpoint devices for receiving the affirmative and negative responses from each of a set of the endpoint devices and for generating an output that reflects a percentage or number of the affirmative responses and a percentage or number of the negative responses received from the plurality of audio-only participants.

11. The system of claim 10 wherein the output comprises an audible and/or visual gesture, and wherein the second server is further operable to communicate the audible and/or visual output to the set of the endpoint devices.

12. An apparatus comprising:

one or more processors; and

a memory comprising one or more instructions executable at the processors, the one or more processors being operable, when executing the instructions, to;

receive affirmative and negative gesture responses from a plurality of audio-only participants of a conference system listening, via a plurality of endpoint devices, to a remote participant of the conference system, the affirmative and negative gesture responses being made in response to one or more statements of the remote participant and electronically detected by the endpoint devices;

generate statistics based on a percentage or number of affirmative gesture responses and a percentage or number of negative gesture responses received from the plurality of audio-only participants; and

communicate the statistics to the remote participant via a sensory output.

13. The apparatus of claim 12 wherein the sensory output comprises an audible and/or visual response.