Enhanced Interface for Voice and Video Communications

• US 20090079813A1
• Filed: 09/23/2008
• Published: 03/26/2009
• Est. Priority Date: 09/24/2007
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: GestureTek Incorporated (Winning Brands Corp.)
• Inventors: Hildreth, Evan
• Granted Patent: US 8,325,214 B2
• Time in Patent Office: Days
• US Class Current: 348/14.30
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: H04M 2203/1025 of avatars
• CPC Class Codes: H04M 2203/253 where a visual mode is used instead of a voice mode
• CPC Class Codes: H04M 2203/6054 Biometric subscriber identification
• CPC Class Codes: H04M 3/42 Systems providing special services or facilities to subscribers specially adapted for wireless communication networks H04W4/00
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

An enhanced interface for voice and video communications, in which a gesture of a user is recognized from a sequence of camera images, and a user interface is provided include a control and a representation of the user. The process also includes causing the representation to interact with the control based on the recognized gesture, and controlling a telecommunication session based on the interaction.

Claims

1. A computer-implemented method comprising:

recognizing a gesture of a user from a sequence of camera images;

providing a user interface comprising a control and a representation of the user;

causing the representation to interact with the control based on the recognized gesture; and

controlling a telecommunication session based on the interaction.

2. The method of claim 1, wherein:

controlling the telecommunication session further comprises changing the telecommunication session from a first state to a second, different state, and

the first or second states comprise a standby state, a notification state, an outgoing call state, a connecting state, a mute state, a menu state, a connection options state, a direct dial state, a redial state, a search state, a browse state, a message menu state, a message playback state, or a configuration state.

3. The method of claim 1, wherein the telecommunication session further comprises a voice and video telecommunication session.

4. The method of claim 1, wherein controlling the telecommunication session further comprises changing the telecommunication session from a standby state to a call or menu state based on recognizing an engagement gesture.

5. The method of claim 1, further comprising:

determining an identity of the user; and

enabling the control based on the determined identity.

6. The method of claim 5, further comprising changing the telecommunication session from a connecting state to a call state only if the determined identity of the user matches an intended recipient of a call.

7. The method of claim 1, further comprising:

determining identities of users within the image; and

enabling or disabling the control based on at least one of the determined identities.

8. The method of claim 1, wherein controlling the telecommunication session further comprises changing the telecommunication session to a standby state based on recognizing a disengagement gesture.

9. The method of claim 1, further comprising focusing one of the camera images on the user.

10. The method of claim 9, wherein focusing the one of the camera images further comprises maintaining focus of a camera on the user, who is moving.

11. The method of claim 9, wherein focusing the one of the camera images further comprises centering the one of the camera images on the user.

12. The method of claim 1, further comprising localizing audio to focus on the user.

13. The method of claim 1, wherein:

recognizing a gesture of the user further comprises recognizing that a second user has performed a second engagement gesture after a first user has performed a first engagement gesture,

controlling the telecommunication session further comprises changing a focus to the second user based on recognizing that the second user has performed the second engagement gesture.

14. The method of claim 13, further comprising:

determining whether the first user has relinquished the focus,

wherein the focus is changed only if the first user has relinquished the focus.

15. The method of claim 14, wherein determining whether the first user has relinquished the focus further comprises determining whether the first user has finished speaking.

16. The method of claim 14, wherein determining whether the first user has relinquished the focus further comprises determining whether the first user has performed a relinquishment gesture.

17. The method of claim 1, further comprising:

determining an identity of the user,

wherein controlling the telecommunication session further comprises displaying, in a browse state, a set of contacts associated with the determined identity.

18. The method of claim 1, further comprising:

determining an identity of the user based on face recognition,

wherein controlling the telecommunication session further comprises transmitting the determined identity of the user to a recipient of a call placed by the user.

19. A device comprising a processor configured to:

recognize a gesture of a user from a sequence of camera images,

provide a user interface comprising a control and a representation of the user,

cause the representation to interact with the control based on the recognized gesture, and

control a telecommunication session based on the interaction.

20. A computer-readable medium encoded with a computer program comprising instructions that, when executed, operate to cause a computer to perform operations comprising:

recognizing a gesture of a user from a sequence of camera images;

providing a user interface comprising a control and a representation of the user;

causing the representation to interact with the control based on the recognized gesture; and

controlling a telecommunication session based on the interaction.