Using an avatar in a videoconferencing system

• US 9,432,626 B2
• Filed: 10/15/2015
• Issued: 08/30/2016
• Est. Priority Date: 08/01/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Liu, Eric HC
• Primary Examiner(s): TRAN, QUOC DUC
• Application Number:
  US14/884,607
• Publication Number:
  US 20160037130A1
• Time in Patent Office: 320 Days
• Field of Search: 348/14.01, 348/14.03, 348/14.07, 348/14.1
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

Systems and methods for videoconferencing using an avatar are described. The presence of a user may be detected by analyzing video captured by a digital camera. The avatar may be provided to a remote device to represent the detected user.

Claims

1. A method for initiating videoconferences, the method comprising:

receiving, at a processing circuit, video data and audio data of an environment associated with a first device;

determining, by the processing circuit, presence of a first device user in the environment based on at least one of the video data and the audio data;

identifying, by the processing circuit, the first device user based on at least one of the video data and the audio data;

selecting, by the processing circuit, an avatar that represents the first device user in response to identifying the first device user; and

causing, by the processing circuit, a videoconference to be initiated between the first device and a second device by presenting display data that includes the selected avatar to the second device.

2. The method of claim 1, further comprising:

generating an image representative of the video data from the environment associated with the first device;

causing the image to be presented on the second device.

3. The method of claim 2, further comprising:

generating an updated image that renders the avatar that represents the first device user in the image of the environment; and

causing the image to be replaced with the updated image on the second device.

4. The method of claim 3, wherein the updated image is generated in response to determining the presence of the first device user.

5. The method of claim 3, wherein the updated image is generated in response to detecting movements of the first device user within the environment based on the video data.

6. The method of claim 1, further comprising determining that a command for initiating the videoconference has been received, wherein the videoconference is initiated in response to determining that the command has been received.

7. The method of claim 6, wherein the command is a gesture from the first device user detected from the video data or from a second device user detected from video data associated with the second device.

8. The method of claim 6, wherein the command is a voice command from the first device user detected from the video data or from a second device user detected from video data associated with the second device.

9. The method of claim 6, further comprising replacing the display data that includes the selected avatar with the video data in response to determining that the command has been received.

10. A system for initiating videoconferences comprising a processing circuit configured to:

receive video data and audio data of an environment associated with a first device;

determine presence of a first device user in the environment based on at least one of the video data and the audio data;

identify the first device user based on at least one of the video data and the audio data;

select an avatar that represents the first device user in response to identifying the first device user; and

cause a videoconference to be initiated between the first device and a second device by presenting display data that includes the selected avatar to the second device.

11. The system of claim 10, wherein the processing circuit is further configured to:

generate an image representative of the video data from the environment associated with the first device;

cause the image to be presented on the second device.

12. The system of claim 11, wherein the processing circuit is further configured to:

generate an updated image that renders the avatar that represents the first device user in the image of the environment; and

cause the image to be replaced with the updated image on the second device.

13. The system of claim 12, wherein the updated image is generated in response to determining the presence of the first device user.

14. The system of claim 12, wherein the updated image is generated in response to detecting movements of the first device user within the environment based on the video data.

15. The system of claim 10, wherein the processing circuit is further configured to determine that a command for initiating the videoconference has been received, wherein the videoconference is initiated in response to determining that the command has been received.

16. The system of claim 15, wherein the command is a gesture from the first device user detected from the video data or from a second device user detected from video data associated with the second device.

17. The method of claim 15, wherein the command is a voice command from the first device user detected from the video data or from a second device user detected from video data associated with the second device.

18. The method of claim 15, further comprising replacing the display data that includes the selected avatar with the video data in response to determining that the command has been received.

19. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for initiating videoconferences, the method comprising:

receiving video data and audio data of an environment associated with a first device;

determining presence of a first device user in the environment based on at least one of the video data and the audio data;

identifying the first device user based on at least one of the video data and the audio data;

selecting an avatar that represents the first device user in response to identifying the first device user; and

causing a videoconference to be initiated between the first device and a second device by presenting display data that includes the selected avatar to the second device.