Using an avatar in a videoconferencing system

• US 10,225,519 B2
• Filed: 07/28/2017
• Issued: 03/05/2019
• Est. Priority Date: 08/01/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Liu, Eric H C
• Primary Examiner(s): Tran, Quoc D
• Application Number:
  US15/663,399
• Publication Number:
  US 20170332046A1
• Time in Patent Office: 585 Days
• Field of Search: 348 1401, 348 1403, 348 1407, 348 1408
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

Systems and methods for videoconferencing using an avatar are described. The presence of a user may be detected by analyzing video captured by a digital camera. The avatar may be provided to a remote device to represent the detected user.

Claims

1. A method for facilitating interactions between users, the method comprising:

receiving camera data from a camera device associated with a computing device;

determining, from the received camera data, movement information of a device user in an environment;

receiving a selection of an avatar that represents the device user in a communication session;

presenting, in the communication session, display data that includes the selected avatar that represents the device user and a user identifier that identifies the device user in which the user identifier is positioned in conjunction with the selected avatar and in which the display data corresponds to the movement information of the device user in relation to the environment; and

modifying the display data that includes the avatar in response to receiving updated camera data from the camera device and determining updated movement information of the device user from the updated camera data.

2. The method of claim 1, wherein the camera device is integrated into the computing device.

3. The method of claim 1, wherein the camera device is in communication with the computing device.

4. The method of claim 1, further comprising generating a background graphic in which the avatar is presented.

5. The method of claim 1, further comprising receiving an indication from the device user to change the avatar to one of a plurality of avatars.

6. The method of claim 1, wherein retrieving the avatar further comprises accessing a profile associated with the device user, wherein the profile is associated with the avatar that was selected from a plurality of avatars and wherein the profile is associated with a username corresponding to the device user and wherein the username is presented along with the avatar in the display data.

7. The method of claim 1, further comprising detecting presence of the device user based on the movement information of the device user in the environment.

8. The method of claim 7, wherein the avatar is retrieved in response to detecting the presence of the device user in the environment.

9. The method of claim 1, further comprising initiating a communication session that presents the modified display data in which the avatar corresponding to the updated movement information of the device user in the environment is included.

10. The method of claim 9, wherein the communication session is a videoconference that is initiated between the computing device and another computing device, wherein the videoconference presents the display data that includes at least the presentation of the avatar to the another computing device.

11. The method of claim 10, further comprising:

detecting presence of the device user based on the movement information of the device user in the environment; and

generating an indication of the presence of the device user, wherein the indication notifies other device users that the device user is available for participating in the videoconference.

12. The method of claim 10, further comprising:

receiving audio data from the computing device;

determining that the audio data includes a voice input from the device user; and

presenting the voice input in the videoconference.

13. The method of claim 12, further comprising:

receiving video data from the computing device; and

in response to receiving the voice input from the device user, replacing the avatar with the received video data.

14. The method of claim 9, wherein retrieving the avatar further comprises:

identifying other device users participating in the communication session; and

selecting the avatar from a plurality of avatars based on the identified other device users in the communication session.

15. The method of claim 1, further comprising accessing a profile associated with the device user, wherein the profile indicates other device users with whom the user has a social connection.

16. The method of claim 15, further comprising:

detecting presence of the device user based on the movement information of the device user in the environment; and

generating an indication of the presence of the device user, wherein the indication notifies the social connection that the device user is available for participating in a communication session.

17. A system for facilitating interactions between users, the system comprising:

a memory; and

a hardware processor that, when executing computer executable instructions stored in the memory, is configured to;

receive camera data from a camera device associated with a computing device;

determine, from the received camera data, movement information of a device user in an environment;

receive a selection of an avatar that represents the device user in a communication session;

present, in the communication session, display data that includes the selected avatar that represents the device user and a user identifier that identifies the device user in which the user identifier is positioned in conjunction with the selected avatar and in which the display data corresponds to the movement information of the device user in relation to the environment; and

modify the display data that includes the avatar in response to receiving updated camera data from the camera device and determining updated movement information of the device user from the updated camera data.

18. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for facilitating interactions between users, the method comprising:

receiving camera data from a camera device associated with a computing device;

determining, from the received camera data, movement information of a device user in an environment;

receiving a selection of an avatar that represents the device user in a communication session;

presenting, in the communication session, display data that includes the selected avatar that represents the device user and a user identifier that identifies the device user in which the user identifier is positioned in conjunction with the selected avatar and in which the display data corresponds to the movement information of the device user in relation to the environment; and

modifying the display data that includes the avatar in response to receiving updated camera data from the camera device and determining updated movement information of the device user from the updated camera data.