Facial gesture driven animation of non-facial features

• US 10,540,800 B2
• Filed: 10/23/2017
• Issued: 01/21/2020
• Est. Priority Date: 12/23/2014
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Tong, Xiaofeng, Li, Qiang Eric, Du, Yangzhou, Li, Wenlong, Yip, Johnny C.
• Primary Examiner(s): Du, Haixia
• Application Number:
  US15/791,222
• Publication Number:
  US 20180204368A1
• Time in Patent Office: 820 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

Examples of systems and methods for non-facial animation in facial performance driven avatar system are generally described herein. A method for facial gesture driven body animation may include capturing a series of images of a face, and computing facial motion data for each of the images in the series of images. The method may include identifying an avatar body animation based on the facial motion data, and animating a body of an avatar using the avatar body animation.

Claims

1. A non-transitory computer-readable storage device having stored thereon instructions which, when executed by one or more processors, cause a computing device to:

receive a plurality of images from a camera, at least one of the plurality of images including an image of a face of a user;

detect a facial expression of the face of the user using the at least one of the plurality of images;

responsive to receipt of a user input selection to enter a body animation mode, identify an avatar body animation based on the facial expression of the user, wherein the identified avatar body animation includes animation of one or more avatar body parts other than a face of the avatar; and

trigger animation of at least an arm or a leg of an avatar based on the identified avatar body animation, wherein the avatar corresponds to the user.

2. The non-transitory computer-readable storage device of claim 1, wherein the instructions comprise instructions to cause the computing device to:

cause animation of an avatar face of the avatar based at least in part on the facial expression.

3. The non-transitory computer-readable storage device of claim 1, wherein the instructions comprise instructions to cause the computing device to:

detect a change of the facial expression; and

trigger an animation of the avatar based on the detected change.

4. A method, comprising:

receiving a plurality of images from a camera, at least one of the plurality of images including an image of a face of a user;

detecting a facial expression of the face of the user using the at least one of the plurality of images;

responsive to receipt of a user input selection to enter a body animation mode, identifying an avatar body animation based on the facial expression of the user, the identified avatar body animation including animation of one or more avatar body parts other than a face of the avatar; and

triggering animation of at least an arm or a leg of an avatar based on the identified avatar body animation, wherein the avatar corresponds to the user.

5. The method of claim 4, comprising:

causing animation of an avatar face of the avatar based at least in part on the detected facial expression.

6. The method of claim 4, comprising:

detecting a change of the facial expression; and

triggering an animation of the avatar based on the detected change.

7. A system, comprising:

means for receiving a plurality of images from a camera, at least one of the plurality of images including an image of a face of a user;

means for detecting a facial expression of the face of the user using the at least one of the plurality of images;

means for identifying, responsive to receipt of a user input selection to enter a body animation mode, an avatar body animation based on the facial expression of the user, wherein the identified avatar body animation includes animation of one or more avatar body parts other than a face of the avatar; and

means for triggering animation of at least an arm or a leg of an avatar based on the identified avatar body animation, wherein the avatar corresponds to the user.

8. The system of claim 7, further comprising:

means for causing animation of an avatar face of the avatar based at least in part on the detected facial expression.

9. The system of claim 7, further comprising:

means for detecting a change of the facial expression; and

means for triggering an animation of the avatar based on the detected change.

10. A system, comprising:

a non-transitory computer-readable storage device having stored thereon instructions; and

one or more processors to execute the instructions to;

receive a plurality of images from a camera, at least one of the plurality of images including an image of a face of a user;

detect a facial expression of the face of the user using the at least one of the plurality of images;

responsive to receipt of a user input selection to enter a body animation mode, identify an avatar body animation based on the facial expression of the user, wherein the identified avatar body animation includes animation of one or more avatar body parts other than a face of the avatar; and

trigger animation of at least an arm or a leg of an avatar based on the identified avatar body animation, wherein the avatar corresponds to the user.

11. The system of claim 10, further comprising the camera.

12. The system of claim 10, further comprising:

a microphone; and

at least one speaker.

13. The system of claim 10, further comprising a wireless interface.

14. The system of claim 10, further comprising a display.

15. The system of claim 14, wherein the one or more processors are to execute the instructions to cause the avatar to appear animated on the display.