Method for sharing emotions through the creation of three-dimensional avatars and their interaction

• US 10,347,028 B2
• Filed: 02/09/2018
• Issued: 07/09/2019
• Est. Priority Date: 02/13/2012
• Status: Active Grant

• Current Assignee: Mood Me Belgium SPRL
• Original Assignee: Mood Me Belgium SPRL
• Inventors: Tarquini, Massimiliano, De Keyser, Olivier C., Ligi, Allessandro
• Primary Examiner(s): Wilson, Nicholas R
• Application Number:
  US15/893,077
• Publication Number:
  US 20180232929A1
• Time in Patent Office: 515 Days
• Field of Search: None
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2213/04 Animation description language
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations

Abstract

A two-dimensional image is transformed into at least one portion of a human or animal body into a three-dimensional model. An image is acquired that includes the at least one portion of the human or animal body. An identification is made of the at least one portion within the image. Searches are made for features indicative of the at least one portion of the human or animal body within the at least one portion. One or more identifications are made of a set of landmarks corresponding to the features. An alignment is a deformable mask including the set of landmarks. The deformable mask includes a number of meshes corresponding to the at least one portion of the human or animal body. The 3D model is animated by dividing it into concentric rings, quasi rings and applying different degrees of rotation to each ring.

Claims

1. A system comprising:

at least one camera capable of acquiring at least one first image comprising a representation of at least a portion of a face; and

at least one processor configured to;

detect a plurality of landmarks in the at least one first image, the plurality of landmarks corresponding to respective features of the face;

generate a three-dimensional model of the face based, at least in part, on the plurality of detected landmarks;

in response to a request to incorporate at least one object absent from the at least one first image, generate a series of subsequent images, each subsequent image comprising a representation of at least a portion of the face generated from the three-dimensional model and a representation of at least a portion of the at least one object;

wherein the incorporation of the at least one object includes defining one or more movements of one or more vertices, respectively, within the three-dimensional model, identifying an order and duration of the one or more movements, and applying the object to the three-dimensional model in the series of subsequent images; and

wherein the series of subsequent images are generated in 20 or more frames per second.

2. The system of claim 1, wherein the at least one camera comprises at least one camera integrated in a mobile device.

3. The system of claim 1, wherein the at least one camera comprises a webcam.

4. The system of claim 1, wherein the at least one object comprises at least one accessory, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face and a representation of the at least one accessory.

5. The system of claim 4, wherein the at least one accessory comprises an article, a product, a branded item, a hat, a wig, glasses, clothing, a costume and/or a gadget.

6. The system of claim 1, wherein the at least one object comprises at least one effect applied to the face, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the at least one effect applied thereto.

7. The system of claim 6, wherein the at least one effect comprises a texture and/or coloring applied to the face, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the texture and/or the coloring applied thereto.

8. The system of claim 7, wherein the at least one effect comprises coloring to lips of the face, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the coloring to the lips applied thereto.

9. The system of claim 7, wherein the at least one effect comprises coloring to skin of the face, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the coloring to the skin applied thereto.

10. The system of claim 7, wherein the at least one effect comprises texture to skin of the face, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the texture to the skin applied thereto.

11. The system of claim 7, wherein the at least one effect comprises make-up, and wherein the at least one processor is configured to generate at least one second image comprising a representation of at least a portion of the face having the make-up applied thereto.

12. The system of claim 1, wherein the at least one processor is configured to transform the three-dimensional model and/or transform the at least one object in response to a request for modification.

13. The system of claim 12, wherein the at least one processor is configured to generate the at least one second image based at least in part on the transformed three-dimensional model and/or transformed at least one object.

14. The system of claim 13, wherein the at least one processor is configured to apply a plurality of transformations to the three-dimensional model and/or the at least one object in response to the request for modification.

15. The system of claim 14, wherein the at least one processor is configured to generate a sequences of images, based at least in part on the plurality of transformations, to produce an animation of the face incorporating the at least one object.

16. The system of claim 1, wherein the request to incorporate the at least one object comprises a selection, by a user, of the at least one object to be incorporated in the at least one second image.

17. The system of claim 1, wherein the three-dimensional model comprises a deformable model and image information from the at least one first image.

18. The system of claim 1, wherein the three-dimensional model comprises a mesh textured with image information from the at least one first image.

19. The system of claim 1, wherein the at least one processor is configured to transmit the at least one second image to a remote location.

20. The system of claim 1, wherein the at least one processor is configured to transmit the at least one second image via messaging applications.

21. The system of claim 1, wherein the at least one processor is configured to transmit the at least one second image to a social networking platform.