Augmented expression system
First Claim
Patent Images
1. A method comprising:
- receiving a user input that assigns a graphical element to an expression definition at a client device;
causing display of a presentation of image data at a client device, the image data depicting a set of facial landmarks of a user;
generating a 3D model based on the set of facial landmarks in response to the causing display of the presentation of the image data;
overlaying the 3D model at a position upon on the presentation of the image data at the client device, the position based on the set of facial landmarks;
receiving a facial tracking input that comprises a movement of a facial landmark from among the set of facial landmarks of the user;
detecting the expression based on the movement of the facial landmark from among the set of facial landmarks;
applying the graphical element to a position upon the 3D model at the client device in response to the detecting the expression based on the movement of the facial landmark;
generating a flattened presentation of the 3D model at the client device based on the animation of the 3D model; and
generating a message that comprises a data packet, the data packet including the flattened presentation of the 3D model.
1 Assignment
0 Petitions
Accused Products
Abstract
Embodiments described herein relate to an augmented expression system to generate and cause display of a specially configured interface to present an augmented reality perspective. The augmented expression system receives image and video data of a user and tracks facial landmarks of the user based on the image and video data, in real-time to generate and present a 3-dimensional (3D) bitmoji of the user.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving a user input that assigns a graphical element to an expression definition at a client device; causing display of a presentation of image data at a client device, the image data depicting a set of facial landmarks of a user; generating a 3D model based on the set of facial landmarks in response to the causing display of the presentation of the image data; overlaying the 3D model at a position upon on the presentation of the image data at the client device, the position based on the set of facial landmarks; receiving a facial tracking input that comprises a movement of a facial landmark from among the set of facial landmarks of the user; detecting the expression based on the movement of the facial landmark from among the set of facial landmarks; applying the graphical element to a position upon the 3D model at the client device in response to the detecting the expression based on the movement of the facial landmark; generating a flattened presentation of the 3D model at the client device based on the animation of the 3D model; and generating a message that comprises a data packet, the data packet including the flattened presentation of the 3D model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising:
-
a memory; and at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising; receiving a user input that assigns a graphical element to an expression definition at a client device; causing display of a presentation of image data at a client device, the image data depicting a set of facial landmarks of a user; generating a 3D model based on the set of facial landmarks in response to the causing display of the presentation of the image data; overlaying the 3D model at a position upon on the presentation of the image data at the client device, the position based on the set of facial landmarks; receiving a facial tracking input that comprises a movement of a facial landmark from among the set of facial landmarks of the user; detecting the expression based on the movement of the facial landmark from among the set of facial landmarks; applying the graphical element to a position upon animating the 3D model at the client device in response to the detecting the expression based on the movement of the facial landmark; generating a flattened presentation of the 3D model at the client device based on the animation of the 3D model; and generating a message that comprises a data packet, the data packet including the flattened presentation of the 3D model. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
-
receiving a user input that assigns a graphical element to an expression definition at a client device; causing display of a presentation of image data at a client device, the image data depicting a set of facial landmarks of a user; generating a 3D model based on the set of facial landmarks in response to the causing display of the presentation of the image data; overlaying the 3D model at a position upon on the presentation e image data at the client device, the position based on the set of facial landmarks; receiving a facial tracking input that comprises a movement of a facial landmark from among the set of facial landmarks of the user; detecting the expression based on the movement of the facial landmark from anion the set of facial landmarks; applying the graphical element to a position upon the 3D model at the client device in response to the detecting the expression based on the movement of the facial landmark; generating a flattened presentation of the 3D model at the client device based on the animation of the 3D model; and generating a message that comprises a data packet, the data packet including the flattened presentation of the 3D model. - View Dependent Claims (18, 19, 20)
-
Specification