Applying facial masks to faces in live video
First Claim
Patent Images
1. A computer system, the computer system comprising:
- one or more hardware processors;
system memory coupled to the one or more hardware processors, the system memory storing instructions that are executable by the one or more hardware processors;
the one or more hardware processors executing the instructions stored in the system memory to apply facial masks to faces in live video, including the following;
receive an image containing a face from a user, wherein the image is a frame of a video;
identify the coordinates of a face in the image;
identify the coordinates of facial elements within the face previously identified using a successive steps method, wherein the successive steps method includes;
placing an approximate grid into the region containing the face;
running an integer chooser at each coordinate and concatenating the outputs;
constructing a vector E;
calculating the (dx,dy) shifts for the k-th facial element; and
shifting the X and Y coordinates of fk by the calculated (dx,dy) shifts;
synchronize a bitmap add-on, wherein synchronizing the bitmap add-on includes aligning the bitmap add-on with the identified facial elements; and
apply the bitmap add-ons over the frame of the identified face.
0 Assignments
0 Petitions
Accused Products
Abstract
A method for applying facial masks to faces in live video. The method includes receiving an image containing a face from a user, wherein the image is a frame of a video and identifying the coordinates of a face in the image. The method also includes identifying the coordinates of facial elements within the face previously identified and synchronizing a bitmap add-on, wherein synchronizing the bitmap add-on includes aligning the bitmap add-on with the identified facial elements. The method further includes applying the bitmap add-ons over the frame of the identified face.
-
Citations
18 Claims
-
1. A computer system, the computer system comprising:
-
one or more hardware processors; system memory coupled to the one or more hardware processors, the system memory storing instructions that are executable by the one or more hardware processors; the one or more hardware processors executing the instructions stored in the system memory to apply facial masks to faces in live video, including the following; receive an image containing a face from a user, wherein the image is a frame of a video; identify the coordinates of a face in the image; identify the coordinates of facial elements within the face previously identified using a successive steps method, wherein the successive steps method includes; placing an approximate grid into the region containing the face; running an integer chooser at each coordinate and concatenating the outputs; constructing a vector E; calculating the (dx,dy) shifts for the k-th facial element; and shifting the X and Y coordinates of fk by the calculated (dx,dy) shifts; synchronize a bitmap add-on, wherein synchronizing the bitmap add-on includes aligning the bitmap add-on with the identified facial elements; and apply the bitmap add-ons over the frame of the identified face. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A computer system, the computer system comprising:
-
one or more hardware processors; system memory coupled to the one or more hardware processors, the system memory storing instructions that are executable by the one or more hardware processors; the one or more hardware processors executing the instructions stored in the system memory to apply facial masks to faces in live video, including the following; receive an image containing a face from a user, wherein the image is a frame of a video; identify the coordinates of a face in the image; identify the coordinates of facial elements within the face previously identified using a successive steps method, wherein the successive steps method includes; placing an approximate grid into the region containing the face; running an integer chooser at each coordinate and concatenating the outputs; constructing a vector E; calculating the (dx,dy) shifts for the k-th facial element; and shifting the X and Y coordinates of fk by the calculated (dx,dy) shifts; synchronize a bitmap add-on, wherein synchronizing the bitmap add-on includes aligning the bitmap add-on with the identified facial elements, the method for synchronizing the bitmap add-on including; smoothing facial element coordinates in the current frame based on previous frames; warping the face in the image; and warping the bitmap add-on; and apply the bitmap add-ons over the frame of the identified face. - View Dependent Claims (13, 14, 15)
-
-
16. A computer system, the computer system comprising:
-
one or more hardware processors; system memory coupled to the one or more hardware processors, the system memory storing instructions that are executable by the one or more hardware processors; the one or more hardware processors executing the instructions stored in the system memory to apply facial masks to faces in live video, including the following; receive an image containing a face from a user, wherein the image is a frame of a video; identify the coordinates of a face in the image; identify the coordinates of facial elements within the face previously identified using a successive steps method, wherein the successive steps method includes; placing an approximate grid into the region containing the face; running an integer chooser at each coordinate and concatenating the outputs; constructing a vector E; calculating the (dx,dy) shifts for the k-th facial element; and shifting the X and Y coordinates of fk by the calculated (dx,dy) shifts; train a detector, wherein training a detector allows for synchronization of a bitmap add-on; synchronize the bitmap add-on, wherein synchronizing the bitmap add-on includes aligning the bitmap add-on with the identified facial elements, the method for synchronizing the bitmap add-on including; smoothing facial element coordinates in the current frame based on previous frames; warping the face in the image; and warping the bitmap add-on; and apply the bitmap add-ons over the frame of the identified face. - View Dependent Claims (17, 18)
-
Specification