Method for real time video processing involving changing a color of an object on a human face in a video
First Claim
1. A computer-implemented method of real time processing of a video for changing color of an object on a face in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
- forming a mesh of the face in the video based on distinguishable points present in most frames of the video;
aligning the mesh to the face image in each frame;
forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame;
aligning the binary mask to the mesh on each frame; and
applying a new colour and a new intensity value to the pixels of each frame that are to be recolored.
3 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method for real time video processing for changing a color of an object in a video is presented. The method is performed in connection with a computerized system comprising a processing unit and a memory. The method comprises providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video; tracking the detected object in the video; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
-
Citations
24 Claims
-
1. A computer-implemented method of real time processing of a video for changing color of an object on a face in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
-
forming a mesh of the face in the video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A mobile computerized system comprising a processing unit and a memory, the memory storing instructions for:
-
forming a mesh of the face in a video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A device capable of video processing comprising a processing unit and a memory, the memory storing instructions for:
-
forming a mesh of the face in a video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying anew colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
Specification