METHOD FOR REAL TIME VIDEO PROCESSING INVOLVING CHANGING A COLOR OF AN OBJECT ON A HUMAN FACE IN A VIDEO
First Claim
1. A computer-implemented method for real time processing of a video for changing a color of an object in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
- providing an object in the video that at least partially and at least occasionally is presented in frames of the video;
detecting the object in the video, wherein said detection comprises detecting feature reference points of the object;
tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame;
generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and
transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
3 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method for real time video processing for changing a color of an object in a video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising: providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
-
Citations
25 Claims
-
1. A computer-implemented method for real time processing of a video for changing a color of an object in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
-
providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
-
-
2. A computer-implemented method of real time processing of a video for changing color of an object on a face in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
-
forming a mesh of the face in the video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9)
-
-
10. A mobile computerized system comprising a processing unit and a memory, the memory storing instructions for:
-
forming a mesh of the face in a video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A device capable of video processing comprising a processing unit and a memory, the memory storing instructions for:
-
forming a mesh of the face in a video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25)
-
Specification