METHOD FOR REAL TIME VIDEO PROCESSING INVOLVING CHANGING A COLOR OF AN OBJECT ON A HUMAN FACE IN A VIDEO
First Claim
1. A computer-implemented method for real time processing of a video for changing a color of an object in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
- providing an object in the video that at least partially and at least occasionally is presented in frames of the video;
detecting the object in the video, wherein said detection comprises detecting feature reference points of the object;
tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame;
generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and
transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
3 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method for real time video processing for changing a color of an object in a video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising: providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
39 Citations
25 Claims
-
1. A computer-implemented method for real time processing of a video for changing a color of an object in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
-
providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
-
-
2. A computer-implemented method of real time processing of a video for changing color of an object on a face in the video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising:
-
forming a mesh of the face in the video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9)
-
-
10. A mobile computerized system comprising a processing unit and a memory, the memory storing instructions for:
-
forming a mesh of the face in a video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A device capable of video processing comprising a processing unit and a memory, the memory storing instructions for:
-
forming a mesh of the face in a video based on distinguishable points present in most frames of the video; aligning the mesh to the face image in each frame; forming a binary mask providing the pixels to be recolored based on a weighted sum of information from the current frame and information from at least one previous frame; aligning the binary mask to the mesh on each frame; and applying a new colour and a new intensity value to the pixels of each frame that are to be recolored. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25)
-
Specification