Method for real time video processing involving changing a color of an object on a human face in a video
First Claim
1. A computer-implemented method, comprising:
- identifying, by one or more processors, a face within a set of images comprising a video stream;
identifying, by the one or more processors, a set of pixels for one or more objects depicted on the face;
identifying, by the one or more processors, one or more pixels to be recolored within the set of images, the one or more pixels included within the set of pixels for the one or more objects;
computing, by the one or more processors, a new pixel value, for the one or more pixels to be recolored in the set of images comprising the video stream, as a function of intensity values of a collection of pixels within the set of pixels that is within a given distance of the one or more pixels; and
transforming, by the one or more processors, at least a portion of the set of images of the video stream to generate a modified video stream by applying the new pixel value that has been computed to the one or more pixels to be recolored of each image of the video stream while the one or more objects, corresponding to the one or more pixels, are presented within the set of images of the video stream; and
wherein the set of pixels are within a region having a prespecified shape, and wherein determining that the one or more pixels to be recolored corresponds to one or more pixels of a target object to be recolored in response to determining that an intensity value of the one or more pixels, in the region, to be recolored is less than a fraction of a value of a pixel at a center of the region.
3 Assignments
0 Petitions
Accused Products
Abstract
A computer-implemented method for real time video processing for changing a color of an object in a video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising: providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object'"'"'s color is changed within the defined area when the object is presented in frames of the video.
-
Citations
17 Claims
-
1. A computer-implemented method, comprising:
-
identifying, by one or more processors, a face within a set of images comprising a video stream; identifying, by the one or more processors, a set of pixels for one or more objects depicted on the face; identifying, by the one or more processors, one or more pixels to be recolored within the set of images, the one or more pixels included within the set of pixels for the one or more objects; computing, by the one or more processors, a new pixel value, for the one or more pixels to be recolored in the set of images comprising the video stream, as a function of intensity values of a collection of pixels within the set of pixels that is within a given distance of the one or more pixels; and transforming, by the one or more processors, at least a portion of the set of images of the video stream to generate a modified video stream by applying the new pixel value that has been computed to the one or more pixels to be recolored of each image of the video stream while the one or more objects, corresponding to the one or more pixels, are presented within the set of images of the video stream; and wherein the set of pixels are within a region having a prespecified shape, and wherein determining that the one or more pixels to be recolored corresponds to one or more pixels of a target object to be recolored in response to determining that an intensity value of the one or more pixels, in the region, to be recolored is less than a fraction of a value of a pixel at a center of the region. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A system, comprising:
-
one or more processors; and a processor-readable storage device coupled to the one or more processors, the processor readable storage device storing processor executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising; identifying a face within a set of images comprising a video stream; identifying a set of pixels for one or more objects depicted on the face; identifying one or more pixels to be recolored within the set of images, the one or more pixels included within the set of pixels for the one or more objects; computing a new pixel value, for the one or more pixels to be recolored in the set of images comprising the video stream, as a function of intensity values of a collection of pixels within the set of pixels that is within a given distance of the one or more pixels; and transforming at least a portion of the set of images of the video stream to generate a modified video stream by applying the new pixel value that has been computed to the one or more pixels to be recolored of each image of the video stream while the one or more objects, corresponding to the one or more pixels, are presented within the set of images of the video stream; and wherein the set of pixels are within a region having a prespecified shape, and wherein determining that the one or more pixels to be recolored corresponds to one or more pixels of a target object to be recolored in response to determining that an intensity value of the one or more pixels, in the region, to be recolored is less than a fraction of a value of a pixel at a center of the region. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A processor-readable storage device storing processor executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:
-
identifying a face within a set of images comprising a video stream; identifying a set of pixels for one or more objects depicted on the face; identifying one or more pixels to be recolored within the set of images, the one or more pixels included within the set of pixels for the one or more objects; computing a new pixel value, for the one or more pixels to be recolored in the set of images comprising the video stream, as a function of intensity values of a collection of pixels within the set of pixels that is within a given distance of the one or more pixels; and transforming at least a portion of the set of images of the video stream to generate a modified video stream by applying the new pixel value that has been computed to the one or more pixels to be recolored of each image of the video stream while the one or more objects, corresponding to the one or more pixels, are presented within the set of images of the video stream; and wherein the set of pixels are within a region having a prespecified shape, and wherein determining that the one or more pixels to be recolored corresponds to one or more pixels of a target object to be recolored in response to determining that an intensity value of the one or more pixels, in the region, to be recolored is less than a fraction of a value of a pixel at a center of the region. - View Dependent Claims (14, 15, 16, 17)
-
Specification