Virtual masking using rigid parametric modeling
First Claim
Patent Images
1. A method for masking a target item by a processing device within an image, the method comprising the steps of:
- (a) defining a target image encompassing said target item within an input image;
(b) defining a mask image with which to mask said target item;
(c) scaling the size of a three-dimensional rigid parametric model to the size of the target image within said input image;
(d) determining the projection of said target image to the scaled rigid parametric model to establish a pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model;
(e) constructing a pixel mapping between said mask image and the target image to obtain a mapped mask image with a one-to-one pixel correspondence between image pixels in said target image and image pixels in said mapped mask image;
(f) determining the projection of said mapped mask image to the scaled rigid parametric model in accordance with said pixel correspondence between said target image and said mapped mask image and said pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model;
(g) replacing said target item within said input image with a composite of said target image and the mapped mask image in accordance with said pixel correspondence between said target image and said mapped mask image and said pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model, said, composite image being a weighted sum of the target image and the mapped mask imagewherein the weighted sum of the target image and the mapped mask image is defined as Ib=W*Ic+(1−
w)*Im, where Ic is a given pixel in the target image, Im is its corresponding pixel in the mapped mask image, and Ib is the resultant pixel in the composite image; and
w is the weight defined as
2 Assignments
0 Petitions
Accused Products
Abstract
Disclosed are systems and methods for masking at least a portion of one image with another image. Aspects of the present invention facilitate the placing of a virtual mask onto an item in an image even if that items moves in subsequent images, such as between different image frames in a video.
-
Citations
18 Claims
-
1. A method for masking a target item by a processing device within an image, the method comprising the steps of:
-
(a) defining a target image encompassing said target item within an input image; (b) defining a mask image with which to mask said target item; (c) scaling the size of a three-dimensional rigid parametric model to the size of the target image within said input image; (d) determining the projection of said target image to the scaled rigid parametric model to establish a pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model; (e) constructing a pixel mapping between said mask image and the target image to obtain a mapped mask image with a one-to-one pixel correspondence between image pixels in said target image and image pixels in said mapped mask image; (f) determining the projection of said mapped mask image to the scaled rigid parametric model in accordance with said pixel correspondence between said target image and said mapped mask image and said pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model; (g) replacing said target item within said input image with a composite of said target image and the mapped mask image in accordance with said pixel correspondence between said target image and said mapped mask image and said pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model, said, composite image being a weighted sum of the target image and the mapped mask image wherein the weighted sum of the target image and the mapped mask image is defined as Ib=W*Ic+(1−
w)*Im, where Ic is a given pixel in the target image, Im is its corresponding pixel in the mapped mask image, and Ib is the resultant pixel in the composite image; andw is the weight defined as - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A system for masking a target item within an image, the system comprising:
-
an item detector for-defining a target image encompassing said target item within an input image; a mask definer foe-defining a mask image with which to mask said target item; a scaler foe-scaling the size of a three-dimensional, rigid parametric model to the size of the target image within said input image, wherein the shape of said rigid parametric model is independent of the shape of said target image; a projector foe-determining the projection of said target image to the scaled rigid parametric model to establish a pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model; and a mapper constructing a pixel mapping between said mask image and the target image to obtain a mapped mask image with a one-to-one pixel correspondence between image pixels in said target image and image pixels in said mapped mask image; said projector further determining the projection of said mapped mask image to the scaled rigid parametric model in accordance with said pixel correspondence between said target image and said mapped mask image and said pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model; said projector further replacing said target item within said input image with a composite of said target image and the mapped mask image in accordance with said pixel correspondence between said target image and said mapped mask image and said pixel correlation between image pixel locations in said target image and corresponding projected pixel locations on said scaled rigid parametric model, said composite image being a weighted sum of the target image and the mapped mask image; wherein; wherein the weighted sum of the target image and the mapped mask image is defined as Ib=W*Ic+(1−
w)*Im, where Ic is a given pixel in the target image, Im is its corresponding pixel in the mapped mask image, and Ib is the resultant pixel in the composite image; andw is the weight defined as - View Dependent Claims (16, 17, 18)
-
Specification