IMPORTANCE FILTERING FOR IMAGE RETARGETING
First Claim
1. A method of retargeting a digital original image to a digital target image, said method comprising:
- (a) accessing said original image, wherein the size of at least one dimension of said original image is different than the size of the corresponding one dimension in said target image, and a scaling factor relates the size of said one dimension of said original image to the size of said corresponding one dimension in said target image;
(b) constructing an image saliency of said original image;
(c) filtering the image saliency under the guidance of said original image to produce an importance map, SImp, that matches pixels to salient structures in said original image;
(d) estimating a shift-map gradient G according to said scaling factor and under the constraint of said importance map SImp, wherein pixels that are matched to salient structures are assigned a consistently distributed gradient;
(e) defining a shift-map M from said shift-map gradient G, wherein said shift-map M estimates pixel shifts from said original image to said target image; and
(f) applying said shift-map M to said original image to construct said target image.
2 Assignments
0 Petitions
Accused Products
Abstract
A content-aware image retargeting technique uses an “importance filtering” technique to preserve important information in the resizing of an image. The image saliency is first filtered, guided by the image itself to achieve a structure-consistent importance map. The pixel importance is then used as the key constraint in computing the gradient map of pixel shifts from the original resolution to the target resolution. Finally the shift gradient is integrated across the image by a weighted filtering process to construct a smooth pixel shift-map and render the target image. The weight is again controlled by the pixel importance. The two filtering processes enforce the maintaining of structural consistency while preserving the important contents in the target image. The simple nature of the present filter operations allow for real-time applications and easy extension to video retargeting, as the structural constraints from the original image naturally convey the temporal coherence between frames.
-
Citations
22 Claims
-
1. A method of retargeting a digital original image to a digital target image, said method comprising:
-
(a) accessing said original image, wherein the size of at least one dimension of said original image is different than the size of the corresponding one dimension in said target image, and a scaling factor relates the size of said one dimension of said original image to the size of said corresponding one dimension in said target image; (b) constructing an image saliency of said original image; (c) filtering the image saliency under the guidance of said original image to produce an importance map, SImp, that matches pixels to salient structures in said original image; (d) estimating a shift-map gradient G according to said scaling factor and under the constraint of said importance map SImp, wherein pixels that are matched to salient structures are assigned a consistently distributed gradient; (e) defining a shift-map M from said shift-map gradient G, wherein said shift-map M estimates pixel shifts from said original image to said target image; and (f) applying said shift-map M to said original image to construct said target image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
Specification