COMBINING SEAM CARVING AN IMAGE RESIZING

• US 20110091132A1
• Filed: 10/20/2009
• Published: 04/21/2011
• Est. Priority Date: 10/20/2009
• Status: Active Grant

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Conger, David D., Kumar, Mrityunjay, Luo, Jiebo, Miller, Rodney L.
• Granted Patent: US 8,184,928 B2
• Time in Patent Office: Days
• US Class Current: 382/298
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 1/393 Enlarging or reducing

Abstract

A method for resizing an input digital image to form an output digital image with an output aspect ratio, comprising: determining a number of rows or columns that need to be reduced from the input digital image; determining an image energy map for the input digital image; repeatedly determining a seam path responsive to the image energy map and removing pixels along the determined seam path to determine the output digital image, wherein the determined seam path satisfies a constraint that a directional image gradient is less than a gradient threshold for each pixel in the seam path, until either the determined number of rows or columns has been reduced or no valid seam path can be found; and cropping or scaling the output digital image to the output aspect ratio if the determined number of rows or columns was not reduced.

Claims

1. A method for resizing an input digital image with an input aspect ratio to form an output digital image with an output aspect ratio, comprising using a processor to perform the steps of:

a) determining a number of rows or columns that need to be reduced from the input digital image to form an output digital image with the output aspect ratio;

b) selecting either a horizontal seam direction when the number of rows needs to be reduced or a vertical seam direction when the number of columns needs to be reduced;

c) determining an image energy map for the input digital image;

d) defining a gradient threshold;

e) repeatedly determining a seam path responsive to the image energy map and removing pixels along the determined seam path to determine the output digital image, wherein the determined seam path satisfies a constraint that a directional image gradient computed in a direction perpendicular to either the seam path or the seam direction is less than the gradient threshold for each pixel in the seam path, until either the determined number of rows or columns has been reduced or no valid seam path can be found which satisfies the constraint; and

f) cropping or scaling the output digital image to the output aspect ratio if the determined number of rows or columns was not reduced in step e).

2. The method of claim 1 where step e) includes modifying the output image pixels in a neighborhood near removed pixels along the seam path using the values of the removed pixels.

3. The method of claim 2 where the values of output image pixels adjacent to the seam path are replaced by the average of the original image pixel values and the adjacent removed image pixel values.

4. The method of claim 1, where the output digital image is scaled in step f) when the aspect ratio of the output digital image is sufficiently close to the output aspect ratio.

5. The method of claim 1, where the output digital image is cropped in step f) by removing equal portions of the output image from either top and bottom sides of the image or left and right sides of the image.

6. The method of claim 1, where the output digital image is cropped in step f) by determining a visual saliency map representing an estimated importance of the image content in the output digital image and removing portions of the output image having lower importance.

7. The method of claim 1 wherein the image energy map is computed by:

8. The method of claim 1 wherein the gradient threshold is determined responsive to a distribution of directional image gradient values.

9. The method of claim 1 wherein a determination that no valid seam path can be found is made after a predetermined number of attempts are made to find a seam path that satisfies the constraint that a directional image gradient computed in a direction perpendicular to either the seam path or the seam direction is less than the gradient threshold for each pixel in the seam path.

10. The method of claim 1 wherein the directional image gradient is computed in a direction perpendicular to the seam direction and step e) further includes:

i) determining an image gradient map where the gradient is a directional image gradient computed in a direction perpendicular to the seam direction;

ii) thresholding the image gradient map with the gradient threshold to determine illegal pixel locations; and

iii) determining a seam path responsive to the image energy map, where the seam path does not pass through any illegal pixel locations.

11. The method of claim 1 wherein the input image is a color input image and the seam path is determined using a luminance image determined from the color input image.

12. A system comprising:

a data processing system; and

a memory system communicatively connected to the data processing system and storing instructions configured to cause the data processing system to implement a method for resizing an input digital image with an input aspect ratio to form an output digital image with an output aspect ratio, wherein the instructions comprise;

a) determining a number of rows or columns that need to be reduced from the input digital image to form an output digital image with the output aspect ratio;

b) selecting either a horizontal seam direction when the number of rows needs to be reduced or a vertical seam direction when the number of columns needs to be reduced;

c) determining an image energy map for the input digital image;

d) defining a gradient threshold;

e) repeatedly determining a seam path responsive to the image energy map and removing pixels along the determined seam path to determine the output digital image, wherein the determined seam path satisfies a constraint that a directional image gradient computed in a direction perpendicular to either the seam path or the seam direction is less than the gradient threshold for each pixel in the seam path, until either the determined number of rows or columns has been reduced or no valid seam path can be found which satisfies the constraint; and

f) cropping or scaling the output digital image to the output aspect ratio if the determined number of rows or columns was not reduced in step e).