Automatic frame selection and layout of one or more images and generation of images bounded by a frame

• US 7,346,212 B2
• Filed: 02/22/2002
• Issued: 03/18/2008
• Est. Priority Date: 07/31/2001
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Cheatle, Stephen Philip
• Primary Examiner(s): Werner, Brian
• Assistant Examiner(s): Thomas, Mia M
• Application Number:
  US10/381,748
• Publication Number:
  US 20040080670A1
• Time in Patent Office: 2,216 Days
• Field of Search: None
• US Class Current: 382/173
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04N 1/3872 Repositioning or masking

Abstract

A method is disclosed of analyzing an image to identify “must exclude” regions and of determining the best fit of an image outline so as to generate an image boundary that excludes the majority of “must exclude” regions. The method is applicable to the automatic generation of greeting cards and photo-montages.

Claims

1. A method of arranging at least one image within a display area, the method comprising the steps of:

analysing the at least one image in accordance with at least one predefined compositional rule;

selecting an image boundary the shape of which, in accordance with said analysis, best fits the at least one image;

applying the image boundary to the at least one image to produce a processed image; and

placing the processed image within said display area,

wherein the step of analysing the image comprises identifying at least one region of compositional significance based on color and/or contrast and/or brightness differences with respect to adjacent regions in the image, and applying at least one of;

a) at least one compositional rule to identify regions which should be included within the processed image; and

b) at least one compositional rule to identify regions which should be excluded from the processed image,

wherein said step of analysing the image further comprises identifying “

don'"'"'t care”

regions of images, said “

don'"'"'t care”

regions comprising regions that may be optionally excluded from said image boundary.

2. A method of arranging at least one image within a display area as claimed in claim 1, wherein the step of analysing the image comprises identifying one or more regions of compositional significance based on color and/or brightness differences with respect to adjacent regions in the image, and applying at least one compositional rule to identify regions which should be included within the processed image.

3. A method of arranging at least one image as claimed in claim 2, wherein the image boundary shape placed within said display area equals a number of selected combinations of regions of interest to be included, said selection being controlled by at least one heuristic rule.

4. A method as claimed in claim 2, wherein the at least one compositional rule is selected from a set comprising a plurality of rules.

5. A method as claimed in claim 4, wherein the at least one compositional rule is selected based on its relevance to one or more of the identified features.

6. A method as claimed in claim 2, wherein the step of analysing the image comprises identifying one or more regions of compositional significance which should be excluded from the processed image, the regions of computations significance being identified based on color and/or brightness differences with respect to adjacent regions in the image.

7. A method as claimed in claim 6, wherein the image boundary shape is compared with the image, and those shapes which include the regions which should be included and exclude the regions which should be excluded are presented to a user as acceptable solutions.

8. A method as claimed in claim 7, in which the image boundary shape that best includes the features to be included and best excludes the features to be excluded is presented to the user as the best fit.

9. A method of arranging at least one image within a display area as claimed in claim 1, wherein the step of analysing the image comprises identifying one or more regions of compositional significance based on color and/or brightness differences with respect to adjacent regions in the image, and applying at least one compositional rule to identify regions which should be excluded from the processed image.

10. A method as claimed in claim 9, wherein the at least one compositional rule is selected from a set comprising a plurality of compositional rules on the basis of its relevance to one or more of the identified features.

11. A method of arranging at least one image as claimed in claim 9, wherein one or more parameters of said shape of image boundary is adjusted to optimise said best fit.

12. A method of arranging at least one image as claimed in claim 9, wherein said image boundary shape is selected from a plurality of geometric shapes.

13. A method of arranging at least one image as claimed in claim 9, wherein said display area comprises a predefined arrangement of image boundaries.

14. A method of arranging at least one image as claimed in claim 9, wherein at least one of the number, position, size, shape and aspect ratio of the at least one image boundary is defined by a user.

15. A method of arranging at least one image as claimed in claim 9, wherein at least one parameter of the style of the display area is controlled by a user.

16. A method of arranging at least one image as claimed in claim 1, wherein a plurality of images are arranged and the number of image boundaries placed within said display area is equal to the number of images.

17. A method of arranging at least one image as claimed in claim 1, wherein a plurality of image boundaries are placed within said display area, at least some of the image boundaries overlapping at least a portion of one other of said image boundaries.

18. A method of arranging at least one image as claimed in claim 1, wherein said overlapping portions comprise said “

don'"'"'t care”

regions.

19. A method of arranging at least one image as claimed in claim 1, wherein a plurality of images are arranged and the placement of the images is controlled by one or more parameters of the images.

20. A computer-readable medium storing a program product comprising computer readable instructions for causing a data processor to execute the method as claimed in claim 1.

21. A method of arranging a plurality of images within a display area, the method comprising the steps of:

analysing each of said plurality of images in accordance with at least one compositional rule to thereby identify one or more regions of each image to be excluded from said image;

placing said analysed images within said display area, such that some images overlap a portion of at least one other image, whereby said overlapping portions obscure one or more of said regions to be excluded,

wherein said step of analysing an image comprises;

identifying one or more features of compositional significance based on color and/or brightness differences with respect to adjacent regions in the image;

identifying a number of regions of interest;

selecting at least one combination of one or more of said regions of interest;

applying said at least one composition rule to those said features of compositional significance located within said selected combination of regions of interest to thereby identify “

must include” and

“

must exclude”

regions of said selected combination; and

identifying “

don'"'"'t care”

regions of images, said “

don'"'"'t care”

regions comprising regions that may be optionally excluded from an image boundary.

22. A method of arranging a number of images as claimed in claim 21, wherein regions to be excluded for each image that are not obscured by said overlapping portions are cropped from said image.

23. A method of arranging a plurality of images within a display area as claimed in claim 21, wherein the method further comprises identifying “

don'"'"'t care”

regions which may be wholly or partially overlapped by another image.

24. A method of arranging a plurality of image according to claim 21, wherein placement of said images is controlled by one or more parameters of said images.

25. A computer-readable medium storing a program product comprising computer readable instructions for causing a programmable data processor to execute the method as claimed in claim 21.

26. An image processing system for arranging a number of images within a display area, comprising:

an input arranged to receive said images;

an image processor coupled to said input; and

an output coupled to said image processor, and arranged to output said arrangement of images within the display area;

wherein the image processor is arranged;

to analyse at least one image in accordance with at least one predefined compositional rule;

to select an image boundary the shape of which, in accordance with said analysis, best fits said image;

to apply the image boundary to the at least one image to produce a processed image; and

to place the processed image within said display areas,

wherein the step of analysing the image comprises identifying at least one region of compositional significance based on color and/or brightness differences with respect to adjacent regions in the image, and applying at least one of;

a) at least one compositional rule to identify regions which should be included within the processed image; and

b) at least one compositional rule to identify regions which should be excluded from the processed image,

wherein said step of analysing the image further comprises identifying “

don'"'"'t care”

regions of images, said “

don'"'"'t care”

regions comprising regions that may be optionally excluded from said image boundary.