Laying out multiple images

• US 8,200,039 B2
• Filed: 04/05/2007
• Issued: 06/12/2012
• Est. Priority Date: 04/05/2007
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Jin, Hailin, Chien, Jen-Chan
• Primary Examiner(s): Repko, Jason M
• Assistant Examiner(s): Thirugnanam, Gandhi
• Application Number:
  US11/697,284
• Publication Number:
  US 20080247667A1
• Time in Patent Office: 1,895 Days
• Field of Search: 382/284, 382276-277, 382/287, 382/289, 382294-298
• US Class Current: 382/284
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration

Abstract

Systems, methods, and apparatuses, including computer program products, are provided for re-layout of composite images. In some implementations, a method includes identifying geometric transformations corresponding to multiple images from a collection of images, where a geometric transformation reorients a corresponding image in relation to a common reference frame when applied and identifying a reference image for the multiple images in the collection of images. The method also includes determining overlapping image regions for the multiple images starting from the reference image, the determining based on the identified geometric transformations, determining additional transformations of a specified type for the multiple images based on the overlapping image regions, where an additional transformation lays out a corresponding image in relation to the reference image when applied, and making the additional transformations available for further processing and output with respect to the collection of images.

Claims

1. A method comprising:

identifying geometric transformations corresponding to multiple images from a collection of images, where a geometric transformation reorients a corresponding image in relation to a common reference frame when applied;

identifying a reference image for the multiple images in the collection of images;

determining overlapping image regions for the multiple images starting from the reference image and proceeding according to an order based on a distance measure between images of the multiple images, the distance measure between a particular pair of images of the multiple images being based on a measure of distortion between the pair of images, the determining based on the identified geometric transformations;

determining additional transformations of a specified type for the multiple images based on the overlapping image regions, where an additional transformation lays out a corresponding image in relation to the reference image when applied; and

making the additional transformations available for further processing and output with respect to the collection of images.

2. The method of claim 1, where determining overlapping image regions for the multiple images further comprises:

identifying a relative transformation for a second image relative to a first image of the multiple images using the identified geometric transformations corresponding to the first image and the second image; and

identifying the overlapping image region of the first image and the second image when the relative transformation is applied to the second image.

3. The method of claim 2, where the first image is the reference image and the second image is an image of the multiple images having a shortest distance to the reference image.

4. The method of claim 3, where the distance from the reference image to the second image is determined using a connectivity graph relating overlapping images of the multiple images.

5. The method of claim 2, where the additional transformations are two-dimensional (2D) translations and determining the 2D translation for the second image includes determining an incremental 2D translation relative to a translation of the first image.

6. The method of claim 2, where identifying the relative transformation includes determining a projective transformation between the first image and the second image using the corresponding geometric transformations.

7. The method of claim 6, where determining the projective transformation includes converting the corresponding geometric transformations into first projective transformations relating the first image and the second image to the common reference frame.

8. The method of claim 1, where the additional transformations are 2D translations and determining the 2D translations for the multiple images based on the overlapping image regions includes identifying center points for each of the overlapping image regions.

9. The method of claim 8, where identifying the center point of an overlapping image region comprises:

identifying coordinates for a plurality of vertices of the overlapping region; and

calculating a mean of the coordinates for the plurality of vertices.

10. The method of claim 1, where the geometric transformations are projective transformations.

11. The method of claim 1, where the geometric transformations are cylindrical transformations or spherical transformations.

12. The method of claim 1, further comprising:

identifying a center image of the multiple images; and

using the center image as the reference image.

13. The method of claim 1, where the additional transformations are 2D translation and rotation transformations, and where determining the translation and rotation for one or more of the multiple images includes using two or more points in the determined overlapping regions.

14. The method of claim 1, where the additional transformations are 2D translation, rotation and scaling transformations and where determining the translation, rotation and scaling for one or more images of the multiple images includes using two or more points in the determined overlapping regions.

15. The method of claim 1, where the type of additional transformations is user specified.

16. The method of claim 1, where identifying the reference image comprises identifying an image corresponding to the common reference frame.

17. The method of claim 1, further comprising:

displaying a composite layout for the multiple images after applying the additional transformations.

18. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

identifying geometric transformations corresponding to multiple images from a collection of images, where a geometric transformation reorients a corresponding image in relation to a common reference frame when applied;

identifying a reference image for the multiple images in the collection of images;

determining overlapping image regions for the multiple images starting from the reference image and proceeding according to an order based on a distance measure between images of the multiple images, the distance measure between a particular pair of images of the multiple images being based on a measure of distortion between the pair of images, the determining based on the identified geometric transformations;

determining additional transformations of a specified type for the multiple images based on the overlapping image regions, where an additional transformation lays out a corresponding image in relation to the reference image when applied; and

making the additional transformations available for further processing and output with respect to the collection of images.

19. The computer program product of claim 18, where determining overlapping image regions for the multiple images further comprises:

identifying a relative transformation for a second image relative to a first image of the multiple images using the identified geometric transformations corresponding to the first image and the second image; and

identifying the overlapping image region of the first image and the second image when the relative transformation is applied to the second image.

20. The computer program product of claim 19, where the first image is the reference image and the second image is an image of the multiple images having a shortest distance to the reference image.

21. The computer program product of claim 20, where the distance from the reference image to the second image is determined using a connectivity graph relating overlapping images of the multiple images.

22. The computer program product of claim 19, where the additional transformations are two-dimensional (2D) translations and determining the 2D translation for the second image includes determining an incremental 2D translation relative to a translation of the first image.

23. The computer program product of claim 19, where identifying the relative transformation includes determining a projective transformation between the first image and the second image using the corresponding geometric transformations.

24. The computer program product of claim 23, where determining the projective transformation includes converting the corresponding geometric transformations into first projective transformations relating the first image and the second image to the common reference frame.

25. The computer program product of claim 18, where the additional transformations are 2D translations and determining the 2D translations for the multiple images based on the overlapping image regions includes identifying center points for each of the overlapping image regions.

26. The computer program product of claim 25, where identifying the center point of an overlapping image region comprises:

identifying coordinates for a plurality of vertices of the overlapping region; and

calculating a mean of the coordinates for the plurality of vertices.

27. The computer program product of claim 18, where the geometric transformations are projective transformations.

28. The computer program product of claim 18, where the geometric transformations are cylindrical transformations or spherical transformations.

29. The computer program product of claim 18, further comprising:

identifying a center image of the multiple images; and

using the center image as the reference image.

30. The computer program product of claim 18, where the additional transformations are 2D translation and rotation transformations, and where determining the translation and rotation for one or more of the multiple images includes using two or more points in the determined overlapping regions.

31. The computer program product of claim 18, where the specified transformations are 2D translation, rotation and scaling transformations and where determining the translation, rotation and scaling for one or more images of the multiple images includes using two or more points in the determined overlapping regions.

32. The computer program product of claim 18, where the type of additional transformations is user specified.

33. The computer program product of claim 18, where identifying the reference image comprises identifying an image corresponding to the common reference frame.

34. The computer program product of claim 18, further comprising:

displaying a composite layout for the multiple images after applying the additional transformations.

35. A system comprising:

a user input device, a display, a memory device, and a processor programmed to;

identify geometric transformations corresponding to multiple images from a collection of images, where a geometric transformation reorients a corresponding image in relation to a common reference frame when applied;

identify a reference image for the multiple images in the collection of images;

determine overlapping image regions for the multiple images starting from the reference image and proceeding according to an order based on a distance measure between images of the multiple images, the distance measure between a particular pair of images of the multiple images being based on a measure of distortion between the pair of images, the determining based on the identified geometric transformations;

determine additional transformations of a specified type for the multiple images based on the overlapping image regions, where an additional transformation lays out a corresponding image in relation to the reference image when applied; and

make the additional transformations available for further processing and output with respect to the collection of images.

36. The system of claim 35, where determining overlapping image regions for the multiple images further comprises:

identifying a relative transformation for a second image relative to a first image of the multiple images using the identified geometric transformations corresponding to the first image and the second image; and

identifying the overlapping image region of the first image and the second image when the relative transformation is applied to the second image.

37. The system of claim 36, where the first image is the reference image and the second image is an image of the multiple images having a shortest distance to the reference image.

38. The system of claim 37, where the distance from the reference image to the second image is determined using a connectivity graph relating overlapping images of the multiple images.

39. The system of claim 36, where the additional transformations are two-dimensional (2D) translations and determining the 2D translation for the second image includes determining an incremental 2D translation relative to a translation of the first image.

40. The system of claim 36, where identifying the relative transformation includes determining a projective transformation between the first image and the second image using the corresponding geometric transformations.

41. The system of claim 40, where determining the projective transformation includes converting the corresponding geometric transformations into first projective transformations relating the first image and the second image to the common reference frame.

42. The system of claim 35, where the additional transformations are 2D translations and determining the 2D translations for the multiple images based on the overlapping image regions includes identifying center points for each of the overlapping image regions.

43. The system of claim 42, where identifying the center point of an overlapping image region comprises:

identifying coordinates for a plurality of vertices of the overlapping region; and

calculating a mean of the coordinates for the plurality of vertices.

44. The system of claim 35, where the geometric transformations are projective transformations.

45. The system of claim 35, where the geometric transformations are cylindrical transformations or spherical transformations.

46. The system of claim 35, where the processor is further programmed to:

identify a center image of the multiple images; and

use the center image as the reference image.

47. The system of claim 35, where the additional transformations are 2D translation and rotation transformations, and where determining the translation and rotation for one or more of the multiple images includes using two or more points in the determined overlapping regions.

48. The system of claim 35, where the additional transformations are 2D translation, rotation and scaling transformations and where determining the translation, rotation and scaling for one or more images of the multiple images includes using two or more points in the determined overlapping regions.

49. The system of claim 35, where the type of additional transformations is user specified.

50. The system of claim 35, where identifying the reference image comprises identifying an image corresponding to the common reference frame.

51. The system of claim 35, where the processor is further programmed to:

display a composite layout for the multiple images after applying the additional transformations.