SEAM NETWORK PROCESSING FOR PANORAMA WEAVING

• US 20140002488A1
• Filed: 06/28/2013
• Published: 01/02/2014
• Est. Priority Date: 06/28/2012
• Status: Active Grant

• Current Assignee: Brian Summa, Julien Tierny, Valerio Pascucci
• Original Assignee: Brian Summa, Julien Tierny, Valerio Pascucci
• Inventors: Pascucci, Valerio, Summa, Brian, Tierny, Julien
• Granted Patent: US 9,275,485 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images

Abstract

A method of creating an image mosaic is provided. A plurality of image files is read at a computing device. The plurality of image files contains image data defining a plurality of overlapping images. A dual adjacency mesh for an image mosaic is defined based on an arrangement of the plurality of overlapping images. The dual adjacency mesh is defined as a plurality of nodes and edges that connect a pair of the plurality of nodes. A node is defined for each image of the plurality of overlapping images, and an edge is defined when an overlap exists between a pair of images of the plurality of overlapping images. The image mosaic is presented in a display of the computing device. The image mosaic is created from the plurality of overlapping images based on the defined dual adjacency mesh.

Claims

1. A computer-readable medium having stored thereon computer-readable instructions that when executed by a computing device cause the computing device to:

read a plurality of image files, wherein the plurality of image files contain image data defining a plurality of overlapping images;

define a dual adjacency mesh for an image mosaic based on an arrangement of the plurality of overlapping images, wherein the dual adjacency mesh is defined as a plurality of nodes and edges that connect a pair of the plurality of nodes, wherein a node is defined for each image of the plurality of overlapping images and an edge is defined between each node of a pair of images of the plurality of overlapping images that overlap; and

control presentation of the image mosaic in a display of a first device, wherein the image mosaic is created from the plurality of overlapping images based on the defined dual adjacency mesh.

4. The computer-readable medium of claim 1, wherein a first seam includes a plurality of pixels in the image mosaic between a first group of the plurality of overlapping images that together overlap at a group of pixels, wherein on a first side of the first seam a first image from the first group is shown and on a second side of the first seam opposite the first side a second image from the first group is shown and the computer-readable instructions further cause the computing device to control presentation of the first seam in the image mosaic.

5. The computer-readable medium of claim 4, wherein the first group is a pair of overlapping images, and locations of the plurality of pixels that form the first seam are determined based on a first independent pair-wise boundary computation between a first overlap point and a second overlap point of the pair of overlapping images.

6. The computer-readable medium of claim 5, wherein the locations of the plurality of pixels that form the first seam are further determined based on a second independent pair-wise boundary computation between a third overlap point and a fourth overlap point of the pair of overlapping images.

7. The computer-readable medium of claim 5, wherein the computer-readable instructions further cause the computing device to:

receive an indicator of an interaction by a user with the image mosaic presented in the display, wherein the indicator indicates that the user has selected a pixel of the plurality of pixels of the first seam and has moved the selected pixel to a first location within an overlapping region between the pair of overlapping images;

compute a second seam that includes the first location; and

control presentation of the image mosaic in the display of the first device, wherein the image mosaic includes the second seam between the pair of overlapping images, and further wherein the second seam replaces at least a portion of the first seam in the image mosaic.

8. The computer-readable medium of claim 4, wherein the first group is at least three overlapping images, wherein pairs of the at least three overlapping images cross at a plurality of overlap points, wherein a first plurality of overlap points of the plurality of overlap points are located along an outside edge of the first group and a second plurality of overlap points of the plurality of overlap points are located within the first group, and locations of the plurality of pixels that form the first seam are determined based on a first independent pair-wise boundary computation between a first overlap point of the first plurality of overlap points and a branching point defined based on the second plurality of overlap points.

9. The computer-readable medium of claim 8, wherein the branching point is defined as a minimum point with respect to a min-path distance calculated between pairs of the first plurality of overlap points and the second plurality of overlap points associated with the same pair of images of the at least three overlapping images.

10. The computer-readable medium of claim 9, wherein the first overlap point is between a first pair of images of the first group, and the first overlap point and the branching point are on opposite sides of the edge defined between the nodes of the first pair of images of the dual adjacency mesh.

11. The computer-readable medium of claim 9, wherein a second seam includes a second plurality of pixels in the image mosaic, and locations of the second plurality of pixels that form the second seam are determined based on a second independent pair-wise boundary computation between a second overlap point of the first plurality of overlap points and the branching point and the computer-readable instructions further cause the computing device to control presentation of the second seam in the image mosaic.

12. The computer-readable medium of claim 4, wherein a second seam includes a second plurality of pixels in the image mosaic between a second group of the plurality of overlapping images that together overlap at a second group of pixels, wherein on a first side of the second seam a first image from the second group is shown and on a second side of the second seam opposite the first side a second image from the second group is shown and the computer-readable instructions further cause the computing device to control presentation of the second seam in the image mosaic.

13. The computer-readable medium of claim 12, wherein the first group is at least three overlapping images and the second group is at least three overlapping images, wherein at least two overlapping images of the first group and the second group are the same images, wherein first pairs of the first group cross at a first plurality of overlap points and second pairs of the second group cross at a second plurality of overlap points, and locations of the plurality of pixels that form the second seam are determined based on a first independent pair-wise boundary computation between a first branching point defined based on the first plurality of overlap points and a second branching point defined based on the second plurality of overlap points.

14. The computer-readable medium of claim 13, wherein a first plurality of the first plurality of overlap points are located along an outside edge of the first group and a second plurality of the first plurality of overlap points are located within the first group, wherein the first branching point is defined as a minimum point with respect to a min-path distance calculated between pairs of the first plurality of the first plurality of overlap points and the second plurality of the first plurality of overlap points associated with the same pair of images of the first group.

15. The computer-readable medium of claim 14, wherein a first plurality of the second plurality of overlap points are located along an outside edge of the second group and a second plurality of the second plurality of overlap points are located within the second group, wherein the second branching point is defined as a second minimum point with respect to a second min-path distance calculated between second pairs of the first plurality of the second plurality of overlap points and the second plurality of the second plurality of overlap points associated with the same pair of images of the second group.

16. The computer-readable medium of claim 13, wherein the first branching point and the second branching point are on opposite sides of the edge defined between the nodes of the at least two overlapping images of the first group and the second group that are the same images.

17. The computer-readable medium of claim 9, wherein the computer-readable instructions further cause the computing device to:

receive an indicator of an interaction by a user with the image mosaic presented in the display, wherein the indicator indicates that the user has selected the branching point and has moved the selected branching point to a first location within an overlapping region between the at least three overlapping images;

compute a second seam that includes the first location; and

control presentation of the image mosaic in the display of the first device, wherein the image mosaic includes the second seam between the at least three overlapping images, and further wherein the second seam replaces at least a portion of the first seam in the image mosaic.

18. The computer-readable medium of claim 17, wherein the first seam is computed using a first seam tree and a second seam tree, wherein the first seam tree is stored as a first node buffer and a first tree buffer, wherein the first node buffer includes a first node distance value for each pixel in the overlapping region to the first overlap point and the first tree buffer includes a first direction value for each pixel in the overlapping region that indicates a first direction of a first connecting pixel in a 4-pixel neighborhood about each pixel in a first path from the first overlap point to the respective pixel, and further wherein the second seam tree is stored as a second node buffer and a second tree buffer, wherein the second node buffer includes a second node distance value for each pixel in the overlapping region to the branching point and the second tree buffer includes a second direction value for each pixel in the overlapping region that indicates a second direction of a second connecting pixel in a 4-pixel neighborhood about each pixel in a second path from the branching point to the respective pixel.

19. The computer-readable medium of claim 18, wherein the second seam is computed by identifying a first pixel in the first node buffer associated with the first location and by walking up the first seam tree to the first overlap point from the first pixel using the first node distance value and the first direction value.

20. The computer-readable medium of claim 19, wherein the second seam is further computed by identifying a second pixel in the second node buffer associated with the first location and by walking up the second seam tree to the branching point from the second pixel using the second node distance value and the second direction value.

2. A system comprising:

a display;

a processor; and

a computer-readable medium operably coupled to the processor, the computer-readable medium having computer-readable instructions stored thereon that, when executed by the processor, cause the system to

read a plurality of image files, wherein the plurality of image files contain image data defining a plurality of overlapping images;

define a dual adjacency mesh for an image mosaic based on an arrangement of the plurality of overlapping images, wherein the dual adjacency mesh is defined as a plurality of nodes and edges that connect a pair of the plurality of nodes, wherein a node is defined for each image of the plurality of overlapping images and an edge is defined between each node of a pair of images of the plurality of overlapping images that overlap; and

control presentation of the image mosaic in the display, wherein the image mosaic is created from the plurality of overlapping images based on the defined dual adjacency mesh.

3. A method of creating an image mosaic, the method comprising:

reading a plurality of image files at a computing device, wherein the plurality of image files contain image data defining a plurality of overlapping images;

defining, by the computing device, a dual adjacency mesh for an image mosaic based on an arrangement of the plurality of overlapping images, wherein the dual adjacency mesh is defined as a plurality of nodes and edges that connect a pair of the plurality of nodes, wherein a node is defined for each image of the plurality of overlapping images and an edge is defined between each node of a pair of images of the plurality of overlapping images that overlap; and

control presentation of the image mosaic in a display of the computing device, wherein the image mosaic is created from the plurality of overlapping images based on the defined dual adjacency mesh.