Panorama imaging using a blending map
First Claim
Patent Images
1. A method of generating a panorama image using a portable imaging device, said method comprising:
- fixing an exposure level for acquiring the panorama image using the portable imaging device;
panning the imaging device across a panoramic scene, acquiring a set of at least two image frames of overlapping portions of said panorama image and processing said set, said acquiring comprising using an optic and imaging sensor of the portable imaging device, said processing including;
sorting and retaining a set of image frames including one or more overlapping pairs of image frames,determining a relative displacement between each of said set of overlapping image frames, including determining the overlapped region for each image pair,registering or aligning, or both, said set of images based on the relative displacements;
determining an alpha blending map or an optimal stitch line or both for each pair of overlapping image frames;
joining said one or more pairs of image frames to form a panorama image; and
storing, transmitting or displaying said panorama image, or combinations thereof,wherein the determining of relative displacement comprises determining relative horizontal displacement between a pair of images of a set of overlapping image frames, and further includes summing pixel values in image columns across each of first and second images to determine a horizontal image profile for each image, and then determining a column difference profile across each of said images, and then determining a relative error function between said pair of images that is determined from said image column difference profiles, and wherein a minimum of said relative error function indicates a relative number of pixel columns of horizontal displacement are between said pair of images.
5 Assignments
0 Petitions
Accused Products
Abstract
A technique of generating a panoramic image involves acquiring a set of at least two main image frames, as well as corresponding generating and/or acquiring corresponding relatively low-resolution image frames, of overlapping portions of a panoramic scene. A map or other information is stored relating to the generation of a low-res panorama. A main panorama image is formed by joining main image frames based on the map or other information gained in the low-res process.
127 Citations
24 Claims
-
1. A method of generating a panorama image using a portable imaging device, said method comprising:
-
fixing an exposure level for acquiring the panorama image using the portable imaging device; panning the imaging device across a panoramic scene, acquiring a set of at least two image frames of overlapping portions of said panorama image and processing said set, said acquiring comprising using an optic and imaging sensor of the portable imaging device, said processing including; sorting and retaining a set of image frames including one or more overlapping pairs of image frames, determining a relative displacement between each of said set of overlapping image frames, including determining the overlapped region for each image pair, registering or aligning, or both, said set of images based on the relative displacements; determining an alpha blending map or an optimal stitch line or both for each pair of overlapping image frames; joining said one or more pairs of image frames to form a panorama image; and storing, transmitting or displaying said panorama image, or combinations thereof, wherein the determining of relative displacement comprises determining relative horizontal displacement between a pair of images of a set of overlapping image frames, and further includes summing pixel values in image columns across each of first and second images to determine a horizontal image profile for each image, and then determining a column difference profile across each of said images, and then determining a relative error function between said pair of images that is determined from said image column difference profiles, and wherein a minimum of said relative error function indicates a relative number of pixel columns of horizontal displacement are between said pair of images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A portable camera-enabled device capable of in-camera generation of a panorama image, comprising:
-
a lens; an image sensor; a processor; and a processor readable medium having code embedded therein for programming the processor to perform a panorama image generation method that comprises; fixing an exposure level for acquiring the panorama image using the portable device; panning the imaging device across a panoramic scene, acquiring a set of at least two image frames of overlapping portions of said panorama image and processing said set, said acquiring comprising using an optic and imaging sensor of the portable imaging device, said processing including; sorting and retaining a set of image frames including one or more overlapping pairs of image frames, determining a relative displacement between each of said set of overlapping image frames, including determining the overlapped region for each image pair, registering or aligning, or both, said set of images based on the relative displacements; determining an alpha blending map or an optimal stitch line or both for each pair of overlapping image frames; joining said one or more pairs of image frames to form a panorama image; and storing, transmitting or displaying said panorama image, or combinations thereof, wherein the determining of relative displacement comprises determining relative horizontal displacement between a pair of images of a set of overlapping image frames, and further includes summing pixel values in image columns across each of first and second images to determine a horizontal image profile for each image, and then determining a column difference profile across each of said images, and then determining a relative error function between said pair of images that is determined from said image column difference profiles, and wherein a minimum of said relative error function indicates a relative number of pixel columns of horizontal displacement are between said pair of images. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. One or more non-transitory processor-readable storage media having code embedded therein for programming a processor to perform a method for acquiring a panorama image using a portable imaging device, said method comprising:
-
fixing an exposure level for acquiring the panorama image using the portable imaging device; panning the imaging device across a panoramic scene, acquiring a set of at least two image frames of overlapping portions of said panorama image and processing said set, said acquiring comprising using an optic and imaging sensor of the portable imaging device, said processing including; sorting and retaining a set of image frames including one or more overlapping pairs of image frames, determining a relative displacement between each of said set of overlapping image frames, including determining the overlapped region for each image pair, registering or aligning, or both, said set of images based on the relative displacements; determining an alpha blending map or an optimal stitch line or both for each pair of overlapping image frames; joining said one or more pairs of image frames to form a panorama image; and storing, transmitting or displaying said panorama image, or combinations thereof, wherein the determining of relative displacement comprises determining relative horizontal displacement between a pair of images of a set of overlapping image frames, and further includes summing pixel values in image columns across each of first and second images to determine a horizontal image profile for each image, and then determining a column difference profile across each of said images, and then determining a relative error function between said pair of images that is determined from said image column difference profiles, and wherein a minimum of said relative error function indicates a relative number of pixel columns of horizontal displacement are between said pair of images. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
Specification