System and method of aligning images
First Claim
1. A method comprising:
- receiving, with a processing system, a sequence of frames, the frames together forming a shot, each frame comprising a sequence of at least two image positions with an image acquired from a corresponding image capturing device at each image position, wherein the images corresponding to each pair of adjacent image positions have an overlap region;
determining, with a processor of the imaging system, a set of local alignment values for each frame of a selected group of at least two frames of the shot, each set of local alignment values including one local alignment value for each pair of adjacent image positions of the frame which is based on minimizing a difference of a desired parameter between the corresponding images in the overlap region;
determining, with the processor, a single set of global alignment values for the shot, the set of global alignment values including one global alignment value for each pair of same adjacent image positions of all frames of the shot, wherein each global alignment value is based on the local alignment value for the corresponding pair of adjacent image positions of all sets of local alignment values; and
applying, with the processing system, each global alignment value to at least one of the images at the corresponding pair of adjacent image positions of every frame of the shot to adjust a position of the at least one image relative to the other image.
1 Assignment
0 Petitions
Accused Products
Abstract
A method performed by a processing system. The method includes receiving a sequence of frames, each frame comprising a sequence of at least two images, each image at a different image position in the sequence and each pair of adjacent images having an overlap region. A local alignment value is determined for the images of each pair of adjacent image positions of each frame based on minimizing a difference of a desired parameter between the images in the overlap region. Global alignment values are determined for all images at corresponding pairs of adjacent image positions of each frame based on the local alignment values for the images at the corresponding pair of adjacent image positions of each frame. Each global alignment value is applied to at least one image of the images of the corresponding pair of adjacent image positions of each frame.
-
Citations
30 Claims
-
1. A method comprising:
-
receiving, with a processing system, a sequence of frames, the frames together forming a shot, each frame comprising a sequence of at least two image positions with an image acquired from a corresponding image capturing device at each image position, wherein the images corresponding to each pair of adjacent image positions have an overlap region; determining, with a processor of the imaging system, a set of local alignment values for each frame of a selected group of at least two frames of the shot, each set of local alignment values including one local alignment value for each pair of adjacent image positions of the frame which is based on minimizing a difference of a desired parameter between the corresponding images in the overlap region; determining, with the processor, a single set of global alignment values for the shot, the set of global alignment values including one global alignment value for each pair of same adjacent image positions of all frames of the shot, wherein each global alignment value is based on the local alignment value for the corresponding pair of adjacent image positions of all sets of local alignment values; and applying, with the processing system, each global alignment value to at least one of the images at the corresponding pair of adjacent image positions of every frame of the shot to adjust a position of the at least one image relative to the other image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A system comprising:
-
a memory system including; a local alignment module; a global alignment module; and a combining module; and a processor, wherein upon the system receiving a shot comprising a sequence of frames, each frame comprising a sequence of at least two image positions with an image at each image position, wherein the images at each pair of adjacent image positions have an overlap region, the processor is configured to; execute the local alignment module to determine a set of local alignment values for each frame of at least two selected frames of the shot, each set of local alignment values including one local alignment values for each pair of adjacent image positions of the frame which is based on minimizing a difference of a desired parameter between the corresponding images in the overlap region; execute the global alignment module to determine a single set of global alignment values for the shot, the set of global alignment values including one global alignment value for each pair of same adjacent image positions of all frames of the shot, wherein each global alignment value is based on the local alignment value for the corresponding pair of adjacent image positions of all sets of local alignment values; and execute the combining module to apply each global alignment value to at least one of the images at the corresponding pair of adjacent image positions of each frame. - View Dependent Claims (22, 23, 24)
-
-
25. A method performed by a processing system on a sequence of frames forming a shot, each frame comprising a sequence of at least two image positions with an image acquired from a corresponding image capturing device at each image position in the sequence, wherein the images at each pair of adjacent image positions have an overlap region, the method comprising:
-
determining, with a processor of the processing system, a set of local alignment values for each frame of a selected number of frames of the shot, each set of local alignment values having a local alignment value for the images at each pair of adjacent image positions of the frame; determining, with the processor, a single set of global alignment values for all frames of the shot, one global alignment value for the same pair of adjacent image positions of each frame and which is based on the local alignment values of the corresponding pair of adjacent image positions of the selected frames; and applying, with the processor, each global alignment value to at least one of the images of the corresponding pair of adjacent image positions of each frame, to adjust a position of the at least one image relative to the other image.
-
-
26. A system comprising:
-
an input/output unit to receive a sequence of frames forming a shot, each frame comprising at least two images, each image at a different image position in the sequence and acquires from a corresponding image capturing device, wherein each pair of adjacent images having an overlap region a local alignment module executed by a processor of the system to determine for each frame of a selected number of frames of the shot, a set of local alignment values for the images of each pair of adjacent image positions of the frame; a global alignment module executed by the processor to determine a single set of global alignment values for all frames of the shot including one global alignment value each of the same pairs of adjacent image positions of all frames which is based on each of the local alignment values for the corresponding pair of adjacent image positions of the selected frames; and a combining module executed by the processor to apply each global alignment value to at least one image of the images at the corresponding pair of adjacent image positions of each frame to adjust a position of the at least one image to the other image.
-
-
27. A computer-readable medium including instructions executable by a processing system for performing a method comprising:
-
receiving a sequence of frames forming a shot, each frame comprising a sequence of at least two images, each image at a different image position in the sequence with the images at each pair of adjacent image positions having an overlap region; determining a set of local alignment values for each frame of a plurality of selected frames of the shot, each set of local alignment values including one local alignment value for the images of each pair of adjacent image positions of the selected frame; determining a single set of global alignment values for all frames of the shot, one global alignment value for the same pair of adjacent image positions of each frame; and applying each global alignment value to at least one of the images of the corresponding pair of adjacent image positions of each frame.
-
-
28. A method comprising:
-
receiving, with a processing system, a sequence of p frames, the p frames together forming a shot, each of the p frames comprising a sequence of n images at n image positions acquired from a corresponding image capturing device for each image position, wherein the images at each of n−
1 pairs of adjacent image positions have an overlap region;determining, with a processor of the imaging system, p sets of local alignment values, one for each of the p frames, each of the p sets of local alignment values including n−
1 local alignment values, one local alignment value for the images at each of the n−
1 pairs of adjacent image positions, wherein each of the n−
1 local alignment values is based on minimizing a difference of a selected parameter in the overlap region between the images at the corresponding pair of adjacent image positions;determining, with the processor, one set of global alignment values for the shot, the set of global alignment values including n−
1 global alignment values, one global alignment value for each of the n−
1 pairs of adjacent image positions of all p frames of the shot, wherein each of the n−
1 global alignment values is based on the p local alignment values of corresponding pair of adjacent image positions of all sets of local alignment values; andapplying, with the processing system, each of the n−
1 global alignment values to one of the images at the corresponding pair of adjacent image positions of each of the p frames to adjust a position of the one image relative to the other image. - View Dependent Claims (29, 30)
-
Specification