Target-Less Auto-Alignment Of Image Sensors In A Multi-Camera System
First Claim
1. A computer-implemented method for determining a pixel shift between an image pair captured by image sensors, the method comprising:
- accessing a first image and a second image of the image pair captured at a substantially same time, the images comprising image data representative of an overlapping field of view between the image sensors;
determining edge magnitude of the image data based on derivatives along at least a row and a column of pixel luma components in the image data;
determining edge phase of the image data based an inverse tangent of the derivatives of the pixel luma components;
identifying, by one or more processors, one or more edges in the image data based, at least in part, on the edge magnitude and the edge phase of the image data;
matching the identified one or more edges in the image data corresponding to the first image to the identified one or more edges in the image data corresponding to the second image; and
determining a pixel shift between the image pair based, at least in part, on the matching of edges.
4 Assignments
0 Petitions
Accused Products
Abstract
A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
-
Citations
20 Claims
-
1. A computer-implemented method for determining a pixel shift between an image pair captured by image sensors, the method comprising:
-
accessing a first image and a second image of the image pair captured at a substantially same time, the images comprising image data representative of an overlapping field of view between the image sensors; determining edge magnitude of the image data based on derivatives along at least a row and a column of pixel luma components in the image data; determining edge phase of the image data based an inverse tangent of the derivatives of the pixel luma components; identifying, by one or more processors, one or more edges in the image data based, at least in part, on the edge magnitude and the edge phase of the image data; matching the identified one or more edges in the image data corresponding to the first image to the identified one or more edges in the image data corresponding to the second image; and determining a pixel shift between the image pair based, at least in part, on the matching of edges. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer readable medium comprising instructions for determining a pixel shift between an image pair captured by image sensors, the instructions executable by a processor, the instructions comprising instructions for:
-
accessing a first image and a second image of the image pair captured at a substantially same time, the images comprising image data representative of an overlapping field of view between the image sensors; determining edge magnitude of the image data based on derivatives along at least a row and a column of pixel luma components in the image data; determining edge phase of the image data based an inverse tangent of the derivatives of the pixel luma components; identifying, by one or more processors, one or more edges in the image data based, at least in part, on the edge magnitude and the edge phase of the image data; matching the identified one or more edges in the image data corresponding to the first image to the identified one or more edges in the image data corresponding to the second image; and determining a pixel shift between the image pair based, at least in part, on the matching of edges. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A camera system comprising at least one processor, an image sensor, and a non-transitory computer readable medium comprising instructions for determining a pixel shift between an image pair captured by image sensors including the image sensor, the instructions executable by the at least one processor, the instructions comprising instructions for:
-
accessing a first image and a second image of the image pair captured at a substantially same time, the images comprising image data representative of an overlapping field of view between the image sensors; determining edge magnitude of the image data based on derivatives along at least a row and a column of pixel luma components in the image data; determining edge phase of the image data based an inverse tangent of the derivatives of the pixel luma components; identifying, by one or more processors, one or more edges in the image data based, at least in part, on the edge magnitude and the edge phase of the image data; matching the identified one or more edges in the image data corresponding to the first image to the identified one or more edges in the image data corresponding to the second image; and determining a pixel shift between the image pair based, at least in part, on the matching of edges. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification