Multispectral imaging system
First Claim
Patent Images
1. An electronic method for aligning a near infrared (NIR) image with a visible image in a system including a NIR imaging sensor and a visible imaging sensor, the method comprising:
- receiving a NIR image from the NIR imaging sensor, the NIR image being devoid of visible image data;
receiving a visible image from the visible imaging sensor;
matching pixels in the NIR image with pixels in the visible image on a pixel-by-pixel basis to form a plurality of matched pixel pairs based at least in part on an association of NIR pixel image data with visible pixel image data for each matched pixel pair;
calculating a pixel disparity, a disparity-similarity, and a color-similarity for each matched pixel pair;
assigning weights to each matched pixel pair based at least in part on the calculated pixel disparity, the calculated disparity-similarity, and the calculated color-similarity for each matched pixel pair; and
aligning the NIR image with the visible image based at least in part on the assigned weights that exceed a predetermined threshold.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for multispectral imaging are disclosed. The multispectral imaging system can include a near infrared (NIR) imaging sensor and a visible imaging sensor. The disclosed systems and methods can be implemented to improve alignment between the NIR and visible images. Once the NIR and visible images are aligned, various types of multispectral processing techniques can be performed on the aligned images.
-
Citations
24 Claims
-
1. An electronic method for aligning a near infrared (NIR) image with a visible image in a system including a NIR imaging sensor and a visible imaging sensor, the method comprising:
-
receiving a NIR image from the NIR imaging sensor, the NIR image being devoid of visible image data; receiving a visible image from the visible imaging sensor; matching pixels in the NIR image with pixels in the visible image on a pixel-by-pixel basis to form a plurality of matched pixel pairs based at least in part on an association of NIR pixel image data with visible pixel image data for each matched pixel pair; calculating a pixel disparity, a disparity-similarity, and a color-similarity for each matched pixel pair; assigning weights to each matched pixel pair based at least in part on the calculated pixel disparity, the calculated disparity-similarity, and the calculated color-similarity for each matched pixel pair; and aligning the NIR image with the visible image based at least in part on the assigned weights that exceed a predetermined threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A multispectral imaging system comprising:
-
a near infrared (NIR) imaging sensor configured to capture a NIR image, the NIR image being devoid of visible image data; a visible light imaging sensor configured to capture a visible light image; a dense matching module programmed to match pixels in the NIR image with pixels in the visible light image on a pixel-by-pixel basis to form a plurality of matched pixel pairs based at least in part on an association of NIR pixel image data with visible pixel image data for each matched pixel pair; a sparse matching module programmed to; calculate a pixel disparity, a disparity-similarity, and a color-similarity for each matched pixel pair; and assign weights to each matched pixel pair based at least in part on the calculated pixel disparity, the calculated disparity-similarity, and the calculated color-similarity for each matched pixel pair; an aligned image formation module programmed to align the NIR image with the visible image based at least in part on the assigned weights that exceed a predetermined threshold; and a storage module programmed to store the aligned image on the system. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. An imaging system, comprising:
-
means for receiving a near infrared (NIR) image from a NIR imaging sensor, the NIR image being devoid of visible image data; means for receiving a visible image from a visible imaging sensor; means for matching pixels in the NIR image with pixels in the visible image on a pixel-by-pixel basis to form a plurality of matched pixel pairs based at least in part on an association of NIR pixel image data with visible pixel image data for each matched pixel pair; means for calculating a pixel disparity, a disparity-similarity, and a color-similarity for each matched pixel pair; means for assigning weights to each matched pixel pair based at least in part on the calculated pixel disparity, the calculated disparity-similarity, and the calculated color-similarity for each matched pixel pair; and means for aligning the NIR image with the visible image based at least in part on the assigned weights that exceed a predetermined threshold. - View Dependent Claims (19, 20, 21, 22, 23)
-
-
24. A non-transitory computer-readable medium having stored thereon code that when executed performs a method comprising:
-
receiving a near infrared (NIR) image from the NIR imaging sensor, the NIR image being devoid of visible image data; receiving a visible image from the visible imaging sensor; matching pixels in the NIR image with pixels in the visible image on a pixel-by-pixel basis to form a plurality of matched pixel pairs based at least in part on an association of NIR pixel image data with visible pixel image data for each matched pixel pair; calculating a pixel disparity, a disparity-similarity, and a color-similarity for each matched pixel pair; assigning weights to each matched pixel pair based at least in part on the calculated pixel disparity, the calculated disparity-similarity, and the calculated color-similarity for each matched pixel pair; and aligning the NIR image with the visible image based at least in part on the assigned weights that exceed a predetermined threshold.
-
Specification