Video image processing and fusion
First Claim
1. A method of processing image data derived from radiation emanating from a scene and acquired by a multi-channel enhanced vision system to render an image of the scene for display, the image exhibiting features of spatial regions of the scene in great detail, comprising:
- detecting first and second wavelength bands of radiation emanating from a scene to produce respective first and second sets of high dynamic range image data that include representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene;
performing nonlinear intensity transformation of data derived from the first set and second set of high dynamic range image data to produce, respectively, a first set of low dynamic range image data representing a first low dynamic range detailed image of the scene and a second set of low dynamic range image data representing a second low dynamic range detailed image of the scene, the nonlinear intensity transformation substantially preserving or enhancing in the first and second low dynamic range detailed images the relatively low contrast, high spatial frequency detail of features of the spatial regions of the scene represented in the first and second sets of high dynamic range image data; and
combining the first low dynamic range detailed image and the second low dynamic range detailed image to form a fused image that, when rendered on a display, exhibits in great detail the features of the spatial regions of the scene.
8 Assignments
0 Petitions
Accused Products
Abstract
Processing of image data derived from radiation emanating from a scene and acquired by a multi-channel enhanced vision system renders an image of the scene for display. Detected first and second wavelength bands of radiation produce respective first and second sets of image data that include representations of relatively low contrast, high spatial frequency detail of features of the scene. Nonlinear intensity transformation of data derived from the first and second sets of image data produces, respectively, first and second sets of low dynamic range image data representing, respectively, first and second sets of intensity values. Different pairs of associated intensity values of the first and second sets correspond to different pixels forming an image. The associated intensity values of the different pairs are combined to form fused image data representing brightness levels of the pixels forming a displayed image that exhibits with high brightness and in great detail the features of the scene.
-
Citations
25 Claims
-
1. A method of processing image data derived from radiation emanating from a scene and acquired by a multi-channel enhanced vision system to render an image of the scene for display, the image exhibiting features of spatial regions of the scene in great detail, comprising:
-
detecting first and second wavelength bands of radiation emanating from a scene to produce respective first and second sets of high dynamic range image data that include representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene; performing nonlinear intensity transformation of data derived from the first set and second set of high dynamic range image data to produce, respectively, a first set of low dynamic range image data representing a first low dynamic range detailed image of the scene and a second set of low dynamic range image data representing a second low dynamic range detailed image of the scene, the nonlinear intensity transformation substantially preserving or enhancing in the first and second low dynamic range detailed images the relatively low contrast, high spatial frequency detail of features of the spatial regions of the scene represented in the first and second sets of high dynamic range image data; and combining the first low dynamic range detailed image and the second low dynamic range detailed image to form a fused image that, when rendered on a display, exhibits in great detail the features of the spatial regions of the scene. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of processing image data derived from radiation emanating from a scene and acquired by a multi-channel enhanced vision system to render an image of the scene for display, the image exhibiting features of spatial regions of the scene with high brightness and in great detail, comprising:
-
detecting first and second wavelength bands of radiation emanating from a scene to produce respective first and second sets of image data that include representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene; performing nonlinear intensity transformation of data derived from the first set and second set of image data to produce, respectively, a first set of low dynamic range image data representing a first set of intensity values of pixels of a first image of the scene and a second set of low dynamic range image data representing a second set of intensity values of pixels of a second image of the scene; performing distortion correction to the first set of intensity values to form corrected intensity values of the pixels of the first image, the corrected intensity values being paired with intensity values of the second set to form different pairs of associated intensity values, the distortion correction to an intensity value of the first set corresponding to a first pixel of the first image comprising; selecting a first set of predetermined offset values that identify intensity values of the first set corresponding to a first group of adjacent pixels of the first image; selecting a first set of predetermined weight values for the adjacent pixels in the first group; determining a first weighted average intensity value based on the first set of weight values and the intensity values of the first set corresponding to the first group of adjacent pixels; and assigning the first weighted average intensity value as a corrected intensity value of the first pixel; and combining the associated intensity values of the different pairs to form fused image data representing brightness levels of pixels forming a fused image that, when rendered on a display, exhibits with high brightness and in great detail the features of the spatial regions of the scene. - View Dependent Claims (13, 14, 15)
-
-
16. A method of processing image data derived from radiation emanating from a scene and acquired by a multi-channel enhanced vision system to render an image of the scene for display, the image exhibiting features of spatial regions of the scene with high brightness and in great detail, comprising:
-
detecting first and second wavelength bands of radiation emanating from a scene to produce respective first and second sets of image data that include representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene; performing nonlinear intensity transformation of data derived from the first set and second set of image data to produce, respectively, a first set of low dynamic range image data representing a first set of intensity values and a second set of low dynamic range image data representing a second set of intensity values; adjusting intensity values of the first set representing negative-going excursions to reduce perception of visible artifacts of the image of the scene, the adjusting producing a third set of intensity values, and different pairs of associated intensity values of the second and third sets corresponding to different pixels forming the image of the scene; and combining the associated intensity values of the different pairs to form fused image data representing brightness levels of the pixels forming the image that, when rendered on a display, exhibits with high brightness and in great detail the features of the spatial regions of the scene.
-
-
17. A method of processing image data derived from radiation emanating from a scene and acquired by a multi-channel enhanced vision system to render an image of the scene for display, the image exhibiting features of spatial regions of the scene with high brightness and in great detail, comprising:
-
detecting first, second, and third wavelength bands of radiation emanating from a scene to produce respective first, second, and third sets of image data that include representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene; performing nonlinear intensity transformation of data derived from the first, second, and third sets of image data to produce, respectively, a first set of low dynamic range image data representing a first set of intensity values, a second set of low dynamic range image data representing a second set of intensity values, and a third set of low dynamic range image data representing a third set of intensity values; determining an average value of the intensity values of the first set; adjusting the intensity values of the third set according to the determined average value such that the intensity values of the third set are decreased corresponding to an increase of the average value of the first set, the adjusting producing a fourth set of intensity values, and different groups of associated intensity values of the first, second, and fourth sets corresponding to different pixels forming an image of the scene; and combining the associated intensity values of the different groups to form fused image data representing brightness levels of the pixels forming an image that, when rendered on a display, exhibits with high brightness and in great detail the features of the spatial regions of the scene. - View Dependent Claims (18, 19, 20)
-
-
21. A method of processing image data derived from radiation emanating from a scene and acquired by a multi-channel enhanced vision system to render an image of the scene for display, the image exhibiting features of spatial regions of the scene with high brightness and in great detail, comprising:
-
detecting first and second wavelength bands of radiation emanating from a scene to produce respective first and second sets of image data that include representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene; identifying a subset of the image data of the first set; determining a peak intensity level of the first wavelength band of radiation represented in the subset; producing a control signal representing the peak intensity level; regulating an amount of radiation detected in the first wavelength band in response to the control signal to reduce saturation caused by image features of the scene represented in the first wavelength band of radiation; performing nonlinear intensity transformation of data derived from the first set and second set of image data to produce, respectively, a first set of low dynamic range image data representing a first set of intensity values and a second set of low dynamic range image data representing a second set of intensity values, different pairs of associated intensity values of the first and second sets corresponding to different pixels forming an image of the scene; and combining the associated intensity values of the different pairs to form fused image data representing brightness levels of the pixels forming an image that, when rendered on a display, exhibits with high brightness and in great detail the features of the spatial regions of the scene. - View Dependent Claims (22)
-
-
23. A multi-channel enhanced vision system for processing image data derived from radiation emanating from a scene and acquired by the multi-channel enhanced vision system to render an image of the scene for display, comprising:
-
a first channel configured to detect a first wavelength band of radiation emanating from a scene and produce a first set of high dynamic range image data including representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene, the first channel comprising; a first conversion unit implemented with a nonlinear intensity transformation for transforming data derived from the first set of high dynamic range image data to produce a first set of low dynamic range image data representing a first low dynamic range detailed image of the scene, the first conversion unit configured to substantially preserve or enhance in the first low dynamic range detailed image the relatively low contrast, high spatial frequency detail of the features of the spatial regions of the scene represented in the first set of high dynamic range image data; a second channel configured to detect a second wavelength band of radiation emanating from a scene and produce a second set of high dynamic range image data including representations of relatively low contrast, high spatial frequency detail of features of spatial regions of the scene, the second channel comprising; a second conversion unit implemented with a nonlinear intensity transformation for transforming data derived from the second set of high dynamic range image data to produce a second set of low dynamic range image data representing a second low dynamic range detailed image of the scene, the second conversion unit configured to substantially preserve or enhance in the second low dynamic range detailed image the relatively low contrast, high spatial frequency detail of the features of the spatial regions of the scene represented in the second set of high dynamic range image data; and a fusion unit configured to combine the first low dynamic range detailed image and the second low dynamic range detailed image to form a fused image that, when rendered on a display, exhibits in great detail the features of the spatial regions of the scene. - View Dependent Claims (24, 25)
-
Specification