Multi-camera vehicle vision system with image gap fill
First Claim
1. A vision system of a vehicle, said vision system comprising:
- a plurality of cameras configured to be disposed at a vehicle so as to have respective fields of view exterior of the vehicle, wherein each camera captures image data, and wherein each camera comprises a two dimensional array of photosensing elements;
an image processor receiving, with the cameras disposed at the vehicle, image data captured by the cameras, the image processor processing image data captured by each of the cameras for warping or projection of a source image into a target image for display at a display device that is viewable by a driver of the vehicle;
wherein the display device comprises a two dimensional array of display pixels, the display device operable to display target images derived from image data captured by the cameras;
wherein said vision system provides images for display by the display device that are derived via backward projection, tracing rays from a display plane pixel grid of the display device backwards to one or more source camera pixel grids of one or more of the cameras using warping and unwarping schemes of the one or more cameras and virtual views that are to be generated for display of images by the display device;
wherein the image processor scans through image data of source images in a scan order, and wherein each source image element of the source image is included only once in the scan order, and wherein the image processor determines the location of a source image element in the target image, and wherein multiple source image elements exist with the same target image location; and
wherein the image processor comprises a set of accumulator registers, and wherein one accumulator register is selected by the location of the source image element in the target image, and wherein the image processor adds each source image element to the selected accumulator register to obtain an average of all source image elements within the same target image location.
0 Assignments
0 Petitions
Accused Products
Abstract
A vision system of a vehicle includes an image processor and a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle. The image processor provides warping or projection of a source image into a target image. The image processor scans through source images in a regular order, wherein each element of the source image is included only once in the scan order. The image processor determines the location of the source image element in the target image, with multiple source image elements existing with the same target image location. The image processor includes a set of accumulator registers, with one accumulator register selected by the location in the target image, and the image processor adds each source image element to the selected accumulator register to obtain an average of all source image elements with the same target image location.
-
Citations
20 Claims
-
1. A vision system of a vehicle, said vision system comprising:
-
a plurality of cameras configured to be disposed at a vehicle so as to have respective fields of view exterior of the vehicle, wherein each camera captures image data, and wherein each camera comprises a two dimensional array of photosensing elements; an image processor receiving, with the cameras disposed at the vehicle, image data captured by the cameras, the image processor processing image data captured by each of the cameras for warping or projection of a source image into a target image for display at a display device that is viewable by a driver of the vehicle; wherein the display device comprises a two dimensional array of display pixels, the display device operable to display target images derived from image data captured by the cameras; wherein said vision system provides images for display by the display device that are derived via backward projection, tracing rays from a display plane pixel grid of the display device backwards to one or more source camera pixel grids of one or more of the cameras using warping and unwarping schemes of the one or more cameras and virtual views that are to be generated for display of images by the display device; wherein the image processor scans through image data of source images in a scan order, and wherein each source image element of the source image is included only once in the scan order, and wherein the image processor determines the location of a source image element in the target image, and wherein multiple source image elements exist with the same target image location; and wherein the image processor comprises a set of accumulator registers, and wherein one accumulator register is selected by the location of the source image element in the target image, and wherein the image processor adds each source image element to the selected accumulator register to obtain an average of all source image elements within the same target image location. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A vision system of a vehicle, said vision system comprising:
-
a plurality of cameras configured to be disposed at a vehicle so as to have respective fields of view exterior of the vehicle, wherein each camera captures image data, and wherein each camera comprises a two dimensional array of photosensing elements; an image processor receiving, with the cameras disposed at the vehicle, image data captured by the cameras, the image processor processing image data captured by each of the cameras for warping or projection of a source image into a target image for display at a display device that is viewable by a driver of the vehicle; wherein the display device comprises a two dimensional array of display pixels, the display device operable to display target images derived from image data captured by the cameras; wherein said vision system provides images for display by the display device that are derived via backward projection, tracing rays from a display plane pixel grid of the display device backwards to one or more source camera pixel grids of one or more of the cameras using warping and unwarping schemes of the one or more cameras and virtual views that are to be generated for display of images by the display device; wherein the image processor scans through image data of source images in a scan order, and wherein each source image element of the source image is included only once in the scan order, and wherein the image processor determines the location of a source image element in the target image, and wherein multiple source image elements exist with the same target image location; wherein the image processor comprises a set of accumulator registers, and wherein one accumulator register is selected by the location of the source image element in the target image, and wherein the image processor adds each source image element to the selected accumulator register to obtain an average of all source image elements within the same target image location; wherein one accumulator register exists per horizontal or vertical element of the target image, and wherein the accumulator register is selected by the horizontal or vertical position of the source image element in the target image; and wherein gaps in the target image exist where no source image element is located, and wherein the gaps are between target image elements where source image elements are located, and wherein the image processor detects the gaps while scanning through the source image, and wherein the image processor comprises a memory where a list of detected gaps is maintained, and wherein the image processor uses the list of detected gap in an independent processing step to fill the gaps. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A vision system of a vehicle, said vision system comprising:
-
a plurality of cameras configured to be disposed at a vehicle so as to have respective fields of view exterior of the vehicle, wherein each camera captures image data, and wherein each camera comprises a two dimensional array of photosensing elements; wherein the plurality of cameras are part of a surround view system of the vehicle and wherein the plurality of cameras at least comprise a forward viewing camera, a rearward viewing camera, a driver side viewing camera and a passenger side viewing camera; an image processor receiving, with the cameras disposed at the vehicle, image data captured by the cameras, the image processor processing image data captured by each of the cameras for warping or projection of a source image into a target image for display at a display device that is viewable by a driver of the vehicle; wherein the display device comprises a two dimensional array of display pixels, the display device operable to display target images derived from image data captured by the cameras; wherein said vision system provides images for display by the display device that are derived via backward projection, tracing rays from a display plane pixel grid of the display device backwards to one or more source camera pixel grids of one or more of the cameras using warping and unwarping schemes of the one or more cameras and virtual views that are to be generated for display of images by the display device; wherein the image processor scans through image data of source images in a scan order, and wherein each source image element of the source image is included only once in the scan order, and wherein the image processor determines the location of a source image element in the target image, and wherein multiple source image elements exist with the same target image location; wherein the image processor comprises a set of accumulator registers, and wherein one accumulator register is selected by the location of the source image element in the target image, and wherein the image processor adds each source image element to the selected accumulator register to obtain an average of all source image elements within the same target image location; wherein gaps in the target image exist where no source image element is located, and wherein the gaps are between target image elements where source image elements are located, and wherein the image processor detects the gaps while scanning through the source image, and wherein the image processor comprises a memory where a list of detected gaps is maintained, and wherein the image processor uses the list of detected gap in an independent processing step to fill the gaps; and wherein a source image is partially or completely visible multiple times in the target image, and wherein in a first step, all views of the source image are processed independently into partial target image, and wherein in a second step, the gaps in the target image are filled, and wherein in a third step, all partial target images are blended into the final target image. - View Dependent Claims (20)
-
Specification