FREE SPACE DETECTION SYSTEM AND METHOD FOR A VEHICLE USING STEREO VISION
First Claim
1. A system for detecting a free space in a direction of travel of a vehicle, comprising:
- an image capturing unit including left and right image capturers adapted to be spacedly loaded on the vehicle for capturing respectively left and right images from the vehicle environment in the direction of travel of the vehicle;
a signal processing unit connected electrically to said image capturing unit for receiving the left and right images therefrom, said signal processing unit being operable totransforming the left and right images captured by said first and second image capturing units to obtain a three-dimensional depth image that includes X×
Y pixels, where X represents the number of the pixels in an image column direction, and Y represents the number of the pixels in an image row direction, each of the pixels having an individual disparity value,transforming the three-dimensional depth image into two-dimensional image data relative to image row and the disparity so as to generate a road function based on the two-dimensional image data,transforming the three-dimensional depth image into an occupancy grid map relative to disparity and image column,determining, based on a travel condition of the vehicle, a detecting area of the occupancy grid map to be detected,estimating a cost estimation value corresponding to each of the disparity values on the same image column in the detecting area of the occupancy grid map using a cost function and the road function, and defining one of the disparity values on the same image column in the detecting area of the occupancy grid map whose the cost estimation value is maximum as an initial boundary disparity value for a corresponding one of all image columns in the detecting area of the occupancy grid map, andoptimizing the initial boundary disparity values for all the image columns in the detecting area of the occupancy grid map using an optimized boundary estimation function so as to obtain optimized boundary disparity values corresponding respectively to the initial boundary disparity values, and determining the free space in an image plane based on the optimized boundary disparity values using the road function.
1 Assignment
0 Petitions
Accused Products
Abstract
In free space detection system and method for a vehicle, left and right images captured from the vehicle environment in a direction of travel of the vehicle are transformed to obtain a depth image with disparity values. The depth image is transformed to obtain a road function and an occupancy grid map. A cost estimation value corresponding to each disparity value on the same image column in a detecting area of the occupancy grid map is estimated using a cost function and the road function such that initial boundary disparity values each defined by one disparity value on the same image column whose the cost estimation value is maximum are optimized to obtain optimized boundary disparity values by which a free space is determined.
24 Citations
8 Claims
-
1. A system for detecting a free space in a direction of travel of a vehicle, comprising:
-
an image capturing unit including left and right image capturers adapted to be spacedly loaded on the vehicle for capturing respectively left and right images from the vehicle environment in the direction of travel of the vehicle; a signal processing unit connected electrically to said image capturing unit for receiving the left and right images therefrom, said signal processing unit being operable to transforming the left and right images captured by said first and second image capturing units to obtain a three-dimensional depth image that includes X×
Y pixels, where X represents the number of the pixels in an image column direction, and Y represents the number of the pixels in an image row direction, each of the pixels having an individual disparity value,transforming the three-dimensional depth image into two-dimensional image data relative to image row and the disparity so as to generate a road function based on the two-dimensional image data, transforming the three-dimensional depth image into an occupancy grid map relative to disparity and image column, determining, based on a travel condition of the vehicle, a detecting area of the occupancy grid map to be detected, estimating a cost estimation value corresponding to each of the disparity values on the same image column in the detecting area of the occupancy grid map using a cost function and the road function, and defining one of the disparity values on the same image column in the detecting area of the occupancy grid map whose the cost estimation value is maximum as an initial boundary disparity value for a corresponding one of all image columns in the detecting area of the occupancy grid map, and optimizing the initial boundary disparity values for all the image columns in the detecting area of the occupancy grid map using an optimized boundary estimation function so as to obtain optimized boundary disparity values corresponding respectively to the initial boundary disparity values, and determining the free space in an image plane based on the optimized boundary disparity values using the road function. - View Dependent Claims (2, 3, 4)
-
-
5. A method of detecting a free space in a direction of travel of a vehicle, comprising the steps of:
-
a) capturing respectively left and right images from the vehicle environment in the direction of travel of the vehicle; b) transforming the left and right images captured in step a) to obtain a three-dimensional depth image that includes X×
Y pixels, where X represents the number of the pixels in an image column direction, and Y represents the number of the pixels in an image row direction, each of the pixels having an individual disparity value;c) transforming the three-dimensional depth image into two-dimensional image data relative to image row and disparity so as to generate a road function based on the two-dimensional image data; d) transforming the three-dimensional depth image into an occupancy grid map relative to disparity and image column; e) determining, based on a travel condition of the vehicle, a detecting area of the occupancy grid map to be detected; f) estimating a cost estimation value corresponding to each of the disparity values on the same image column in the detecting area of the occupancy grid map using a cost function and the road function obtained in step c), and defining one of the disparity values on the same image column in the detecting area of the occupancy grid map whose the cost estimation value is maximum as an initial boundary disparity value for a corresponding one of all image columns in the detecting area of the occupancy grid map; and g) optimizing the initial boundary disparity values for all the image column coordinates in the detecting area of the occupancy grid map using an optimized boundary estimation function so as to obtain optimized boundary disparity values corresponding respectively to the initial boundary disparity values, and determining the free space in an image plane based on the optimized boundary disparity values using the road function obtained in step c). - View Dependent Claims (6, 7, 8)
-
Specification