Obstacle detection device and method therefor

• US 20050169530A1
• Filed: 03/23/2005
• Published: 08/04/2005
• Est. Priority Date: 08/28/2002
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Nakai, Hiroaki, Hattori, Hiroshi, Onoguchi, Kazunori, Takeda, Nobuyuki
• Granted Patent: US 7,132,933 B2
• Time in Patent Office: Days
• US Class Current: 382/190
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/182 Network patterns, e.g. roads or rivers
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

Provided is a technology for helping safe driving and realizing automatic driving of vehicles, or for counting the number of passing vehicles on the road or monitoring those passing vehicles for their driving. Using a plurality of cameras mounted in a vehicle or provided above a road, even if the relationship between the road plane and the respective cameras constantly changes in relative position or posture due to camera vibration or a change in road tilt, any obstacles located on the road such as other vehicles ahead, parked vehicles, and pedestrians on the road are detected without confusing those with textures including white lines, road signs, paint, road stains, and shadows of roadside objects, all of which do not disturb vehicle driving. An obstacle detection device 10 is structured by an image input section 11 for receiving images from a plurality of image pick-up devices 101, a correspondence detection section 12 for finding a plurality of pairs of corresponding points from the received right and left images, the slope degree calculation section 13 for calculating a slope degree of a plane including the corresponding points, and a result determination section 14 for determining as there being an obstacle when the calculated slope degree is larger than a predetermined value.

Claims

1-17. -17. (canceled)

18. A vehicle in which at least two image pick-up devices each pick up an image of a preset common detection region, and which determines whether an obstacle is present or not in the detection region from the stereo images picked up using the image pick-up devices, the vehicle comprising:

image input means for receiving the image from each of the image pick-up devices;

correspondence detection means for deriving a plurality of pairs of corresponding points in the detection regions of the received two stereo images;

slope degree calculation means for calculating a slope degree corresponding to a slope angle between a basic plane which is parallel to optical axes of the image pick-up devices and a detection plane including the derived plurality of corresponding points in the stereo images; and

result determination means for determining there is an obstacle when the slope degree of the detection plane is larger than a predetermined value.

19. The vehicle according to claim 18, wherein:

the slope degree calculation means regards the slope angle as a pitch angle between the basic plane and the detection plane, and a parameter of an affine transformation matrix indicating a relationship between the corresponding points in the images or a unique value derived from the parameter as a slope degree.

20. The vehicle according to claim 19, wherein:

the slope degree calculation means calculates the slope degree by solving an equation based on a parallax and vertical positions of the plurality of pairs of corresponding points.

21. The vehicle according to claim 18, wherein:

the slope degree calculation means calculates the slope degree by voting coordinate values of the plurality of pairs of corresponding points into a voting space based on an equation satisfied by the coordinate values.

22. The vehicle according to claim 18, wherein:

the slope degree calculation means detects, as an obstacle, out of the plurality of pairs of corresponding points, only the pair of corresponding points resulting in the slope degree large in value.

23. A vehicle in which at least two image pick-up devices each pick up an image of a preset common detection region, and a determination is made from stereo images picked up using the image pick-up devices whether or not the detection region includes an obstacle, the vehicle comprising:

an image input section for receiving the stereo images from the image pick-up devices;

a correspondence detection section for deriving a plurality of pairs of corresponding points in the detection regions of the received stereo images;

a slope degree calculation section for calculating a slope degree corresponding to a slope angle between a basic plane which is parallel to optical axes of the image pick-up devices and a detection plane including the derived plurality of corresponding points in the stereo images; and

a result determination section for determining there is an obstacle when the slope degree of the detection plane is larger than a predetermined value.