Forward direction monitoring device

• US 20070075892A1
• Filed: 10/02/2006
• Published: 04/05/2007
• Est. Priority Date: 10/03/2005
• Status: Abandoned Application

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Horibe, Koji
• Application Number:
  US11/542,587
• Publication Number:
  US 20070075892A1
• Time in Patent Office: Days
• US Class Current: 342/70
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 17/931 of land vehicles
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A forward direction monitoring device has a camera to take an image of road condition in front and a back-projection image is generated. A radar part receives reflected waves from objects in front and obtains their relative position data. These relative positions are mapped on the image taken by the camera. Portions of the image are specified with reference to these relative positions and brightness distribution of image portions is analyzed to distinguish the kinds of the objects. After those of the relative position data not related to a desired object are eliminated, the remaining relative position data are obtained sequentially to monitor the desired object based on the obtained data.

Claims

1. A forward direction monitoring device comprising:

an image taking part for taking an image of road condition in front of own vehicle;

a radar part for projecting detecting waves into a detection area in front of said own vehicle and receiving reflected waves of said detecting waves from objects in front to thereby obtain relative position data on relative positions of said objects with respect to said own vehicle;

a mapping part for mapping said relative positions of said objects on said image taken by said image taking part;

an object identifying part for specifying image portions of said image with respect to said relative positions, identifying kinds of said objects by analyzing brightness distribution of said image portions and eliminating those of relative position data of said objects other than relative position data of desired objects from the relative position data of said objects obtained by said radar part; and

a monitoring part for obtaining continuously in time sequence the relative position data after the step of eliminating and continuously monitoring said desired objects based on said obtained relative position data.

2. The forward direction monitoring device of claim 1 wherein said mapping part converts said image taken by said image taking part into a back-projection image and maps said relative positions of said objects onto said back-projection image.

3. The forward direction monitoring device of claim 1 wherein said object identifying part has the functions of:

setting each of said image portions as a rectangular area defining vertical direction as the direction of motion of said own vehicle and horizontal direction as the direction of the width of the road;

generating a histogram by cumulatively adding brightness of each point in said vertical direction corresponding to each point in said horizontal direction;

detecting a width in said horizontal direction on said histogram where the cumulatively added brightness is in excess of a preliminarily determined reference value; and

eliminating from consideration, if said detected width is greater than a preliminary defined first threshold value and the average of cumulatively added brightness corresponding to said detected width is greater than a preliminarily defined second threshold value, the object corresponding to the corresponding image portion.

4. The forward direction monitoring device of claim 2 wherein said object identifying part has the functions of:

setting each of said image portions as a rectangular area defining vertical direction as the direction of motion of said own vehicle and horizontal direction as the direction of the width of the road;

generating a histogram by cumulatively adding brightness of each point in said vertical direction corresponding to each point in said horizontal direction;

detecting a width in said horizontal direction on said histogram where the cumulatively added brightness is in excess of a preliminarily determined reference value; and

eliminating from consideration, if said detected width is greater than a preliminary defined first threshold value and the average of cumulatively added brightness corresponding to said detected width is greater than a preliminarily defined second threshold value, the object corresponding to the corresponding image portion.

5. The forward direction monitoring device of claim 3 further comprising a white line detector for detecting white lines extending parallel to the direction of the road;

wherein said object identifying part further has the functions of setting the width of the image portions in said horizontal direction and said first threshold value according to a change in the distance between said white lines detected by said white line detector.

6. The forward direction monitoring device of claim 4 further comprising a white line detector for detecting white lines extending parallel to the direction of the road;

wherein said object identifying part further has the functions of setting the width of the image portions in said horizontal direction and said first threshold value according to a change in the distance between said white lines detected by said white line detector.

7. The forward direction monitoring device of claim 2 further comprising a white line detector for detecting white lines extending parallel to the direction of the road;

wherein said mapping part serves to detect a change in the slope condition of the road in front according to a change in the distance between said white lines detected by said white line detector and to correct and map to said back-projection image the relative positions of said objects along the direction of the road according to said change in the slope condition.

8. The forward direction monitoring device of claim 3 further comprising a white line detector for detecting white lines extending parallel to the direction of the road;

wherein said mapping part serves to detect a change in the slope condition of the road in front according to a change in the distance between said white lines detected by said white line detector and to correct and map to said back-projection image the relative positions of said objects along the direction of the road according to said change in the slope condition.

9. The forward direction monitoring device of claim 4 further comprising a white line detector for detecting white lines extending parallel to the direction of the road;

wherein said mapping part serves to detect a change in the slope condition of the road in front according to a change in the distance between said white lines detected by said white line detector and to correct and map to said back-projection image the relative positions of said objects along the direction of the road according to said change in the slope condition.

10. The forward direction monitoring device of claim 5 wherein said mapping part serves to detect a change in the slope condition of the road in front according to a change in the distance between said white lines detected by said white line detector and to correct and map to said back-projection image the relative positions of said objects along the direction of the road according to said change in the slope condition.

11. The forward direction monitoring device of claim 6 wherein said mapping part serves to detect a change in the slope condition of the road in front according to a change in the distance between said white lines detected by said white line detector and to correct and map to said back-projection image the relative positions of said objects along the direction of the road according to said change in the slope condition.