Lane boundary line recognition apparatus and program for recognizing lane boundary line on roadway

• US 9,713,983 B2
• Filed: 04/29/2015
• Issued: 07/25/2017
• Est. Priority Date: 05/14/2014
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Takaki, Masanari, Kobayashi, Kenji
• Primary Examiner(s): Park, Chan
• Assistant Examiner(s): CHOI, TIMOTHY WING HO
• Application Number:
  US14/698,952
• Publication Number:
  US 20150332101A1
• Time in Patent Office: 818 Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60T 2201/08 Lane monitoring; Lane Keeping Systems
• CPC Class Codes: B60T 2201/089 using optical detection
• CPC Class Codes: B60T 7/22 initiated by contact of vehicle, e.g. bumper, with an external object, e.g. another vehicle , or by means of contactless obstacle detectors mounted on the vehicle
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A boundary line recognition apparatus receives detection results transmitted from camera devices and a laser radar device performing different optical detection methods. These detection results indicate information regarding a lane boundary line of a vehicle lane on a roadway on which an own vehicle drives. The apparatus further obtains surrounding environmental information of the own vehicle on the roadway, and selects at least one of the camera devices and the laser radar device suitable for correctly recognizing the lane boundary line on the basis of the environmental information. The apparatus finally recognizes the lane boundary line with high accuracy on the basis of the detection result transmitted form one or more devices selected based on the environment information.

Claims

1. A lane boundary line recognition apparatus capable of recognizing a lane boundary line of a vehicle lane on a roadway on which an own vehicle drives, the lane boundary line separating an inside of the vehicle lane, on which the own vehicle drives, from the outside of the vehicle lane, the lane boundary line recognition apparatus comprising:

a plurality of boundary line recognizers comprising an optical sensor, each boundary line recognizer having a different detection range that recognizes a lane boundary line by using a different optical detection method from other boundary line recognizers; and

a processing section comprising a central processing unit and including an environmental information obtaining section and a selection section, wherein

the environmental information obtaining section is configured to obtain environmental information from the plurality of boundary line recognizers which represent a surrounding environment of the own vehicle regarding obstacle factors preventing correct recognition of a lane boundary line; and

the selection section is configured to select at least one optimum boundary line recognizer of the boundary line recognizers on the basis of the obtained environmental information suitable for recognizing the lane boundary line of the vehicle lane of the own vehicle.

2. The lane boundary line recognition apparatus according to claim 1, wherein the environmental information obtaining section obtains the environmental information generated on the basis of sensor information transmitted from sensors mounted to the own vehicle.

3. The lane boundary line recognition apparatus according to claim 1, further comprising a current location obtaining section capable of obtaining a current location of the own vehicle,

wherein the environmental information obtaining section obtains the environmental information corresponding to the current location of the own vehicle.

4. The lane boundary line recognition apparatus according to claim 3, wherein the environmental information obtaining section obtains, as the environmental information, map information corresponding to the current location of the own vehicle.

5. The lane boundary line recognition apparatus according to claim 1, wherein the environmental information obtaining section obtains, as the environmental information, information which indicates a difference between the recognition results of the boundary line recognizers.

6. A non-transitory computer-readable storage medium for storing a program for performing processes to be executed by a central processing unit for performing the functions of the boundary line recognizers, the environmental information obtaining section and the selection section according to claim 1.

7. The lane boundary line recognition apparatus according to claim 1, wherein the boundary line recognizers comprise cameras and radar devices.

8. The lane boundary line recognition apparatus according to claim 1, wherein the boundary line recognizers comprise a camera having a narrow angle and a camera having a wide angle.

9. The lane boundary line recognition apparatus according to claim 1, wherein the environmental information obtained by the environmental information obtaining section includes information regarding at least one of rain, afternoon sun, shadow, night, traffic congestion, road work, change of longitudinal slope, tunnel-inlet and outlet, shape curve, branch point, junction point, asphalt road and concrete road.

11. The lane boundary line recognition apparatus according to claim 9, wherein the boundary line recognizers comprise radar devices, and

the selection section selects the radar devices when the obtained environmental information indicates night.

12. The lane boundary line recognition apparatus according to claim 1, wherein the selection section selects at least one of the boundary line recognizers on the basis of the detection results of the boundary line recognizers.

10. A lane boundary line recognition apparatus capable of recognizing a lane boundary line of a vehicle lane on a roadway on which an own vehicle drives, the lane boundary line separating an inside of the vehicle lane, on which the own vehicle drives, from the outside of the vehicle lane, the lane boundary line recognition apparatus comprising:

a plurality of boundary line recognizers comprising a camera having a narrow angle and a camera having a wide angle;

a processing section comprising a central processing unit and including an environmental information obtaining section and a selection section, wherein

the environmental information obtaining section is configured to obtain environmental information from the plurality of boundary line recognizers which represent a surrounding environment of the own vehicle regarding obstacle factors preventing correct recognition of a lane boundary line;

the environmental information obtained by the environmental information obtaining section includes information regarding at least one of rain, afternoon sun, shadow, night, traffic congestion, road work, change of longitudinal slope, tunnel-inlet and outlet, shape curve, branch point, junction point, asphalt road and concrete road, and

the selection section that selects at least one of the boundary line recognizers on the basis of the obtained environmental information suitable for recognizing the lane boundary line of the vehicle lane of the own vehicle, and

the selection section selects the camera having a narrow angle where the obtained environmental information indicates traffic congestion.

13. A lane boundary line recognition apparatus capable of recognizing a lane boundary line of a vehicle lane on a roadway on which an own vehicle drives, the lane boundary line separating an inside of the vehicle lane, on which the own vehicle drives, from the outside of the vehicle lane, the lane boundary line recognition apparatus comprising:

a plurality of boundary line recognizers comprising an optical sensor, each boundary line recognizer having a different detection range that recognizes a lane boundary line by using a different optical detection method from other boundary line recognizers;

a processing section comprising a central processing unit which includes an environmental information obtaining section, a white line determination section and a selection section, wherein

the environmental information obtaining section is configured to obtain environmental information from the plurality of boundary line recognizers which represent a surrounding environment of the own vehicle regarding obstacle factors preventing correct recognition of a lane boundary line;

the white line determination section is configured to obtain white line information from the plurality of boundary line recognizers which represent a surrounding environment of the own vehicle regarding road edge factors concerning validity of a lane white line; and

the selection section is configured to determine validity of a lane white line and to select at least one optimum boundary line recognizer of the boundary line recognizers, based on a valid lane white line and the obtained environmental information suitable for recognizing the lane boundary line of the vehicle lane of the own vehicle.