ROAD SHAPE DETERMINING DEVICE, IN-VEHICLE IMAGE RECOGNIZING DEVICE, IMAGING AXIS ADJUSTING DEVICE, AND LANE RECOGNIZING METHOD

• US 20140118552A1
• Filed: 03/07/2012
• Published: 05/01/2014
• Est. Priority Date: 06/13/2011
• Status: Abandoned Application

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Takahama, Taku, Takeda, Fuminori
• Application Number:
  US14/125,832
• Publication Number:
  US 20140118552A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60W 2050/0083 Setting, resetting, calibration
• CPC Class Codes: B60W 2050/0215 Sensor drifts or sensor failures
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2520/10 Longitudinal speed
• CPC Class Codes: B60W 2540/18 Steering angle
• CPC Class Codes: B60W 30/12 Lane keeping
• CPC Class Codes: B60W 40/072 Curvature of the road
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30256 Lane; Road marking
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

An imaging angle of an imaging unit disposed in a vehicle is estimated with a less computational load. An in-vehicle image recognizing device disposed in a vehicle recognizes a lane shape of a traveling lane in which the vehicle travels based on an image captured by a camera capturing an image of a traveling road around the vehicle. An imaging angle of the camera is calculated based on the recognized lane shape. It is determined whether or not there is a bias in the recognized lane shape, and the imaging angle of the camera is corrected using the imaging angle when it is determined that there is no bias.

Claims

1-13. -13. (canceled)

14. A road shape determining device comprising:

an imaging unit for capturing an image of a periphery of a vehicle;

a lane shape recognizing unit for recognizing a lane shape of a travel lane along which the vehicle travels on the basis of the image captured by the imaging unit;

an intersection bias determining unit for determining an intersection bias which is a bias between an intersection of extension lines obtained by approximating left and right lane markers located in a near area to a straight line, and an intersection of extension lines obtained by approximating left and right lane markers located in a far area to a straight line, on the basis of the lane shape in the near area relatively close to the vehicle and the lane shape in the far area distant from the vehicle out of the lane shapes recognized by the lane shape recognizing unit; and

a straight lane determining unit for determining that the travel lane is a straight lane when the intersection bias determining unit determines that the intersection bias is equal to or less than a predetermined threshold value.

15. An in-vehicle image recognizing device comprising:

the road shape determining device according to claim 14; and

an imaging angle correcting unit for correcting an imaging angle of the imaging unit when the road shape determining device determines that the travel lane is a straight lane.

16. The in-vehicle image recognizing device according to claim 15, further comprising an imaging angle deriving unit for calculating an imaging angle of the imaging unit based on the lane shape recognized by the lane shape recognizing unit,

wherein the imaging angle correcting unit corrects the imaging angle of the imaging unit using the imaging angle calculated by the imaging angle deriving unit when the road shape determining device determines that the travel lane is a straight lane.

17. The in-vehicle image recognizing device according to claim 16, further comprising a standard deviation calculating unit for calculating a standard deviation of the imaging angle calculated by the imaging angle deriving unit when the intersection bias determining unit determines that the intersection bias is equal to or less than a predetermined threshold value,

wherein the imaging angle correcting unit corrects the imaging angle of the imaging unit depending on the standard deviation calculated by the standard deviation calculating unit.

18. The in-vehicle image recognizing device according to claim 17, wherein correcting of the imaging angle is terminated when the standard deviation calculated by the standard deviation calculating unit is less than a predetermined value.

19. The in-vehicle image recognizing device according to claim 15, further comprising a recognition bias determining unit for determining the shape of the travel lane based on a bias of the lane shape recognized by using a road curvature recognized by the lane shape recognizing unit,

wherein the imaging angle correcting unit corrects the imaging angle of the imaging unit, when the intersection bias determining unit determines that the intersection bias is equal to or less than a predetermined threshold value and the recognition bias determining unit determines that the travel lane is a straight lane.

20. The in-vehicle image recognizing device according to claim 19, wherein the recognition bias determining unit determines that the travel lane is a straight lane when the absolute value of the bias of the lane shape recognized by the lane shape recognizing unit is less than a predetermined threshold value and the total sum of the bias is less than the threshold value.

21. The in-vehicle image recognizing device according to claim 15, further comprising:

a vehicle speed detecting unit for detecting a vehicle speed of the vehicle;

a steering angle detecting unit for detecting a steering angle of the vehicle; and

a vehicle behavior recognizing unit for recognizing a behavior of the vehicle based on the vehicle speed detected by the vehicle speed detecting unit and the steering angle detected by the steering angle detecting unit,

wherein the imaging angle correcting unit corrects the imaging angle of the imaging unit when it is determined that a bias of the behavior of the vehicle recognized by the vehicle behavior recognizing unit is equal to or less than a predetermined threshold value.

22. The in-vehicle image recognizing device according to claim 21, wherein the behavior of the vehicle recognized by the vehicle behavior recognizing unit is information on a translational behavior in a vehicle width direction of the vehicle.

23. The in-vehicle image recognizing device according to claim 21, wherein the behavior of the vehicle recognized by the vehicle behavior recognizing unit is information on a rotational behavior in a vehicle width direction of the vehicle.

24. The in-vehicle image recognizing device according to claim 21, wherein the vehicle behavior recognizing unit recognizes the behavior of the vehicle based on a temporal variation in a position in the vehicle width direction of the vehicle or a yaw angle relative to the travel lane recognized by the lane shape recognizing unit.

25. An imaging axis adjusting device configured to automatically adjust an imaging axis of an imaging unit disposed in a vehicle, comprising:

a parameter detecting unit for detecting a parameter associated with a road curvature;

a convergence determining unit for determining whether or not a value of the parameter associated with the road curvature converges on a predetermined range;

an integrating unit for integrating the value of the parameter within a predetermined time from a time point at which the convergence determining unit determines that the value of the parameter converges;

a straight traveling state determining unit for determining whether or not the vehicle is in a straight traveling state by determining that an integrated value calculated by the integrating unit is less than a predetermined value; and

an aiming execution unit for performing an aiming process when the straight traveling state determining unit determines that the vehicle is in the straight traveling state.

26. A lane recognizing method comprising:

capturing an image of periphery of a vehicle with an imaging unit disposed in the vehicle;

recognizing a lane shape of a travel lane in which the vehicle travels based on the image captured;

calculating an imaging angle of the imaging unit based on the lane shape recognized;

correcting the imaging angle of the imaging unit using the imaging angle detected when it is determined that an intersection bias, which is a bias between an intersection of extension lines obtained by approximating left and right lane markers located in a near area to a straight line, and an intersection of extension lines obtained by approximating left and right lane markers located in a far area to a straight line, is equal to or less than a predetermined threshold value, on the basis of the lane shape in the near area relatively close to the vehicle and the lane shape in the far area distant from the vehicle out of the lane shapes recognized.