Running-environment recognition apparatus

• US 8,982,188 B2
• Filed: 10/27/2011
• Issued: 03/17/2015
• Est. Priority Date: 12/07/2010
• Status: Active Grant

• Current Assignee: Hitachi Astemo Ltd. (Hitachi, Ltd.)
• Original Assignee: Hitachi Automotive Systems Limited (Hitachi, Ltd.)
• Inventors: Ota, Ryo, Oosawa, Toshiya, Takahashi, Akira
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): KALAPODAS, DRAMOS
• Application Number:
  US13/283,011
• Publication Number:
  US 20120140039A1
• Time in Patent Office: 1,237 Days
• Field of Search: 348/46, 348/148, 348/E13.074, 348/E13.075, 348/6, 348/51, 348/57, 342/70, 701/301, 701/45, 340/435, 703/1, 703/45, 382/104, 382/106
• US Class Current: 348/46
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2552/15 Road slope, i.e. the inclination of a road segment in the longitudinal direction
• CPC Class Codes: B60W 2552/20 Road profile, i.e. the change in elevation or curvature of a plurality of continuous road segments
• CPC Class Codes: B60W 2552/30 Road curve radius
• CPC Class Codes: B60W 30/12 Lane keeping

Abstract

A running-environment recognition apparatus includes an information recognition section mounted in a vehicle and configured to recognize an information of at least a frontward region of the vehicle relative to a traveling direction of the vehicle; and a road-surface calculating section configured to calculate a road surface of a traveling road and a portion lower than the road surface in the frontward region of the vehicle, from the information recognized by the information recognition section.

Claims

1. A running-environment recognition apparatus comprising:

an information recognition section mounted in a vehicle and configured to recognize an information of at least a frontward region of the vehicle relative to a traveling direction of the vehicle; and

a road-surface calculating section configured

to calculate a road surface of a traveling road and a portion lower than the road surface in the frontward region of the vehicle, from the information recognized by the information recognition section, the information comprising a plurality of first visually-characteristic points existing in the road surface and a plurality of second visually-characteristic points existing in the portion lower than the road surface, and

to recognize a boundary portion between the plurality of first visually-characteristic points and the plurality of second visually-characteristic points as a boundary portion between the road surface and the portion lower than the surface,

wherein the recognized boundary portion is an end of the traveling road.

2. The running-environment recognition apparatus according to claim 1, wherein

the information recognition section is a camera configured to take an image of the frontward region of the vehicle relative to the traveling direction of the vehicle.

3. The running-environment recognition apparatus according to claim 2, wherein

the information recognition section is a stereo camera including a plurality of cameras configured to measure a distance by means of a parallax that is caused when the plurality of cameras take respective images of an identical object, and

the information is related to distance.

4. The running-environment recognition apparatus according to claim 3, wherein the road-surface calculating section is configured

to recognize a first area having a first visually-characteristic point and a second area having a second visually-characteristic point from the information related to distance, and

to calculate the road surface and the portion lower than the road surface, in relation to the recognized respective first and second areas.

5. The running-environment recognition apparatus according to claim 4,

wherein the respective first and second areas are directly continuous with each other,

wherein the road-surface calculating section is configured to calculate a location corresponding to a boundary portion between the first and second areas, as an end of the road surface.

6. The running-environment recognition apparatus according to claim 5, wherein

the road-surface calculating section is configured to calculate a second predetermined location existing between a first predetermined location of the first area and the location corresponding to the boundary portion, as the end of the road surface.

7. The running-environment recognition apparatus according to claim 4,

wherein the road-surface calculating section includes a distance-data accumulation section configured to store the information on distance at predetermined intervals,

wherein the road-surface calculating section is configured to recognize the first and second areas by superimposing a plurality of stored distance data on each other.

8. The running-environment recognition apparatus according to claim 7, wherein

if a part of a current-time-around data is different from that of a previous-time-around data when the plurality of stored distance data are superimposed on each other, the road-surface calculating section recognizes the first and second areas on the basis of the part of the current-time-round data.

9. The running-environment recognition apparatus according to claim 7, wherein

if a part of a current-time-around data is different from that of a previous-time-around data when the plurality of stored distance data are superimposed on each other, the road-surface calculating section recognizes the first and second areas on the basis of an average of the part of the current-time-around data and the part of the previous-time-around data.

10. The running-environment recognition apparatus according to claim 2,

wherein the information recognition section is a single camera,

wherein the road-surface calculating section is configured to calculate a height difference in the taken image, in accordance with a difference of inter-image moving speed of photographed object that is caused between in a region close to the single camera and a region away from the single camera.

11. The running-environment recognition apparatus according to claim 1, wherein

the information recognition section is a laser radar or a millimeter-wave radar, and

the information is related to distance and is obtained by a reflected wave from the road surface and the portion lower than the road surface in the frontward region of the vehicle.

21. The running-environment recognition apparatus according to claim 1, wherein

the road-surface calculating section is configured to collect the plurality of first visually-characteristic points and the plurality of second visually-characteristic points by superimposing a plurality of time-different images of the information on each other.

22. The running-environment recognition apparatus according to claim 1, wherein

the road-surface calculating section is configured to recognize a slope portion linking the road surface and the portion lower than the road surface as being unsuitable for running the vehicle.

23. The running-environment recognition apparatus according to claim 1, wherein

the road-surface calculating section is configured to determine that a lower-level region that is substantially lower than the road surface or that is in unclear contrast is not the road surface.

24. The running-environment recognition apparatus of claim 1, wherein the road-surface calculating section is configured to

calculate a modified end of the traveling road that is closer to an inner portion of the traveling road than the end of the traveling road recognized as the boundary portion, and

counteract a detection error in the recognition of the boundary portion by treating the modified end of the traveling road as the end of the traveling road.

25. The running-environment recognition apparatus of claim 1, wherein the road-surface calculating section is configured to

calculate a modified end of the traveling road that is closer to an outer portion of the traveling road than the end of the traveling road recognized as the boundary portion, and

suppress excessive control of vehicle movement or excessive warnings by treating the modified end of the traveling road as the end of the traveling road.

12. A running-environment recognition apparatus comprising:

a camera mounted in a vehicle and configured to recognize an environment of a frontward region of the vehicle relative to a traveling direction of the vehicle; and

a road-surface calculating section configured

to calculate a boundary portion between a road surface of a traveling road and a portion lower than the road surface around the traveling road, as an end of the traveling road, based on distance data obtained in relation to a distance to each object existing in the frontward region of the vehicle from the environment recognized by the camera, the distance data comprising a plurality of first visually-characteristic points existing in the road surface and a plurality of second visually-characteristic points existing in the portion lower than the road surface, and

to recognize a boundary portion between the plurality of the first visually-characteristic points and the plurality of second visually-characteristic points as the boundary portion between the road surface and the portion lower than the road surface.

13. The running-environment recognition apparatus according to claim 12, wherein

the camera is a stereo camera including a plurality of cameras configured to measure the distance by means of a parallax that is caused when the plurality of cameras take respective images of an identical object, and

the environment is an information related to distance.

14. The running-environment recognition apparatus according to claim 13, wherein the road-surface calculating section is configured

to recognize a first area having a first visually-characteristic point and a second area having a second visually-characteristic point from the information related to distance, and

to calculate the road surface and the portion lower than the road surface, in relation to the recognized respective first and second areas.

15. The running-environment recognition apparatus according to claim 14,

wherein the respective first and second areas are directly continuous with each other,

wherein the road-surface calculating section is configured to calculate a location corresponding to a boundary portion between the first and second areas, as an end of the road surface.

16. The running-environment recognition apparatus according to claim 14, wherein

the road-surface calculating section is configured to estimate a second predetermined location existing between a first predetermined location in the first area and the location corresponding to the boundary portion between the first and second areas, as the end of the road surface.

17. The running-environment recognition apparatus according to claim 16,

wherein the road-surface calculating section includes a distance-data accumulation section configured to store the information on distance at predetermined intervals,

wherein the road-surface calculating section is configured to recognize the first and second areas by superimposing a plurality of stored distance data on each other.

18. The running-environment recognition apparatus according to claim 17, wherein

if a part of a current-time-around data is different from that of a previous-time-around data when the plurality of stored distance data are superimposed on each other, the road-surface calculating section recognizes the first and second areas on the basis of the part of the current-time-round data.

19. The running-environment recognition apparatus according to claim 17, wherein

if a part of a current-time-around data is different from that of a previous-time-around data when the plurality of stored distance data are superimposed on each other, the road-surface calculating section recognizes the first and second areas on the basis of an average of the part of the current-time-around data and the part of the previous-time-around data.

20. A running-environment recognition apparatus comprising:

a stereo camera including a plurality of cameras mounted in a vehicle and configured to obtain an image information including a road surface of a traveling road existing in a frontward region of the vehicle relative to a traveling direction of the vehicle,

wherein the stereo camera is configured to measure a distance in the image information by means of a parallax that is caused when the plurality of cameras take respective images of an identical object; and

a road-surface calculating section configured to recognize a first area that is the road surface of the traveling road and a second area that is a portion lower than the road surface around the traveling road, by use of the distance information measured by the stereo camera, the distance information comprising a plurality of first visually-characteristic points existing in the first area and a plurality of second visually-characteristic points existing in the second area,

wherein the road-surface calculating section is configured to recognize a boundary portion between the plurality of first visually-characteristic points and the plurality of second visually-characteristic points as the boundary portion between the first and second areas,

wherein the recognized boundary portion is an end of the traveling road.