Vehicle periphery monitoring device

• US 8,994,824 B2
• Filed: 12/16/2010
• Issued: 03/31/2015
• Est. Priority Date: 01/14/2010
• Status: Active Grant

• Current Assignee: Arriver Software AB (Qualcomm, Inc.)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Aimura, Makoto, Nagaoka, Nobuharu
• Primary Examiner(s): Anyikire, Chikaodili E
• Application Number:
  US13/515,618
• Publication Number:
  US 20120300076A1
• Time in Patent Office: 1,566 Days
• Field of Search: 348/148
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 2300/103 using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/107 using stereoscopic cameras
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A vehicle periphery monitoring device is provided with a symmetrical image portion extraction unit (21) which extracts a first image portion (A1) and a second image portion (A2) which are line-symmetrical to each other in the horizontal direction; and expanded region setting unit (22) which sets a first expanded region (B1) containing the first image portion (A1); an expanded search range setting unit (23) which sets an expanded search range (C) which contains the second image portion (A2); and an object class recognition unit (24) which searches in the expanded search range (C) a second expanded region (B2) which has a correlation degree to a mirror reflection image (B1m) of the first expanded region (B1), and recognizes the image containing the first image portion (A1) and the second image portion (A2) as the image of another vehicle if the second expanded region (B2) is detected.

Claims

1. A vehicle periphery monitoring device configured to recognize a monitoring object in the periphery of a self vehicle on the basis of a captured image by a vehicular camera, comprising:

a symmetrical image portion extraction unit configured to extract from the captured image a first image portion and a second image portion which are line-symmetrical to each other in the horizontal direction;

an expanded region setting unit configured to set a region which has a predefined size and contains the first image portion as a first expanded region;

an expanded search range setting unit configured to set a region which is wider than the size of the first expanded region and contains the second image portion as an expanded search range; and

an object class recognition unit configured to search in the expanded search range a second expanded region which has a correlation degree to the first expanded region or a mirror reflection image of the first expanded region not smaller than a predefined level, and recognize an image containing the first image portion and the second image portion as the image of another vehicle when the second expanded region is detected.

2. The vehicle periphery monitoring device according to claim 1, wherein

the expanded region setting unit sets the first expanded region in a range to the side of the first image portion with a straight line orthogonal to a line segment joining the first image portion and the second image portion at the midpoint of the line segment as the boundary line, and

the expanded search range setting unit sets the expanded search range in the horizontal direction to contain the region from the midpoint up to the second image portion.

3. The vehicle periphery monitoring device according to claim 1, wherein

the expanded search range setting unit sets the first expanded region on condition that the height thereof to the road surface of a corresponding position in the real space is not smaller than a predefined height.

4. The vehicle periphery monitoring device according to claim 1 is further comprises a feature portion searching unit configured to search a third image portion having a predefined feature portion pertained to a vehicle in ambient regions around the first image portion and the second image portion,

wherein the object class recognition unit recognizes the image containing the first image portion and the second image portion as the image of another vehicle when the correlation degree between the first expanded region and the second expanded region is not smaller than the predefined level and the third image portion is detected by the feature portion searching unit.

5. The vehicle periphery monitoring device according to claim 1 is provided with a singular camera as the vehicular camera and comprises a distance calculation unit configured to calculate the distance from the self vehicle to the monitoring object on the basis of a dimension variation rate of the captured images of the monitoring object captured by the camera at different time points.

6. The vehicle periphery monitoring device according to claim 1 is provided with a singular camera as the vehicular camera and comprises a distance calculation unit configured to calculate the distance from the self vehicle to the monitoring object on the basis of an interval in the horizontal direction between the first image portion and the second image portion in the captured image by the camera.

7. The vehicle periphery monitoring device according to claim 6, wherein

the distance calculation unit is configured to calculate the distance from the self vehicle to the monitoring object on the basis of a dimension variation rate of the captured images of the monitoring object captured by the camera at different time points, and

the object class recognition unit recognizes the monitoring object as a mobile object when the difference between a distance obtained on the basis of the interval in the horizontal direction between the first image portion and the second image portion which is calculated by the distance calculation unit for the monitoring object and a distance obtained on the basis of the dimension variation rate of the captured images of the same monitoring object is not smaller than a predefined value.

8. The vehicle periphery monitoring device according to claim 1, wherein the symmetrical image portion extraction unit is configured to extract the first image portion and the second image portion having a feature quantity of a light of a vehicle from the captured image.

9. The vehicle periphery monitoring device according to claim 8 is provided with a singular camera as the vehicular camera, and comprises a distance calculation unit configured to calculate the distance from the self vehicle to the monitoring object on the basis of a dimension variation rate of the captured images of the monitoring object captured by the camera at different time points.