Approaching-object detection system and vehicle

• US 9,811,745 B2
• Filed: 05/29/2014
• Issued: 11/07/2017
• Est. Priority Date: 07/03/2013
• Status: Active Grant

• Current Assignee: Clarion Co., Ltd. (Faurecia SA)
• Original Assignee: Clarion Co., Ltd. (Faurecia SA)
• Inventors: Nakamura, Katsuyuki, Akiyama, Yasuhiro, Irie, Kota
• Primary Examiner(s): Chang, Jon
• Application Number:
  US14/892,961
• Publication Number:
  US 20160098606A1
• Time in Patent Office: 1,258 Days
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06V 10/247 by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights

Abstract

An approaching-object detection system detects an approaching object based on images captured by an imaging device. The approaching-object detection system comprises an extraction unit, a distortion correction unit, an object detection unit, and an approaching-object classification unit. The extraction unit extracts a partial image of one far side and a partial image of the other far side from each of the images. The distortion correction unit corrects distortion of the partial images. The object detection unit detects an object from the corrected partial images through pattern matching with reference to preinstalled image information on the object. The approaching-object classification unit classifies the detection result of the object detection unit as an approaching object or not.

Claims

1. An approaching-object detection system for detecting an approaching object based on images captured by an imaging device, the approaching-object detection system comprising:

an extraction unit configured to extract a partial image of one far side and a partial image of the other far side from each of the images;

a distortion correction unit configured to correct distortion of the partial images extracted by the extraction unit;

an object detection unit configured to detect an object from the partial images corrected in distortion by the distortion correction unit through pattern matching with reference to preinstalled image information on the object;

an approaching-object classification unit configured to classify the detection result of the object detection unit as an approaching object or not; and

an orientation estimation unit configured to estimate an orientation of the imaging device,

wherein the approaching-object classification unit is configured to;

calculate a feature value of the object detected by the object detection unit; and

classify the object as approaching object or not based on a variation with time in the calculated feature value of the object, and

wherein the approaching-object detection unit is configured to;

locate a grounding point of the object detected by the object detection unit in the partial images corrected in distortion by the distortion correction unit;

calculate a relative distance from the imaging device to the object based on the orientation of the imaging device estimated by the orientation estimation unit and the located grounding point;

estimate a pixel count of the object based on the calculated relative distance and a kind of the object detected by the object detection unit; and

determine whether the object is an approaching object or not in consideration of a difference between the estimated pixel count and an actual pixel count of the object.

2. The approaching-object detection system according to claim 1, wherein the approaching-object classification unit is configured to calculate, as the feature value of the object, at least one of a width of the object in the partial images, a height of the object in the partial images, coordinates of the grounding point of the object, a motion vector of the object, an edge strength, a texture frequency, a rectangle expansion rate, and an actual pixel count of the object in the partial images.

3. A vehicle on which the approaching-object detection system according to claim 1 is mounted, wherein the imaging device is attached on at least one of front, rear, and sides of the vehicle.

4. The vehicle according to claim 3, further comprising a warning notification unit for issuing a warning in a case where the approaching-object classification unit classifies the detection result as an approaching object.

5. An approaching-object detection system for detecting an approaching object based on images captured by an imaging device, the approaching-object detection system comprising:

an extraction unit configured to extract a partial image of one far side and a partial image of the other far side from each of the images;

a distortion correction unit configured to correct distortion of the partial images extracted by the extraction unit;

an object detection unit configured to detect an object from the partial images corrected in distortion by the distortion correction unit through pattern matching with reference to preinstalled image information on the object;

an approaching-object classification unit configured to classify the detection result of the object detection unit as an approaching object or not;

an object tracking unit configured to track an object by comparing the partial images corrected in distortion by the distortion correction unit with an object previously classified as an approaching object; and

a combined-determination unit configured to determine whether there is consistency between a detection result of the object detection unit and a tracking result of the object tracking unit based on the detection result and the tracking result,

wherein the combined-determination unit is configured to;

determine that there is no consistency between the detection result and the tracking result in a case where the object detection unit newly detects an object and the object newly detected by the object detection unit is an object previously classified as an approaching object and is being tracked by the object tracking unit;

estimate a current position of the object previously classified as an approaching object using a position as of the previous classification in a case where the combined-determination unit determines that there is no consistency between the detection result and the tracking result; and

output a result indicating the object positioned closer to the estimated current position between the detection result of the object detection unit and the tracking result of the object tracking unit to the approaching-object classification unit.

6. The approaching-object detection system according to claim 5, wherein the approaching-object classification unit is configured to:

calculate a feature value of the object detected by the object detection unit; and

classify the object as approaching object or not based on a variation with time in the calculated feature value of the object.

7. The approaching-object detection system according to claim 6, wherein the approaching-object classification unit is configured to calculate, as the feature value of the object, at least one of a width of the object in the partial images, a height of the object in the partial images, coordinates of the grounding point of the object, a motion vector of the object, an edge strength, a texture frequency, a rectangle expansion rate, and an actual pixel count of the object in the partial images.

8. A vehicle on which the approaching-object detection system according to claim 5 is mounted, wherein the imaging device is attached on at least one of front, rear, and sides of the vehicle.

9. The vehicle according to claim 8, further comprising a warning notification unit for issuing a warning in a case where the approaching-object classification unit classifies the detection result as an approaching object.

10. A vehicle comprising:

an approaching-object detection system mounted on the vehicle, the approaching-object detection system being for detecting an approaching object based on images captured by an imaging device, the approaching-object detection system comprising;

an extraction unit configured to extract a partial image of one far side and a partial image of the other far side from each of the images;

a distortion correction unit configured to correct distortion of the partial images extracted by the extraction unit;

an object detection unit configured to detect an object from the partial images corrected in distortion by the distortion correction unit through pattern matching with reference to preinstalled image information on the object; and

an approaching-object classification unit configured to classify the detection result of the object detection unit as an approaching object or not,

wherein the imaging device is attached on at least one of front, rear, and sides of the vehicle,

wherein a plurality of imaging devices are attached on the vehicle, and

wherein the vehicle comprises an imaging device selection unit for selecting an imaging device to capture the images to be used in approaching-object classification in the approaching-object detection system based on speed information and steering angle information on the vehicle.

11. The vehicle according to claim 10, wherein the approaching-object classification unit is configured to:

calculate a feature value of the object detected by the object detection unit; and

classify the object as approaching object or not based on a variation with time in the calculated feature value of the object.

12. The vehicle according to claim 11, wherein the approaching-object classification unit is configured to calculate, as the feature value of the object, at least one of a width of the object in the partial images, a height of the object in the partial images, coordinates of the grounding point of the object, a motion vector of the object, an edge strength, a texture frequency, a rectangle expansion rate, and an actual pixel count of the object in the partial images.

13. The vehicle according to claim 10, further comprising a warning notification unit for issuing a warning in a case where the approaching-object classification unit classifies the detection result as an approaching object.