OBJECT DETECTION APPARATUS AND OBJECT DETECTION METHOD

• US 20170357863A1
• Filed: 06/08/2017
• Published: 12/14/2017
• Est. Priority Date: 06/10/2016
• Status: Abandoned Application

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: TSURUTA, Tomohiko, KAWASAKI, Naoki, ISHIMARU, Kazuhisa, SHIRAI, Noriaki, ISHIGAMI, Hirotake
• Application Number:
  US15/617,636
• Publication Number:
  US 20170357863A1
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06T 7/285 using a sequence of stereo image pairs
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence

Abstract

In an object detection apparatus and an object detection method, as first and second images, captured images of an area ahead of a vehicle in a vehicle advancing direction are acquired from first and second imaging units provided in the vehicle. Based on the first and second images, whether or not an object is present in a blind spot ahead of the vehicle in the vehicle advancing direction is determined. When the object is determined to be present in the blind spot, the first and second images are held in time series. As first and second image differences, differences in a feature quantity between a previous image and a current image in the first and second images are acquired. Based on the first and second image differences, whether or not the object is approaching the area ahead of the vehicle is determined.

Claims

1. An object detection apparatus comprising:

an image acquiring unit that acquires, as a first image, a captured image of an area ahead of a vehicle in a vehicle advancing direction from a first imaging unit provided in the vehicle and acquires, as a second image, a captured image of an area ahead of the vehicle in the vehicle advancing direction from a second imaging unit provided in the vehicle;

a blind-spot determining unit that determines whether or not an object is present in a blind spot ahead of the vehicle in the vehicle advancing direction, based on the first image captured by the first imaging unit and the second image captured by the second imaging unit, the blind spot being an area that is visible through one of the first imaging unit and the second imaging unit and is not visible through the other of the first imaging unit and the second imaging unit;

an image holding unit that holds the first image captured by the first imaging unit and the second image captured by the second imaging unit in time series, when the object is determined to be present in the blind spot;

a difference acquiring unit that acquires, as a first image difference, a difference in a feature quantity between a previous image and a current image in the first image held in time series and acquires, as a second image difference, a difference in a feature quantity between a previous image and a current image in the second image held in time series; and

an approach determining unit that determines whether or not the object is approaching the area ahead of the vehicle based on the first image difference and the second image difference acquired by the difference acquiring unit.

2. The object detection apparatus according to claim 1, wherein:

one of the first image and the second image in which the object is visible in a periphery of the blind spot captured by one of the first imaging unit and the second imaging unit is set to a visible image;

the other of the first image and the second image in which the object is not visible in the blind spot is set to a non-visible image; and

the approach determining unit determines that the object is approaching the area ahead of the vehicle when, in the visible image, a state in which the object is visible is recognized as being maintained based on the first image difference and the second image difference and when, in the non-visible image, a state in which the object is not visible is recognized to have changed to a state in which the object is visible based on the first image difference and the second image difference.

3. The object detection apparatus according to claim 2, further comprising:

a moving-object determining unit that determines whether or not the object present in the periphery of the blind spot in the visible image is a moving object, when the first image captured by the first imaging unit is the visible image and the second image captured by the second imaging unit is the non-visible image, wherein

the approach determining unit determines whether or not the object is approaching the area ahead of the vehicle under a condition that the object present in the blind spot in the visible image is the moving object.

4. The object detection apparatus according to claim 1, further comprising:

a type determining unit that determines at least a pedestrian or a bicycle as a type of the object present in the blind spot, wherein

the blind-spot determining unit determines whether or not the object is present in the blind spot under a condition that the object is the pedestrian or the bicycle.

5. The object detection apparatus according to claim 2, further comprising:

a type determining unit that determines at least a pedestrian or a bicycle as a type of the object present in the blind spot, wherein

the blind-spot determining unit determines whether or not the object is present in the blind spot under a condition that the object is the pedestrian or the bicycle.

6. The object detection apparatus according to claim 3, further comprising:

a type determining unit that determines at least a pedestrian or a bicycle as a type of the object present in the blind spot, wherein

the blind-spot determining unit determines whether or not the object is present in the blind spot under a condition that the object is the pedestrian or the bicycle.

7. The object detection apparatus according to claim 1, wherein:

the blind spot includes a blind spot that is formed by a predetermined object; and

the blind-spot determining unit is configured to;

determine whether or not a blind spot formed by the predetermined object is present ahead of the vehicle in the vehicle advancing direction, based on the first image captured by the first imaging unit and the second image captured by the second imaging unit; and

determine whether or not an object is present in the blind spot formed by the predetermined object, based on the first image captured by the first imaging unit and the second image captured by the second imaging unit.

8. The object detection apparatus according to claim 1, wherein:

one of the first imaging unit and the second imaging unit is one of a right-side camera and a left-side camera, right-side camera and the left-side camera configuring a stereo camera that is mounted to the vehicle; and

the other of the first imaging unit and the second imaging unit is the other of the right-side camera and the left-side camera.

9. The object detection apparatus according to claim 1, wherein:

one of the first imaging unit and the second imaging unit is a first camera that is mounted to the vehicle; and

the other of the first imaging unit and the second imaging unit is a second camera that is mounted to the vehicle and has a wider angle of view than the first camera.

10. An object detection method comprising:

an image acquiring step of acquiring, as a first image, a captured image of an area ahead of a vehicle in a vehicle advancing direction from a first imaging unit provided in the vehicle and acquiring, as a second image, a captured image of an area ahead of the vehicle in the vehicle advancing direction from a second imaging unit provided in the vehicle;

a blind spot determining step of determining whether or not an object is present in a blind spot ahead of the vehicle in the vehicle advancing direction, based on the first image captured by the first imaging unit and the second image captured by the second imaging unit, the blind spot being an area that is visible through one of the first imaging unit and the second imaging unit and is not visible through the other of the first imaging unit and the second imaging unit;

an image holding step of holding the first image captured by the first imaging unit and the second image captured by the second imaging unit in time series, when the object is determined to be present in the blind spot;

a difference acquiring step of acquiring, as a first image difference, a difference in a feature quantity between a previous image and a current image in the first image held in time series and acquiring, as a second image difference, a difference in a feature quantity between a previous image and a current image in the second image held in time series; and

an approach determining step of determining whether or not the object is approaching the area ahead of the vehicle based on the first image difference and the second image difference acquired at the difference acquiring step.