Detecting device, detecting method, and program

• US 9,798,938 B2
• Filed: 09/30/2015
• Issued: 10/24/2017
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lin, Ching-Yung, Murata, Masayuki, Shimizu, Shuichi
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): Lemieux, Ian
• Application Number:
  US14/870,597
• Publication Number:
  US 20160093057A1
• Time in Patent Office: 755 Days
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

To detect a distant object that may become an obstacle to a traveling destination of a moving vehicle or the like more accurately than the conventional, there is provided a detecting device, a program used in the detecting device, and a detecting method using the detecting device, where the detecting device includes: an acquisition section for acquiring two or more images captured in two or more imaging devices provided at different heights; and a detection section for detecting a rising portion of an identical object toward the imaging devices based on a difference between the lengths of the identical object in the height direction in the two or more images.

Claims

1. A detecting device comprising:

an acquisition section for acquiring a plurality of images captured in a plurality of imaging devices provided at different heights; and

a detection section for detecting a rising portion of an identical object toward the imaging devices based on a difference between lengths of the identical object in a height direction in the plurality of images;

wherein the plurality of imaging devices are provided in a moving vehicle to capture images in a moving direction of the moving vehicle, and

the detecting device further comprises a determination section for determining whether the identical object is an obstacle based on a determination result as to whether the identical object has a rising portion, wherein the determination section estimates a height of the identical object based on distance to the identical object; and

an extraction section for extracting, from the plurality of images, an obstacle candidate as an candidate for the obstacle,

wherein the determination section determines the identical object having a rising portion higher than or equal to a predetermined height among the obstacle candidates to be the obstacle.

2. The detecting device according to claim 1, wherein the detection section detects the rising portion based on a length ratio between regions corresponding to the identical object in the height direction in the plurality of images.

3. The detecting device according to claim 2, wherein the detection section detects the rising portion based further on a height ratio between installation positions of the plurality of imaging devices.

4. The detecting device according to claim 3, wherein, on condition that a ratio of a length of a region corresponding to the identical object in the height direction in an image captured from a lower position to a length of a region corresponding to the identical object in the height direction in an image captured from a higher position is larger than a predetermined threshold value, the detection section detects a rising portion of the identical object.

5. The detecting device according to claim 4, further comprising a distance calculation section for calculating distance to the identical object based on amounts of parallax of the plurality of images.

6. The detecting device according to claim 5, wherein the distance calculation section calculates distance to the identical object based on the amounts of parallax of the plurality of images in the height direction.

7. The detecting device according to claim 1, wherein the detection section:

generates a plurality of template images obtained by reducing an image of an obstacle candidate included in one image of the plurality of images at each of a plurality of magnification candidates;

performs template matching using each of the plurality of template images on another image of the plurality of images to calculate a matching score at a best matching position in the other image;

calculates a magnification giving a maximum matching score from among the plurality of magnification candidates; and

on condition that the magnification giving the maximum matching score is larger than a threshold value, detects a rising portion of the obstacle candidate toward the imaging devices.

8. A detecting device comprising:

an acquisition section for acquiring a plurality of images captured in a plurality of imaging devices provided at different heights; and

a detection section for detecting a rising portion of an identical object toward the imaging devices based on a difference between lengths of the identical object in a height direction in the plurality of images;

wherein the plurality of imaging devices are provided in a moving vehicle to capture images in a moving direction of the moving vehicle, and the detecting device further comprises;

an extraction section for extracting, from the plurality of images, an obstacle candidate as an candidate for an obstacle;

a distance calculation section for calculating distance to an identical object corresponding to the obstacle candidate based on amounts of parallax of the plurality of images; and

a determination section for determining whether the identical object is an obstacle;

wherein;

the detection section generates a plurality of template images obtained by reducing an image of the obstacle candidate included in one image of the plurality of images at each of a plurality of magnification candidates, performs template matching using each of the plurality of template images on another image of the plurality of images, calculates a matching score at a best matching position in the other image, and calculates a magnification giving a maximum matching score from among the plurality of magnification candidates; and

on condition that the magnification giving the maximum matching score is larger than a threshold value based on distance to the identical object, the determination section determines the identical object to be an obstacle.