Detecting device, detecting method, and program

• US 9,798,939 B2
• Filed: 11/29/2016
• Issued: 10/24/2017
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lin, Ching-Yung, Murata, Masayuki, Shimizu, Shuichi
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): LEMIEUX, IAN L
• Application Number:
  US15/363,739
• Publication Number:
  US 20170076163A1
• Time in Patent Office: 329 Days
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

To detect a distant object that may become an obstacle to a traveling destination of a moving vehicle or the like more accurately than the conventional, there is provided a detecting device, a program used in the detecting device, and a detecting method using the detecting device, where the detecting device includes: an acquisition section for acquiring two or more images captured in two or more imaging devices provided at different heights; and a detection section for detecting a rising portion of an identical object toward the imaging devices based on a difference between the lengths of the identical object in the height direction in the two or more images.

Claims

1. A detecting method executed by a computer, comprising:

acquiring two or more images captured in two or more imaging devices provided at different heights; and

detecting a rising portion of an identical object toward the imaging devices based on a difference between lengths of the identical object in a height direction in the two or more images;

wherein the two or more imaging devices are provided in a moving vehicle to capture images in a moving direction of the moving vehicle, and

the method further comprising;

determining whether the identical object is an obstacle based on a determination result as to whether the identical object has a rising portion;

estimating a height of the identical object based on distance to the identical object;

extracting, from the two or more images, an obstacle candidate as a candidate for the obstacle; and

determining the identical object having a rising portion higher than or equal to a predetermined height among the obstacle candidates to be the obstacle.

2. The method of claim 1, wherein detecting the rising portion comprises detecting the rising portion based on a length ratio between regions corresponding to the identical object in the height direction in the two or more images.

3. The method of claim 2, wherein detecting the rising portion further comprises detecting the rising portion based further on a height ratio between installation positions of the two or more imaging devices.

4. The method of claim 3, further comprising detecting a rising portion of the identical object, on condition that a ratio of a length of a region corresponding to the identical object in the height direction in an image captured from a lower position to a length of a region corresponding to the identical object in the height direction in an image captured from a higher position is larger than a predetermined threshold value.

5. The method of claim 4, further comprising calculating distance to the identical object based on amounts of parallax of the two or more images.

6. The method of claim 5, wherein calculating distance to the identical object comprises calculating distance to the identical object based on the amounts of parallax of the two or more images in the height direction.

7. The method of claim 1, further comprising:

generating a plurality of template images obtained by reducing an image of an obstacle candidate included in one image of the two or more images at each of a plurality of magnification candidates;

performing template matching using each of the plurality of template images on another image of the two or more images to calculate a matching score at a best matching position in the other image;

calculating a magnification giving a maximum matching score from among the plurality of magnification candidates; and

on condition that the magnification giving the maximum matching score is larger than a threshold value, detecting a rising portion of the obstacle candidate toward the imaging devices.

8. A detecting method executed by a computer, comprising:

acquiring two or more images captured in two or more imaging devices provided at different heights; and

detecting a rising portion of an identical object toward the imaging devices based on a difference between lengths of the identical object in a height direction in the two or more images;

wherein the two or more imaging devices are provided in a moving vehicle to capture images in a moving direction of the moving vehicle, and the method further comprises;

extracting, from the two or more images, an obstacle candidate as a candidate for an obstacle;

calculating distance to an identical object corresponding to the obstacle candidate based on amounts of parallax of the two or more images; and

determining whether the identical object is an obstacle;

generating a plurality of template images obtained by reducing an image of the obstacle candidate included in one image of the two or more images at each of a plurality of magnification candidates;

performing template matching using each of the plurality of template images on another image of the two or more images;

calculating a matching score at a best matching position in the other image, and calculates a magnification giving a maximum matching score from among the plurality of magnification candidates; and

on condition that the magnification giving the maximum matching score is larger than a threshold value based on distance to the identical object, determining the identical object to be an obstacle.