Target point arrival detector, method of detecting target point arrival, storage medium of program of detecting target point arrival and vehicle-mounted device control system

• US 9,189,690 B2
• Filed: 10/23/2013
• Issued: 11/17/2015
• Est. Priority Date: 11/13/2012
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Guan, Haike
• Primary Examiner(s): Vu, Kim
• Assistant Examiner(s): Delaney, Molly
• Application Number:
  US14/060,781
• Publication Number:
  US 20140133699A1
• Time in Patent Office: 755 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/77 using statistical methods
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A target point arrival detector for detecting that a vehicle arrives at a target point based on an image ahead of the vehicle moving on a surface captured by an image capturing unit includes a target point arrival signal output unit, using a processing circuit, to output a signal indicating that the vehicle arrives at the target point where an inclination condition of a surface ahead of the vehicle with respect to a surface over which the vehicle moves changes to a downward based on the captured image.

Claims

1. A target point arrival detector for detecting that a vehicle arrives at a target point based on an image ahead of the vehicle moving on a surface captured by an image capturing unit, the target point arrival detector comprising:

a target point arrival signal output unit, using a processing circuit, to output a signal indicating that the vehicle arrives at the target point where a surface ahead of the vehicle changes to a downward slope with respect to a surface over which the vehicle moves based on the captured image;

a parallax information generator, using the processing circuit, to generate parallax information based on a plurality of captured images of an area ahead of the vehicle captured by a plurality of image capturing units;

a parallax histogram information generator, using the processing circuit, to generate parallax histogram information, based on the parallax information, indicating parallax value mapping conditions for each of a plurality of lines prepared by dividing captured image into a plurality of areas vertically; and

an approximated curved line information generator, using the processing circuit, to select a group of parallax values, all of the parallax values decreasing as they approach an upper art of the captured imam values greater than a preset reference value, based on the parallax histogram information, and to generate approximated curved line information for the selected group of parallax values,

wherein the target point arrival signal output unit, using the processing circuit, outputs a signal indicating that the vehicle arrives at the target point when the approximated curved line information satisfies a given target point arrival condition.

2. The target point arrival detector of claim 1, wherein the target point arrival signal output unit extracts a target point feature value from the approximated curved line information,

wherein the target point arrival signal output unit determines that the given target point arrival condition is satisfied when the extracted target point feature value satisfies a given feature value condition, and outputs a signal indicating that the vehicle arrives at the target point.

3. The target point arrival target point detector of claim 1, wherein the approximated curved line information is information that identifies an approximated curved line drawn on a two-dimensional orthogonal coordinate system that plots the selected group of parallax values against the two dimensional orthogonal coordinate system defined by positions of the captured image in a vertical direction and parallax value.

4. The target point arrival detector of claim 3, wherein the approximated curved line information is information of the approximated curved line approximated by a polynomial equation,

wherein the target point arrival signal output unit extracts a coefficient of the polynomial equation corresponding to the approximated curved line information and a minimum parallax value of the selected group of parallax values as a target point feature value,

wherein the target point arrival signal output unit determines that the given target point arrival condition is satisfied when the extracted target point feature value satisfies a given feature value condition, and outputs a signal indicating that the vehicle arrives at the target point.

5. The target point arrival detector of claim 1, wherein the target point arrival signal output unit determines whether the approximated curved line information satisfies a given target point arrival condition by using learning data composed of image data obtained by capturing the target point in advance and image data obtained by capturing a point which is not the target point.

8. A vehicle-mounted device control system comprising:

an information detector employing the target point arrival detector of claim 1 that detects information around a vehicle moving on a surface; and

a vehicle device controller that controls one or more devices mounted on the vehicle based on a detection signal output from the information detector.

6. A method of detecting a condition of a surface ahead of a vehicle moving on the surface based on a plurality of images captured with an image capturing unit, the method comprising the steps of:

generating parallax information based on the plurality of captured images captured with the image capturing unit;

generating parallax histogram information, based on the parallax information, indicating parallax value mapping condition for each line prepared by dividing the captured image into a plurality of areas vertically;

selecting a group of parallax values, all of the parallax values decreasing as they approach an upper part of the captured image, among parallax values greater than a preset reference value, based on the parallax histogram information;

generating approximated curved line information for the selected group of parallax values; and

outputting a signal indicating that the vehicle arrives at a target point when the approximated curved line information satisfies a given target point arrival condition.

7. A non-transitory computer-readable storage medium storing a line recognition program that, when executed by a computer having a processor, causes the computer to execute a method of detecting a condition of a surface ahead of a vehicle moving on the surface based on a plurality of images captured with an image capturing unit, the method comprising the steps of:

generating parallax information based on the plurality of captured images captured with the image capturing unit;

generating parallax histogram information, based on the parallax information, indicating parallax value mapping condition for each line prepared by dividing the captured image into a plurality of areas vertically;

selecting a group of parallax values, all of the parallax values decreasing as they approach an upper part of the captured image, among parallax values greater than a preset reference value, based on the parallax histogram information;

generating approximated curved line information for the selected group of parallax values; and

outputting a signal indicating that the vehicle arrives at a target point when the approximated curved line information satisfies a given target point arrival condition.