OBJECT RECOGNITION APPARATUS AND OBJECT RECOGNITION METHOD

• US 20150243017A1
• Filed: 02/24/2015
• Published: 08/27/2015
• Est. Priority Date: 02/24/2014
• Status: Abandoned Application

• Current Assignee: Ricoh Company Limited
• Original Assignee: Haike Guan, Hideomi Fujimoto, Hiroyoshi Sekiguchi, Mitsuru Nakajima, Shin Aoki, Shuichi Suzuki, Soichiro Yokota
• Inventors: SEKIGUCHI, Hiroyoshi, GUAN, Haike, SUZUKI, Shuichi, NAKAJIMA, Mitsuru, AOKI, Shin, FUJIMOTO, Hideomi, YOKOTA, Soichiro
• Application Number:
  US14/630,078
• Publication Number:
  US 20150243017A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01S 11/12 using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 17/42 Simultaneous measurement of distance and other co-ordinates indirect measurement G01S17/46
• CPC Class Codes: G01S 17/66 Tracking systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 17/931 of land vehicles
• CPC Class Codes: G01S 2013/9318 Controlling the steering
• CPC Class Codes: G01S 2013/93185 Controlling the brakes
• CPC Class Codes: G01S 2013/93271 in the front of the vehicles
• CPC Class Codes: G01S 7/4814 of transmitters alone
• CPC Class Codes: G01S 7/4817 relating to scanning
• CPC Class Codes: G02B 26/127 Adaptive control of the scanning light beam, e.g. using the feedback from one or more detectors G02B27/0031 takes precedence
• CPC Class Codes: G06F 18/251 of input or preprocessed data
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/521 from laser ranging, e.g. using interferometry; from the projection of structured light
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 10/803 of input or preprocessed data
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

An object recognition apparatus includes a first object detection unit configured to detect an object based on an image captured by an imaging unit, and output first information including a distance and a direction to the object; a second object detection unit configured to emit light, detect the object based on reflected light, and output second information including a distance and a direction to the object; an output unit configured to output at least one of the first information and the second information; a disappearance detection unit configured to detect disappearance upon when the first object detection unit becomes unable to detect the object; and an emission control unit configured to control the second object detection unit to emit light in an object direction based on the first information before detecting the disappearance. Upon the disappearance detection unit detecting the disappearance, the output unit starts outputting the second information.

Claims

1. An object recognition apparatus comprising:

a first object detection unit configured to detect an object based on an image of the object captured by an imaging unit, and output first distance information including a distance to the object and first direction information including a direction to the object;

a second object detection unit configured to emit light, detect the object based on reflected light reflected at the object, and output second distance information including a distance to the object and second direction information including a direction to the object;

an output unit configured to output at least one of the first distance information and the second distance information and at least one of the first direction information and the second direction information;

a disappearance detection unit configured to detect disappearance upon when the first object detection unit becomes unable to detect the object; and

an emission control unit configured to control the second object detection unit, in a case where the disappearance detection unit detects the disappearance, to emit light in an object direction based on the first direction information before the disappearance detection unit detects the disappearance, wherein upon the disappearance detection unit detecting the disappearance, the output unit starts outputting the second distance information and the second direction information.

2. The object recognition apparatus as claimed in claim 1 wherein the disappearance detection unit detects the disappearance based on pixel values in an imaging range in the image of the object.

3. The object recognition apparatus as claimed in claim 2 wherein the disappearance detection unit detects the disappearance, in a case where a variance value of the pixel values in the imaging range in the image of the object is less than or equal to a threshold.

4. The object recognition apparatus as claimed in claim 1 wherein the output unit outputs the first distance information and the first direction information in a case of receiving the first distance information, the second distance information, the first direction information and the second direction information, and upon when the first object detection unit becomes able to detect the object after the output unit starts outputting the second distance information and the second direction information, the output unit starts outputting the first distance information and the first direction information.

5. The object recognition apparatus as claimed in claim 1 wherein in a case where the second object detection unit cannot detect the object with the light emitted in the object direction, the emission control unit controls the second object detection unit to emit light in a direction deviated from the object direction by a predetermined angle.

6. The object recognition apparatus as claimed in claim 1 wherein the second object detection unit emits light at a periodical timing while changing an emission direction, and in a case where the disappearance detection unit detects the disappearance, the second object detection unit does not emit light at a timing adjacent to a timing for emitting light in the object direction.

7. The object recognition apparatus as claimed in claim 1 wherein the second object detection unit emits light at a periodical timing while changing an emission direction, and in a case where the disappearance detection unit detects the disappearance, the second object detection unit emits light at the periodical timing, in addition to a timing for emitting light in the object direction.

8. The object recognition apparatus as claimed in claim 1 wherein the first object detection unit acquires the first distance information and the first direction information based on a plurality of images captured by a stereo camera, and the second object detection unit emits laser light and detects the second distance information and the second direction information.

9. An object recognition method comprising:

detecting an object based on an image of the object captured by an imaging unit, and outputting first distance information including a distance to the object and first direction information including a direction to the object;

emitting light, detecting the object based on reflected light reflected at the object, and outputting second distance information including a distance to the object and second direction information including a direction to the object;

outputting at least one of the first distance information and the second distance information and at least one of the first direction information and the second direction information;

detecting disappearance upon when the object becomes unable to be detected based on the image of the object; and

emitting light, in a case where the disappearance is detected, in an object direction based on the first direction information before the disappearance is detected, wherein upon the disappearance being detected, the second distance information and the second direction information start to be output.