Obstacle detecting apparatus and method

• US 20050152580A1
• Filed: 12/09/2004
• Published: 07/14/2005
• Est. Priority Date: 12/16/2003
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Furukawa, Kenji, Okada, Ryuzo, Onoguchi, Kazunori
• Application Number:
  US11/007,209
• Publication Number:
  US 20050152580A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 2201/08 Detecting or categorising vehicles

Abstract

An apparatus that detects an obstacle using images shot by an image shooting device mounted on a mobile object on a plane, the apparatus comprising: an image receiving unit configured to receive time-series images shot by the image shooting device; an area setting unit configured to set a plurality of processing areas in the images received by the image receiving unit; an object motion detector configured to detect objects moving within the areas set by the area setting unit and to detect motion trajectories of the objects; an obstacle candidate detector configured to detect the respective objects as obstacle candidates if a direction of a line connecting between the objects is a predetermined direction; and an obstacle determining unit configured to compare the motion trajectories of the respective obstacle candidates and to determine the obstacle candidates as an obstacle if the motion trajectories of the obstacle candidates satisfy a predetermined similarity condition.

Claims

1. An apparatus that detects an obstacle using images shot by an image shooting device mounted on a mobile object on a plane, the apparatus comprising:

an image receiving unit configured to receive time-series images shot by the image shooting device;

an area setting unit configured to set a plurality of processing areas in the images received by the image receiving unit;

an object motion detector configured to detect objects moving within the areas set by the area setting unit and to detect motion trajectories of the objects;

an obstacle candidate detector configured to detect the respective objects as obstacle candidates if a direction of a line connecting between the objects is a predetermined direction; and

an obstacle determining unit configured to compare the motion trajectories of the respective obstacle candidates and to determine the obstacle candidates as an obstacle if the motion trajectories of the obstacle candidates satisfy a predetermined similarity condition.

2. The apparatus according to claim 1, wherein the area setting unit sets a first area in which an obstacle on the plane on which the mobile object moves should be detected, and a second area including a vanishing line of the plane on which the mobile object moves as the processing areas.

3. The apparatus according to claim 2, wherein, if the object motion detector detects an object moving within the first area, the obstacle candidate detector determines whether there is an object within a determination area in a predetermined direction from the detection position of interest in the second area, and detects the objects detected within both areas as obstacle candidates if there is the object moving within the determination area in the second area.

4. The apparatus according to claim 1, wherein the predetermined direction is a vertical direction.

5. The apparatus according to claim 1, wherein the obstacle determining unit compares motion trajectories with respect to each predetermined period of the respective objects detected as the obstacle candidates, and determines the objects as an obstacle if the motion trajectories thereof satisfy the similarity condition.

6. The apparatus according to claim 1, wherein the obstacle candidate determining unit determines the objects as an obstacle if horizontal components of the amounts of movement of the respective objects detected as the obstacle candidates are substantially identical.

7. The apparatus according to claim 1, wherein the image receiving unit performs image correction so as to make the vanishing line of the plane on which the mobile object moves in the image shot by the image shooting device horizontal in the image of interest.

8. The apparatus according to claim 1, wherein the image receiving unit receives an image shot by the image shooting device installed so as to shoot an adjacent lane rearward of an automobile traveling on a road plane near a side mirror of the automobile of interest.

9. A method of detecting an obstacle using images shot by an image shooting device mounted on a mobile object on a plane, the method comprising:

receiving time-series images shot by the image shooting device;

setting a plurality of processing areas in the images received;

detecting objects moving within the plurality of processing areas;

detecting motion trajectories of the objects;

detecting the respective objects as obstacle candidates if a direction of a line connecting between objects is a predetermined direction;

comparing the motion trajectories of the respective obstacle candidates; and

determining the obstacle candidates as an obstacle if the motion trajectories of the obstacle candidates satisfy a predetermined similarity condition.

10. The method according to claim 9, wherein the plurality of processing areas includes a first area in which an obstacle on the plane on which the mobile object moves should be detected, and a second area includes a vanishing line of the plane on which the mobile object moves as the processing areas.

11. The method according to claim 10, wherein, if an object moving within the first area is detected, it is determined whether there is an object within a determination area in a predetermined direction from the detection position of interest in the second area, and the objects is detected as obstacle candidates if there is the object moving within the determination area in the second area.

12. The method according to claim 9, wherein the predetermined direction is a vertical direction.

13. The method according to claim 9, wherein the motion trajectories with respect to each predetermined period of the respective objects detected as the obstacle candidates are compared each other, and the objects is determined as an obstacle if the motion trajectories thereof satisfy the similarity condition.

14. The method according to claim 9, wherein the objects are determined as an obstacle if horizontal components of the amounts of movement of the respective objects detected as the obstacle candidates within the respective plurality of processing areas are substantially identical.

15. The method according to claim 9, further comprising, after receiving time-series images, performing image correction so as to make the vanishing line of the plane on which the mobile object moves in the image shot by the image shooting device horizontal in the image of interest.

16. The method according to claim 9, wherein the time-series images received are images shot by the image shooting device installed so as to shoot an adjacent lane rearward of an automobile traveling on a road plane near a side mirror of the automobile of interest.

17. The method according to claim 10, wherein, if an object moving within the first area is detected, the detecting as obstacle candidates determines whether there is an object within a determination area in a predetermined direction from the detection position of interest in the second area, and the detecting as obstacle candidates detects the objects as obstacle candidates if there is the object moving within the determination area in the second area.