Vehicle surroundings monitoring apparatus

• US 20080130954A1
• Filed: 05/03/2007
• Published: 06/05/2008
• Est. Priority Date: 05/19/2006
• Status: Active Grant

• Current Assignee: Arriver Software AB (Qualcomm, Inc.)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Saka, Masakazu, Koike, Hiroyuki, Taniguchi, Fuminori
• Granted Patent: US 7,949,151 B2
• Time in Patent Office: Days
• US Class Current: 382/104
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

A vehicle surroundings monitoring apparatus is provided herein which is capable of determining an object type, particularly capable of determining an animal other than a human being among objects. The vehicle surroundings monitoring apparatus which monitors the surroundings of a vehicle by using an image captured by a camera (2R, 2L) mounted on the vehicle, including an object extraction process unit which extracts an image area of the object from the captured image (steps 1 to 6) and an object type determination process unit which determines the object type according to whether the image area of the object extracted by the object extraction process unit includes a first object area in which the ratio of widths in different directions is within a predetermined range and a plurality of second object areas located below the first object area and smaller in area than the first object area (steps 31 to 37).

Claims

1. A vehicle surroundings monitoring apparatus which monitors the surroundings of a vehicle by using an image captured by a camera mounted on the vehicle, comprising:

an object extraction process unit which extracts an image area of an object from the image captured by the camera; and

an object type determination process unit which determines an object type according to whether the image area of the object extracted by the object extraction process unit includes a first object area in which the ratio of widths in different directions is within a predetermined range and a plurality of second object areas located below the first object area and smaller in area than the first object area.

2. A vehicle surroundings monitoring apparatus according to claim 1, wherein the object type determination process unit determines that the object type is an animal other than a human being in the case where the image area of the object extracted by the object extraction process unit includes the first object area in which the ratio of widths in different directions is within the predetermined range and the plurality of second object areas located below the first object area and smaller in area than the first object area.

3. A vehicle surroundings monitoring apparatus according to claim 1, wherein the first object area further has a predetermined size.

4. A vehicle surroundings monitoring apparatus according to claim 1, wherein the object type determination process unit determines the object type based on the relationship between a first area width which is the horizontal width of the image captured by the camera of the first object area and a second area width which is the horizontal width of the image captured by the camera between the left end on the left side and the right end on the right side of the two or more second object areas.

5. A vehicle surroundings monitoring apparatus according to claim 4, wherein the object type determination process unit determines that the object type is an animal other than a human being in the case where the second area width is greater than one half of the first area width.

6. A vehicle surroundings monitoring apparatus according to claim 1, further comprising a distance calculation process unit which calculates a distance of a real space position corresponding to the image area included in the image captured by the camera from the vehicle, wherein the object type determination process unit determines the object type under the condition that the image area of the object has a feature located within a predetermined range from the first object area in the image captured by the camera and satisfying a preset feature condition and that the distance of the real space position corresponding to the feature from the vehicle is equal to the distance of the real space position corresponding to the first object area from the vehicle.

8. A vehicle equipped with the vehicle surroundings monitoring apparatus according to claim 1.

7. A vehicle surroundings monitoring apparatus which monitors the surroundings of a vehicle by using a computer which is provided in the apparatus and includes an interface circuit for use in accessing an image captured by a camera mounted on the vehicle,

wherein the computer performs:

an object extraction process for extracting an image area of an object from the image captured by the camera; and

an object type determination process for determining an object type according to whether the image area of the object extracted in the object extraction process includes a first object area in which the ratio of widths in different directions is within a predetermined range and a plurality of second object areas located below the first object area and smaller in area than the first object area.

9. A vehicle surroundings monitoring program which causes an in-vehicle computer including a processing unit which accesses data of an image captured by a camera mounted on a vehicle to perform a function of monitoring the surroundings of the vehicle, the program causing the computer to function as:

an object extraction process unit which extracts an image area of an object from the image captured by the camera; and

an object type determination process unit which determines an object type according to whether the image area of the object extracted by the object extraction process unit includes a first object area in which the ratio of widths in different directions is within a predetermined range and a plurality of second object areas located below the first object area and smaller in area than the first object area.

10. A vehicle surroundings monitoring method of monitoring the surroundings of a vehicle by using an in-vehicle computer including a processing unit which accesses data of an image captured by a camera mounted on the vehicle, the method comprising:

an object extraction step of causing the computer to extract the image area of an object from the image captured by the camera; and

an object type determination step of causing the computer to determine an object type according to whether the image area of the object extracted in the object extraction step includes a first object area in which the ratio of widths in different directions is within a predetermined range and a plurality of second object areas located below the first object area and smaller in area than the first object area.