Surrounding area monitoring device for vehicle

• US 9,321,399 B2
• Filed: 02/21/2011
• Issued: 04/26/2016
• Est. Priority Date: 03/01/2010
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Aimura, Makoto, Nagaoka, Nobuharu
• Primary Examiner(s): Teitelbaum, Michael
• Application Number:
  US13/580,014
• Publication Number:
  US 20120314074A1
• Time in Patent Office: 1,891 Days
• Field of Search: 348 42- 60
• US Class Current: 1/1
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G01C 3/14 with binocular observation at a single point, e.g. stereoscopic type G01C3/20 takes precedence
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A surrounding area monitoring apparatus, which is built into a vehicle, images the area surrounding the vehicle and detects physical objects in the area surrounding the vehicle based on the image taken. The apparatus determines whether the detected physical object is a pedestrian or an animal, and a warning is given to the driver of the vehicle if the determined physical object is present within a specified area from the vehicle. If it is determined that the detected physical object is an animal and that the animal is present within the specified area, the warning in continued for a specified period even after the animal has left the specified area. Since animals have habits of behaving in a herd, the risk of lurking animals can be brought to the driver'"'"'s attention by the continuation of the warning.

Claims

1. A surrounding area monitoring apparatus comprising:

an imaging device mounted on a vehicle that captures images around the vehicle;

a image processing unit including a processor and a memory that are configured to;

process images captured by the imaging device to detect a physical object lying around the vehicle;

determine whether the physical object detected is a pedestrian or an animal; and

provide a warning screen image to a display device, the warning screen image emphasizing the physical object that is within a specified area from the vehicle,

wherein when the detected physical object is determined to be an animal and is within the specified area, the warning screen image is continuously displayed for a specified period after the animal is determined to no longer be in the specified area, and

wherein when the detected physical object is determined to be a pedestrian, the warning screen image is turned off at a time when the pedestrian exists the specified area.

2. The apparatus according to claim 1, wherein the image processing unit is further configured to provide a warning screen image in a first mode, each physical object being separately highlighted in the warning screen image in the first mode.

3. The apparatus according to claim 2, wherein the image processing unit is further configured to provide a warning screen image in a second mode, presence of one or more physical objects within a specified area being indicated by an icon placed in the warning screen image in the second mode.

4. The apparatus according to claim 3, wherein the image processing unit is further configured to provide a warning screen image in the second mode to indicate presence of one or more animals in the specified area.

5. The apparatus according to claim 4, wherein the image processing unit is configured to continue to provide the warning screen image in the second mode to indicate presence of one or more animals for a specified period after the one or more animals have left the specified area.

6. The apparatus according to claim 3, wherein the image processing unit is configured to provide the warning screen image in combination of the first mode and the second mode.

7. The apparatus according to claim 1, wherein the imaging device comprises one or more cameras.

8. The apparatus according to claim 1, further comprising one or more speakers that produce warnings by sound or voice.

9. The apparatus according to claim 1, wherein the specified area has predefined dimensions originating from the vehicle.

10. The apparatus according to claim 1, wherein the continuously displayed warning screen image is displayed for the specified period based on a timer that is initiated when the animal is determined to no longer be in the specified area.

11. A surrounding area monitoring method for a vehicle having an imaging device mounted thereon that captures images around the vehicle, and an image processing unit including a processor and a memory, the method comprising:

processing images captured by the imaging device to detect a physical object lying around the vehicle;

determining whether the physical object detected is a pedestrian or an animal; and

providing a warning screen image to a display device, the warning screen image emphasizing the physical object that is within a specified area from the vehicle,

wherein when the detected physical object is determined to be an animal and is within the specified area, the method further includes;

determining that the animal is no longer in the specified area;

establishing a timer of a specified period after it is determined that the animal is no longer in the specified area; and

continuously displaying the warning screen image for the specified period of the time after the animal is determined to no longer be in the specified area, and

wherein when the detected physical object is determined to be a pedestrian, the method further includes turning off the warning screen image at a time when the pedestrian exists the specified area.

12. The method according to claim 11, wherein the image processing unit is further configured to provide a warning screen image in a first mode, each physical object being separately highlighted in the warning screen image in the first mode.

13. The method according to claim 12, wherein the image processing unit is further configured to provide a warning screen image in a second mode, presence of one or more physical objects within a specified area being indicated by an icon placed in the warning screen image in the second mode.

14. The method according to claim 13, wherein the image processing unit is further configured to provide a warning screen image in the second mode to indicate presence of one or more animals in the specified area.

15. The method according to claim 14, wherein the image processing unit is configured to continue to provide the warning screen image in the second mode to indicate presence of one or more animals for a specified period after the one or more animals have left the specified area.

16. The method according to claim 13, wherein the image processing unit is configured to provide the warning screen image in combination of the first mode and the second mode.

17. The method according to claim 11, wherein the imaging device comprises one or more cameras.

18. The method according to claim 11, further comprising one or more speakers that produce warnings by sound or voice.

19. The method according to claim 11, wherein the specified area has predefined dimensions originating from the vehicle.