Movable Body Circumstance Monitoring Apparatus

• US 20080002025A1
• Filed: 09/30/2005
• Published: 01/03/2008
• Est. Priority Date: 10/28/2004
• Status: Abandoned Application

• Current Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Original Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Inventors: Kakinami, Toshiaki
• Application Number:
  US11/665,992
• Publication Number:
  US 20080002025A1
• Time in Patent Office: Days
• US Class Current: 348/115
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 19/48 combined with, or convertible into, other devices or objects, e.g. bumpers combined with road brushes, bumpers convertible into beds
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

There are provided environmental information detection means (SR) for detecting and storing environmental information around a movable body on the basis of image information output from a specific image capturing means (C1), movable body information detection means (MB) for successively detecting and storing a position and posture of the movable body, information combining means (CB) for combining these information, and correcting a relationship of the position and posture of the movable body relative to the environment to output the information, and obstacle detection means (OD) for detecting an obstacle to bar against movement of the movable body on the basis of the output information. Based on the detected information or the like, a positional relationship between the movable body and the obstacle is determined, then, on the basis of the positional relationship, either one of the information output from the specific image capturing means (C1) and second image capturing means (C2) is selected by display control means (VC), and displayed by display means (VD).

Claims

1. In a movable body circumstance monitoring apparatus having a plurality of image capturing means mounted on different positions of a movable body for capturing an image of environment of said movable body to output an image information, and display means for selecting one of the image information output from said plurality of image capturing means to be displayed, the movable body circumstance monitoring apparatus is characterized in comprising:

environmental information detection means for detecting and storing environmental information around said movable body on the basis of the image information output from single specific image capturing means out of said plurality of image capturing means;

movable body information detection means for successively detecting and storing a position and posture of said movable body;

information combining means for combining the information detected by said movable body information detection means and the information detected by said environmental information detection means, and correcting a relationship of the position and posture of said movable body relative to said environment to output the information;

obstacle detection means for detecting an obstacle to bar against movement of said movable body on the basis of the information output from said information combining means; and

display control means for determining a positional relationship between said movable body and said obstacle, on the basis of the information detected by said obstacle detection means and the information output from said information combining means, selecting one of the image information output from second image capturing means other than said specific image capturing means out of said plurality of image capturing means and the image information output from said specific image capturing means, on the basis of said positional relationship, and controlling said display means to display the selected image information.

2. A movable body circumstance monitoring apparatus as described in claim 1, wherein, when said obstacle is included in both of the image information output from said specific image capturing means and the image information output from said second image capturing means, said display control means selects the image information output from the image capturing means, which outputs the image information captured at a position where said obstacle is away from a boundary of a view from said movable body.

3. A movable body circumstance monitoring apparatus as described in claim 1, wherein, when a plurality of obstacles exist, and different obstacles thereof are included in both of the image information output from said specific image capturing means and the image information output from said second image capturing means, said display control means selects the image information output from the image capturing means, which outputs the image information including the obstacle with highest possibility of approaching to said movable body.

4. A movable body circumstance monitoring apparatus as described in claim 3, wherein said obstacle detection means comprises track estimation means for estimating an expected moving track of said movable body on the basis of the information output from said information combining means, and point-blank moving distance measuring means for combining the expected moving track estimated by said track estimation means with the environmental information detected by said environmental information detection means, to identify said obstacle present on the expected moving track of said movable body, and measuring a minimal distance between said movable body and said obstacle on the expected moving track, and wherein said display control means selects the image information output from the image capturing means, which outputs the image information including the obstacle with highest possibility of approaching to said movable body, on the basis of the result measured by said point-blank moving distance measuring means.

5. A movable body circumstance monitoring apparatus as described in claim 1, wherein said plurality of image capturing means include image capturing means disposed in a moving direction of said movable body and a reverse direction thereof, respectively, and wherein said display control means selects the image capturing means disposed in the moving direction of said movable body, to be served as said specific image capturing means.

6. A movable body circumstance monitoring apparatus as described in claim 5, wherein said specific image capturing means comprises the image capturing means disposed in a longitudinal direction of said movable body, and wherein said second image capturing means comprises the image capturing means disposed in a lateral direction of said movable body.

7. A movable body circumstance monitoring apparatus as described in claim 1, wherein said plurality of image capturing means comprise image capturing means disposed at four corners of said movable body.

8. A movable body circumstance monitoring apparatus as described in claim 1, wherein, when said movable body is moved from a first state to a second state, at least two images are captured by said specific image capturing means in said first state and said second state, and wherein said environmental information detection means includes feature point tracking means for detecting a coordinate of a feature point on the image captured in said first state, and detecting a coordinate corresponding to said feature point on the image captured in said second state, on the basis of said two images.

9. A movable body circumstance monitoring apparatus as described in claim 8, wherein said environmental information detection means includes three-dimensional coordinate estimation means for estimating a three-dimensional coordinate of said feature point on the basis of the position and posture of said vehicle in said first state and said second state, the coordinate of the feature point on the image captured in said first state, and the coordinate corresponding to said feature point on the image captured in said second state.

10. A movable body circumstance monitoring apparatus as described in claim 1, wherein, when there exists an obstacle moving relatively according to movement of said movable body, the image in an image capturing region by said specific image capturing means is automatically changed into the image in an image capturing region by said second image capturing means.