Vehicle peripheral observation device using multiple cameras and enlarging an image

• US 9,403,481 B2
• Filed: 02/02/2011
• Issued: 08/02/2016
• Est. Priority Date: 03/26/2010
• Status: Active Grant

• Current Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Original Assignee: Aisin Seiki Co., Ltd. (Aisin Corp.)
• Inventors: Miyoshi, Hidehiko, Nagamine, Noboru, Miura, Kenji, Yamamoto, Kinji, Goto, Kenjiro
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): Suh, Joseph
• Application Number:
  US13/636,080
• Publication Number:
  US 20130010118A1
• Time in Patent Office: 2,008 Days
• Field of Search: 348/148, 348/149, 345/419, 382/103
• US Class Current: 1/1
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/602 with an adjustable viewpoint
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Provided is a device whereby the position of an obstacle can be perceived on a monitor without compromising the effectiveness of displaying an overhead image on the monitor. An overhead image generator generates an overhead image from images captured using multiple cameras, and the overhead image is displayed in an auxiliary display area of a monitor. When an obstacle detection part detects an obstacle in proximity to a vehicle, a specified information output unit emphasizes the display of a frame in the outer side of a divided area of the overhead image that contains the obstacle. Touching the auxiliary display area with a finger or the like during this emphasized display causes the captured image of the obstacle to be enlarged and displayed in the auxiliary display area.

Claims

1. A vehicle peripheral observation device comprising a plurality of cameras for imaging an area including a road surface of a vehicle periphery, an image processor for displaying the images captured using the plurality of cameras on a monitor, and obstacle-detecting unit for detecting an obstacle in the vehicle periphery;

the image processor having overhead-image-generator for generating an overhead image looking down on the vehicle and the vehicle periphery disposed on the road surface from above from the images captured using the plurality of cameras and displaying the resulting image in an overhead image display area of the monitor, the overhead image display area being divided and managed as a plurality of divided areas, and

specified information output unit that, when an obstacle is detected by the obstacle-detecting unit, emphasizes the display of a frame in the outer periphery of the divided area containing the obstacle detected by the obstacle-detecting unit from among the plurality of divided areas, and displaying the position of the detected obstacle on the monitor,

wherein the monitor has a touch panel in a display surface, and also has an enlarged display unit for enlarging, in a state where the specified information output unit emphasizes the display of a frame, the display of an image of the divided area in the monitor where the specified information output unit emphasizes the display of a frame when touching any one of the plurality of divided areas of the overhead image display area is sensed in the touch panel while the specified information output unit emphasizes the display of a frame.

2. The vehicle peripheral observation device according to claim 1, wherein the specified information output unit increases the brightness of the frame or a switches a hue of the frame to a different hue, for emphasizing the display.

3. The vehicle peripheral observation device according to claim 1, wherein the enlarged display unit performs a process of setting, as an image to be enlarged, the overhead image displayed in the divided area where the specified information output unit emphasizes the display of a frame, wherein setting an enlarged display area in which the image to be enlarged is displayed as enlarged, generates a plurality of intermediate images in which the image to be enlarged is be an intermediate size between the size of the divided area and the size of the enlarged display area, and sequentially displaying the intermediate images beginning with the smallest size.

4. The vehicle peripheral observation device according to claim 3, wherein a primary display area, as the overhead image display area, and an auxiliary display area, as the enlarged display area, are displayed on the monitor.

5. The vehicle peripheral observation device according to claim 1, wherein the enlarged display unit performs a process of setting, as an image to be enlarged, the image captured using the camera that has imaged the divided area where the specified information output unit emphasizes the display of a frame, wherein setting an enlarged display area in which the image to be enlarged is displayed as enlarged, generates a plurality of intermediate images in which the image to be enlarged is be an intermediate size between the size of the divided area and the size of the enlarged display area, and sequentially displaying the intermediate images beginning with the smallest size.

6. The vehicle peripheral observation device according to claim 5, wherein a primary display area, as the overhead image display area, and an auxiliary display area, as the enlarged display area, are displayed on the monitor.

7. The vehicle peripheral observation device according to claim 1, wherein the overhead-image-generator acquires the images captured using the plurality of the cameras, converts the images to projected images in a format of looking down from above, and maps the projected images in an imaginary plane in a position encompassing the vehicle image.

8. A vehicle peripheral observation device comprising a plurality of cameras for imaging an area including a road surface of a vehicle periphery, an image processor for displaying the images captured using the plurality of cameras on a monitor, and obstacle-detecting unit for detecting an obstacle in the vehicle periphery;

the image processor having overhead-image-generator for generating an overhead image looking down on the vehicle and the vehicle periphery disposed on the mad surface from above from the images captured using the plurality of cameras and displaying the resulting image in an overhead image display area of the monitor, the overhead image display area being divided and managed as a plurality of divided areas, and

specified information output unit that, when an obstacle is detected by the obstacle-detecting unit, emphasizes the display of a frame in the outer periphery of the divided area containing the obstacle detected by the obstacle-detecting unit from among the plurality of divided areas, and displaying the position of the detected obstacle on the monitor,

wherein the monitor has a touch panel in a display surface, and also has an enlarged display unit for enlarging, in a state where the specified information output unit emphasizes the display of a frame, the display of an image of the divided area in the monitor where the specified information output unit emphasizes the display of a frame when touching of the overhead image display area is sensed in the touch panel while the specified information output unit emphasizes the display of a frame,

wherein the enlarged display unit displays the overhead image in the overhead image display area instead of the enlarged display produced by the enlarged display unit when the obstacle-detecting unit has switched to a state of not detecting obstacles.

9. A vehicle peripheral observation device comprising a plurality of cameras for imaging an area including a road surface of a vehicle periphery, an image processor for displaying the images captured using the plurality of cameras on a monitor, and obstacle-detecting unit for detecting an obstacle in the vehicle periphery;

the image processor having overhead-image-generator for generating an overhead image looking down on the vehicle and the vehicle periphery disposed on the road surface from above from the images captured using the plurality of cameras and displaying the resulting image in an overhead image display area of the monitor, the overhead image display area being divided and managed as a plurality of divided areas, and

specified information output unit that, when an obstacle is detected by the obstacle-detecting unit, emphasizes the display of a frame in the outer periphery of the divided area containing the obstacle detected by the obstacle-detecting unit from among the plurality of divided areas, and displaying the position of the detected obstacle on the monitor,

wherein the monitor has a touch panel in a display surface, and also has an enlarged display unit for enlarging, in a state where the specified information output unit emphasizes the display of a frame, the display of an image of the divided area in the monitor where the specified information output unit emphasizes the display of a frame when touching of the overhead image display area is sensed in the touch panel while the specified information output unit emphasizes the display of a frame,

wherein an enlarged image is generated by enlarging an intermediate image to a size of an enlarged display area; and

when the enlarged image is generated, an area icon showing an original position of the enlarged image is displayed in a part of the enlarged image.