Vehicle periphery monitoring apparatus and image displaying method

• US 8,144,033 B2
• Filed: 09/02/2008
• Issued: 03/27/2012
• Est. Priority Date: 09/26/2007
• Status: Active Grant

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Akatsuka, Takeshi, Nakano, Yoshinori, Kawano, Tsutomu, Chinomi, Satoshi, Yanagi, Takura
• Primary Examiner(s): Pham, Toan N
• Assistant Examiner(s): GIRMA, FEKADESELASS
• Application Number:
  US12/202,640
• Publication Number:
  US 20090079585A1
• Time in Patent Office: 1,302 Days
• Field of Search: 340/937, 340/936
• US Class Current: 340/937
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/306 using a re-scaling of images
• CPC Class Codes: B60R 2300/8026 in addition to a rear-view mirror system
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images

Abstract

A vehicle periphery monitoring apparatus includes an image capturing device, a display device and an image processing device. The image capturing device is configured and arranged to capture a first original image of a region rearward of a vehicle and a second original image of a region laterally rearward of the vehicle. The display device includes a first display area and a second display area disposed on a lateral side of the first display area. The image processing device is configured to display a first displayed image from the first original image in the first display area and to display a second displayed image from the second original image in the second display area to form a combined image on the display device with the second displayed image being horizontally compressed from the second original image to at least a greater degree than the first displayed image.

Claims

1. A vehicle periphery monitoring apparatus comprising:

an image capturing device configured and arranged to capture a first original image of a region rearward of a vehicle and a second original image of a region laterally rearward of the vehicle;

a display device mounted in an interior of the vehicle, the display device including a first display area and a second display area disposed on a lateral side of the first display area; and

an image processing device configured to display a first displayed image from the first original image of the region rearward of the vehicle in the first display area of the display device and to display a second displayed image from the second original image of the region laterally rearward of the vehicle in the second display area of the display device to form a combined image on the display device with the second displayed image being horizontally compressed from the second original image to at least a greater degree than the first displayed image,

the image processing device being configured to compress the first original image of the region rearward of the vehicle captured by the image capturing device to display the first displayed image in the first display area of the display device,

the second displayed image having first and second lateral edges, with the first lateral edge being adjacent the first display area, and the image processing device being further configured to process the second original image so that the second displayed image displayed in the second display area is gradually compressed to a greater degree as one moves in a horizontal direction away from the first lateral edge toward the second lateral edge.

2. The vehicle periphery monitoring apparatus recited in claim 1, wherein

the image processing device is configured to convert the first original image of the region rearward of the vehicle captured by the image capturing device to the first displayed image having a reference image size generally corresponding to a mirror reflection image of the region rearward of the vehicle viewed by a driver in an interior rearview mirror of the vehicle.

3. The vehicle periphery monitoring apparatus recited in claim 2, wherein

the image processing device is configured to extract a prescribed portion of the first original image of the region rearward of the vehicle captured by the image capturing device and to convert the extracted image into the first displayed image having the reference image size.

6. The vehicle periphery monitoring apparatus recited in claim 1, wherein

the image capturing device includes

a rearward camera configured and arranged to capture the first original image of the region rearward of the vehicle from a rearward portion of the vehicle, and

a lateral camera configured and arranged to capture the second original image of the region laterally rearward of the vehicle from a lateral portion of the vehicle.

7. The vehicle periphery monitoring apparatus recited in claim 6, wherein

the lateral camera is installed on a door mirror of the vehicle.

8. The vehicle periphery monitoring apparatus recited in claim 1, wherein

the image capturing device includes a single camera configured and arranged to capture the first original image of the region rearward of the vehicle and the second original image of the region laterally rearward of the vehicle.

9. The vehicle periphery monitoring apparatus recited in claim 1, wherein

the image capturing device is further configured and arranged to capture a third original image of a region laterally rearward of the vehicle disposed on an opposite side from the region laterally rearward of the vehicle encompassed in the second original image with respect to the region rearward of the vehicle in the first original image,

the display device further includes a third display area disposed on a lateral side of the first display area on an opposite side from the second display area, and

the image processing device is further configured to display a third displayed image from the third original image of the region laterally rearward of the vehicle in the third display area of the display device to form the combined image on the display device with the third displayed image being horizontally compressed from the third original image to at least a greater degree than the first displayed image.

10. The vehicle periphery monitoring apparatus recited in claim 9, wherein

the image capturing device includes

a rearward camera configured and arranged to capture the first original image of the region rearward of the vehicle from a rearward portion of the vehicle, and

a pair of left and right lateral cameras configured and arranged to capture the second and third original images of the regions laterally rearward of the vehicle from left and right lateral portions of the vehicle, respectively.

11. The vehicle periphery monitoring apparatus recited in claim 10, wherein

the left and right lateral cameras are installed on left and right door mirrors of the vehicle, respectively.

12. The vehicle periphery monitoring apparatus recited in claim 9, wherein

the image capturing device includes a single camera configured and arranged to capture the first original image of the region rearward of the vehicle and the second and third original images of the regions laterally rearward of the vehicle.

13. The vehicle periphery monitoring apparatus recited in claim 1, wherein

the image processing device is further configured to process the second original image so that the second displayed image is uniformly compressed in a horizontal direction.

14. The vehicle periphery monitoring apparatus recited in claim 1, wherein

the image capturing device is configured and arranged to sequentially capture the first original image and the second original image, and

the image processing device is configured to sequentially output the combined image including the first and second displayed images to form a plurality of frames of a video sequence displayed on the display device.

4. A vehicle periphery monitoring apparatus wherein comprising:

an image capturing device configured and arranged to capture a first original image of a region rearward of a vehicle and a second original image of a region laterally rearward of the vehicle;

a display device mounted in an interior of the vehicle, the display device including a first display area and a second display area disposed on a lateral side of the first display area; and

an image processing device configured to display a first displayed image from the first original image of the region rearward of the vehicle in the first display area of the display device and to display a second displayed image from the second original image of the region laterally rearward of the vehicle in the second display area of the display device to form a combined image on the display device with the second displayed image being horizontally compressed from the second original image to at least a greater degree than the first displayed image,

the image processing device being configured to convert the first original image of the region rearward of the vehicle captured by the image capturing device to the first displayed image having a reference image size generally corresponding to a mirror reflection image of the region rearward of the vehicle viewed by a driver in an interior rearview mirror of the vehicle, the image processing device being configured to extract a prescribed portion of the first original image of the region rearward of the vehicle captured by the image capturing device and to convert the extracted image into the first displayed image having the reference image size, the image processing device being further configured to enlarge the extracted image into the reference image size to obtain the first displayed image,

the second displayed image having first and second lateral edges, with the first lateral edge being adjacent the first display area, and the image processing device being further configured to process the second original image so that the second displayed image displayed in the second display area is gradually compressed to a greater degree as one moves in a horizontal direction away from the first lateral edge toward the second lateral edge.

5. A vehicle periphery monitoring apparatus comprising:

an image capturing device configured and arranged to capture a first original image of a region rearward of a vehicle and a second original image of a region laterally rearward of the vehicle;

a display device mounted in an interior of the vehicle, the display device including a first display area and a second display area disposed on a lateral side of the first display area; and

an image processing device configured to display a first displayed image from the first original image of the region rearward of the vehicle in the first display area of the display device and to display a second displayed image from the second original image of the region laterally rearward of the vehicle in the second display area of the display device to form a combined image on the display device with the second displayed image being horizontally compressed from the second original image to at least a greater degree than the first displayed image,

the image processing device being configured to convert the first original image of the region rearward of the vehicle captured by the image capturing device to the first displayed image having a reference image size generally corresponding to a mirror reflection image of the region rearward of the vehicle viewed by a driver in an interior rearview mirror of the vehicle, the image processing device being further configured to vertically compress the second original image of the region laterally rearward of the vehicle captured by the image capturing device,

the second displayed image having first and second lateral edges, with the first lateral edge being adjacent the first display area, and the image processing device being further configured to process the second original image so that the second displayed image displayed in the second display area is gradually compressed to a greater degree as one moves in a horizontal direction away from the first lateral edge toward the second lateral edge.

15. A vehicle periphery monitoring apparatus comprising:

image capturing means for capturing a first original image of a region rearward of a vehicle and a second original image of a region laterally rearward of the vehicle;

image processing means for generating a first displayed image from the first original image of the region rearward of the vehicle and for generating a second displayed image from the second original image of the region laterally rearward of the vehicle with the second displayed image being horizontally compressed from the second original image to at least a greater degree than the first displayed image; and

display means for displaying the first displayed image in a first display area and the second displayed image in a second display area to form a combined image on the display means, the display means being mounted in an interior of the vehicle,

the image processing means being further configured to compress the first original image of the region rearward of the vehicle captured by the image capturing means to display the first displayed image in the first display area of the display means,

the second displayed image having first and second lateral edges, with the first lateral edge being adjacent the first display area, and the image processing means being further configured to process the second original image so that the second displayed image displayed in the second display area is gradually compressed to a greater degree as one moves in a horizontal direction away from the first lateral edge toward the second lateral edge.

16. A vehicle periphery monitoring method comprising:

capturing a first original image of a region rearward of a vehicle and a second original image of a region laterally rearward of the vehicle;

generating a first displayed image from the first original image of the region rearward of the vehicle;

generating a second displayed image from the second original image of the region laterally rearward of the vehicle, with the second displayed image being horizontally compressed from the second original image to at least a greater degree than the first displayed image; and

displaying within an interior of the vehicle the first displayed image in a first display area of a display device and the second displayed image in a second display area of the display device to form a combined image on the display device, the second displayed image having first and second lateral edges, with the first lateral edge being adjacent the first display area,

the generating of the first displayed image including compressing the first original image of the region rearward of the vehicle that was captured to display the first displayed image in the first display area of the display device,

the generating of the second displayed image including processing the second original image so that the second displayed image displayed in the second display area is gradually compressed to a greater degree as one moves in a horizontal direction away from the first lateral edge toward the second lateral edge.