IMAGE PROCESSING SYSTEM AND METHOD

• US 20070285549A1
• Filed: 05/30/2007
• Published: 12/13/2007
• Est. Priority Date: 06/02/2006
• Status: Active Grant

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Takano, Teruhisa
• Granted Patent: US 8,134,595 B2
• Time in Patent Office: Days
• US Class Current: 348/333.10
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/102 using 360 degree surveillance camera system
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/60 characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

An image processing system so disclosed has respective image pickup parts and respective viewpoint conversion parts configured to perform viewpoint conversion of original images captured by the respective image pickup parts to generate converted images. The image processing system also includes a display device controllable to display the converted images.

Claims

1. An image processing system, comprising:

plural image pickup devices, each including an image pickup part configured to capture an original image and a viewpoint conversion part configured to perform viewpoint conversion for the original image to generate a converted image;

an image processor operable to synthesize converted images output from the plural image pickup devices to generate a synthesized image; and

a display device controllable to selectively displaying the synthesized image and at least one original image output from the plural image pickup devices.

2. The system according to claim 1 wherein the plural image pickup devices are configured to output a portion of the converted images generated by respective viewpoint conversion parts to the image processor.

3. The system according to claim 1 wherein each of the plural image pickup devices further comprises:

a rotating part configured to rotate the converted image generated by the viewpoint conversion part to match an orientation in the synthesized image.

4. The system according to claim 1 wherein the plural image pickup devices are configured to alternately output respective original images and converted images to the image processor.

5. The system according to claim 4 wherein each of the plural image pickup devices further comprises:

a storage part with at least a 4-image storage capacity; and

wherein a ratio of write speed to read speed relative to the storage part is 1;

2.

6. The system according to claim 1 wherein each of the image pickup devices further comprises:

a second viewpoint conversion part configured to perform viewpoint conversion of the original image to generate a second converted image; and

wherein the plural image pickup devices are configured to sequentially output respective original images, converted images and second converted images to the image processor.

7. The system according to claim 6 wherein each of the image pickup devices further comprises:

a storage part with a 6-image storage capacity; and

wherein a ratio of write speed to read speed relative to the storage part is 1;

3.

8. The system according to claim 1 wherein each of the image pickup devices further comprises:

a second image synthesis part configured to synthesize the original image and the converted image to generate a second synthesized image.

9. An image processing system, comprising;

image pickup devices having respective image pickup parts and respective viewpoint conversion parts configured to perform viewpoint conversion of original images captured by the respective image pickup parts to generate converted images; and

a display device controllable to display the original images and the converted images.

10. An image processing system, comprising:

image pickup devices having respective image pickup parts and respective viewpoint conversion parts configured to perform viewpoint conversion of original images captured by the respective image pickup parts to generate converted images; and

a display device controllable to display the converted images.

11. An image processing system, comprising:

plural image pickup devices, each including means for capturing an original image and viewpoint conversion means for performing viewpoint conversion for the original image to generate a converted image;

image processing means for synthesizing converted images output from the plural image pickup devices to generate a synthesized image; and

display means for selectively displaying the synthesized image and at least one original image output from the plural image pickup devices.

12. The system according to claim 11 wherein each of the plural image pickup devices further comprises:

means for rotating the converted image generated by the viewpoint conversion means to match an orientation in the synthesized image.

13. The system according to claim 11 wherein each of the image pickup devices further comprises:

second viewpoint conversion means for performing viewpoint conversion of the original image to generate a second converted image; and

means for sequentially outputting respective original images, converted images and second converted images to the image processor.

14. The system according to claim 13 wherein the sequentially outputting means comprises:

means for storing six images; and

wherein a ratio of write speed to read speed relative to the storage means is 1;

3.

15. An image processing method, comprising:

capturing original images using respective image pickup devices;

subjecting the original images to viewpoint conversion to form respective converted images in the respective image pickup devices;

outputting the original images and the respective converted images from the respective image pickup devices to an image processor;

synthesizing the respective converted images output from the respective image pickup devices to form a synthesized image; and

selectively displaying the synthesized image and at least one of the original images.

16. The method according to claim 15, further comprising:

rotating at least one of the respective converted images using at least one of the respective image pickup devices to match an orientation in the synthesized image.

17. The method according to claim 15 wherein outputting the original images and the respective converted images from the respective image pickup devices to the image processor further comprises:

alternately outputting the original images and the respective converted images.

18. The method according to claim 17, further comprising:

alternately storing the original images and the respective converted images in a storage part with at least a 4-image storage capacity; and

wherein a ratio of write speed to read speed relative to the storage part is 1;

2.

19. The method according to claim 17, further comprising:

performing viewpoint conversion of the original images to generate respective second converted images; and

wherein outputting the original images and the respective converted images from the respective image pickup devices to the image processor further comprises;

sequentially outputting the original images, the respective converted images and the respective second converted images to the image processor.

20. An image processing method, comprising:

capturing original images using image pickup devices;

subjecting the original images to viewpoint conversion to produce visible images; and

displaying the visible images on a display device.