Image Pickup Device and Image Pickup Method

• US 20080143833A1
• Filed: 11/23/2005
• Published: 06/19/2008
• Est. Priority Date: 11/26/2004
• Status: Abandoned Application

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Oizumi, Ken, Yanai, Tatsumi
• Application Number:
  US10/574,131
• Publication Number:
  US 20080143833A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/101 using cameras with adjustable capturing direction
• CPC Class Codes: B60R 2300/102 using 360 degree surveillance camera system
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/404 triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8093 for obstacle warning

Abstract

To provide an image pickup device and image pickup method for displaying the optimum range of observation without relying on the conditions in which the vehicle enters the road or the installation situation of the plurality of cameras. To provide a plurality of periphery image pickup means 10 and 11 that obtain images of the periphery of a vehicle wherein periphery image pickup means 10 and 11 that obtain the images displayed for the driver of the vehicle and the image range of the images obtained by periphery image pickup means 10 and 11 that are displayed to the driver of the vehicle are selected.

Claims

1. An image pickup method, comprising:

picking up images of the periphery of said vehicle using a plurality of cameras;

acquiring a global position of said vehicle;

acquiring a global direction of said vehicle;

acquiring a road information of the periphery of said vehicle;

selecting the images for said camera to be used based on the position of each camera on said vehicle, said global position, said global direction and said road information and

displaying the selected image or plurality of images to the driver of said vehicle.

2. The image pickup method described in claim 1, and further comprising:

detecting a display starting point to begin displaying said images picked up by said plurality of cameras to the driver of said vehicle;

detecting conditions in which said vehicle enters said road at said display starting point;

adjusting said displayed image range in accordance with said detected conditions; and

displaying said adjusted image range.

3. The image pickup method described in claim 2, wherein said entry conditions are the entry direction, entry angle and position of said vehicle in relation to the extended direction of said road.

4. The image pickup method described in claim 2, wherein said plurality of cameras comprises side cameras disposed on both sides of said vehicle and a front camera disposed at the front of said vehicle, and further comprising:

displaying the image picked up by said front camera first when said vehicle enters the road in a forward-moving direction; and

displaying the image picked up by said side camera when an image of one side of said road cannot be picked up by said front camera.

5. The image pickup method described in claim 2, and further comprising:

creating and displaying a composite image of the plurality of images when said plurality of images picked up by said plurality of cameras include an overlapping portion in said image range.

6. The image pickup method described in claim 2, wherein said plurality of cameras comprises side cameras disposed on both sides of said vehicle and a rear camera disposed at the rear of said vehicle, and further comprising:

creating and displaying a composite image of the image picked up by said side cameras and the image picked up by said rear camera when said vehicle enters the road in a reverse direction.

7. The image pickup method described in claim 1, and further comprising:

selecting one or more cameras in accordance with said entry conditions that are present while said vehicle is in the process of entering said road as well as after said vehicle has entered said road.

8. The image pickup method described in claim 7, and further comprising:

selecting the images for the selected cameras based on the straight-line distance between each camera on said vehicle and the road, the target range that is determined from the relationship between said vehicle and the road and the image pickup range for each camera on the said vehicle.

9. The image pickup method described in claim 8, and further comprising:

setting a priority for each camera so that the camera at the shortest distance has the highest priority.

10. The image pickup method described in claim 7, and further comprising:

determining a positional relationship for the display with consideration made to the positional relationship of the selected one or more cameras.

11. An image pickup device to obtain the periphery of a vehicle, comprising:

a plurality of cameras to pick up images of the periphery of said vehicle;

a starting point detection portion to detect the display starting point to begin displaying said images picked up by said plurality of cameras to the driver of said vehicle;

an entry conditions detecting portion to detect the conditions in which said vehicle enters said road at said display starting point that is detected by said starting point detecting means;

an image range adjusting portion to adjust said displayed image range in accordance with said entry conditions detected by said entry condition detecting means; and

a display to display said image range that is adjusted by said image range adjusting means.

12. The image pickup device described in claim 11, wherein said entry conditions are the entry direction, entry angle and position of said vehicle in relation to the extended direction of said road.

13. The image pickup device described in claim 11, wherein said plurality of cameras comprises side cameras disposed on both sides of said vehicle and a front camera disposed at the front of said vehicle and when said vehicle enters the road in a forward-moving direction, first the image picked up by said front camera is displayed and if an image of one side of said road cannot be picked up by said front camera, then the image picked up by said side camera is displayed.

14. The image pickup device described in claim 12, wherein said plurality of cameras comprises side cameras disposed on both sides of said vehicle and a front camera disposed at the front of said vehicle and when said vehicle enters the road in a forward-moving direction, first the image picked up by said front camera is displayed and if an image of one side of said road cannot be picked up by said front camera, then the image picked up by said side camera is displayed.

15. The image pickup device described in claim 11 wherein when said plurality of images picked up by said plurality of cameras include an overlapping portion in said image range adjusted by said image range adjusting portion, said display creates and displays a composite image of said plurality of images.

16. The image pickup device described in claim 12 wherein when said plurality of images picked up by said plurality of cameras include an overlapping portion in said image range adjusted by said image range adjusting portion, and said display creates and displays a composite image of said plurality of images.

17. The image pickup device described in claim 13 wherein when said plurality of images picked up by said plurality of cameras include an overlapping portion in said image range adjusted by said image range adjusting portion, and said display creates and displays a composite image of said plurality of images.

18. The image pickup device described in claim 14 wherein when said plurality of images picked up by said plurality of cameras include an overlapping portion in said image range adjusted by said image range adjusting portion, and said display creates and displays a composite image of said plurality of images.

19. The image pickup device described in claim 15 wherein said plurality of cameras comprises side cameras disposed on both sides of said vehicle and a rear camera disposed at the rear of said vehicle and when said vehicle enters the road in a reverse direction said display creates and displays a composite image of the image picked up by said side cameras and the image picked up by said rear camera.

20. The image pickup device described in claim 11 wherein said periphery image pickup devices that obtain said images to display to the driver of said vehicle and the image range of the images obtained by the periphery image pickup devices that are displayed to the driver of the vehicle are selected in accordance with said entry conditions that are present while said vehicle is in the process of entering said road as well as after said vehicle has entered said road.

21. The image pickup device described in claim 11, and further comprising:

a vehicle position acquiring portion for acquiring the global position of said vehicle;

a vehicle direction acquiring portion for acquiring the global direction of said vehicle;

a road information acquiring portion for acquiring road information for the periphery of said vehicle; and

an image selecting portion for selecting the images for said camera to be used based on the position of each camera on said vehicle, said global position, said global direction and said road information.

22. The image pickup device described in claim 21 wherein said image selecting portion selects the images for said cameras based on the straight-line distance between each camera on said vehicle and the road, the target range that is determined from the relationship between said vehicle and the road and the image pickup range for each camera on the said vehicle.

23. The image pickup device described in claim 22 wherein for said image selecting portion, the priority is set for each camera so that the camera at the shortest distance has the highest priority.

24. The image pickup device described in claim 23 wherein each of said target range and said image pickup range are only represented as an angle.

25. The image pickup device described in claim 21 wherein said display determines the positional relationship for the display with consideration made to the positional relationship of the original camera when displaying images selected by said image selecting portion.

26. The image pickup device described in claim 22 wherein said display determines the positional relationship for the display with consideration made to the positional relationship of the original camera when displaying images selected by said image selecting portion.

27. The image pickup device described in claim 23 wherein said display determines the positional relationship for the display with consideration made to the positional relationship of the original camera when displaying images selected by said image selecting portion.

28. The image pickup device described in claim 24 wherein said display determines the positional relationship for the display with consideration made to the positional relationship of the original camera when displaying images selected by said image selecting portion.