Vehicle vision system utilizing camera synchronization

• US 9,481,301 B2
• Filed: 12/05/2013
• Issued: 11/01/2016
• Est. Priority Date: 12/05/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Schaffner, Michael
• Primary Examiner(s): Bailey, Frederick
• Assistant Examiner(s): Nawaz, Talha M
• Application Number:
  US14/097,581
• Publication Number:
  US 20140160291A1
• Time in Patent Office: 1,062 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2300/00 Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicular vision system includes an image sensor and an image processor. The image sensor is disposed at a vehicle and has an exterior field of view. The image sensor is operable to capture image data. The image processor is operable to process captured image data. The vision system is operable to automatically synchronize the image sensor to an ECU reference timing. The vision system may power on the image sensor synchronous to the ECU reference timing, and the vision system may regulate the timing of the image sensor synchronous to the ECU reference timing. The vision system may regulate the timing of the image sensor between a fast mode and a slow mode to synchronize the timing of the image sensor to the ECU reference timing.

Claims

1. A vehicular vision system, said vehicular vision system comprising:

an image sensor disposed at a vehicle and having an exterior field of view, wherein said image sensor is operable to capture image data;

an image processor operable to process captured image data;

an electronic control unit (ECU);

wherein said vision system is operable to automatically synchronize said image sensor to reference timing of said ECU;

wherein said vision system regulates said image sensor between a fast mode and a slow mode, and wherein said vision system regulates said image sensor between said fast mode and said slow mode depending on whether a maximum buffer level achieved during processing of captured image data by said image processor exceeds a selected maximum buffer threshold; and

wherein said vision system switches the timing of said image sensor to the slow mode when the maximum buffer level is greater than the selected maximum buffer threshold, and wherein said vision system switches the timing of said image sensor to the fast mode when the minimum buffer level is below the selected minimum buffer threshold.

2. The vehicular vision system of claim 1, wherein said vision system is operable to power on said image sensor synchronous to the reference timing of said ECU.

3. The vehicular vision system of claim 1, wherein said vision system is operable to regulate the timing of said image sensor synchronous to the reference timing of said ECU.

4. The vehicular vision system of claim 3, wherein said vision system regulates the timing of said image sensor between the fast mode and the slow mode to synchronize the timing of said image sensor to the reference timing of said ECU.

5. The vehicular vision system of claim 1, comprising a plurality of image sensors.

6. The vehicular vision system of claim 5, wherein each of said plurality of image sensors is synchronized automatically and independently via a respective control signal to the reference timing of said ECU.

7. The vehicular vision system of claim 5, comprising a hub in the path of image data captured by at least some of said plurality of image sensors to said ECU.

8. The vehicular vision system of claim 7, wherein each of said at least some of said plurality of image sensors is synchronized automatically and independently via a respective control signal to a hub reference timing.

9. A vehicular vision system, said vehicular vision system comprising:

an image sensor disposed at a vehicle and having an exterior field of view, wherein said image sensor is operable to capture image data;

an image processor operable to process captured image data;

an electronic control unit (ECU);

wherein said vision system is operable to automatically synchronize said image sensor to reference timing of said ECU;

wherein said vision system is operable to power on said image sensor synchronous to the ECU reference timing;

wherein said vision system is operable to regulate the timing of said image sensor synchronous to the reference timing of said ECU;

wherein said vision system regulates said image sensor between a fast mode and a slow mode, and wherein said vision system regulates said image sensor between said fast mode and said slow mode depending on whether a maximum buffer level achieved during processing of captured image data by said image processor exceeds a selected maximum buffer threshold; and

wherein said vision system switches the timing of said image sensor to the slow mode when the maximum buffer level is greater than the selected maximum buffer threshold, and wherein said vision system switches the timing of said image sensor to the fast mode when the minimum buffer level is below the selected minimum buffer threshold.

10. The vehicular vision system of claim 9, wherein said vision system regulates the timing of said image sensor between the fast mode and the slow mode to synchronize the timing of said image sensor to the reference timing of said ECU.

11. The vehicular vision system of claim 9, comprising a plurality of image sensors, and wherein each of said plurality of image sensors is synchronized automatically and independently via a respective control signal to the reference timing of said ECU.

12. A vehicular vision system, said vehicular vision system comprising:

a plurality of image sensors disposed at a vehicle and having respective exterior fields of view;

wherein said plurality of image sensors comprises at least one first image sensor that interfaces directly with an electronic control unit (ECU);

wherein said plurality of image sensors comprises second image sensors that interface with a hub disposed in the path of captured image data captured from said second image sensors to said ECU;

wherein said first and second image sensors are operable to capture image data;

an image processor operable to process captured image data;

wherein said vision system is operable to automatically synchronize said first and second image sensors to reference timing of said ECU;

wherein said at least one first image sensor is synchronized automatically and independently via a respective control signal for each said at least one first image sensor to the reference timing of said ECU;

wherein said second image sensors are synchronized automatically and independently via a respective control signal for each said second image sensors to a hub reference timing;

wherein said vision system regulates said image sensor between a fast mode and a slow mode, and wherein said vision system regulates said image sensor between said fast mode and said slow mode depending on whether a maximum buffer level achieved during processing of captured image data by said image processor exceeds a selected maximum buffer threshold and whether a minimum buffer level achieved during processing of captured image data by said image processor is below a selected minimum buffer threshold; and

wherein said vision system switches the timing of said image sensor to the slow mode when the maximum buffer level is greater than the selected maximum buffer threshold, and wherein said vision system switches the timing of said image sensor to the fast mode when the minimum buffer level is below the selected minimum buffer threshold.

13. The vehicular vision system of claim 12, wherein said vision system is operable to power on said image sensors synchronous to the reference timing of said ECU, and wherein said vision system is operable to regulate the timing of said image sensors synchronous to the reference timing of said ECU.

14. The vehicular vision system of claim 13, wherein said vision system regulates the timing of each image sensor between the fast mode and the slow mode to synchronize the timing of said image sensor to the reference timing of said ECU.