Vehicle imaging system with stereo imaging

• US 20050083184A1
• Filed: 11/09/2004
• Published: 04/21/2005
• Est. Priority Date: 02/26/1993
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Schofield, Kenneth, Bos, Brent J.
• Granted Patent: US 7,227,459 B2
• Time in Patent Office: Days
• US Class Current: 340/435
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60Q 1/143 combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/31 providing stereoscopic vision
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2011/0003 inside the vehicle
• CPC Class Codes: B60R 2011/0026 Windows, e.g. windscreen
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/107 using stereoscopic cameras
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/305 merging camera image with lines or icons
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: G01B 11/026 by measuring distance between sensor and object G01B11/0608 takes precedence
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30252 : Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/593 : from stereo images
• CPC Class Codes: G06T 7/97 : Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: G06V 20/584 : of vehicle lights or traffic lights
• CPC Class Codes: H04N 13/239 : using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 25/00 : Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A vehicle imaging system includes an imaging array sensor having a field of view directed outwardly from the vehicle and toward an external scene, first and second optic elements, and a control responsive to an output of the imaging array sensor. The imaging array sensor has at least first and second portions, with the first optic element positioned along a first optic path between the first portion of the imaging array sensor and the external scene, and the second optic element positioned along a second optic path between the second portion of the imaging array sensor and the external scene. The control processes the output and distinguishes the first image and the second image in order to identify objects of interest in the external scene. The control generates a control output in response to the processing.

Claims

1-98. -98. (canceled)

99. A vehicular imaging system suitable for use in a vehicle, said vehicular imaging system comprising:

an imaging array sensor having a field of view directed outwardly from the vehicle and toward an external scene, said imaging array sensor having at least a first portion and a second portion, said first portion capturing a first image of the external scene and said second portion capturing a second image of the external scene;

a first optic element and a second optic element, said first optic element positioned along a first optic path between said first portion of said imaging array sensor and the external scene, said second optic element positioned along a second optic path between said second portion of said imaging array sensor and the external scene; and

a control responsive to an output of said imaging array sensor, said control processing said output and distinguishing said first image and said second image in order to identify objects of interest in the external scene, said control generating a control output in response to said processing.

100. The imaging system of claim 99, wherein said control comprises at least one of a headlamp control, a reverse aid imaging system control and a rain sensor control.

101. The imaging system of claim 99, wherein said control comprises a headlamp control.

102. The imaging system of claim 101, wherein said control adjusts a headlamp setting in response to said processing.

103. The imaging system of claim 102, wherein said imaging array sensor has a forward field of view.

104. The imaging system of claim 103, wherein said imaging array sensor has a forward field of view through the windshield of the vehicle.

105. The imaging system of claim 99, wherein said control comprises a reverse aid imaging system.

106. The imaging system of claim 105, wherein said control controls at least one of a display, an alert device and said imaging array sensor in response to said processing.

107. The imaging system of claim 106, wherein said imaging array sensor has a rearward field of view toward an external scene rearward of the vehicle.

108. The imaging system of claim 99, wherein said control comprises a rain sensor control.

109. The imaging system of claim 108, wherein said control controls at least one of a windshield wiper of the vehicle and a blower motor of a heating, ventilation and air conditioning system of the vehicle in response to said processing.

110. The imaging system of claim 99, wherein said control is operable to control at least one accessory of the vehicle in response to said processing.

111. The imaging system of claim 110, wherein said at least one accessory comprises at least one of a display system of the vehicle, a warning indicator of the vehicle, a signaling device of the vehicle, a collision avoidance system of the vehicle, a brake system of the vehicle, a headlamp of the vehicle, a windshield wiper of the vehicle, and a blower motor of a heating, ventilation and air conditioning system of the vehicle.

112. The imaging system of claim 110, wherein said at least one accessory comprises a display system of the vehicle.

113. The imaging system of claim 112, wherein said control is operable to adjust a display of said display system in response to a distance to a closest object of interest.

114. The imaging system of claim 113, wherein said control is operable to adjust said display to display the distance to the closest object of interest.

115. The imaging system of claim 113, wherein said control is operable to adjust said display of said display system in response to at least one of a classification of the closest object of interest, an intensity of the closest object of interest, a size of the closest object of interest, and a position of the closest object of interest.

116. The imaging system of claim 99, wherein said imaging array sensor comprises at least one pixelated imaging array sensor comprising a plurality of pixels.

117. The imaging system of claim 99, wherein said first optic has a first focal length and said second optic has a second focal length.

118. The imaging system of claim 117, wherein said control generates said control output as a function of said first and second focal lengths.

119. The imaging system of claim 99, wherein said control is operable to determine a distance and angle to a detected object of interest.