VISION SYSTEM FOR VEHICLE

• US 20180020192A1
• Filed: 08/14/2017
• Published: 01/18/2018
• Est. Priority Date: 04/15/2004
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Schofield, Kenneth, Lynam, Niall R.
• Granted Patent: US 9,948,904 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/148 Instrument input by voice
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/27 using semi-transparent optical elements
• CPC Class Codes: B60K 2360/331 Electroluminescent elements
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 2360/34 Backlit symbols
• CPC Class Codes: B60K 2360/589 Wireless data transfers
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60K 35/85 Arrangements for transferring vehicle- or driver-related data
• CPC Class Codes: B60Q 1/08 automatically
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/001 integrated in the windows, e.g. Fresnel lenses
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/24 : in front of the vehicle
• CPC Class Codes: B60R 1/26 : to the rear of the vehicle
• CPC Class Codes: B60R 11/04 : Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1215 : with information displays
• CPC Class Codes: B60R 2001/1253 : with cameras, video cameras or video screens
• CPC Class Codes: B60R 2011/0026 : Windows, e.g. windscreen
• CPC Class Codes: B60R 2300/205 : using a head-up display
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/30 : characterised by the type of image processing
• CPC Class Codes: B60R 2300/301 : combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/302 : combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/804 : for lane monitoring
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: B60W 2050/143 : Alarm means
• CPC Class Codes: B60W 2050/146 : Display means
• CPC Class Codes: B60W 30/143 : Speed control B60W30/16 takes precedence
• CPC Class Codes: B60W 30/18 : Propelling the vehicle
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B60W 50/16 : Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 10/147 : Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/582 : of traffic signs
• CPC Class Codes: G06V 20/584 : of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/54 : Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A vision system for a vehicle includes a forward viewing camera. Responsive at least in part to processing by an image processor of image data captured by the forward viewing camera, at least one road characteristic of a road along which the vehicle is traveling is detected. Responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, other vehicles exterior the equipped vehicle are detected. Responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, road curvature of the road along which the vehicle is traveling is determined. Data derived from image data captured by the forward viewing camera may be wirelessly communicated from the vehicle to a remote data receiver located remote from the vehicle.

Claims

1. A vision system for a vehicle, said vision system comprising:

a forward viewing camera disposed at a windshield of a vehicle equipped with said vision system;

wherein said forward viewing camera views forward through the windshield of the equipped vehicle and is operable to capture image data;

said forward viewing camera comprising an imaging array sensor and a lens;

an image processor operable to process image data captured by said forward viewing camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, at least one road characteristic of a road along which the equipped vehicle is traveling is detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, other vehicles exterior the equipped vehicle are detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, road curvature of the road along which the equipped vehicle is traveling is determined; and

wherein data derived from image data captured by said forward viewing camera is wirelessly communicated from the equipped vehicle to a remote data receiver located remote from the equipped vehicle.

2. The vision system of claim 1, wherein said at least one road characteristic comprises a curb.

3. The vision system of claim 2, wherein said at least one road characteristic comprises a road shoulder.

4. The vision system of claim 1, wherein data derived from captured image data received from the equipped vehicle is processed at said remote data receiver to extract information relevant to the geographic location at which the equipped vehicle is located when wirelessly transmitting the data to said remote data receiver.

5. The vision system of claim 4, wherein said remote data receiver receives location data from other vehicles.

6. The vision system of claim 5, wherein, based at least in part on received location data, movement of other vehicles relative to the equipped vehicle is determined.

7. The vision system of claim 6, wherein, responsive at least in part to said determination of movement of other vehicles relative to the equipped vehicle, said remote data receiver communicates to the equipped vehicle that another vehicle is approaching the equipped vehicle from a direction opposite to the direction of travel of the equipped vehicle.

8. The vision system of claim 7, wherein, responsive at least in part to said determination of movement of other vehicles relative to the equipped vehicle, a speed control system of the equipped vehicle is controlled.

9. The vision system of claim 8, wherein said speed control system comprises an adaptive cruise control system of the equipped vehicle.

10. The vision system of claim 6, wherein, responsive at least in part to said determination of movement of other vehicles relative to the equipped vehicle, a lighting system of the equipped vehicle is controlled.

11. The vision system of claim 6, wherein, responsive at least in part to said determination of movement of other vehicles relative to the equipped vehicle, a speed control system of the equipped vehicle is dynamically controlled.

12. The vision system of claim 1, wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, speed of the equipped vehicle is reduced responsive to approach by the equipped vehicle to a road curve of the road along which the equipped vehicle is traveling.

13. The vision system of claim 12, wherein, upon the equipped vehicle having traveled around the curve, speed of the equipped vehicle automatically increases.

14. The vision system of claim 1, wherein the road along which the equipped vehicle is traveling comprises a freeway, and wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera detecting an exit sign announcing an exit ramp ahead off the freeway the equipped vehicle is traveling on, at least one of (i) speed of the equipped vehicle and (ii) acceleration of the equipped vehicle is adjusted so that the equipped vehicle enters the exit ramp at a safe speed.

15. The vision system of claim 1, wherein the road along which the equipped vehicle is traveling comprises a freeway, and wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera detecting an exit sign announcing an exit ramp ahead off the freeway the equipped vehicle is traveling on and responsive at least in part to determining characters on the detected exit sign, a driver of the equipped vehicle is alerted that a desired exit ramp off the freeway is ahead.

16. The vision system of claim 15, wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, characters on the detected exit sign are determined.

17. A vision system for a vehicle, said vision system comprising:

a forward viewing camera disposed at a windshield of a vehicle equipped with said vision system;

wherein said forward viewing camera views forward through the windshield of the equipped vehicle and is operable to capture image data;

said forward viewing camera comprising an imaging array sensor and a lens;

an image processor operable to process image data captured by said forward viewing camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, at least one road characteristic of a road along which the equipped vehicle is traveling is detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, other vehicles exterior the equipped vehicle are detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, road curvature of the road along which the equipped vehicle is traveling is determined;

wherein the road along which the equipped vehicle is traveling comprises a freeway; and

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera detecting an exit sign announcing an exit ramp ahead off the freeway the equipped vehicle is traveling on, speed of the equipped vehicle is adjusted so that the equipped vehicle enters the exit ramp at a safe speed.

18. The vision system of claim 17, wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, characters on the detected exit sign are determined.

19. The vision system of claim 18, wherein, responsive to determination of characters on the detected exit sign by processing by said image processor of captured image data, a driver of the equipped vehicle is alerted that a desired exit ramp off the freeway is ahead.

20. The vision system of claim 17, wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera detecting the exit sign announcing an exit ramp ahead off the freeway the equipped vehicle is traveling on, speed of the equipped vehicle and acceleration of the equipped vehicle are adjusted so that the equipped vehicle enters the exit ramp at a safe speed.

21. The vision system of claim 17, wherein data derived from image data captured by said forward viewing camera is wirelessly communicated from the equipped vehicle to a remote data receiver located remote from the equipped vehicle, and wherein data derived from captured image data received from the equipped vehicle is processed at said remote data receiver to extract information relevant to the geographic location at which the equipped vehicle is located when wirelessly transmitting the data to said remote data receiver.

22. The vision system of claim 21, wherein said remote data receiver receives location data from other vehicles, and wherein, based at least in part on received location data, movement of other vehicles relative to the equipped vehicle is determined.

23. The vision system of claim 22, wherein, responsive at least in part to said determination of movement of other vehicles relative to the equipped vehicle, a speed control system of the equipped vehicle is controlled.

24. The vision system of claim 23, wherein said speed control system of the equipped vehicle is dynamically controlled.

25. The vision system of claim 24, wherein said speed control system comprises an adaptive cruise control system of the equipped vehicle.

26. The vision system of claim 24, wherein said at least one road characteristic comprises a road shoulder.

27. A vision system for a vehicle, said vision system comprising:

a forward viewing camera disposed at a windshield of a vehicle equipped with said vision system;

wherein said forward viewing camera views forward through the windshield of the equipped vehicle and is operable to capture image data;

said forward viewing camera comprising an imaging array sensor and a lens;

an image processor operable to process image data captured by said forward viewing camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, at least one road characteristic of a road along which the equipped vehicle is traveling is detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, other vehicles exterior the equipped vehicle are detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, road curvature of the road along which the equipped vehicle is traveling is determined; and

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, speed of the equipped vehicle is reduced responsive to approach by the equipped vehicle to a road curve of the road along which the equipped vehicle is traveling.

28. The vision system of claim 27, wherein the road along which the equipped vehicle is traveling comprises a freeway, and wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera detecting an exit sign announcing an exit ramp ahead off the freeway the equipped vehicle is traveling on, speed of the equipped vehicle is adjusted so that the equipped vehicle enters the exit ramp at a safe speed, and wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, characters on the detected exit sign are determined.

29. The vision system of claim 28, wherein, responsive to determination of characters on the detected exit sign by processing by said image processor of captured image data, a driver of the equipped vehicle is alerted that a desired exit ramp off the freeway is ahead.

30. The vision system of claim 28, wherein, responsive to determination of characters on the detected exit sign by processing by said image processor of captured image data, speed of the equipped vehicle and acceleration of the equipped vehicle are adjusted so that the equipped vehicle enters the exit ramp at a safe speed.

31. The vision system of claim 27, wherein data derived from image data captured by said forward viewing camera is wirelessly communicated from the equipped vehicle to a remote data receiver located remote from the equipped vehicle, and wherein data derived from captured image data received from the equipped vehicle is processed at said remote data receiver to extract information relevant to the geographic location at which the equipped vehicle is located when wirelessly transmitting the data to said remote data receiver.

32. The vision system of claim 31, wherein said remote data receiver receives location data from other vehicles, and wherein, based at least in part on received location data, movement of other vehicles relative to the equipped vehicle is determined.

33. The vision system of claim 32, wherein, responsive at least in part to said determination of movement of other vehicles relative to the equipped vehicle, a speed control system of the equipped vehicle is controlled.

34. The vision system of claim 33, wherein said speed control system of the equipped vehicle is dynamically controlled.

35. The vision system of claim 27, wherein said at least one road characteristic comprises a curb.

36. The vision system of claim 27, wherein said at least one road characteristic comprises a road shoulder.