Vehicular video system

• US 7,697,027 B2
• Filed: 07/31/2002
• Issued: 04/13/2010
• Est. Priority Date: 07/31/2001
• Status: Expired due to Term

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Cooprider, Troy O., McMahon, Martha A.
• Primary Examiner(s): Kelley; Christopher
• Assistant Examiner(s): Shepard; Justin E
• Application Number:
  US10/209,181
• Publication Number:
  US 20030025793A1
• Time in Patent Office: 2,813 Days
• Field of Search: 348/148, 701/25, 340/937
• US Class Current: 348/148
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60Q 1/08 automatically
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 16/023 for transmission of signals between vehicle parts or subsystems
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/304 using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60W 30/143 Speed control B60W30/16 takes precedence
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G05D 1/00 Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots drive control systems specially adapted for autonomous road vehicles B60W60/00
• CPC Class Codes: G05D 1/0033 by having the operator tracking the vehicle either by direct line of sight or via one or more cameras located remotely from the vehicle
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A vehicle-based video system includes a video processor, a plurality of electronic sensor interfaces that are operable to receive image output data from a plurality of sensor devices and at least one electronic vehicle interface that is operable to communicate with a vehicle communication bus. The video processor generates display signals for displaying video information for viewing and use by a driver in the vehicle for normal operation of the vehicle by the driver. The video processor is operable to fuse data from at least one imaging device and at least one non-imaging device into a single database in a standard format. The video processor, in response to processing the fused data, provides at least one output signal for conveying information to a driver in the vehicle that is used by the driver in the vehicle when the vehicle is being driven by the driver in the vehicle.

Claims

1. A vehicle-based video system of a vehicle, said video system comprising:

a video processor;

a plurality of sensing devices, said plurality of sensing devices comprising at least one imaging device and at least one non-imaging device;

a plurality of electronic sensor interfaces operable to receive output data from said plurality of sensing devices;

at least one electronic vehicle interface operable to communicate with a vehicle communication bus;

said video processor generating display signals for displaying video information for viewing and use by a driver in the vehicle for operation of the vehicle when the driver is normally operating the vehicle in the vehicle;

a video display screen responsive to said display signals of said video processor;

said video processor comprising at least one of a diagnostics section for performing diagnostics and an object-tracking section for tracking detected objects; and

wherein said video processor is operable to fuse data from said at least one imaging device and said at least one non-imaging device into a single database in a standard format, said video processor further processing said single database to at least one of (i) merge images from at least two imaging devices for displaying merged images on said video display screen for viewing and use by the driver in the vehicle when the vehicle is normally operated and is being driven by the driver in the vehicle, (ii) reduce distortion created by a wide-angle lens for displaying information with reduced distortion on said video display screen for viewing and use by the driver in the vehicle when the vehicle is normally operated and is being driven by the driver in the vehicle, and (iii) superimpose a graphical overlay on a display image for displaying information with a graphical overlay superimposed thereon on said video display screen for viewing and use by the driver in the vehicle when the vehicle is normally operated and is being driven by the driver in the vehicle; and

said video processor providing at least one output signal in response to processing said fused data of said single database, said at least one output signal comprising at least an output signal for conveying information to a driver in the vehicle that is used by the driver in the vehicle when the vehicle is being driven by the driver in the vehicle.

2. The video system of claim 1 wherein said at least one non-imaging device includes at least one chosen from a radar sensor, a sonar sensor, a thermal sensor, a near infrared sensor and a far infrared sensor.

3. The video system of claim 1 wherein said at least one imaging device is chosen from a rear-facing camera, a front-facing camera, a side-facing camera and an internal-facing cabin camera.

4. The video system of claim 1 wherein said electronic sensor interfaces include at least one wired interface.

5. The video system of claim 4 wherein said at least one wired interface is chosen from one of a firewire transceiver and an NTSC transceiver.

6. The video system of claim 1 wherein said electronic sensor interfaces include at least one wireless interface.

7. The video system of claim 6 wherein said at least one wireless interface is operable to communicate with a restricted-range radio-frequency communication device.

8. The video system of claim 7 wherein said restricted-range radio-frequency communication device is housed at an interior mirror.

9. The video system of claim 7 wherein said restricted-range radio-frequency communication device is housed at one of an overhead console and an instrument panel.

10. The video system of claim 7 wherein said restricted-range radio-frequency communication device is operable to program radio-frequency devices within said vehicle.

11. The video system of claim 7 wherein said restricted-range radio-frequency communication device is operable to receive user selection of vehicle parameters.

12. The video system of claim 11 wherein said vehicle parameter includes at least one chosen from a garage door opener code, memory seat position, memory mirror position and exterior mirror position.

13. The video system of claim 7 wherein said restricted-range radio-frequency device comprises a personal display assistant device.

14. The video system of claim 1 wherein said video processor provides detection of other vehicles adjacent said vehicle.

15. The video system of claim 1 wherein said video processor provides detection of an edge of a lane on a road.

16. The video system of claim 1 wherein said video processor provides adaptive speed control of said vehicle.

17. The video system of claim 1 wherein said video processor provides reverse aid warning.

18. The video system of claim 1 wherein said video processor establishes ambient light sensing.

19. The video system of claim 1 wherein said video processor detects other vehicles and controls a state of headlamps of said vehicle.

20. The video system of claim 1 wherein said video processor detects at least one chosen from presence, position and size of occupants inside a cabin of said vehicle.

21. A vehicle-based video system of a vehicle, said video system comprising:

a video processor;

a plurality of sensing devices, said plurality of sensing devices comprising at least one imaging device and at least one non-imaging device;

a plurality of electronic sensor interfaces operable to receive output data from said plurality of sensing devices;

at least one electronic vehicle interface operable to communicate with a vehicle communication bus;

said video processor generating display signals for displaying video information for viewing and use by a driver in the vehicle when the driver is normally operating the vehicle in the vehicle;

a video display screen responsive to said display signals of said video processor;

said video processor comprising at least one of a diagnostics section for performing diagnostics and an object tracking section for tracking detected objects; and

wherein said video processor is operable to fuse data from said plurality of sensing devices into a single database in a standard format, said video processor being operable to further process said single database to at least one of (i) merge images from at least two imaging devices for displaying merged images on said video display screen for viewing and use by the driver in the vehicle when the vehicle is normally operated and is being driven by the driver in the vehicle, (ii) reduce distortion for displaying information with reduced distortion on said video display screen for viewing and use by the driver in the vehicle when the vehicle is normally operated and is being driven by the driver in the vehicle, and (iii) superimpose a graphical overlay on a display image for displaying information with a graphical overlay superimposed thereon on said video display screen for viewing and use by the driver in the vehicle when the vehicle is normally operated and is being driven by the driver in the vehicle; and

said video processor being operable to process said fused output data to extract information from said fused data, said video processor providing at least one output signal in response to said processing of said fused data, said at least one output signal comprising at least an output signal for conveying information to a driver in the vehicle when the vehicle is being driven by the driver in the vehicle.

22. The video system of claim 21 wherein said video processor is operable to enhance said output data to compensate for low visibility conditions.

23. The video system of claim 21 wherein said non-imaging device includes at least one chosen from a radar sensor, a sonar sensor, a thermal sensor, a near infrared sensor and a far infrared sensor.

24. The video system of claim 23 wherein said video processor is operable to enhance said output data to compensate for low visibility conditions.

25. The video system of claim 21 wherein said at least one imaging device is chosen from a rear-facing camera, a front-facing camera, a side-facing camera and an interior-facing cabin camera.

26. The video system of claim 21 wherein said electronic sensor interfaces include at least one wired interface.

27. The video system of claim 26 wherein said at least one wired interface is chosen from one of a firewire transceiver and an NTSC transceiver.

28. The video system of claim 21 wherein said electronic sensor interfaces include at least one wireless interface.

29. The video system of claim 28 wherein said at least one wireless interface is operable to communicate with a restricted-range radio-frequency communication device.

30. The video system of claim 29 wherein said restricted-range radio-frequency communication device is housed at an interior mirror housing.

31. The video system of claim 29 wherein said restricted-range radio-frequency communication device is housed at one of an overhead console and an instrument panel.

32. The video system of claim 29 wherein said restricted-range radio-frequency communication device is operable to program radio-frequency devices within said vehicle.

33. The video system of claim 29 wherein said restricted-range radio-frequency communication device is operable to receive user selection of vehicle parameters.

34. The video system of claim 33 wherein said vehicle parameter includes at least one chosen from a garage door opener code, memory seat position, memory mirror position and exterior mirror position.

35. The video system of claim 29 wherein said restricted-range radio-frequency device comprises a personal display assistant device.

36. The video system of claim 21 wherein said video processor provides detection of other vehicles adjacent said vehicle.

37. The video system of claim 21 wherein said video processor provides detection of an edge of a lane on a road.

38. The video system of claim 21 wherein said video processor provides adaptive speed control of said vehicle.

39. The video system of claim 21 wherein said video processor provides reverse aid warning.

40. The video system of claim 21 wherein said video processor establishes ambient light sensing.

41. The video system of claim 21 wherein said video processor detects other vehicles and controls a state of headlamps of said vehicle.

42. The video system of claim 21 wherein said video processor detects at least one chosen from presence, position and size of occupants inside a cabin of said vehicle.