Integrated video/data information system and method for application to commercial vehicles to enhance driver awareness

• US 20030222982A1
• Filed: 03/20/2003
• Published: 12/04/2003
• Est. Priority Date: 03/28/2002
• Status: Abandoned Application

• Current Assignee: Bendix Commercial Vehicle Systems LLC (Estate of Heinz Hermann Thiele)
• Original Assignee: Bendix Commercial Vehicle Systems LLC (Estate of Heinz Hermann Thiele)
• Inventors: Grolle, Ken A., Losh, Dennis M., Waltz, Mark W., Hamdan, Majil M., Pfefferl, David J.
• Application Number:
  US10/393,180
• Publication Number:
  US 20030222982A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An integrated video/data information system for use on-board a commercial vehicle comprises a digital integrated data bus for conveying among bus compatible camera and display modules coupled to the bus video and data information in a digital format based on a predetermined bus protocol. Each camera module is operative to transmit, upon command, over the bus the image data in a digital format compatible with the predetermined bus protocol. Each display module is operative to receive from the bus, upon command, image data originating from a selected camera module, and to display the image data on a display monitor thereof. The system includes a bus master module coupled to the integrated data bus for transmitting commands over the bus to the camera and display modules. Such commands comprise a first command for directing a selected camera module to transmit image data thereof over the bus, and a second command for directing a selected display module to receive image data corresponding to the selected camera module from the bus and to display the received image data on the display monitor thereof. The first and second commands may be transmitted based on the operational status of the vehicle.

Claims

1. An integrated video/data information system for use on-board a commercial vehicle, said system comprising:

a digital integrated data bus for conveying among bus modules coupled to said bus video and data information in a digital format based on a predetermined bus protocol;

a plurality of bus compatible camera modules coupled to said integrated data bus, each camera module of said plurality comprising a camera for generating image data representative of a view thereof, each camera module operative as a bus module for transmitting, upon command, over said bus said image data in a digital format compatible with said predetermined bus protocol;

at least one bus compatible display module coupled to said integrated data bus, each display module comprising a display monitor for displaying image data for viewing by an operator, each display module operative as a bus module to receive from said bus, upon command, image data originating from a selected camera module of said plurality, and to display said image data on said display monitor thereof; and

a bus master module coupled to said integrated data bus for transmitting commands over said bus to said plurality of camera modules and said at least one display module, said commands comprising a first command for directing a selected camera module of said plurality to transmit image data thereof over said bus, and a second command for directing a selected display module of said at least one display module to receive image data corresponding to said selected camera module from said bus and to display said received image data on said display monitor thereof.

2. The system of claim 1 wherein the plurality of bus compatible camera modules comprises at least one integrated bus compatible camera coupled to the bus and responsive to a first command to transmit compressed digital video data over the bus in a format compatible with the predetermined bus protocol, said compressed digital video data being representative of an NTSC image signal generated by the camera.

3. The system of claim 1 wherein the plurality of bus compatible camera modules comprises at least one camera module including:

a camera for generating an NTSC image signal representative of view thereof, and a bus compatible converter circuit coupled between said camera and the integrated data bus for converting said NTSC image signal into compressed digital video data, said converter circuit operative as a bus module to transmit, upon command, said compressed digital video data over the bus in a format compatible with the predetermined bus protocol.

4. The system of claim 1 wherein the plurality of bus compatible camera modules comprises at least one camera module including:

a camera for generating an NTSC image signal representative of view thereof and transmitting said image signal wirelessly;

a receiver for receiving said transmitted image signal; and

a bus compatible converter circuit coupled between said receiver and the integrated data bus for converting said NTSC image signal into compressed digital video data, said converter circuit operative as a bus module to transmit, upon command, said compressed digital video data over the bus in a format compatible with the predetermined bus protocol.

5. The system of claim 1 wherein the plurality of bus compatible camera modules comprises at least one camera module including:

a video camera for generating an NTSC image signal representative of view thereof.

6. The system of claim 1 wherein the plurality of bus compatible camera modules comprises at least one camera module including:

a night vision camera for generating an NTSC infrared image signal representative of view thereof.

7. The system of claim 1 wherein the at least one bus compatible display module comprises at least one integrated bus compatible display monitor coupled to the bus and responsive to the second command to receive from the bus compressed digital video data originating from a selected camera module and to convert said received compressed digital video data into a representative NTSC image signal which is displayed on the display monitor thereof.

8. The system of claim 1 wherein the at least bus compatible display module comprises at least one display module including:

a display monitor for displaying an NTSC image signal; and

a bus compatible converter circuit coupled between said display monitor and the integrated data bus, said converter circuit operative as a bus module to receive from the bus, upon command, compressed digital video data originating from a selected camera module and converting said received compressed digital video data into a representative NTSC image signal which is passed to said display monitor for display.

9. The system of claim 1 wherein the plurality of bus compatible camera modules comprises a camera module for generating an image signal representative of a front view from the vehicle.

10. The system of claim 1 wherein the plurality of bus compatible camera modules comprises a camera module for generating an image signal representative of a side view from the vehicle.

11. The system of claim 1 wherein the plurality of bus compatible camera modules comprises a camera module for generating an image signal representative of a rear view from the vehicle.

12. The system of claim 1 wherein the bus master module is operative to receive data signals representative of an operational status of the vehicle and to transmit the first and second commands over the bus based on said received data signals.

13. The system of claim 12 wherein the received data signals comprise data signals representative of the turning status and directional movement of the vehicle.

14. The system of claim 13 wherein the turning status data signals and the directional movement data signals are coupled directly to the bus master module through a digital input port thereof.

15. The system of claim 12 wherein the vehicle includes at least one existing communication bus;

and including;

a communication bus module operative to receive data signals representative of an operational status of the vehicle, to convert the data signals into communication bus compatible messages, and to transmit said data signal messages over said at least one existing communication bus; and

a gateway module coupled to said at least one communication bus and operative to receive said data signal messages from said at least one communication bus, said gateway module coupled to the bus master module for passing said data signals to said bus master module for use therein.

16. The system of claim 12 wherein the bus master module is operative to transmit the first and second commands over the bus in accordance with a look-up table based on predetermined camera image-to-display monitor combinations correlated to the operational status of the vehicle represented by the data signals.

17. The system of claim 1 including a recording module coupled to the bus for recoding, upon command, image and operational data, received from the bus, on respectively designated channels on a recording media thereof in a real time synchronized format.

18. The system of claim 17 wherein the bus master module is operative to transmit a third command over the bus to the recording module;

and wherein the recording module is responsive to said third command received from the bus to start recording for a predetermined time period.

19. The system of claim 18 wherein the bus master module is operative to transmit the third command over the bus to the recording module in response to an event signal.

20. The system of claim 17 wherein the vehicle includes at least one existing communication bus for conveying among communication bus modules operational data of the vehicle;

and including a gateway module coupled to said at least one communication bus and operative to receive said operational data from said at least one communication bus, said gateway module also coupled to the integrated data bus and operative as an integrated data bus module for transmitting said operational data received from the at least one communication bus over the integrated data bus.

21. The system of claim 17 including a retrieval module coupleable to the recording module for retrieving and displaying recorded image and operational data for analysis.

22. The system of claim 21 wherein the retrieval module comprises a personal computer.

23. The system of claim 1 including a text overlay module coupled to a display module for overlaying text messages onto image data for display on the display monitor of said display module.

24. The system of claim 23 wherein the text overlay module is operative to overlay graphic messages onto image data for display on the display monitor of said display module.

25. The system of claim 23 wherein the vehicle includes at least one existing communication bus for conveying among communication bus modules operational data of the vehicle;

and wherein the text overlay module includes a bus interface circuit coupled to said at least one communication bus and operative to receive said operational data from said at least one communication bus, the text overlay module operative to overlay onto image data for display text messages representative of selected operational data received from said communication bus.

26. The system of claim 25 wherein the text overlay module includes a memory for storing text messages corresponding to fault conditions of the vehicle;

wherein the communication bus also conveys data representative of fault conditions of the vehicle which is received by the text overlay module through the bus interface circuit thereof; and

wherein the text overlay module is operative in response to received fault condition data to access corresponding text messages from said memory and to display said text messages on the display monitor.

27. The system of claim 26 including a bus communication module coupled to the communication bus and responsive to interactive display commands from a user interface to transmit said commands over the communication bus;

wherein the text overlay module is operative to receive said commands from the communication bus through the bus interface circuit thereof and to select text messages to display on the display monitor in response to said commands.

28. The system of claim 26 including a bus communication module coupled to the communication bus and including an interface circuit for receiving signals from sensors on-board the vehicle, said bus communications module operative to determine fault conditions from said received sensor signals and to transmit said fault conditions over the communication bus.

29. The system of claim 1 including a configuration module coupled to the integrated data bus and operative as a user interface for system configuration, said configuration module for transmitting system configuration information to the bus master module.

30. The system of claim 1 wherein the bus master module is operative to transmit first commands over the integrated data bus for directing a plurality of selected camera modules to transmit simultaneously image data over said bus, and to transmit second commands over the integrated data bus for directing a plurality of selected display modules to receive simultaneously image data from said bus, each selected display module directed to receive image data from a corresponding selected camera module of said plurality.

31. The system of claim 1 wherein the integrated data bus is based on an IEEE-1394 bus standard.

32. A text overlay module disposeable on-board a commercial vehicle and coupleable between a display monitor and at least one existing communication bus of said vehicle for overlaying text messages onto image data for display on said display monitor, said module comprising:

a bus interface circuit coupled to said at least one communication bus for receiving vehicle data representative of fault conditions and operational measurement and status data from the at least one communication bus;

a microcontroller coupled to said bus interface circuit and operative to respond to said received fault condition and operational data;

a memory for storing text messages corresponding to fault conditions and operational

said microcontroller responsive to fault condition and operational data received from the at least one communication bus to access corresponding text messages from said memory and to overlay said text messages onto image data for display on said display monitor.

33. The module of claim 32 wherein the vehicle includes at least one camera for generating image data representative of a camera view for display on the display monitor;

and wherein the module is disposed between the camera and display monitor for overlaying text messages onto image data of said camera for display on the display monitor.

34. A communication bus module operative to communicate alarm and operational data over at least one existing communication bus on-board a commercial vehicle, said module comprising:

a bus interface circuit coupled to said at least one communication bus for transmitting alarm and operational data over the at least one communication bus;

a microcontroller coupled to said bus interface circuit and operative to control the transmission of alarm and operational data over the at least one communication bus;

a first interface circuit coupled to said microcontroller for receiving data signals representative of an operational status of the vehicle and for passing said operational status data to said microcontroller;

a second interface circuit coupled to said microcontroller for receiving and digitizing sensor signals from a plurality of on-board vehicle sensors operative to measure parameters of the vehicle and for passing said digitized sensor signals to said microcontroller;

a memory for storing thresholds corresponding to said sensor signals, said thresholds being based on the vehicle parameter being measured by the corresponding sensor;

said microcontroller operative to convert said operational status data into first bus messages and to control the transmission of said first bus messages over the at least one communication bus; and

said microcontroller further operative to generate data representative of alarm conditions determined from the digitized sensor signals and their corresponding thresholds, to convert said alarm condition data into second bus messages and to control the transmission of said second bus messages over the at least one communication bus.

35. A diagnostic system for use on a commercial vehicle utilizing an at least one existing on-board communication bus and an existing on-board vision system including a camera for generating image data representative of a view thereof, and a display monitor for displaying said camera image data on a screen thereof, said vehicle including a plurality of electronic control units (ECUs) for monitoring the fault status of corresponding resources, said plurality of ECUs being coupled to said at least one communication bus for conveying fault condition and diagnostic data thereover, said system comprising:

a display generator unit including;

a microcontroller;

a bus interface circuit coupled between said microcontroller and the at least one communication bus for receiving fault condition and diagnostic data from the communication bus and passing said received data to said microcontroller;

a text overlay circuit coupled between the camera and display monitor and governed by said microcontroller for overlaying text messages onto the image data of the camera to form composite image data and for transmitting said composite image data to the display monitor for display thereon; and

a memory coupled to said microcontroller for storing text messages and text menu screens corresponding to said fault conditions; and

a communication bus module coupled to the at least one communication bus for receiving display command signals from a user interface and transmitting said display command signals over the at least one communication bus, said display command signals being received by the bus interface circuit and passed to the microcontroller for use in controlling the display of text messages and text menu screens on the display monitor.

36. The diagnostic system of claim 35 wherein the microcontroller is responsive to fault condition data from an ECU of said plurality received from the at least one communication bus to access a corresponding text message from the memory, said microcontroller operative to control said text overlay circuit to overlay said accessed text message onto the camera image data to form composite image data for display on the display monitor.

37. The diagnostic system of claim 36 wherein the microcontroller is responsive to a first display command, focused on the displayed ECU fault text message, received over the at least one communication bus to access data representative of an ECU text menu screen from the memory, said microcontroller operative to control said text overlay circuit to pass said accessed ECU text menu screen data to the display monitor for display thereon.

38. The diagnostic system of claim 37 wherein the microcontroller is responsive to a second display command, selecting the faulted ECU from the displayed ECU text menu screen, received over the at least one communication bus to interact with the faulted ECU over the at least one communication bus to determine the fault condition of the ECU.

39. The diagnostic system of claim 38 wherein the microcontroller is operative to access a text message corresponding to the determined ECU fault condition from the memory, said microcontroller operative to control said text overlay circuit to pass said accessed ECU fault condition text message to the display monitor for display thereon.

40. The diagnostic system of claim 38 the microcontroller interacts with the faulted ECU over the at least one communication bus-by transmitting an interrogation signal over the at least one communication bus via the bus interface circuit to the faulted ECU requesting the fault condition thereof;

wherein the faulted ECU is responsive to said interrogation signal to transmit data representative of the fault condition back over the at least one communication bus to the microcontroller via the bus interface circuit.

41. A bus compatible converter circuit coupled between an integrated data bus having a predetermined bus protocol and a camera for generating an NTSC image signal representative of a view thereof, said converter circuit comprising:

a first circuit coupled to said camera for converting said NTSC image signal into compressed digital video data representative thereof;

a second circuit coupled between said first circuit and said bus for transmitting said compressed digital video data over said bus in a format compatible with said predetermined bus protocol; and

a controller coupled to said first and second circuits for coordinating the operations of said first and second circuits.

42. The bus compatible converter circuit of claim 41 wherein the first circuit comprises a CODEC integrated circuit.

43. The bus compatible converter circuit of claim 41 wherein the second circuit comprises a data link layer circuit and a physical layer circuit.

44. The bus compatible converter circuit of claim 41 wherein the controller comprises a programmed CPU.

45. A bus compatible converter circuit coupled between an integrated data bus having a predetermined bus protocol and a display monitor for displaying an NTSC image signal on a screen thereof, said converter circuit comprising:

a first circuit coupled to said bus for receiving from said bus compressed digital video data representative of said NTSC image signal and in a format compatible with said predetermined bus protocol;

a second circuit coupled between said first circuit and said display monitor for converting said compressed digital video data into the NTSC image signal representative thereof for display on said monitor screen; and

a controller coupled to said first and second circuits for coordinating the operations of said first and second circuits.

46. The bus compatible converter circuit of claim 45 wherein the second circuit comprises a CODEC integrated circuit.

47. The bus compatible converter circuit of claim 45 wherein the first circuit comprises a data link layer circuit and a physical layer circuit.

48. The bus compatible converter circuit of claim 45 wherein the controller comprises a programmed CPU.

49. An integrated video/data information system for use on-board a commercial vehicle including at least one existing communication bus, said system comprising:

a plurality of cameras, each camera for generating an image signal representative of a view thereof;

a plurality of display monitors, each display monitor for displaying a camera generated image signal for viewing by an operator;

a matrix of switches disposed between said plurality of cameras and said plurality of display monitors;

a switch controller coupled to said matrix of switches for controlling said switches to connect the image signal from at least one camera to at least one display monitor for display on a viewing screen thereof, said switch controller being coupled to said at least one communication bus for receiving data therefrom; and

a bus communication module coupled to said at least one communication bus, said module operative to receive data signals representative of an operational status of the vehicle and to transmit said operational status data over the at least one communication bus, said switch controller operative to receive the operational status data from the at least one communication bus and to control the switches of said matrix based on said operational status data.

50. The system of claim 49 wherein the matrix of switches comprises a switch coupled between each camera of the plurality and each display monitor of said plurality.

51. The system of claim 49 including a buffer amplifier coupled between each camera of the plurality and the matrix of switches.

52. The system of claim 49 including a buffer amplifier coupled between each display monitor and the matrix of switches.

53. The system of claim 49 including a display generator unit coupled to the communication bus and matrix of switches;

and wherein the switch controller is operative to control the switches of the switch matrix to connect said display generator unit between a selected camera image signal and a selected display monitor.

54. The system of claim 53 wherein the matrix of switches comprises:

a first switch coupled between each camera of the plurality and each display monitor of said plurality;

a second switch coupled between each camera of the plurality and the display generator unit;

a third switch coupled between the first switches and each display monitor of the plurality; and

a fourth switch coupled between each display monitor of the plurality and the display generator unit.

55. The system of claim 53 wherein the display generator unit is operative to overlay text messages onto the selected camera image signal to form a composite text/image signal for display on the selected display monitor.

56. The system of claim 53 including another communication bus module coupled between a user interface and the at least one communication bus for receiving display command signals from the user interface and transmitting said display command signals over the at least one communication bus;

and wherein the display generator unit operative to receive said display command signals from the at least one communication bus to govern the display of text messages to the selected display monitor.

57. The system of claim 49 wherein the switch controller is operative to receive the operational status data from the at least one communication bus and to control the switches of said matrix in accordance with a look-up table based on predetermined camera image-to-display monitor combinations correlated to the operational status data.

58. The system of claim 57 wherein the operational status data comprises data representative of the turning status and directional movement of the vehicle.

59. The system of claim 49 wherein the switch matrix comprises solid-state switches.

60. The system of claim 49 including a recording unit coupled to the switch matrix for recording a selected camera image signal.

61. A keyboard user interface for use on-board a commercial vehicle for communicating over at least one existing communication bus of said vehicle, said interface comprising:

a keyboard comprising a multiplicity of character keys for selection by a user and for generating a coded digital word representative of a user selected character key thereof; and

a communication interface circuit coupled between said keyboard and the at least one communication bus, said communication interface circuit operative to receive said coded digital word, to convert the received coded digital word into a character message compatible with the at least one communication bus, and to transmit said character message over the at least one communication bus of the vehicle.

62. The interface of claim 61 wherein the communication interface circuit comprises:

a digital input port coupled to the keyboard;

a microcontroller coupled to the digital input port for receiving the coded digital word from the keyboard and converting the coded digital word into the character message compatible with the at least one communication bus; and

a bus interface circuit coupled between the at least one communication bus and said microcontroller for transmitting the character message over the at least one communication bus of the vehicle.

63. The interface of claim 62 wherein the coded digital word is transmitted bit serial from the keyboard to the digital input port.

64. The interface of claim 63 wherein the keyboard transmits a synchronizing clock signal together with the bit serial coded digital word;

and wherein the digital input port comprises a synchronous serial port governed by the synchronizing clock signal to receive the bit serial coded digital word.

65. The interface of claim 62 wherein the at least one communication bus operates in accordance with a predetermined bus protocol;

wherein the microcontroller is operative to convert the coded digital word into the character message in a format compatible with said predetermined bus protocol of the at least one communication bus; and

wherein the bus interface circuit is operative to transmit the character message over the at least one communication bus of the vehicle in accordance with said predetermined bus protocol.

66. A method of communicating integrated video/data information on-board a commercial vehicle, said method comprising the steps of:

generating from each of a plurality of bus compatible camera modules image data representative of a corresponding view thereof;

transmitting a first command over a digital integrated data bus to a selected camera module of said plurality to direct said selected camera module to transmit image data over said data bus in a digital format compatible with a predetermined bus protocol;

transmitting a second command over said digital integrated data bus to a bus compatible display module to direct said display module to receive from said data bus in accordance with said predetermined bus protocol said digitally formatted image data originating from said selected camera module and to display said image data; and

transmitting said first and second commands based on an operational status of said commercial vehicle.

67. The method of claim 66 wherein the step of transmitting the first and second commands is based on a turning status and directional movement of the commercial vehicle.

68. The method of claim 66 wherein the step of transmitting the first and second commands includes transmitting the first and second commands in accordance with a look-up table based on predetermined camera image-to-display module combinations correlated to the operational status of the vehicle.

69. The method of claim 66 including the steps of:

transmitting data representative of the operational status of the commercial vehicle over at least one pre-existing communication bus of the commercial vehicle; and

receiving said operational data from the at least one pre-existing communication bus for use in transmitting the first and second commands.

70. The method of claim 66 including the step of transmitting a third command over the digital integrated data bus to a bus compatible recording module to direct said recording module to receive from said data bus in accordance with said predetermined bus protocol said digitally formatted image data originating from said selected camera module and to record said image data for a predetermined time period.

71. The method of claim 70 wherein the third command is transmitted in response to an event signal.

72. The method of claim 70 including the step of transmitting operational data of the commercial vehicle over the integrated data bus in digital format compatible with the predetermined bus protocol;

and wherein the step of transmitting the third command includes transmitting the third command over the digital integrated data bus to the bus compatible recording module to direct the recording module to receive from the data bus in accordance with the predetermined bus protocol the digitally formatted image data originating from the selected camera module and operational data, and to record the received image and operational data in a real time synchronized format.

73. The method of claim 66 including the step of overlaying text messages onto image data for display by the display module.

74. The method of claim 73 including the steps of:

transmitting data representative of operational status of the commercial vehicle over at least one pre-existing communication bus of the commercial vehicle;

receiving operational data from the at least one pre-existing communication bus; and

overlaying text messages representative of the operational data onto the image data in response to said received operational data.

75. The method of claim 73 including the steps of:

transmitting data representative of fault conditions of the commercial vehicle over at least one pre-existing communication bus of the commercial vehicle;

receiving fault condition data from the at least one pre-existing communication bus; and

overlaying text messages representative of said fault conditions onto the image data in response to said received fault condition data.

76. The method of claim 73 including the steps of:

transmitting user display commands over at least one pre-existing communication bus of the commercial vehicle;

receiving the user display commands from the at least one pre-existing communication bus; and

controlling the display of the display module in response to said received display commands.

77. The method of claim 66 wherein the step of transmitting a first command includes transmitting first commands over the integrated data bus to a plurality of selected camera modules to direct said selected camera modules to transmit simultaneously image data over said data bus, and wherein the step of transmitting a second command includes transmitting second commands over the integrated data bus to a plurality of selected display modules to direct said selected display modules to receive simultaneously image data from said bus data, each selected display module directed to receive image data from a corresponding selected camera module of said plurality.