Vehicle with image processing system and method for operating an image processing system

• US 7,280,124 B2
• Filed: 08/01/2005
• Issued: 10/09/2007
• Est. Priority Date: 08/11/2004
• Status: Active Grant

• Current Assignee: Magna Donnelly GmbH & Company KG
• Original Assignee: Magna Donnelly GmbH & Company KG
• Inventors: Weis, Tim, Laufer, Martin
• Primary Examiner(s): Tung; Kee M.
• Assistant Examiner(s): GOOD JOHNSON, MOTILEWA
• Application Number:
  US11/194,433
• Publication Number:
  US 20060033755A1
• Time in Patent Office: 799 Days
• Field of Search: 345/629, 382/284
• US Class Current: 345/629
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicle (01) has at least two image data sources (02), at least one mixing unit (03), at least one conversion unit (04) and an image display unit (05). The pixel data (09) generated with the image data sources (02) can be brought together by means of the mixing unit (03) in particular for simultaneous display on the image display unit (05). With the conversion unit (04), the pixel data (10) can be transformed to a form of image data (11) which can be displayed on the image display unit (05). The mixing unit (03) includes at least two data input ports (06) for receiving pixel data (09) from the two image data sources (02), and at least one data output port (07) for the brought-together pixel data (10). The conversion unit (04) includes at least one data input port (08) for the brought-together pixel data (10). The data output port (07) of the mixing unit (03) is directly or indirectly connected to the data input port (08) of the conversion unit (04). A method for operating an image processing system in a vehicle (01) is provided in which first the pixel data (09) of the various image data sources (02) is brought together by means of the mixing unit (03), and thereafter, by means of the conversion unit (04), the brought-together pixel data (10) is transformed into a form of image data (11).

Claims

1. A vehicle comprising:

two image data sources;

a mixing unit;

a conversion unit;

a plurality of arithmetic units of identical design;

an image display unit, wherein an image processing chain is provided in which pixel data with digital addressing generated with the image data sources can be brought together by means of the mixing unit for simultaneous display on the image display unit and wherein, by means of the conversion unit, the pixel data can be transformed to a form of image data which can be displayed on the image display unit, said mixing unit comprising two data input ports for receiving pixel data from the two image data sources and a data output port for the brought together pixel data, wherein the conversion unit comprises a data input port for the brought-together pixel data, and wherein the data output port of the mixing unit is directly or indirectly connected to the data input port of the conversion unit and wherein the plurality of arithmetic units are provided in the digital data processing chain and carry out individual functions in parallel, independently of one another, for at least one of image region analysis, object detection analysis and image overlap detection.

2. The vehicle according to claim 1, wherein the image data sources comprise at least one CCD unit and/or one CMOS unit.

3. The vehicle according to claim 1, wherein the mixing unit comprises at least one data input port, wherein the pixel data generated with the image data sources can directly or indirectly be forwarded to the data input port of the mixing unit.

4. The vehicle according to claim 1, wherein the mixing unit comprises an integrated circuit in the form of one of a DSP and/or an FPGA and/or an ASIC.

5. The vehicle according to claim 1, wherein the conversion unit is designed in the form of an integrated circuit, comprising one of a DSP and/or an FPGA and/or an ASIC.

6. The vehicle according to claim 1, wherein at least one of the plurality of arithmetic units is integrated in the mixing unit and/or the conversion unit.

7. The vehicle according to claim 1, wherein the plurality of arithmetic units can exchange data lines.

8. The vehicle according to claim 1, wherein the image display unit comprises a flat-panel monitor and/or a display.

9. The vehicle according to claim 1, wherein the image display unit comprises a projector device.

10. A method for operating an image processing system in a vehicle, comprising at least two image data sources including a CCD unit and/or CMOS unit, an image display unit and a digital processing chain including at least one mixing unit and at least one conversion unit, the method comprising:

bringing the pixel data of the various image data sources together by means of the mixing unit whereby the overall quantity of the pixel data generated by the various image data sources is reducible to that part which is to be displayed on the image display unit; and

subsequent to said step of bringing the pixel data of the various image data sources together, transforming the brought together pixel data by means of the conversion unit into a form of image data whereby the transformation of the pixel data into a form of image data is based on averaging by way of adjacent pixel data or interpolation, and plural arithmetic units carry out additional processing steps including one of image region analysis, object detection analysis and image overlap detection.

11. The method according to claim 10, wherein the pixel data of the various image data sources is subjected to additional processing steps and/or evaluation steps before the pixel data reaches the mixing unit.

12. The method according to claim 10, wherein the pixel data which has already been brought together by means of the mixing unit is subjected to additional processing steps and/or evaluation steps before the pixel data reaches the conversion unit.

13. The method according to claim 10, wherein the image data which has already been transformed by means of the conversion unit is subjected to additional processing steps and/or evaluation steps.

14. The method according to claim 10, wherein the additional processing steps can be implemented by means of the mixing unit and/or by means of the conversion unit.

15. The method according to claim 10, wherein the results of the additional processing steps can be shown on the image display unit.

16. The method according to claim 10, wherein the plurality of arithmetic units are provided with an identical design in the digital data processing chain and carry out individual functions in parallel, independently of one another, for at least one of image region analysis, object detection analysis and image overlap detection.