Vehicle with image processing system and method for operating an image processing system

• US 20060033755A1
• Filed: 08/01/2005
• Published: 02/16/2006
• Est. Priority Date: 08/11/2004
• Status: Active Grant

• Current Assignee: Magna Donnelly GmbH & Company KG
• Original Assignee: Magna Donnelly GmbH & Company KG
• Inventors: Weis, Tim, Laufer, Martin
• Granted Patent: US 7,280,124 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A vehicle (01) has at least two image data sources (02), at least one mixing unit (03), at least one conversion unit (04) and an image display unit (05). The pixel data (09) generated with the image data sources (02) can be brought together by means of the mixing unit (03) in particular for simultaneous display on the image display unit (05). With the conversion unit (04), the pixel data (10) can be transformed to a form of image data (11) which can be displayed on the image display unit (05). The mixing unit (03) includes at least two data input ports (06) for receiving pixel data (09) from the two image data sources (02), and at least one data output port (07) for the brought-together pixel data (10). The conversion unit (04) includes at least one data input port (08) for the brought-together pixel data (10). The data output port (07) of the mixing unit (03) is directly or indirectly connected to the data input port (08) of the conversion unit (04). A method for operating an image processing system in a vehicle (01) is provided in which first the pixel data (09) of the various image data sources (02) is brought together by means of the mixing unit (03), and thereafter, by means of the conversion unit (04), the brought-together pixel data (10) is transformed into a form of image data (11).

Claims

1. A vehicle comprising:

two image data sources

a mixing unit;

a conversion unit;

an image display unit, wherein pixel data generated with the image data sources can be brought together by means of the mixing unit for simultaneous display on the image display unit and wherein, by means of the conversion unit, the pixel data can be transformed to a form of image data which can be displayed on the image display unit, said mixing unit comprising two data input ports for receiving pixel data from the two image data sources and a data output port for the brought together pixel data, wherein the conversion unit comprises a data input port for the brought-together pixel data, and wherein the data output port of the mixing unit is directly or indirectly connected to the data input port of the conversion unit.

2. The vehicle according to claim 1, wherein the image data sources comprise at least one CCD unit and/or one CMOS unit.

3. The vehicle according to claim 1, wherein the mixing unit comprises at least one data input port, wherein the pixel data generated with the image data sources can directly or indirectly be forwarded to the data input port of the mixing unit.

4. The vehicle according to claim 1, wherein the mixing unit comprises an integrated circuit in the form of one of a DSP and/or an FPGA and/or an ASIC.

5. The vehicle according to claim 1,wherein the conversion unit (04) is designed in the form of an integrated circuit, in particular a DSP and/or an FPGA and/or an ASIC.

6. The vehicle according to claim 1, wherein at least a third arithmetic unit is provided in a data processing chain, wherein additional processing and/or evaluation with the pixel data and/or image data can be carried out by means of the third arithmetic unit.

7. The vehicle according to claim 1, wherein the third arithmetic unit is integrated in the mixing unit and/or the conversion unit.

8. The vehicle according to claim 1, wherein several third arithmetic units, in particular arithmetic units of identical design, in which individual functions can be carried out in parallel independently of one another, are provided in the data processing chain.

9. The vehicle according to claim 1, wherein the various third arithmetic units can exchange data via data lines.

10. The vehicle according to claim 1, wherein the image display unit comprises a flat-panel monitor and/or a display.

11. The vehicle according to claim 1, wherein the image display unit comprises a projector device.

12. A method for operating an image processing system in a vehicle, comprising at least two image data sources including a CCD unit and/or CMOS unit, at least one mixing unit, at least one conversion unit and an image display unit, the method comprising:

bringing together the pixel data generated with the image data sources by means of the mixing unit for simultaneous display on the image display unit;

transforming the pixel data by means of the conversion unit to a form of image data which can be displayed on the image display unit;

bringing the pixel data of the various image data sources together by means of the mixing unit and thereafter; and

subsequent to said step of bringing the pixel data of the various image data sources together transforming the brought together pixel data by means of the conversion unit into a form of image data.

13. The method according to claim 12,wherein the overall quantity of the pixel data generated by the various image data sources by means of the mixing unit is reducible to that part which is to be displayed on the image display unit.

14. The method according to claim 12, wherein the transformation of the pixel data into a form of image data is based on averaging by way of adjacent pixel data or interpolation.

15. The method according to claim 12, wherein the pixel data of the various image data sources is subjected to additional processing steps and/or evaluation steps before it reaches the mixing unit.

16. The method according to claim 12, wherein the pixel data which has already been brought together by means of the mixing unit is subjected to additional processing steps and/or evaluation steps before it reaches the conversion unit.

17. The method according to claim 12, wherein the image data which has already been transformed by means of the conversion unit is subjected to additional processing steps and/or evaluation steps.

18. The method according to claim 12, wherein the additional processing steps and/or evaluation steps can be implemented by means of a third arithmetic unit.

19. The vehicle according to claims 18, wherein the additional processing steps and/or evaluation steps can be carried out in parallel by means of several third arithmetic units.

20. The method according to claim 12, wherein the additional processing steps and/or evaluation steps can be implemented by means of the mixing unit and/or by means of the conversion unit.

21. The method according to claim 12, wherein the processing steps and/or evaluation steps are based on a form for detecting image overlap.

22. The method according to claim 12, wherein the processing steps and/or evaluation steps are based on a form of image region analysis and/or image region detection.

23. The method according to claim 12, wherein the results of the additional processing steps and/or evaluation steps can be shown on the image display unit.