Method and device for processing 3D image data

• US 9,767,603 B2
• Filed: 07/28/2015
• Issued: 09/19/2017
• Est. Priority Date: 01/29/2013
• Status: Active Grant

• Current Assignee: Bayerische Motoren Werke AG
• Original Assignee: Bayerische Motoren Werke AG
• Inventors: Schuldt, Michael, Ochs, Tilmann, Lotterbach, Timo, Von Beuningen, Sven
• Primary Examiner(s): LETT, THOMAS J
• Application Number:
  US14/811,063
• Publication Number:
  US 20150332499A1
• Time in Patent Office: 784 Days
• Field of Search: 345426
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/80 Shading
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

In order to process 3D input image data for a display of images on at least one display unit, the 3D input image data are provided scene-by-scene in accordance with an associated 3D image scene. The 3D input image data are each fed to a scene processing unit for management and processing. The 3D input image data are processed scene-by-scene in the scene processing unit, wherein at least two 3D image scenes are at least partially superposed and a whole 3D scene is formed and managed. Several 3D output scenes are derived from the whole 3D scene, for which 3D output scenes the superposition occurs in accordance with different perspective locations of observation and 3D output image data are produced in the process. The 3D output image data are fed to at least one rendering unit, which is associated with the display unit, for the production of target image data adapted to the display unit.

Claims

1. A method for processing 3D input image data for a display of images on at least one display unit, wherein the 3D input image data are provided scene-by-scene in each case in accordance with an associated 3D image scene, the method comprising the acts of:

receiving the 3D input image data in each case in a scene processing unit for management and processing;

processing the 3D input image data scene-by-scene in the scene processing unit to generate a plurality of 3D image scenes;

forming a whole 3D scene by superimposing at least partially two of the plurality of the 3D image scenes and managing the whole 3D scene;

deriving a plurality of 3D output scenes from the formed whole 3D scene, in which 3D output scenes the superposition takes place in each case in accordance with a perspective viewing location, and wherein 3D output image data are produced in the process; and

feeding the 3D output image data to at least one rendering unit, which is associated with the at least one display unit, for producing target image data that are adapted to the at least one display unit.

2. The method according to claim 1, wherein:

a plurality of display units are provided, with which in each case a rendering unit is associated, and

the scene processing unit produces for the display units in each case different 3D output image data and the 3D output image data are distributed to the one or more rendering units for producing the target image data.

3. The method according to claim 2, wherein:

the target image data are associated in each case with one display unit, and

the rendering unit outputs the target image data to the display unit that is in each case associated therewith.

4. The method according to claim 3, wherein:

the at least one display unit is configured for displaying 2D images, the rendering unit is a raster processor, and the target image data are 2D image data.

5. The method according to claim 1, wherein:

the at least one display unit is configured for displaying 2D images,

the rendering unit is a raster processor, and

the target image data are 2D image data.

6. The method according to claim 1, wherein:

in each case one of at least two priority stages is associated with the 3D input image data, with a priority stage in each case indicating to what degree the associated 3D image scene remains visible when superposed with another 3D image scene, and

the 3D output scenes are configured such that, when the target image data are produced in the rendering unit, those target image data that are derived from a 3D image scene of a higher priority stage are superposed at a target image coordinate on target image data that are derived from a lower priority stage.

7. The method according to claim 6, wherein the method is carried out in a vehicle and, using the priority stages and the 3D output scenes, safety-relevant image elements are superposed on other image elements that are not safety relevant on the display unit.

8. The method according to claim 7, wherein the perspective viewing location corresponds to a spatial position of the display unit.

9. The method according to claim 1, wherein the perspective viewing location corresponds to a spatial position of the display unit.

10. The method according to claim 1, wherein

the scene processing unit uses, for forming the whole 3D scene, interaction parameters that describe an interaction between 3D image elements of at least two of the client-computer systems that provide the 3D input image data.

11. The method according to claim 1, wherein deferred shading takes place in the rendering unit.

12. The method according to claim 1, wherein:

a predetermined reference image is rendered in parallel with the rendering of the 3D output image data, and

a decision is made based on a rendering result of the reference image as to whether the rendering result of the 3D output image data is used for further processing or is discarded.

13. The method according to claim 1, wherein the 3D input image data are produced by a client-computer program application in a vehicle.

14. The method according to claim 13, wherein a plurality of client-computer program applications are carried out in the vehicle, which in each case produce individual 3D input image data for respectively associated 3D image scenes and parameters which are respectively associated with the 3D image scenes.

15. The method according to claim 14, wherein the parameters produced by the client-computer program application comprise safety parameters, which in each case indicate a priority stage to which extent the associated 3D image scene remains visible when superposed with a different 3D image scene.

16. The method according to claim 15, wherein the parameters produced by the client-computer program applications comprise interaction parameters which describe how 3D image objects of the 3D image scene interact with 3D image objects of different 3D image scenes.

17. The method according to claim 16, wherein an interaction parameter indicates a reflectance of a 3D image object, and how strongly other 3D image objects are reflected by the 3D image object.

18. The method according to claim 14, wherein the parameters produced by the client-computer program applications comprise interaction parameters which describe how 3D image objects of the 3D image scene interact with 3D image objects of different 3D image scenes.

19. An image processing system, comprising:

at least one controller configured to executed a program for processing 3D input image data for a display of images on at least one display unit, wherein the 3D input image data are provided scene-by-scene in each case in accordance with an associated 3D image scene, the controlling executing the program by;

receiving the 3D input image data in each case in a scene processing unit for management and processing;

processing the 3D input image data scene-by-scene in the scene processing unit to generate a plurality of 3D image scenes;

forming a whole 3D scene by superimposing at least partially two of the plurality of the 3D image scenes and managing the whole 3D scene;

deriving a plurality of 3D output scenes from the formed whole 3D scene, in which 3D output scenes the superposition takes place in each case in accordance with a perspective viewing location, and wherein 3D output image data are produced in the process; and

feeding the 3D output image data to at least one rendering unit, which is associated with the at least one display unit, for producing target image data that are adapted to the at least one display unit.

20. A vehicle, comprising:

at least one display unit;

an image processing system comprising at least one controller for executing a program to process 3D input image data for a display of images on the at least one display unit, wherein the 3D input image data are provided scene-by-scene in each case in accordance with an associated 3D image screen, the controller executing the program by;

receiving the 3D input image data in each case in a scene processing unit for management and processing;

processing the 3D input image data scene-by-scene in the scene processing unit to generate a plurality of 3D image scenes;

forming a whole 3D scene by superimposing at least partially two of the plurality of the 3D image scenes and managing the whole 3D scene;

deriving a plurality of 3D output scenes from the formed whole 3D scene, in which 3D output scenes the superposition takes place in each case in accordance with a perspective viewing location, and wherein 3D output image data are produced in the process; and

feeding the 3D output image data to at least one rendering unit, which is associated with the at least one display unit, for producing target image data that are adapted to the at least one display unit.