Method for texturizing virtual three-dimensional objects

• US 8,705,843 B2
• Filed: 10/10/2007
• Issued: 04/22/2014
• Est. Priority Date: 10/11/2006
• Status: Active Grant

• Current Assignee: GTA Geoinformatik GmbH (Hexagon AB)
• Original Assignee: GTA Geoinformatik GmbH (Hexagon AB)
• Inventors: Lieckfeldt, Peter
• Primary Examiner(s): Li, Ruiping
• Application Number:
  US12/311,684
• Publication Number:
  US 20100202682A1
• Time in Patent Office: 2,386 Days
• Field of Search: 382/154, 382/162, 382/285, 382/181, 382/294
• US Class Current: 382/154
• CPC Class Codes: G06T 15/04 Texture mapping

Abstract

The invention relates to a method for texturizing virtual three-dimensional objects, particularly virtual three-dimensional building objects and city models with a photographic image (1) of a real object, particularly of a picture of a façade. The method is characterized by the following steps: Projecting the photographic image (1) onto a virtual surface (2) of the virtual three-dimensional object to produce a raw texture; localizing a raw texture element (3) in the raw texture by using a classification method; computer-compatible description of the localized raw texture element by a formal feature set for the raw texture element, particularly a feature vector; comparing the formal feature set of the raw texture element with each feature set of predefined library elements (4), and determining degrees of similarity between the raw texture element and each library element; replacing the localized raw texture element with at least one library element when a predefined degree of similarity is present, and reshaping the raw texture into a generalized texture (5) of the virtual object by replacing all raw texture elements with library elements.

Claims

1. Method for texturing a virtual three-dimensional object with a photographic image of a real object, the method comprising:

obtaining a photographic image;

projecting the photographic image onto a virtual surface of the virtual three-dimensional object to generate a raw texture;

localizing a raw texture element within the raw texture by using a classification method;

describing the localized raw texture element in a computerized manner by a formal attribute set for the raw texture element;

comparing the formal attribute set of the raw texture element with an attribute set of predetermined library elements and determining similarity measures between the raw texture element and a library element; and

replacing the localized raw texture element with at least one library element if a predefined similarity measure is present, wherein the raw texture is transformed into a generalized texture of the virtual object by replacing all localized raw texture elements with library elements.

2. Method according to claim 1, wherein the projected photographic image for generating the raw texture is obtained from a georeferenced terrestrial digital photograph.

3. Method according to claim 1, wherein the projected photographic image is obtained from one of a nadir aerial photograph and an oblique aerial photograph.

4. Method according to claim 1, further comprising image processing to improve the image by removing faults in the raw texture, specifically a reduction and/or elimination of disadvantageous shadow edges and blurrings by means of suited methods.

5. Method according to claim 1, wherein the classification method for localizing the raw texture element includes a detection of position, shape, color, surface and/or edge according to previously defined search parameters, whereby the localized raw texture element is selected at least in view of its position, shape, color, surface and/or edge structure and the like attributes.

6. Method according to claim 1, wherein if the attributes of the raw texture element, particularly a height and width and/or a picture element number, are scaling-dependent, the raw texture element is rescaled to a normalized reference quantity and the normalized reference quantity forms a part of the formal attribute set of the raw texture element.

7. Method according to claim 1, wherein scaling-independent attributes of the raw texture element, particularly color values, define an absolute reference quantity in the formal attribute set of the raw texture element.

8. Method according to claim 6, wherein the comparison of the formal attribute set of the raw texture element with the attribute set of a library element includes a comparison of the normalized reference quantities, wherein similarity is determined when a ratio between two attributes of the formal attribute set is invariant relative to a ratio between the corresponding two attributes of the attribute set of the library element.

9. Method according to claim 7, wherein the comparison of the formal attribute set of the raw texture element with the attribute set of a library element includes a comparison of the absolute reference quantities, whereby a test for a greatest possible correspondence of the absolute reference quantities is carried out.

10. Method according to claim 8, wherein in the determination of the similarity measure a degree of correspondence of the absolute reference quantities and a stability of the invariant ratio is evaluated.

11. Method according to claim 1, wherein the similarity measure is defined in advance, with all library elements being outputted as selection alternatives for the raw texture element with a similarity measure lying within a tolerance range.

12. Method according to claim 1, wherein the replacement of the localized raw texture element with the library element is accomplished by cutting the point set of the raw texture element out of the raw texture and inserting the point set of the at least one library element into the raw texture.

13. Method according to claim 12, wherein the replacement includes a manual postprocessing step.

14. Method according to claim 1, wherein non-classified sections of the raw texture are inserted into the generalized texture as pixel groups, particularly bitmaps.

15. Method according to claim 1, wherein during the transformation of the raw texture into the generalized texture a tiling of the virtual object is carried out at least partially by a repeated insertion of an adapted library element.

16. Method according to claim 2, wherein image processing steps are carried out to improve the image by removing faults in the raw texture, specifically a reduction and/or elimination of disadvantageous shadow edges and blurrings by means of suited methods.

17. Method according to claim 3, wherein image processing steps are carried out to improve the image by removing faults in the raw texture, specifically a reduction and/or elimination of disadvantageous shadow edges and blurrings by means of suited methods.

18. Method according to claim 5, wherein for attributes of the raw texture element that are scaling-dependent, the raw texture element is rescaled to a normalized reference quantity and the normalized reference quantity forms a part of the formal attribute set of the raw texture element.

19. Method according to claim 5, wherein color value attributes of the raw texture element define an absolute reference quantity in the formal attribute set of the raw texture element.