Texture blending between view-dependent texture and base texture in a geographic information system

• US 9,704,282 B1
• Filed: 10/06/2015
• Issued: 07/11/2017
• Est. Priority Date: 06/19/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Dillard, Scott E., Golovinskiy, Aleksey, Allen, Brett A.
• Primary Examiner(s): Crawford, Jacinta M
• Assistant Examiner(s): Doan, Phuc
• Application Number:
  US14/875,886
• Time in Patent Office: 644 Days
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images

Abstract

Systems and methods for rendering a view-dependent texture in conjunction with a three-dimensional model of a geographic area are provided. A view-dependent texture can be rendered in conjunction with at least portions of the three-dimensional model. A base texture can be rendered for portions of the three-dimensional model in the same field of view that are viewed from a slightly different perspective than a reference direction associated with the view-dependent texture. For instance, a stretching factor can be determined for each portion of the three-dimensional model based on the reference direction and a viewpoint direction associated with the portion of the three-dimensional model. A base texture, a view-dependent texture, or a blended texture can be selected for rendering at the portion of the three-dimensional model based on the stretching factor.

Claims

1. A computer-implemented method of providing a three-dimensional model of a geographic area, comprising:

identifying, by one or more computing devices, a perspective of a virtual camera for viewing a polygon mesh, the polygon mesh modeling geometry of a geographic area;

identifying, by the one or more computing devices, a view-dependent texture associated with a reference direction, the view-dependent texture generated for viewing the three-dimensional model from a reference viewpoint associated with the reference direction;

identifying, by the one or more computing devices, a base texture generated for viewing the three-dimensional model from a plurality of different viewpoints;

determining, by the one or more computing devices, a viewpoint direction associated with a fragment of the polygon mesh, the viewpoint direction extending from the virtual camera towards the fragment; and

determining, by the one or more computing devices, a texture for display at the fragment based at least in part on an amount that a texture mapped image is stretched when mapped to the fragment when viewed from the viewpoint direction;

wherein the texture determined for display at the fragment comprises one or more elements of the base texture or the view-dependent texture;

wherein the texture is determined for display at the fragment based at least in part on a stretching factor indicative of the amount the texture mapped image is stretched when mapped to the fragment when viewed from the viewpoint direction;

wherein the view-dependent texture is selected for display at the fragment when the stretching factor is less than a first threshold;

wherein the base texture is selected for display at the fragment when the stretching factor is greater than a second threshold;

a blended texture is selected for display at the fragment based at least in part on the stretching factor when the stretching factor is between the first threshold and the second threshold, the blended texture comprising a blend between the base texture and the view-dependent texture.

2. The computer-implemented method of claim 1, wherein the stretching factor for the fragment is determined based at least in part on a surface normal associated with the fragment.

3. The computer-implemented method of claim 1, wherein the stretching factor is determined based at least in part by:

accessing, by the one or more computing devices, a mathematical model projecting a circular element in a two-dimensional space associated with the view-dependent texture as an ellipse on the polygon mesh, the ellipse having a minor axis and a major axis; and

determining, by the one or more computing devices, the stretching factor based at least in part on the major axis of the ellipse.

4. The computer-implemented method of claim 3, wherein the mathematical model specifies the minor axis of the ellipse based at least in part on a relationship between a surface normal associated with the fragment and the reference direction, the mathematical model further specifying a direction of the major axis based on a relationship between the minor axis of the ellipse and the surface normal, the mathematical model further specifying a magnitude of the major axis based on a relationship between the reference direction and the surface normal.

5. The computer-implemented method of claim 4, wherein the stretching factor is determined based at least in part on a relationship between the major axis of the ellipse and the viewpoint direction associated with the fragment.

6. The computer-implemented method of claim 1, wherein the stretching factor has an inverse texture stretch component for the fragment and a view stretch component for the fragment.

7. The computer implemented method of claim 6, wherein the inverse texture stretch component for the fragment is determined based on a relationship between the reference direction and a surface normal associated with the fragment.

8. The computer-implemented method of claim 7, wherein the view stretch component for the fragment is determined based on a relationship between the viewpoint direction associated with the fragment and the surface normal associated with the fragment.

9. The computer-implemented method of claim 1, wherein the reference viewpoint is a canonical viewpoint.

10. A computing system for rendering a three-dimensional model of a geographic area, the system comprising:

a display;

one or more processors;

one or more computer-readable media, the computer-readable media storing instructions that when executed by the one or more processors cause the processors to perform operations, the operations comprising;

identifying a perspective of a virtual camera for viewing a polygon mesh, the polygon mesh modeling geometry of a geographic area;

identifying a view-dependent texture associated with a reference direction, the view-dependent texture generated for viewing the three-dimensional model from a reference viewpoint associated with the reference direction;

identifying a base texture generated for viewing the three-dimensional model from a plurality of different viewpoints;

determining a viewpoint direction associated with a fragment of the polygon mesh, the viewpoint direction extending from the virtual camera towards the fragment; and

determining a texture for display at the fragment based at least in part on an amount that a texture mapped image is stretched when mapped to the fragment when viewed from the viewpoint direction;

wherein the texture determined for display at the fragment comprises one or more elements of the base texture or the view-dependent texture;

wherein the texture is determined for display at the fragment based at least in part on a stretching factor indicative of the amount the texture mapped image is stretched when mapped to the fragment when viewed from the viewpoint direction;

wherein the view-dependent texture is selected for display at the fragment when the stretching factor is less than a first threshold;

wherein the base texture is selected for display at the fragment when the stretching factor is greater than a second threshold;

a blended texture is selected for display at the fragment based at least in part on the stretching factor when the stretching factor is between the first threshold and the second threshold, the blended texture comprising a blend between the base texture and the view-dependent texture.

11. A tangible non-transitory computer-readable medium comprising computer-readable instructions that when executed by one or more processors, cause the one or more processors to perform operations of providing a three-dimensional model of a geographic area, the operations comprising:

identifying a perspective of a virtual camera for viewing a polygon mesh, the polygon mesh modeling geometry of a geographic area;

identifying a view-dependent texture associated with a reference direction, the view-dependent texture generated for viewing the three-dimensional model from a reference viewpoint associated with the reference direction;

identifying a base texture generated for viewing the three-dimensional model from a plurality of different viewpoints;

determining a viewpoint direction associated with a fragment of the polygon mesh, the viewpoint direction extending from the virtual camera towards the fragment; and

determining a texture for display at the fragment based at least in part on an amount that a texture mapped image is stretched when mapped to the fragment when viewed from the viewpoint direction;

wherein the texture determined for display at the fragment comprises one or more elements of the base texture or the view-dependent texture;

wherein the texture is determined for display at the fragment based at least in part on a stretching factor indicative of the amount the texture mapped image is stretched when mapped to the fragment when viewed from the viewpoint direction;

wherein the view-dependent texture is selected for display at the fragment when the stretching factor is less than a first threshold;

wherein the base texture is selected for display at the fragment when the stretching factor is greater than a second threshold;

a blended texture is selected for display at the fragment based at least in part on the stretching factor when the stretching factor is between the first threshold and the second threshold, the blended texture comprising a blend between the base texture and the view-dependent texture.