System and method of texturing a 3D model from video

• US 8,749,580 B1
• Filed: 08/12/2011
• Issued: 06/10/2014
• Est. Priority Date: 08/12/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Lininger, Scott
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US13/209,115
• Time in Patent Office: 1,033 Days
• Field of Search: 348/224.1, 348/229.1, 348/121, 348/228.1, 348/771, 348/345, 382/272, 382/100, 382/284, 345/629, 345/594, 345/473, 345/84, 345/272, 345/100, 345/284
• US Class Current: 345/629
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G11B 27/322 used signal is digitally coded

Abstract

A method and system for applying photo texture acquired from a video resource to a 3D model operates within a 3D modeling system. The modeling system includes a modeling application operating on a workstation and a storage device containing a video resource. A 3D model is created or edited within the 3D modeling system. For a selected surface, the method and system allow selection of a video resource, selection of a video frame of the video resource, and selection of an area of the video frame to use as a photo texture to apply to the selected surface. The selected area of the video frame is copied and mapped to the selected surface of the 3D model.

Claims

1. A computer-implemented method for applying a photo texture to a 3D model of a real-world object, the method comprising:

receiving geolocation information for a point in a model space in which the 3D model is created;

receiving a selection of a surface of the 3D model;

receiving a request to apply to the selected surface a photo texture acquired from a video resource;

receiving a selection of the video resource from which to acquire the photo texture;

receiving a selection of a video frame of the video resource;

using information stored as metadata with the selected video resource to determine a video frame of the video resource to display;

receiving a selection of an area of the selected video frame to apply as a photo texture to the selected surface; and

applying the selected area of the selected video frame to the selected surface,

wherein the video resource includes geotagging metadata indicating camera locations associated with a plurality of bookmarks of the video resource, and

wherein determining a video frame of the video resource to display comprises;

selecting a bookmark having associated geotagging metadata meeting pre-determined criteria relative to the received geolocation information; and

displaying the first frame of video after the bookmark, and

wherein selecting a bookmark having associated geotagging metadata meeting pre-determined criteria relative to the received geolocation information comprises selecting a bookmark having associated geotagging metadata indicating a one of the camera locations having a position closest to a calculated best camera location.

2. The method of claim 1, further comprising:

initiating a search of metadata associated with a plurality of video resources to determine one or more video resources according to the received geolocation information.

3. The method of claim 1, further comprising determining the likely best camera location by:

finding a center point of the selected surface; and

determining a location a pre-determined distance from the center point.

4. The method of claim 1, wherein receiving a selection of the video resource from which to acquire the photo texture comprises receiving a selection of a video file stored locally on a computer implementing the method.

5. The method of claim 1, wherein receiving a selection of the video resource from which to acquire the photo texture comprises receiving a selection of a video file stored remotely and accessed via a network connection.

6. The method of claim 1, wherein applying the selected area of the selected video frame to the selected surface comprises:

copying the selected area of the selected video frame; and

UV mapping the created second image onto the selected surface of the 3D model.

7. A system comprising:

a storage device storing a plurality of video resources;

a display device;

a processor communicatively coupled to the storage device and to the display device; and

a memory device storing a set of machine readable instructions executable by the processor, the instructions operable to cause the processor to;

facilitate the creation of a 3D model in a 3D space represented on the display device;

receive geolocation information for a point in the 3D space in which the 3D model is created;

receive a selection of a surface of the 3D model;

receive a request to apply to the selected surface a photo texture acquired from a video resource stored on the storage device;

receive a selection of the video resource from which to acquire the photo texture;

use information stored as metadata with the selected video resource to determine a video frame of the video resource to display;

receive a selection of a video frame of the video resource;

receive a selection of an area of the selected video frame to apply as the photo texture to the selected surface; and

apply the selected area of the selected video frame to the selected surface, wherein the video resource includes geotagging metadata indicating camera locations associated with a plurality of bookmarks of the video resource, each bookmark marking a position within the video resource, and wherein determining a video frame of the video resource to display comprises;

selecting a bookmark having associated geotagging metadata meeting pre-determined criteria relative to the received geolocation information; and

displaying the first video frame of the video after the bookmark, and wherein selecting a bookmark having associated geotagging metadata meeting pre-determined criteria relative to the received geolocation information comprises selecting a bookmark having associated geotagging metadata indicating a one of the camera locations having a position closest to a calculated best camera location.

8. The system of claim 7, wherein the instructions are further operable to cause the processor to:

initiate a search of metadata associated with a plurality of video resources to determine one or more video resources according to the received geolocation information.

9. The system of claim 7, wherein the instructions are further operable to cause the processor to determine the likely best camera location by:

finding a center point of the selected surface; and

determining a location a pre-determined distance from the center point.

10. The system of claim 7, wherein the storage device is a web server coupled to the processor via a network connection.

11. A tangible, non-transitory computer-readable medium storing instructions, the instructions when executed by a processor, operable to cause the processor to:

create a 3-dimensional (3D) digital model of a real-world object;

receive geolocation information for a point in a 3D space in which the 3D model is created;

receive a selection of a surface of the 3D model; and

receive a request to apply to the selected surface a photo texture acquired from a video frame of a video resource and, in response to the request;

receive a selection of the video resource that includes the video frame from which to acquire the photo texture;

use information stored as metadata with the selected video resource to determine a video frame of the video resource to display;

receive a selection of the video frame of the video resource;

receive a selection of an area of the selected video frame to apply as a photo texture to the selected surface; and

apply the selected area of the selected video frame to the selected surface, wherein the video resource includes geotagging metadata indicating camera locations associated with a plurality of bookmarks of the video resource, each bookmark marking a position within the video resource, and wherein determining a video frame of the video resource to display comprises;

selecting a bookmark having associated geotagging metadata meeting pre-determined criteria relative to the received geolocation information; and

displaying the first video frame of the video after the bookmark, and wherein selecting a bookmark having associated geotagging metadata meeting pre-determined criteria relative to the received geolocation information comprises selecting a bookmark having associated geotagging metadata indicating a one of the camera locations having a position closest to a calculated best camera location.

12. The computer-readable medium of claim 11, wherein the instructions are further operable to cause the processor to:

receive geolocation information for a 3D space in which the model is created;

determine geolocation information for one or more points of the 3D model; and

initiate a search for one or more video resources according to one or both of the received geolocation information and the determined geolocation information, and

wherein receiving a selection of a video resource comprises receiving a selection of one of a plurality of search results returned by the initiated search.

13. The computer-readable medium of claim 12, wherein receiving a selection of a video resource comprises receiving a selection of a web-hosted video resource.

14. The computer-readable medium of claim 11, wherein applying the selected area of the selected video frame to the selected surface comprises:

copying the selected area of the selected video frame; and

UV mapping the created second image onto the selected surface of the 3D model.