SELECTING TWO-DIMENSIONAL IMAGERY DATA FOR DISPLAY WITHIN A THREE-DIMENSIONAL MODEL

• US 20150269785A1
• Filed: 03/19/2014
• Published: 09/24/2015
• Est. Priority Date: 03/19/2014
• Status: Active Grant

• Current Assignee: Matterport, Inc
• Original Assignee: Matterport, Inc
• Inventors: Bell, Matthew Tschudy, Gausebeck, David Alan, Coombe, Gregory William, Ford, Daniel, Brown, William John
• Granted Patent: US 10,163,261 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images

Abstract

Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.

Claims

1. A system, comprising

a computer-readable storage media having stored thereon computer executable components, and

a processor configured to execute the following computer executable components stored in the computer-readable storage media:

an imagery component that receives a model representing a three dimensional environment; and

a selection component that selects, based on the model, two dimensional imagery data as candidate imagery data for transitioning to.

2. The system of claim 1, wherein the selection component selects the two dimensional imagery data based on a defined selection criterion.

3. The system of claim 2, wherein the selection criterion is based on a capture position of the two dimensional imagery data.

4. The system of claim 2, wherein the selection criterion is based on a quality metric associated with the two dimensional imagery data.

5. The system of claim 2, wherein the selection criterion is based on a navigation position associated with the model.

6. The system of claim 2, wherein the selection component determines an orientation of the selected two dimensional imagery data.

7. The system of claim 2, wherein the selection component selects the two dimensional imagery data based on a weighted confidence score.

8. The system of claim 1, further comprising:

a construction component that renders the three dimensional model based at least in part on imagery data and position data.

9. The system of claim 8 further comprising:

a display control component that generates, based on the model and an associated navigation position, a notification representing availability of the selected two dimensional imagery data.

10. The system of claim 9, wherein the display control component generates the notification as at least one of a notification token, a pop up entity, an audible signal, or a vibration signal.

11. The system of claim 8, further comprising:

a transition component that transitions the rendering of the model to a rendering of the selected two dimensional imagery data.

12. The system of claim 11, wherein the transition component renders the two dimensional imagery data as an overlay above the three dimensional model.

13. The system of claim 11, wherein the transition component renders the two dimensional imagery data as a rendering in an imagery portal.

14. A method, comprising

using a processor to execute the following computer executable instructions stored in a memory to perform the following acts:

receiving a three dimensional model; and

selecting, based on the three dimensional model, a candidate two dimensional image from a set of two dimensional images for display.

15. The method of claim 14, wherein the acts further comprise:

receiving the three dimensional model in response to generating the three dimensional model from data describing positions and data describing images associated with an environment.

16. The method of claim 14 wherein the acts further comprise:

in response to detecting a triggering event, generating a notification of an availability of the candidate two dimensional image.

17. The method of claim 16 wherein the acts further comprise:

wherein the notification comprises at least one of a graphical notification, a textual notification, an audible notification, or a motion notification.

18. The method of claim 14 wherein the acts further comprise:

generating a first display of the three dimensional model; and

navigating the first display of the three dimensional model.

19. The method of claim 18 wherein the acts further comprise:

generating, based on the navigating of the first display, a second display of the candidate two dimensional image.

20. A computer readable storage device comprising instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

generating a three dimensional model of an environment based on a collection of three dimensional positional data and two dimensional image data;

in response to occurrence of a first event, selecting a two dimensional image; and

generating, based on the selecting the two dimensional image, a display of the two dimensional image.

21. The computer readable storage device of claim 20, wherein the operations further comprises:

determining occurrence of the first event based on at least one of a viewpoint of the three dimensional model, a passage of time, or user input.

22. The computer readable storage device of claim 20 wherein the operations further comprise:

selecting the two dimensional image based on a determined distance between a viewpoint associated with the two dimensional image and a navigational position of the three dimensional model.

23. The computer readable storage device of claim 20, wherein the operations further comprise:

generating the three dimensional model in at least one of a walking mode, an orbital mode, or a floor plan mode.

24. The computer readable storage device of claim 20, wherein the operations further comprise:

generating a set of visual notification tokens within the three dimensional model.