Method and system for navigating in panoramic images using voxel maps

• US 10,186,083 B1
• Filed: 07/28/2017
• Issued: 01/22/2019
• Est. Priority Date: 03/26/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Gray, Christopher
• Primary Examiner(s): Hoang, Peter
• Application Number:
  US15/662,754
• Time in Patent Office: 543 Days
• Field of Search: None
• CPC Class Codes: G06T 17/005 Tree description, e.g. octree, quadtree
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

The present disclosure describes a system and method that includes receiving a user selection of a portion of a first image. In response to the user-selection, a first identifier of three-dimensional space associated with the user-selection is determined and a second image is selected based on a portion of the second image being associated with the first identifier. The second image may be provided to the user to be displayed. The present disclosure also provides for mapping a portion of a first image to an identifier of three-dimensional space.

Claims

1. A method comprising:

receiving, by one or more computing devices, a user selection of a first portion of a first image, the first portion capturing at least a portion of a surface of an object, wherein the first image is one of a plurality of images stored in a server;

determining, by the one or more computing devices, that the first portion of the first image is associated with a first spatial identifier associated with a three-dimensional (3D) model of geographic space, the first spatial identifier identifying a first cube in the 3D model and a second cube in the 3D model, wherein the first cube is contained within the second cube;

transmitting, by the one or more computing devices, the first spatial identifier to the server;

receiving, by the one or more computing devices, a second image from the server, the second image having a second portion that is associated with the first spatial identifier; and

providing, by the one or more computing devices, the second image for display on a display.

2. The method of claim 1, wherein the user selection includes clicking on the first portion of the first image.

3. The method of claim 1, wherein the first portion of the first image is a pixel of the first image.

4. The method of claim 1, wherein the second image is received in panorama tiles, and the second image is provided for display according to orientation information received from the server.

5. The method claim 1, wherein the first cube and the second cube are part of an octree associated with the 3D model, the octree having a root cube that encompasses the Earth, the root cube having a side length on an order of 2²³ meters.

6. The method of claim 5, wherein the first spatial identifier is 78 bits.

7. The method of claim 1, wherein cubes in the lower level have a side length of about ⅛

meter.

8. A system comprising:

one or more computing devices;

a memory storing computer readable instructions of a program, wherein the instructions, when executed by the one or more computing devices, case the one or more computing devices to;

receive a user selection of a first portion of a first image, the first portion capturing at least a portion of a surface of an object, wherein the first image is one of a plurality of images stored in a server;

determine that the first portion of the first image is associated with a first spatial identifier associated with a three-dimensional (3D) model of geographic space, the first spatial identifier identifying a first cube in the 3D model and a second cube in the 3D model, wherein the first cube is contained within the second cube;

transmit the first spatial identifier to the server;

receive a second image from the server, the second image having a second portion that is associated with the first spatial identifier; and

provide the second image for display on a display.

9. The system of claim 8, wherein the user selection includes clicking on the first portion of the first image.

10. The system of claim 8, wherein the first portion of the first image is a pixel of the first image.

11. The system of claim 8, wherein the second image is received in panorama tiles, and the second image is provided for display according to orientation information received from the server.

12. The system of claim 8, wherein the first cube and the second cube are part of an octree associated with the 3D model, the octree having a root cube that encompasses the Earth, the root cube having a side length on an order of 2²³ meters.

13. The system of claim 8, wherein cubes in the lower level have a side length of about ⅛

meter.

14. A non-transitory, tangible computer-readable storage medium on which computer readable instructions of a program are stored, the instructions, when executed by one or more computing devices, cause the one or more computing devices to perform a method, the method comprising:

receiving a user selection of a first portion of a first image, the first portion capturing at least a portion of a surface of an object, wherein the first image is one of a plurality of images stored in a server;

determining that the first portion of the first image is associated with a first spatial identifier associated with a three-dimensional (3D) model of geographic space, the first spatial identifier identifying a first cube in the 3D model and a second cube in the 3D model, wherein the first cube is contained within the second cube;

transmitting the first spatial identifier to the server;

receiving a second image from the server, the second image having a second portion that is associated with the first spatial identifier; and

providing the second image for display on a display.

15. The medium of claim 14, wherein the user selection includes clicking on the first portion of the first image.

16. The medium of claim 14, wherein the first portion of the first image is a pixel of the first image.

17. The medium of claim 14, wherein the second image is received in panorama tiles, and the second image is provided for display according to orientation information received from the server.

18. The medium of claim 14, wherein the first cube and the second cube are part of an octree associated with the 3D model, the octree having a root cube that encompasses the Earth, the root cube having a side length on an order of 2²³ meters.

19. The medium of claim 18, wherein the first spatial identifier is 78 bits.

20. The medium of claim 14, wherein cubes in the lower level have a side length of about ⅛

meter.