Method, system, and computer-readable data storage device for creating and displaying three-dimensional features on an electronic map display

• US 9,984,500 B2
• Filed: 10/27/2015
• Issued: 05/29/2018
• Est. Priority Date: 04/26/2011
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Lynch, James D.
• Primary Examiner(s): HAJNIK, DANIEL F
• Application Number:
  US14/924,154
• Publication Number:
  US 20160049002A1
• Time in Patent Office: 945 Days
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G01C 21/3852 Data derived from aerial or satellite images
• CPC Class Codes: G01C 21/3867 Geometry of map features, e.g. shape points, polygons or for simplified maps
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/61 Scene description
• CPC Class Codes: G09B 29/007 using computer methods
• CPC Class Codes: G09B 29/12 Relief maps relief models G09B25/06

Abstract

Methods, systems, and computer-readable data storage devices for generating and/or displaying a map with three-dimensional (3D) features are disclosed. For example, a method may comprise (i) defining a plurality of major three-dimensional regions (“major 3DRs”) and associating each major 3DR with a respective geographical area defined for a map stored in a computer-readable map database, and (ii) displaying, via a display device, one or more of the major 3DRs upon the map. Each major 3DR comprises a top, a bottom, and multiple sides. Each top, bottom, and side of each major 3DR comprises at least one surface. At least one surface of each major 3DR being displayed is textured with an image captured via an imaging device. The image textured onto each surface comprises an image captured by the imaging device when capturing images in a direction of that surface.

Claims

1. A method comprising:

generating, using a processor, a set of major three-dimensional regions (major 3DRs) associated with respective geographical data comprising a set of images derived from at least one point cloud, the respective geographical data stored in a computer-readable map database;

defining, using the processor, a set of minor three-dimensional regions (minor 3DRs) for a subset of the set of major 3DRs, wherein each minor 3DR pertains to a portion of the subset of the set of major 3DRs, wherein each minor 3DR comprises one or more levels of three-dimensional regions and at least some of the minor 3DRs in the set of minor 3DRs contain more than one level of three-dimensional regions;

projecting, using the processor, a subset of the set of images onto at least the subset of the set of major 3DRs;

associating the subset of the set of images with a road segment, wherein a first wall of the subset of the set of major 3DRs corresponds to a first side of the road segment and a second wall of the subset of the set of major 3DRs corresponds to a second side of the road segment; and

generating a map including at least the subset of the set of major 3DRs, including the subset of projected images, and the defined set of minor 3DRs in proximity to the road segment, wherein a resolution of the map is based on the one or more levels of each respective minor 3DR in the set of minor 3DRs, wherein the resolution of the map is higher with more levels of three-dimensional regions and lower with fewer levels of three-dimensional regions.

2. The method of claim 1, further comprising:

retrieving, using the processor, the subset of projected images for a selected location; and

displaying, using a display device, the map including the subset of projected images in proximity to the road segment.

3. The method of claim 1, further comprising:

compiling, using the processor, the respective geographical data for use with a navigation device.

4. The method of claim 1, wherein the computer-readable map database comprises a road network including the road segment.

5. The method of claim 1, wherein the projected images are configured for use with a navigation device.

6. The method of claim 1, wherein the subset of projected images derived from the at least one point cloud and included in the map include data for an object adjacent to the road segment.

7. The method of claim 6, wherein the object adjacent to the road segment is a tree, a lamp post or a fire hydrant.

8. The method of claim 1, further comprising:

retrieving, using the processor, from the computer-readable map database, point-of-interest data associated with a particular projected image of the set of major 3DRs.

9. An apparatus comprising:

at least one processor; and

at least one computer-readable map database including computer-readable program instructions for one or more programs;

the at least one computer-readable map database and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform;

generating a set of major three-dimensional regions (major 3DRs) associated with respective geographical data comprising a set of images derived from at least one point cloud, the respective geographical data stored in a computer-readable map database;

generating a set of minor three-dimensional regions (minor 3DRs) within one of the major 3DRs, wherein each minor 3DR comprises one or more levels of three-dimensional regions and at least some of the minor 3DRs in the set of minor 3DRs contain more than one level of three-dimensional regions, wherein a size of a minor 3DR in the set of minor 3DRs decreases as a resolution of the minor 3DR in the set of minor 3DRs increases, and wherein the size of the minor 3DR in the set of minor 3DRs increases as the resolution of the minor 3DR in the set of minor 3DRs decreases;

projecting a first subset of the set of images onto a first surface of a subset of the set of major 3DRs;

projecting a second subset of the set of images onto a second surface of the subset of the set of major 3DRs;

projecting a third subset of the set of images onto a third surface of the subset of the set of major 3DRs;

associating the first subset of the set of images with a road link and a first viewpoint;

associating the second subset of the set of images with the road link and a second viewpoint; and

generating a map including at least the subset of the set of major 3DRs, including the first, second, and third subset of images, and the set of minor 3DRs in proximity to the road link, wherein a resolution of the map is based on the one or more levels and resolution of each respective minor 3DR in the set of minor 3DRs.

10. The apparatus of claim 9, further comprising:

a display device configured to display the first and second subset of images on the same plane.

11. The apparatus of claim 9, wherein the processor is configured to display the first and second subset of images for a selected location using a display device.

12. The apparatus of claim 9, wherein the set of major 3DRs are associated with road link data.

13. The apparatus of claim 9, wherein the computer-readable map database comprises a road network, including a road link.

14. The apparatus of claim 9, wherein the subset of projected images included in the map include an object adjacent to the road link.

15. The apparatus of claim 9, wherein the respective geographical data is configured for use with a navigation device.

16. A method comprising:

capturing, using at least one image device, geographical data comprising a set of images derived from at least one point cloud;

storing the set of images in a computer-readable map database;

determining, using a global positioning system, a respective geographic location for each of the stored set of images;

associating the set of images with a road segment based on location data from the global positioning system;

generating, using a processor, a set of major three-dimensional regions (major 3DRs) including multiple surfaces, including a first surface for a first side of the road segment and a first subset of the set of images and a second surface for a second side of the road segment and a second subset of the set of images;

generating, using the processor, a minor three-dimensional region (minor 3DR) within one of the major 3DRs, wherein the minor 3DR comprises one or more levels of three-dimensional regions; and

generating a map including the set of images for the major 3DRs and the minor 3DR in proximity to the road segment, wherein a resolution of the map is based on a number of levels of the one or more levels of the minor 3DR, wherein the number of levels of the one or more levels of the minor 3DR is based on a distance from a viewpoint of the map.

17. The method of claim 16, wherein the at least one image device comprises multiple cameras, each facing in a different direction.

18. The method of claim 16, wherein the at least one image device is capable of capturing 360 degrees of imagery.

19. The method of claim 16, wherein the projected images are configured for use with a navigation device.

20. The method of claim 16, wherein the computer-readable map database comprises a road network, including the road segment associated with the set of images.