Image Enhancement Using a Multi-Dimensional Model

• US 20140340394A1
• Filed: 05/20/2013
• Published: 11/20/2014
• Est. Priority Date: 05/20/2013
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Mattila, Ville-Veikko
• Granted Patent: US 9,454,848 B2
• Time in Patent Office: Days
• US Class Current: 345/420
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/344 involving models

Abstract

A method and apparatus for enhancing an image capture of a geographic area is presented. The enhancement involves receiving an image and aligning a three dimensional model to the received image. A view of the three dimensional model defined by the outline of the received image may be determined. A point of interest in the determined view of the aligned three dimensional model may be identified. A transition may be triggered between the received image to information from the three dimensional model associated with the point of interest.

Claims

1. A method comprising:

receiving an image;

aligning, with a processor, a three dimensional model to the received image;

determining a view of the three dimensional model defined by the outline of the received image;

identifying a point of interest in the determined view of the aligned three dimensional model; and

transitioning from the received image to information from the three dimensional model associated with the point of interest.

2. The method of claim 1, wherein the transitioning is triggered automatically after a period of time.

3. The method of claim 2, wherein a plurality of points of interest are identified in the determined view, and transitioning further comprises transitioning between the plurality of points of interest in an order based on a point of interest hierarchy.

4. The method of claim 1, further comprising:

modifying the received image to include an area of interest that correlates to the point of interest.

5. The method of claim 4, wherein the transitioning is triggered by selecting the area of interest in the received image.

6. The method of claim 1, wherein the transitioning comprises transitioning to a perspective of the point of interest in the three dimensional model.

7. The method of claim 6, wherein a presented orientation of the point of interest in the three dimensional model is substantially similar to the orientation of the point of interest as represented in the received image.

8. The method of claim 1, wherein the information from the three dimensional model comprises a name of the point of interest, hours of operation of the point of interest, or background information relating to the point of interest.

9. The method of claim 1, wherein the received image comprises registration information, and the determined view of the three dimensional model is determined using the registration information.

10. An apparatus comprising:

a memory configured to store an image and a three dimensional model of a geographic area represented by the image; and

a controller configured to;

align the three dimensional model to the image, wherein the geographic area comprises a point of interest, and

transition from the image to information associated with the point of interest in the three dimensional model.

11. The apparatus of claim 10, further comprising:

an image capture device configured to generate the image from a physical view of the geographic area.

12. The apparatus of claim 10, wherein the apparatus further comprises:

position circuitry configured to determine position information, wherein the controller is further configured to associate the position information with the image as registration information, and the registration information is used to align the three dimensional model to the image.

13. The apparatus of claim 10, wherein there are a plurality of points of interest in the geographic area, and the controller is further configured to transition between the plurality of points of interest.

14. The apparatus of claim 10, wherein the controller is further configured to:

modify the image to include an area of interest that correlates to the point of interest.

15. The apparatus of claim 10, wherein the transitioning is triggered by selecting the area of interest.

16. The apparatus of claim 10, further comprising:

a communication interface configured to download at least a portion of the three dimensional model corresponding to the geographic area.

17. A non-transitory computer readable medium including instructions that when executed by a processor are operable to:

receive an image;

align the received image to a model;

display the received image in an active view;

identify a point of interest in the received image that correlates to the point of interest as represented in the model; and

transition the active view from the received image to the point of interest.

18. The non-transitory computer readable medium of claim 17, wherein the transitioning is automatic.

19. The non-transitory computer readable medium of claim 17, wherein the non-transitory computer readable medium is a memory of a mobile device.

20. The non-transitory computer readable medium of claim 19, wherein the instructions are further operable to cause the processor to:

capture the received image as two dimensional visual data representing a physical view of a geographic area.