Method and apparatus for correlating and navigating between a live image and a prerecorded panoramic image

• US 9,766,089 B2
• Filed: 12/14/2009
• Issued: 09/19/2017
• Est. Priority Date: 12/14/2009
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Kankainen, Mikko
• Primary Examiner(s): Chauhan, Ulka
• Assistant Examiner(s): Yoon, Sae Won
• Application Number:
  US12/637,057
• Publication Number:
  US 20110141141A1
• Time in Patent Office: 2,836 Days
• Field of Search: 382284, 348143, 348 1401, 3482181
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

An approach is provided for correlating and navigating between a live camera image and a prerecorded panoramic image. A mapping and augmented reality application correlates at least one live image with a prerecorded panoramic image, when a location of a device used to capture the at least one live image matches a location of a device used to capture the panoramic prerecorded image. The mapping and augmented reality application causes, at least in part, automatically alternating presentation on a screen of the device capturing the at least one live image, of the at least one live image and the prerecorded panoramic image.

Claims

1. A method comprising:

correlating, with one or more processors, at least one live image with a prerecorded panoramic image when a location of a device used to capture the at least one live image matches a location of a device used to capture the panoramic prerecorded image; and

causing, with the one or more processors, at least in part, switching between presentation on a screen of the device capturing the at least one live image, of the at least one live image and the prerecorded panoramic image,

wherein address, geographic coordinates, and/or longitude and latitude information is used for the location of the device, and

wherein the presentation on the screen only displays either the at least one live image or the prerecorded panoramic image.

2. A method of claim 1, further comprising:

causing, at least in part, augmenting into at least one of the at least one live image and the prerecorded panoramic image that is on the screen content related to one or more points of interest shown in the at least one of the images.

3. A method of claim 1, wherein switching between presentation on the screen of the at least one live image and the prerecorded panoramic image activates in response to reception of an input specifying image switching, and the switching of presentation on the screen between the at least one live image and the prerecorded panoramic image successively continues after activation in response to another input specifying image switching.

4. A method of claim 1, wherein switching between presentation on the screen of the at least one live image and the prerecorded panoramic image activates in response to reception of a condition specifying image switching, and the switching of presentation on the screen between the at least one live image and the prerecorded panoramic image successively continues after activation in response to another condition specifying image switching.

5. A method of claim 1, wherein the at least one live image is automatically switched to the prerecorded panoramic image, when a viewing tag is navigating on the screen to an edge of the at least one live image.

6. A method of claim 1, further comprising:

causing, at least in part, presentation on the screen a viewpoint of the prerecorded panoramic image according to a tilt angle and directional heading of the device with the screen.

7. A method of claim 1, further comprising:

during displaying the live image and an indication of a turn in the live image, causing switching to a prerecorded panoramic image taken from the turn,

wherein switching to the prerecorded panoramic image taken from the turn activates in response to a user tapping on the turn.

8. An apparatus comprising:

at least one processor; and

at least one memory including computer program code,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

correlate at least one live image with a prerecorded panoramic image when a location of a device used to capture the at least one live image matches a location of a device used to capture the panoramic prerecorded image; and

cause, at least in part, switching between presentation on a screen of the device capturing the at least one live image, of the at least one live image and the prerecorded panoramic image,

wherein address, geographic coordinates, and/or longitude and latitude information is used for the location of the device, and

wherein the presentation on the screen only displays either the at least one live image or the prerecorded panoramic image.

9. An apparatus of claim 8, wherein the apparatus is further caused to:

cause, at least in part, augmenting into at least one of the images on the screen content related to one or more points of interest shown in the at least one of the images.

10. An apparatus of claim 8, wherein switching between presentation on the screen of the at least one live image and the prerecorded panoramic image activates in response to reception of an input specifying image switching, and the switching of presentation on the screen between the at least one live image and the prerecorded panoramic image successively continues after activation in response to another input specifying image switching.

11. An apparatus of claim 8, wherein switching between presentation on the screen between the at least one live image and the prerecorded panoramic image activates in response to reception of a condition specifying image switching, and the switching of presentation on the screen between the at least one live image and the prerecorded panoramic image successively continues after activation in response to another condition specifying image switching.

12. An apparatus of claim 8, wherein the at least one live image is automatically switched to the prerecorded panoramic image, when a viewing tag is navigating on the screen to an edge of the at least one live image.

13. An apparatus of claim 8, wherein the apparatus is further caused to:

cause, at least in part, presentation on the screen a viewpoint of the prerecorded panoramic image according to a tilt angle and directional heading of the device with the screen.

14. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

correlating at least one live image with a prerecorded panoramic image when a location of a device used to capture the at least one live image matches a location of a device used to capture the panoramic prerecorded image; and

causing, at least in part, switching between presentation on a screen of the device capturing the at least one live image, of the at least one live image and the prerecorded panoramic image,

wherein address, geographic coordinates, and/or longitude and latitude information is used for the location of the device, and

wherein the presentation on the screen only displays either the at least one live image or the prerecorded panoramic image.

15. A non-transitory computer-readable storage medium of claim 14, wherein the apparatus is caused to further perform:

causing, at least in part, augmenting into at least one of the images on the screen content related to one or more points of interest shown in the at least one of the images.

16. A non-transitory computer-readable storage medium of claim 14, wherein switching between presentation on the screen of the at least one live image and the prerecorded panoramic image activates in response to reception of an input specifying image switching, and the switching of presentation on the screen between the at least one live image and the prerecorded panoramic image successively continues after activation in response to another input specifying image switching.

17. A non-transitory computer-readable storage medium of claim 14, wherein switching between presentation on the screen of the at least one live image and the prerecorded panoramic image activates in response to reception of a condition specifying image switching, and the switching of presentation on the screen between the at least one live image and the prerecorded panoramic image successively continues after activation in response to another condition specifying image switching.

18. A non-transitory computer-readable storage medium of claim 14, wherein the at least one live image is automatically switched to the prerecorded panoramic image, when a viewing tag is navigating on the screen to an edge of the at least one live image.

19. A non-transitory computer-readable storage medium of claim 14, wherein the apparatus is caused to further perform:

causing, at least in part, presentation on the screen a viewpoint of the prerecorded panoramic image according to a tilt angle and directional heading of the device with the screen.