METHOD AND APPARATUS FOR CORRELATING AND NAVIGATING BETWEEN A LIVE IMAGE AND A PRERECORDED PANORAMIC IMAGE

• US 20120033032A1
• Filed: 07/08/2011
• Published: 02/09/2012
• Est. Priority Date: 12/14/2009
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Kankainen, Mikko Tapio
• Granted Patent: US 9,372,094 B2
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

An approach is provided for correlating and navigating between a live camera image and a prerecorded panoramic image. A mapping and augmented reality application correlates at least one live image with a prerecorded panoramic image, when a first location of a device used to capture the at least one live image substantially matches or falls within a predetermined proximity of a second location of a device used to capture the panoramic prerecorded image. The mapping and augmented reality application causes, at least in part, alternating of the at least one live image and the prerecorded panoramic image in a presentation on a screen of the device capturing the at least one live image.

Claims

1. A method comprising facilitating a processing of and/or processing (1) data and/or (2) information and/or (3) at least one signal, the (1) data and/or (2) information and/or (3) at least one signal based, at least in part, on the following:

a correlation of at least one live image with a prerecorded panoramic image, when a first location of a device used to capture the at least one live image substantially matches a second location of a device used to capture the panoramic prerecorded image; and

an alternating of the at least one live image and the prerecorded panoramic image in a presentation on a screen of the device capturing the at least one live image.

2. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

an augmenting into at least one of the images on the screen content related to one or more point of interest shown in the at least one of the images.

3. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

an input specifying a switch of images; and

in response to the input, a switching of a presentation on the screen between the at least one live image and the prerecorded panoramic image.

4. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a condition of an image switching; and

a switching of a presentation on the screen between the at least one live image and the prerecorded panoramic image, when the condition is met.

5. A method of claim 1, wherein the at least one live image is automatically alternated to the prerecorded panoramic image, when a viewing tag is navigating on the screen to an edge of the at least one live image.

6. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a presentation on the screen of a viewpoint of the prerecorded panoramic image according to a tilt angle and directional heading of the device with the screen.

7. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a stitching of the at least one live image with the prerecorded panoramic image thereby alternating the presentation on the screen.

8. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination to share at least one of the first and second locations with one or more other devices; and

an association of the prerecorded panoramic image, the at least one live image, one or more other prerecorded panoramic images, one or more other live images, or a combination thereof with the shared locations.

9. A method of claim 8, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of information for causing, at least in part, a presentation of the prerecorded panoramic image, the at least one live image, the one or more other prerecorded panoramic images, the one or more other live images, or a combination thereof,

wherein the association is based, at least in part, on the information.

10. A method of claim 8, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of the prerecorded panoramic image, the at least one live image, the one or more other prerecorded panoramic images, the one or more other live images, or a combination thereof to determine proximity information with respect to at least one of the first and second locations,

wherein the association is based, at least in part, on the proximity information.

11. A method of claim 8, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of the one or more other prerecorded panoramic images, the one or more other live images, or a combination thereof based, at least in part, on a third location that is proximate to at least one of the first and second locations; and

a rendering of a representation of the device, a user of the device, information associated with the user, or a combination thereof in the one or more other prerecorded panoramic images, the one or more other live images, or a combination thereof.

12. A method of claim 8, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a rendering of the association as an interactive user interface element including, at least in part, an icon, a thumbnail, or a combination thereof.

13. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

correlate at least one live image with a prerecorded panoramic image, when a first location of a device used to capture the at least one live image substantially matches or falls within a predetermined proximity of a second location of a device used to capture the panoramic prerecorded image; and

cause, at least in part, alternating of the at least one live image and the prerecorded panoramic image in a presentation on a screen of the device capturing the at least one live image.

14. An apparatus of claim 13, wherein the apparatus is further caused to:

cause, at least in part, augmenting into at least one of the images on the screen content related to one or more point of interest shown in the at least one of the images.

15. An apparatus of claim 13, wherein the apparatus is further caused to:

cause, at least in part, reception of an input specifying a switch of images; and

in response to the input, switch presentation on the screen between the at least one live image and the prerecorded panoramic image.

16. An apparatus of claim 13, wherein the apparatus is further caused to:

cause, at least in part, reception of a condition of an image switching; and

switch presentation on the screen between the at least one live image and the prerecorded panoramic image, when the condition is met.

17. An apparatus of claim 13, wherein the at least one live image is automatically alternated to the prerecorded panoramic image, when a viewing tag is navigating on the screen to an edge of the at least one live image.

18. An apparatus of claim 13, wherein the apparatus is further caused to:

determine to share at least one of the first and second locations with one or more other devices; and

cause, at least in part, an association of the prerecorded panoramic image, the at least one live image, one or more other prerecorded panoramic images, one or more other live images, or a combination thereof with the shared locations.

19. An apparatus of claim 18, wherein the apparatus is further caused to:

determine information for causing, at least in part, a presentation of the prerecorded panoramic image, the at least one live image, the one or more other prerecorded panoramic images, the one or more other live images, or a combination thereof,

wherein the association is based, at least in part, on the information.

20. An apparatus of claim 18, wherein the apparatus is further caused to:

process and/or facilitate a processing of the prerecorded panoramic image, the at least one live image, the one or more other prerecorded panoramic images, the one or more other live images, or a combination thereof to determine proximity information with respect to at least one of the first and second locations,

wherein the association is based, at least in part, on the proximity information.

21-52. -52. (canceled)