METHOD, APPARATUS AND COMPUTER PROGRAM PRODUCT FOR PROVIDING NAVIGATION INFORMATION IN RELATION TO AUGMENTED REALITY GUIDANCE

• US 20160349062A1
• Filed: 05/27/2015
• Published: 12/01/2016
• Est. Priority Date: 05/27/2015
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Campan, Marius, Delitsyn, Igor, Jagoda, Michal, Koblenz, Johannes
• Granted Patent: US 9,927,246 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/26 specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/265 constructional aspects of navigation devices, e.g. housings, mountings, displays G01C21/3688 takes precedence
• CPC Class Codes: G01C 21/28 with correlation of data from several navigational instruments
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method, apparatus and computer program product are provided to provide navigational information in conjunction with augmented reality guidance. In the context of a method, the position of a mobile terminal is determined. The method also includes determining an orientation of the mobile terminal. Based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, the method further includes providing for augmentation of a display of at least a portion of an image associated with the position. The method provides for augmentation of the display of at least the portion of the image by causing navigational information to be presented upon a sidewall surface of a structure within the image. A corresponding apparatus and computer program product are also provided.

Claims

1. A method comprising:

determining a position of a mobile terminal;

determining an orientation of the mobile terminal; and

based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, providing for augmentation of a display of at least a portion of an image associated with the position, wherein providing for augmentation of the display of at least the portion of the image comprises causing navigational information to be presented upon a sidewall surface of a structure within the image.

2. A method according to claim 1 further comprising:

determining whether the orientation of the mobile terminal has changed to a different orientation; and

in an instance in which the orientation of the mobile terminal has changed, providing for augmentation of the display of a different portion of the image captured by the mobile terminal based at least in part upon the different orientation of the mobile terminal.

3. A method according to claim 1 further comprising:

determining that the position of the mobile terminal has changed to a different position; and

providing for augmentation of the display of at least a portion of the image captured by the mobile terminal at the different position by causing the navigational information to be presented upon the sidewall surface of the structure within the image captured by the mobile terminal at the different position.

4. A method according to claim 1 wherein causing navigational information to be presented upon the sidewall surface of the structure within the image comprises causing a directional arrow or a sign to be presented upon the sidewall surface of the structure within the image.

5. A method according to claim 4 wherein causing the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image comprises causing a perspective view of the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image.

6. A method according to claim 1 wherein causing navigational information to be presented upon the sidewall surface of the structure within the image comprises causing navigational information to be presented a predefined distance above street level upon the sidewall surface of the structure within the image.

7. A method according to claim 1 wherein causing navigational information to be presented upon the sidewall surface of the structure within the image comprises causing navigational information to be presented upon the sidewall surface of a building within the image, wherein the building is laterally offset to a side of a street within the image.

8. An apparatus comprising at least one processor and at least one memory including computer program code, wherein the memory and computer program code are configured to, with the processor, cause the apparatus to:

determine a position of a mobile terminal;

determine an orientation of the mobile terminal; and

based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, provide for augmentation of a display of at least a portion of an image associated with the position, wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to provide for augmentation of the display of at least the portion of the image by causing navigational information to be presented upon a sidewall surface of a structure within the image.

9. An apparatus according to claim 8 wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to:

determine whether the orientation of the mobile terminal has changed to a different orientation; and

in an instance in which the orientation of the mobile terminal has changed, provide for augmentation of the display of a different portion of the image captured by the mobile terminal based at least in part upon the different orientation of the mobile terminal.

10. An apparatus according to claim 8 wherein the memory and the computer program code are further configured to, with the processor, cause the apparatus to:

determine that the position of the mobile terminal has changed to a different position; and

provide for augmentation of the display of at least a portion of the image captured by the mobile terminal at the different position by causing the navigational information to be presented upon the sidewall surface of the structure within the image captured by the mobile terminal at the different position.

11. An apparatus according to claim 8 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause navigational information to be presented upon the sidewall surface of the structure within the image by causing a directional arrow or a sign to be presented upon the sidewall surface of the structure within the image.

12. An apparatus according to claim 11 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image by causing a perspective view of the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image.

13. An apparatus according to claim 8 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause navigational information to be presented upon the sidewall surface of the structure within the image by causing navigational information to be presented a predefined distance above street level upon the sidewall surface of the structure within the image.

14. An apparatus according to claim 8 wherein the memory and the computer program code are configured to, with the processor, cause the apparatus to cause navigational information to be presented upon the sidewall surface of the structure within the image by causing navigational information to be presented upon the sidewall surface of a building within the image, wherein the building is laterally offset to a side of a street within the image.

15. A computer program product comprising at least one non-transitory computer readable medium having program code portions stored thereon, wherein the program code portions are configured, upon execution, to:

determine a position of a mobile terminal;

determine an orientation of the mobile terminal; and

based at least in part upon the position and orientation of the mobile terminal and map data associated therewith, provide for augmentation of a display of at least a portion of an image associated with the position, wherein the program code portions configured to provide for augmentation of the display of at least the portion of the image comprise program code portions configured to cause navigational information to be presented upon a sidewall surface of a structure within the image.

16. A computer program product according to claim 15 wherein the program code portions are further configured, upon execution, to:

determine whether the orientation of the mobile terminal has changed to a different orientation; and

in an instance in which the orientation of the mobile terminal has changed, provide for augmentation of the display of a different portion of the image captured by the mobile terminal based at least in part upon the different orientation of the mobile terminal.

17. A computer program product according to claim 15 wherein the program code portions are further configured, upon execution, to:

determine that the position of the mobile terminal has changed to a different position; and

provide for augmentation of the display of at least a portion of the image captured by the mobile terminal at the different position by causing the navigational information to be presented upon the sidewall surface of the structure within the image captured by the mobile terminal at the different position.

18. A computer program product according to claim 15 wherein the program code portions configured to cause navigational information to be presented upon the sidewall surface of the structure within the image comprise program code portions configured to cause a directional arrow or a sign to be presented upon the sidewall surface of the structure within the image.

19. A computer program product according to claim 18 wherein the program code portions configured to cause the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image comprise program code portions configured to cause a perspective view of the directional arrow or the sign to be presented upon the sidewall surface of the structure within the image.

20. A computer program product according to claim 15 wherein the program code portions configured to cause navigational information to be presented upon the sidewall surface of the structure within the image comprise program code portions configured to cause navigational information to be presented a predefined distance above street level upon the sidewall surface of the structure within the image.