Methods, apparatuses, and computer-readable storage media for providing interactive navigational assistance using movable guidance markers

• US 9,525,964 B2
• Filed: 02/02/2012
• Issued: 12/20/2016
• Est. Priority Date: 02/02/2012
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Piippo, Petri, Vaittinen, Sampo T., Arrasvuori, Juha H.
• Primary Examiner(s): McDowell, Jr., Maurice L
• Application Number:
  US13/364,483
• Publication Number:
  US 20130201214A1
• Time in Patent Office: 1,783 Days
• Field of Search: 345/633
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3632 Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/024 Guidance services
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

Methods, apparatuses and computer-readable storage media for displaying at a first user equipment a first marker a location wherein the location is defined remotely at a second user equipment; displaying at the second user equipment a current geographic location and a current vantage point for the first user equipment; displaying at the second user equipment a second marker; accepting at the second user equipment an input for adjusting the second marker from a first position to a second position, wherein the second position is indicative of a target geographic location in a first virtual view of the current geographic location of the first user equipment as displayed on the second user equipment; and in response to the adjusting, displaying at the first user equipment the first marker at the target geographic location in a second virtual view of the current geographic location.

Claims

1. A method comprising:

determining a current geographic location and bearing information for a first user equipment;

displaying a second virtual view in the first user equipment;

displaying a first virtual view in a second user equipment generated based on the current geographic location and the bearing information for the first user equipment;

displaying at the second user equipment a second guidance marker used for navigational assistance;

displaying at the first user equipment a first guidance marker used for navigational assistance at a first location wherein the first location is defined remotely at the second user equipment in the first virtual view and the location of the first guidance marker is determined by translating the second guidance marker coordinates into the first virtual view;

displaying at the second user equipment a current geographic location for the first user equipment;

accepting at the second user equipment an input, wherein the user input selects an adjustment made to the second guidance marker from a first position to a second position, wherein the second position is selected by the user input to be indicative of a target geographic location in a first virtual view of the current geographic location of the first user equipment as displayed on the second user equipment; and

in response to the adjusting, displaying at the first user equipment the first guidance marker at the target geographic location in a second virtual view of the current geographic location, wherein the first guidance marker displayed at the target geographic location in the second virtual view provides navigation guidance to the first user for navigating to the target geographic location based on the user input selecting the adjustment made to the second guidance marker from the first position to the second position.

2. The method of claim 1 wherein the first guidance marker comprises at least one of a persistent pointer, a non-persistent pointer, a persistent highlighted area, or a non-persistent highlighted area, and wherein the second guidance marker comprises at least one of a persistent pointer, a non-persistent pointer, a persistent highlighted area, or a non-persistent highlighted area.

3. The method of claim 1 further comprising providing the first virtual view by displaying at the second user equipment a panorama view corresponding to the current geographic location and the current vantage point of the first user equipment.

4. The method of claim 1 further comprising providing the second virtual view by displaying at the first user equipment an augmented reality view corresponding to the current geographic location and the current vantage point of the first user equipment.

5. The method of claim 3 further comprising accepting at the second user equipment a first input for changing the vantage point of the panorama view that is displayed on the second user equipment.

6. The method of claim 5 further comprising accepting at the second user equipment a second input for adjusting a location of the second guidance marker on the panorama view that is displayed on the second user equipment, wherein the displayed augmented reality view of the first user equipment includes the first marker, and the first guidance marker moves in response to the adjusting of the location of the second guidance marker on the panorama view of the second user equipment.

7. The method of claim 1 further comprising providing a voice or textual communication channel between the first user equipment and the second user equipment.

8. The method of claim 7 wherein the communication channel is provided over a wireless communications network.

9. The method of claim 1 wherein the first guidance marker is implemented using a persistent first pointer that is first displayed in any location on the first user equipment and then moved to a displayed location on the first user equipment as specified by a remote user manipulating the second guidance marker at the second user equipment.

10. The method of claim 1 wherein the second guidance marker is implemented by a non-persistent pointing mechanism, such that the second user equipment is configured to accept a finger tap input on a selected displayed building or selected portion of the displayed building, and a highlight is momentarily or temporarily displayed on both the first and the second user equipments at a geographic location corresponding to the finger tap input on the second user equipment, wherein the temporarily or momentarily highlighted area is used to provide the first guidance marker on the first user equipment and the second marker on the second user equipment;

or alternatively or additionally, the highlighted area remains highlighted until a user input is received comprising at least one of tapping, touching, or pressing a non-highlighted area on the first or second user equipment.

wherein the first user equipment determines a current geographic location and bearing information, and display a second virtual view.

11. An apparatus configured to accept an input for defining a location;

the apparatus comprising a second user equipment for use with a first user equipment that is configured to display a first guidance marker used for navigational assistance at a location, wherein the first user equipment is configured to determine a current geographic location and bearing information, and display a second virtual view;

the second user equipment being configured to display a first virtual view geographic based on the current geographic location and bearing information for the first user equipment;

the second user equipment being configured to display the current geographic location for the first user equipment;

the second user equipment displaying a second guidance marker used for navigational assistance wherein the first user equipment is configured to display the first guidance marker at a first location wherein the first location is defined remotely at the second user equipment in the first virtual view and the location of the first guidance marker is determined by translating the second guidance marker coordinates into the first virtual view;

the second user equipment accepting the user input and, in response thereto, adjusting the second guidance marker from the first position to a second position, wherein the user input selects an adjustment made to the second position is indicative of a target geographic location in the first virtual view of the current geographic location of the first user equipment; and

in response to the adjusting, causing the first user equipment to display the first guidance marker at the target geographic location in the second virtual view of the current geographic location, wherein the first guidance marker displayed at the target geographic location in the second virtual view provides navigation guidance to the first user for navigating to the target geographic location based on the user input selecting the adjustment made to the second guidance marker from the first position to the second position.

12. The apparatus of claim 11 wherein the first guidance marker comprises at least one of a persistent pointer or a non-persistent highlighted area, and wherein the second guidance marker comprises at least one of a persistent pointer or a non-persistent highlighted area.

13. The apparatus of claim 11 wherein the first virtual view is provided by displaying at the second user equipment a panorama view corresponding to the current geographic location and the current vantage point of the first user equipment.

14. The apparatus of claim 11 wherein the second virtual view comprises an augmented reality view corresponding to the current geographic location and the current vantage point of the first user equipment.

15. The apparatus of claim 11 wherein the second user equipment is configured to accept a first input for changing the vantage point of the panorama view that is displayed on the second user equipment.

16. The apparatus of claim 11 wherein the second user equipment is configured to accept a second input for adjusting a location of the second guidance marker on the panorama view that is displayed on the second user equipment, wherein the displayed augmented reality view of the first user equipment includes the first guidance marker, and the first guidance marker moves in response to the adjusting of the location of the second guidance marker on the panorama view of the second user equipment.

17. The apparatus of claim 11 wherein the second user equipment is configured to establish a voice or textual communication channel between the first user equipment and the second user equipment.

18. The apparatus of claim 17 wherein the communication channel is provided over a wireless communications network.

19. The apparatus of claim 11 wherein the first guidance marker is implemented using a persistent first pointer that is first displayed in any location on the first user equipment and then moved to a displayed location on the first user equipment as specified by a remote user manipulating the second marker at the second user equipment.

20. The apparatus of claim 11 wherein the second guidance marker is implemented by a non-persistent pointing mechanism on the second user equipment, such that the second user equipment is configured to accept a finger tap input on a selected displayed building or selected portion of the displayed building, and a highlight is momentarily or temporarily displayed on both the first and the second user equipments at a geographic location corresponding to the finger tap input on the second user equipment, wherein the temporarily or momentarily highlighted area is used to provide the first marker on the first user equipment and the second guidance marker on the second user equipment.

21. A non-transitory computer readable storage medium with an executable program stored thereon, wherein the program instructs a processing device to perform:

determining a current geographic location and bearing information for a first user equipment;

displaying a second virtual view in the first user equipment;

displaying a second virtual view in the first user equipment;

displaying a first virtual view in a second user equipment generated based on the current geographic location and the bearing information for the first user equipment;

displaying at the second user equipment a second guidance marker used for navigational assistance;

displaying at the first user equipment a first guidance marker used for navigational assistance at a first location wherein the first location is defined remotely at the second user equipment in the first virtual view and the location of the first guidance marker is determined by translating the second guidance marker coordinates into the first virtual view;

displaying at the second user equipment a current geographic location for the first user equipment;

accepting at the second user equipment a user input, wherein the user input selects an adjustment made to the second guidance marker from the first position to a second position, wherein the second position is selected by the user input to be indicative of a target geographic location in the first virtual view of the current geographic location of the first user equipment as displayed on the second user equipment; and

in response to the adjusting, displaying at the first user equipment the first guidance marker at the target geographic location in the second virtual view of the current geographic location, wherein the first guidance marker displayed at the target geographic location in the second virtual view provides navigation guidance to the first user for navigating to the target geographic location based on the user input selecting the adjustment made to the second guidance marker from the first position to the second position.

22. The non-transitory computer readable storage medium of claim 21 wherein the first guidance marker comprises at least one of a persistent pointer or a non-persistent highlighted area, and wherein the second guidance marker comprises at least one of a persistent pointer or a non-persistent highlighted area.

23. The non-transitory computer readable storage medium of claim 21 wherein the program further comprises instructions for providing the first virtual view by displaying at the second user equipment a panorama view corresponding to the current geographic location and the current vantage point of the first user equipment.

24. The non-transitory computer readable storage medium of claim 21 wherein the program further comprises instructions for providing the second virtual view by displaying at the first user equipment an augmented reality view corresponding to the current geographic location and the current vantage point of the first user equipment.

25. The non-transitory computer readable storage medium of claim 23 wherein the program further comprises instructions for accepting at the second user equipment a first input for changing the vantage point of the panorama view that is displayed on the second user equipment.

26. The non-transitory computer readable storage medium of claim 21 wherein the program further comprises instructions for accepting at the second user equipment a second input for adjusting a location of the second marker on the panorama view that is displayed on the second user equipment, wherein the displayed augmented reality view of the first user equipment includes the first guidance marker, and the first marker moves in response to the adjusting of the location of the second guidance marker on the panorama view of the second user equipment.

27. The non-transitory computer readable storage medium of claim 21 wherein the program further comprises instructions for providing a voice or textual communication channel between the first user equipment and the second user equipment.

28. The non-transitory computer readable storage medium of claim 21 wherein the program further comprises instructions for providing the communication channel over a wireless communications network.

29. The non-transitory computer readable storage medium of claim 21 wherein the first marker is implemented using a persistent first pointer that is first displayed in any location on the first user equipment and then moved to a displayed location on the first user equipment as specified by a remote user manipulating the second marker at the second user equipment.

30. The non-transitory computer readable storage medium of claim 21 wherein the guidance marker is implemented by a non-persistent pointing mechanism, such that the second user equipment is configured to accept a finger tap input on a selected displayed building or selected portion of the displayed building, and a highlight is momentarily or temporarily displayed on both the first and the second user equipments at a geographic location corresponding to the finger tap input on the second user equipment, wherein the temporarily or momentarily highlighted area is used to provide the first guidance marker on the first user equipment and the second guidance marker on the second user equipment.