DIRECTIONAL AND X-RAY VIEW TECHNIQUES FOR NAVIGATION USING A MOBILE DEVICE

• US 20140240350A1
• Filed: 02/26/2013
• Published: 08/28/2014
• Est. Priority Date: 02/26/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: CHAO, Hui, CHEN, Jiajian
• Granted Patent: US 9,959,674 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels

Abstract

Techniques for displaying navigation information on a mobile device are provided that include a method that includes obtaining an indication of a position and an indication of a direction associated with the mobile device, using the indication of the position, the indication of the direction, information regarding identities of POIs within a geographic region of interest, and information regarding areas associated with the POIs to determine at least one relevant POI, of the POIs, that is associated with the position and direction, and displaying at least one visual indication associated with each of the at least one relevant POI on the mobile device. The appearance of the at least one visual indication is dependent on at least one of a distance from the mobile device of the relevant POI associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant POI.

Claims

1. A method of displaying navigation information on a mobile device, the method comprising:

obtaining, at the mobile device, an indication of a position of the mobile device;

obtaining, at the mobile device, an indication of a direction associated with the mobile device;

using the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device; and

displaying at least one visual indication associated with each of the at least one relevant point of interest on the mobile device;

wherein an appearance of the at least one visual indication for each of the at least one relevant point of interest is dependent on at least one of a distance from the mobile device of the relevant point of interest associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant point of interest associated with the visual indication.

2. The method of claim 1 wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

3. The method of claim 2 wherein the using further comprises determining a first relevant point of interest at a first different distance from the mobile device and a second relevant point of interest at a second different distance from the mobile device that is greater than the first distance, and wherein the displaying further comprises displaying first and second visual indications corresponding to the first and second relevant points of interest, respectively, with the first visual indication being at least one of larger or less transparent than the second visual indication.

4. The method of claim 1 wherein the at least one visual indication associated with each of the at least one relevant point of interest has a transparency of the visual indication dependent on the presence of the known physical barrier between the mobile device and the relevant point of interest, and wherein the relevant point of interest is disposed beyond the known physical barrier relative to the mobile device and the visual indication is transparent.

5. The method of claim 1, wherein the geographic area of interests comprises an indoor environment.

6. The method of claim 1, wherein using the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine the at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device further comprises:

identifying at least one eye ray associated with the position of the mobile device and the indication of direction of the mobile device;

projecting the eye ray through a geometric representation of the indoor environment; and

identifying at least one point of interest with which the eye ray intersects as the at least one relevant point of interest.

7. The method of claim 1, wherein displaying the at least one visual indication associated with each of the at least one relevant point of interest on the mobile device further comprises:

sorting the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

rendering at least one visual indication associated with each of the relevant points of interest; and

displaying the at least one visual indication associated with each of the at least one relevant point of interest and a representation of a field of view of a camera of the mobile device.

8. The method of claim 7, wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

9. The method of claim 1, wherein displaying the at least one visual indication associated with each of the at least one relevant point of interest on the mobile device further comprises:

sorting the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

determining an alpha channel value for each of the at least one relevant point of interest based on a distance of the at least one relevant point of interest from the position of the mobile device;

generating composite image content based on a graphical indications associated with each of the at least one relevant point of interest and the alpha channel value associated with each of the at least one relevant point of interest; and

displaying the composite image content on a display of the mobile device.

10. The method of claim 9, wherein the graphical indications associated with each of the at least one point of interest comprises an image of the relevant point of interest associated with the graphical indications.

24. The non-transitory computer-readable medium of claim 1 wherein the at least one visual indication associated with each of the at least one relevant point of interest has a transparency of the visual indication dependent on the presence of the known physical barrier between the mobile device and the relevant point of interest, and wherein the relevant point of interest is disposed beyond the known physical barrier relative to the mobile device and the visual indication is transparent.

11. An apparatus for displaying navigation information on a mobile device, the apparatus comprising:

means for obtaining, at the mobile device, an indication of a position of the mobile device;

means for obtaining, at the mobile device, an indication of a direction associated with the mobile device;

means for using the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device; and

means for displaying a visual indication for each of the at least one relevant point of interest on the mobile device;

wherein an appearance of the visual indication for each of the at least one relevant point of interest is dependent on at least one of a distance from the mobile device of the relevant point of interest associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant point of interest associated with the visual indication.

12. The apparatus of claim 11 wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

13. The apparatus of claim 12 wherein the means for using further comprises means for determining a first relevant point of interest at a first different distance from the mobile device and a second relevant point of interest at a second different distance from the mobile device that is greater than the first distance, and wherein the means for displaying further comprises means for displaying first and second visual indications corresponding to the first and second relevant points of interest, respectively, with the first visual indication being at least one of larger or less transparent than the second visual indication.

14. The apparatus of claim 11 wherein the at least one visual indication associated with each of the at least one relevant point of interest has a transparency of the visual indication dependent on the presence of the known physical barrier between the mobile device and the relevant point of interest, and wherein the relevant point of interest is disposed beyond the known physical barrier relative to the mobile device and the visual indication is transparent.

15. The apparatus of claim 11, wherein the geographic area of interests comprises an indoor environment.

16. The apparatus of claim 11, wherein the means for using the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine the at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device further comprises:

means for identifying at least one eye ray associated with the position of the mobile device and the indication of direction of the mobile device;

means for projecting the eye ray through a geometric representation of the indoor environment; and

means for identifying at least one point of interest with which the eye ray intersects as the at least one relevant point of interest.

17. The apparatus of claim 11, wherein the means for displaying the at least one visual indication associated with each of the at least one relevant point of interest on the mobile device further comprises:

means for sorting the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

means for rendering at least one visual indication associated with each of the relevant points of interest; and

means for displaying the at least one visual indication associated with each of the at least one relevant point of interest and a representation of a field of view of a camera of the mobile device.

18. The apparatus of claim 17, wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

19. The apparatus of claim 11, wherein the means for displaying the at least one visual indication associated with each of the at least one relevant point of interest on the mobile device further comprises:

means for sorting the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

means for determining an alpha channel value for each of the at least one relevant point of interest based on a distance of the at least one relevant point of interest from the position of the mobile device;

means for generating composite image content based on a graphical indications associated with each of the at least one relevant point of interest and the alpha channel value associated with each of the at least one relevant point of interest; and

means for displaying the composite image content on a display of the mobile device.

20. The apparatus of claim 19, wherein the graphical indications associated with each of the at least one point of interest comprises an image of the relevant point of interest associated with the graphical indications.

21. A non-transitory computer-readable medium, having stored thereon computer-readable instructions for displaying navigation information on a mobile device, comprising instructions configured to cause a computer to:

obtain, at the mobile device, an indication of a position of the mobile device;

obtain, at the mobile device, an indication of a direction associated with the mobile device;

use the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device; and

display at least one visual indication associated with each of the at least one relevant point of interest on the mobile device;

wherein an appearance of the at least one visual indication for each of the at least one relevant point of interest is dependent on at least one of a distance from the mobile device of the relevant point of interest associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant point of interest associated with the visual indication.

22. The non-transitory computer-readable medium of claim 21 wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

23. The non-transitory computer-readable medium of claim 22 wherein the instructions configured to cause the computer to use further comprise instructions to cause the computer to determine a first relevant point of interest at a first different distance from the mobile device and a second relevant point of interest at a second different distance from the mobile device that is greater than the first distance, and wherein the instructions to cause the computer to display further comprises instructions to cause the computer to display first and second visual indications corresponding to the first and second relevant points of interest, respectively, with the first visual indication being at least one of larger or less transparent than the second visual indication.

25. The non-transitory computer-readable medium of claim 21, wherein the geographic area of interests comprises an indoor environment.

26. The non-transitory computer-readable medium of claim 21, wherein the instructions to cause the computer to use the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine the at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device further comprise instructions to cause the computer to:

identify at least one eye ray associated with the position of the mobile device and the indication of direction of the mobile device;

project the eye ray through a geometric representation of the indoor environment; and

identify at least one point of interest with which the eye ray intersects as the at least one relevant point of interest.

27. The non-transitory computer-readable medium of claim 21, wherein the instructions to cause the computer to display the at least one visual indication associated with each of the at least one relevant point of interest on the mobile device further comprise instructions to cause the computer to:

sort the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

render at least one visual indication associated with each of the relevant points of interest; and

display the at least one visual indication associated with each of the at least one relevant point of interest and a representation of a field of view of a camera of the mobile device.

28. The non-transitory computer-readable medium of claim 27, wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

29. The non-transitory computer-readable medium of claim 21, wherein the instructions to cause the computer to display the at least one visual indication associated with each of the at least one relevant point of interest on the mobile device further comprise instructions to cause the computer to:

sort the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

determine an alpha channel value for each of the at least one relevant point of interest based on a distance of the at least one relevant point of interest from the position of the mobile device;

generate composite image content based on a graphical indications associated with each of the at least one relevant point of interest and the alpha channel value associated with each of the at least one relevant point of interest; and

display the composite image content on a display of the mobile device.

30. The non-transitory computer-readable medium of claim 29, wherein the graphical indications associated with each of the at least one point of interest comprises an image of the relevant point of interest associated with the graphical indications.

31. An apparatus for displaying navigation information on a mobile device, the apparatus comprising:

a transceiver configured to transmit and receive data wirelessly;

a memory configured to store processor-executable program code;

a processor configured to;

obtain, at the mobile device, an indication of a position of the mobile device;

obtain, at the mobile device, an indication of a direction associated with the mobile device;

use the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device; and

display at least one visual indication associated with each of the at least one relevant point of interest on the mobile device;

wherein an appearance of the at least one visual indication for each of the at least one relevant point of interest is dependent on at least one of a distance from the mobile device of the relevant point of interest associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant point of interest associated with the visual indication.

32. The apparatus of claim 31 wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

33. The apparatus of claim 32 wherein the processor being configured to use the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device is further configured to determine a first relevant point of interest at a first different distance from the mobile device and a second relevant point of interest at a second different distance from the mobile device that is greater than the first distance, and wherein the processor being configured to display at least one visual indication associated with each of the at least one relevant point of interest on the mobile device is further configured to display first and second visual indications corresponding to the first and second relevant points of interest, respectively, with the first visual indication being at least one of larger or less transparent than the second visual indication.

34. The apparatus of claim 31 wherein the at least one visual indication associated with each of the at least one relevant point of interest has a transparency of the visual indication dependent on the presence of the known physical barrier between the mobile device and the relevant point of interest, and wherein the relevant point of interest is disposed beyond the known physical barrier relative to the mobile device and the visual indication is transparent.

35. The apparatus of claim 31, wherein the geographic area of interests comprises an indoor environment.

36. The apparatus of claim 31, wherein the processor being configure to use the indication of the position of the mobile device, the indication of the direction associated with the mobile device, information regarding identities of points of interest within a geographic region of interest, and information regarding areas associated with the points of interest to determine the at least one relevant point of interest, of the points of interest, that is associated with the position and direction of the mobile device is further configured to:

identify at least one eye ray associated with the position of the mobile device and the indication of direction of the mobile device;

project the eye ray through a geometric representation of the indoor environment; and

identify at least one point of interest with which the eye ray intersects as the at least one relevant point of interest.

37. The apparatus of claim 31, wherein the processor being configured to display at least one visual indication associated with each of the at least one relevant point of interest on the mobile device is further configured to:

sort the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

render at least one visual indication associated with each of the relevant points of interest; and

display the at least one visual indication associated with each of the at least one relevant point of interest and a representation of a field of view of a camera of the mobile device.

38. The apparatus of claim 37, wherein the at least one visual indication associated with each of the at least one relevant point of interest has at least one of a size or a transparency of the visual indication dependent on the distance from the mobile device of the relevant point of interest.

39. The apparatus of claim 31, wherein the processor being configured to display the at least one visual indication associated with each of the at least one relevant point of interest on the mobile device is further configured to:

sort the at least one relevant point of interest based on a distance of each of the at least one relevant point of interest from the position of the mobile device;

determine an alpha channel value for each of the at least one relevant point of interest based on a distance of the at least one relevant point of interest from the position of the mobile device;

generate composite image content based on a graphical indications associated with each of the at least one relevant point of interest and the alpha channel value associated with each of the at least one relevant point of interest; and

display the composite image content on a display of the mobile device.

40. The apparatus of claim 39, wherein the graphical indications associated with each of the at least one point of interest comprises an image of the relevant point of interest associated with the graphical indications.