Directional and X-ray view techniques for navigation using a mobile device

• US 9,959,674 B2
• Filed: 02/26/2013
• Issued: 05/01/2018
• Est. Priority Date: 02/26/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Jiajian, Chao, Hui
• Primary Examiner(s): McDowell, Jr., Maurice L
• Assistant Examiner(s): Ricks, Donna J
• Application Number:
  US13/777,861
• Publication Number:
  US 20140240350A1
• Time in Patent Office: 1,890 Days
• Field of Search: None
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels

Abstract

Techniques for displaying navigation information on a mobile device are provided that include a method that includes obtaining an indication of a position and an indication of a direction associated with the mobile device, using the indication of the position, the indication of the direction, information regarding identities of POIs within a geographic region of interest, and information regarding areas associated with the POIs to determine at least one relevant POI, of the POIs, that is associated with the position and direction, and displaying at least one visual indication associated with each of the at least one relevant POI on the mobile device. The appearance of the at least one visual indication is dependent on at least one of a distance from the mobile device of the relevant POI associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant POI.

Claims

1. A method of displaying navigation information on a mobile device, the method comprising:

obtaining, at the mobile device, an indication of a position of the mobile device;

determining, at the mobile device, an indication of an orientation of the mobile device;

determining a plurality of points of interest within a geographic area of interest using the indication of the position of the mobile device, the indication of the orientation of the mobile device, and boundary information of the plurality of points of interest;

generating a composite image by overlaying a first visual indication associated with a first point of interest and a second visual indication associated with a second point of interest over an image of a portion of the geographic area of interest captured using a camera of the mobile device, wherein the first point of interest is disposed within the portion of the geographic area of interest at a first distance from the mobile device, wherein the second point of interest is disposed within the portion of the geographic area of interest at a second distance from the mobile device, and wherein the second visual indication is overlaid before the first visual indication based on the second distance being greater than the first distance;

setting a first transparency level of the first visual indication based on the first distance and a second transparency level of the second visual indication based on the second distance; and

displaying, on the mobile device, an augmented view of the portion of the geographic area of interest, the augmented view including the composite image.

2. The method of claim 1 wherein at least a portion of the first visual indication does not overlap the second visual indication in the image.

3. The method of claim 1 wherein the first transparency level has a lower transparency than the second transparency level.

4. The method of claim 1 wherein the second transparency level of the second visual indication is dependent on a presence of a known physical barrier between the mobile device and the second point of interest, and wherein the second point of interest is disposed beyond the known physical barrier relative to the mobile device.

5. The method of claim 1, wherein the geographic area of interest comprises an indoor environment.

6. The method of claim 1, further comprising:

sorting the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

determining transparency levels of visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest;

rendering at least one of the visual indications at one or more of the determined transparency levels; and

displaying the at least one visual indication at the one or more determined transparency levels.

7. The method of claim 1 wherein at least one visual indication has a size that is dependent on a distance from the mobile device of a point of interest associated with the at least one visual indication.

8. The method of claim 1, further comprising:

sorting the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

determining alpha channel values for visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest; and

generating the composite image based on the visual indications and the alpha channel values determined for the visual indications associated with the plurality of points of interest.

9. The method of claim 8, wherein a visual indication associated with a point of interest comprises an image of the point of interest.

10. The method of claim 1, further comprising:

determining a height of the mobile device over a floor of the geographic area of interest; and

projecting at least one eye ray through a three-dimensional geometric representation of the geographic area of interest from the height of the mobile device.

11. The method of claim 1, further comprising:

sending a request for point of interest information to a location server, the request comprising the indication of the position of the mobile device; and

receiving the point of interest information from the location server.

12. The method of claim 1, wherein a visual indication for at least one point of interest is based on a type of environment in which the mobile device is located, wherein the type of environment is a building, and wherein the visual indication is based at least in part on where the at least one point of interest is within the building.

13. An apparatus for displaying navigation information on a mobile device, the apparatus comprising:

means for obtaining, at the mobile device, an indication of a position of the mobile device;

means for determining, at the mobile device, an indication of an orientation of the mobile device;

means for determining a plurality of points of interest within a geographic area of interest using the indication of the position of the mobile device, the indication of the orientation of the mobile device, and boundary information of the plurality of points of interest;

means for generating a composite image by overlaying a first visual indication associated with a first point of interest and a second visual indication associated with a second point of interest over an image of a portion of the geographic area of interest captured using a camera of the mobile device, wherein the first point of interest is disposed within the portion of the geographic area of interest at a first distance from the mobile device, wherein the second point of interest is disposed within the portion of the geographic area of interest at a second distance from the mobile device, and wherein the second visual indication is overlaid before the first visual indication based on the second distance being greater than the first distance;

means for setting a first transparency level of the first visual indication based on the first distance and a second transparency level of the second visual indication based on the second distance; and

means for displaying an augmented view of a portion of the geographic area of interest, the augmented view including the composite image.

14. The apparatus of claim 13 wherein at least a portion of the first visual indication does not overlap the second visual indication in the image.

15. The apparatus of claim 13 wherein the first transparency level has a lower transparency than the second transparency level.

16. The apparatus of claim 13 wherein the second transparency level of the second visual indication is dependent on a presence of a known physical barrier between the mobile device and the second point of interest, and wherein the second point of interest is disposed beyond the known physical barrier relative to the mobile device.

17. The apparatus of claim 13, wherein the geographic area of interest comprises an indoor environment.

18. The apparatus of claim 13, further comprising:

means for sorting the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

means for determining transparency levels of visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest;

means for rendering at least one of the visual indications at one or more of the determined transparency levels; and

means for displaying the at least one visual indication at the one or more determined transparency levels.

19. The apparatus of claim 18, wherein at least one visual indication has a size that is dependent on a distance from the mobile device of a point of interest associated with the at least one visual indication.

20. The apparatus of claim 13, further comprising:

means for sorting the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

means for determining alpha channel values for visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest; and

means for generating the composite image based on the visual indications and the alpha channel values determined for the visual indications associated with the plurality of points of interest.

21. The apparatus of claim 20, wherein a visual indication associated with a point of interest comprises an image of the point of interest.

22. A non-transitory computer-readable medium, having stored thereon computer-readable instructions for displaying navigation information on a mobile device, comprising instructions configured to cause a computer to:

obtain, at the mobile device, an indication of a position of the mobile device;

determine, at the mobile device, an indication of an orientation of the mobile device;

determine a plurality of points of interest within a geographic area of interest using the indication of the position of the mobile device, the indication of the orientation of the mobile device, and boundary information of the plurality of points of interest;

generate a composite image by overlaying a first visual indication associated with a first point of interest and a second visual indication associated with a second point of interest over an image of a portion of the geographic area of interest captured using a camera of the mobile device, wherein the first point of interest is disposed within the portion of the geographic area of interest at a first distance from the mobile device, wherein the second point of interest is disposed within the portion of the geographic area of interest at a second distance from the mobile device, and wherein the second visual indication is overlaid before the first visual indication based on the second distance being greater than the first distance;

set a first transparency level of the first visual indication based on the first distance and a second transparency level of the second visual indication based on the second distance; and

display an augmented view of the portion of the geographic area of interest, the augmented view including the composite image.

23. The non-transitory computer-readable medium of claim 22 wherein at least a portion of the first visual indication does not overlap the second visual indication in the image.

24. The non-transitory computer-readable medium of claim 22 wherein the first transparency level has a lower transparency than the second transparency level.

25. The non-transitory computer-readable medium of claim 22 wherein the second transparency level of the second visual indication is dependent on a presence of a known physical barrier between the mobile device and the second point of interest, and wherein the second point of interest is disposed beyond the known physical barrier relative to the mobile device.

26. The non-transitory computer-readable medium of claim 22, wherein the geographic area of interest comprises an indoor environment.

27. The non-transitory computer-readable medium of claim 22, further comprising instructions to cause the computer to:

sort the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

determine transparency levels of visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest;

render at least one of the visual indications at one or more of the determined transparency levels; and

display the at least one visual indication at the one or more determined transparency levels.

28. The non-transitory computer-readable medium of claim 27, wherein at least one visual indication has a size that is dependent on a distance from the mobile device of a point of interest associated with the at least one visual indication.

29. The non-transitory computer-readable medium of claim 22, further comprising instructions to cause the computer to:

sort the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

determine alpha channel values for visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest; and

generate the composite image based on the visual indications and the alpha channel values determined for the visual indications associated with the plurality of points of interest.

30. The non-transitory computer-readable medium of claim 29, wherein a visual indication associated with a point of interest comprises an image of the point of interest.

31. An apparatus for displaying navigation information on a mobile device, the apparatus comprising:

a transceiver configured to transmit and receive data wirelessly;

a memory configured to store processor-executable program code;

a processor configured to;

obtain, at the mobile device, an indication of a position of the mobile device;

determine, at the mobile device, an indication of an orientation of the mobile device;

determine a plurality of points of interest within a geographic area of interest using the indication of the position of the mobile device, the indication of the orientation of the mobile device, and boundary information of the plurality of points of interest;

generate a composite image by overlaying a first visual indication associated with a first point of interest and a second visual indication associated with a second point of interest over an image of a portion of the geographic area of interest captured using a camera of the mobile device, wherein the first point of interest is disposed within the portion of the geographic area of interest at a first distance from the mobile device, wherein the second point of interest is disposed within the portion of the geographic area of interest at a second distance from the mobile device, and wherein the second visual indication is overlaid before the first visual indication based on the second distance being greater than the first distance;

set a first transparency level of the first visual indication based on the first distance and a second transparency level of the second visual indication based on the second distance; and

display an augmented view of the portion of the geographic area of interest, the augmented view including the composite image.

32. The apparatus of claim 31 wherein at least a portion of the first visual indication does not overlap the second visual indication in the image.

33. The apparatus of claim 31 wherein the first transparency level has a lower transparency than the second transparency level.

34. The apparatus of claim 31 wherein the second transparency level of the second visual indication is dependent on a presence of a known physical barrier between the mobile device and the second point of interest, and wherein the second point of interest is disposed beyond the known physical barrier relative to the mobile device.

35. The apparatus of claim 31, wherein the geographic area of interest comprises an indoor environment.

36. The apparatus of claim 31, wherein the processor is further configured to:

sort the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

determine transparency levels of visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest;

render at least one of the visual indications at one or more of the determined transparency levels; and

display the at least one visual indication at the one or more determined transparency levels.

37. The apparatus of claim 36, wherein at least one visual indication has a size that is dependent on a distance from the mobile device of a point of interest associated with the at least one visual indication.

38. The apparatus of claim 31, wherein the processor is further configured to:

sort the plurality of points of interest based on distances of the plurality of points of interest from the mobile device;

determine alpha channel values for visual indications associated with the plurality of points of interest based on the sorted plurality of points of interest; and

generate the composite image based on the visual indications and the alpha channel values determined for the visual indications associated with the plurality of points of interest.

39. The apparatus of claim 38, wherein a visual indication associated with a point of interest comprises an image of the point of interest.