Directional and X-ray view techniques for navigation using a mobile device

• US 10,445,945 B2
• Filed: 05/14/2019
• Issued: 10/15/2019
• Est. Priority Date: 02/26/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Jiajian, Chao, Hui
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Assistant Examiner(s): Ricks, Donna J.
• Application Number:
  US16/412,407
• Publication Number:
  US 20190279429A1
• Time in Patent Office: 154 Days
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels

Abstract

Techniques for displaying navigation information on a mobile device are provided that include a method that includes obtaining an indication of a position and an indication of a direction associated with the mobile device, using the indication of the position, the indication of the direction, information regarding identities of POIs within a geographic region of interest, and information regarding areas associated with the POIs to determine at least one relevant POI, of the POIs, that is associated with the position and direction, and displaying at least one visual indication associated with each of the at least one relevant POI on the mobile device. The appearance of the at least one visual indication is dependent on at least one of a distance from the mobile device of the relevant POI associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant POI.

Claims

1. A method of generating one or more augmented views, the method comprising:

obtaining an image of a scene disposed within a geographic area of interest including a first point of interest and a second point of interest; and

generating an augmented view, wherein generating the augmented view includes;

overlaying over the image of the scene, at a first transparency level, a first visual indication associated with the first point of interest; and

overlaying over the image of the scene, at a second transparency level, a second visual indication associated with the second point of interest, the second transparency level of the second visual indication being different than the first transparency level of the first visual indication, wherein the first visual indication is overlaid to appear in front of at least a portion of the second visual indication based on the first point of interest being disposed at least partially behind the second point of interest in the scene relative to a camera.

2. The method of claim 1, further comprising displaying the augmented view on a mobile device.

3. The method of claim 1, wherein at least a portion of the first visual indication does not overlap at least a portion of the second visual indication.

4. The method of claim 1, wherein at least one of the first visual indication or the second visual indication has a size that is dependent on a distance from a device including the camera to at least one of the first point of interest or the second point of interest.

5. The method of claim 1, wherein the second transparency level has a lower transparency than the first transparency level.

6. The method of claim 1, wherein one or more visual indications associated with one or more points of interest that are not visible in a field of view of the camera are displayed as at least partially transparent based on the one or more points of interest being at least partially obstructed from view by one or more objects in the geographic area of interest.

7. The method of claim 1, wherein a transparency level of each of one or more visual indications associated with one or more points of interest is dependent on a presence of one or more physical barriers between a device including the camera and the one or more points of interest.

8. The method of claim 1, wherein one or more visual indications associated with one or more points of interest are displayed as opaque based on the one or more visual indications being associated with one or more points of interest that are visible in a field of view of the camera.

9. The method of claim 1, further comprising generating an updated augmented view, wherein at least one of the first transparency level of the first visual indication or the second transparency level of the second visual indication is adjusted in the updated augmented view based on movement of a device relative to at least one of the first point of interest or the second point of interest.

10. The method of claim 1, wherein the geographic area of interest comprises an indoor environment.

11. The method of claim 10, wherein a device including the camera is in the indoor environment, wherein the second point of interest is in the indoor environment, and wherein the first point of interest is outside of the indoor environment.

12. The method of claim 1, wherein a device including the camera is in a first indoor environment, wherein the second point of interest is in the first indoor environment, and wherein the first point of interest is in a second indoor environment.

13. The method of claim 1, wherein the geographic area of interest comprises an outdoor environment.

14. The method of claim 1, wherein a device including the camera is in a first outdoor environment, wherein at least one of the second point of interest and the first point of interest is in a second outdoor environment.

15. The method of claim 1, wherein the first transparency level of the first visual indication and the second transparency level of the second visual indication are based on the first point of interest being disposed at least partially behind the second point of interest in the geographic area of interest.

16. The method of claim 1, wherein the first point of interest is disposed within the portion of the geographic area of interest at a first distance from a device including the camera, wherein the second point of interest is disposed within the portion of the geographic area of interest at a second distance from the device, and wherein the first transparency level of the first visual indication is based on the first distance and the second transparency level of the second visual indication is based on the second distance.

17. The method of claim 1, wherein the first point of interest is disposed within the portion of the geographic area of interest at a distance from the second point of interest, and wherein the first transparency level of the first visual indication and the second transparency level of the second visual indication are based on the distance.

18. The method of claim 1, wherein the first point of interest is disposed within the portion of the geographic area of interest at a first distance from a device including the camera, wherein the second point of interest is disposed within the portion of the geographic area of interest at a second distance from the device, and wherein the first visual indication is displayed as being in front of at least the portion of the second visual indication based on the first distance being greater than the second distance.

19. The method of claim 1, wherein the first visual indication includes a first image, and wherein the second visual indication includes a second image.

20. An apparatus for generating one or more augmented views, comprising:

a memory configured to store one or more images; and

a processor configured to;

obtain an image of a scene disposed within a geographic area of interest including a first point of interest and a second point of interest; and

generate an augmented view, wherein generating the augmented view includes;

overlaying over the image of the scene, at a first transparency level, a first visual indication associated with the first point of interest; and

overlaying over the image of the scene, at a second transparency level, a second visual indication associated with the second point of interest, the second transparency level of the second visual indication being different than the first transparency level of the first visual indication, wherein the first visual indication is overlaid to appear in front of at least a portion of the second visual indication based on the first point of interest being disposed at least partially behind the second point of interest in the scene relative to a camera.

21. The apparatus of claim 20, wherein the processor is further configured to cause the augmented view to be displayed on a mobile device.

22. The apparatus of claim 20, wherein at least a portion of the first visual indication does not overlap at least a portion of the second visual indication.

23. The apparatus of claim 20, wherein the second transparency level has a lower transparency than the first transparency level.

24. The apparatus of claim 20, wherein one or more visual indications associated with one or more points of interest that are not visible in a field of view of the camera are displayed as at least partially transparent based on the one or more points of interest being at least partially obstructed from view by one or more objects in the geographic area of interest.

25. The apparatus of claim 20, wherein a transparency level of each of one or more visual indications associated with one or more points of interest is dependent on a presence of one or more physical barriers between a device including the camera and the one or more points of interest.

26. The apparatus of claim 20, wherein one or more visual indications associated with one or more points of interest are displayed as opaque based on the one or more visual indications being associated with one or more points of interest that are visible in a field of view of the camera.

27. The apparatus of claim 20, wherein the processor is further configured to generate an updated augmented view, wherein at least one of the first transparency level of the first visual indication or the second transparency level of the second visual indication is adjusted in the updated augmented view based on movement of a device relative to at least one of the first point of interest or the second point of interest.

28. The apparatus of claim 20, wherein the first point of interest is disposed within the portion of the geographic area of interest at a first distance from a device including the camera, wherein the second point of interest is disposed within the portion of the geographic area of interest at a second distance from the device, and wherein the first transparency level of the first visual indication is based on the first distance and the second transparency level of the second visual indication is based on the second distance.

29. The apparatus of claim 20, wherein the first point of interest is disposed within the portion of the geographic area of interest at a distance from the second point of interest, and wherein the first transparency level of the first visual indication and the second transparency level of the second visual indication are based on the distance.

30. The apparatus of claim 20, wherein the apparatus includes the camera.

31. The apparatus of claim 20, wherein the geographic area of interest comprises an indoor environment.

32. The apparatus of claim 31, wherein a device including the camera is in the indoor environment, wherein the second point of interest is in the indoor environment, and wherein the first point of interest is outside of the indoor environment.

33. The apparatus of claim 20, wherein a device including the camera is in a first indoor environment, wherein the second point of interest is in the first indoor environment, and wherein the first point of interest is in a second indoor environment.

34. The apparatus of claim 20, wherein the geographic area of interest comprises an outdoor environment.

35. The apparatus of claim 20, wherein a device including the camera is in a first outdoor environment, wherein at least one of the second point of interest and the first point of interest is in a second outdoor environment.

36. The apparatus of claim 20, further comprising:

a transmitter for transmitting the augmented view to a device including the camera.

37. A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:

obtain an image of a scene disposed within a geographic area of interest including a first point of interest and a second point of interest; and

generate an augmented view, wherein generating the augmented view includes;

overlaying over the image of the scene, at a first transparency level, a first visual indication associated with the first point of interest; and

overlaying over the image of the scene, at a second transparency level, a second visual indication associated with the second point of interest, the second transparency level of the second visual indication being different than the first transparency level of the first visual indication, wherein the first visual indication is overlaid to appear in front of at least a portion of the second visual indication based on the first point of interest being disposed at least partially behind the second point of interest in the scene relative to a camera.