Methods and apparatus for position estimation

• US 9,584,980 B2
• Filed: 05/27/2014
• Issued: 02/28/2017
• Est. Priority Date: 05/27/2014
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Yin, Chao, Hui, Naguib, Ayman Fawzy
• Primary Examiner(s): MAPA, MICHAEL Y
• Application Number:
  US14/288,195
• Publication Number:
  US 20150350846A1
• Time in Patent Office: 1,008 Days
• Field of Search: 4554561-457, 4554041-4042, 455418-420
• US Class Current: 1/1
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences

Abstract

Systems, apparatus and methods disclosed herein facilitate vision based mobile device location determination. In some embodiments, a method for estimating a position of a mobile device may comprise: detecting that the mobile device is in communication with at least one of a plurality of devices, where each of the plurality of devices associated with a corresponding device identifier. The capture of at least one image by an image sensor coupled to the mobile device may be triggered, based, in part on: the device identifier corresponding to the device in communication with the mobile device, and/or a field of view of the image sensor. A location of the mobile device may then be determined, based, in part, on the at least one captured image.

Claims

1. A method for estimating a position of a mobile device, the method comprising:

detecting that the mobile device is in communication with one of a plurality of devices, each of the plurality of devices associated with a corresponding device identifier;

triggering, by the mobile device, a capture of at least one image by an image sensor coupled to the mobile device, based, in part, on;

a device identifier corresponding to the device communicating with the mobile device, and

a field of view of the image sensor as determined based on input from a proximity sensor on the mobile device indicating that a section of the mobile device is within a threshold proximity of a user of the mobile device; and

determining a location of the mobile device based, in part, on the at least one captured image.

2. The method of claim 1, wherein the field of view of the image sensor is determined based further on a configuration of the mobile device indicating that the field of view is available for the image sensor.

3. The method of claim 1, wherein the image sensor is rear facing and/or capable of capturing video images.

4. The method of claim 1 further comprising:

transmitting the determined location of the mobile device to the device communicating with the mobile device.

5. The method of claim 4 further comprising:

transmitting the at least one captured image to the device communicating with the mobile device.

6. The method of claim 1, wherein determining the location of the mobile device comprises:

identifying, in the at least one captured image, a subset of Points of Interest (POIs) in a plurality of POIs, the subset of POIs being identified by comparing the at least one captured image with stored images of the POIs, wherein each POI in the subset is associated with a corresponding visibility map; and

determining the location of the mobile device based, at least in part, on an intersection of visibility maps corresponding to each POI in the subset.

7. The method of claim 1, wherein the at least one captured image forms part of a video image stream captured by the image sensor.

8. The method of claim 1, wherein the device identifier corresponding to the device is a phone number.

9. A method for estimating a position of a mobile device, the method comprising:

detecting that the mobile device is in communication with one of a plurality of devices, each of the plurality of devices associated with a corresponding device identifier;

triggering, by the mobile device, a capture of at least one image by an image sensor coupled to the mobile device, based, in part, on;

a device identifier corresponding to the device communicating with the mobile device, and

a field of view of the image sensor as determined based on input from a proximity sensor on the mobile device, wherein the input from the proximity sensor indicates that a section of the mobile device is in contact with a user of the mobile device; and

determining a location of the mobile device based, in part, on the at least one captured image.

10. A mobile device comprising:

a memory;

an image sensor;

a proximity sensor, and

a processor coupled to the image sensor, the proximity sensor, and the memory, wherein the processor is configured to;

detect that the mobile device is in communication with one of a plurality of devices, each device in the plurality of devices associated with a corresponding device identifier;

trigger, by the processor, a capture of at least one image by the image sensor based, in part, on;

a device identifier corresponding to the device communicating with the mobile device, and

a field of view of the image sensor as determined by the processor based on input from the proximity sensor indicating that a section of the mobile device is within a threshold proximity of a user of the mobile device; and

determine a location of the mobile device based, in part, on the at least one captured image.

11. The mobile device of claim 10, wherein:

the memory comprises configuration settings indicating that the field of view is available for the image sensor, and

wherein the processor is configured to;

determine the field of view of the image sensor based further on the configuration settings in the memory.

12. The mobile device of claim 10, wherein the image sensor is rear facing and/or capable of capturing video images.

13. The mobile device of claim 10, wherein the processor is further configured to:

transmit the determined location of the mobile device to the device communicating with the mobile device.

14. The mobile device of claim 10 wherein the processor is further configured to:

transmit the at least one captured image to the device communicating with the mobile device.

15. The mobile device of claim 10, wherein to determine the location of the mobile device, the processor is configured to:

identify, in the at least one captured image, a subset of Points of Interest (POIs) in a plurality of POIs, the subset of POIs being identified by comparing the at least one captured image with obtained images of the POIs, wherein each POI in the subset is associated with a corresponding visibility map; and

determine the location of the mobile device based, at least in part, on an intersection of visibility maps corresponding to each POI in the subset.

16. The mobile device of claim 10, wherein the at least one captured image forms part of a video image stream captured by the image sensor.

17. The mobile device of claim 10, wherein the device identifier corresponding to the device is a phone number.

18. A mobile device

a memory;

an image sensor;

a proximity sensor, and

a processor coupled to the image sensor, the proximity sensor, and the memory, wherein the processor is configured to;

detect that the mobile device is in communication with one of a plurality of devices, each device in the plurality of devices associated with a corresponding device identifier;

trigger, by the processor, a capture of at least one image by the image sensor based, in part, on;

a device identifier corresponding to the device communicating with the mobile device, and

input from the proximity sensor indicating that a section of the mobile device is in physical contact with a user of the mobile device; and

determine a location of the mobile device based, in part, on the at least one captured image.

19. A mobile device comprising:

means for detecting that that the mobile device is in communication with one of a plurality of devices, each device in the plurality of devices associated with a corresponding device identifier in the stored plurality of device identifiers;

means for triggering, by the mobile device, a capture of at least one image by an image sensing means based, in part, on;

the device identifier corresponding to the device in communication with the mobile device, and

a field of view of the image sensor means as determined based on input from a proximity sensing means on the mobile device indicating that a section of the mobile device is within a threshold proximity of a user of the mobile device; and

means for determining a location of the mobile device based, in part, on the at least one captured image.

20. The mobile device of claim 19 further comprising:

means for transmitting the determined location of the mobile device to the device communicating with the mobile device.

21. The mobile device of claim 19 further comprising:

means for transmitting the at least one captured image to the device communicating with the mobile device.

22. A mobile device comprising:

means for detecting that that the mobile device is in communication with one of a plurality of devices, each device in the plurality of devices associated with a corresponding device identifier in the stored plurality of device identifiers;

means for triggering, by the mobile device, a capture of at least one image by an image sensing means based, in part, on;

the device identifier corresponding to the device in communication with the mobile device, and

a field of view of the image sensor means based on input from a proximity sensing means indicating that a section of the mobile device is in physical contact with the user; and

means for determining a location of the mobile device based, in part, on the at least one captured image.

23. A non-transitory computer-readable medium comprising executable instructions, which when executed by a processor, perform steps in a method for estimating a position of a mobile device, the steps comprising:

detecting that the mobile device is in communication with one of a plurality of devices, each of the plurality of devices associated with a corresponding device identifier;

triggering, by the mobile device, a capture of at least one image by an image sensor coupled to the mobile device, based, in part, on;

a device identifier corresponding to the device communicating with mobile device, and

a field of view of the image sensor as determined based on input from a proximity sensor on the mobile device indicating that a section of the mobile device is within a threshold proximity of a user of the mobile device; and

determining a location of the mobile device based, in part, on the at least one captured image.

24. The non-transitory computer-readable medium of claim 23, further comprising:

transmitting the determined location of the mobile device to the device communicating with the mobile device.

25. The non-transitory computer-readable medium of claim 23, further comprising:

transmitting the at least one captured image to the device communicating with the mobile device.

26. A non-transitory computer-readable medium comprising instructions, which when executed by a processor, perform steps in a method for estimating a position of a mobile device, the steps comprising:

detecting that the mobile device is in communication with one of a plurality of devices, each of the plurality of devices associated with a corresponding device identifier;

triggering, by the mobile device, a capture of at least one image by an image sensor coupled to the mobile device, based, in part, on;

a device identifier corresponding to the device communicating with mobile device, and

input from a proximity sensor on the mobile device indicating that a section of the mobile device is in contact with a user of the mobile device; and

determining a location of the mobile device based, in part, on the at least one captured image.