System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system

• US 9,989,624 B2
• Filed: 03/10/2016
• Issued: 06/05/2018
• Est. Priority Date: 08/12/2014
• Status: Active Grant

• Current Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Original Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Inventors: Ryan, Daniel, Green, Kelby Edward, Malandrakis, Emanuel Paul, Klitenik, Konstantin
• Primary Examiner(s): Liu, Li
• Application Number:
  US15/066,656
• Publication Number:
  US 20160195605A1
• Time in Patent Office: 817 Days
• Field of Search: None
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01S 2205/02 Indoor
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: H04B 10/1141 One-way transmission
• CPC Class Codes: H04B 10/1149 Arrangements for indoor wireless networking of information
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/30 Services specially adapted for particular environments, situations or purposes
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings
• CPC Class Codes: H04W 4/40 for vehicles, e.g. vehicle-to-pedestrians [V2P]
• CPC Class Codes: H05B 45/12 using optical feedback

Abstract

An example of a technique for compensating for effects of Earth'"'"'s magnetic field variations on a mobile device positioning system. A mobile device utilizes a compass to obtain an absolute heading when located relative to a visible light source. The mobile device obtains a heading correction value based on an identifier of the visible light source. An orientation of a map displayed on the mobile device is rotated based on the absolute heading and the heading correction value in order to provide an indication of a location of the mobile device properly oriented on the map.

Claims

1. A mobile device, comprising:

an image sensor;

a compass;

a processor coupled to the image sensor and the compass;

a user interface element comprising a display screen;

a wireless interface configured to communicate through a network over a wireless medium;

a memory configured to store for each of a plurality of visible light sources located within an interior space for light-based positioning, a respective location of a respective visible light source and a respective heading correction value for the respective visible light source; and

software in the memory to be run by the processor, wherein running of the software by the processor configures the mobile device to implement functions, including functions to;

operate the image sensor to capture one or more images including a plurality of signals modulated within visible light, wherein;

the visible light is transmitted from the plurality of visible light sources located within the interior space for light-based positioning;

each signal is modulated within visible light transmitted by the respective visible light source located within the interior space for light-based positioning; and

each signal corresponds to a respective identity of the respective visible light source;

process the one or more images captured by the image sensor to determine, based at least in part on the plurality of signals, an estimated location of the mobile device within the interior space, the estimated location being an intermediate point between the plurality of visible light sources that is not directly underneath any of the visible light sources;

operate the compass to capture a raw heading measurement at the intermediate point;

obtain a corrected heading estimate for the intermediate point, wherein the function to obtain the corrected heading estimate further includes functions to;

for each modulated signal by the respective visible light source;

obtain the respective location of the respective visible light source; and

retrieve, based on the respective location of the respective visible light source, the respective heading correction value, wherein the function to retrieve includes functions to;

 

receive, via the wireless interface, the respective heading correction value and the respective location for each of the respective visible light sources; and

 

store the respective heading correction value and the respective location for each of the respective visible light sources in the memory;

determine, based on the retrieved heading correction values, an estimated heading correction value for the intermediate point, wherein the function to determine includes functions to;

weight the retrieved heading correction values of the visible light sources by an inverse of distance from the respective location of the respective visible light source to the intermediate point; and

average the inversely weighted heading correction values to produce the estimated heading correction value for the intermediate point;

determine, based on the raw measurement and the estimated heading correction value, the corrected heading estimate for the intermediate point; and

operate the user interface element to display a map of the interior space, the displayed map including a depiction of the determined estimated location of the mobile device that is based on processing the one or more images captured by the image sensor including each signal modulated within visible light transmitted by the respective visible light source located within the interior space for light-based positioning and the displayed map being rotated, based on the corrected heading estimate, to be consistent with a physical orientation of a user of the mobile device within the interior space.

2. The mobile device of claim 1, wherein the implemented functions further include functions to:

receive, upon entry into the interior space and via the wireless interface, data representing the map of the interior space; and

store data representing the map in the memory.

3. A mobile device, comprising:

an image sensor;

a compass;

a processor coupled to the image sensor and the compass;

a user interface element comprising a display screen;

a wireless interface configured to communicate through a network over a wireless medium;

a memory configured to store for each of a plurality of visible light sources located within an interior space for light-based positioning, a respective location of a respective visible light source and a respective heading correction value for the respective visible light source; and

software in the memory to be run by the processor, wherein running of the software by the processor configures the mobile device to implement functions, including functions to;

operate the image sensor to capture one or more images including a plurality of signals modulated within visible light, wherein;

the visible light is transmitted from the plurality of visible light sources located within the interior space for light-based positioning;

each signal is modulated within visible light transmitted by the respective visible light source located within the interior space for light-based positioning; and

each signal corresponds to a respective identity of the respective visible light source;

process the one or more images captured by the image sensor to determine, based at least in part on the plurality of signals, an estimated location of the mobile device within the interior space, the estimated location being an intermediate point between the plurality of visible light sources that is not directly underneath any of the visible light sources;

operate the compass to capture a raw heading measurement at the intermediate point;

obtain a corrected heading estimate for the intermediate point, wherein the function to obtain the corrected heading estimate further includes functions to;

for each modulated signal by the respective visible light source;

obtain the respective location of the respective visible light source; and

retrieve, based on the respective location of the respective visible light source, the respective heading correction value, wherein the function to retrieve includes functions to;

 

receive, via the wireless interface, the respective heading correction value and the respective location for each of the respective visible light sources; and

 

store the respective heading correction value and the respective location for each of the respective visible light sources in the memory;

determine, based on the retrieved heading correction values, an estimated heading correction value for the intermediate point, wherein the function to determine includes functions to;

weight the retrieved heading correction values of the visible light sources by distance from the respective location of the respective visible light source to the intermediate point such that closer visible light sources have a heavier weighting; and

average the weighted heading correction values to produce the estimated heading correction value for the intermediate point;

determine, based on the raw measurement and the estimated heading correction value, the corrected heading estimate for the intermediate point; and

operate the user interface element to display a map of the interior space, the displayed map including a depiction of the determined estimated location of the mobile device that is based on processing the one or more images captured by the image sensor including each signal modulated within visible light transmitted by the respective visible light source located within the interior space for light-based positioning and the displayed map being rotated, based on the corrected heading estimate, to be consistent with a physical orientation of a user of the mobile device within the interior space.

4. The mobile device of claim 3,

wherein:

the function to process the one or more images includes a function to determine, for each modulated signal, the respective identity of the respective visible light source; and

the function to obtain the respective location of the respective visible light source includes functions to;

transmit, via the wireless interface, the respective identity; and

receive, via the wireless interface, the respective location.

5. The mobile device of claim 3, wherein:

the function to process the one or more images includes a function to determine, for each modulated signal, the respective identity of the respective visible light source; and

the function to obtain the respective location of the respective visible light source includes a function to retrieve, from the memory and based on the respective identity of the respective visible light source, the respective location of the respective visible light source.

6. The mobile device of claim 3,

wherein the implemented functions further include functions to:

receive, upon entry into the interior space and via the wireless interface, data representing the map of the interior space; and

store data representing the map in the memory.

7. A method, comprising steps to:

capture, via an image sensor of a mobile device, one or more images including at least one signal modulated within visible light, wherein;

the visible light is transmitted from a plurality of visible light sources located within an interior space for light-based positioning;

each signal is modulated within visible light transmitted by a respective one visible light source located within the interior space for light-based positioning; and

each signal corresponds to a respective identity of a respective visible light source;

process the one or more images captured via the image sensor to determine, based at least in part on the plurality of signals, an estimated location of the mobile device within the interior space, the estimated location being an intermediate point between the plurality of visible light sources that is not underneath the visible light sources;

capture, via a compass of the mobile device, a raw heading measurement at the intermediate point;

obtain a corrected heading estimate based at least in part on the raw heading measurement for the intermediate point, wherein the function to obtain the corrected heading estimate further includes steps to;

for each modulated signal by the respective visible light source;

obtain a respective location of a respective visible light source; and

retrieve, based on the respective location of the respective visible light source, a respective heading correction value, the function to retrieve including functions to;

receive, via a wireless interface, the heading correction value and the respective location for each of the respective visible light sources; and

store the respective heading correction value and the respective location for each of the respective visible light sources in a memory; and

determine, based on the retrieved heading correction values, an estimated heading correction value for the intermediate point, wherein the step to determine includes steps to;

weight the retrieved heading correction values of the visible light sources by an inverse of distance from the respective location of the respective visible light source to the intermediate point; and

average the inversely weighted heading correction values to produce the estimated heading correction value for the intermediate point.

8. A method, comprising steps to:

capture, via an image sensor of a mobile device, one or more images including at least one signal modulated within visible light, wherein;

the visible light is transmitted from a plurality of visible light sources located within an interior space for light-based positioning;

each signal is modulated within visible light transmitted by a respective one visible light source located within the interior space for light-based positioning; and

each signal corresponds to a respective identity of a respective visible light source;

process the one or more images captured via the image sensor to determine, based at least in part on the plurality of signals, an estimated location of the mobile device within the interior space, the estimated location being an intermediate point between the plurality of visible light sources that is not underneath the visible light sources;

capture, via a compass of the mobile device, a raw heading measurement at the intermediate point;

obtain a corrected heading estimate based at least in part on the raw heading measurement for the intermediate point, wherein the function to obtain the corrected heading estimate further includes steps to;

for each modulated signal by the respective visible light source;

obtain a respective location of a respective visible light source; and

retrieve, based on the respective location of the respective visible light source, a respective heading correction value, the function to retrieve including functions to;

receive, via a wireless interface, the heading correction value and the respective location for each of the respective visible light sources; and

store the respective heading correction value and the respective location for each of the respective visible light sources in a memory; and

determine, based on the retrieved heading correction values, an estimated heading correction value for the intermediate point, wherein the step to determine includes steps to;

weight the retrieved heading correction values of the visible light sources by distance from the respective location of the respective visible light source to the intermediate point such that closer visible light sources have a heavier weighting; and

average the weighted heading correction values to produce the estimated heading correction value for the intermediate point.

9. The method of claim 8, wherein:

the step to process the one or more images further comprises a step to determine, for each modulated signal, the respective identity of the respective visible light source; and

the step to obtain the respective location of the respective visible light source comprises steps to;

transmit, via a wireless interface of the mobile device, the respective identity; and

receive, via the wireless interface, the respective location.

10. The method of claim 8, wherein:

the step to process the one or more images further comprises a step to determine, for each modulated signal, the respective identity of the respective visible light source; and

the step to obtain the respective location of the respective visible light source comprises a step to retrieve, from the memory and based on the respective identity of the respective visible light source, the respective location of the respective visible light source.

11. A non-transitory tangible computer readable medium embodying instructions to cause a mobile device to perform the method of claim 8-9.

12. A method, comprising steps to:

for each of a plurality of visible light sources located within an interior space for light-based positioning;

capture, via an image sensor of a mobile device, one or more images including a modulated visible light signal transmitted from the respective visible light source;

process the one or more images captured via the image sensor to determine, based at least in part on the modulated visible light signal, an estimated location of the mobile device within the interior space, the estimated location being an intermediate point between the plurality of visible light sources;

capture, via a compass of the mobile device, a raw heading of the mobile device;

obtain a corrected heading estimate based at least in part on the raw heading measurement for the intermediate point, wherein the function to obtain the corrected heading estimate further includes steps to;

for each modulated signal by the respective visible light source;

obtain a respective location of a respective visible light source; and

retrieve, based on the respective location of the respective visible light source, a respective heading correction value;

determine, based on the retrieved heading correction values, an estimated heading correction value for the intermediate point, wherein the step to determine includes steps to;

weight the retrieved heading correction values of the visible light sources by an inverse of distance from the respective location of the respective visible light source to the intermediate point; and

average the inversely weighted heading correction values to produce the estimated heading correction value for the intermediate point; and

transmit, via a wireless interface of the mobile device, the corrected heading estimate and the estimated location of the mobile device.

13. A method, comprising steps to:

for each of a plurality of visible light sources located within an interior space for light-based positioning;

capture, via an image sensor of a mobile device, one or more images including a modulated visible light signal transmitted from the respective visible light source;

process the one or more images captured via the image sensor to determine, based at least in part on the modulated visible light signal, an estimated location of the mobile device within the interior space, the estimated location being an intermediate point between the plurality of visible light sources;

capture, via a compass of the mobile device, a raw heading of the mobile device;

obtain a corrected heading estimate based at least in part on the raw heading measurement for the intermediate point, wherein the function to obtain the corrected heading estimate further includes steps to;

for each modulated signal by the respective visible light source;

obtain a respective location of a respective visible light source; and

retrieve, based on the respective location of the respective visible light source, a respective heading correction value;

determine, based on the retrieved heading correction values, an estimated heading correction value for the intermediate point, wherein the step to determine, based on the retrieved heading correction values, an estimated heading correction value for the intermediate point includes steps to;

weight the retrieved heading correction values of the visible light sources by distance from the respective location of the respective visible light source to the intermediate point such that closer visible light sources have a heavier weighting; and

average the weighted heading correction values to produce the estimated heading correction value for the intermediate point; and

transmit, via a wireless interface of the mobile device, the corrected heading estimate and the estimated location of the mobile device.