Independent beacon based light position system

• US 9,829,559 B2
• Filed: 01/27/2016
• Issued: 11/28/2017
• Est. Priority Date: 07/26/2011
• Status: Active Grant

• Current Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Original Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Inventors: Ganick, Aaron, Ryan, Daniel
• Primary Examiner(s): WONG, ALLEN C
• Application Number:
  US15/007,614
• Publication Number:
  US 20160139232A1
• Time in Patent Office: 671 Days
• Field of Search: 348 61
• CPC Class Codes: G01S 5/0264 at least one of the systems being a non-radio wave positioning system
• CPC Class Codes: G01S 5/16 using electromagnetic waves other than radio waves
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04B 10/60 Receivers
• CPC Class Codes: H04L 25/4902 Pulse width modulation; Pulse position modulation
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 25/76 Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

Systems an methods are provided that disclose providing a positioning service for devices based on light received from one or more light sources. This light based positioning service uses light information transmitted by each light source to determine the position of the device. The positioning information can include three dimension position information in a building that can then be used to deliver services and information to a mobile device. The content delivered to a mobile device can include multimedia, text, audio, and/or pictorial information. The positioning information along with other location or positioning information can be used in providing augmented reality or location aware services. The light sources can be independent beacons that broadcast information in visible light at a rate that is undetectable by the human eye. Content can be retrieved from a server over a communications connection.

Claims

1. A mobile device, comprising:

an image sensor;

a wireless interface configured to communicate through a network over a wireless medium;

a processor coupled to the image sensor and the wireless interface;

a memory; and

software in the memory to be run by the processor, wherein running of the software by the processor configures the mobile device to perform functions, including functions to;

operate the image sensor to capture an image of at least two visible light sources in an indoor location including a modulated visible light signal transmitted by one of the at least two visible light sources of an indoor location;

using the captured image, demodulate the modulated visible light signal transmitted by the one visible light source;

based on the demodulated visible light signals, determine a light source identifier corresponding to the one visible light source;

retrieve position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and

calculate, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the at least two light sources, coordinates for a position of the mobile device relative in the indoor location.

2. The mobile device of claim 1, wherein the mobile device when retrieving position information is further configured by the software running on the processor, to:

transmit, via the wireless interface, a request to a server requesting position information corresponding to the determined light source identifier; and

receive, via the wireless interface, position information corresponding to the determined light source identifier.

3. The mobile device of claim 1, further comprises:

indoor location information stored in the memory, the indoor location information including a map of the indoor location, light source identifiers, and position information of light sources within the indoor location, wherein;

the mobile device when retrieving position information is further configured by the software running on the processor, to;

access the indoor location information stored in the memory; and

retrieve position information corresponding to the determined light source identifier.

4. The mobile device of claim 1, wherein:

the mobile device, when demodulating the visible light signals is further configured by the software running on the processor, to;

apply a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the at least two light sources appear in brighter regions of pixels than other pixels in the captured image;

in response to isolating the brighter regions of pixels in the captured image, independently process each of the isolated brighter regions as corresponding to each of the at least two light sources to determine the visible light signal transmitted by the respective light sources.

5. The mobile device of claim 1, further comprising:

a display device;

a map of the indoor location stored in the memory; and

wherein running of the software by the processor configures the mobile device to implement functions, including functions to;

retrieve the map of the indoor location in which the mobile device is located; and

present, on the display device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

6. The mobile device of claim 1, wherein the image sensor is a rolling shutter camera.

7. The mobile device of claim 1, wherein the image sensor is a charge-coupled device.

8. A method, comprising:

operating an image sensor of the mobile device to capture an image of at least two visible light signals in an outdoor location including a modulated visible light signal transmitted by at least two visible light source of an indoor location;

demodulating the modulated visible light signal transmitted by one of the at least two visible light source using the captured image;

determining a light source identifier corresponding to the one of at least two visible light source based on the demodulated visible light signals;

retrieving position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and

calculating, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the three light sources, coordinates for a position of the mobile device relative in the indoor location.

9. The method of claim 8, wherein retrieving position information further comprises:

transmitting, via a wireless interface configured to communicate through a network over a wireless medium, a request to a server, the request requesting position information corresponding to each of the determined light source identifier; and

receiving, via the wireless interface, position information corresponding to the determined light source identifiers.

10. The method of claim 8, further comprises:

accessing indoor location information stored in a memory of the mobile device, wherein the indoor location information includes a map of the indoor location, light source identifiers, and position information of light sources within the indoor location; and

retrieving position information from the accessed indoor location information corresponding to the determined light source identifier.

11. The method of claim 8, wherein demodulating the visible light signals further comprises:

applying a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the at least two light sources appear in brighter regions of pixels than other pixels in the captured image;

in response to isolating the brighter regions of pixels in the captured image, independently processing each of the isolated brighter regions as corresponding to each of the at least two light sources to determine the visible light signal transmitted by the respective light sources.

12. The method of claim 8, further comprising:

retrieving, from a memory of the mobile device, a map of the indoor location in which the mobile device is located; and

presenting, on a display device of the mobile device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

13. The method of claim 8, wherein the image sensor is a rolling shutter camera.

14. A non-transitory tangible computer readable medium embodying instructions to cause a mobile device to perform functions, including functions to:

operate an image sensor of the mobile device to capture an image of at least two visible light signal in an outdoor location including a modulated visible light signal transmitted by one of at least one visible light source of an indoor location;

demodulate the modulated visible light signal transmitted by the one of the at least two visible light source using the captured image;

determine a light source identifier corresponding to the one visible light source based on the demodulated visible light signals;

retrieve position information corresponding to the determined light source identifier, the retrieved position information including position coordinates in three dimensions of the one light source corresponding to the light source identifier and of other light sources; and

calculate, by applying photogrammetric image processing techniques to the image of the at least two light sources and the position coordinates of the at least two light sources, coordinates for a position of the mobile device relative in the indoor location.

15. The non-transitory tangible computer readable medium of claim 14, wherein retrieving position information is further comprises:

transmit, via a wireless interface configured to communicate through a network over a wireless medium, a request to a server, the request requesting position information corresponding to each determined light source identifier; and

receive, via the wireless interface, position information corresponding to the determined light source identifiers.

16. The non-transitory tangible computer readable medium of claim 14, further comprises:

access indoor location information stored in a memory of the mobile device, wherein the indoor location information includes a map of the indoor location, light source identifiers, and position information of light sources within the indoor location; and

retrieve position information from the accessed indoor location information corresponding to the determined light source identifier.

17. The non-transitory tangible computer readable medium of claim 14, wherein demodulating the visible light signals further comprises:

apply a threshold to the captured image to isolate regions of brighter pixels in the image, wherein the three light sources appear in brighter regions of pixels than other pixels in the captured image;

in response to isolating the brighter regions of pixels in the captured image, independently process each of the isolated brighter regions as corresponding to each visible light source to determine the visible light signal transmitted by the respective light sources.

18. The non-transitory tangible computer readable medium of claim 14, further comprising:

retrieve, from a memory of the mobile device, a map of the indoor location in which the mobile device is located; and

present, on a display device of the mobile device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

19. The non-transitory tangible computer readable medium of claim 14, further comprising:

retrieve, from a memory of the mobile device, a map of the indoor location in which the mobile device is located; and

present, on a display device of the mobile device, the map with an identifying marker corresponding to the calculated coordinates of the position of the mobile device overlaid on the map.

20. The non-transitory tangible computer readable medium of claim 14, wherein the image sensor is a rolling shutter camera.