Method and system for digital pulse recognition demodulation

• US 8,416,290 B2
• Filed: 06/19/2012
• Issued: 04/09/2013
• Est. Priority Date: 07/26/2011
• Status: Active Grant

• Current Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Original Assignee: Bytelight, Inc. (Acuity Brands, Inc.)
• Inventors: Ryan, Daniel, Staats, Peter, Sumner, Rob
• Primary Examiner(s): WONG, ALLEN C
• Application Number:
  US13/526,773
• Publication Number:
  US 20130027576A1
• Time in Patent Office: 294 Days
• Field of Search: 348/61, 348/362, 701/208, 455/456.1, 382/103
• US Class Current: 348/61
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04M 2250/52 including functional features of a camera
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings
• CPC Class Codes: H04W 4/38 for collecting sensor information

Abstract

In one aspect, the present disclosure relates to a method for recognizing a broadcast digital pulse recognition tone in a beacon-based light positioning system. In some embodiments, the method includes capturing a digital image using an imaging sensor of an imaging device, identifying one or more regions of the digital image illuminated by one of one or more beacon light sources, determining a frequency content of each of the one or more regions, and determining a particular tone broadcast by the beacon light source illuminating a particular region using the frequency content of the particular region. In some embodiments, the imaging sensor has a frame rate and includes a rolling shutter, the rolling shutter having a sampling rate greater than the frame rate of the imaging sensor.

Claims

1. A method for detecting information transmitted by a plurality of light sources using a complementary metal-oxide-semiconductor (CMOS) image sensor by detecting a frequency of light pulses produced by the light sources, the method comprising:

capturing on the CMOS image sensor with a rolling shutter an image in which different portions of the CMOS image sensor are exposed at different points in time and the image comprises a plurality of regions, each region corresponding to received light pulses from one of the plurality of light sources;

simultaneously detecting visible distortions that include alternating patterns in each region of the image;

measuring a feature of the alternating patterns present in each region of the image; and

selecting a symbol based on the measured feature of the alternating patterns present in each region of the image to recover information encoded in the frequency of light pulses produced by the plurality of light sources captured in the image.

2. The method of claim 1, wherein the image sensor has a frame rate and the rolling shutter has a sampling rate greater than the frame rate of the image sensor.

3. The method of claim 2, wherein the alternating patterns comprise a plurality of lines sampled at successive time intervals by the rolling shutter, the lines comprising horizontal or vertical sequences of pixels.

4. The method of claim 2, wherein a first group of the plurality of lines is sampled when the light source illuminates the first group of the plurality of lines with a first intensity and a second group of the plurality of lines is sampled when the light source illuminates the second group of the plurality of lines with a second intensity.

5. The method of claim 4, wherein the first intensity is greater than the second intensity.

6. The method of claim 5, wherein the width of the plurality of stripes is calculated using a line detection algorithm comprising one of the Canny edge detection algorithm, Hough transforms, Sobel operators, differentials, Prewitt operators or Roberts Cross detectors.

7. The method of claim 4, wherein a frequency content of each region is detected by calculating the width of a plurality of stripes comprising contiguous lines of the first group of the plurality of lines.

8. The method of claim 1, wherein selecting a symbol comprises implementing a lookup table, wherein the lookup table associates a frequency content with the symbol.

9. The method of claim 1, comprising identifying the light source using the symbol broadcast.

10. The method of claim 9, further comprising determining the location of the image sensor based on the location of the identified light source.

11. The method of claim 10, wherein determining the location of the image sensor based on the location of the identified light source comprises referencing a lookup table, wherein the lookup table associates the symbol broadcast by the identified light source with the location of the identified light source.

12. The method of claim 11, wherein the lookup table is locally stored.

13. The method of claim 1, wherein capturing the image comprises capturing an entire scene visible to the image sensor.

14. The method of claim 1, wherein capturing the image comprises capturing a portion of a scene visible to the image sensor.

15. An image detection apparatus for detecting information transmitted by a plurality of light sources using a complementary metal-oxide-semiconductor (CMOS) image sensor by detecting a frequency of light pulses produced by the light sources, the image detection apparatus comprising:

an CMOS image sensor; and

a processor in communication with the CMOS image sensor configured to

capture on the CMOS image sensor with a rolling shutter an image in which different portions of the CMOS image sensor are exposed at different points in time and the image comprises a plurality of regions, each region corresponding to received light pulses from one of the plurality of light sources;

simultaneously detect visible distortions that include alternating patterns in each region of the image;

measure a feature of the alternating patterns present in each region of the image; and

select a symbol based on the measured feature of the alternating patterns present in each region of the image to recover information encoded in the frequency of light pulses produced by the plurality of light sources captured in the image.

16. The image detection apparatus of claim 15, wherein the image sensor has a frame rate and the rolling shutter has a sampling rate greater than the frame rate of the image sensor.

17. The image detection apparatus of claim 16, wherein the alternating patterns comprise a plurality of lines sampled at successive time intervals by the rolling shutter, the lines comprising horizontal or vertical sequences of pixels.

18. The image detection apparatus of claim 16, wherein a first group of the plurality of lines is sampled when the light source illuminates the first group of the plurality of lines with a first intensity and a second group of the plurality of lines is sampled when the light source illuminates the second group of the plurality of lines with a second intensity.

19. The image detection apparatus of claim 18, wherein the first intensity is greater than the second intensity.

20. The image detection apparatus of claim 19, wherein the processor is configured to calculate the width of the plurality of stripes using a line detection algorithm comprising one of the Canny edge detection algorithm, Hough transforms, Sobel operators, differentials, Prewitt operators or Roberts Cross detectors.

21. The image detection apparatus of claim 18, wherein a frequency content of each region is detected by calculating the width of a plurality of stripes comprising contiguous lines of the first group of the plurality of lines.

22. The image detection apparatus of claim 15, wherein the processor is configured to select a symbol by referencing a lookup table, wherein the lookup table associates a frequency content with the particular symbol.

23. The image detection apparatus of claim 15, wherein the processor is configured to identify the light source using the particular symbol broadcast.

24. The image detection apparatus of claim 23, wherein the processor is configured to determine the location of the image detection apparatus based on the location of the identified light source.

25. The image detection apparatus of claim 24, wherein the processor is configured to reference a lookup table to determine the location of the image detection apparatus based on the location of the identified light source, wherein the lookup table associates the symbol broadcast by the identified light source with the location of the identified light source.

26. The image detection apparatus of claim 25, wherein the lookup table is locally stored by the image detection apparatus.

27. The image detection apparatus of claim 15, wherein the digital image comprises an entire scene visible to the image sensor.

28. The image detection apparatus of claim 15, wherein the image comprises a portion of a scene visible to the image sensor.