Data detection for visible light communications using conventional camera sensor

• US 8,942,570 B2
• Filed: 01/13/2011
• Issued: 01/27/2015
• Est. Priority Date: 01/15/2010
• Status: Active Grant

• Current Assignee: Signify Holding B.V. (Signify N.V.)
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Schenk, Tim Corneel Wilhelmus, De Bruijn, Frederik Jan, Vlutters, Ruud, Feri, Lorenzo
• Primary Examiner(s): Liu, Li
• Application Number:
  US13/520,589
• Publication Number:
  US 20120281987A1
• Time in Patent Office: 1,475 Days
• Field of Search: 398/172, 398118-131
• US Class Current: 398/172
• CPC Class Codes: H05B 47/155 Coordinated control of two or more light sources
• CPC Class Codes: H05B 47/19 via wireless transmission
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

The invention relates to a detection system for determining data embedded into the light output of a light source in a form of a repeating sequence of N symbols. The detection system includes a camera and a processing unit. The camera is configured to acquire a series of images of the scene via specific open/closure patterns of the shutter. The processing unit is configured to process the acquired series of images to determine the repeating sequence of N symbols. By carefully triggering when a shutter of the camera is open to capture the different symbols of the encoded light within each frame time of a camera, a conventional camera with a relatively long frame time may be employed. Therefore, the techniques presented herein are suitable for detecting the invisible “high frequency” coded light while using less expensive cameras as those used in the prior art.

Claims

1. A detection system for determining a repeating first sequence of N symbols included in a first code, wherein the first code is embedded into a light output of a first light source of an illumination system, the detection system comprising:

a camera configured to acquire a series of images of a scene, wherein;

each acquired image includes a plurality of pixels, each pixel representing an intensity of a total light output of the illumination system at a different physical position within the scene and the total light output of the illumination system comprises the light output of the first light source in at least one physical position within the scene,

the series comprises at least N different images, and

each image of the at least N different images is acquired with a total exposure time comprising one or more exposure instances at different temporal positions within the repeating first sequence of N symbols, wherein, for each image, the total exposure time is less than the frame time of the camera; and

a processing unit configured to process the acquired series of images to determine the repeating first sequence of N symbols.

2. The detection system according to claim 1, wherein, to process the acquired series of images to determine the repeating first sequence of N symbols, the processing unit is configured to:

determine a type of modulation used to embed the first code into the light output of the first light source,

based on the determined type of modulation, determine one or more thresholds differentiating different symbols of the first code, and

determine the repeating first sequence of N symbols by comparing each pixel of a sequence of pixels of the acquired series of images corresponding to the at least one physical position within the scene that comprises the light output of the first light source with at least one of the one or more determined thresholds.

3. The detection system according to claim 2, wherein the processing unit is further configured to determine that the at least one physical position within the scene that comprises the light output of the first light source comprises only the light output of the first light source.

4. The detection system according to claim 2, wherein at least one first sequence of N symbols is separated from another first sequence of N symbols by an intermediate sequence of symbols.

5. The detection system according to claim 4, wherein, to process the acquired series of images to determine the repeating first sequence of N symbols, the processing unit is further configured to:

correlate the sequence of pixels of the acquired series of images corresponding to the at least one physical position within the scene that comprises the light output of the first light source with the intermediate sequence of symbols, and

based on the correlation, determine the beginning of the at least one first sequence of N symbols, determine the beginning of the another first sequence of N symbols, and/or determine that the at least one physical position within the scene that comprises the light output of the first light source comprises only the light output of the first light source.

6. The detection system according to claim 4, wherein the intermediate sequence of symbols is indicative of the type of modulation used to embed the first code into the light output of the first light source.

7. The detection system according to claim 4, wherein the duration of each of the one or more exposure instances is equal to the duration of one symbol of the first sequence of N symbols.

8. The detection system according to claim 4, wherein the one or more exposure instances comprise a single exposure of two or more consecutive exposure instances.

9. The detection system according to claim 8, wherein the processing unit is further configured to apply a transformation accounting for having more than one exposure instances within the total exposure time to the sequence of pixels of the acquired series of images corresponding to the at least one physical position within the scene that comprises the light output of the first light source.

10. The detection system according to claim 8, wherein a frame rate of the camera is lower than a frequency of modulation used to embed the first code into the light output of the first light source.

11. The detection system according to claim 4, wherein the one or more exposure instances comprise two or more non-consecutive exposure instances.

12. A method for determining a repeating first sequence of N symbols included in a first code, wherein the first code is embedded into a light output of a first light source of an illumination system, the method comprising:

acquiring a series of images of a scene, wherein;

each acquired image includes a plurality of pixels, each pixel representing an intensity of a total light output of the illumination system at a different physical position within the scene and the total light output of the illumination system comprises the light output of the first light source in at least one physical position within the scene,

the series comprises at least N different images, and

each image of the at least N different images is acquired with a total exposure time comprising one or more exposure instances at different temporal positions within the repeating first sequence of N symbols, wherein, for each image, the total exposure time is less than the frame time of the camera; and

processing the acquired series of images to determine the repeating first sequence of N symbols.

13. The method according to claim 12, wherein the processing of the acquired series of images to determine the repeating first sequence of N symbols comprises:

determining a type of modulation used to embed the first code into the light output of the first light source,

based on the determined type of modulation, determining one or more thresholds differentiating different symbols of the first code, and

determining the repeating first sequence of N symbols by comparing each pixel of a sequence of pixels of the acquired series of images corresponding to the at least one physical position within the scene that comprises the light output of the first light source with at least one of the one or more determined thresholds.

14. The method according to claim 13, wherein the one or more exposure instances comprise two or more exposure instances and the processing of the acquired series of images to determine the repeating first sequence of N symbols further comprises applying a transformation accounting for having more than one exposure instances within the total exposure time to the sequence of pixels of the acquired series of images corresponding to the at least one physical position within the scene that comprises the light output of the first light source.

15. A non-transitory computer readable medium comprising a computer readable program for determining a repeating first sequence of N symbols included in a first code, wherein the first code is embedded into a light output of a first light source of an illumination system, wherein the computer readable program, when executed on a computer, causes the computer to perform the steps comprising:

acquiring a series of images of a scene, wherein;

each acquired image includes a plurality of pixels, each pixel representing an intensity of a total light output of the illumination system at a different physical position within the scene and the total light output of the illumination system comprises the light output of the first light source in at least one physical position within the scene,

the series comprises at least N different images, and

each image of the at least N different images is acquired with a total exposure time comprising one or more exposure instances at different temporal positions within the repeating first sequence of N symbols, wherein, for each image, the total exposure time is less than the frame time of the camera; and

processing the acquired series of images to determine the repeating first sequence of N symbols.

16. The non-transitory computer readable medium of claim 15, wherein the computer readable program further causes the computer to perform the steps comprising:

determining a type of modulation used to embed the first code into the light output of the first light source;

based on the determined type of modulation, determining one or more thresholds differentiating different symbols of the first code; and

determining the repeating first sequence of N symbols by comparing each pixel of the sequence of pixels of the acquired series of images corresponding to the at least one physical position within the scene that comprises the light output of the first light source with at least one of the one or more determined thresholds.