Method and system for video processing to remove noise from a digital video sequence containing a modulated light signal

• US 9,374,524 B2
• Filed: 01/24/2014
• Issued: 06/21/2016
• Est. Priority Date: 07/26/2011
• Status: Active Grant

• Current Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Original Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Inventors: Ryan, Daniel, Staats, Peter, Sumner, Rob
• Primary Examiner(s): WONG, ALLEN C
• Application Number:
  US14/163,772
• Publication Number:
  US 20140139744A1
• Time in Patent Office: 879 Days
• Field of Search: 348/61
• US Class Current: 1/1
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01S 17/46 Indirect determination of position data
• CPC Class Codes: G01S 7/484 Transmitters
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: H04B 10/1149 Arrangements for indoor wireless networking of information
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/455 Demodulation-circuits

Abstract

In one aspect, the present disclosure relates to a method for removing noise from a digital video sequence containing a modulated light signal emitted from a beacon light source. In some embodiments, the method includes electronically receiving, by an image sensor of a device, a digital video sequence of a scene, calculating noise from the digital video sequence, wherein the noise comprises information within the digital video sequence corresponding to the un-modulated illumination of the scene, reducing the noise from the digital video sequence to obtain an isolated digital video sequence of the modulated illumination of the scene, and demodulating the emitted light signal from the isolated digital video sequence.

Claims

1. A method comprising:

electronically receiving, by an image sensor of a device, a digital video sequence of a scene, wherein;

the digital video sequence comprises a sequence of frames;

the scene comprises both modulated illumination broadcast by a beacon light source and un-modulated illumination; and

each frame of the sequence of frames comprises a plurality of pixel values, each of the plurality of pixel values having a given point in the frame;

calculating noise from the digital video sequence, wherein the noise comprises information within the digital video sequence corresponding to the un-modulated illumination of the scene;

removing the calculated noise from the digital video sequence to obtain an isolated digital video sequence of the modulated illumination of the scene; and

demodulating the emitted light signal from the isolated digital video sequence.

2. The method of claim 1, wherein removing the calculated noise comprises subtracting the plurality of pixel values corresponding to the un-modulated illumination of the scene from the plurality of pixel values corresponding to the modulated illumination of the scene.

3. The method of claim 1, comprising accumulating the subset of the frames in a frame buffer.

4. The method of claim 1, comprising applying a motion compensation technique to transform each frame prior to calculating the noise.

5. The method of claim 4, wherein the motion compensation technique comprises one of shifting or transforming each frame of the sequence of frames to substantially overlie the previous frame.

6. The method of claim 4, wherein the motion compensation technique comprises one of kernel density estimation, Eigenbackground, or mean-shift based estimation.

7. The method of claim 1, wherein calculating the noise comprises averaging the plurality of pixel values of each given point of a subset of the sequence of frames.

8. The method of claim 7, wherein the averaging is performed using a technique comprising one of calculating a simple numerical average, calculating a normalized average, calculating a Gaussian average, or calculating the frame difference between subsequent frames.

9. An image detection apparatus, comprising:

an imaging sensor; and

a processor in communication with the imaging sensor configured to;

electronically receive a digital video sequence of a scene, wherein;

the digital video sequence comprises a sequence of frames;

the scene comprises both modulated illumination broadcast by a beacon light source and un-modulated illumination; and

each frame of the sequence of frames comprises a plurality of pixel values, each of the plurality of pixel values having a given point in the frame;

calculate noise from the digital video sequence, wherein the noise comprises information within the digital video sequence corresponding to the un-modulated illumination of the scene;

remove the calculated noise from the digital video sequence to obtain an isolated digital video sequence of the modulated illumination of the scene; and

demodulate the emitted light signal from the isolated digital video sequence.

10. The image detection apparatus of claim 9, wherein the processor is configured to remove the calculated noise using a technique comprising subtracting the plurality of pixel values corresponding to the un-modulated illumination of the scene from the plurality of pixel values corresponding to the modulated illumination of the scene.

11. The image detection apparatus of claim 9, further comprising a frame buffer accessible by the processor, wherein the processor is configured to accumulate the subset of the frames in a frame buffer.

12. The image detection apparatus of claim 9, wherein the processor is configured to apply a motion compensation technique to transform each frame prior to calculating the noise.

13. The image detection apparatus of claim 12, wherein the motion compensation technique comprises one of shifting or transforming each frame of the sequence of frames to substantially overlie the previous frame.

14. The image detection apparatus of claim 12, wherein the motion compensation technique comprises one of kernel density estimation, Eigenbackground, or mean-shift based estimation.

15. The image detection apparatus of claim 9, wherein the processor is configured to perform the calculating of noise using a technique comprising averaging the plurality of pixel values of each given point of a subset of the sequence of frames.

16. The image detection apparatus of claim 15, wherein the processor is configured to perform averaging using a technique comprising one of calculating a simple numerical average, calculating a normalized average, calculating a Gaussian average, or calculating the frame difference between subsequent frames.