Automatic detection of fluorescent flicker in video images

• US 7,502,054 B2
• Filed: 12/20/2004
• Issued: 03/10/2009
• Est. Priority Date: 12/20/2004
• Status: Active Grant

• Current Assignee: Pixim, Inc. (Sony Group Corp.)
• Original Assignee: Pixim, Inc. (Sony Group Corp.)
• Inventors: Kalapathy, Paul E., Frank, Michael
• Primary Examiner(s): Vu; Ngoc-Yen T
• Assistant Examiner(s): Quiett; Carramah J
• Application Number:
  US11/018,662
• Publication Number:
  US 20060132859A1
• Time in Patent Office: 1,541 Days
• Field of Search: 348/226.1, 348/227.1, 348/228.1, 348/229.1, 348/223.1, 348/370, 348/371, 348/255, 348/607
• US Class Current: 348/226.1
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/745 Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination

Abstract

A method for detecting the presence of flicker in video images includes obtaining luminance data from sampled image fields and analyzing the luminance data to obtain a digital number characterizing the brightness of the luminance data. Frequency analysis is performed on a time-series of digital numbers collected over multiple sampled image fields to provide a signal indicative of the spectral energy at a flicker frequency band and a signal indicative of the spectral energy at a non-flicker frequency band. A ratio of the two spectral energy signals is computed as the flicker detect indicator. Multiple flicker detect indicators are accumulated to generate a flicker present signal. In one embodiment, the flicker detect indicator is accumulated only when the ratio has a value greater than a first threshold and the flicker present signal is asserted only when the number of flicker detect indicator signals accumulated exceeds an entry value.

Claims

1. A method for detecting the presence of flicker in video images comprising:

obtaining a set of luminance data from each sampled image field of the video images;

analyzing the set of luminance data to obtain a digital number characterizing a brightness characteristic of the set of luminance data;

compiling a time-series of digital numbers over multiple sets of luminance data of multiple sampled image fields;

performing a frequency analysis on the time-series of digital numbers to provide a first signal indicative of frequency components of the time-series of digital numbers in a flicker frequency band and a second signal indicative of the frequency components of the time-series of digital numbers in a non-flicker frequency band;

computing a first spectral energy signal and a second spectral energy signal based on the first signal and the second signal respectively;

computing a ratio of the first spectral energy signal to the second spectral energy signal, the ratio being a flicker detect indicator signal;

accumulating multiple flicker detect indicator signals from multiple time-series of digital numbers, the accumulated flicker detect indicator signals having values greater than a first threshold; and

generating a flicker present signal when the number of accumulated flicker detect indicator signals is greater than an entry value.

2. The method of claim 1, wherein obtaining a set of luminance data from each sampled image field of the video images comprises obtaining luminance data for the entire image of each sampled image field of the video images.

3. The method of claim 1, wherein obtaining a set of luminance data from each sampled image field of the video images comprises obtaining luminance data from a region of each sampled image field of the video images.

4. The method of claim 1, wherein analyzing the set of luminance data to obtain a digital number characterizing the brightness characteristic of the set of luminance data comprises:

determining the median luminance value of the set of luminance data; and

assigning the median luminance value as the digital number.

5. The method of claim 4, wherein determining the median luminance value of the set of luminance data comprises:

generating a histogram of the brightness values of the set of luminance data; and

deriving the median luminance value from the histogram.

6. The method of claim 1, wherein analyzing the set of luminance data to obtain a digital number characterizing the brightness characteristic of the set of luminance data comprises:

generating a histogram of the brightness values of the set of luminance data;

selecting a percentile value for the set of luminance data;

determining a percentile luminance value associated with the selected percentile value from the histogram; and

assigning the percentile luminance value as the digital number.

7. The method of claim 6, wherein selecting a percentile value for the set of luminance data comprises selecting the median value, and wherein determining a percentile luminance value comprises determining the median luminance value of the set of luminance data from the histogram, the median luminance value being the digital number.

8. The method of claim 6, wherein the percentile value for the set of luminance data comprises a percentile value selected from the range of 25th percentile to 75 percentile.

9. The method of claim 1, wherein the flicker frequency band comprises a frequency range of frequencies where flicker in the video images is expected to occur and the non-flicker frequency band comprises a frequency range of frequencies where flicker in the video images is not expected to occur.

10. The method of claim 1, wherein each sampled image field of the video images is sampled at a sampling frequency and the flicker frequency band comprises a frequency range of alias frequencies corresponding to the range of fundamental flicker frequencies associated with the flicker in the video images, the frequency range of the alias frequencies being within a detectable frequency range determined by the sampling frequency of the video images.

11. The method of claim 10, wherein the detectable frequency range is one-half of the sampling frequency.

12. The method of claim 10, wherein the non-flicker frequency band comprises a frequency range of frequencies within the detectable frequency range where flicker in the video images is not expected to occur.

13. The method of claim 1, wherein performing frequency analysis on the time-series of digital numbers comprises:

applying a first digital filtering function to the time-series of digital numbers, the first digital filtering function generating the first signal indicative of the frequency components of the time-series of digital numbers in the flicker frequency band; and

applying a second digital filtering function to the time-series of digital numbers, the second digital filtering function generating the second signal indicative of the spectral energy of the time-series of digital numbers at the non-flicker frequency band.

14. The method of claim 1, wherein performing frequency analysis on the time-series of digital numbers comprises:

performing a first Fourier analysis on the time-series of digital numbers, the first Fourier analysis generating the first signal indicative of the frequency components of the time-series of digital numbers in the flicker frequency band; and

performing a second Fourier analysis on the time-series of digital numbers, the second Fourier analysis generating the second signal indicative of the frequency components of the time-series of digital numbers at the non-flicker frequency band.

15. The method of claim 1, wherein performing frequency analysis on the time-series of digital numbers comprises:

performing a frequency transform on the time-series of digital numbers, the frequency transform generating the first signal indicative of the frequency components of the time-series of digital numbers at the flicker frequency band and the second signal indicative of the spectral energy of the time-series of digital numbers in the non-flicker frequency band.

16. The method of claim 1, wherein computing a first spectral energy signal and a second spectral energy signal based on the first signal and the second signal respectively comprises:

computing a square of the first signal as the first spectral energy signal; and

computing a square of the second signal as the second spectral energy signal.

17. The method of claim 16, wherein computing a first spectral energy signal and a second spectral energy signal based on the first signal and the second signal respectively further comprises:

low pass filtering the square of the first signal as the first spectral energy signal; and

low pass filtering the square of the second signal as the second spectral energy signal.

18. The method of claim 1, wherein accumulating multiple flicker detect indicator signals and generating a flicker present signal comprise:

resetting a first count value;

comparing each flicker detect indicator signal to the first threshold;

incrementing the first count value when a flicker detect indicator is equal to or greater than the first threshold;

decrementing the first count value when a flicker detect indicator is less than the first threshold;

accumulating the first count value over multiple flicker detect indicator signals;

comparing the first count value to the entry value; and

generating a flicker present signal when the first count value is greater than the entry value.

19. The method of claim 1, further comprising:

accumulating multiple flicker detect indicator signals from multiple time-series of digital numbers, the accumulated flicker detect indicator signals having values smaller than a second threshold; and

generating a flicker absent signal when the number of accumulated flicker detect indicator signals having values smaller than a second threshold is greater than an exit value.

20. The method of claim 19, wherein accumulating multiple flicker detect indicator signals and generating a flicker absent signal comprise:

resetting a second count value;

comparing each flicker detect indicator signal to the second threshold;

incrementing the second count value when a flicker detect indicator is equal to or less than the second threshold;

decrementing the second count value when a flicker detect indicator is greater than the second threshold;

accumulating the second count value over multiple flicker detect indicator signals;

comparing the second count value to the exit value; and

generating a flicker absent signal when the second count value is greater than the exit value.