Method and apparatus for detecting fades in digital video sequences

• US 5,245,436 A
• Filed: 02/14/1992
• Issued: 09/14/1993
• Est. Priority Date: 02/14/1992
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Alattar, Adnan M.
• Primary Examiner(s): Kostak, Victor R.
• Application Number:
  US07/836,108
• Time in Patent Office: 578 Days
• Field of Search: 358/182, 358/183, 358/185, 358/22, 358/105
• US Class Current: 348/595
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

A method and apparatus for detecting a fade within a sequence of digital motion video frames. A first frame and a previous frame are selected from the sequence as first and second regions, respectively, for processing. The mean of the first region and the mean of the second region are each calculated and the relative mean change between the means is determined. A fade is detected if the relative mean change exceeds a first predetermined threshold. Alternatively, a fade is detected if the relative mean change is less than the first predetermined threshold but greater than a second predetermined threshold and the magnitude of the difference between the means is greater than a third predetermined threshold.

Claims

1. A method for compressing a fade within a sequence of digital motion video frames comprising the steps of:

(a) selecting first and second frames from said sequence for processing;

(b) determining a first luminosity difference value from said first and second frames;

(c) detecting a fade within said sequence by comparing said first luminosity difference value to at least one predetermined threshold; and

(d) compressing at least one of said selected frames in accordance with the result of step (c).

2. The method of claim 1, wherein step (a) comprises the steps of:

i. selecting a frame from said sequence as a first region for processing; and

ii. selecting a previous frame from said sequence as a second region for processing;

step (b) comprises the steps of;

i. calculating the mean of said first region;

ii. calculating the mean of said second region;

iii. determining the magnitude of the difference between the result of steps (i) and (ii); and

iv. determining a relative mean change by dividing the magnitude of said difference by the means of said first region; and

step (c) comprises the steps of;

i. comparing said relative mean change to a first predetermined threshold; and

ii. detecting a fade if said relative mean change exceeds said first predetermined threshold.

3. The method of claim 1, wherein said first luminosity difference value is determined by summing pixel values in said first frame, summing pixel values in said second frame, and determining the absolute value of the difference between said sums.

4. The method of claim 1, wherein said first luminosity difference value is determined by comparing said first and second frames on a pixel-by-pixel basis and summing the absolute value of the difference of each pair of compared pixels.

5. A method for processing a sequence of digital motion video frames having at least one flagged fade frame comprising the steps of:

(a) determining whether said at least one flagged fade frame is a single fade frame;

(b) if said at least one flagged fade frame is a single fade frame then

i. calculating a relative mean change for said single fade frame;

ii. comparing said relative mean change against a predetermined threshold; and

iii. unflagging said single fade frame if the magnitude of said relative mean change is less than said predetermined threshold.

6. The method of claim 5 wherein said digital motion video sequence includes a plurality of flagged fade frames, said plurality of flagged fade frames defining at least one fade range, said method further comprising the steps of:

(c) identifying at least one non-fade frame within said at least one fade range; and

(d) flagging said at least one non-fade frame as a fade frame.

7. An apparatus for compressing a fade within a sequence of digital motion video frames comprising:

(a) means for providing first and second frames from said sequence for processing;

(b) means for determining at least one luminosity difference value from said first and second frames;

(c) fade detector means for detecting a fade within said sequence by comparing said at least one luminosity difference value to at least one predetermined threshold; and

(d) means for compressing at least one of said selected frames in accordance with the result of said fade detector means.

8. The apparatus of claim 7, wherein said means for providing first and second frames for processing comprises:

i. means for providing a selected frame from said sequence as a first region for processing;

ii. means for providing a previous frame from said sequence as a second region for processing;

said means for determining at least one luminosity difference value comprises;

i. first calculating means for calculating the means of said first region;

ii. second calculating means for calculating the mean of said second region;

iii. difference means for determining the magnitude of the difference between the means of said first region and the mean of said second region;

iv. relative difference means for determining the relative mean change between said first region and said second region; and

said fade detector means comprises;

i. first comparing means for comparing said relative means change to a first predetermined threshold; and

ii. means for detecting the presence of a fade if said relative mean change exceeds said first predetermined threshold.

9. The apparatus of claim 7, wherein said first luminosity difference value is the magnitude of the difference between the sum of the pixel values in said first frame and the sum of pixel values in said second frame.

10. The apparatus of claim 7, wherein said first luminosity difference value is a sum of the absolute value of differences determined by comparing said first and second frames on a pixel-by-pixel basis.

11. A apparatus for processing a sequence of digital motion video frames having at least one flagged fade frame comprising:

(a) means for determining whether said at least one flagged fade frame is a single fade frame;

(b) means for calculating a first luminosity difference value for a single fade frame;

(c) means for comparing said first luminosity difference value against a predetermined threshold; and

(d) means for unflagging said single fade frame if the magnitude of first luminosity difference value is less than said predetermined threshold.

12. The apparatus of claim 11, wherein said first luminosity difference value is the relative means change between said single fade frame and another frame in said sequence.

13. The apparatus of claim 12, wherein said digital motion video sequence includes a plurality of flagged fade frames, said plurality of flagged fade frames defining at least one fade range, said apparatus further comprising:

(e) means for identifying at least one non-fade frame within said at least one fade range; and

(f) means for flagging said at least one non-fade frame as fade frame.

14. A method for detecting a fade frame within a sequence of digital motion video frames comprising the steps of:

(a) selecting a frame from said sequence as a first region for processing; and

(b) selecting a previous frame from said sequence as a second region for processing;

(c) calculating the means of said first region;

(d) calculating the mean of said second region;

(e) determining the magnitude of the difference between the results of steps (c) and (d);

(f) determining a relative mean change between said first and second regions in accordance with the result of step (e);

(g) comparing said relative means change to a first predetermined threshold;

(h) detecting a fade if said relative means change exceeds a first predetermined threshold;

(i) if a fade is detected in step (h) then;

(1) dividing said selected frame and said previous frame into corresponding regions;

(2) selecting a region from said selected frame as a first region for processing and a corresponding region in said previous frame as a second region for processing;

(3) repeating steps (c) to (g);

(4) if said relative mean change exceeds said first predetermined threshold, then incrementing a counter;

(5) repeating steps (i) (1) to (i) (4) for remaining corresponding regions in said selected and previous frames; and

(6) flagging said selected frame as a fade frame if said counter divided by the number of regions in said selected frame exceeds a predetermined percentage.

15. An apparatus for detecting a fade within a sequence of digital motion video frames comprising:

(a) means for providing a selected frame from said sequence as a first region for processing;

(b) means for providing a previous frame from said sequence as a second region for processing;

(c) first calculating means or calculating the mean of said first region;

(d) second calculating means for calculating the mean of said second region;

(e) difference means for determining the magnitude of the difference between the mean of said first region and the mean of said second region;

(f) relative difference means for determining the relative mean change between said first region and said second region;

(g) first comparing means for comparing said relative means change to a first predetermined threshold;

(h) means for detecting the presence of a fade if said relative means change exceeds said first predetermined threshold;

(i) frame dividing means for dividing said selected frame and said previous frame into corresponding regions;

(j) means for selecting a region from said selected frame as a first region for processing;

(k) means for selecting a region from said previous frame as a second region for processing;

(l) means for incrementing a counter if the relative means change between said first region and said second region exceeds said first predetermined threshold; and

(m) fade frame flagging means for flagging said selected frame as a fade frame if said counter divided by the number of regions in said selected frame exceeds a predetermined percentage.

16. A method for detecting a fade within a sequence of digital motion video frames comprising the steps of:

(a) selecting first and second frames from said sequence for processing;

(b) determining a first luminosity difference value between said first and second frames, and determining a second luminosity difference value between said first and second frames; and

(c) detecting a fade by comparing said first luminosity difference value to at least one predetermined threshold and by comparing said second luminosity difference value to a second predetermined threshold.

17. The method of claim 16, wherein step (a) comprises the steps of:

i. selecting a frame from said sequence as a first region for processing; and

ii. selecting a previous frame from said sequence as a second region for processing;

step (b) comprises the steps of;

i. calculating the mean of said first region;

ii. calculating the mean of said second region;

iii. determining the magnitude of the difference between the result of steps (i) and (ii); and

iv. determining a relative means change by dividing the magnitude of said difference by the mean of said first region; and

step (c) comprises the steps of;

i. comparing said relative mean change to a first predetermined threshold;

ii. comparing said relative mean change to a second predetermined threshold, said second predetermined threshold being smaller than said first predetermined threshold;

iii. comparing the magnitude of said difference to a third predetermined threshold; and

iv. detecting a fade if said relative mean change is between said first and second predetermined thresholds and the magnitude of said difference is greater than said third predetermined threshold.

18. The method of claim 17, further comprising the step of:

(d) if a fade is detected in step (c) (iv) then;

i. dividing said selected frame and said previous frame into corresponding regions;

ii. selecting a region from said selected frame as a first region for processing and a corresponding region in said previous frame as a second region for processing;

iii. repeating steps (b) to (c) (iii);

iv. if said relative mean change is between said first and second predetermined thresholds and the magnitude of said difference is greater than said third predetermined threshold, then incrementing a counter;

v. repeating steps ii. to iv. for remaining corresponding regions in said selected and previous frames; and

vi. flagging said selected frame as a fade frame if said counter divided by the number of regions in said selected frame exceeds a predetermined percentage.

19. The method of claim 16, wherein step (a) comprises the steps of:

i. selecting a frame from said sequence as a first region for processing; and

ii. selecting a previous frame from said sequence as a second region for processing;

step (b) comprises the steps of;

i. calculating the mean of said first region;

ii. calculating the mean of said second region;

iii. determining the magnitude of the difference between the result of steps (i) and (ii); and

iv. determining a relative mean change by dividing the magnitude of said difference by the means of said first region; and

step (c) comprises the steps of;

i. comparing said relative means change to a first predetermined threshold;

ii. comparing said relative means change to a second predetermined threshold, said second predetermined threshold being smaller than said first predetermined threshold;

iii. comparing said difference to a third predetermined threshold; and

iv. detecting a fade if said relative mean change is greater than said first predetermined threshold or if said relative means change is greater than said second predetermined threshold and the magnitude of said difference is greater than said third predetermined threshold.

20. The method of claim 19, further comprising the step of:

(d) if a fade is detected in step (c) (iv) then;

i. dividing said selected frame and said previous frame into corresponding regions;

ii. selecting a region from said selected frame as a first region for processing and a corresponding region in said previous frame as a second region for processing;

iii. repeating steps (b) to (c) (iii);

iv. if said relative mean change is greater than said first predetermined threshold or if said relative mean change is greater than said second predetermined threshold and the magnitude of said difference is greater than said third predetermined threshold, then incrementing a counter;

v. repeating steps ii. to iv. for remaining corresponding regions in said selected and previous frames; and

vi. flagging said selected frame as a fade frame if said counter divided by the number of regions in said selected frame exceeds a predetermined percentage.

21. The method of claim 19, wherein step (c) further comprises the steps of:

i. comparing the mean of said first region with a fourth predetermined threshold, said second predetermined threshold being greater than said fourth predetermined threshold;

ii. comparing the mean of said first region with a fifth predetermined threshold;

iii. detecting a fade only if the mean of said first region is between said fourth and fifth thresholds.

22. An apparatus for detecting a fade within a sequence of digital motion video frames comprising:

(a) means for providing first and second frames from said sequence for processing;

(b) means for determining at least one luminosity difference value from said first and second frames, and means for determining a second luminosity difference value from said first and second frames; and

(c) fade detector means for detecting a fade by comparing said at least one luminosity difference value to at least one predetermined threshold and by comparing said second luminosity difference value to a second predetermined threshold.

23. The apparatus of claim 22, wherein said means for providing first and second frames for processing comprises:

i. means for providing a selected frame from said sequence as a first region for processing;

ii. means for providing a previous frame from said sequence as a second region for processing;

said means for determining at least one luminosity difference value and said second luminosity difference value comprise;

i. first calculating means for calculating the mean of said first region;

ii. second calculating means for calculating the mean of said second region;

iii. difference means for determining the magnitude of the difference between the means of said first region and the mean of said second region;

iv. relative difference means for determining the relative mean change between said first region and said second region; and

said fade detector means comprises;

i. first comparing means for comparing said relative means change to a first predetermined threshold;

ii. second comparing means for comparing said relative means change to a second predetermined threshold and for comparing said difference to a third predetermined threshold, said second predetermined threshold being smaller than said first predetermined threshold; and

iii. means for detecting the presence of a fade if said relative mean change is between said first and second thresholds and the magnitude of said difference is greater than said third predetermined threshold.

24. The apparatus of claim 23, further comprising:

(d) frame dividing means for dividing said selected frame and said previous frame into corresponding regions;

(e) means for selecting a region from said selected frame as a first region for processing;

(f) means for selecting a region from said previous frame as a second region for processing;

(g) means for incrementing a counter if said relative mean change is between said first and second thresholds and the magnitude of said difference is greater than said third predetermined threshold; and

(h) fade frame flagging means for flagging said selected frame as a fade frame if said counter divided by the number of regions in said selected frame exceeds a predetermined percentage.

25. The apparatus of claim 22, wherein said means for providing first and second frames for processing comprises:

i. means for providing a selected frame from said sequence as a first region for processing;

ii. means for providing a previous frame from said sequence as a second region for processing;

said means for determining at least one luminosity difference value and said second luminosity difference value comprise;

i. first calculating means for calculating the mean of said first region;

ii. second calculating means for calculating the mean of said second region;

iii. difference means for determining the magnitude of the difference between the mean of said first region and the mean of said second region;

iv. relative difference means for determining the relative mean change between said first region and said second region; and

said fade detector means comprises;

i. first comparing means for comparing said relative means change to a first predetermined threshold; and

ii. second comparing means for comparing said relative mean change to a second predetermined threshold and for comparing the magnitude of said difference to a third predetermined threshold, said second predetermined threshold being smaller than said first predetermined threshold; and

iii. means for detecting the presence of a fade if said relative mean change is greater than said first predetermined threshold or if said relative mean change is between said first and second thresholds and the magnitude of said difference is greater than said third predetermined threshold.

26. The apparatus of claim 25, further comprising:

(d) frame dividing means for dividing said selected frame and said previous frame into corresponding regions;

(e) means for selecting a region from said selected frame as a first region for processing;

(f) means for selecting a region from said previous frame as a second region for processing;

(g) means for incrementing a counter if said relative mean change is greater than said first predetermined threshold or if said relative mean change is between said first and second thresholds and the magnitude of said difference is greater than said third predetermined threshold; and

(h) fade frame flagging means for flagging said selected frame as a fade frame if said counter divided by the number of regions in said selected frame exceeds a predetermined percentage.

27. The apparatus of claim 26, wherein said fade detector means detects a fade only if the mean of said first region is between fourth and fifth predetermined thresholds.