Scene change detector for digital video

• US 5,751,378 A
• Filed: 09/27/1996
• Issued: 05/12/1998
• Est. Priority Date: 09/27/1996
• Status: Expired due to Term

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: General Instrument Corporation (CommScope Holding Company, Inc.)
• Inventors: Chen, Xuemin, Liu, Vincent
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): DIN, LUANNE PAN
• Application Number:
  US08/722,468
• Time in Patent Office: 592 Days
• Field of Search: 348/700, 348/699, 348/405, 348/412, 348/415, 348/416
• US Class Current: 348/700
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

In a method for detecting a scene change between a prior video picture and a current video picture of a sequence of pictures, an average luminance value is determined for a block pair of the prior and current video pictures. Preferably, the blocks of the block pair are located, respectively, in the same relative position in the prior and current pictures. An incremental visual sensation value is determined using a difference between the average luminance values. If the incremental visual sensation value exceeds a block contrast threshold level, a scene change is indicated. In particular, if the minimum of the average luminance values of the current and prior picture blocks exceeds a dark scene threshold, the incremental visual sensation value is determined using the ratio of (a) the absolute value of the difference between the average luminance values, and (b) the minimum of the average luminance values of the current and prior picture blocks. Otherwise, the incremental visual sensation value is determined using the ratio of (a) the absolute value of the difference, and (b) the dark scene threshold. The method may be optimized by adjusting the block size based on the relative amount of motion and the current picture type.

Claims

1. A method for detecting a scene change between a prior video picture and a current video picture, comprising the steps of:

determining average luminance values of a block pair of said prior and current video pictures;

determining an incremental visual sensation value using a difference between said average luminance values;

determining a minimum of said average luminance values of said current and prior picture blocks, wherein;

if said minimum exceeds a dark scene threshold, said incremental visual sensation value is determined using the ratio of (a) the absolute value of said difference, and (b) said minimum;

if said minimum does not exceed a dark scene threshold, said incremental visual sensation value is determined using the ratio of (a) the absolute value of said difference, and (b) said dark scene threshold; and

if said incremental visual sensation value exceeds a block contrast threshold level, a scene change is indicated.

2. The method of claim 1, wherein said block contrast threshold level is approximately fifteen to approximately twenty-five times a Weber fraction constant.

3. The method of claim 1, wherein said blocks of said block pair are located, respectively, in the same relative position in said prior and current pictures.

4. The method of claim 1, wherein:

said dark scene threshold is approximately 10% of a maximum gray level.

5. The method of claim 1, wherein:

said difference between average luminance values is determined for a plurality of block pairs of said prior and current video pictures; and

said incremental visual sensation value is determined for each of said block pairs using said differences;

wherein;

if said incremental visual sensation value exceeds the block contrast threshold level for a threshold proportion of block pairs in said current and prior video pictures, a scene change is indicated.

6. The method of claim 5, wherein said threshold proportion is approximately 80% to approximately 90%.

7. An apparatus for detecting a scene change between a prior video picture and a current video picture, comprising:

means for determining average luminance values of a block pair of said prior and current video pictures;

means for determining an incremental visual sensation value using a difference between said average luminance values;

means for determining a minimum of said average luminance values of said current and prior picture blocks, wherein;

if said minimum exceeds a dark scene threshold, said incremental visual sensation value is determined using the ratio of (a) the absolute value of said difference, and (b) said minimum;

if said minimum does not exceed a dark scene threshold said incremental visual sensation value is determined using the ratio of (a) the absolute value of said difference, and (b) said dark scene threshold; and

if said incremental visual sensation value exceeds a block contrast threshold level, a scene change is indicated.

8. The apparatus of claim 7, wherein said block contrast threshold level is approximately fifteen to approximately twenty-five times a Weber fraction constant.

9. The apparatus of claim 7, further comprising:

means for determining said difference between average luminance values for a plurality of block pairs of said prior and current video pictures; and

means for determining said incremental visual sensation value for each of said block pairs using said differences;

wherein;

if said incremental visual sensation value exceeds the block contrast threshold level for a threshold proportion of block pairs in said current and prior video pictures, a scene change is indicated.

10. The apparatus of claim 9, wherein said threshold proportion is approximately 80% to approximately 90%.

11. The apparatus of claim 7, wherein:

said dark scene threshold is approximately 10% of a maximum gray level.

12. A method for detecting a scene change between a prior video picture and a current video picture, comprising the steps of:

determining average luminance values of a block pair of said prior and current video pictures;

determining an incremental visual sensation value using a difference between said average luminance values;

determining a relative amount of motion between said blocks of said block pair; and

adjusting a size of said blocks based on said relative amount of motion;

wherein;

if said incremental visual sensation value exceeds a block contrast threshold level, a scene change is indicated.

13. The method of claim 12, wherein the size of said blocks is increased as said relative amount of motion increases.

14. The method of claim 12, wherein said step of determining a relative amount of motion comprises the further steps of:

determining a sum of the absolute value of a horizontal motion vector and the absolute value of a vertical motion vector;

wherein said horizontal and vertical motion vectors are indicative of horizontal and vertical motion, respectively, of a video image of said current picture block relative to a video image of said prior picture block; and

determining if said sum exceeds a motion threshold.

15. The method of claim 14, wherein:

said motion threshold is adjusted according to a picture type of said current picture.

16. An apparatus for detecting a scene change between a prior video picture and a current video picture, comprising:

means for determining average luminance values of a block pair of said prior and current video pictures;

means for determining an incremental visual sensation value using a difference between said average luminance values;

means for determining a relative amount of motion between said blocks of said block pair; and

means for adjusting a size of said blocks based on said relative amount of motion;

wherein;

if said incremental visual sensation value exceeds a block contrast threshold level, a scene change is indicated.

17. The apparatus of claim 16, further comprising:

means for increasing the size of said blocks as said relative amount of motion increases.

18. The apparatus of claim 16, wherein said means for determining a relative amount of motion further comprises:

means for determining a sum of the absolute value of a horizontal motion vector and the absolute value of a vertical motion vector;

wherein said horizontal and vertical motion vectors are indicative of horizontal and vertical motion, respectively, of a video image of said current picture-block relative to a video image of said prior picture block; and

means for determining if said sum exceeds a motion threshold.

19. The apparatus of claim 18, further comprising:

means for adjusting said motion threshold according to a picture type of said current picture.