Integrated method for scene change detection
First Claim
1. A method for detecting scene changes in a video, comprising the steps of:
- computing a plurality of difference metrics of successive frames in a sequence of video frames, wherein the plurality of difference metrics comprise an interframe difference metric, a histogram difference metric, and an interframe variance difference metric;
automatically identifying candidate scene changes in the sequence of video frames using each of the computed difference metrics, wherein the candidate scene changes comprise abrupt scene changes that are identified using a combination of the computed interframe difference and histogram difference metrics, and gradual scene changes that are identified using the computed interframe variance difference metric; and
verifying that the candidate scene changes satisfy at least one predetermined condition for selecting final scene changes, wherein the step of identifying candidate scene changes comprises the steps of;
identifying a given video frame as a candidate scene change based on the interframe difference metric, if the computed interframe difference between the given video frame and a previous video frame satisfies a first threshold;
identifying a given video frame as a candidate scene change based on the histogram difference metric, if the computed histogram difference between the given video frame and a previous video frame satisfies a second threshold; and
identifying a given video frame as a candidate scene change based on the interframe variance difference metric, if the computed interframe variance difference between the given video frame and a previous video frame satisfies a third threshold, wherein the step of verifying comprises the steps of;
(a) selecting as a potential abrupt scene change, each video frame that was identified as a candidate scene change based on both the interframe difference metric and the histogram difference metric;
(b) removing a least probable one of any two successive potential abrupt scene changes, if a distance between the two successive potential abrupt scene changes is less than a predetermined minimum shot duration;
(c) selecting as a potential gradual scene change, each video frame that was identified as a candidate scene change based on the interframe variance difference metric;
(d) removing as a potential gradual scene change, each video frame selected in step (c) that is also a potential abrupt scene change remaining after step (b);
(e) for each potential gradual scene change remaining after step (d), determining if there are proximate frames that were selected as potential gradual scene changes;
(f) removing as a potential gradual scene change, each frame having no proximate frames that were selected as potential gradual scene changes;
(g) for each frame remaining after step (f) that is not selected as a potential gradual scene change, determining if the frame is located between sequences of frames that are selected as potential gradual scene changes;
(h) selecting each frame in step (g) as a potential gradual scene change if the frame is determined to be located between sequences of frames that are selected as potential gradual scene changes;
(i) determining a length of each sequence of potential gradual scene changes remaining after step (h);
(i) comparing the length of each sequence to a predetermined scene change duration threshold; and
(k) removing as a potential gradual scene change location, each frame of each sequence having a length that exceeds the predetermined scene change duration threshold.
3 Assignments
0 Petitions
Accused Products
Abstract
A system and method for detecting scene changes in a sequence of video frames utilizing a combination of a plurality of difference metrics including an interframe difference metric, a histogram difference metric and an interframe variance difference metric, as well as adaptive threshold level selection methods to dynamically select appropriate threshold levels for each of the difference metrics. The interframe and histogram difference metrics are used to identify abrupt scene changes and the interframe variance difference metric is used to identify gradual scene changes. The identified gradual and abrupt scene changes are validated by applying a plurality of conditions.
85 Citations
16 Claims
-
1. A method for detecting scene changes in a video, comprising the steps of:
-
computing a plurality of difference metrics of successive frames in a sequence of video frames, wherein the plurality of difference metrics comprise an interframe difference metric, a histogram difference metric, and an interframe variance difference metric;
automatically identifying candidate scene changes in the sequence of video frames using each of the computed difference metrics, wherein the candidate scene changes comprise abrupt scene changes that are identified using a combination of the computed interframe difference and histogram difference metrics, and gradual scene changes that are identified using the computed interframe variance difference metric; and
verifying that the candidate scene changes satisfy at least one predetermined condition for selecting final scene changes, wherein the step of identifying candidate scene changes comprises the steps of;
identifying a given video frame as a candidate scene change based on the interframe difference metric, if the computed interframe difference between the given video frame and a previous video frame satisfies a first threshold;
identifying a given video frame as a candidate scene change based on the histogram difference metric, if the computed histogram difference between the given video frame and a previous video frame satisfies a second threshold; and
identifying a given video frame as a candidate scene change based on the interframe variance difference metric, if the computed interframe variance difference between the given video frame and a previous video frame satisfies a third threshold, wherein the step of verifying comprises the steps of;
(a) selecting as a potential abrupt scene change, each video frame that was identified as a candidate scene change based on both the interframe difference metric and the histogram difference metric;
(b) removing a least probable one of any two successive potential abrupt scene changes, if a distance between the two successive potential abrupt scene changes is less than a predetermined minimum shot duration;
(c) selecting as a potential gradual scene change, each video frame that was identified as a candidate scene change based on the interframe variance difference metric;
(d) removing as a potential gradual scene change, each video frame selected in step (c) that is also a potential abrupt scene change remaining after step (b);
(e) for each potential gradual scene change remaining after step (d), determining if there are proximate frames that were selected as potential gradual scene changes;
(f) removing as a potential gradual scene change, each frame having no proximate frames that were selected as potential gradual scene changes;
(g) for each frame remaining after step (f) that is not selected as a potential gradual scene change, determining if the frame is located between sequences of frames that are selected as potential gradual scene changes;
(h) selecting each frame in step (g) as a potential gradual scene change if the frame is determined to be located between sequences of frames that are selected as potential gradual scene changes;
(i) determining a length of each sequence of potential gradual scene changes remaining after step (h);
(i) comparing the length of each sequence to a predetermined scene change duration threshold; and
(k) removing as a potential gradual scene change location, each frame of each sequence having a length that exceeds the predetermined scene change duration threshold. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for detecting scene changes in a video, the method comprising the steps of:
-
computing a plurality of difference metrics of successive frames in a sequence of video frames, wherein the plurality of difference metrics comprise an interframe difference metric, a histogram difference metric, and an interframe variance difference metric;
automatically identifying candidate scene changes in the sequence of video frames using each of the computed difference metrics, wherein the candidate scene changes comprise abrupt scene changes that are identified using a combination of the computed interframe difference and histogram difference metrics, and gradual scene changes that are identified using the computed interframe variance difference metric; and
verifying that the candidate scene changes satisfy at least one predetermined condition for selecting final scene changes, wherein the instructions for performing the step of identifying candidate scene changes comprise instructions for performing the steps of;
identifying a given video frame as a candidate scene change based on the interframe difference metric, if the computed interframe difference between the given video frame and a previous video frame satisfies a first threshold;
identifying a given video frame as a candidate scene change based on the histogram difference metric, if the computed histogram difference between the given video frame and a previous video frame satisfies a second threshold; and
identifying a given video frame as a candidate scene change based on the interframe variance difference metric, if the computed interframe variance difference between the given video frame and a previous video frame satisfies a third threshold, wherein the instructions for performing the step of verifying comprise instructions for performing the steps of;
(a) selecting as a potential abrupt scene change, each video frame that was identified as a candidate scene change based on both the interframe difference metric and the histogram difference metric;
(b) removing a least probable one of any two successive potential abrupt scene changes, if a distance between the two successive potential abrupt scene changes is less than a predetermined minimum shot duration;
(c) selecting as a potential gradual scene change, each video frame that was identified as a candidate scene change based on the interframe variance difference metric;
(d) removing as a potential gradual scene change, each video frame selected in step (c) that is also a potential abrupt scene change remaining after step (b);
(e) for each potential gradual scene change remaining after step (d), determining if there are proximate frames that were selected as potential gradual scene changes;
(f) removing as a potential gradual scene change, each frame having no proximate frames that were selected as potential gradual scene changes;
(g) for each frame remaining after step (f) that is not selected as a potential gradual scene change, determining if the frame is located between sequences of frames that are selected as potential gradual scene changes;
(h) selecting each frame in step (g) as a potential gradual scene change if the frame is determined to be located between sequences of frames that are selected as potential gradual scene changes;
(i) determining a length of each sequence of potential gradual scene changes remaining after step (h);
(j) comparing the length of each sequence to a predetermined scene change duration threshold; and
(k) removing as a potential gradual scene change location each frame of each sequence having a length that exceeds the predetermined scene change duration threshold. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
Specification