Shot transition detecting method for video stream

• US 20030123541A1
• Filed: 10/01/2002
• Published: 07/03/2003
• Est. Priority Date: 12/29/2001
• Status: Abandoned Application

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Yoon, Kyoung Ro, Jun, Sung Bae
• Application Number:
  US10/263,051
• Publication Number:
  US 20030123541A1
• Time in Patent Office: Days
• US Class Current: 375/240.08
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

Disclosed herein is a method of detecting a shot transition of a moving picture video, comprising the steps of: extracting a color histogram of three adjacent frames in order on time series; obtaining a difference of the color histogram between the three adjacent frames and then detecting a shot transition candidate interval by concurrently using arrangement characteristics of the difference of the color histogram; and examining a distribution of a macro block type within the shot transition candidate interval and verifying whether a shot transition is present or not within the shot transition candidate interval.

Claims

1. A method of detecting a shot transition of a moving picture video, comprising the steps of:

obtaining color histogram differences between three frames placed at different points of time on time series; and

detecting the shot transition by using arrangement characteristics of the color histogram differences concurrently.

2. The method according to claim 1, wherein the arrangement characteristics of the color histogram differences are placed in the order of a first frame, a second frame, and a third frame, and the shot transition is detected by using a color histogram difference (D1) between the first frame and the second frame, a color histogram difference (D2) between the second frame and the third frame, and a color histogram difference (D3) between the first frame and the third frame.

3. The method according to claim 1, wherein the frames are I frame in a stream encoded by MPEG or H.26x series.

4. The method according to claim 2, wherein a concerned interval is set as a cut candidate interval if the color histogram differences (D1, D2, D3) satisfy hard cut condition,

the concerned interval is set as a gradual shot transition candidate interval if the color histogram differences (D1, D2, D3) satisfy gradual shot transition condition, and

if the hard cut condition and the gradual shot transition condition are not satisfied, it is determined that the shot transition is not generated in the concerned interval.

5. The method according to claim 4, wherein in addition to the shot transition candidate, a type of shot variation and a probability of shot variation are outputted concurrently.

6. The method according to claim 4, wherein the hard cut condition is set as follows:

condition 1. D1>

τ

₁ &

&

D2<

τ

₂,

condition 2. D1>

τ

₃ &

&

D2>

τ

₃ &

&

D1/D3>

τ

₄ &

&

D3>

τ

₅.

7. The method according to claim 6, wherein

a case corresponding to the condition 1 is considered as a high probability for the hard cut, and

a case corresponding to the condition 2 is considered as a low probability for the hard cut.

8. The method according to claim 4, wherein the gradual shot transition condition is set as follows:

condition 1. D1>

τ

₆ &

&

D2<

τ

₆ &

&

D3<

τ

₇,

condition 2. D1>

τ

₆ &

&

D2>

τ

₆ &

&

τ

₈<

(D1+D2)/D3<

τ

₉.

9. The method according to claim 8, wherein

a case corresponding to the condition 1 is considered as a high probability for the gradual shot transition, and

a case corresponding to the condition 2 is considered as a low probability for the gradual shot transition.

10. A method of detecting a shot transition of a moving picture video, comprising the steps of:

extracting a color histogram of three frames in order on time series;

obtaining a difference of the color histogram between the three frames and then detecting a shot transition candidate interval by concurrently using arrangement characteristics of the difference of the color histogram; and

examining a distribution of a macro block type within the shot transition candidate interval and verifying whether a shot transition is present or not within the shot transition candidate interval.

11. The method according to claim 10, wherein said step of detecting a shot transition candidate interval includes generating a histogram difference vector consisting of a histogram difference between three frames;

and

determining whether a concerned interval is the shot transition candidate interval by using a characteristic of each element value of the histogram difference vector.

12. The method according to claim 11, wherein in addition to the shot transition candidate, a type of shot variation and a probability of shot variation are outputted concurrently.

13. The method according to claim 10, wherein said step of verifying whether a shot transition is present or not includes verifying whether a shot transition is present or not by concurrently using characteristics of the macro block type of a P frame and the macro block type of a B frame within a concerned interval.

14. The method according to claim 13, wherein whether the hard cut is generated or not is verified based on the presence of a peak of intra coded block rates and the presence of hard cut characteristic in a prescribed frame within a concerned GOP for the shot transition detection.

15. The method according to claim 13, wherein whether the gradual shot transition is present or not is verified based on swing characteristic of a rate of forward macro block or a rate of backward macro block and a forward prediction rate in a prescribed frame within a concerned GOP for the shot transition detection.

16. The method according to claim 12, wherein a condition on whether the shot transition is present or not is adjusted based on the type of shot variation and the probability of shot variation.

17. A method of detecting a shot transition of a moving picture video, comprising the steps of:

extracting a color histogram of three adjacent I frames in order on time series;

obtaining a difference of a pair of the color histogram combined from the three adjacent I frames;

detecting a shot transition candidate interval by concurrently using arrangement characteristics of the difference of the color histogram; and

examining a distribution of a macro block type within the shot transition candidate interval, verifying whether a shot transition is present or not within the shot transition candidate interval, and if it is verified that the transition is present, identifying the shot transition candidate interval as a separate shot.