Method for indexing a sports video program carried by a video stream

• US 8,233,048 B2
• Filed: 09/19/2006
• Issued: 07/31/2012
• Est. Priority Date: 09/19/2006
• Status: Active Grant

• Current Assignee: MAVS Lab Incorporated
• Original Assignee: MAVS Lab Incorporated
• Inventors: Yeh, Chia-Hung, Shih, Hsuan-Huei
• Primary Examiner(s): Rao, Andy
• Application Number:
  US11/533,357
• Publication Number:
  US 20080068511A1
• Time in Patent Office: 2,142 Days
• Field of Search: 37524001-24029, 348142-160
• US Class Current: 348/157
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

A method for indexing a sports video program carried by a video stream is disclosed. The method includes temporarily indexing a plurality of shots of the video stream by performing shot detection. In addition, the method further includes extracting a plurality of shots of the sports video program from at least one portion of the shots indexed during the shot detection at least according to low level visual features of the at least one portion, whereby the extracted shots are temporarily kept indexed. Additionally, the method further includes validating a plurality of shots by comparing one of the extracted shots with at least the others of the extracted shots, whereby the validated shots are kept indexed for use of playback of at least one portion of the sports video program.

Claims

1. A method for indexing a sports video program carried by a video stream, comprising:

temporarily indexing a plurality of shots of the video stream by performing shot detection;

extracting a plurality of shots of the sports video program from at least one portion of the shots indexed during the shot detection at least according to low level visual features of the at least one portion, whereby the extracted shots are temporarily kept indexed; and

validating a plurality of shots by comparing one of the extracted shots with at least the others of the extracted shots, whereby the validated shots are kept indexed for use of playback of at least one portion of the sports video program.

2. The method of claim 1, further comprising:

performing commercial detection to sieve out a plurality of shots of the sports video program from the other shots indexed during the shot detection;

wherein in the step of extracting the plurality of shots of the sports video program, the at least one portion of the shots indexed during the shot detection is defined as the sieved shots.

3. The method of claim 1, wherein the validated shots are kept indexed for use of rearranged playback of the at least one portion of the sports video program.

4. The method of claim 3, further comprising:

sorting the validated shots that are kept indexed to perform the rearranged playback of the at least one portion of the sports video program.

5. The method of claim 4, wherein the step of sorting the validated shots further comprises:

sorting the validated shots by comparing motions of the validated shots.

6. The method of claim 5, wherein the validated shots are sorted by similarity.

7. The method of claim 5, wherein the validated shots are sorted by variation of the motions.

8. The method of claim 1, wherein the low level visual features of the at least one portion comprise histogram data of the at least one portion.

9. The method of claim 8, wherein the step of extracting the plurality of shots of the sports video program further comprises:

summing a plurality of histogram differences (HDs) within each shot to generate a histogram difference sum of the shot, wherein each of the plurality of HDs corresponds to the difference between two histograms of two frames within the shot; and

excluding at least the shots that have larger histogram difference sums than the others from being extracted.

10. The method of claim 9, wherein the step of extracting the plurality of shots of the sports video program further comprises:

summing a plurality of histogram square values of a key frame of each of the shots except the shots that have larger histogram difference sums than the others to generate a histogram square sum (HSS) of the key frame; and

excluding at least the shots whose key frames have larger HSSs than the others from being extracted.

11. The method of claim 10, wherein the step of extracting the plurality of shots of the sports video program further comprises:

calculating the variance of a key frame of each of the shots except the shots whose key frames have larger HSSs than the others; and

excluding the shots whose key frames have larger variances than the others from being extracted.

12. The method of claim 8, wherein the low level visual features comprise the histogram data of color histograms or luminance histograms.

13. The method of claim 1, wherein the low level visual features of the at least one portion comprise pixel difference comparison results of the at least one portion.

14. The method of claim 1, wherein the low level visual features of the at least one portion comprise discrete cosine transform (DCT) coefficients of the at least one portion.

15. The method of claim 1, wherein a key frame is selected from a plurality of frames within each shot to represent the shot.

16. The method of claim 1, wherein the step of validating the plurality of shots by comparing one of the extracted shots with at least the others of the extracted shots further comprises:

selecting a most significant shot within the extracted shots; and

validating the plurality of shots according to comparison results of the most significant shot and the other extracted shots.

17. The method of claim 1, wherein the step of validating the plurality of shots by comparing one of the extracted shots with at least the others of the extracted shots further comprises:

selecting a most significant shot within the extracted shots; and

validating the at least one portion of the shots indexed during the shot detection according to comparison results of the most significant shot and the at least one portion of the shots indexed during the shot detection.

18. The method of claim 1, wherein the step of validating the plurality of shots by comparing one of the extracted shots with at least the others of the extracted shots further comprises:

selecting a most significant shot within the extracted shots; and

validating all the shots indexed during the shot detection according to comparison results of the most significant shot and all the shots indexed during the shot detection.

19. The method of claim 1, further comprising:

determining the video genre of the sports video program;

wherein the step of extracting the plurality of shots of the sports video program from the at least one portion of the shots indexed during the shot detection further comprises;

extracting the plurality of shots of the sports video program from the at least one portion of the shots indexed during the shot detection according to the video genre.