Systems and methods for classifying sports video

• US 20070250777A1
• Filed: 04/25/2006
• Published: 10/25/2007
• Est. Priority Date: 04/25/2006
• Status: Active Grant

• Current Assignee: Cyberlink Corporation
• Original Assignee: Cyberlink Corporation
• Inventors: Tang, Shih-Min, Huang, Ho-Chao, Chen, Ming-Jun, Chen, Jiun-Fu
• Granted Patent: US 8,682,654 B2
• Time in Patent Office: Days
• US Class Current: 715/723
• CPC Class Codes: G10L 25/00 Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 muting semiconductor-based amplifiers when some special characteristics of a signal are sensed by a speech detector, e.g. sensing when no signal is present, H03G3/34
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

Disclosed are systems, methods, and computer readable media having programs for classifying sports video. In one embodiment, a method includes: extracting, from an audio stream of a video clip, a plurality of key audio components contained therein; and classifying, using at least one of the plurality of key audio components, a sport type contained in the video clip. In one embodiment, a computer readable medium having a computer program for classifying ports video includes: logic configured to extract a plurality of key audio components from a video clip; and logic configured to classify a sport type corresponding to the video clip.

Claims

1. A system for classifying sports video, comprising:

logic configured to collect a plurality of key audio samples from a plurality of types of sports;

logic configured to extract a plurality of sample audio features from a plurality of frames within each of the plurality of key audio samples;

logic configured to generate a plurality of patterns corresponding to the plurality of key audio samples;

logic configured to extract a plurality of audio features from the plurality of frames within an audio stream of a video clip;

logic configured to compare the plurality of sample audio features in the plurality of patterns with the a plurality of audio features extracted from the audio stream; and

logic configured to classify the video clip based on the location and the frequency of the key audio components.

2. The system of claim 1, further comprising means for editing the video clip by using the location and distribution of the plurality of key audio components within the video clip.

3. The system of claim 1, wherein a portion of the plurality of audio features are selected from the group consisting of:

mel-frequency cepstrum coefficients, pitch, LPC coefficients, LSP coefficients, audio energy, zero-crossing-rate, and noise frame ratio.

4. A method for classifying sports video, comprising:

extracting, from an audio stream of a video clip, a plurality of key audio components contained therein; and

classifying, using at least one of the plurality of key audio components, a sport type contained in the video clip.

5. The method of claim 4, further comprising generating a plurality of patterns corresponding to a plurality of key audio components.

6. The method of claim 5, wherein the generating further comprises collecting the plurality of key audio components that correspond to a plurality of sports.

7. The method of claim 6, wherein the generating further comprises determining a plurality of features for each of the plurality of key audio components.

8. The method of claim 7, wherein a portion of the plurality of features are selected from the group consisting of:

mel-frequency cepstrum coefficients, pitch, LPC coefficients, LSP coefficients, audio energy, zero-crossing-rate, and noise frame ratio.

9. The method of claim 7, wherein the generating further comprises determining a plurality of patterns of the plurality of features, wherein each pattern of the plurality of patterns corresponds to one of the plurality of key audio components.

10. The method of claim 9, wherein the generating further comprises training a model for each of the plurality of key audio components using the corresponding pattern of features.

11. The method of claim 4, wherein the extracting comprises determining a plurality of features from an audio stream of a video clip, wherein each of the features corresponds to one of a plurality of frames in the video clip.

12. The method of claim 11, wherein a portion of the plurality of features are selected from the group consisting of:

mel-frequency cepstrum coefficients, pitch, LPC coefficients, LSP coefficients, audio energy, zero-crossing rate, and noise frame ratio.

13. The method of claim 4, wherein the extracting comprises comparing the plurality of features in the audio stream with the plurality of patterns.

14. The method of claim 13, wherein the comparing comprises determining which of the plurality of key audio components is present in the video clip.

15. The method of claim 13, wherein the comparing comprises determining a distribution of the plurality of key audio components that occur in the video clip.

16. The method of claim 4, wherein an event that generates one of the plurality of key audio components is selected from the group consisting of:

ball strikes, whistles, car engines, water splashes, a referee sound, a commentator sound, and a bell ringing.

17. A computer readable medium having a computer program for classifying ports video, comprising:

logic configured to extract a plurality of key audio components from a video clip; and

logic configured to classify a sport type corresponding to the video clip.

18. The computer readable medium of claim 17, further comprising logic configured to generate a plurality of key audio patterns corresponding to a plurality of key audio sample components.

19. The computer readable medium of claim 17, further comprising logic configured to determine a plurality of audio characteristics from the video clip.

20. The computer readable medium of claim 19, wherein a portion of the plurality of audio characteristics are selected from the group consisting of:

mel-frequency cepstrum coefficients, pitch, LPC coefficients, LSP coefficients, audio energy, zero-crossing-rate, and noise frame ratio.

21. The computer readable medium of claim 17, further comprising logic configured to compare the plurality of audio characteristics within the video clip to the plurality of key audio patterns.

22. The computer readable medium of claim 17, wherein the classify logic is further configured to determine the sport type based on which of the key audio components is in the video clip.

23. The computer readable medium of claim 17, wherein the classify logic is further configured to determine the sport type based on a distribution of the key audio components within the video clip.