Method and apparatus for determining highlight segments of sport video

• US 7,983,442 B2
• Filed: 05/30/2008
• Issued: 07/19/2011
• Est. Priority Date: 08/29/2007
• Status: Active Grant

• Current Assignee: Cyberlink Corporation
• Original Assignee: Cyberlink Corporation
• Inventors: Chen, Ming-Jun, Lin, Bor-Ching, Chiang, Yueh-Hsuan, Huang, Ho-Chao
• Primary Examiner(s): Johns; Andrew W
• Assistant Examiner(s): GORADIA, SHEFALI DINESH
• Application Number:
  US12/129,695
• Publication Number:
  US 20090060342A1
• Time in Patent Office: 1,145 Days
• Field of Search: 382/100, 382/190, 348/157, 340/323.R, 700/91, 700/92
• US Class Current: 382/100
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44

Abstract

In a method for determining highlight segments of a sport video, the sport video having a plurality of image frames is analyzed to recognize a scoreboard image and a plurality of scoreboard characteristics thereof. The scoreboard image comprises at least one of the scoreboard characteristics. Then, a request message showing at least one recognized scoreboard characteristic is displayed on a user interface to receive a user response, wherein the user response includes a recognized result of one of the scoreboard characteristics. Finally, variations in the recognized scoreboard image among image frames can be monitored according to the user response. Therefore, the highlight segments of the sport video can be determined according to the variations.

Claims

1. A method for determining highlight segments of a sport video, wherein the sport video comprises a plurality of image frames, the method comprising the steps of:

receiving the sport video;

analyzing the sport video to recognize a scoreboard image and a plurality of scoreboard characteristics, wherein the scoreboard image comprises at least one of the scoreboard characteristics;

displaying a request message showing at least one recognized scoreboard characteristic on a user interface to receive a user response, wherein the user response includes a recognized result of one of the scoreboard characteristics;

monitoring variations in the recognized scoreboard image among image frames according to the user response; and

determining the highlight segments of the sport video according to the variations.

2. The method of claim 1, wherein at least one image frame comprises the scoreboard image.

3. The method of claim 1, the method further comprising:

providing a database, and

storing a metadata into the database.

4. The method of claim 3, wherein the metadata further comprises occurrence time, duration, and number of times according to the highlight segments in the sport video.

5. The method of claim 3, wherein the metadata is generated by the user response.

6. The method of claim 5, wherein the user response further comprises a location of one of the recognized scoreboard characteristics.

7. The method of claim 5, wherein the user response further comprises one of Yes, No, Correct, and Incorrect.

8. The method of claim 5, wherein the user response further comprises a number.

9. The method of claim 1, wherein analyzing step further comprises:

comparing the image frames of the sport video, wherein the image frames comprise the scoreboard image;

recognizing a region with small variation between the image frames, wherein the recognized region is determined to be the scoreboard image.

10. The method of claim 1, the method further comprising:

providing a database; and

storing the recognized result into the database to be reference patterns when processing subsequent sport video analysis for the same sport game.

11. The method of claim 10, wherein analyzing step further comprises:

comparing the image frames with the reference patterns of each of sport games stored in the database; and

determining the matched patterns in the image frames as the scoreboard image and the scoreboard characteristics thereof.

12. The method of claim 1, wherein the scoreboard characteristics comprise content data, wherein the content data comprises number data, text data, brightness and status of the scoreboard characteristics in the image frames.

13. The method of claim 12, wherein displaying step further comprising:

analyzing at least one content data of the recognized scoreboard characteristics;

displaying at least one analyzed content data;

generating the request message on the user interface simultaneously to receive the user response; and

determining whether the analyzed content data is correct according to the user response.

14. The method of claim 1, wherein the scoreboard characteristics further comprise locations, size, and shape thereof.

15. The method of claim 14, wherein displaying step further comprising:

displaying at least one indicated location of the recognized scoreboard characteristics;

generating the request message on the user interface simultaneously to receive the user response; and

determining whether the indicated location is correct according to the user response.

16. The method of claim 14, wherein displaying step further comprising:

displaying a plurality sets of possible locations of the recognized scoreboard characteristics;

generating the request message simultaneously to receive the user response directly selecting a correct set of locations of the recognized scoreboard characteristics, wherein another request message is displayed simultaneously to receive the user response directly indicating a correct location of the recognized scoreboard characteristics if the possible locations are all incorrect; and

determining the indicated location of the recognized scoreboard characteristics according to the user response.

17. The method of claim 14, wherein displaying step further comprising:

displaying the recognized scoreboard image;

generating the request message on the user interface simultaneously to receive the user response directly indicating a location of one of the scoreboard characteristics; and

determining the indicated location according to the user response.

18. An apparatus for determining highlight segments of a sport video, wherein the sport video comprises a plurality of image frames, the apparatus comprising:

a receiver for receiving the sport video;

an analyzer connected to the receiver for analyzing the sport video to recognize a scoreboard image and a plurality of scoreboard characteristics, wherein the scoreboard image comprises at least one of the scoreboard characteristics;

a user interface connected to the analyzer for displaying a request message showing at least one recognized scoreboard characteristic to receive a user response, wherein the user response includes a recognized result of one of the scoreboard characteristics;

a detector coupled to the user interface for monitoring variations in the recognized scoreboard image among image frames according to the user response; and

a determination module for determining the highlight segments of the sport video according to the variations.

19. The apparatus of claim 18, wherein at least one image frame comprises the scoreboard image.

20. The apparatus of claim 18, wherein the apparatus further comprises a database and the database stores a metadata.

21. The apparatus of claim 20, wherein the metadata further comprises occurrence time, duration, and number of times according to the highlight segments in the sport video.

22. The apparatus of claim 20, wherein the metadata is generated by the user response.

23. The apparatus of claim 22, wherein the user response further comprises a location of one of the recognized scoreboard characteristics.

24. The apparatus of claim 22, wherein the user response further comprises one of Yes, No, Correct, and Incorrect.

25. The apparatus of claim 22, wherein the user response further comprises a number.

26. The apparatus of claim 18, wherein the analyzer further comprises:

a first comparator for comparing the image frames of the sport video for recognizing a region with small variation between the image frames, wherein the image frames comprise the scoreboard image; and

a first recognizer for determining the recognized region to be the scoreboard image.

27. The apparatus of claim 18, wherein the apparatus further comprises a database and the database stores the recognized result to be reference patterns when processing subsequent sport video analysis for the same sport game.

28. The apparatus of claim 27, wherein the analyzer further comprises:

a second comparator for comparing the image frames with the reference patterns of each of sport games stored in the database; and

a second recognizer for determining the matched patterns in the image frames as the scoreboard image and the scoreboard characteristics thereof.

29. The apparatus of claim 18, wherein the scoreboard characteristics comprise content data, wherein the content data comprises number data, text data, brightness and status of the scoreboard characteristics in the image frames.

30. The apparatus of claim 18, wherein the scoreboard characteristics further comprise locations, size, and shape thereof.

31. The apparatus of claim 18, wherein the user interface further comprises:

a request generator for displaying the request message showing at least one recognized scoreboard characteristic.

32. The apparatus of claim 18, wherein the user interface further comprises:

a request receiver for receiving the user response for determining the recognized scoreboard characteristics, wherein the user response includes a recognized result of one of the scoreboard characteristics.