Summarization of football video content

• US 7,639,275 B2
• Filed: 01/03/2005
• Issued: 12/29/2009
• Est. Priority Date: 08/20/2001
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Sampsell, Jeffrey B., Li, Baoxin, Sezan, M. Ibrahim
• Primary Examiner(s): DIEP, NHON THANH
• Application Number:
  US11/028,812
• Publication Number:
  US 20050134686A1
• Time in Patent Office: 1,821 Days
• Field of Search: 348/159
• US Class Current: 348/159
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

Summarization of video content including football.

Claims

1. A method of processing a video including football comprising:

(a) a computer identifying a plurality of segments of said video representing an event, wherein said identifying for at least one of said segments includes detecting the start of said event based upon processing of a first single frame of said video, where each of said segments includes a plurality of frames of said video, and wherein said detecting the start of said event is performed without comparing characteristics of any frame of said video to characteristics of frames of model sequences of said event;

(b) verifying that said first single frame is an appropriate start of said event based upon processing of a plurality of additional single frames, each temporally relevant to said first single frame, concurrently with said processing of said first single frame, where detecting the start of said event includes processing a sliding window of frames considered simultaneously, and where the start of said event is identified when at least a threshold percentage of frames in said sliding window are considered candidate hiking frames, said threshold percentage being less than 100%; and

(c) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.

2. The method of claim 1 where said threshold percentage is 70%.

3. The method of claim 1 where said steps of processing said first single frame and said processing of said plurality of additional frames detects the zooming of a camera used in capturing said video.

4. The method of claim 1 where said steps of processing said first single frame and said processing of said plurality of additional frames detects a lack of significant motion in said video.

5. The method of claim 1 where said processing said first single frame detects the zooming of a camera used in capturing said video.

6. The method of claim 1 where said processing said first single frame detects a lack of significant motion in said video.

7. A method of processing a video including football comprising:

(a) a computer identifying a plurality of segments of said video each including a plurality of frames and representing a play initiated by a hiking event, wherein said identifying for at least one of said segments includes individually processing respective frames in a sliding window of a plurality of sequential said frames of said video, said sliding window having a fixed number of frames, and identifying the first frame of a said window of said plurality of sequential frames as the start of said segment when at least a threshold percentage of frames, said threshold less than 100%, in said window are identified as candidate hiking frames; and

(b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.

8. The method of claim 7 where said threshold percentage of frames is 70%.

9. The method of claim 7 wherein said identifying is performed without comparing characteristics of any of said one or more sequential frames to characteristics of frames of model sequences of said event.

10. The method of claim 7 where each frame in said sliding window is processed concurrently.

11. A method of processing a video including football comprising:

(a) a computer identifying a plurality of segments of said video representing an event, wherein said identifying for at least one of said segments includes detecting the start of said event based upon processing of a first single frame of said video, where each of said segments includes a plurality of frames of said video, and wherein said detecting the start of said event is performed without comparing characteristics of any frame of said video to characteristics of frames of model sequences of said event;

(b) verifying that said first single frame is an appropriate start of said event based upon individually processing at least one other single frame temporally relevant to said first single frame, wherein said step of verifying includes individually processing respective frames in a sliding window of a plurality of sequential said frames of said video, said sliding window having a fixed number of frames, and identifying the first frame of a said window of said plurality of sequential frames as the start of said segment when at least a threshold percentage of frames, said threshold less than 100%, in said window are identified as candidate frames for the start of said event; and

(c) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.