Systems and methods for generating multimedia highlight content

• US 20070041706A1
• Filed: 08/09/2005
• Published: 02/22/2007
• Est. Priority Date: 08/09/2005
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Gunatilake, Priyan
• Application Number:
  US11/199,635
• Publication Number:
  US 20070041706A1
• Time in Patent Office: Days
• US Class Current: 386/241
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4345 Extraction or processing of SI, e.g. extracting service information from an MPEG stream
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4508 Management of client data or end-user data
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

User-defined parameters and/or default parameters are used to detect the presence of potential highlights within a recorded version of a full-length broadcast program, according to one embodiment. Locations within the recorded program which satisfy any of the user or default parameters may then be added to a highlight list, which is usable to generate a highlight program. In one embodiment, video packets, audio packets and closed-caption packets are parceled out from the video stream and analyzed separately. For each of the types of packets analyzed, the locations and descriptions of potential highlights may be tabulated. This tabulated data may then be correlated and consolidated into a single highlight list which is usable to access the various identified highlights from the recorded full-length broadcast program, and to present them in sequence on a display device.

Claims

1. A method comprising:

receiving one or more user highlight parameters;

segmenting media content into video packets and closed-caption packets, wherein said video packets are comprised of a plurality of frames;

processing said video packets to identify graphical changes within a predetermined frame location between two or more of said plurality of frames, wherein said graphical changes are indicative of a potential highlight segment;

processing said closed-caption packets to identify highlight keywords that match at least one of said user highlight parameters; and

compiling a plurality of potential highlight segments into a highlight program based on at least one of said identified graphical changes and said identified highlight keywords.

2. The method of claim 1, wherein said video content is formatted as one of MPEG2, MPEG4 and Advanced Video Coding formats.

3. The method of claim 1, wherein said one or more user highlight parameters include one or more user-defined keywords.

4. The method of claim 1, wherein processing said video packets comprises comparing the predetermined frame locations of two or more of said plurality of frames, and wherein said graphical changes are based on said one or more user highlight parameters.

5. The method of claim 1, further comprising generating a video list based on said processing the video packets, wherein said video list contains highlight locations within said video content and corresponding descriptions.

6. The method of claim 5, further comprising generating a closed-caption list based on said processing the closed-caption packets, wherein said closed-caption list contains highlight locations within said video content and corresponding descriptions.

7. The method of claim 6, further comprising consolidating said video list and said closed-caption list into a highlight list containing highlight locations within said video content and corresponding descriptions.

8. The method of claim 7, further comprising accessing the plurality of potential highlight segments from said video content using said highlight list.

9. The method of claim 8, further comprising displaying said highlight program in an graphical user interface usable to edit said plurality of potential highlight segment.

10. The method of claim 1, further comprising editing said highlight program by altering one or more of said plurality of potential highlight segments

11. The method of claim 1, wherein processing said closed-caption packets comprises processing said closed-caption packets to identify highlight keywords that match at least one of said user highlight parameters and a default set of keywords.

12. The method of claim 1, further comprising segmenting said video content into video packets, closed-caption packets and audio packets.

17. The apparatus of claim 1, wherein said instruction sequences further include instruction sequences to cause the processor to generate a video list based on said processing the video packets, wherein said video list contains highlight locations within said video content and corresponding descriptions.

18. The apparatus of claim 17, wherein said instruction sequences further include instruction sequences to cause the processor to generate a closed-caption list based on said processing the closed-caption packets, wherein said closed-caption list contains highlight locations within said video content and corresponding descriptions.

19. The apparatus of claim 18, wherein said instruction sequences further include instruction sequences to cause the processor to consolidate said video list and said closed-caption list into a highlight list containing highlight locations within said video content and corresponding descriptions.

20. The apparatus of claim 19, wherein said instruction sequences further include instruction sequences to cause the processor to access the plurality of potential highlight segments from said video content using said highlight list.

21. The apparatus of claim 20, wherein said apparatus is coupled to a display device, and wherein said instruction sequences further include instruction sequences to cause the processor to display said highlight program on said display in an graphical user interface usable to edit said plurality of potential highlight segment.

22. The apparatus of claim 1, wherein said instruction sequences further include instruction sequences to cause the processor to process one or more edit commands to edit said highlight program by altering one or more of said plurality of potential highlight segments.

23. The apparatus of claim 1, wherein said instructions sequences to cause the processor to process said closed-caption packets comprises instructions sequences to cause the processor to process said closed-caption packets to identify highlight keywords that match at least one of said user highlight parameters and a default set of keywords.

24. The apparatus of claim 1, wherein said instruction sequences further include instruction sequences to cause the processor to segment said video content into video packets, closed-caption packets and audio packets.

13. An apparatus comprising:

a processor;

a storage device coupled to said processor; and

a memory containing instruction sequences to cause the processor to,

receive one or more user highlight parameters,

segment media content stored on said storage device into video packets and closed-caption packets, wherein said video packets are comprised of a plurality of frames,

process said video packets to identify graphical changes within a predetermined frame location between two or more of said plurality of frames, wherein said graphical changes are indicative of a potential highlight segment,

process said closed-caption packets to identify highlight keywords that match at least one of said user highlight parameters, and

compile a plurality of potential highlight segments into a highlight program based on at least one of said identified graphical changes and said identified highlight keywords.

14. The apparatus of claim 13, wherein said video content is formatted as one of MPEG2 and Advanced Video Coding.

15. The apparatus of claim 13, wherein said one or more user highlight parameters include one or more user-defined keywords.

16. The apparatus of claim 13, wherein said instructions sequences to cause the processor to process said video packets comprises instructions sequences to cause the processor to compare the predetermined frame locations of two or more of said plurality of frames, and wherein said graphical changes are based on said one or more user highlight parameters.

25. A computer program product comprising:

a computer usable medium having computer program code embodied therein, the computer program product having;

computer readable program code to receive one or more user highlight parameters;

computer readable program code to segment video content into video packets and closed-caption packets, wherein said video packets are comprised of a plurality of frames;

computer readable program code to process said video packets to identify graphical changes within a predetermined frame location between two or more of said plurality of frames, wherein said graphical changes are indicative of a potential highlight segment;

computer readable program code to process said closed-caption packets to identify highlight keywords that match at least one of said user highlight parameters; and

computer readable program code to compile a plurality of potential highlight segments into a highlight program based on at least one of said identified graphical changes and said identified highlight keywords.

26. The computer program product of claim 25, wherein said video content is formatted as one of MPEG2 and Advanced Video Coding.

27. The computer program product of claim 25, wherein said one or more user highlight parameters include one or more user-defined keywords.

28. The computer program product of claim 25, wherein said computer readable program code to process said video packets comprises computer readable program code to compare the predetermined frame locations of two or more of said plurality of frames, and wherein said graphical changes are based on said one or more user highlight parameters.

29. The computer program product of claim 25, further having computer readable program code to generate a video list based on the computer readable program code to process the video packets, wherein said video list contains highlight locations within said video content and corresponding descriptions.

30. The computer program product of claim 29, further having computer readable program code to generate a closed-caption list based on the computer readable program code to process the closed-caption packets, wherein said closed-caption list contains highlight locations within said video content and corresponding descriptions.

31. The computer program product of claim 30, further having computer readable program code to consolidate said video list and said closed-caption list into a highlight list containing highlight locations within said video content and corresponding descriptions.

32. The computer program product of claim 31, further having computer readable program code to access the plurality of potential highlight segments from said video content using said highlight list.

33. The computer program product of claim 32, further having computer readable program code to display said highlight program in an graphical user interface usable to edit said plurality of potential highlight segment.

34. The computer program product of claim 25, further having computer readable program code to receive edit commands to edit said highlight program by altering one or more of said plurality of potential highlight segments.

35. The computer program product of claim 25, wherein said computer readable program code to process said closed-caption packets comprises computer readable program code to process said closed-caption packets to identify highlight keywords that match at least one of said user highlight parameters and a default set of keywords.

36. The computer program product of claim 25, further having computer readable program code to segment said video content into video packets, closed-caption packets and audio packets.