METHOD OF CREATING A SUMMARY

• US 20100111498A1
• Filed: 09/26/2007
• Published: 05/06/2010
• Est. Priority Date: 09/27/2006
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Weda, Johannes, Shrestha, Prarthana, Barbieri, Mauro, Campanella, Marco Emanuele
• Application Number:
  US12/442,717
• Publication Number:
  US 20100111498A1
• Time in Patent Office: Days
• US Class Current: 386/241
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

Method of creating a summary (110) of a content item (100) that comprises a plurality of segments (101-1 . . . 101-7), each having a respective segment importance score. The method comprises deriving a cut point importance score for each one of N a plurality of potential cut points (102-1 . . . 102-8), each potential cut point being a boundary between two respective segments, the cut point importance score of a particular potential cut point being based on content characteristics of the two segments aligned to said potential cut point; and creating a summary (110) comprising a subset of the plurality of segments of the content item selected based on a combination of the segment importance scores and the cut point importance scores.

Claims

1. Method of creating a summary (110) of a content item (100) that comprises a plurality of segments (101-1 . . . 101-7) each having a respective segment importance score, characterized by:

deriving a cut point importance score for each one of a plurality of potential cut points (102-1 . . . 102-8), each potential cut point being a boundary between two respective segments, the cut point importance score of a particular potential cut point being based on content characteristics of the two segments aligned to said potential cut point; and

creating a summary (110) comprising a subset of the plurality of segments of the content item selected based on a combination of the segment importance scores and the cut point importance scores.

2. The method as claimed in claim 1, wherein the cut point importance score of the potential cut point is an absolute difference of weighted norms of the content characteristics (201-i, 201-j) corresponding to the two segments (101-i, 101-j) aligned to said potential cut point (102-ij).

3. The method as claimed in claim 1, wherein the potential cut point (102-ij) is determined at a significant change in at least one component of the content characteristics of the neighbouring segments.

4. The method as claimed in claim 1, wherein a suitability of the subset of segments to be comprised in the summary (110) is measured by means of a suitability score, said suitability score being a weighted sum of:

the segment importance scores of segments belonging to the subset of segments, and

the significant cut point importance scores of the potential cut points delimiting groups of consecutive segments with insignificant cut point importance scores for the potential cut points between the segments pertaining to the group.

5. The method as claimed in claim 4, wherein the subset of segments selected to be comprised in the summary (110) has the highest suitability score.

6. The method as claimed in claim 1, wherein the potential cut point (e.g. 102-2) is determined at a camera shot boundary (e.g. 105-2), said camera shot being a continuous video content recorded between succesive start and stop of a recording.

7. The method as claimed in claim 1, wherein a size of the segment is not smaller than a predetermined minimum segment size, and not larger than a predetermined maximum segment size.

8. The method as claimed in claim 7, wherein the potential cut point is chosen such that it has the highest cut point importance score among the admissible potential cut points, said admissible potential cut points providing the segment size not smaller than the predetermined minimum segment size and not larger than the predetermined maximum segment size.

9. The method as claimed in claim 7, wherein the minimum segment size and maximum segment size are explicitly provided by a user.

10. The method as claimed in claim 1, wherein a size of the summary is provided by the user.

11. The method as claimed in claim 10, wherein the subset of segments selected to the summary (110) providing the predetermined size has the highest suitability score.

12. A device operable to provide a means (802-d) to derive a cut point importance score for each one of a plurality of potential cut points (102-1 . . . 102-8), each potential cut point being a boundary between two respective segments, the cut point importance score of a particular cut point being based on content characteristics of the two segments aligned to said potential cut point, and a means (802-e) to create a summary comprising a subset of the plurality of segments (101-1 . . . 101-7) of the content item (100) selected based on a combination of the segment importance scores and the cut point importance scores, said device being operable according to the method claimed in claim 1.

13. A device as claimed in claim 12, further comprising a means (802-b) to segment the content item (100) such that the potential cut point (102-ij) is determined at a significant change in at least one of components of the content characteristics of the neighbouring segments.

14. A device as claimed in claim 12, further comprising a means (802-b) to segment the content item (100) such that the potential cut point (102-ij) is determined at a camera shot boundary, said camera shot being a continuous video content recorded between succesive start and stop of recording.

15. A device as claimed in claim 13, wherein the means (802-b) to segment the content item (100) is configured such that the size of segments is not smaller than a predetermined minimum segment size, and not larger than a predetermined maximum segment size.

16. A device as claimed in claim 12, further comprising a user interface means to enable the user to provide at least one of:

the minimum segment size, the maximum segment size, or the size of the summary.

17. Software executable on device hardware for implementing a method as claimed in claim 1.