Summarization of a visual recording

• US 20040052505A1
• Filed: 05/28/2003
• Published: 03/18/2004
• Est. Priority Date: 05/28/2002
• Status: Abandoned Application

• Current Assignee: YesVideo, Inc.
• Original Assignee: YesVideo, Inc.
• Inventors: Ahmad, Subutai, Cohen, Jonathan R., Sampson, Harold G.
• Application Number:
  US10/448,255
• Publication Number:
  US 20040052505A1
• Time in Patent Office: Days
• US Class Current: 386/69
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

The invention facilitates and/or enhances the creation and/or viewing of a summary of a visual recording. The invention can be implemented so that part or all of the creation of a visual recording summary is performed automatically, thus increasing the ease and speed with which a visual recording summary can be created. The invention can also be implemented so that clips (segments of the visual recording) of high quality and/or particular interest are selected for inclusion in a visual recording summary. Additionally, the invention can be implemented to enable synchronization of non-source audio content, such as music, to the display of clips of the visual recording summary.

Claims

1. A method for creating a summary of a visual recording, comprising the steps of:

evaluating the visual recording data of the visual recording; and

selecting one or more segments of the visual recording to be included in the summary of the visual recording, based on the evaluation of the visual recording data, wherein the selected segments of the visual recording comprise less than all of the visual recording.

2. A method as in claim 1, wherein the step of evaluating comprises the step of evaluating the quality of each of a plurality of visual images of the visual recording.

3. A method as in claim 2, wherein the step of evaluating comprises the step of evaluating the content of each of a plurality of visual images of the visual recording.

4. A method as in claim 3, wherein the step of evaluating comprises the step of evaluating the position in the visual recording of each of a plurality of visual images of the visual recording.

5. A method as in claim 2, wherein the step of evaluating comprises the step of evaluating the position in the visual recording of each of a plurality of visual images of the visual recording.

6. A method as in claim 1, wherein the step of evaluating comprises the step of evaluating the content of each of a plurality of visual images of the visual recording.

7. A method as in claim 1, wherein the step of evaluating comprises the step of evaluating the position in the visual recording of each of a plurality of visual images of the visual recording.

8. A method as in claim 1, wherein:

the step of evaluating comprises the step of identifying scenes in the visual recording; and

the step of selecting comprises the step of selecting one or more scenes to be included in the summary of the visual recording.

9. A method as in claim 8, wherein:

the step of evaluating comprises identifying the location of scenes in the visual recording; and

the step of selecting comprises selecting scenes based on the location of scenes in the visual recording.

10. A method as in claim 8, wherein:

the step of evaluating comprises the steps of;

identifying keyframes for the identified scenes; and

evaluating the keyframes; and

the step of selecting comprises selecting scenes based on the evaluation of the keyframes.

11. A method as in claim 10, wherein the step of identifying keyframes comprises the step of evaluating the location of one or more visual images in each of the scenes.

12. A method as in claim 10, wherein the step of identifying keyframes comprises the step of evaluating the content of one or more visual images in each of the scenes.

13. A method as in claim 10, wherein the step of evaluating the keyframes further comprises the step of evaluating the quality, content and/or position in the visual recording of each keyframe.

14. A method as in claim 8, wherein the step of electing comprises the step of determining whether each scene meets a specified criterion or criteria.

15. A method as in claim 8, wherein the step of selecting comprises the steps of:

determining a score for each scene; and

evaluating the scene scores.

16. A method as in claim 1, wherein:

the step of evaluating comprises the step of identifying candidate visual images in the visual recording; and

the step of selecting comprises the steps of;

selecting one or more of the candidate visual images from the visual recording; and

identifying one or more segments of the visual recording that have a specified relationship to one or more of the selected visual images.

17. A method as in claim 1, wherein the step of evaluating and/or the step of selecting are performed, at least in part, automatically.

18. A method as in claim 1, further comprising the step of evaluating audio content to be included in the summary, wherein the step of selecting comprises the step of selecting the one or more segments of the visual recording based on the evaluation of the visual recording data and the evaluation of the audio content.

19. A method for selecting a segment of a visual recording, comprising the steps of:

evaluating the quality, content and/or position in the visual recording of each of a plurality of visual images of the visual recording;

selecting one or more visual images from the visual recording based on the evaluations of the plurality of visual images; and

identifying a segment of the visual recording that has a specified relationship to the one or more selected visual images.

20. A method as in claim 19, further comprising the steps of:

selecting a plurality of groups of one or more visual images from the visual recording based on the evaluations of the plurality of visual images; and

for each of the selected plurality of groups of one or more visual images, identifying a segment of the visual recording that has a specified relationship to the one or more selected visual images.

21. A method as in claim 19, wherein the step of evaluating, the step of selecting and/or the step of identifying are performed, at least in part, automatically.

22. A method for creating a summary of a visual recording, comprising the steps of:

selecting one or more segments of the visual recording, wherein the selected segment or segments of the visual recording comprise less than all of the visual recording; and

associating audio content with the selected segment or segments of the visual recording, wherein the audio content is not part of the visual recording,

wherein the step of selecting and/or the step of associating are performed, at least in part, automatically.

23. A method for facilitating viewing of a visual recording, comprising the steps of:

selecting one or more segments of the visual recording for viewing as a first summary of the visual recording; and

selecting one or more segments of the visual recording for viewing as a second summary of the visual recording, wherein a majority of the segments in the first summary of the visual recording are not in the second summary of the visual recording.

24. A method as in claim 23, wherein none of the segments in the first summary of the visual recording is the same as a segment in the second summary of the visual recording.

25. A method as in claim 23, wherein the step of selecting one or more segments of the visual recording for viewing as a first summary of the visual recording and/or the step of selecting one or more segments of the visual recording for viewing as a second summary of the visual recording are performed, at least in part, automatically.

26. A method for creating a visual recording summary, comprising the steps of:

selecting one or more segments of a first visual recording to be included in the visual recording summary; and

selecting one or more segments of a second visual recording to be included in the visual recording summary.

27. A method as in claim 26, wherein the first and second visual recordings are of the same event or object and are acquired at the same or approximately the same time, but are acquired using different visual recording apparatus and/or from different perspectives.

28. A method as in claim 26, wherein the step of selecting one or more segments of a first visual recording and/or the step of selecting one or more segments of a second visual recording are performed, at least in part, automatically.

29. A method for facilitating viewing of a visual recording, comprising the steps of:

selecting one or more segments of the visual recording to be included in the visual recording summary; and

including one or more still visual images in the visual recording summary.

30. A method as in claim 29, wherein the step of selecting and/or the step of including are performed, at least in part, automatically.

31. A portable computer readable medium or media for storing instructions and/or data, comprising:

instructions and/or data representing a visual recording; and

instructions and/or data representing a summary of the visual recording.

32. A portable computer readable medium or media as in claim 31, wherein the portable data storage medium or media comprises one or more DVDs.

33. A portable computer readable medium or media as in claim 31, wherein the portable data storage medium or media comprises one or more optical disks.

34. A portable computer readable medium or media as in claim 31, further comprising instructions and/or data representing audio content that is not part of the visual recording.