Automatic editing of a visual recording to eliminate content of unacceptably low quality and/or very little or no interest

• US 7,483,618 B1
• Filed: 12/04/2003
• Issued: 01/27/2009
• Est. Priority Date: 12/04/2003
• Status: Expired due to Fees

• Current Assignee: YesVideo, Inc.
• Original Assignee: YesVideo, Inc.
• Inventors: Edwards, Jeffrey L., Ahmad, Subutai
• Primary Examiner(s): Tran; Thai
• Assistant Examiner(s): Zhao; Daquan
• Application Number:
  US10/729,433
• Time in Patent Office: 1,881 Days
• Field of Search: 386/52, 386/55, 386/4, 360/13, 369/83
• US Class Current: 386/278
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/85 on discs or drums

Abstract

A visual recording can be automatically edited in a manner that creates a summary of the visual recording in which only content that is of unacceptably low quality and/or very little or no interest is eliminated, thereby enabling the original unsummarized visual recording to be discarded if desired. Additionally, a summary of a visual recording can be automatically produced in accordance with a format template that imposes a certain overall style to the visual recording summary. Further, a viewer of a visual recording can be enabled to provide input which can affect the visual recording content included in an automatically generated summary of the visual recording.

Claims

1. A method for editing a visual recording stored on a data storage medium, comprising the steps of:

evaluating data regarding the content of the visual recording and/or data regarding the manner in which the visual recording was obtained;

selecting one or more clips of the visual recording to be included in a summary of the visual recording, based on the evaluation, wherein the selected clips of the visual recording comprise less than all of the visual recording, and wherein the step of selecting and/or the step of evaluating are performed, at least in part, automatically; and

discarding parts of the visual recording not included in the visual recording summary so that the discarded parts of the visual recording are no longer stored on a data storage medium;

modifying the result of the evaluation in accordance with an input provided by a viewer of the visual recording regarding the desirability of a part of the visual recording, wherein the step of selecting is based on the modified result of the evaluation;

the step of modifying is implemented to modify the result of the evaluation in accordance with input provided by each of a plurality of viewers of the visual recording regarding the desirability of a part of the visual recording.

2. A method as in claim 1, further comprising the step of storing the visual recording summary on a data storage medium.

3. A method as in claim 2, wherein the data storage medium is a portable data storage medium.

4. A method as in claim 1, further comprising the step of specifying the duration of the visual recording summary.

5. A method as in claim 4, wherein the specified duration of the visual recording summary is greater than or equal to 75% of the duration of the original unsummarized visual recording.

6. A method as in claim 5, wherein the specified duration of the visual recording summary is greater than or equal to 50% of the duration of the original unsummarized visual recording.

7. A method as in claim 4, wherein the step of specifying the duration of the visual recording summary further comprises the step of choosing a music selection or selections to accompany the visual recording summary, wherein the duration of the visual recording summary is established in accordance with the duration of the music selection or selections.

8. A method as in claim 4, wherein the step of selecting comprises selecting only candidate clips that meet a specified criterion or criteria, such that the actual duration of the visual recording summary may be less than the specified duration of the visual recording summary.

9. A method as in claim 1, wherein the step of selecting comprises selecting all candidate clips that meet a specified criterion or criteria.

10. A method as in claim 1, wherein the step of evaluating comprises the steps of:

identifying a plurality of candidate clips in the visual recording; and

evaluating each of the candidate clips regarding the content of the clip and/or the manner in which the clip was obtained.

11. A method as in claim 10, wherein the evaluation of each candidate clip is based on an image stability criterion.

12. A method as in claim 10, wherein the evaluation of each candidate clip is based on an image saturation criterion.

13. A method as in claim 10, wherein the evaluation of each candidate clip is based on an edge sharpness criterion.

14. A method as in claim 10, wherein the evaluation of each candidate clip is based on an image contrast criterion.

15. A method as in claim 10, wherein the evaluation of each candidate clip is based on a garbage content criterion.

16. A method as in claim 10, wherein the evaluation of each candidate clip is based on a snapshot criterion.

17. A method as in claim 10, wherein the evaluation of each candidate clip is based on a front-loading criterion.

18. A method as in claim 10, wherein the evaluation of each candidate clip is based on an audio content criterion.

19. A method as in claim 10, wherein the evaluation of each candidate clip is based on a camera hints criterion.

20. A method as in claim 10, wherein the step of evaluating each of the candidate clips comprises the step of computing a score for each candidate clip based on the evaluation of the clip.

21. A method as in claim 10, wherein the evaluation of each candidate clip is based on multiple criteria.

22. A method as in claim 21, wherein the step of evaluating each of the candidate clips comprises the steps of:

computing a sub-score for each criterion for each candidate clip based on an evaluation of the clip in accordance with the criterion; and

combining the sub-scores for each candidate clip to produce an overall score for the candidate clip.

23. A method as in claim 1, further comprising the step of specifying the manner of display of the selected clips in accordance with a format template.

24. A method as in claim 1, implemented on a DVD recorder.

25. A method as in claim 1, implemented on a camcorder.

26. A method as in claim 1, implemented on a video camera phone.

27. A method as in claim 1, wherein the step of modifying further comprises:

identifying a score for the input provided by each of the plurality of viewers regarding the desirability of the part of the visual recording; and

combining the scores for the plurality of viewers to produce an aggregate score representing the desirability of the part of the visual recording to the plurality of viewers.

28. A method as in claim 27, wherein the step of combining further comprises averaging the scores for the plurality of viewers.

29. A method as in claim 1, further comprising the step of modifying the result of the evaluation in accordance with an input provided by a viewer of the visual recording, wherein the step of selecting is based on the modified result of the evaluation.

30. A method as in claim 29, wherein the input provided by the viewer of the visual recording concerns a part of the visual recording.

31. A method as in claim 30, wherein the part of the visual recording comprises a visual image of the visual recording.

32. A method as in claim 30, wherein the part of the visual recording comprises a clip of the visual recording.

33. A method as in claim 30, further comprising the steps of:

displaying a plurality of parts of the visual recording; and

monitoring a user input apparatus to identify input from the viewer regarding one of the plurality of parts of the visual recording.

34. A method as in claim 33, wherein the part of the visual recording which the input concerns comprises a part of the visual recording having a specified relationship to the part of the visual recording being viewed at the time that the input is provided.

35. A method as in claim 34, wherein the part of the visual recording which the input concerns comprises the part of the visual recording being viewed at the time that the input is provided.

36. A method as in claim 1, further comprising the step of selecting one or more clips of the visual recording to be included in a second summary of the visual recording comprising less than all of the visual recording.

37. A method as in claim 36, further comprising the step of discarding parts of the visual recording not included in the second visual recording summary so that the discarded parts of the visual recording are no longer stored on a data storage medium.

38. A method as in claim 36, wherein the first and second summaries are of different duration.

39. A method for viewing the first and second summaries of claim 38, wherein the duration of the second summary is shorter than the duration of the first summary, the method further comprising the steps of:

displaying the second summary;

monitoring a user input apparatus during display of the second summary to identify input from a viewer; and

displaying the first summary in accordance with an identified input from the viewer.

40. Apparatus for editing a visual recording stored on a data storage medium, comprising:

means for evaluating data regarding the content of the visual recording and/or data regarding the manner in which the visual recording was obtained;

means for selecting one or more clips of the visual recording to be included in a summary of the visual recording, based on the evaluation, wherein;

the selected clips of the visual recording comprise less than all of the visual recording;

the step of selecting and/or the step of evaluating are performed, at least in part, automatically; and

the parts of the visual recording not included in the visual recording summary are discarded so that the discarded parts of the visual recording are no longer stored on a data storage medium;

modifying the result of the evaluation in accordance with an input provided by a viewer of the visual recording regarding the desirability of a part of the visual recording, wherein the step of selecting is based on the modified result of the evaluation;

the step of modifying is implemented to modify the result of the evaluation in accordance with input provided by each of a plurality of viewers of the visual recording regarding the desirability of a part of the visual recording.

41. Apparatus as in claim 40, further comprising:

user input apparatus; and

means for modifying the result of the evaluation of data regarding the content of the visual recording and/or data regarding the manner in which the visual recording was obtained, in accordance with an input provided by a viewer of the visual recording using the user input apparatus, wherein the selection of one or more clips of the visual recording to be included in a summary of the visual recording is based on the modified result of the evaluation.

42. A camcorder comprising apparatus as in claim 40.

43. A video camera phone comprising apparatus as in claim 40.

44. A computer readable-storage medium or media encoded with one or more computer programs for editing a visual recording stored on a data storage medium, the one or more computer programs comprising:

instructions for evaluating data regarding the content of the visual recording and/or data regarding the manner in which the visual recording was obtained;

instructions for selecting one or more clips of the visual recording to be included in a summary of the visual recording, based on the evaluation, wherein;

the selected clips of the visual recording comprise less than all of the visual recording;

the step of selecting and/or the step of evaluating are performed, at least in part, automatically; and

the parts, of the visual recording not included in the visual recording summary are discarded so that the discarded parts of the visual recording are no longer stored on a data storage medium;

modifying the result of the evaluation in accordance with an input provided by a viewer of the visual recording regarding the desirability of a part of the visual recording, wherein the step of selecting is based on the modified result of the evaluation;

the step of modifying is implemented to modify the result of the evaluation in accordance with input provided by each of a plurality of viewers of the visual recording regarding the desirability of a part of the visual recording.