Automatic capturing and editing of a video

• US 7,739,599 B2
• Filed: 09/23/2005
• Issued: 06/15/2010
• Est. Priority Date: 09/23/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mercer, Ian, Burch, Warren L., Patten, Michael J., Ahlstrom, Bret D., Randall, Russell Scott
• Primary Examiner(s): Chow; Dennis-Doon
• Assistant Examiner(s): TILLERY, RASHAWN N
• Application Number:
  US11/234,489
• Publication Number:
  US 20070074115A1
• Time in Patent Office: 1,726 Days
• Field of Search: 715/726, 715/723, 715/716, 715/719, 715/730, 715/781
• US Class Current: 715/723
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Automatic editing of video clips detected during the capture of a video data stream. A media editing application identifies video clips as a function of determined property values of each of a series of video frames included in the video. An edit component automatically edits video clips during the capture of the video data stream. A user interface allows the user to view individual video clips during the video capturing process and to define desired transition effects to apply between successive video clips and/or a desired special effect to apply to selected video clips.

Claims

1. One or more computer-readable storage media having computer executable components executed by a computing device for editing a video data stream, said video data stream having a sequenced plurality of video frames and being transferred from a video source, said computer-readable storage media comprising:

an analysis component for determining a property value of each of the video frames in the video data stream and determining differences of the property values between successive video frames in the video data stream, wherein the property value of each said video frame is determined by at least one of a time stamp, a face recognition algorithm analysis, a GPS data, and an audio analysis of each said video frame;

a segmentation component for segmenting the video data stream into sequenced video clips as a function of determined differences of the property values between successive video frames, said segmentation component segmenting the video data stream while the video data stream is being transferred from the video source, wherein the analysis component determines a property rating for each of the sequenced video clips in the video data stream, wherein the property rating comprises at least three different values, and wherein the analysis component assigns one of the property rating values to each video clip based on each of the determined property values of each of the video frames included in each video clip;

an edit component for applying a default special effect to at least one video clip of the sequenced video clips as a function of the determined property values of the video frames included in the at least one video clip and based on transition selection rules stored in a memory, wherein said special effect is applied to the video clip while the video data stream is being transferred from the video source; and

a user interface (UI) component for displaying each of the sequenced video clips while the video data stream is being transferred from the video source, wherein the UI component includes a clip queue window comprising a first miniaturized window for displaying a current video clip being transferred to the computer from the video source, and at least two second miniaturized windows each representative of a video clip previously transferred, wherein each of the second miniaturized windows displays a thumbnail representative of a previously transferred video clip, and wherein said UI component comprises a transition control located between each of the at least two second miniaturized windows for allowing a user to select a desired transition effect from a plurality of transition effects to apply between a selected set of successive video clips, whereby the transition effect is applied between two successive video clips whereas the special effect is applied to the at least one of the video clips, wherein the selected set of successive video clips are the video clips represented by the second miniaturized windows between which the transition control is located, wherein the UI component displays each of the sequenced video clips with the transition effect applied between successive video clips while the video data stream is being transferred from the video source and wherein the UI component includes a video clip property rating field for displaying the value of the property rating assigned by the segmentation component of the video clip being displayed.

2. The computer-readable storage media of claim 1, wherein the UI component displays each of the video frames included in the sequenced video clips substantially simultaneously with the transfer of each of the plurality video frames included in the video data stream from the video source and wherein the UI component includes a property rating control for allowing a user to define a value to the property rating for a selected video clip to override the value of the property rating assigned by the analysis component, and wherein the video clip property rating field displays the user defined value of the property rating for the video clip being displayed.

3. The computer-readable storage media of claim 1, wherein the UI component displays each of the sequenced video clips in a first window, and wherein the UI component is responsive to a user selecting one of the second miniaturized windows to play the video clip corresponding to the selected second miniaturized window in a second window.

4. The computer-readable storage media of claim 1, wherein applying a transition effect between successive video clips includes applying one or more of the following a dissolve effect, a side wipe effect, a checkerboard effect, a fade effect, a circle effect, a wipe effect, and a line effect.

5. The computer-readable storage media of claim 1 wherein the edit component is responsive to the desired transition effect selected by the user to replace the default transition effect applied between the selected set of successive video clips with the desired transition effect.

6. The computer-readable storage media of claim 1, wherein the edit component further applies a default special effect to each video clip in the sequenced video clips as a function of the determined the property values of the video frames included in each video clip and based on the transition selection rules stored in the memory, and wherein said special effect is applied to each video clip while the video data stream is being transferred from the video source, and wherein the UI component displays the special effect applied to each video clip while the video data stream is being transferred from the video source, wherein the UI component includes a special effect control for allowing a user to select a desired special effect to apply to a selected video clip, and wherein the edit component is responsive to the desired special effect selected by the user to replace the default special effect applied to the selected video clip with the desired special effect and wherein applying a special effect to the selected video clip includes applying one or more of the following a threshold effect, a fade out effect, a speed up effect, a grayscale effect, a film effect, a rotate effect, a water color effect, and a sepia tone effect.

13. The computer readable storage media of claim 1 wherein the property value of each said video frame as determined by said analysis component is determined by the time stamp, the face recognition algorithm analysis, the GPS data, and the audio analysis of each said video frame.

14. The computer readable storage media of claim 1 wherein the property value of each said video frame as determined by said analysis component is determined by the time stamp of each said video frame.

15. The computer readable storage media of claim 1 wherein the property value of each said video frame as determined by said analysis component is determined by the face recognition algorithm analysis applied to each said video frame.

16. The computer readable storage media of claim 1 wherein the property value of each said video frame as determined by said analysis component is determined by the GPS data of each said video frame.

17. The computer readable storage media of claim 1 wherein the property value of each said video frame as determined by said analysis component is determined by the audio analysis of each said video frame.

7. A computerized method for editing a video data stream being captured from a video source, said video data stream including a sequenced plurality of video frames, said computerized method comprising:

determining a property value of each of the video frames in the video data stream and determining differences of the property values between successive video frames in the video data stream, wherein the property value of each said video frame is determined by at least one of a time stamp, a face recognition algorithm analysis, a GPS data, and an audio analysis of each said video frame;

segmenting the video data stream into sequenced video clips as a function of determined differences of the property values between successive video frames, said segmenting further comprising segmenting the video data stream while the video data stream is being transferred from the video source, wherein the determining determines a property rating for each of the sequenced video clips in the video data stream, wherein the property rating comprises at least three different values, and further comprising assigning one of the property rating values to each video clip based on each of the determined property values of each of the video frames included in each video clip;

applying a default special effect to at least one video clip of the sequenced video clips as a function of the determined property values of the video frames included in the at least one video clip and based on transition selection rules stored in a memory, wherein said special effect is applied to the video clip while the video data stream is being transferred from the video source; and

displaying a user interface (UI) for displaying each of the sequenced video clips while the video data stream is being transferred from the video source, wherein the UI includes a clip queue window comprising a first miniaturized window for displaying a current video clip being transferred to the computer from the video source, and at least two second miniaturized windows each representative of a video clip previously transferred, wherein each of the second miniaturized windows displays a thumbnail representative of a previously transferred video clip, and wherein said UI comprises a transition control located between each of the at least two second miniaturized windows for allowing a user to select a desired transition effect from a plurality of transition effects to apply between a selected set of successive video clips, whereby the transition effect is applied between two successive video clips whereas the special effect is applied to the at least one of the video clips, wherein the selected set of successive video clips are the video clips represented by the second miniaturized windows between which the transition control is located, wherein the UI displays each of the sequenced video clips with the transition effect applied between successive video clips while the video data stream is being transferred from the video source and wherein the UI includes a video clip property rating field for displaying the value of the property rating of the video clip being displayed.

8. The computerized method of claim 7, wherein determining a property value includes determining a content property value for each of the video frames by analyzing image content of each video frame in the video data stream using a color histogram, and wherein the segmenting includes comparing the distance or difference between the color histograms of adjacent video frames to a threshold value and defining a segment boundary between adjacent video frames having a difference greater than the threshold value, wherein said segment boundary segments one video clip from a next video clip.

9. The computerized method of claim 7, wherein determining a property value includes determining a time property value for each of the video frames in the video data stream being captured by analyzing time stamp data included in each video frame, and wherein the segmenting includes comparing the difference between time data included in successive video frames to a threshold value and defining a segment boundary between successive video frames having a difference greater than the threshold, wherein said segment boundary segments one video clip from a next video clip.

10. The computerized method of claim 7 further comprising:

applying a special effect to each video clip in the sequenced video clips as a function of the determined the property values of the video frames included in each video clip and based on transition selection rules stored in a memory, and wherein said special effect is applied to each video clip while the video data stream is being captured from the video source; and

selectively applying a special effect to a selected video clip in response to user input.

11. The computerized method of claim 7 further including:

displaying a current video clip being captured from the video source in a miniaturized capture window; and

displaying a previously captured video clip in a preview window in responsive to a user selecting one of the one or more thumbnails.

12. The computerized method of claim 7 further comprising storing a video file on a computer readable medium including at least two of the series of video clips with user selected transitions effects applied between the at least two of the series of video clips.