CHANGING VIDEO PLAYBACK RATE

• US 20080253735A1
• Filed: 04/16/2007
• Published: 10/16/2008
• Est. Priority Date: 04/16/2007
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Young, Paul E., Warner, Steven, Davey, Matthew, KUSPA, DAVID
• Granted Patent: US 8,170,396 B2
• Time in Patent Office: Days
• US Class Current: 386/52
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/326 used signal is a video-frame or a video-field (P.I.P.)
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

The present disclosure includes systems and techniques relating to changing video playback rate. In general, one aspect of the subject matter described in this specification can be embodied in a method that includes providing a user interface for a digital video editing system, the user interface including a graphical representation of playback rate and playback duration for a sequence of digital video, and the user interface including defined points that reference respective frames in the sequence of digital video; receiving input specifying a change in playback rate for the sequence of digital video; and showing the change in playback rate and a corresponding change in playback duration for the sequence of digital video, the showing including moving one of the defined points in accordance with a new temporal position of a corresponding frame referenced by the one of the defined points.

Claims

1. A computer-implemented method comprising:

providing a user interface for a digital video editing system, the user interface comprising a graphical representation of playback rate and playback duration for a sequence of digital video, and the user interface including defined points that reference respective frames in the sequence of digital video;

receiving input specifying a change in playback rate for the sequence of digital video; and

showing the change in playback rate and a corresponding change in playback duration for the sequence of digital video, the showing comprising moving one of the defined points in accordance with a new temporal position of a corresponding frame referenced by the one of the defined points.

2. The method of claim 1, wherein providing the user interface comprises providing a timeline interface including the graphical representation overlaid on a track item in a track of the timeline interface, the track item corresponding to the sequence of digital video, the graphical representation comprises a plot of playback rate in a graph having a horizontal axis representing playback duration and a vertical axis representing playback rate, and receiving the input specifying the change in playback rate comprises receiving the input as defined by a drag operation performed on a segment of the plot.

3. The method of claim 2, wherein moving the one of the defined points comprises moving an end point of the track item in the timeline interface and trimming the track item in the timeline interface when the end point moves beyond a begin point of a next track item in the track.

4. The method of claim 1, comprising receiving input defining a first keyframe point that references a specified frame in the sequence of digital video, the defined points including the first keyframe point, and wherein the moving comprises moving the one of the defined points and the first keyframe point.

5. The method of claim 4, comprising:

receiving input defining a second keyframe point that references another frame in the sequence of digital video, the defined points including the second keyframe point and delineating at least three distinct segments of the sequence of digital video, each of the at least three distinct segments having a corresponding subset of frames from the sequence of digital video;

receiving the input specifying the change in playback rate comprises receiving an adjustment in playback rate to one of the at least three distinct segments;

maintaining the correspondence of segments to frames for all of the at least three distinct segments while making the adjustment in playback rate for the one of the at least three distinct segments; and

showing the change in playback rate and the corresponding change in playback duration comprises updating a total duration of the sequence of digital video in accordance with the adjustment in playback rate.

6. The method of claim 4, wherein receiving the input specifying the change in playback rate comprises receiving input specifying a duration of still frame playback with respect to the first keyframe point.

7. The method of claim 4, wherein receiving the input specifying the change in playback rate comprises receiving input specifying a duration of reverse playback with respect to the first keyframe point.

8. The method of claim 4, wherein the first keyframe point comprises a split-able keyframe point, the user interface comprising a variable rate speed control configured to define for the split-able keyframe point associated keyframe elements comprising a begin element, an end element and an intermediate time element, and the method comprises:

receiving, through the variable rate speed control, input defining at least one of the keyframe elements in relation to a sequence of digital video; and

generating a time transition function for remapping playback time of the sequence of digital video based on the input, wherein the time transition function maintains predefined speed for video frames leading into the begin element, maintains predefined speed for video frames leading away from the end element, and changes video speed from a begin speed value associated with the begin element to an end speed value associated with the end element in accordance with one or more values associated with the intermediate time element.

9. The method of claim 8, wherein generating the time transition function comprises determining a combination of two curves between a first location of the begin element and a second location of the end element, the two curves being rotationally symmetrical around a central point between the first and second locations.

10. The method of claim 1, wherein the showing comprises providing marks along the graphical representation for the sequence of digital video, the marks including different shapes to represent at least two different playback rates.

11. The method of claim 10, wherein the showing comprises using the different shapes, indexed to locations in the graphical representation, to represent varying degrees of playback rate, and the different shapes comprise less-than and greater-than signs.

12. A computer program product, encoded on a computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

providing a user interface for a digital video editing system, the user interface comprising a graphical representation of playback rate and playback duration for a sequence of digital video, and the user interface including defined points that reference respective frames in the sequence of digital video;

receiving input specifying a change in playback rate for the sequence of digital video; and

showing the change in playback rate and a corresponding change in playback duration for the sequence of digital video, the showing comprising moving one of the defined points in accordance with a new temporal position of a corresponding frame referenced by the one of the defined points.

13. The computer program product of claim 12, wherein providing the user interface comprises providing a timeline interface including the graphical representation overlaid on a track item in a track of the timeline interface, the track item corresponding to the sequence of digital video, the graphical representation comprises a plot of playback rate in a graph having a horizontal axis representing playback duration and a vertical axis representing playback rate, and receiving the input specifying the change in playback rate comprises receiving the input as defined by a drag operation performed on a segment of the plot.

14. The computer program product of claim 13 wherein moving the one of the defined points comprises moving an end point of the track item in the timeline interface and trimming the track item in the timeline interface when the end point moves beyond a begin point of a next track item in the track.

15. The computer program product of claim 12, the operations comprising receiving input defining a first keyframe point that references a specified frame in the sequence of digital video, the defined points including the first keyframe point, and wherein the moving comprises moving the one of the defined points and the first keyframe point.

16. The computer program product of claim 15, the operations comprising:

receiving input defining a second keyframe point that references another frame in the sequence of digital video, the defined points including the second keyframe point and delineating at least three distinct segments of the sequence of digital video, each of the at least three distinct segments having a corresponding subset of frames from the sequence of digital video;

receiving the input specifying the change in playback rate comprises receiving an adjustment in playback rate to one of the at least three distinct segments;

maintaining the correspondence of segments to frames for all of the at least three distinct segments while making the adjustment in playback rate for the one of the at least three distinct segments; and

showing the change in playback rate and the corresponding change in playback duration comprises updating a total duration of the sequence of digital video in accordance with the adjustment in playback rate.

17. The computer program product of claim 15, wherein receiving the input specifying the change in playback rate comprises receiving input specifying a duration of still frame playback with respect to the first keyframe point.

18. The computer program product of claim 15, wherein receiving the input specifying the change in playback rate comprises receiving input specifying a duration of reverse playback with respect to the first keyframe point.

19. The computer program product of claim 15, wherein the first keyframe point comprises a split-able keyframe point, the user interface comprising a variable rate speed control configured to define for the split-able keyframe point associated keyframe elements comprising a begin element, an end element and an intermediate time element, and the operations comprise:

receiving, through the variable rate speed control, input defining at least one of the keyframe elements in relation to a sequence of digital video; and

generating a time transition function for remapping playback time of the sequence of digital video based on the input, wherein the time transition function maintains predefined speed for video frames leading into the begin element, maintains predefined speed for video frames leading away from the end element, and changes video speed from a begin speed value associated with the begin element to an end speed value associated with the end element in accordance with one or more values associated with the intermediate time element.

20. The computer program product of claim 19, wherein generating the time transition function comprises determining a combination of two curves between a first location of the begin element and a second location of the end element, the two curves being rotationally symmetrical around a central point between the first and second locations.

21. The computer program product of claim 12, wherein the showing comprises providing marks along the graphical representation for the sequence of digital video, the marks including different shapes to represent at least two different playback rates

22. The computer program product of claim 21, wherein the showing comprises using the different shapes, indexed to locations in the graphical representation, to represent varying degrees of playback rate, and the different shapes comprise less-than and greater-than signs.

23. A system comprising:

a user interface device; and

one or more computers operable to interact with the user interface device and to perform operations comprising;

providing a user interface for a digital video editing system, the user interface comprising a graphical representation of playback rate and playback duration for a sequence of digital video, and the user interface including defined points that reference respective frames in the sequence of digital video;

receiving input specifying a change in playback rate for the sequence of digital video; and

showing the change in playback rate and a corresponding change in playback duration for the sequence of digital video, the showing comprising moving one of the defined points in accordance with a new temporal position of a corresponding frame referenced by the one of the defined points.

24. The system of claim 23, wherein providing the user interface comprises providing a timeline interface including the graphical representation overlaid on a track item in a track of the timeline interface, the track item corresponding to the sequence of digital video, the graphical representation comprises a plot of playback rate in a graph having a horizontal axis representing playback duration and a vertical axis representing playback rate, and receiving the input specifying the change in playback rate comprises receiving the input as defined by a drag operation performed on a segment of the plot.

25. The system of claim 24 wherein moving the one of the defined points comprises moving an end point of the track item in the timeline interface and trimming the track item in the timeline interface when the end point moves beyond a begin point of a next track item in the track.

26. The system of claim 23, the operations comprising receiving input defining a first keyframe point that references a specified frame in the sequence of digital video, the defined points including the first keyframe point, and wherein the moving comprises moving the one of the defined points and the first keyframe point.

27. The system of claim 26, the operations comprising:

receiving input defining a second keyframe point that references another frame in the sequence of digital video, the defined points including the second keyframe point and delineating at least three distinct segments of the sequence of digital video, each of the at least three distinct segments having a corresponding subset of frames from the sequence of digital video;

receiving the input specifying the change in playback rate comprises receiving an adjustment in playback rate to one of the at least three distinct segments;

maintaining the correspondence of segments to frames for all of the at least three distinct segments while making the adjustment in playback rate for the one of the at least three distinct segments; and

showing the change in playback rate and the corresponding change in playback duration comprises updating a total duration of the sequence of digital video in accordance with the adjustment in playback rate.

28. The system of claim 26, wherein receiving the input specifying the change in playback rate comprises receiving input specifying a duration of still frame playback with respect to the first keyframe point.

29. The system of claim 26, wherein receiving the input specifying the change in playback rate comprises receiving input specifying a duration of reverse playback with respect to the first keyframe point.

30. The system of claim 26, wherein the first keyframe point comprises a split-able keyframe point, the user interface comprising a variable rate speed control configured to define for the split-able keyframe point associated keyframe elements comprising a begin element, an end element and an intermediate time element, and the operations comprise:

receiving, through the variable rate speed control, input defining at least one of the keyframe elements in relation to a sequence of digital video; and

generating a time transition function for remapping playback time of the sequence of digital video based on the input, wherein the time transition function maintains predefined speed for video frames leading into the begin element, maintains predefined speed for video frames leading away from the end element, and changes video speed from a begin speed value associated with the begin element to an end speed value associated with the end element in accordance with one or more values associated with the intermediate time element.

31. The system of claim 30, wherein generating the time transition function comprises determining a combination of two curves between a first location of the begin element and a second location of the end element, the two curves being rotationally symmetrical around a central point between the first and second locations.

32. The system of claim 23, wherein the showing comprises providing marks along the graphical representation for the sequence of digital video, the marks including different shapes to represent at least two different playback rates

33. The system of claim 32, wherein the showing comprises using the different shapes, indexed to locations in the graphical representation, to represent varying degrees of playback rate, and the different shapes comprise less-than and greater-than signs.

34. The system of claim 23, wherein the one or more computers comprise a server operable to interact with the user interface device through a data communication network, and the user interface device is operable to interact with the server as a client.

35. The system of claim 34, wherein the user interface device comprises a personal computer running a web browser.

36. The system of claim 23, wherein the one or more computers comprises one personal computer, and the personal computer comprises the user interface device.