Dynamic real-time playback

• US 8,645,834 B2
• Filed: 01/05/2010
• Issued: 02/04/2014
• Est. Priority Date: 04/15/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Agarwal, Sachin, Agnoli, Giovanni, Meaney, Brian Everett
• Primary Examiner(s): SALOMON, PHENUEL S
• Application Number:
  US12/652,692
• Publication Number:
  US 20100178024A1
• Time in Patent Office: 1,491 Days
• Field of Search: 715/716, 715/723, 386/113, 386/114, 386/52
• US Class Current: 715/723
• CPC Class Codes: G11B 27/02 Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Systems and methods for previewing edited video. In general, in one implementation, a method includes generating a video sequence from a plurality of video segments, identifying an inability to output at least one video segment in the video sequence in substantially real time; and adjusting an output level associated with the at least one video segment to enable the at least one video segment to be output in substantially real time. The output level may include a video quality or a frame rate.

Claims

1. A non-transitory computer-readable medium encoded with a computer program comprising instructions that, when executed by a data processing apparatus, cause the data processing apparatus to perform operations comprising:

editing a video segment of a plurality of video segments included in two or more tracks;

generating a preview video sequence from the two or more tracks, wherein video segments included in the two or more tracks are sequentially arranged according to the preview video sequence;

estimating, for each of the plurality of video segments, a cost associated with outputting the video segment in real time, the cost being in terms of system resources;

identifying, in conjunction with the generating a preview video sequence, at least one video segment in the preview video sequence that cannot be output in substantially real time based at least in part on the estimated cost, wherein output in substantially real time refers to output having consistency with respect to an associated output level; and

dynamically adjusting at least one of video quality or video frame rate of each individual identified video segment to enable the identified video segment to be output in substantially real time.

2. The non-transitory computer-readable medium of claim 1, further including instructions that, when executed by a data processing apparatus, cause the data processing apparatus to perform operations comprising:

selecting a frame rate;

identifying an inability to output a particular video segment of the preview video sequence in substantially real time at the selected frame rate; and

adjusting a frame rate associated with the particular video segment, the adjustment being to a highest available frame rate that enables the particular video segment to be output in substantially real time.

3. The non-transitory computer-readable medium of claim 1, further including instructions that, when executed by a data processing apparatus, cause the data processing apparatus to perform operations comprising:

preserving an output level associated with a video segment in the preview video sequence that is able to be output in substantially real time.

4. The non-transitory computer-readable medium of claim 1, wherein the estimated cost is used to identify a video segment in the preview video sequence that cannot be output in substantially real time.

5. The non-transitory computer-readable medium of claim 1, wherein output in substantially real time complies with a predetermined level of accuracy of strict real time.

6. The non-transitory computer-readable medium of claim 1, wherein the at least one of video quality or video frame rate includes at least one level selected from a predetermined group.

7. The non-transitory computer-readable medium of claim 1, wherein the two or more tracks are at least one of reels or effect timelines.

8. The non-transitory computer-readable medium of claim 1, further comprising:

dynamically allocating a capacity for one or more buffers associated with outputting the preview video sequence, where the capacity for the one or more buffers is allocated at least in accordance with a frame resolution of a video segment in the preview video sequence.

9. The non-transitory computer-readable medium of claim 8, wherein the one or more buffers are comprised of at least one of a decode buffer, an effects buffer, and a composite buffer.

10. A computer-implemented method, the method comprising:

editing a video segment of a plurality of video segments included in two or more tracks;

generating a preview video sequence from the two or more tracks, wherein video segments included in the two or more tracks are sequentially arranged according to the preview video sequence;

determining, for each of the plurality of video segments in the preview video sequence, a cost associated with outputting the video segment in real time, the cost being in terms of system resources;

identifying, in conjunction with the generating the preview video segment, at least one video segment in the preview video sequence that cannot be output in substantially real time based at least in part on the determined cost, wherein output in substantially real time refers to output having consistency with respect to an associated output level; and

dynamically adjusting at least one of video quality or video frame rate of each individual identified video segment to enable the identified video segment to be output in substantially real time.

11. The computer-implemented method of claim 10, further comprising:

preserving an output level associated with video segments in the preview video sequence that are able to be output in substantially real time.

12. The computer-implemented method of claim 10, further comprising:

selecting a video quality;

identifying an inability to output a particular video segment of the preview video sequence in substantially real time at the selected video quality; and

adjusting a level of video quality associated with the particular video segment, the adjustment being to a highest available level of video quality that enables the particular video segment to be output in substantially real time.

13. The computer-implemented method of claim 10, wherein generating the preview video sequence includes:

editing a subset of the plurality of video segments to add an effect.

14. The computer-implemented method of claim 10, further comprising:

outputting the preview video sequence in substantially real time after the at least one of video quality or video frame rate of each individual identified video segment has been adjusted.

15. The computer-implemented method of claim 10, wherein the two or more tracks are at least one of reels or effect timelines.

16. The computer-implemented method of claim 10, further comprising:

dynamically allocating a capacity for one or more buffers associated with outputting the preview video sequence, where the capacity for the one or more buffers is allocated at least in accordance with a frame resolution of a video segment in the preview video sequence.

17. The computer-implemented method of claim 16, wherein the one or more buffers are comprised of at least one of a decode buffer, an effects buffer, and a composite buffer.

18. A system, comprising:

a computer-readable medium storing a plurality of video segments included in two or more tracks;

an editing time line configurable to edit a video segment of the plurality of video segments and to generate a preview video sequence from the two or more tracks;

a cost block configured to calculate a cost associated with outputting each of the video segments included in the preview video sequence in real time, the cost being represented in terms of system resources, wherein the preview block identifies the inability to output based on the calculated cost; and

a preview block, in communication with the editing timeline, the preview block configured to identify, in conjunction with the generation of the preview video sequence, at least one video segment in the preview video sequence that cannot be output in substantially real time based at least in part on the calculated cost, the preview block dynamically adjusting at least one of video quality or video frame rate of each individual identified video segment to enable the at least one identified video segment to be output in substantially real time, and wherein output in substantially real time refers to output having consistency with respect to an associated output level.

19. The system of claim 18, further including:

a real time engine, in communication with the editing timeline and the preview block, the real time engine configured to output the preview video sequence in substantially real time, including dynamically allocating a size of one or more buffers associated with outputting the preview video sequence.

20. The system of claim 19, wherein the real time engine is further configured to allocate the size of the one or more buffers in accordance with a frame resolution of a current video segment in the preview video sequence.

21. The system of claim 19, wherein the one or more buffers are comprised of at least one of a decode buffer, an effects buffer, and a composite buffer.

22. The system of claim 18, further comprising:

a rendering engine, in communication with the preview block, the rendering engine configured to render an output preview video sequence responsive to the inability of the preview block to output each video segment included in the preview video sequence in substantially real time.

23. The system of claim 18, wherein the two or more tracks are at least one of reels or effect timelines.

24. A non-transitory computer-readable medium encoded with a computer program comprising instructions that, when executed by a data processing apparatus, cause the data processing apparatus to perform operations comprising:

editing a video segment of a plurality of video segments included in two or more tracks;

generating a preview video sequence from the two or more tracks, wherein video segments included in the two or more tracks are sequentially arranged according to the preview video sequence;

estimating, for each of the plurality of video segments in the preview video sequence, a cost associated with outputting the video segment in real time, the cost being in terms of system resources;

identifying, in conjunction with the generating a preview video sequence, at least one video segment in the preview video sequence that cannot be output in substantially real time at an associated first resolution based at least in part on the estimated cost; and

dynamically reducing a frame resolution of each individual identified video segment from the first frame resolution to a second frame resolution to enable the identified video segment to be output in substantially real time;

wherein output in substantially real time refers to output having consistency with respect to an associated output level.

25. The non-transitory computer-readable medium of claim 24, further comprising:

dynamically allocating a capacity for one or more buffers associated with processing the preview video sequence for output, the one or more buffers having a first capacity when processing a video segment at the first frame resolution and the one or more buffers having a second capacity when processing a video segment at the second frame resolution.