Collaborative media editing system

• US 9,373,358 B2
• Filed: 11/08/2011
• Issued: 06/21/2016
• Est. Priority Date: 11/08/2011
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Guerrera, Enzo Mario, Warner, Steven G., Lee, Peter Erick, Schnepel, Soenke
• Primary Examiner(s): Tran, William
• Application Number:
  US13/291,233
• Publication Number:
  US 20140040737A1
• Time in Patent Office: 1,687 Days
• Field of Search: 386/278, 715/716
• US Class Current: 1/1
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

A media editing system includes one or more machines that are configured to support cloud-based collaborative editing of media by one or more client devices. A machine within the media editing system may be configured to receive a render request for generation of a media frame, determine whether a client device is to generate the media frame, and initiate generation of the media frame. Moreover, a machine within the media editing system may facilitate resolution of conflicts between edits to a particular piece of media. Furthermore, a machine within the media editing system may facilitate provision of convenient access to media from a particular client device to one or more additional client devices.

Claims

1. A method comprising:

receiving a render request from a client device, the render request specifying that a first media frame be generated based on a second media frame that is stored by a source machine communicatively coupled to the client device;

determining, by one or more processors, whether a render machine is selected to generate the first media frame, wherein determining whether the render machine is selected to generate the first media frame is based on a position within a media timeline to be associated with the first media frame, wherein the media timeline is associated with a media content accessed for editing;

initiating, by the one or more processors, generation of the first media frame by the render machine communicatively coupled to the source machine, the render machine accessing the second media frame from the source machine and generating the first media frame based on the second media frame in response to the received render request, wherein the render machine is selected to generate the first media frame when the position within the media timeline to be associated with the first media frame is distant from a current position within the media timeline; and

communicating the generated first media frame to the client device in response to the received render request, wherein the generated first media frame communicated to the client device is directly accessible to one or more additional client devices from the client device prior to the first media frame being communicated to the source machine.

2. The method of claim 1, wherein:

the second media frame from which the first media frame is to be generated is absent from the client device.

3. The method of claim 1 further comprising:

providing client software to the client device,

the client software configuring the client device to communicate the render request and to receive the generated first media frame in response to the communicated render request.

4. The method of claim 1 further comprising:

providing client software to the client device,

the client software configuring the client device to generate the render request to specify that the first media frame be generated based on the second media frame.

5. The method of claim 1, wherein:

the receiving of the render request is in response to media editor software being executed by the client device,

the media editor software configuring the client device to initiate generation of the render request.

6. The method of claim 5, wherein:

the media editor software includes a nonlinear editor interface operable by a user to specify the generation of the first media frame based on the second media frame.

7. The method of claim 1, wherein:

the first media frame and the second media frame are video frames; and

the generating of the first media frame includes modifying a pixel within the second media frame to generate a pixel within the first media frame.

8. The method of claim 1, wherein:

the first media frame and the second media frame are audio frames; and

the generating of the first media frame includes modifying audio data within the second media frame to generate audio data within the first media frame.

9. The method of claim 1, wherein:

the render request specifies that the second media frame be composited with a third media frame in the generation of the first media frame; and

the generation of the first media frame includes compositing the second media frame with the third media frame stored by a further source machine communicatively coupled to the client device.

10. The method of claim 1, wherein:

the render request specifies that the second media frame be modified by application of a media effect to generate the first media frame; and

the generation of the first media frame includes applying the media effect to the second media frame.

11. The method of claim 1 further comprising:

determining a level of compression for the first media frame generated based on the second media frame; and

initiating compression of the generated first media frame to the determined level of compression in response to the generation of the first media frame.

12. The method of claim 11, wherein:

the determining of the level of compression is based on an indicator of latency in a network that communicatively couples the client device and the render machine.

13. The method of claim 11, wherein:

the determining of the level of compression is based on an indicator of a data rate in a network that communicatively couples the client device and the render machine.

14. The method of claim 1 further comprising:

accessing a first media project stored by a storage machine communicatively coupled to the client device,

the first media project specifying a first set of edits to the second media frame stored by the source machine communicatively coupled to the client device;

accessing a second media project,

the second media project specifying a second set of edits to the second media frame;

determining whether the second set of edits is obtainable from the first set of edits; and

communicating a notification regarding compatibility of the second set of edits with the first set of edits.

15. The method of claim 14, wherein:

the determining of whether the second set of edits is obtainable from the first set of edits includes determining that the second set of edits is unobtainable from the first set of edits.

16. The method of claim 15, wherein:

the determining that the second set of edits is unobtainable from the first set of edits includes determining that no combination of available edits results in the second set of edits when applied to the first set of edits.

17. The method of claim 14, wherein:

the determining of whether the second set of edits is obtainable from the first set of edits includes determining that the second set of edits is obtainable from the first set of edits.

18. The method of claim 14, wherein:

the determining that the second set of edits is obtainable from the first set of edits includes determining a combination of available edits that results in the second set of edits when applied to the first set of edits.

19. A system comprising:

a media editing system server comprising one or more processors and computer-storage memory having computer-executable instructions stored thereon that, when executed by the one or more processors, implement a method, comprising;

receiving a render request from a client device, the render request specifying that a first media frame be generated based on a second media frame that is stored by a source machine communicatively coupled to the client device;

determining whether a render machine is selected to generate the first media frame, wherein determining whether the render machine is selected to generate the first media frame is based on a position within a media timeline to be associated with the first media frame, wherein the media timeline is associated with a media content accessed for editing;

initiating generation of the first media frame by the render machine communicatively coupled to the source machine, the render machine accessing the second media frame from the source machine and generating the first media frame based on the second media frame in response to the received render request, wherein the render machine is selected to generate the first media frame when the position within the media timeline to be associated with the first media frame is distant from a current position within the media timeline;

communicating the first media frame to the client device in response to the received render request, and

providing an availability notification to one or more additional client devices not storing the generated first media frame that the first media frame is available to the one or more additional client devices directly from the client device.

20. The system of claim 19, wherein the method comprises:

the render request specifying that the second media frame be composited with a third media frame in the generation of the first media frame; and

configuring the processor to composite the second media frame with the third media frame stored by a further source machine communicatively coupled to the client device.

21. The system of claim 19, wherein the method further comprises:

determining that the render machine is selected to generate the first media frame, the client device being available to generate the first media frame yet unselected to generate the first media frame.

22. The system of claim 21, wherein the method further comprises:

determining that the render machine is selected to generate the first media frame based on an indicator of latency in a network that communicatively couples the client device and the render machine.

23. The system of claim 21, wherein the method further comprises:

determining that the render machine is selected to generate the first media frame based on an indicator of a data rate in a network that communicatively couples the client device and the render machine.

24. The system of claim 21, wherein the method further comprises:

determining that the render machine is selected to generate the first media frame based on media editor software being executed by the client device to generate media content based on the second media frame.

25. The system of claim 21, wherein the method further comprises:

determining that the render machine is selected to generate the first media frame based on media editor software being executed by the client device to present media content based on the second media frame.

26. A system comprising:

one or more processors; and

computer-storage memory having computer-executable instructions stored thereon that, when executed by the one or more processors, implement a method comprising;

receiving a render request from a client device, the render request specifying that a first media frame be generated based on a second media frame that is stored by a source machine communicatively coupled to the client device;

determining, by the one or more processors, whether a render machine is selected to generate the first media frame, wherein determining whether the render machine is selected to generate the first media frame is based on a position within a media timeline to be associated with the first media frame, wherein the media timeline is associated with a media content accessed for editing;

initiating generation of the first media frame by the render machine, the render machine accessing the second media frame from the source machine and generating the first media frame based on the second media frame in response to the received render request, wherein the render machine is selected to generate the first media frame when the position within the media timeline to be associated with the first media frame is distant from a current position within the media timeline;

communicating the generated first media frame to the client device in response to the received render request;

communicating the generated first media frame to the source machine; and

providing a second client device access to the generated first media frame from the client device prior to completion of uploading the first media frame to the source machine, the source machine configured to store the second media frame.