RENDERING IN A MULTI-USER VIDEO EDITING SYSTEM

• US 20100262710A1
• Filed: 04/06/2010
• Published: 10/14/2010
• Est. Priority Date: 04/14/2009
• Status: Active Grant

• Current Assignee: Avid Technology Canada Corporation (Avid Technology Incorporated)
• Original Assignee: Avid Technology Canada Corporation (Avid Technology Incorporated)
• Inventors: Wei, Min, Khatib, Maher
• Granted Patent: US 8,527,646 B2
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence

Abstract

Methods and systems for remotely editing a video file involve: receiving, at a server, a video editing command from a remote client; modifying, at the server, a virtual representation of a media file in accordance with the received command, the virtual representation including a reference to a source media file stored on a storage device, the storage device being connected to the server over a high-speed link; and generating and transmitting, from the server to the remote client, a proxy representation of the source media file modified by the editing commands, wherein the various regions of the proxy representation are rendered either in the background or in real-time according to their complexity. Rendered frames, whether generated in the background or in real time, are stored for reuse. Individual frames of the edited video file may be transmitted upon request from a client. Simultaneous editing of independent projects by multiple users connected to the server via multiple thin clients is supported.

Claims

1. A system for remote video editing, the system comprising:

a storage device for storing a source media file;

an input for receiving, over a network, video editing commands pertaining to the source media file;

a virtual representation of the source media file, the virtual representation comprising the editing commands and a link to the source media file;

a complexity evaluator that determines a complexity for rendering a proxy representation of a region of the virtual representation, wherein rendering involves applying the received video editing commands for the region to the source media file;

a render scheduler that dispatches the region for rendering to a background rendering engine if the complexity of the region exceeds a predetermined threshold, wherein the background rendering engine renders the region by applying the received editing commands to a portion of the source media file corresponding to the region and stores the rendered region in a render cache; and

a media delivery engine that delivers the proxy representation of the edited source media file, wherein for each region of the virtual representation, if a rendering of the region is present in the render cache, the media delivery engine retrieves the region from the render cache and transmits the region over the network, and if a rendering of the region is not present in the render cache, the media delivery engine retrieves a portion of the source media file corresponding to the region, renders the region in real-time using a real-time rendering engine by applying the received video editing commands to the retrieved portion of the source media file, and transmits the region over the network.

2. The system of claim 1, wherein the real-time rendering engine stores the rendered region in the rendering cache.

3. The system of claim 1, wherein the proxy representation is a video stream and the media delivery engine is a streaming engine.

4. The system of claim 1, wherein the region of the virtual representation comprises one or more frames of the source media files having the video editing commands applied thereto.

5. The remote video editing system of claim 1, wherein a first user is connected to the video editing system over the network, and the video editing system is configured to receive, over the network, video editing commands from the first user, the commands from the first user being associated with the virtual representation.

6. The remote video system of claim 5 further comprising a plurality of virtual representations including the first-mentioned virtual representation, each of the plurality of virtual representations being associated with one of a plurality of users connected to the video editing system over the network, the plurality of users including the first user, wherein the video editing system is configured to receive, over the network, video editing commands from each of the plurality of connected users, each received command pertaining to one of the plurality of virtual representations associated with the one of the plurality of users from whom the command was received.

7. The remote video editing system of claim 6, wherein a processing resource level allocated to one or more of the plurality of connected users is dynamically dependent on the number of connected users.

8. The remote video editing system of claim 7, wherein the processing resource level allocated to one or more of the plurality of connected users includes an allocation for background rendering.

9. The remote video editing system of claim 7, wherein the processing resource level allocated to one or more of the plurality of connected users includes an allocation of foreground processing resources for real-time rendering and transmitting the proxy representation over the network.

10. The remote video editing system of claim 6, wherein a processing resource level allocated to a connected user is based in part on a weight assigned to the user.

11. A system for remote video editing comprising:

a client comprising;

(a) an input for receiving a proxy representation of media;

(b) a processor for decoding the proxy representation;

(c) a graphical user interface for displaying content represented by the decoded proxy representation;

(d) a user input for facilitating entry of commands for editing the proxy representation; and

an

(e) output for transmitting the editing commands, and

a server for receiving the editing commands, applying the editing commands to a source media file, and generating the proxy representation in accordance with the source media file and the editing commands, wherein, the proxy representation is generated by a background process for regions of the source media file for which applying the editing commands involves a computational load exceeding a predetermined threshold, and the proxy representation is generated in real-time for regions of the source file for which applying the editing commands involves a computational load below the predetermined threshold.

12. The system of claim 11, wherein the client is one of a desktop computer, workstation, laptop computer, netbook, and smartphone.

13. The system of claim 11, wherein the proxy representation comprises a media stream.

14. The system of claim 11, wherein the proxy representation includes one or more individual frames requested via the user input, the one or more individual frames corresponding to application of the editing commands to the source media file.

15. A method for remotely editing a video file, the method comprising:

receiving, at a server, a video editing command from a remote client;

modifying, at the server, a virtual representation of a media file in accordance with the received command, the virtual representation comprising a reference to a source media file stored on a storage device, the storage device being connected to the server over a high-speed link; and

rendering and transmitting, from the server to the remote client, a proxy representation of the source media file modified by the editing commands, wherein regions of the proxy representation for which rendering the proxy representation requires computational resources that exceed a threshold are rendered by a background rendering process, and wherein the remaining regions of the proxy representation are rendered in real time.

16. The method of claim 15, wherein the server includes a plurality of virtual representations, and further comprising receiving video editing commands from a plurality of remote clients, each of the remote clients being associated with a corresponding virtual representation, wherein each of the editing commands pertains to the one of the plurality of virtual representations corresponding to the client from which the command was received.

17. The method of claim 16, wherein a server processing resource level allocated to one or more of the plurality of remote clients is dynamically dependent on a number of remote clients connected to the server.

18. The method of claim 17, wherein the processing resource level allocated to one or more of the plurality of remote clients includes an allocation for background rendering.

19. The method of claim 17, wherein the processing resource level allocated to one or more of the plurality of remote clients includes an allocation of foreground processing resources for real-time rendering and transmitting the proxy representation.

20. The remote video editing system of claim 16, wherein a processing resource level allocated to a remote client is based in part on a weight assigned to the client.

21. The method of claim 15, wherein the proxy representation comprises a video stream.

22. The method of claim 15, wherein the server stores the proxy representation in a rendering cache.