System and method for enabling multimedia production collaboration over a network

• US 6,598,074 B1
• Filed: 09/23/1999
• Issued: 07/22/2003
• Est. Priority Date: 09/23/1999
• Status: Expired due to Fees

• Current Assignee: Avid Technology Incorporated
• Original Assignee: Rocket Networks, Incorporated (Avid Technology Incorporated)
• Inventors: Franke, Michael, Lyus, Graham, Moller, Matthew D.
• Primary Examiner(s): Harrell, Robert B.
• Assistant Examiner(s): Pollack, Melvin H.
• Application Number:
  US09/401,318
• Time in Patent Office: 1,398 Days
• Field of Search: 709/204, 709/205, 709/219, 709/231, 709/206, 709/217, 709/218, 370/260, 370/263, 370/270, 725/61, 725/87, 725/133
• US Class Current: 709/204
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 2240/175 for jam sessions or musical collaboration through a network, e.g. for composition, ensemble playing or repeating; Compensation of network or internet delays therefor

Abstract

A system and method for collaborative multimedia production by users at different geographic locations. The users produce sequencer data at a plurality of sequencer stations connected via a network. The sequencer stations encapsulate sequencer data units into broadcast data units and upload and download broadcast data units to and from a server, in response to user commands received at the sequencer stations.

Claims

1. Apparatus for sharing sequence data associated with a collaborative project between a local sequencer station and at least one remote sequencer station over a network via a server, the sequence data representing audiovisual occurrences each having descriptive characteristics and time characteristics, the apparatus comprising:

a first interface module receiving commands from an associated client application operating on the local sequencer station and capable of modifying the audiovisual occurrences;

a data packaging module coupled to the first interface module, the data packaging module responding to the received commands by encapsulating sequence data associated with the collaborative project from the local sequencer station into broadcast data units retaining the descriptive characteristics and time relationships of the sequence data, the data packaging module also extracting sequence data associated with the collaborative project from broadcast data units received from the server for access by the local sequencer station;

a broadcast handler coupled to the first interface module and the data packaging module, the broadcast handler processing commands received via the first interface module;

a server communications module responding to commands processed by the broadcast handler by transmitting broadcast data units to the server for distribution to at least one remote sequencer station, the server communications module also receiving data available messages associated with the collaborative project and broadcast data units transmitted from the server; and

a notification queue handler coupled to the server communications module and responsive to receipt of data available messages associated with the collaborative project and broadcast data units transmitted from the server to transmit notifications to the client application via the first interface, the notifications indicating availability of broadcast data units for access by the local sequencer station.

2. Apparatus as recited in claim 1, wherein the data packaging module encapsulates the sequence data into broadcast data units including an arrangement data unit establishing a time reference, and at least one track data unit having a track time reference corresponding to the arrangement time reference, each track data unit having at least one associated event data unit representing an audiovisual occurrence at a specified time with respect to the associated track time reference.

3. Apparatus as recited in claim 2, wherein the sequence data produced by the local sequencer station includes multimedia data source data units and wherein the data packaging module encapsulates the multimedia source data units into at least one type of asset rendering broadcast unit, each asset rendering broadcast unit type specifying a version of multimedia data source data exhibiting a different degree of data compression.

4. Apparatus as recited in claim 3, wherein the server communications module responds to commands processed by the broadcast handler by transmitting asset rendering broadcast units of a selected asset rendering broadcast unit type to the server for distribution to at least one remote sequencer station.

5. Apparatus as recited in claim 3, wherein the sequence data units produced by the local sequencer station include clip data units each representing a specified portion of a multimedia data source data unit and wherein the data packaging module encapsulates the clip data units into broadcast clip data units.

6. Apparatus as recited in claim 5, wherein the data packaging module encapsulates sequence data units into broadcast clip event data units each representing a specified portion of a multimedia data source data unit beginning at a specified time with respect to an associated track time reference.

7. Apparatus as recited in claim 6, wherein:

the data packaging module encapsulates sequence data units into scope event data units each having a scope event time reference established at a specific time with respect to an associated track time reference;

each scope event data unit including at least one timeline event data unit, each timeline event data unit having a timeline event time reference established at a specific time with respect to the associated scope event time reference and including at least one event data unit representing an audiovisual occurrence at a specified time with respect to the associated timeline event time reference.

8. Apparatus as recited in claim 1, comprising a connection control component responsive to commands received from the local sequencer station to establish access via the server to a predetermined subset of broadcast data units stored on the server.

9. Apparatus as recited in claim 8, wherein the connection control component receives registration data from the local sequencer station and establishes access to a predetermined subset of broadcast data units stored on the server in accordance with permission data stored on the server.

10. Apparatus as recited in claim 1, wherein the data packaging module:

encapsulates sequence data into first and second types of broadcast data units;

responds to receipt of a message indicating the availability at the server of the first type of broadcast data unit by causing the server communications module to initiate a download of the first type of broadcast data unit without requiring authorization from the client application component; and

responds to receipt of a message indicating the availability at the server of the second type of broadcast data unit by causing the server communications module to initiate a download of the second type of broadcast data unit only after receipt of a download command from the client application component.

11. Apparatus as recited in claim 10, wherein the first type of broadcast data unit comprises a non-media broadcast data unit and the second type of broadcast data unit comprises a media broadcast data unit.

15. Apparatus as recited in claim 1, wherein the server communications module caches broadcast data units.

16. Apparatus as recited in claim 1, wherein the sequence data includes at least one rendered version of sequence data.

17. Apparatus as recited in claim 16, wherein the rendered version of sequence data includes a compressed version of sequence data.

18. Apparatus as recited in claim 1, wherein the network includes a local area network (LAN).

12. Apparatus for sharing sequence data associated with a collaborative project between a local sequencer station and at least one remote sequencer station over a network via a server, the sequence data representing audiovisual occurrences each having descriptive characteristics and time characteristics and including multimedia data source data units, the apparatus comprising:

a first interface module receiving commands from an associated client application operating on the local sequencer station and capable of modifying the audiovisual occurrences;

a data packaging module coupled to the first interface module, the data packaging module responding to the received commands by encapsulating sequence data associated with the collaborative project from the local sequencer station into broadcast data units retaining the descriptive characteristics and time relationships of the sequence data, the data packaging module encapsulating the multimedia data source data units into at least one type of asset rendering broadcast unit, each rendering broadcast unit type specifying a version of multimedia data source data units exhibiting a different degree of data compression, the data packaging module also extracting sequence data associated with the collaborative project from broadcast data units received from the server;

a broadcast handler coupled to the first interface module and the data packaging module, the broadcast handler processing command received via the first interface module; and

a server communications module responding to commands processed by the broadcast handler by transmitting broadcast data units to the server for distribution to at least one remote sequencer station, the server communications module also receiving broadcast data units via the server from the at least one remote sequencer station.

13. Apparatus for sharing sequence data associated with a collaborative project between a local sequencer station and at least one remote sequencer station over a network via a server, the sequence data representing audiovisual occurrences each having descriptive characteristics and time characteristics, the apparatus comprising:

a first interface module receiving commands from an associated client application operating on the local sequencer station and capable of modifying the audiovisual occurrences;

a data packaging module coupled to the first interface module, the data packaging module responding to the received commands by encapsulating sequence data associated with the collaborative project from the local sequencer station into broadcast data units retaining the descriptive characteristics and time relationships of the sequence data, the broadcast data units including custom broadcast data units, standard broadcast data units expressing a hierarchy of sequence data, and specialized broadcast data units including all attributes of standard broadcast data units plus additional attributes, the data packaging module also extracting sequence data associated with the collaborative project from broadcast data units received from the server;

a broadcast handler coupled to the first interface module and the data packaging module, the broadcast handler processing commands received via the first interface module; and

a server communications module responding to commands processed by the broadcast handler by transmitting broadcast data units to the server for distribution to at least one remote sequencer station, the server communications module also receiving broadcast data units via the server from the at least one remote sequencer station and passing the received broadcast data units to the data packaging module.

14. A method for sharing sequence data associated with a project between a local sequencer station and at least one remote sequencer station over a network via a server, the sequence data representing audiovisual occurrences each having descriptive characteristics and time characteristics, the method comprising:

receiving commands from a user at the local sequencer station via a client application component capable of modifying the audiovisual occurrences;

responding to the received commands by encapsulating sequence data associated with the collaborative project from the local sequencer station into broadcast data units retaining the descriptive characteristics and time relationships of the sequence data and transmitting broadcast data units to the server for distribution to at least one remote sequencer station;

receiving data available messages associated with the collaborative project transmitted from the server;

responding to receipt of data available messages associated with the collaborative project transmitted from the server to transmit notifications to the client application component, the notifications indicating availability of broadcast data units for access by the client application component;

responding to commands received from the client application component to request download of broadcast data units from the server; and

receiving broadcast data units from the server and extracting sequence data associated with the collaborative project from the received broadcast data units for access by the client application component.

19. A computer-readable medium storing instructions which, if executed by a computer system, cause the computer system to implement a method for sharing sequence data associated with a collaborative project between a local sequencer station and at least one remote sequencer station over a network via a server, the sequence data representing audiovisual occurrences each having descriptive characteristics and time characteristics, the method comprising:

receiving commands from a user at the local sequencer station via a client application component capable of modifying the audiovisual occurrences;

responding to the received commands by encapsulating sequence data associated with the collaborative project from the local sequencer station into broadcast data units retaining the descriptive characteristics and time relationships of the sequence data and transmitting broadcast data units to the server for distribution to at least one remote sequencer station;

receiving data available messages associated with the collaborative project transmitted from the server;

responding to receipt of data available messages transmitted from the server to transmit notifications to the client application component, the notifications indicating availability of broadcast data units for access by the client application component;

responding to commands received from the client application component to request download of broadcast data units from the server; and

receiving broadcast data units from the server and extracting sequence data associated with the collaborative project from the received broadcast data units for access by the client application component.

20. Apparatus for sending sequence data associated with a collaborative project to a server and accessing sequence data associated with the collaborative project stored on the server by a local sequencer station connected to the server over a network, the sequence data representing audiovisual occurrences each having descriptive characteristics and time characteristics, the apparatus comprising:

a first interface module receiving commands from an associated client application operating on the local sequencer station and capable of modifying the audiovisual occurrences;

a data packaging module coupled to the first interface module, the data packaging module responding to the received commands by encapsulating sequence data associated with the collaborative project from the local sequencer station into broadcast data units retaining the descriptive characteristics and time relationships of the sequence data, the data packaging module also extracting sequence data associated with the collaborative project from broadcast data units received from the server for access by the local sequencer station;

a broadcast handler coupled to the first interface module and the data packaging module, the broadcast handler processing commands received via the first interface module;

a server communications module responding to commands processed by the broadcast handler by transmitting broadcast data units to the server, the server communications module also receiving data available messages associated with the collaborative project and broadcast data units transmitted from the server; and

a notification queue handler coupled to the server communications module and responsive to receipt of data available messages associated with the collaborative project and broadcast data units transmitted from the server to transmit notifications to the client application component via the first interface, the notifications indicating availability of broadcast data units for access by the local sequencer station.

21. Apparatus as recited in claim 20, further comprising a caching module caching broadcast data units.

22. Apparatus as recited in claim 20, further comprising a rendering module rendering sequence data into at least one rendered version of sequence data.

23. Apparatus as recited in claim 22, wherein the rendered version of sequence data includes a compressed version of sequence data.

24. Apparatus as recited in claim 20, wherein the data packaging module encapsulates the sequence data into broadcast data units including an arrangement data unit establishing a time reference.

25. Apparatus as recited in claim 24, wherein the broadcast data units further include at least one track data unit having a track time reference corresponding to the arrangement time reference, each track data unit having at least one associated event data unit representing an audiovisual occurrence at a specified time with respect to the associated track time reference.

26. Apparatus as recited in claim 20, wherein the sequence data produced by the local sequencer station includes multimedia data source data units and wherein the data packaging module encapsulates the multimedia source data units into at least one type of asset rendering broadcast unit, each asset rendering broadcast unit type specifying a version of multimedia data source data exhibiting a different degree of data compression.

27. Apparatus as recited in claim 26, wherein the server communications module responds to commands processed by the broadcast handler by transmitting asset rendering broadcast units of a selected asset rendering broadcast unit type to the server.

28. Apparatus as recited in claim 26, wherein the sequence data units produced by the local sequencer station include clip data units each representing a specified portion of a multimedia data source data unit and wherein the data packaging module encapsulates the clip data units into broadcast clip data units.

29. Apparatus as recited in claim 28, wherein the data packaging module encapsulates sequence data units into broadcast clip event data units each representing a specified portion of a multimedia data source data unit beginning at a specified time with respect to an associated track time reference.

30. Apparatus as recited in claim 29, wherein:

the data packaging module encapsulates sequence data units into scope event data units each having a scope event time reference established at a specific time with respect to an associated track time reference; and

each scope event data unit including at least one timeline event data unit, each timeline event data unit having a timeline event time reference established at a specific time with respect to the associated scope event time reference and including at least one event data unit representing an audiovisual occurrence at a specified time with respect to the associated timeline event time reference.

31. Apparatus as recited in claim 20, comprising a connection control component responsive to commands received from the local sequencer station to establish access via the server to a predetermined subset of broadcast data units stored on the server.

32. Apparatus as recited in claim 31, wherein the connection control component receives registration data from the local sequencer station and establishes access to a predetermined subset of broadcast data units stored on the server in accordance with permission data stored on the server.

33. Apparatus as recited in claim 20, wherein the data packaging module:

encapsulates sequence data into first and second types of broadcast data units;

responds to receipt of a message indicating the availability at the server of the first type of broadcast data unit by causing the server communications module to initiate a download of the first type of broadcast data unit based on a download command from the client application; and

responds to receipt of a message indicating the availability at the server of the second type of broadcast data unit by causing the server communications module to initiate a download of the second type of broadcast data unit upon authorization from the client application.

34. Apparatus as recited in claim 33, wherein the first type of broadcast data unit comprises a non-media broadcast data unit and the second type of broadcast data unit comprises a media broadcast data unit.

35. Apparatus as recited in claim 20, wherein the network includes a local area network (LAN).

36. A computer-readable medium storing instructions which, if executed by a computer system, cause the computer system to implement a method for sending sequence data associated with the collaborative project to a server and accessing sequence data associated with the collaborative project stored on the server by a local sequencer station connected to the server over a network, the sequence data representing audiovisual occurrences each having descriptive characteristics and time characteristics, the method comprising:

receiving commands from a user at the local sequencer station via a client application component capable of modifying the audiovisual occurrences;

responding to the received commands by encapsulating sequence data associated with the collaborative project from the local sequencer station into broadcast data units retaining the descriptive characteristics and time relationships of the sequence data and transmitting broadcast data units to the server for distribution to at least one remote sequencer station;

receiving data available messages associated with the collaborative project transmitted from the server;

responding to receipt of data available messages transmitted from the server to transmit notifications to the client application component, the notifications indicating availability of broadcast data units for access by the client application component;

responding to commands received from the client application component to request download of broadcast data units from the server; and

receiving broadcast data units from the server and extracting sequence data associated with the collaborative project from the received broadcast data units for access by the client application component.