Integrated multi-media production and authoring system

• US 5,307,456 A
• Filed: 01/28/1992
• Issued: 04/26/1994
• Est. Priority Date: 12/04/1990
• Status: Expired due to Term

• Current Assignee: Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Electronics Inc. (Sony Group Corp.)
• Inventors: MacKay, Michael T.
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): BURRASTON, NEIL
• Application Number:
  US07/827,009
• Time in Patent Office: 819 Days
• Field of Search: 395/152, 395/153, 395/154, 395/155, 395/156, 395/157, 395/159, 395/161, 395/200
• US Class Current: 715/782
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G11B 2220/41 Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: G11B 27/36 Monitoring, i.e. supervising the progress of recording or reproducing for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

A network multi-media production and authoring system. A real-time network referred to as an "AV LAN" is defined. Coupled to the AV LAN are a number of shared multi-media production resource devices. These multi-media production resource devices include video tape recorders, audio tape recorders, video titling devices, graphics devices, special effects generators, etc. Also connected to the AV LAN are a number of workstations which are used to control the production resources connected to the AV LAN. The production resources are connected to the AV LAN through an interface unit known as a `device translator`. The device translator is a microprocessor driven device that translates coded messages received over the AV LAN into specific commands which the particular production resource understands. The edit workstations present the user with an intuitive graphical user interface that enables the user access the various production resources in order to create, define, edit, and store elements for use in a multi-media production. The scalable nature of the AV LAN system allows users to design and build AV LAN networks to suit their particular needs. An AV LAN system can be as simple as a single workstation connected to a single production resource device. The AV LAN can be expanded into entire production, editing, and post-production studio. This is accomplished by coupling together several individual AV LAN networks using a network bridge. Efficient organization of such a large system can be accomplished by grouping together like kind production resources onto the same local AV LAN network.

Claims

1. An integrated multi-media production and authoring system, said system comprising:

a digital communications network for carrying a plurality of addressed messages such that communication on the digital communications network takes place in real-time;

a plurality of workstations comprising digital computers coupled to said digital communications network, said workstations transmitting and receiving said plurality of addressed messages over said digital communications network; and

a plurality of production resources including audio and video production and editing devices, said production resources coupled to said digital communications network, said production resources transmitting and receiving said plurality of addressed messages on said digital communications network such that a user working with any of said plurality of workstations may access any of said plurality of production resources coupled to said digital communications network to create and edit a multi-media work;

said plurality of workstations including a display system having a display and user input means, said display system comprising;

a user interface for display on said display, said user interface displaying representations of said production resources coupled to said digital communications network with which a user interacts using said user input means;

said representations of said production resources comprising at least three dimensions and being arranged in a venue of at least three dimensions, each of said dimensions corresponding to an attribute of said production resources which may be viewed using said user interface from a plurality of view ports, such that viewing said representations of said production resources from different view ports results in the display of different attributes of said production resources;

said representations of said production resources being arranged in said venue such that each of said production resources is disposed relative to one another in time and space within said venue;

manipulation means coupled to said user input means for selectively positioning said representations of said production resources within said venue.

2. The system as defined by claim 1 wherein said venue may be viewed from six view ports, namely, a top, left, right, rear, bottom and front view port.

3. The system as defined by claim 2 wherein viewing said venue from a top view port reveals the relative positions of each of said three dimensional representations of said production resources relative in time to one another.

4. The system as defined by claim 3 wherein viewing said venue from a front view port reveals an icon identifying the type of production resource each of said representations represent.

5. The system as defined by claim 4 wherein viewing said venue from a side view port reveals versions of said production resource and the lengths of said versions relative to one another.

6. The system as defined by claim 5 wherein viewing said venue from a front view port further reveals version activation buttons, one of said buttons for each of said versions, such that said user, using said user input means may selectively activate said versions.

7. The system as defined by claim 6 wherein if said user activates one of said versions, said version is executed within said representation of said production resource, and may viewed through said front view port of said venue on said display.

8. The system as defined by claim 7 wherein said user interface includes interface generation means for generating and displaying a control frame using said display means to display selected view ports of a venue, said control frame including a plurality of command options which may be selected by said user using said user input means.

9. The system as defined by claim 8 wherein said control frame further includes a first area for defining said attributes of said resources and displaying said representations of said resources once said attributes are defined.

10. The system as defined by claim 9 wherein said first area displays said representations of said production resources in a venue initially from a first view port.

11. The system as defined by claim 10 wherein said user may selectively change view ports from said first view port by selecting one of said command options.

12. The system as defined by claim 11 wherein said control frame further includes a second area for displaying said top view port of said venue, such that timing data representing relative time associated with said production resources is displayed in said second area.

13. The system as defined by claim 12 wherein said control frame further includes a event horizon bar, such that the placement of a representation of a production resource on said bar results in said timing data being displayed in said second area of said control frame.

14. The system as defined by claim 13 wherein selecting an Element command option results in the display of an element attribute box for defining said production resource attributes.

15. The system as defined by claim 14 wherein said representations of said production resources may be selectively placed on said event horizon bar, thereby altering the relative placement of said representations in said venue in time and space.

16. The system as defined by claim 15 wherein said command options of said control frame further includes a plurality of mode specific action options on the periphery of said control frame.

17. The system as defined by claim 16 wherein said command options of said control frame further includes a plurality of major mode options on the periphery of said control frame.

18. The system as defined by claim 17 wherein said first view port initially displayed comprises the front view port.

19. The system as set forth in claim 1 wherein each of said plurality of production resources are coupled to said digital communications network through a device translator, said device translator comprises:

a network interface coupled to said digital communications network such that said device translator transmits and receives said plurality of addressed messages over said digital communications network;

a central processing unit coupled to said network interface, said central processing unit programmed such that the plurality of addressed messages received over said digital communications network are translated into a plurality of device-specific commands; and

a device-specific interface coupled to said central processing unit and coupled to said production resource associated with said device translator, wherein said device translator communicates said plurality of device-specific commands to said production resource;

wherein said device translator translates said received plurality of addressed messages into said plurality of device specific commands.

20. The system as set forth in claim 19 wherein said device translator includes a programmable translation data set stored in a memory means coupled to said central processing unit such that said device translator can be programmed to translate said plurality of addressed messages into a plurality of device-specific commands for a plurality of different production resources.

21. The system as set forth in claim 20 wherein said programmable translation data set is downloaded into said memory means in said device translator through said digital communications network.

22. The system as set forth in claim 1 further comprising a library management system coupled to said digital communications network.

23. The system as set forth in claim 22 wherein said library management system comprises:

a library of digital media storage units;

means for accessing said digital media storage units, said accessing means coupled to said digital communications network;

means for loading said digital media storage units into said accessing means, said loading means coupled to said digital communications network.

24. The system as set forth in claim 23 wherein said digital media storage units in said library management system comprise magnetic tapes.

25. The system as set forth in claim 24 wherein said accessing means in said library management system comprise digital video tape recorders.

26. The system as set forth in claim 23 wherein said accessing means in said library management system comprise digital data tape recorders.

27. The system as set forth in claim 23 further comprising a matrix routing switcher coupled to said digital communications network.

28. The system as set forth in claim 27 wherein said matrix routing switcher is coupled to said plurality of production resources, said matrix routing switcher establishing a plurality of signals paths between said production resources.

29. An integrated multi-media production studio comprising:

a plurality of local area networks coupled to each other wherein each said local area network carries a plurality of addressed messages;

a plurality of production resources devices coupled to said local area networks, each of said plurality of production resources able to transmit and receive said plurality of addressed messages; and

a plurality of workstations coupled to said local area networks, each of said plurality of workstations able to transmit and receive said plurality of addressed messages wherein a user working on any said plurality of workstations may transmit and receive messages to any of said plurality of production resources coupled to said plurality of local area networks;

said plurality of workstations including a display system having a display and user input means, said display system comprising;

a user interface for display on said display, said user interface displaying representations of said production resources coupled to said digital communications network with which a user interacts using said user input means;

said representations of said production resources comprising at least three dimensions and being arranged in a venue of at least three dimensions, each of said dimensions corresponding to an attribute of said production resources which may be viewed using said user interface from a plurality of view ports, such that viewing said representations of said production resources from different view ports results in the display of different attributes of said production resources;

said representations of said production resources being arranged in said venue such that each of said production resources is disposed relative to one another in time and space within said venue;

manipulation means coupled to said user input means for selectively positioning said representations of said production resources within said venue.

30. The system as set forth in claim 29 wherein each of said plurality of production resources are coupled to said local area network local area networks through a device translator.

31. The system as set forth in claim 30 wherein said device translator comprises:

a network interface coupled to said local area networks such that said device translator transmits and receives said plurality of addressed messages over said local area networks;

a central processing unit coupled to said network interface, said central processing unit programmed such that the plurality of addressed messages received over said local area networks are translated into a plurality of device-specific commands; and

a device-specific interface coupled to said central processing unit and coupled to said production resource associated with said device translator, wherein said device translator communicates said plurality of device-specific commands to said production resource;

wherein said device translator translates said received plurality of addressed messages into said plurality of device specific commands.

32. The system as set forth in claim 31 wherein said device translator includes a programmable translation data set stored in a memory means coupled to said central processing unit such that said device translator can be programmed to translate said plurality of addressed messages into a plurality of device-specific commands for a plurality of different production resources.

33. The system as set forth in claim 32 wherein said programmable translation data set is downloaded into said memory means in said device translator through said digital communications network.

34. A method for accessing and editing a set of multi-media elements in a distributed computing environment, said method comprising the steps of:

providing a digital communications network coupled to a plurality of multi-media production resources having defined attributes and a plurality of edit workstations each of said workstations including a central processing unit (CPU) coupled to a display and user input means, one of said edit workstations executing a database server process and an allocation and routing process;

commencing an edit session on an edit workstation by requesting a set of multi-media elements and production resources using a client process running on said edit workstation;

extracting said set of multi-media elements from a multi-media element database using said database server process;

providing said set of multi-media elements from said database server process to said client process;

allocating production resources from a production resource allocation and routing database using said allocation and routing process;

providing said allocated production resources from said allocation and routing process to said client process;

editing said multi-media elements using said client process on said edit workstation including the steps of;

providing a user interface on said screen of said display for displaying representations of said production resources coupled to said display system with which a user interacts through said user input means;

generating and displaying a control frame on said display using interface generation means coupled to said CPU, said control frame including a plurality of command options which may be selected by said user using said input means, and further including an event horizon bar, such that the placement of a representation of a resource on said bar using said user input means results in predetermined data being displayed in said control frame, and said representations of said resources being disposed relative to one another in time;

said representations of said production resources comprising at least three dimensions and being arranged in a venue comprising at least three dimensions which may be viewed using said user interface from a plurality of view ports, such that viewing said representations of said resources from different view ports results in the display on said screen of different attributes of said resources;

completing said edit session by returning multi-media elements to said database server and returning said allocated production resources to said allocation and routing process;

updating said multi-media element database and said production resource allocation and routing database.