Non-timeline, non-linear digital multimedia composition method and system

• US 6,204,840 B1
• Filed: 04/08/1998
• Issued: 03/20/2001
• Est. Priority Date: 04/08/1997
• Status: Expired due to Term

• Current Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Original Assignee: MGI Software Corporation (MelodyVR Group Plc)
• Inventors: Page, Alan, Maruvada, Prasad, Zhai, Yongjian, Petelycky, Ihor, Harris, Michael, Northmore, Scott, Elliot, Graeme, Staheli, Daniel, Smith, Jeff
• Primary Examiner(s): Feild, Joseph H.
• Application Number:
  US09/057,223
• Time in Patent Office: 1,077 Days
• Field of Search: 345/302, 345/418, 345/433, 345/434, 345/328, 707/501
• US Class Current: 715/202
• CPC Class Codes: G11B 2220/41 Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs

Abstract

A method for digital multimedia composition including selecting multimedia data segments, arranging the selected multimedia data segments on a single storyline strip, inserting transitions between adjacent multimedia data segments on the storyline strip, and combining the selected multimedia data segments based on their arrangement on the storyline strip and based on the inserted transitions, to produce a multimedia output file from the storyline strip. A system is also described and claimed.

Claims

1. A method for non-timeline, non-linear digital multimedia composition comprising:

representing multimedia materials stored in memory as objects;

retrieving one or more of said multimedia materials from said memory for display on a composition console;

dynamically viewing and editing said one or more multimedia materials on said composition console;

placing the objects representing said one or more multimedia materials on a non-frame based storyline strip of said composition console to create a storyline that is viewable on said composition console, said storyline strip including object viewing and object transition positions; and

producing a multimedia output file from objects and transitions on said storyline.

2. The method of claim 1 further comprising editing said storyline.

3. The method of claim 2 wherein said editing said storyline includes reorganizing objects thereon and dynamically viewing and editing said objects on said composition console.

4. The method of claim 3 wherein said multimedia materials includes image, video, audio, and text materials.

5. A system for non-timeline, non-linear digital multimedia composition, the system comprising:

means for representing multimedia materials stored in memory as objects;

means for retrieving one or more of said multimedia materials from said memory for display on a composition console;

means for dynamically viewing and editing said one or more multimedia materials on said composition console;

means for placing the objects representing said one or more multimedia materials on a non-frame based storyline strip of said composition console to create a storyline that is viewable on said composition console, said storyline strip including object viewing and object transition positions; and

means for producing a multimedia output file from objects and transitions on said storyline.

6. The system of claim 5 further comprising means for editing said storyline.

7. The system of claim 6 wherein said means for editing said storyline includes means for reorganizing edited objects thereon and means for dynamically viewing and editing said edited objects on said composition console.

8. The system of claim 7 wherein said multimedia materials includes image, video, audio, and text materials.

9. A computer readable media encoded with a computer program for creating non-timeline, non-linear digital multimedia compositions from multimedia materials stored in memory and represented by objects comprising:

means for retrieving one or more of said multimedia materials from said memory for display on a composition console;

means for dynamically viewing and editing said one or more multimedia materials on said composition console;

means for placing the objects representing said one or more multimedia materials on a non-frame based storyline strip of said composition console to create a storyline that is viewable on said composition console, said storyline strip including object viewing and object transition positions; and

means for producing a multimedia output file from objects and transitions on said storyline.

10. A method for producing a multimedia composition comprising:

providing a user interface having a source material object window and a non-frame based storyline strip, said storyline strip having object viewing and object transition positions;

associating individual identifiers in said window with time varying dynamic multimedia source material objects;

choosing one of said identifiers in said window to retrieve a selected source material object;

dragging said chosen identifier across said interface to one of said object viewing positions on said storyline strip;

repeating said choosing and dragging to organize a multi-object multimedia composition in a desired order; and

generating a multimedia output file based on chosen identifiers and transitions organized on said storyline strip.

11. The method of claim 10 wherein said source material objects include video objects, audio objects and combined audio-visual objects.

12. The method of claim 10 further comprising moving said chosen identifier from a first object viewing position to a second object viewing position on said storyline strip to organize said composition.

13. The method of claim 10 wherein said multimedia output file is presented on an audio-visual display.

14. The method of claim 10 wherein said multimedia output file is stored in external memory.

15. The method of claim 10 wherein said multimedia output file is stored via a tape device.

16. The method of claim 10 wherein said source material objects are retrieved from a remote source.

17. A system for creating a multimedia composition from multimedia source material objects, the system comprising:

a user interface comprising;

a tool bar for accessing system functions;

a source library window for accessing multimedia source material objects;

a console for previewing and editing said multimedia source material objects to create output objects; and

a non-frame based storyline strip for assembling said output objects and transitions therebetween to form a multimedia output file, said storyline strip including object viewing and object transition positions;

a processor for editing said source material objects and creating said multimedia output file in response to user input entered via said user interface; and

a display for displaying said multimedia output file on said console.

18. The system of claim 17 wherein said processor is operable to output said multimedia output file to an output device.

19. The system of claim 17 wherein said output device is a memory storage medium.

20. The system of claim 17 wherein said console includes a preview area, and a plurality of editing tool activators corresponding to a plurality of editing tools selectable to edit said multimedia source material objects.

21. The system of claim 20 wherein the activation of a selected one of said editing tool activators causes said console to display the controls of said corresponding editing tool.

22. The system of claim 17 wherein said tool bar includes a plurality of two dimensional iconic activators, said iconic activators transforming into three dimensional activators in response to movement of a pointing device in close proximity.

23. The system of claim 17 wherein said tool bar contains a plurality of two dimensional activators, said activators being conditioned to exhibit three dimensional rotation when activated to signal that the operation corresponding to said activator has been initialized.

24. A system for producing a multimedia composition, the system comprising:

means for generating a user interface having a source material object window and a non-frame based storyline strip, said storyline strip having object viewing and object transition positions;

means for associating individual identifiers in said window with time varying dynamic multimedia source material objects;

means for choosing one of said identifiers in said window to retrieve a selected object;

means for placing said chosen identifier at one of said object viewing positions on said storyline strip to organize a multi-object, multimedia composition in a desired order; and

means for generating a multimedia output file based on chosen identifiers and transitions organized on said storyline strip.

25. The system of claim 24 wherein said source material objects include video objects, audio objects and combined audio-visual objects.

26. The system of claim 24 wherein said means for organizing includes means for moving said chosen identifier from a first object viewing position to a second object viewing position on said storyline strip to organize said composition.

27. A computer readable media encoded with a computer program for producing a multimedia composition from multimedia materials stored in memory as source material objects comprising:

means for generating a user interface having a source material object window and a non-frame based storyline strip, said storyline strip having object viewing and object transition positions;

means for associating individual identifiers in said window with time varying dynamic multimedia source material objects;

means for choosing one of said identifiers in said window to retrieve a selected source material object from memory;

means for placement of one or more chosen identifiers at selected positions on said storyline strip to organize a multi-object, multimedia composition in a desired order; and

means for generating a multimedia output file based on chosen identifiers and transitions organized on said storyline strip.

28. A method for digital multimedia composition comprising:

selecting multimedia data segments;

arranging the selected multimedia data segments on a single non-frame based storyline strip;

inserting transitions between adjacent multimedia data segments on the storyline strip; and

combining the selected multimedia data segments based on their arrangement on the storyline strip and based on the inserted transitions, to produce a multimedia output file from the storyline strip.

29. The method of claim 28 wherein during said selecting multimedia data segments are selected from the group consisting of audio, video, image and text.

30. The method of claim 28 further comprising editing at least one of the selected multimedia data segments.

31. The method of claim 28 wherein said arranging comprises synchronizing selected multimedia data segments.

32. The method of claim 28 wherein the multimedia output file is an AVI file.

33. The method of claim 28 wherein the multimedia output file is an MPEG file.

34. A digital multimedia composition system comprising:

a user interface for selecting multimedia data segments, for arranging the selected multimedia data segments on a single non-frame based storyline strip, and for inserting transitions between adjacent multimedia data segments on the storyline strip; and

a processor combining the selected multimedia data segments based on their arrangement on the storyline strip and based on the inserted transitions, to produce a multimedia output file from the storyline strip.

35. The digital multimedia composition system of claim 34 wherein the multimedia data segments are selected from the group consisting of audio, video, image and text.

36. The digital multimedia composition system of claim 34 further comprising a multimedia editor for editing at least one of the selected multimedia data segments.

37. The digital multimedia composition system of claim 34 wherein the user interface is used for synchronizing selected multimedia data segments.

38. The digital multimedia composition system of claim 34 wherein the multimedia output file is an AVI file.

39. The digital multimedia composition system of claim 34 wherein the multimedia output file is an MPEG file.