Editing time-based media with enhanced content

• US 7,930,624 B2
• Filed: 04/04/2002
• Issued: 04/19/2011
• Est. Priority Date: 04/20/2001
• Status: Active Grant

• Current Assignee: Avid Technology Incorporated
• Original Assignee: Avid Technology Incorporated
• Inventors: Cooper, Brian, Fay, Larisa, Phillips, Michael
• Primary Examiner(s): Rutledge; Amelia
• Application Number:
  US10/115,693
• Publication Number:
  US 20030018609A1
• Time in Patent Office: 3,302 Days
• Field of Search: 715/500.1, 715/201, 725/110
• US Class Current: 715/201
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Creation of a program with interactive content and time-based media would be improved by having several people working simultaneously on both the interactive content and the time-based media. The range of types of data that can be associated with the time-based media also can include a variety of types of content that enhance the time-based media, including data that is opaque to the editing system. To support editing of such programs, enhanced content may be edited into a program as either a clip or a locator, according to a user'"'"'s selection. The components that represent enhanced content also may be edited in the same way as components that represent time-based media. Enhanced content may be represented by enhancement files that include data defining enhancements. An enhancement includes an identifier of the enhancement within the enhancement file, and a reference to a file defining enhanced content associated with the enhancement. Such enhancement files may be imported into a bin of an editing system to create components that describe the enhanced content referenced by the enhancements. The enhanced content may be modified using native applications for the enhanced content during editing of the program. The components describing the enhanced content in the editing system can be updated using identifiers of the enhanced content that are stored by the components. Enhanced content also may be automatically synchronized with time-based media.

Claims

1. A method for generating a document in a markup language describing a program of time-based media and enhanced content, the program haying at least one track for enhanced content which includes a plurality of components, and at least one track for time-based media, the method comprising:

(1) identifying each component that represents enhanced content and that is on the enhanced content track;

(2) for each identified component representing enhanced content, creating;

(a) a first element in the markup language document specifying the enhanced content represented by the component; and

(b) a second element in the markup language document specifying a temporal position at the enhanced content represented by the component is placed in the program on the enhanced content track, wherein the second element comprises;

(1) a start position of the component on the enhanced content track, thereby indicating the temporal position in the program where the enhanced content is to be placed;

(2) a reference to the first element in the markup language document, thereby indicating the enhanced content to be placed in the program at the start position; and

(3) if the component is a source clip, then an end position of the component on the enhanced content track.

2. The method of claim 1, wherein the start position is specified in a plurality of time code formats.

3. The method of claim 2, wherein the reference to the first element in the markup language document comprises a child element of the second element containing the data defining an enhancement that describes the enhanced content represented by the component, and wherein, for each time format, the second element includes an additional child element containing data representing the location in the time format.

4. The method of claim 2, wherein the end position is specified in a plurality of time code formats.

5. The method of claim 4, wherein the plurality of time code formats includes 24 frames per second, 25 frames per second and 30 frames per second.

6. The method of claim 1, wherein the data defining the enhancement comprises:

one or more attributes, including;

an identifier of the enhancement within the enhancement file; and

a reference to a file defining the enhanced content associated with the enhancement.

7. The method of claim 6, wherein the one or more attributes further includes:

an identifier of a native application for processing the file defining the enhanced content.

8. The method of claim 7, wherein the one or more attributes further includes:

a type indicating a type of the enhancement.

9. The method of claim 8, wherein the one or more attributes further includes:

one or more custom attributes for the enhancement.

10. The method of claim 7, wherein the one or more attributes further includes:

one or more custom attributes for the enhancement.

11. The method of claim 6, wherein the one or more attributes further includes:

a type indicating a type of the enhancement.

12. The method of claim 11, wherein the one or more attributes further includes:

one or more custom attributes for the enhancement.

13. The method of claim 6, wherein the one or more attributes further includes:

one or more custom attributes for the enhancement.

14. The method of claim 1, further comprising:

identifying each of the at least one tracks for enhanced content;

for each identified track for enhanced content, creating an interactive timeline element in the markup language document comprising;

a reference to each element in the markup language document that describes a component representing enhanced content on the identified track for enhanced content.

15. The method of claim 1, wherein the reference to the first element in the markup language document comprises a child element of the second element containing the data defining an enhancement that describes the enhanced content represented by the component.

16. The method of claim 15, wherein the data defining the enhancement comprises a third markup language element, wherein the third markup language element is a child element of the first element and contains a first child element containing an identifier of the enhancement within the enhancement file, a second child element containing a reference to a file defining the enhanced content associated with the enhancement.

17. The method of claim 16, wherein the data defining the enhancement further comprises a third child element of the third markup language element containing an identifier of a native application for processing the file defining the enhanced content.

18. The method of claim 1, wherein the first element is not contained within the second element.

19. A computer program product, comprising:

a computer readable medium;

computer program instructions stored on the computer readable medium that, when executed by a computer, define an editing system for editing a program of time-based media and enhanced content wherein the program has at least one track for enhanced content which includes a plurality of components, and at least one track for time-based media, and instruct the computer to perform a method for generating a document in a markup language describing the at least one track for enhanced content, the method comprising;

(1) identifying each component that represents enhanced content and that is on the enhanced content track;

(2) for each identified component representing enhanced content, creating;

(a) a first element in the markup language document specifying the enhanced content represented by the component; and

(b) a second element in the markup language document specifying a temporal position of the enhanced content represented by the component is placed in the program on the enhanced content track, wherein the second element comprises;

(1) a start position of the component on the enhanced content track, thereby indicating the temporal position in the program where the enhanced content is to be placed;

(2) a reference to the first element in the markup language document, thereby indicating the enhanced content to be placed in the program at the start position; and

(3) if the component is a source clip, then an end position of the component on the enhanced content track.

20. The computer program product of claim 19, wherein the reference to the first element in the markup language document comprises a child element of the second element containing the data defining an enhancement that describes the enhanced content represented by the component.

21. The computer program product of claim 20, wherein the start position is specified in a plurality of time code formats, and wherein, for each time format, the second element includes an additional child element containing data representing the location in the time format.

22. The computer program product of claim 20, wherein the data defining the enhancement comprises a third markup language element, wherein the third markup language element is a child element of the first element and contains a first child element containing an identifier of the enhancement within the enhancement file, a second child element containing a reference to a file defining the enhanced content associated with the enhancement.

23. The computer program product of claim 22, wherein the data defining the enhancement further comprises a third child element of the third markup language element containing an identifier of a native application for processing the file defining the enhanced content.

24. The computer program product of claim 19, wherein the first element is not contained within the second element.

25. An computer-implemented editing system for editing a time-based program of time-based media and enhanced content, comprising:

a processor that processes a computer program so as to provide a timeline interface having at least one track for enhanced content and at least one track for time-based media; and

wherein the processor is further configured to generate a document in a markup language describing the at least one track for enhanced content, by identifying each component that represents enhanced content and that is on the enhanced content track; and

by creating, for each identified component representing enhanced content;

(a) a first element in the markup language document specifying the enhanced content represented by the component; and

(b) a second element in the markup language document specifying a temporal position of the enhanced content represented by the component is laced in the program on the enhanced content track, wherein the second element comprises;

(1) a start position of the component on the enhanced content track, thereby indicating the temporal position in the program where the enhanced content is to be placed;

(2) a reference to the first element in the markup language document, thereby indicating the enhanced content to be placed in the program at the start position; and

(3) if the component is a source clip, then an end position of the component on the enhanced content track.

26. The computer-implemented editing system of claim 25, wherein the reference to the first element in the markup language document comprises a child element of the second element containing the data defining an enhancement that describes the enhanced content represented by the component.

27. The computer-implemented editing system of claim 26, wherein the start position is specified in a plurality of time code formats, and wherein, for each time format, the second element includes an additional child element containing data representing the location in the time format.

28. The computer-implemented editing system of claim 26, wherein the data defining the enhancement comprises a third markup language element, wherein the third markup language element is a child element of the first element and contains a first child element containing an identifier of the enhancement within the enhancement file, a second child element containing a reference to a file defining the enhanced content associated with the enhancement.

29. The computer-implemented editing system of claim 28, wherein the data defining the enhancement further comprises a third child element of the third markup language element containing an identifier of a native application for processing the file defining the enhanced content.

30. The computer-implemented editing system of claim 25, wherein the first element is not contained within the second element.