Methods and systems for managing multiple inputs and methods and systems for processing media content

• US 7,260,310 B2
• Filed: 12/10/2004
• Issued: 08/21/2007
• Est. Priority Date: 12/06/2000
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Rudolph, Eric H., Miller, Daniel J.
• Primary Examiner(s): Chevalier; Robert
• Application Number:
  US11/009,599
• Publication Number:
  US 20050100316A1
• Time in Patent Office: 984 Days
• Field of Search: 386/52, 386/55, 386/46, 386/1, 386/4, 386/124, 386/125, 386/126, 386/105, 386/106, 386/104
• US Class Current: 386/278
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Methods and systems for managing multiple inputs that are capable of competing or contending for a particular or primary output are described. In one embodiment, the multiple inputs are managed through the use of a software-implemented matrix switch object, and an associated data structure that is used to program the switch object and resolve contention issues between the inputs. The matrix switch object can process the multiple inputs to provide a primary output. One implementation of the switch object uses virtual input and output pins to receive and provide data streams. One specific embodiment is used in connection with multi-media editing software that enables users build or define their own editing multi-media editing projects that incorporate multiple different user-selected clips, in the form of digital data streams, into an integrated project. Each clip can be defined in terms of one or more digital data streams, e.g. video and audio streams. One implementation method defines a first data structure that represents an editing project and processes the data structure to provide a second data structure that contains data that can be used to program the matrix switch object so that multiple switch inputs are routed to multiple switch outputs and contentions between the inputs for a primary output are resolved.

Claims

1. A multi-media editing method comprising:

defining a first data structure that represents a user-defined multi-media editing project;

providing a software-implemented matrix switch that is programmable to route multiple switch inputs to multiple switch outputs, at least two of the inputs being capable of competing for a single output during a common time period, the single output being configured to provide a data stream defined by the multi-media editing project;

processing the first data structure to provide a second data structure that contains data that can be used to program the matrix switch so that multiple switch inputs are routed to multiple switch outputs; and

operating on the second data structure so that no two inputs are routed to said single output during a common time period.

2. The multi-media editing method of claim 1, wherein said processing of the first data structure comprises configuring the matrix switch so that it receives at least one source stream at one of its inputs.

3. The multi-media editing method of claim 2, wherein said configuring comprises building a collection of associated objects operably associated with the matrix switch and that are configured to process digital data to provide a source stream at one or more of the inputs.

4. The multi-media editing method of claim 3, wherein at least some of the associated objects comprise filters.

5. The multi-media editing method of claim 1, wherein said processing of the first data structure comprises providing at least one object configured to receive at least one output stream from the matrix switch, process the output stream to provide an input stream, and provide the input stream to an input of the switch.

6. The multi-media editing method of claim 5, wherein said object comprises a transition object that is configured to transition between at least one source stream and at least one other source stream.

7. The multi-media editing method of claim 5, wherein said object comprises an effect object that is configured to operate on a source stream to produce a different source stream.

8. The multi-media editing method of claim 1, wherein said defining of the first data structure comprises defining a hierarchical tree structure.

9. The multi-media editing method of claim 8, wherein the hierarchical tree structure comprises nodes that represent tracks, each track being associated with one or more data stream sources.

10. The multi-media editing method of claim 9, wherein the data stream sources with which one or more of the tracks are associated comprise video data stream sources.

11. The multi-media editing method of claim 9, wherein the data stream sources with which one or more of the tracks are associated comprise audio data stream sources.

12. The multi-media editing method of claim 9, wherein the data stream sources with which one or more of the tracks are associated comprise both video and audio data stream sources.

13. The multi-media editing method of claim 1, wherein said processing of the first data structure to provide the second data structure comprises processing the first data structure to provide a grid structure,

the grid structure containing multiple rows, individual rows representing inputs of the matrix switch and being associated with individual data stream sources,

each row containing at least one value that is associated with an output associated with said single output of the matrix switch.

14. The multi-media editing method of claim 13, wherein said operating on the second data structure comprises changing at least one value in at least one of the rows of the grid structure.

15. The multi-media editing method of claim 1, wherein said processing of the first data structure comprises configuring the matrix switch so that it receives multiple source streams at multiple respective inputs at multiple times.

16. The multi-media editing method of claim 15, wherein said configuring comprises building one or more filter graphs that are individually configured to process digital data to provide multiple respective source streams, and associating one or more filter graphs with individual inputs of the matrix switch.

17. One or more computer-readable media having computer-readable instructions thereon which, when executed by a computer, implement the method of claim 1.

18. One or more computer-readable media having computer-readable instructions thereon which, when executed by a computer, cause the computer to:

represent a multi-media editing project as a first data structure;

process the first data structure to provide a second data structure containing data that defines an association between inputs, outputs and a time line defined by the editing project;

provide a matrix switch having multiple inputs and multiple outputs that correspond to the respective inputs and outputs of the second data structure; and

use the second data structure to program routing of the matrix switch'"'"'s inputs to the matrix switch'"'"'s outputs for the given time line.

19. The computer-readable media of claim 18, wherein the matrix switch has a single output that provides a data stream that represents the editing project.

20. The computer-readable media of claim 18, wherein the matrix switch has at least one feedback loop coupled between an output and an input.

21. The computer-readable media of claim 20, wherein the feedback loop contains a transition element having two or more inputs and a single output, the transition element being configured to transition between multiple data streams.

22. The computer-readable media of claim 20, wherein the feedback loop contains an effect element having an input and an output, the effect element being configured to operate on a first data stream to provide a second data stream that is different from the first data stream.

23. The computer-readable media of claim 18, wherein the first data structure comprises a tree structure.

24. The computer-readable media of claim 18, wherein the second data structure comprises a grid structure.

25. The computer-readable media of claim 24, wherein the instructions cause the computer to change one or more data values within the grid structure to ensure that no two switch inputs are routed to a primary switch output at any one time.

26. An input-managing system comprising:

a software-implemented matrix switch object configured to process multiple inputs and provide one or more outputs, one of the outputs comprising a primary output for which contention can take place between the multiple inputs; and

a data structure associated with the matrix switch object and configured for use in programming the matrix switch object to resolve contention issues between the multiple inputs.

27. A multimedia system comprising:

an application program configured to enable a user to define a multi-media project in which multiple digital source streams can be combined;

a software-implemented matrix switch having multiple input pins and multiple output pins, the input pins being individually associated with inputs that can compete, during a common time period, for a particular output pin that is associated with the matrix switch, the switch being configured to receive, at its input pins, digital source streams;

a first data structure associated with the matrix switch and configured for use in programming the matrix switch to provide a routing scheme for routing input pins to output pins such that at any given time, only one input pin is routed to the particular output pin; and

a second data structure associated with and different from the first data structure, the second data structure representing a user-defined multi-media project and being configured so that the first data structure can be derived therefrom.

28. The multi-media system of claim 27, wherein the first data structure comprises a grid structure.

29. The multi-media system of claim 27, wherein the second data structure comprises a tree structure.