Systems for negotiating buffer size and attribute characteristics in media processing systems that create user-defined development projects

• US 20050149943A1
• Filed: 01/19/2005
• Published: 07/07/2005
• Est. Priority Date: 12/06/2000
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Rudolph, Eric H., Miller, Daniel J.
• Granted Patent: US 7,080,380 B2
• Time in Patent Office: Days
• US Class Current: 719/310
• CPC Class Codes: G06F 9/544 Buffers; Shared memory; Pipes

Abstract

In one embodiment, a system receives an indication to generate a filter graph representing a user-defined development project. Media sources that are to be used in the user-defined development project are identified and a programming grid is establishing that incorporates a user'"'"'s editing instructions. A matrix switch filter is generated based, at least in part, on the programming grid. The filter graph is assembled and comprises a plurality of individual filters. Buffer size and attribute characteristics are negotiated between an input/output of the matrix switch filter and an input/output of adjacent filters. Negotiated buffers are utilized to communicate media content between the matrix switch filter and adjacent filters by sharing a common buffer between inputs and outputs.

Claims

1. A computing device comprising:

one or more processors;

one or more computer-readable media;

computer-readable instructions embodied on the one or more computer-readable media which, when executed by the one or more processors, implement a method comprising;

receiving an indication to generate a filter graph representing a user-defined development project;

identifying media sources that are to be used in the user-defined development project;

based, at least in part, on the identified media sources, exposing sources, transform filters and rendering filters configured for use in the user-defined development project;

establishing a programming grid that incorporates a user'"'"'s editing instructions;

generating a matrix switch filter based, at least in part, on the programming grid, wherein the programming grid identifies which matrix switch filter inputs are to be coupled to which matrix switch filter outputs at particular project times;

assembling the filter graph representing the user-defined development project, wherein the filter graph comprises a plurality of individual filters including said matrix switch filter, transform filters and rendering filters; and

instructing filters of the filter graph to negotiate buffer size and attribute characteristics between adjacent filters, wherein negotiated buffers are utilized to communicate media content between the matrix switch filter and adjacent filters by sharing a common buffer between inputs and outputs.

2. The computing device of claim 1, wherein the method further comprises:

modifying input/output associations between filters of the development project based at least in part on the negotiation.

3. The computing device of claim 2, wherein input/output associations are communicative connections through one or more buffers.

4. The computing device of claim 1, wherein the act of assembling comprises providing a separate buffer for each input and output of each filter within the project, and wherein the method further comprises after and responsive to said act of negotiating, replacing at least a pair of separate adjacent buffers with a single buffer shared therebetween.

5. The computing device of claim 1, wherein the method further comprises attempting, with the matrix switch filter, to be an allocator for buffers shared with each of its input(s) and output(s).

6. The computing device of claim 5, wherein the method further comprises, in an event the matrix switch filter cannot be an allocator for one or more of its input(s) or output(s), not sharing a common buffer between such input(s) and output(s) and filters coupled thereto.

7. The computing device of claim 6, wherein the method further comprises using memory copy operations to communicate information from the matrix switch filter to a downstream filter in an event the matrix switch filter cannot be an allocator for a matrix switch filter output associated with said downstream filter.

8. A computing device comprising:

one or more processors;

one or more computer-readable media;

computer-readable instructions embodied on the one or more computer-readable media which, when executed by the one or more processors, implement a method comprising;

providing one or more processing chains that can be utilized to implement a user-defined development project, wherein individual processing chains comprise a plurality of filters, individual filters comprising one of at least a source filter, a transform filter or a render filter;

providing a matrix switch, coupled to the one or more processing chains, to recursively pass content received from the one or more processing chains through one or more filters to implement the development project; and

negotiating, with the matrix switch, buffer size and attributes between the matrix switch and adjacent filters, wherein the negotiated buffers are utilized to communicate media content between the matrix switch and adjacent filters without requiring a buffer copy operation.

9. The computing device of claim 8, wherein each of the filters comprising the one or more processing chains attempts to negotiate buffer size and attribute characteristics in order to facilitate a shared buffer for communicating information between the filters of the processing chain.

10. The computing device of claim 9, wherein the filters establish shared buffers between an input of one filter and the output of an upstream filter upon negotiating mutually acceptable buffer size and attribute characteristics.

11. The computing device of claim 8, wherein the method further comprises establishing the development project using a render engine that is exposed from an operating system executing on a computing system implementing the development system.

12. The computing device of claim 11, wherein the method further comprises:

using the render engine to facilitate negotiation between filters of the processing chains for buffer size and attribute requirements, and

using the render engine to establish a shared buffer for communicating content between filters when an agreement as to the requirements is achieved.

13. The computing device of claim 8, wherein the method further comprises using the matrix switch to negotiate to be an allocator of buffers between the matrix switch and any filter coupled to its input and output to facilitate communication between the matrix switch and external filters as well as between its input(s) and output(s), without the need for a memory copy operation.

14. The computing device of claim 13, wherein the method further comprises, in an event the matrix switch is not able to be an allocator of a buffer for an output of the matrix switch, using a memory copy operation to communicate with a downstream filter associated with that matrix switch output.

15. A computing device comprising:

one or more processors;

one or more computer-readable media;

computer-readable instructions embodied on the one or more computer-readable media which, when executed by the one or more processors, implement a method comprising;

providing a matrix switch object;

providing a dynamically determined number of matrix switch object inputs to receive content from one or more processing chains;

providing a dynamically determined number of matrix switch object outputs;

selectively coupling one or more of the dynamically determined inputs to one or more of the dynamically determined outputs; and

negotiating, using the matrix switch object, with filters coupled to each of the dynamically determined inputs and outputs for buffer size and attribute requirements to facilitate communication between filters and within the matrix switch object using a shared buffer of agreed upon size and attribute characteristics.

16. The computing device of claim 15, wherein the method further comprises, in an event the matrix switch object cannot negotiate an agreed upon buffer size and attribute characteristics between an input/output and a filter coupled to the input/output, communicating with the input/output using a memory copy operation.

17. The computing device of claim 16, wherein the method further comprises, in an event an input/output coupling the filter to the input/output of the matrix switch object each have an independent buffer, communicating between the filter and the matrix switch object by copying content from one buffer to another buffer.

18. The computing device of claim 15, wherein the method further comprises communicating between the input/output of the matrix switch object and any other input/output, internal or external to the matrix switch object, using a memory copy operation.

19. The computing device of claim 16, wherein the method further comprises, in an event an input/output of the matrix switch object and an input/output of a filter coupled to the input/output of the matrix switch object do agree upon buffer size and attribute requirements, communicating between the filter and the matrix switch object through a shared buffer coupling the input/output of the filter to the input/output of the matrix switch object.

20. The computing device of claim 19, wherein the method further comprises communicating between the input/output of the matrix switch object and a second input/output of the matrix switch object through a shared buffer, unless the second input/output does not adhere to the agreed upon buffer size and attribute requirements.