Dynamic audio buffer creation

• US 7,386,356 B2
• Filed: 03/05/2002
• Issued: 06/10/2008
• Est. Priority Date: 03/05/2001
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Schmidt, Brian L., Geist, James F. Jr., Porter, Dugan O., Fay, Todor J.
• Primary Examiner(s): Tran; Sinh
• Assistant Examiner(s): Flanders; Andrew C
• Application Number:
  US10/093,099
• Publication Number:
  US 20020133249A1
• Time in Patent Office: 2,289 Days
• Field of Search: 700/94, 719/328, 719/321, 719/52, 719/53, 719/56, 719/310
• US Class Current: 700/94
• CPC Class Codes: G10H 1/0041 in coded form
• CPC Class Codes: G10H 1/0091 Means for obtaining special acoustic effects combined with modulation G10H1/043
• CPC Class Codes: G10H 2210/235 Flanging or phasing effects, i.e. creating time and frequency dependent constructive and destructive interferences, obtained, e.g. by using swept comb filters or a feedback loop around all-pass filters with gradually changing non-linear phase response or delays
• CPC Class Codes: G10H 2210/291 Reverberator using both direct, i.e. dry, and indirect, i.e. wet, signals or waveforms, indirect signals having sustained one or more virtual reflections
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios
• CPC Class Codes: H04S 1/007 in which the audio signals are in digital form data reduction aspects thereof based on psychoacoustics G10L19/02

Abstract

An audio generation system includes a buffer manager that creates audio buffers to receive streams of audio data from an audio data source, such as from a synthesizer component for example. The audio buffers include sink-in audio buffers that receive one or more streams of audio data when the streams of audio data are requested by the buffer manager for input to the sink-in audio buffers. The audio buffers also include mix-in audio buffers that receive streams of audio data from one or more of the sink-in audio buffers, and from any number of other mix-in audio buffers. The audio generation system includes an audio component, such as a speaker for example, that receives audio data from the sink-in audio buffers and produces an audio rendition corresponding to the audio data.

Claims

1. An audio generation system, comprising:

an audio rendition manager corresponding to an audio rendition generated from audio data, the audio rendition manager including a synthesizer component, audio buffers, and logical buses that each correspond to one of the audio buffers;

a buffer manager configured to create the audio buffers that receive one or more streams of the audio data generated by the synthesizer component, where each of stream of audio data is assigned to one or more of the logical buses that receive the audio data from the synthesizer component such that the audio data steams assigned to a particular logical bus are routed to an audio buffer that corresponds to the particular logical bus;

a sink-in audio buffer created by the buffer manager and configured to receive a steam of the audio data, the buffer manager further configured to request the steam of audio data from a corresponding logical bus for input to the sink-in audio buffer; and

an audio component configured to receive modified audio data from the sink-in audio buffer and produce the audio rendition corresponding to the modified audio data.

2. An audio generation system as recited in claim 1, further comprising a mix-in audio buffer created by the buffer manager and configured to:

receive streams of audio data from one or more sink-in audio buffers;

generate a stream of combined audio data that includes the streams of audio data received from the one or more sink-in audio buffers; and

communicate the stream of combined audio data to the audio component to produce an audio rendition conesponding to the stream of combined audio data.

3. An audio generation system as recited in claim 1, wherein the sink-in audio buffer is instantiated as a programming object having an interface that is callable by a software component.

4. An audio generation system as recited in claim 1, wherein the sink-in audio buffer is instantiated as a programming object having an interface that is callable by a multimedia application to receive the stream of audio data.

5. An audio generation system as recited in claim 1, wherein the sink-in audio buffer is further configured to receive at least a second stream of the audio data, the buffer manager further configured to request the second stream of audio data from a corresponding logical bus for input to the sink-in audio buffer.

6. An audio generation system as recited in claim 1, further comprising a mix-in audio buffer created by the buffer manager and configured to:

receive streams of audio data from one or more sink-in audio buffers which are created by the buffer manager after the mix-in audio buffer is created;

generate a stream of combined audio data that includes the streams of audio data received from the one or more sink-in audio buffers; and

communicate the stream of combined audio data to the audio component to produce an audio rendition corresponding to the stream of combined audio data.

7. An audio generation system as recited in claim 1, further comprising a mix-in audio buffer created by the buffer manager and configured to:

receive streams of audio data from one or more sink-in audio buffers which are created by the buffer manager after the mix-in audio buffer is created;

generate a stream of combined audio data that includes the streams of audio data received from the one or more sink-in audio buffers; and

wherein the buffer manager deactivates the one or more sink-in audio buffers before the mix-in audio buffer is deactivated.

8. An audio generation system as recited in claim 1, further comprising:

at least a second sink-in audio buffer created by the buffer manager and configured to receive a second stream of the audio data, the buffer manager further configured to request the second stream of audio data from a corresponding logical bus for input to the second sink-in audio buffer; and

a mix-in audio buffer created by the buffer manager and configured to;

generate a stream of combined audio data that includes audio data received from the sink-in audio buffer, and that includes audio data received from the second sink-in audio buffer; and

communicate the stream of combined audio data to the audio component to produce an audio rendition corresponding to the stream of combined audio data.

9. An audio generation system as recited in claim 1, wherein the audio rendition manager is a programming object having an interface that is callable by a software component to generate the audio data.

10. An audio generation system as recited in claim 1, wherein the synthesizer component is instantiated as a programming object having an interface that is callable by a multimedia application to generate the audio data.

11. An audio generation system as recited in claim 1, wherein the synthesizer component is instantiated as a programming object having an interface that is callable by a multimedia application to generate the audio data in response to MIDI instructions.

12. An audio generation system as recited in claim 1, wherein the buffer manager is a programming object having an interface that is callable by a software component to create the audio buffers.

13. An audio generation system as recited in claim 1, wherein the buffer manager is a programming object having an interface that is callable by a multimedia application to create the audio buffers.

14. An audio generation system as recited in claim 1, further comprising a software component that defines the one or more logical buses corresponding to the sink-in audio buffer.

15. An audio generation system as recited in claim 1, further comprising a performance manager that includes at least one audio segment having audio content components that are each configured to generate audio instructions;

and wherein the audio rendition manager includes the synthesizer component configured to process the audio instructions to generate the audio data.

16. An audio generation system as recited in claim 1, further comprising a performance manager that includes at least one audio segment having audio content components that are each configured to generate MIDI instructions;

and wherein the audio rendition manager includes the synthesizer component configured to process the MIDI instructions to generate the audio data.

17. An audio generation system, comprising:

an audio rendition manager corresponding to an audio rendition generated from audio data, the audio rendition manager including a synthesizer component, audio buffers, and logical buses that each correspond to one of the audio buffers;

sink-in audio buffers each configured to receive one or more streams of audio data generated by the synthesizer component, where each stream of audio data is assigned to one or more of the logical buses that receive the audio data from the synthesizer component such that the audio data streams assigned to a particular logical bus are routed to a sink-in audio buffer that corresponds to the particular logical bus; and

a mix-in audio buffer configured to receive the audio data from one or more of the sink-in audio buffers, the mix-in audio buffer further configured to generate a stream of combined audio data that includes the audio data received from the one or more sink-in audio buffers.

18. An audio generation system as recited in claim 17, further comprising an audio component configured to receive the stream of combined audio data from the mix-in audio buffer and produce an audio rendition corresponding to the stream of combined audio data.

19. An audio generation system as recited in claim 17, further comprising at least a second mix-in audio buffer configured to generate a second stream of combined audio data that includes the stream of combined audio data received from the mix-in audio buffer, and that includes one or more streams of audio data received from one or more of the sink-in audio buffers.

20. An audio generation system as recited in claim 17, further comprising a buffer manager configured to create the mix-in audio buffer and the sink-in audio buffers.

21. An audio generation system as recited in claim 17, further comprising a buffer manager configured to create the mix-in audio buffer and the sink-in audio buffers, the buffer manager further configured to request the one or more streams of audio data from the corresponding logical buses for input to each of the one or more sink-in audio buffers.

22. An audio generation system as recited in claim 17, further comprising a buffer manager configured to create the sink-in audio buffers and the mix-in audio buffer, the mix-in audio buffer being created before the one or more sink-in audio buffers are created to input the audio data into the mix-in audio buffer.

23. An audio generation system as recited in claim 17, further comprising a buffer manager configured to:

create the sink-in audio buffers and the mix-in audio buffer, the mix-in audio buffer being created before the one or more sink-in audio buffers are created to input the audio data into the mix-in audio buffer; and

deactivate the one or more sink-in audio buffers before the mix-in audio buffer is deactivated.

24. An audio generation system as recited in claim 17, further comprising a buffer manager configured to:

implement resources to create the sink-in audio buffers and the mix-in audio buffer, the mix-in audio buffer being created before the one or more sink-in audio buffers are created to input the audio data into the mix-in audio buffer; and

release the resources implemented to create the one or more sink-in audio buffers before the resources implemented to create the mix-in audio buffer are released.

25. An audio generation system as recited in claim 17, further comprising a buffer manager instantiated as a programming object having an interface that is callable by a software component, the buffer manager configured to:

instantiate the mix-in audio buffer as a programming object having an interface that is callable by the software component; and

instantiate each of the sink-in audio buffers as a programming object having an interface that is callable by the software component.

26. An audio generation system as recited in claim 17, further comprising a buffer manager instantiated as a programming object having an interface that is callable by a multimedia application, the buffer manager configured to:

instantiate the mix-in audio buffer as a programming object in response to a request from the multimedia application to communicate a stream of audio data from the sink-in audio buffer to the mix-in audio buffer; and

instantiate a sink-in audio buffer as a programming object in response to a request from the multimedia application to communicate a stream of audio data from a corresponding logical bus to the sink-in audio buffer.

27. An audio generation system as recited in claim 17, further comprising a buffer manager instantiated as a programming object having an interface that is callable by a multimedia application, the buffer manager configured to:

instantiate the mix-in audio buffer as a programming object in response to a request from the multimedia application to communicate a stream of audio data from the sink-in audio buffer to the mix-in audio buffer;

instantiate a sink-in audio buffer as a programming object in response to a request from the multimedia application to communicate a stream of audio data from a corresponding logical bus to the sink-in audio buffer; and

request the stream of audio data from the corresponding logical bus for input to the sink-in audio buffer.

28. An audio generation system as recited in claim 17, further comprising a software component that defines the one or more logical buses corresponding respectively to one or more of the sink-in audio buffers.

29. An audio generation system as recited in claim 17, further comprising a software component that defines the logical buses corresponding to the sink-in audio buffers, each logical bus configured to receive the one or more streams of audio data from the synthesizer component and communicate the one or more streams of audio data to the corresponding sink-in audio buffer.

30. An audio generation system as recited in claim 17, further comprising a performance manager that includes at least one audio segment having one or more audio content components that are each configured to generate audio instructions;

and wherein the audio rendition manager includes the synthesizer component configured to process the audio instructions to generate the one or more streams of audio data.

31. An audio generation system as recited in claim 17, further comprising a performance manager that includes at least one audio segment having one or more audio content components that are each configured to generate MIDI instructions;

and wherein the audio rendition manager includes the synthesizer component configured to process the MIDI instructions to generate the one or more streams of audio data.

32. A method, comprising:

requesting multiple streams of audio data from audio rendition managers that each correspond to an audio rendition, an audio rendition manager including a synthesizer component, audio buffers, and logical buses that each correspond to one of the audio buffers;

defining sink-in audio buffers that each receive one or more of the multiple streams of audio data from the synthesizer component, where each stream of audio data is assigned to one or more of the logical buses that receive the audio data from the synthesizer component such that the audio data streams assigned to a particular logical bus are routed to a sink-in audio buffer that corresponds to the particular logical bus;

defining a mix-in audio buffer to receive one or more streams of audio data from one or more of the sink-in audio buffers; and

generating a stream of combined audio data that includes the one or more streams of audio data received from the one or more sink-in audio buffers.

33. A method as recited in claim 32, further comprising communicating the stream of combined audio data to an audio component that produces an audio rendition corresponding to the stream of combined audio data.

34. A method as recited in claim 32, further comprising generating the multiple streams of audio data when receiving audio instructions.

35. A method as recited in claim 32, further comprising generating the multiple streams of audio data when receiving synthesizer MIDI instructions.

36. A method as recited in claim 32, wherein defining the sink-in audio buffers comprises instantiating each sink-in audio buffer as a programming object having an interface that is callable to route the one or more multiple steams of audio data.

37. A method as recited in claim 32, wherein defining the mix-in audio buffer comprises instantiating the mix-in audio buffer as a programming object having an interface that is callable to route the one or more streams of audio data received from the one or more sink-in audio buffers.

38. A method as recited in claim 32, wherein defining the sink-in audio buffers comprises reserving computing system resources to implement each sink-in audio buffer to receive the one or more multiple streams of audio data.

39. A method as recited in claim 32, wherein defining the mix-in audio buffer comprises reserving computing system resources to implement the mix-in audio buffer to receive the one or more steams of audio data received from the one or more sink-in audio buffers.

40. A method as recited in claim 32, wherein the mix-in audio buffer is defined before the one or more sink-in audio buffers are defined.

41. A method as recited in claim 32, wherein defining the mix-in audio buffer comprises reserving computing system resources to impitment the mix-in audio buffer before defining the sink-in audio buffers which comprises reserving computing system resources to implement each sink in audio buffer.

42. A method as recited in claim 32, wherein defining the mix-in audio buffer comprises reserving computing system resources to implement the mix-in audio buffer before defining the sink-in audio buffers which comprises reserving computing system resources to implement each sink-in audio buffer, and the method further comprising:

releasing the computing system resources that implement the sink-in audio buffers before releasing the computing resources that implement the mix-in audio buffer.

43. A method as recited in claim 32, further comprising defining a second mix-in audio buffer to receive the stream of combined audio data from the mix-in audio buffer, and to receive one or more streams of audio data from one or more of the sink-in audio buffers.

44. A method as recited in claim 32, further comprising:

defining a second mix-in audio buffer to receive the stream of combined audio data from the mix-in audio buffer, and to receive one or more streams of audio data from one or more of the sink-in audio buffers;

generating a second stream of combined audio data that includes the stream of combined audio data, and includes the one or more streams of audio data; and

communicating the second stream of combined audio data to an audio component that produces an audio rendition corresponding to the second stream of combined audio data.

45. A method as recited in claim 32, further comprising:

defining a performance manager to generate audio instructions; and

defining an audio rendition manager to process the audio instructions and generate the multiple streams of audio data.

46. A method as recited in claim 32, further comprising:

defining a performance manager having an audio segment with one or more audio content components, the one or more audio content components generating audio instructions; and

defining the audio rendition manager having the synthesizer component to process the audio instructions to generate the multiple streams of audio data.

47. One or more computer-readable storage media encoded with computer-executable instructions that, when executed, direct a computing system to perform the method of claim 32.

48. One or more computer-readable storage media encoded with computer executable instructions that, when executed, direct a computing system to:

generate audio data with a synthesizer component when receiving audio instructions, an audio rendition manager including the synthesizer component, audio buffers, and logical buses that each correspond to one of the audio buffers;

instantiate a sink-in audio buffer as a programming object having an interface that is callable by a software component, the sink-in audio buffer receiving audio data from the synthesizer component where streams of the audio data are assigned to one or more of the logical buses that receive the audio data from the synthesizer component such that the audio data streams assigned to a particular logical bus are routed to the sink-in audio buffer that corresponds to the particular logical bus;

stream the audio data to the sink-in audio buffer when the audio data is requested for input by the software component; and

communicate the audio data to an audio component that produces an audio rendition corresponding to the audio data.

49. One or more computer-readable storage media as recited in claim 48, further encoded with computer executable instructions that, when executed, direct the computing system to instantiate a mix-in audio buffer as a programming object having an interface that is callable by the software component, the mix-in audio buffer generating a stream of combined audio data that includes audio data received from one or more sink-in audio buffers.

50. One or more computer-readable storage media as recited in claim 48, further encoded with computer executable instructions that, when executed, direct the computing system to:

instantiate a mix-in audio buffer as a programming object having an interface that is callable by the software component the mix-in audio buffer generating a stream of combined audio data that includes audio data received from one or more sink-in audio buffers; and

communicate the stream of combined audio data to the audio component that produces an audio rendition corresponding to the stream of combined audio data.

51. One or more computer-readable storage media as recited in claim 48, further encoded with computer executable instructions that, when executed, direct the computing system to:

instantiate a performance manager having an audio segment with one or more audio content components, the one or more audio content components generating audio instructions; and

instantiate the audio rendition manager that includes the synthesizer component to process the audio instructions to generate the audio data.