Kernel-based digital audio mixer

• US 5,768,126 A
• Filed: 05/19/1995
• Issued: 06/16/1998
• Est. Priority Date: 05/19/1995
• Status: Expired due to Fees

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Frederick, Ronald A.
• Primary Examiner(s): Olms, Douglas W.
• Assistant Examiner(s): Patel, Ajit
• Application Number:
  US08/445,261
• Time in Patent Office: 1,124 Days
• Field of Search: 369/4, 369/3, 369/5, 369/2, 381/119, 381/58, 381/80, 381/81, 381/87, 381/88, 360/22, 360/24, 360/18, 364/514 R, 364/400.01
• US Class Current: 700/94
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 69/32 Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A system and method are disclosed for mixing multiple digital audio streams originating from or destined for multiple tasks in a computer system. In one aspect, a method is carried out in a computer system having a processor. The processor executes a multitasking operating system that has a kernel, executes a first task under control of the operating system, and while executing the first task executes a second task under control of the operating system. First and second audio streams are provided, each made up of a series of digital audio samples representing an audio signal and affiliated, respectively, with the first and second tasks. By executing a portion of the operating system kernel with the processor, the first and second audio streams are mixed to provide a mixed audio stream made up of a series of digital audio samples representing a superposition of the first and second audio signals.

Claims

1. In a computer system having a processor, a method comprising the steps of:

executing a multitasking operating system with the processor, the operating system having a kernel comprising kernel software;

executing a first task with the processor under control of the operating system;

while executing the first task, executing a second task with the processor under control of the operating system;

providing a first audio stream comprising a first series of digital audio samples representing a first audio signal, the first audio stream being affiliated with the first task;

while providing the first audio stream, providing a second audio stream comprising a second series of digital audio samples representing a second audio signal, the second audio stream being affiliated with the second task; and

by executing a portion of the kernel software with the processor, mixing the first and second audio streams to provide a mixed audio stream comprising a series of digital audio samples representing a superposition of the first and second audio signals.

2. The method of claim 1 further comprising the step of receiving a series of timing signals in the processor, and in which the mixing step is performed in response to received timing signals of the series.

3. The method of claim 1 in which the computer system further comprises an output device, and further comprising the step of coupling the mixed audio stream to the output device.

4. The method of claim 3 in which the output device comprises a digital-to-analog converter (DAC) and the coupling step comprises converting digital samples of the mixed audio stream to an analog signal with the digital-to-analog converter.

5. The method of claim 3 in which the output device comprises a data storage device and in which the coupling step comprises writing digital samples of the mixed audio stream as data to the data storage device.

6. The method of claim 3 in which the output device comprises a network and in which the coupling step comprises transmitting digital samples of the mixed audio stream across the network.

7. The method of claim 1 in which the computer system further comprises an input device, and further comprising the step of producing the first audio stream with the input device.

8. The method of claim 7 in which the input device comprises an analog-to-digital converter (ADC) and the producing step comprises converting an analog signal to the digital samples of the first audio stream with the analog-to-digital converter.

9. The method of claim 7 in which the input device comprises a data storage device and in which the producing step comprises reading digital samples of the first audio stream as data from the data storage device.

10. The method of claim 7 in which the input device comprises a network and in which the producing step comprises receiving digital samples of the first audio stream from across the network.

11. The method of claim 1 in which the computer system further comprises memory coupled to the processor, and further comprising the steps of:

establishing in the memory a first input queue;

establishing in the memory a second input queue;

by executing a portion of the kernel software with the processor, placing digital samples of the first audio stream into the first input queue; and

by executing a portion of the kernel software with the processor, placing digital samples of the second audio stream into the second input queue;

and in which the mixing step comprises retrieving samples of the first audio stream from the first input queue and retrieving samples of the second audio stream from the second input queue.

12. The method of claim 1 in which the computer system further comprises memory coupled to the processor, and further comprising the step of establishing in the memory an output queue, and in which the mixing step comprises placing samples of the mixed audio stream into the output queue.

13. In a computer system having a processor, a method comprising the steps of:

executing a multitasking operating system with the processor, the operating system having a kernel comprising kernel software, the operating system providing a audio device supporting a single audio stream;

executing a first task with the processor under control of the operating system;

while executing the first task, executing a second task with the processor under control of the operating system;

with the processor, requesting access from the first task to the audio device, the access requested from the first task being of a first access type;

with the processor, requesting access from the second task to the audio device, the access requested from the second task being of a second access type, the second access type including the first access type; and

by executing a portion of the kernel software with the processor, coupling the single audio stream of the audio device contemporaneously to the first and second tasks, the single audio stream being coupled to the first task according to the first access type, the single audio stream being coupled to the second task according to the second access type.

14. The method of claim 13 in which the first access type includes write access, and further comprising the steps of

producing a first audio stream with the first task, and

producing a second audio stream with the second task;

and in which the coupling step comprises mixing the first and second audio streams together to produce the single audio stream supported by the audio device.

15. The method of claim 13 in which the first access type includes read access and the coupling step comprises routing an input stream from the audio device to the first task and to the second task.

16. The method of claim 13 in which the operating system provides a mixing capability including a mixer, in which the first task is affiliated with a first audio stream and the second task is affiliated with a second audio stream, and in which the coupling step comprises:

coupling the single audio stream to the first audio stream via the mixer; and

coupling the single audio stream to the second audio stream via the mixer.

17. In a computer system having a processor, a method comprising the steps of:

executing a multitasking operating system with the processor, the operating system having a kernel, the kernel comprising kernel software, the kernel providing a mixing capability for mixing a plurality of component audio streams into a mixed audio stream, each of the component audio streams comprising a series of digital audio samples representing a component audio signal, the mixed audio stream comprising a series of digital audio samples representing a superposition of the component audio signals;

executing a task with the processor under control of the operating system, the task being affiliated with an audio stream comprising a series of digital audio samples representing an audio signal capable of being used as a component audio signal of the superposition;

establishing a connection between the audio stream affiliated with the task and the mixing capability of the kernel by designating the audio stream affiliated with the task as a component audio stream to be mixed into the mixed audio stream, the audio signal represented by the sample series of the audio stream so designated thus being used as a component audio signal of the superposition;

with the connection between the audio stream affiliated with the task and the mixing capability of the kernel thus established, executing a portion of the kernel software with the processor to effect the mixing capability and thus to mix the audio stream affiliated with the task into the mixed audio stream; and

with the audio stream affiliated with the task thus mixed into the mixed audio stream, providing the mixed audio stream as an output from the mixing capability.

18. The method of claim 17 and further comprising the steps of:

severing the connection between the audio stream affiliated with the task and the mixing capability of the kernel;

with the connection between the audio stream affiliated with the task and the mixing capability of the kernel thus severed, executing a portion of the kernel software with the processor to effect the mixing capability and thus to produce a mixed audio stream in which the audio stream affiliated with the task is not among the plurality of component audio streams; and

with the audio stream affiliated with the task thus not among the plurality of component audio streams of the mixed audio stream, providing the mixed audio stream as an output from the mixing capability.

19. The method of claim 17 in which the mixed audio stream has an overall amplitude, each component audio stream has a relative amplitude with respect to the overall amplitude, and the mixing capability includes a plurality of level controls to adjust amplitudes of the component audio streams relative to the overall amplitude, and further comprising the steps of:

with the connection between the audio stream affiliated with the task and the mixing capability of the kernel established, adjusting a level control to change the relative amplitude of the audio stream affiliated with the task from a first amplitude to a second amplitude;

with the level control thus adjusted, executing a portion of the kernel software with the processor to effect the mixing capability and thus to produce a mixed audio stream in which the relative amplitude of the audio stream affiliated with the task is changed to the second amplitude; and

with the relative amplitude of the audio stream affiliated with the task thus changed to the second amplitude, providing the mixed audio stream as an output from the mixing capability.

20. The method of claim 17 in which the mixing capability includes a plurality of output routings, each output routing having an associated level control, and in which the step of providing the mixed audio stream as an output from the mixing capability comprises the steps of:

routing the mixed audio stream through an output routing to provide a routed output stream having an amplitude; and

changing the amplitude of the routed output stream by adjusting the level control associated with the output routing through which the mixed audio stream has been thus routed.

21. Apparatus comprising:

a computer system having a processor;

a multitasking operating system executed with the processor, the operating system having a kernel, the kernel comprising kernel software;

a plurality of tasks comprising application software programs executed contemporaneously with the processor under control of the operating system, each task being affiliated with an audio stream comprising a series of digital audio samples representing an audio signal; and

mixer means, comprising a portion of the kernel software executed with the processor, providing a mixing capability for mixing the audio streams affiliated with the tasks to provide a mixed audio stream comprising a series of digital audio samples representing a superposition of audio signals, the superposition having a plurality of components, each component being an audio signal represented by the sample series of an audio stream with which a task is affiliated.

22. The apparatus of claim 21 and further comprising an output device for receiving the mixed audio stream.

23. The apparatus of claim 22 in which the output device includes a digital-to-analog converter (DAC).

24. The apparatus of claim 21 and further comprising an input device for providing an audio stream, the audio stream thus provided being an audio stream affiliated with a task of the plurality of tasks.

25. The apparatus of claim 24 in which the input device includes an analog-to-digital converter (ADC).

26. The apparatus of claim 21 in which the computer system further comprises memory coupled to the processor, and further comprising:

a plurality of input queues, coupled to the mixer means, for enqueuing digital samples of the audio streams affiliated with the tasks prior to mixing, the input queues comprising memory;

an output queue, coupled to the mixer means, for enqueuing digital samples of the mixed audio stream subsequent to mixing, the output queue comprising memory; and

queue control means, comprising a portion of the kernel software executed with the processor, to control the enqueuing of digital samples in the input queues and the output queue according to a control logic.

27. The apparatus of claim 21 in which the mixer means comprises:

a plurality of mixers, each mixer providing a mixing capability for mixing a subset of the audio streams affiliated with the tasks to provide a mixed audio stream comprising a series of digital audio samples representing a superposition of the audio signals represented by the sample series of the audio streams of the subset.

28. The apparatus of claim 27 in which the computer system further comprises memory coupled to the processor, and further comprising:

a plurality of input queues, coupled to the mixer means, for enqueuing digital samples of the audio streams affiliated with the tasks prior to mixing, the input queues comprising memory;

a plurality of output queues, coupled to the mixer means, each output queue being associated with a mixer, each output queue being a queue for enqueuing digital samples of the mixed audio stream provided by the mixer with which the output queue is associated subsequent to mixing by said mixer, the output queues comprising memory; and

queue control means, comprising a portion of the kernel software executed with the processor, to control the enqueuing of digital samples in the input queues and the output queues according to a control logic.