Low latency real-time audio streaming

• US 7,706,901 B2
• Filed: 10/01/2004
• Issued: 04/27/2010
• Est. Priority Date: 10/01/2004
• Status: Active Grant

• Current Assignee: Zhigu Holdings Limited
• Original Assignee: Microsoft Corporation
• Inventors: Berreth, Frank
• Primary Examiner(s): Briney, III; Walter F
• Application Number:
  US10/956,280
• Publication Number:
  US 20060074637A1
• Time in Patent Office: 2,034 Days
• Field of Search: 700/94
• US Class Current: 700/94
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs

Abstract

Systems and methods for audio streaming in a computing device are described. In one aspect an interface to an adapter driver is provided. The adapter driver is associated with an audio device. The adapter driver and a wave real-time (WaveRT) port driver associated with the computing device use the interface to configure direct access by a client of the computing device and by the audio device to a cyclic buffer. The direct access is for rendering and/or capturing an audio stream. The direct access is independent of any copying by a port driver on the computer system of the audio stream to any buffer.

Claims

1. A method for audio streaming in a computing device, the method comprising:

providing an interface to an adapter driver associated with an audio device;

configuring, via the interface by the adapter driver and a wave real-time (WaveRT) port driver associated with the computing device, direct access by a client of the computing device and by the audio device to a cyclic buffer for rendering and/or capturing an audio stream, the direct access being independent of any copying by a port driver on the computer system of the audio stream to any buffer;

monitoring, via the interface to the adapter driver, latency between a write position and a play position in the cyclic buffer, the monitoring not requiring a transition from kernel-mode;

obtaining, via the interface, clock register values; and

synchronizing audio streams between the audio device and a second audio device as a function of the clock register values, the first and second audio devices having respective and unsynchronized hardware clock registers.

2. A method as recited in claim 1, wherein the write position corresponds to a value of a write position register in audio hardware.

3. A method as recited in claim 1, wherein the play position corresponds to a value of a play position register in audio hardware.

4. A method as recited in claim 1, further comprising determining, via the interface at regular time intervals, a play position of the cyclic buffer to calculate how far to advance the write position such that an underflow condition is avoided at the cyclic buffer through a next time interval of the regular time intervals.

5. A method as recited in claim 1, wherein the audio device is associated with a direct memory access (DMA) controller that does not have buffer looping capability, and wherein the method further comprises synchronizing DMA controller access to the audio stream in the cyclic buffer through audio position.

6. A method as recited in claim 1, wherein the configuring further comprises:

registering, by the adapter driver, a real-time miniport driver with a port class system driver of the computing system, the real-time miniport driver being configured for audio stream render or capture; and

creating, by the client, a real-time device for kernel streaming of the audio stream, the real-time device comprising the real-time miniport driver and the WaveRT port driver.

7. A method as recited in claim 1, further comprising:

not revoking mappings, by the real-time miniport driver, to any shared data structure during rendering or capturing of audio data; and

wherein the not revoking does not cause synchronization or timing errors.

8. A method as recited in claim 1, wherein the method Wher comprises synchronizing the client for data read or write access to the cyclic buffer through audio position, the audio position being a function of real-time thread scheduling provided by an operating system of the computing device, and audio data write and/or play position(s) in the cyclic buffer.

9. A method as recited in claim 8, further comprising monitoring, by the client at regular time intervals, aspects of the audio position, the aspects being supplied by a WaveRT MiniPort driver registered by the adapter driver.

10. A method as recited in claim 8, further comprising reducing stream latency, by the client, by removing unnecessary padding from a regular time interval, the unnecessary padding being a function of a distance between a read position and a write position in the cyclic buffer.

11. A computer-readable medium having stored thereon computer-program instructions for audio streaming in a computing device, the computer-program instructions being executable by a processor, the computer-program instructions comprising instructions for:

providing an interface to an adapter driver associated with an audio device;

configuring, via the interface by the adapter driver and a wave real-time (WaveRT) port driver associated with the computing device, direct access by a client of the computing device and by the audio device to a cyclic buffer for rendering and/or capturing an audio stream, the direct access being independent of any copying by a port driver on the computer system of the audio stream to any buffer;

monitoring, via the interface to the adapter driver, latency between a write position and a play position in the cyclic buffer, the monitoring not requiring a transition from kernel-mode;

obtaining, via the interface, clock register values; and

synchronizing audio streams between the audio device and a second audio

device as a function of the clock register values, the first and second audio devices having respective and unsynchronized hardware clock registers.

12. A computer-readable medium as recited in claim 11, wherein the write position corresponds to a value of a write position register in audio hardware.

13. A computer-readable medium as recited in claim 11, wherein the play position corresponds to a value of a play position register in audio hardware.

14. A computer-readable medium as recited in claim 11, wherein the instructions further comprise instructions for determining, via the interface at regular time intervals, a play position of the cyclic buffer to calculate how far to advance the write position such that an underflow condition is avoided at the cyclic buffer through a next time interval of the regular time intervals.

15. A computer-readable medium as recited in claim 11, wherein the audio device is associated with a direct memory access (DMA) controller that does not have buffer looping capability, and wherein the computer-program instructions further comprise instructions for:

synchronizing DMA controller access to the audio stream in the cyclic buffer through audio position.

16. A computer-readable medium as recited in claim 11, wherein the computer-program instructions for configuring further comprise instructions for:

registering, by the adapter driver, a real-time miniport driver with a port class system driver of the computing system, the real-time miniport driver being configured for audio stream render or capture; and

creating, by the client, a real-time device for kernel streaming of the audio stream, the real-time device comprising the real-time miniport driver and the WaveRT) port driver.

17. A computer-readable medium as recited in claim 16, further comprising computer-program instructions for:

not revoking mappings, by the real-time miniport driver, to any shared data structure during rendering or capturing of audio data; and

wherein the not revoking does not cause synchronization or timing errors.

18. A computer-readable medium as recited in claim 11, wherein the computer-program instructions further comprise instructions for synchronizing the client for data read or write access to the cyclic buffer through audio position, the audio position being a function of real-time thread scheduling provided by an operating system of the computing device, and audio data write and/or play position(s) in the cyclic buffer.

19. A computer-readable medium as recited in claim 18, further comprising computer-program instructions for monitoring, by the client at regular time intervals, aspects of the audio position, the aspects being supplied by a WaveRT MiniPort driver registered by the adapter driver.

20. A computer-readable medium as recited in claim 18, further comprising computer-program instructions for reducing stream latency, by the client, by removing unnecessary padding from a regular time interval, the unnecessary padding being a function of a distance between a read position and a write position in the cyclic buffer.

21. A computing device comprising:

a processor; and

a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor for real-time audio streaming, the computer-program instructions comprising instructions for;

providing an interface to an adapter driver associated with an audio device;

configuring, via the interface by the adapter driver and a wave real-time (WaveRT) port driver associated with the computing device, direct access by a client of the computing device and by the audio device to a cyclic buffer for rendering and/or capturing an audio stream, the direct access being independent of any copying by a port driver on the computer system of the audio stream to any buffer;

monitoring, via the interface to the adapter driver, latency between a write position and a play position in the cyclic buffer, the monitoring not requiring a transition from kernel-mode;

obtaining, via the interface, clock register values; and

synchronizing audio streams between the audio device and a second audio device as a function of the clock register values, the first and second audio devices having respective and unsynchronized hardware clock registers.

22. A computing device as recited in claim 21, wherein the write position corresponds to a value of a write position register in audio hardware.

23. A computing device as recited in claim 21, wherein the play position corresponds to a value of a play position register in audio hardware.

24. A computing device as recited in claim 21, wherein the instructions further comprise instructions for determining, via the interface at regular time intervals, a play position of the cyclic buffer to calculate how far to advance the write position such that an underflow condition is avoided at the cyclic buffer through a next time interval of the regular time intervals.

25. A computing device as recited in claim 21, wherein the audio device is associated with a direct memory access (DMA) controller that does not have buffer looping capability, and wherein the computer-program instructions further comprise instructions for:

synchronizing DMA controller access to the audio stream in the cyclic buffer through audio position.

26. A computing device as recited in claim 21, wherein the computer-program instructions for configuring further comprise instructions for:

registering, by the adapter driver, a real-time miniport driver with a port class system driver of the computing system, the real-time miniport driver being configured for audio stream render or capture; and

creating, by the client, a real-time device for kernel streaming of the audio stream, the real-time device comprising the real-time miniport driver and the WaveRT port driver.

27. A computing device as recited in claim 26 wherein the computer-program instructions further comprise instructions for:

not revoking mappings, by the real-time miniport driver, to any shared data structure during rendering or capturing of audio data; and

wherein the not revoking does not cause synchronization or timing errors.

28. A computing device as recited in claim 21, wherein the computer-program instructions further comprise instructions for synchronizing the client for data read or write access to the cyclic buffer through audio position, the audio position being a function of real-time thread scheduling provided by an operating system of the computing device, and audio data write and/or play position(s) in the cyclic buffer.

29. A computing device as recited in claim 28, further comprising computer-program instructions for monitoring, by the client at regular time intervals, aspects of the audio position, the aspects being supplied by a WaveRT MiniPort driver registered by the adapter driver.

30. A computing device as recited in claim 28, further comprising computer-program instructions for reducing stream latency, by the client, by removing unnecessary padding from a regular time interval, the unnecessary padding being a function of a distance between a read position and a write position in the cyclic buffer.