Streaming media system and method

• US 8,677,002 B2
• Filed: 01/27/2007
• Issued: 03/18/2014
• Est. Priority Date: 01/28/2006
• Status: Active Grant

• Current Assignee: Roku, Inc.
• Original Assignee: Blackfire Research Corporation
• Inventors: Rajapakse, Ravi
• Primary Examiner(s): Anwari, Maceeh
• Application Number:
  US11/627,957
• Publication Number:
  US 20070180137A1
• Time in Patent Office: 2,607 Days
• Field of Search: 709/231
• US Class Current: 709/231
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/28 Timers or timing mechanisms used in protocols
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/23805 Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/6131 involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6405 Multicasting data broadcast and multicast in packet switching networks H04L12/18
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A system and method for streaming media on a wireless network is provided. In one aspect, the system includes a streaming device driver; a multidestination wireless streaming protocol module, a multitank level algorithm module, a synchronization mechanism module, and an autoequalizing speaker and drive system module. The system and method minimize latency, dropout, jitter, and synchronization issues associated with media streaming while optimizing performance and output quality of the media.

Claims

1. An audio system for streaming using a network, comprising:

a streaming media system transmitting an audio stream including at least a first media channel and a second media channel;

a first audio producing device communicating with the streaming media system, the first audio producing device configured to produce a first output of sounds corresponding to the first media channel; and

a second audio producing device communicating with the streaming media system, the second audio producing device configured to produce a second output of sounds corresponding to the second media channel, the second output synchronized with the first output by delaying or advancing producing of the second output based on a timing value received at the second audio producing device;

wherein the streaming media system further comprises a wireless streaming protocol module;

disallows the first and second audio producing devices from sending data to the streaming media system during a first window of time; and

disallows the streaming media system from sending data of the first and second media channels to the first and second audio producing devices during a second window of time.

2. The audio system of claim 1, wherein the streaming media system is configured to communicate with a handheld portable computing device to receive media that is converted to the audio stream for transmission to the first and second audio producing devices.

3. The audio system of claim 1, wherein the first and second audio producing devices are located remotely from each other and networked by wireless or wired IP networks.

4. The audio system of claim 1, wherein the streaming media system further comprises a streaming device driver that represents the streaming media system as a standard audio device to a software application.

5. The audio system of claim 1, wherein the streaming media system further comprises a synchronization mechanism module for determining the timing value.

6. The audio system of claim 5, wherein the streaming media system is configured to:

send a plurality of frame data packets to the first and second audio producing devices; and

send a plurality of time check packets to the first and second audio producing devices; and

wherein the first or the second audio producing devices sends a time check acknowledgment packet to the synchronization mechanism module, the time check acknowledgment packet having;

a clock stamp, and an elapsed clock count;

wherein the synchronization mechanism module further computes timing values for each of the first and second audio producing devices based on the time check acknowledgement packet received from the first and second audio producing devices and sends the computed timing values to each of the first and second audio producing devices.

7. The audio system of claim 1, wherein the streaming media system further comprises an autoequalizing speaker and drive system module associated with the first and second audio producing devices.

8. The audio system of claim 7, wherein the autoequalizing speaker and drive system module comprises:

a diaphragm;

a voice coil associated with the diaphragm;

a sensor associated with the voice coil, the sensor for sensing a signal related to the movement of the diaphragm and the voice coil; and

an electro magnet coil associated with the sensor, the electro magnet coil for providing a modulated magnetic field for the voice coil.

9. A method for synchronizing outputs at a plurality of audio producing devices, the method comprising:

receiving an audio stream from a streaming media system the audio stream including at least a first media channel and a second media channel;

producing a first output of sounds corresponding to the first media channel at a first audio producing device;

generating a timing value for synchronizing a second output of a second audio producing device with the first output; and

synchronizing, at the second audio producing device, producing of the second output of sounds corresponding to the second media channel with the first output by advancing or delaying producing of the second output based on the timing value

disallowing the first and second audio producing devices from sending data to the streaming media system during a first window of time; and

disallowing the streaming media system from sending data of the first and second media channels to the first and second audio producing devices during a second window of time.

10. The method of claim 9, wherein the streaming media system receives media converted to the audio stream from a handheld portable computing device.

11. The method of claim 9, wherein the first and second audio producing devices are located remotely from each other and networked by wireless or wired IP networks.

12. The method of claim 9, wherein the streaming media system comprises a streaming device driver that represents the streaming media system as a standard audio device to a software application.

13. The method of claim 9, further comprising managing streaming contention at the streaming media system.

14. The method of claim 9, further comprising

receiving a plurality of frame data packets from the streaming media system to the first and second audio producing devices;

and

receiving a plurality of time check packets from the streaming media system to the first and second audio producing devices; and

sending a time check acknowledgment packet to the streaming media system.

15. The method of claim 14, wherein the time check acknowledgment packet comprises:

a clock stamp, a frame number of a last frame sent to the source, and an elapsed clock count.

16. The method of claim 15, further comprising:

computing, at the stream media system, global times at which a same frame was output at each of the first and second audio producing devices based on the time check acknowledgement packet.

17. The method of claim 9, further comprising:

the streaming media system requesting and gaining access to a communication channel for transmitting data to the first and second audio producing devices during a data window time period; and

each of the audio producing devices gaining access to the communication channel for transmitting information to the source during a control window time period.

18. The streaming audio system of claim 9, wherein the audio stream received from the streaming audio system is buffered at each audio producing device prior to producing output of the media at each audio producing device.

19. A streaming audio system for reproducing media audio producing devices, the media system comprising a processor and memory, the streaming processor comprising:

a streaming device driver for interfacing with a source for receiving media comprising a plurality of channels;

a multidestination streaming protocol module for sending each of the plurality of media channels to one or more audio producing devices for producing outputs of sounds;

a synchronization mechanism module for synchronizing the outputs of the sounds at the one or more audio producing devices by sending a timing value to at least one of the audio producing devices, the at least one audio producing device receiving the timing value delaying or advancing producing of output based on the timing value;

wherein the one or more audio producing devices are disallowed from sending data to the streaming media system during a first window of time; and

wherein the streaming device driver is disallowed from sending data of the first and second media channels to the first and second audio producing devices during a second window of time.

20. The streaming audio system of claim 19, wherein the multidestination streaming protocol module manages streaming contention.

21. The streaming audio system of claim 19, wherein the streaming media system further sends a plurality of frame data packets to the plurality of audio producing devices during a data window;

and the synchronization mechanism module further;

sends a plurality of time check packets to the plurality of audio producing devices; and

receives time check acknowledgment packets from the one or more audio producing devices.

22. The streaming a audio system of claim 21, wherein the time check acknowledgment packet comprises:

a clock stamp, a frame number of a last frame sent to the source, and an elapsed clock count.

23. The streaming audio system of claim 22, wherein the source computes global times at which a same frame is to be output at each of the plurality of audio producing devices based on the time check acknowledgement packet.

24. The streaming audio system of claim 22, wherein the multidestination steaming protocol module and the synchronization mechanism module are located remotely from each other and networked by a wireless or wired IP networks.