Distributed channel time allocation for video streaming over wireless networks

• US 20080069201A1
• Filed: 03/20/2007
• Published: 03/20/2008
• Est. Priority Date: 09/18/2006
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: van Beek, Petrus J.L., Zhu, Xiaoqing
• Granted Patent: US 8,861,597 B2
• Time in Patent Office: Days
• US Class Current: 375/240.1
• CPC Class Codes: H04N 21/4113 PC
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114

Abstract

A system for transmitting video from a plurality of transmitters to a plurality of receivers over a shared wireless channel includes a plurality of transmitters each receiving a respective video stream to transmit over the shared wireless channel. Distortion-related information is associated with each of the respective video streams and each of the plurality of transmitters having access to the distortion-related information for the respective video stream while not having access to the distortion-related information for other the video streams. Each of the plurality of transmitters using the respective distortion-related information of the respective the video stream to determine how to modify the video stream for transmission based upon a channel time constraint.

Claims

1. A system for transmitting video from a plurality of transmitters to a plurality of receivers over a shared wireless channel comprising:

(a) said plurality of transmitters each receiving a respective video stream to transmit over said shared wireless channel;

(b) distortion-related information associated with each of said respective video streams;

(c) each of said plurality of transmitters having access to said distortion-related information for said respective video stream while not having access to said distortion-related information for other said video streams;

(d) each of said plurality of transmitters using said respective distortion-related information of said respective said video stream to determine how to modify said video stream for transmission based upon a channel time constraint.

2. The system of claim 1 wherein each of said plurality of transmitters determines a proportion of the available said shared wireless channel time for transmission and said modifies said video stream based upon said determination.

3. The system of claim 1 wherein said modification is not based upon an overall bit rate.

4. The system of claim 1 wherein said modification of said video stream is determined in a distributed manner.

5. The system of claim 2 wherein said proportion of the available channel time is determined separately by each of said transmitters.

6. The system of claim 5 wherein said separate determination by each of said transmitters achieves a minimum overall distortion associated with said plurality of video streams.

7. The system of claim 5 wherein said proportion of the available channel is communicated among said transmitters.

8. The system of claim 5 wherein said proportion is based upon a gradient of a cost function.

9. The system of claim 5 wherein said proportion is based upon optimizing a dual cost function.

10. The system of claim 2 wherein each transmission from a transmitter to a receiver is associated with an effective bandwidth.

11. The system of claim 10 wherein each of said plurality of transmitters has access to said effective bandwidth associated with a transmission from said respective transmitter while not having access to the effective bandwidth associated with transmissions from other transmitters.

12. The system of claim 10 wherein each of said plurality of said transmitters estimates the effective bandwidth available for transmission of a respective video stream over said shared wireless channel.

13. The system of claim 1 wherein said modification of said video stream is based upon cross layer information between a MAC layer and an application layer.

14. The system of claim 1 wherein said system includes an adaptive frame omission process.

15. The system of claim 2 wherein said each transmitter includes an adaptive frame omission process to modify said video stream.

16. The system of claim 1 wherein said system includes an adaptive packet omission process.

17. The system of claim 2 wherein said each transmitter includes an adaptive packet omission process to modify said video stream.

18. The system of claim 14 wherein said frame omission process is based upon selective omitting ones of I frames, B frames, and P frames.

19. The system of claim 16 wherein said packet omission process is based upon selective omitting packets of I frames, B frames, and P frames.

20. The system of claim 18 wherein a pre-defined set of frames of a group of frames is selectively omitted based upon said distortion-related information for a respective said video stream.

21. The system of claim 19 wherein a pre-defined set of packets of a group of frames is selectively omitted based upon said distortion-related information for a respective said video stream.

22. The system of claim 15 wherein a pre-defined set of frames of a group of frames is selectively omitted based upon said proportion of the available said shared wireless channel.

23. The system of claim 17 wherein a pre-defined set of packets of a group of frames is selectively omitted based upon said proportion of the available said shared wireless channel.

24. The system of claim 1 wherein said distortion-related information is associated with a portion of a respective video stream.

25. The system of claim 24 wherein said distortion-related information is associated with a group of frames.

26. The system of claim 24 wherein said distortion-related information is associated with a frame.

27. The system of claim 24 wherein said distortion-related information is associated with a packet.

28. The system of claim 1 wherein said distortion-related information comprises a set of rate and distortion values.

29. The system of claim 1 wherein said distortion-related information comprises a distortion-rate function.

30. A system for transmitting video from a transmitter to a receiver comprising:

(a) a plurality of frames of a video including intra-coded frames, predictive coded frames, and bi-predictive coded frames where each of said frames includes a plurality of packets;

(b) an estimator estimating the effective bandwidth of the connection between said transmitter and said receiver;

(c) determining a data rate for said plurality of frames based upon said estimation of said bandwidth;

(d) identifying frames that should be transmitted, frames that should not be transmitted, and frames that should be partially transmitted, based on (i) said data rate;

(ii) said intra-coded, predictive coded, or bi-predictive coded nature of said frames;

(e) selectively not transmitting at least one of said packets of one of said frames that should be partially transmitted, while transmitting other said packets of said frame from said transmitter to said receiver.

31. The system of claim 30 wherein said transmitting is over a shared wireless channel.

32. The system of claim 31 wherein said wireless channel is shared with at least one other transmitter.

33. The system of claim 30 wherein said estimation of said effective bandwidth is based on cross-layer information between a MAC layer and an application layer.

34. The system of claim 33 wherein said cross-layer information includes a time taken to successfully deliver a packet at the MAC layer.

35. The system of claim 30 wherein said estimation of said effective bandwidth is based on information transmitted from said receiver to said transmitter.

36. The system of claim 31 wherein said determining of said data rate includes determining a proportion of the available channel time for transmission over said shared wireless channel.

37. The system of claim 36 wherein said determining of said proportion is based on distortion-related information associated with said video.

38. The system of claim 37 wherein said distortion-related information is associated with a group of frames of said video.

39. The system of claim 37 wherein said distortion-related information is associated with a frame of said video.

40. The system of claim 37 wherein said distortion-related information is associated with a packet of said video.

41. The system of claim 30 wherein said determining of said data rate includes minimizing distortion of said video given a constraint on the available channel time for transmission of said video.

42. The system of claim 30 wherein said identifying is based on selecting a packet omission pattern from a set of packet omission patterns.

43. The system of claim 42 wherein each packet omission pattern is associated with a rate and a distortion.

44. The system of claim 42 wherein said set of packet omission patterns is determined by successively omitting packets from bi-predictive coded frames, followed by successively omitting packets from predictive coded frames.

45. The system of claim 44 wherein said omitting of packets from bi-predictive coded frames is based on the order of said frames in said video.

46. The system of claim 30 wherein said identifying results in exactly one frame to be identified as a frame that should be partially transmitted.

47. The system of claim 42 wherein said selection of said packet omission pattern is updated once every group of frames.

48. The system of claim 42 wherein said selection of said packet omission pattern is updated once every frame.