Wireless video transmission system

• US 20050008074A1
• Filed: 06/25/2003
• Published: 01/13/2005
• Est. Priority Date: 06/25/2003
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: van Beek, Petrus J.L., Pan, Hao, Li, Baoxin, Sezan, M. Ibrahim
• Granted Patent: US 7,274,740 B2
• Time in Patent Office: Days
• US Class Current: 375/240.10
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/37 with arrangements for assigning different transmission priorities to video input data or to video coded data
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/44029 for generating different versions
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/44227 : Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811
• CPC Class Codes: H04N 21/44231 : Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device configuring of peripheral devices in general G06F9/4411; reporting information sensed by appliance or service execution status of appliance services in a home automation network H04L12/2823; monitoring the status of connected device in data switched networks H04L43/0817
• CPC Class Codes: H04N 21/4621 : Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10

Abstract

A transmission systems suitable for video.

Claims

1. A method for transmitting video comprising:

(a) defining a first set of frames and a first target bit rate for said first set of frames;

(b) at least one of transcoding and encoding a first frame of said first set of frames based upon said first target bit rate;

(c) transmitting said first frame of said at least one of transcoded and encoded first set of frames;

(d) defining a second set of frames, wherein said second set of frames has at least one frame in common with said first set of frames, wherein said second set of frames has at least one frame not in common with said first set of frames, and a second target bit rate for said second set of frames;

(e) at least one of transcoding and encoding a first frame of said second set of frames based upon said second target bit rate;

(f) transmitting said first frame of said at least one of transcoded and encoded second set of frames;

(g) wherein at least one of said first and second target bit rates is based upon a compression rate distortion model of at least one frame resulting from the output of said at least one of said transcoder and encoder.

2. The method of claim 1 wherein at least one of said first and second target bit rates is based upon both a first complexity measure based upon at least one frame resulting from the output of said transcoder and a second complexity measure based upon said at least one frame prior to transcoding.

3. The method of claim 2 wherein said at least one of said first and second target bit rates is based upon the ratio of said first and second complexity measures.

4. The method of claim 2 wherein said ratio is defined as:

$C_{t,n}^{\mathrm{\prime <br><br>}}=\frac{S_{t-\mathrm{\tau <br><br>},n}^{\mathrm{\prime <br><br>}}<br><br>Q_{t-\mathrm{\tau <br><br>},n}^{\mathrm{\prime <br><br>}}}{S_{t-\mathrm{\tau <br><br>},n}<br><br>Q_{t-\mathrm{\tau <br><br>},n}}<br><br>S_{t,n}<br><br>Q_{t,n}.$

5. The method of claim 2 wherein the video is transmitted using a transmission system that includes multiple links, wherein said system is characterized in that the sum of the maximum transmission rate of said multiple links is not the same as the total bandwidth available by the transmission system.

6. A method for transmitting video comprising:

(a) defining a first set of frames and determining a first target bit rate for said first set of frames;

(b) transmitting a first frame of said first set of frames based upon said first target bit rate;

(c) defining a second set of frames, wherein said second set of frames has at least one frame in common with said first set of frames, wherein said second set of frames has at least one frame not in common with said first set of frames, and determining a second target bit rate for said second set of frames;

(d) transmitting said first frame of said second set of frames based upon said second target bit rate;

(e) wherein at least one of said first and second target bit rates is based upon determining the currently available bandwidth for transmission.

7. The method of claim 6 wherein said available bandwidth is determined based upon information from a MAC layer.

8. The method of claim 6 wherein said available bandwidth is determined based upon information transmitted from a receiving device to the transmitter.

9. The method of claim 6 wherein said available bandwidth is determined based upon information from the transmitter.

10. The method of claim 6 wherein said available bandwidth is determined based upon information within an APPLICATION layer.

11. A method for transmitting video comprising:

(a) defining a first set of frames and a first target bit rate for said first set of frames;

(b) transmitting to a first receiver a first frame of said first set of frames based upon said first target bit rate;

(c) defining a second set of frames and a second target bit rate for said second set of frames;

(d) transmitting to a second receiver a first frame of said second set of frames based upon said second target bit rate;

(e) wherein the values of said first and second target bit rates are dependant upon one another; and

(f) wherein said system includes a shared channel that is characterized by at least one of;

(i) the maximum throughput to said first receiver differs from the maximum throughput to a second receiver;

(ii) an amount of data bits sent to said first receiver utilizes a different fraction of the channel capacity than an identical amount of data bits sent to said second receiver;

(iii) the sum of the maximum transmission rate to said first receiver and said second receiver is not the same as the total bandwidth of said system.

12. The method of claim 11 wherein said system is an 802.11 based system.

13. The method of claim 11 wherein said first and second target bit rates are based upon determining the available bandwidth for transmission.

14. The method of claim 11 wherein said first bit rate is based upon:

$f_n=\frac{\frac{p_n}{H_n}<br><br>\underset{t=1}{\overset{N_G}{\sum <br><br>}}<br><br>\frac{C_{n,t}}{K_{n,t}}}{\underset{n=1}{\overset{N_L}{\sum <br><br>}}<br><br>\frac{p_n}{H_n}<br><br>\underset{t=1}{\overset{N_G}{\sum <br><br>}}<br><br>\frac{C_{n,t}}{K_{n,t}}}$

15. A method for transmitting video comprising:

(a) defining a first set of frames and a first target bit rate for said first set of frames;

(b) transmitting to a first receiver a first frame of said first set of frames based upon said first target bit rate;

(c) defining a second set of frames and a second target bit rate for said second set of frames;

(d) transmitting to a second receiver a first frame of said second set of frames based upon said second target bit rate;

(e) wherein the value of at least one of said first and second target bit rates are modified based upon at least one of;

(i) a user preference;

(ii) information about the video source;

(iii) information regarding the receiving device;

(iv) the screen size of the receiving device;

(v) the frame rate supported by the receiving device;

(vi) the content of the video source;

(vii) the location of the receiving device.

(viii) a user selection;

(ix) the presence of a user;

(x) direct user input;

(xi) the priority of said first set of frames relative to the priority of said second set of frames.

16. The method of claim 15 wherein said system is an 801.11 based system.

17. The method of claim 15 wherein said first and second target bit rates are based upon determining the available bandwidth for transmission.

18. The method of claim 15 wherein the value of said first target bit rate is determined based upon said user preferences.

19. The method of claim 15 wherein the value of said first target bit rate is determined based upon said information about the video source.

20. The method of claim 15 wherein the value of said first target bit rate is determined based upon said information regarding the receiving device.

21. The method of claim 15 wherein the value of said first target bit rate is determined based upon said the screen size of the receiving device.

22. The method of claim 15 wherein the value of said first target bit rate is determined based upon said frame rate supported by the receiving device.

23. The method of claim 15 wherein the value of said first target bit rate is determined based upon said content of the video source.

24. The method of claim 15 wherein the value of said first target bit rate is determined based upon said location of the receiving device.

25. The method of claim 15 wherein the value of said first target bit rate is determined based upon said modality of said first set of frames.

26. A method for transmitting video comprising:

(a) defining a first set of frames and a first target bit rate for said first set of frames;

(b) at least one of transcoding and encoding a first frame of said first set of frames based upon said first target bit rate;

(c) transmitting to a first receiver said first frame of at least one of said transcoded and encoded first set of frames;

(d) defining a second set of frames and a second target bit rate for said second set of frames;

(e) at least one of transcoding and encoding a first frame of said second set of frames based upon said second target bit rate;

(e) transmitting to a second receiver said first frame of at least one of said transcoded and encoded said second set of frames based upon said second target bit rate;

(f) wherein said first target bit rate is based upon a compression rate distortion model of at least one frame resulting from the output of said transcoder.

27. The method of claim 26 further comprising transcoding said first frame of said second set of frames, transmitting in a second channel said first frame of said transcoded second set of frames based upon said second target bit rate, and wherein said second target bit rate is based upon a complexity measure of at least one frame resulting from the output of said transcoder.

28. The method of claim 26 wherein at least one of said first and second target bit rates is based upon both a first complexity measure based upon at least one frame resulting from the output of said transcoder and a second complexity measure based upon said at least one frame prior to transcoding.

29. The method of claim 28 wherein said at least one of said first and second target bit rates is based upon the ratio of said first and second complexity measures.

30. The method of claim 28 wherein said ratio is defined as:

$C_{t,n}^{\mathrm{\prime <br><br>}}=\frac{S_{t-\mathrm{\tau <br><br>},n}^{\mathrm{\prime <br><br>}}<br><br>Q_{t-\mathrm{\tau <br><br>},n}^{\mathrm{\prime <br><br>}}}{S_{t-\mathrm{\tau <br><br>},n}<br><br>Q_{t-\mathrm{\tau <br><br>},n}}<br><br>S_{t,n}<br><br>Q_{t,n}.$

31. A method for transmitting video comprising:

(a) defining a first set of frames and a first target bit rate for said first set of frames;

(b) transmitting to a first receiver a first frame of said first set of frames based upon said first target bit rate;

(c) defining a second set of frames and a second target bit rate for said first set of frames;

(d) transmitting to a second receiver a first frame of said second set of frames based upon said second target bit rate;

(e) wherein the value of said first and second target bit rates are dependant upon one another; and

(f) wherein the value of said first and second target bit rates are determined based upon the bandwidth available to transmit said first frame of said first set and said first frame of said second set.

32. The method of claim 31 where said system includes a shared channel that is characterized by at least one of:

(i) the maximum throughput to said first receiver differs from the maximum throughput to a second receiver;

(ii) an amount of data bits sent to said first receiver utilizes a different fraction of the channel capacity than an identical amount of data bits sent to said second receiver;

(iii) the sum of the maximum transmission rate to said first receiver and said second receiver is not the same as the total bandwidth of said system.

33. The method of claim 31 wherein said system is an 802.11 based system.

34. The method of claim 31 wherein said first and second target bit rates are based upon determining the available bandwidth for transmission.

35. A method for transmitting video comprising:

(a) defining a first set of frames and a first target bit rate for said first set of frames;

(b) at least one of transcoding and encoding a first frame of said first set of frames based upon said first target bit rate;

(c) transmitting said first frame of said at least one of transcoded and encoded first set of frames;

(d) defining a second set of frames, wherein said second set of frames has at least one frame in common with said first set of frames, wherein said second set of frames has at least one frame not in common with said first set of frames, and a second target bit rate for said second set of frames;

(e) at least one of transcoding and encoding a first frame of said second set of frames based upon said second target bit rate;

(f) transmitting said first frame of said at least one of transcoded and encoded second set of frames;

(g) wherein said first and second target bit rates are adapted to a temporal changing bandwidth.

36. A method for transmitting video comprising:

(a) defining a first set of frames and determining a first target bit rate for said first set of frames;

(b) transmitting a first frame of said first set of frames based upon said first target bit rate;

(c) defining a second set of frames, wherein said second set of frames has at least one frame in common with said first set of frames, wherein said second set of frames has at least one frame not in common with said first set of frames, and determining a second target bit rate for said second set of frames;

(d) transmitting said first frame of said second set of frames based upon said second target bit rate;

(e) wherein said first and second target bit rates are adapted to a temporal changing bandwidth.