Method of transmitting a pre-coded video signal over a communication network

• US 8,792,548 B2
• Filed: 03/09/2009
• Issued: 07/29/2014
• Est. Priority Date: 03/11/2008
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Henocq, Xavier, Onno, Patrice, Le Leannec, Fabrice
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): LI, TRACY Y
• Application Number:
  US12/400,745
• Publication Number:
  US 20090232200A1
• Time in Patent Office: 1,968 Days
• Field of Search: 375/240.01, 375/240.1
• US Class Current: 375/240.01
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/440227 by decomposing into layers, e.g. base layer and one or more enhancement layers

Abstract

A video signal pre-coded using hierarchical coding is transmitted over a communication network, the signal being constituted by data distributed into several hierarchical levels. More specifically, a bandwidth of the communication network is periodically estimated over evaluation periods. A set of hierarchical levels is selected for a current evaluation period, where a transmission rate of the data of the selected hierarchical levels is compatible with the bandwidth estimated for a current evaluation period. A change tendency of the bandwidth is estimated for a following evaluation period. Additional data of the video signal to transmit is then determined depending on the estimated change tendency of the bandwidth, and the data of the selected hierarchical levels and the determined additional data is transmitted during the current evaluation period.

Claims

1. A transmission method for transmitting a video signal over a communication network, comprising the following steps:

pre-coding the video signal using hierarchical coding thereby obtaining pre-coded video signal, the pre-coded video signal being constituted by data distributed into a plurality of hierarchical levels;

periodically estimating a bandwidth of the communication network over evaluation periods;

selecting, for a current evaluation period, a set of hierarchical levels in the plurality of hierarchical levels constituting the pre-coded video signal, wherein a transmission rate of the data of the selected hierarchical levels is compatible with the bandwidth estimated for the current evaluation period;

estimating a change tendency of the bandwidth for a following evaluation period;

determining additional data of the video signal to transmit depending on the estimated change tendency of the bandwidth,

wherein the additional data are chosen from among data of the current evaluation period or data of the following evaluation period,

wherein if the bandwidth for the following evaluation period has a tendency to increase, the additional data are chosen in at least one hierarchical level higher than the set of hierarchical levels selected for the current evaluation period, and

wherein if the bandwidth for the following evaluation period has a tendency to decrease, the additional data are chosen from among at least one hierarchical level of the following evaluation period, wherein the hierarchical level is identical to a hierarchical level of the set of hierarchical levels selected for the current evaluation period; and

transmitting the data of the selected hierarchical levels and the determined additional data during the current evaluation period.

2. A transmission method according to claim 1, wherein at the step of determining additional data, the additional data are determined furthermore on the basis of a bandwidth residue calculated on the basis of a difference between the current bandwidth and the transmission rate of the data of the selected hierarchical levels.

3. A transmission method according to claim 1, wherein the transmitting step comprises:

sending the data of the set of hierarchical levels selected for the current evaluation period;

searching for data not transmitted during an evaluation period preceding the current evaluation period; and

transmitting the data not transmitted at the preceding evaluation period, and then transmitting the determined additional data.

4. A transmission method according to claim 1, wherein at the step of estimating the change tendency, the change tendency is evaluated on the basis of bandwidths estimated for at least one preceding evaluation period prior to the current evaluation period.

5. A transmission method according to claim 4, wherein at the step of estimating the change tendency, the bandwidth estimated for the current evaluation period is compared with an average value of the bandwidths estimated for preceding evaluation periods, the bandwidth for a following evaluation period tending to increase when the estimated current bandwidth is less than the average value of the bandwidths, and the bandwidth for a following evaluation period tending to decrease when the estimated current bandwidth is greater than the average value of the bandwidths.

6. A transmission method according to claim 1, wherein at the step of selecting a set of hierarchical levels, the set is selected such that the transmission rate of the data of the selected hierarchical levels is the closest possible to the current bandwidth.

7. A transmission method according to claim 1, wherein the pre-coded video signal is transmitted in real-time between a server and a client of the communication network.

8. A transmission method according to claim 1, wherein the pre-coded video signal is a signal coded in accordance with the Scalable Video Coding (SVC) standard with Coarse Grain Scalability (CGS) hierarchical levels.

9. A transmission method according to claim 1, wherein the plurality of hierarchical levels are one of either Coarse Grain Scalability (CGS) or Medium Grain Scalability (MGS) hierarchical levels.

10. A non-transitory computer-readable storage medium storing a computer program that can be loaded into a computer system, the program comprising instructions enabling the implementation of the transmission method according to claim 1, when that program is loaded and executed by a computer system.

14. A server of a communication network adapted to transmit a video signal pre-coded using hierarchical coding, comprising means for implementing the transmission method according to claim 1.

15. A server according to claim 14, wherein the pre-coded video signal is transmitted in real-time between the server and a client of the communication network.

16. A server according to one of claim 14 or 15, wherein the pre-coded video signal is a signal coded in accordance with the Scalable Video Coding (SVC) standard with Coarse Grain Scalability (CGS) hierarchical levels.

11. A transmission device for transmitting a video signal over a communication network, comprising:

a pre-coding unit configured to pre-code the video signal using hierarchical coding thereby obtaining a pre-coded video signal, the pre-coded video signal being constituted by data distributed into a plurality of hierarchical levels;

an periodic estimating unit configured to periodically estimate a bandwidth of the communication network over evaluation periods;

a selecting unit configured to select, for a current evaluation period, a set of hierarchical levels in the plurality of hierarchical levels constituting the pre-coded video signal, wherein a transmission rate of the data of the selected hierarchical levels is compatible with the bandwidth estimated for the current evaluation period;

an estimating unit configured to estimate a change tendency of the bandwidth for a following evaluation period;

a determining unit configured to determine additional data of the video signal to transmit depending on the estimated change tendency of the bandwidth,

wherein the additional data are chosen from among data of the current evaluation period or data of the following evaluation period,

wherein if the bandwidth for the following evaluation period has a tendency to increase, the additional data are chosen in at least one hierarchical level higher than the set of hierarchical levels selected for the current evaluation period, and

wherein if the bandwidth for the following evaluation period has a tendency to decrease, the additional data are chosen from among at least one hierarchical level of the following evaluation period, wherein the hierarchical level is identical to a hierarchical level of the set of hierarchical levels selected for the current evaluation period; and

a transmitting unit configured to transmit the data of the selected hierarchical levels and the determined additional data during the current evaluation period.

12. A transmission device according to claim 11, wherein the transmitting unit comprises:

a sending unit configured to send said data of the set of hierarchical levels selected for the current evaluation period; and

a search unit configured to search for data not transmitted during an evaluation period preceding the current evaluation period,

wherein the transmitting unit transmits data not transmitted at the preceding evaluation period, and then transmits determined additional data.

13. A transmission device according to one of claim 11 or 12, comprising:

a calculating unit configured to calculate a residue of current bandwidth on the basis of difference between the current bandwidth and the rate of transmission of the data of the selected hierarchical levels.

17. A transmission device according to claim 11, wherein the plurality of hierarchical levels are one of either Coarse Grain Scalability (CGS) or Medium Grain Scalability (MGS) hierarchical levels.

18. A transmission method for transmitting a video signal over a communication network, comprising the following steps:

pre-coding the video signal using hierarchical coding thereby obtaining a pre-coded video signal, the pre-coded video signal being constituted by data distributed into a plurality of hierarchical levels;

periodically estimating a bandwidth of the communication network over evaluation periods;

selecting, for a current evaluation period, a set of hierarchical levels, wherein a transmission rate of the data of said selected hierarchical levels is compatible with the bandwidth estimated for the current evaluation period;

estimating, before transmitting data during the current evaluation period, a change tendency of the bandwidth for a following evaluation period;

determining additional data of the video signal to transmit depending on the estimated change tendency of the bandwidth for the following evaluation period,

wherein the additional data are chosen from among data of the current evaluation period or data of the following evaluation period,

wherein if the bandwidth for the following evaluation period has a tendency to increase, the additional data are chosen in at least one hierarchical level higher than the set of hierarchical levels selected for the current evaluation period, and

wherein if the bandwidth for the following evaluation period has a tendency to decrease, the additional data are chosen from among at least one hierarchical level of the following evaluation period, wherein the hierarchical level is identical to a hierarchical level of the set of hierarchical levels selected for the current evaluation period; and

transmitting the data of the selected hierarchical levels and the determined additional data during the current evaluation period.

19. A transmission device for transmitting a video signal over a communication network, comprising:

a pre-coding unit configured to pre-code the video signal using hierarchical coding thereby obtaining a pre-coded video signal, the pre-coded video signal being constituted by data distributed into a plurality of hierarchical levels;

a periodic estimating unit configured to periodically estimate a bandwidth of the communication network over evaluation periods;

a selecting unit configured to select, for a current evaluation period, a set of hierarchical levels, wherein a transmission rate of the data of the selected hierarchical levels is compatible with the bandwidth estimated for the current evaluation period;

an estimating unit configured to estimate, before transmitting data during the current evaluation period, a change tendency of the bandwidth for a following evaluation period;

a determining unit configured to determine additional data of the video signal to transmit depending on the estimated change tendency of the bandwidth for the following evaluation period,

wherein the additional data are chosen from among data of the current evaluation period or data of the following evaluation period,

wherein if the bandwidth for the following evaluation period has a tendency to increase, the additional data are chosen in at least one hierarchical level higher than the set of hierarchical levels selected for the current evaluation period, and

wherein if the bandwidth for the following evaluation period has a tendency to decrease, the additional data are chosen from among at least one hierarchical level of the following evaluation period, wherein the hierarchical level is identical to a hierarchical level of the set of hierarchical levels selected for the current evaluation period; and

a transmitting unit configured to transmit the data of the selected hierarchical levels and the determined additional data during the current evaluation period.

20. A transmission method for transmitting a video signal over a communication network, comprising the following steps:

pre-coding the video signal using hierarchical coding thereby obtaining a pre-coded video signal, the pre-coded video signal being constituted by data distributed into a plurality of hierarchical levels;

periodically estimating a bandwidth of the communication network over evaluation periods;

selecting, for a current evaluation period for evaluating a bandwidth available on the communication network, a set of hierarchical levels, wherein a transmission rate of the data of the selected hierarchical levels is compatible with the bandwidth estimated for the current evaluation period;

estimating a change tendency of the bandwidth for a future following evaluation period for evaluating a bandwidth available on the communication network that will follow the current evaluation period;

determining additional data of the video signal to transmit depending on the estimated change tendency of the bandwidth,

wherein the additional data are chosen from among data of the current evaluation period or data of the following evaluation period,

wherein if the bandwidth for the following evaluation period has a tendency to increase, the additional data are chosen in at least one hierarchical level higher than the set of hierarchical levels selected for the current evaluation period, and

wherein if the bandwidth for the following evaluation period has a tendency to decrease, the additional data are chosen from among at least one hierarchical level of the following evaluation period, wherein the hierarchical level is identical to a hierarchical level of the set of hierarchical levels selected for the current evaluation period; and

transmitting the data of the selected hierarchical levels and the determined additional data during the current evaluation period.

21. A transmission device for transmitting a video signal over a communication network, comprising:

a pre-coding unit configured to pre-code the video signal using hierarchical coding thereby obtaining a pre-coded video signal, the pre-coded video signal being constituted by data distributed into a plurality of hierarchical levels;

a periodic estimating unit configured to periodically estimate a bandwidth of the communication network over evaluation periods;

a selecting unit configured to select, for a current evaluation period for evaluating a bandwidth available on the communication network, a set of hierarchical levels, wherein a transmission rate of the data of the selected hierarchical levels is compatible with the bandwidth estimated for the current evaluation period;

an estimating unit configured to estimate a change tendency of the bandwidth for a future following evaluation period for evaluating a bandwidth available on the communication network that will follow the current evaluation period;

a determining unit configured to determine additional data of the video signal to transmit depending on the estimated change tendency of the bandwidth,

wherein the additional data are chosen from among data of the current evaluation period or data of the following evaluation period,

wherein if the bandwidth for the following evaluation period has a tendency to increase, the additional data are chosen in at least one hierarchical level higher than the set of hierarchical levels selected for the current evaluation period, and

wherein if the bandwidth for the following evaluation period has a tendency to decrease, the additional data are chosen from among at least one hierarchical level of the following evaluation period, wherein the hierarchical level is identical to a hierarchical level of the set of hierarchical levels selected for the current evaluation period; and

a transmitting unit configured to transmit the data of the selected hierarchical levels and the determined additional data during the current evaluation period.