System and method for modifying a video stream based on a client or network enviroment

• US 20040261135A1
• Filed: 06/15/2004
• Published: 12/23/2004
• Est. Priority Date: 12/09/2002
• Status: Active Grant

• Current Assignee: InterDigital Patent Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Richardson, John William, Cahnbley, Jens
• Granted Patent: US 8,352,991 B2
• Time in Patent Office: Days
• US Class Current: 725/146
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4424 Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used error monitoring in general G06F11/30; arrangements for monitoring conditions of receiving stations in broadcast systems H04H60/32; diagnosis, testing or measuring for television receivers H04N17/04
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38

Abstract

A Video Server (VS 100) encodes a video stream according to the values of parameters and transmits the video stream over a Network to a Video Client (VC 200) that decodes the received video stream for presentation to a user. As the video stream is being received, (VC 200 continually gathers data regarding at least the condition of Network sends this data to (VS 100). (VS 100) modifies the values of the parameters based on the data received from (VC 200), which in turn modifies the encoding of the video stream.

Claims

1. A method for modifying a video stream being encoded according to the values of one or more parameters and being delivered through a network, the method comprising:

obtaining data related at least to the ability of the network to transport the video stream; and

modifying the values of the one or more parameters according to which the video stream is being encoded based on the obtained data.

2. A method for modifying a video stream being encoded according to the values of one or more parameters and being delivered to a computer through a network, the method comprising:

obtaining data related to the ability of the network to transport the video stream to the computer and related to the ability of the computer to decode the video stream; and

modifying the values of the one or more parameters according to which the video stream is being encoded based on the obtained data.

3. The method of claim 2, wherein the one or more parameters according to which the video stream is being encoded includes a frame resolution;

and

wherein the modifying comprises modifying the frame resolution value based on the obtained data.

4. The method of claim 2, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate;

and

wherein the modifying comprises modifying the frame rate value based on the obtained data.

5. The method of claim 2, wherein the obtaining comprises obtaining the data related to the computer or the network in RTCP packets received from the computer.

6. The method of claim 5, wherein the obtaining comprises obtaining the data related to the computer or the network in the application specific portion of the RTCP packets received from the computer.

7. The method of claim 2, wherein the obtaining comprises obtaining a measurement representing the resources available at the computer for decoding the video stream being delivered to the computer.

8. The method of claim 7, wherein the obtaining comprises obtaining a measurement representing the computer processor power available at the computer for decoding the video stream being delivered to the computer.

9. The method of claim 2, wherein the obtaining comprises obtaining a measurement representing the packet loss associated with the delivery of the video stream through the network to the computer.

10. The method of claim 2, wherein the obtaining comprises obtaining a measurement representing the bytes transmitted and the bytes received associated with the delivery of the video stream through the network to the computer.

11. The method of claim 2, wherein the obtaining comprises obtaining a measurement representing a bit error rate associated with the delivery of the video stream through the network to the computer.

12. The method of claim 2, wherein the obtaining comprises:

gathering the data at the computer; and

receiving the gathered data from the computer.

13. A method for facilitating the modification of a video stream being encoded by a first computer according to the values of one or more parameters and being transmitted by the first computer through a network to a second computer, the method comprising:

gathering data at the second computer related to the ability of the network to transport the video stream to the second computer and related to the ability of the second computer to decode the video stream; and

transmitting the gathered data to the first computer to enable the modification of the values of the one or more parameters according to which the first computer is encoding the video stream.

14. The method of claim 13, wherein the transmitting comprises transmitting the gathered data in the application specific portion of RTCP packets being sent to the first computer.

15. A system for modifying a video stream being encoded according to the values of one or more parameters and being delivered through a network, the system comprising:

means for obtaining data related at least to the ability of the network to transport the video stream; and

means for modifying the values of the one or more parameters according to which the video stream is being encoded based on the obtained data.

16. A system for modifying a video stream being encoded according to the values of one or more parameters and being delivered to a computer through a network, the system comprising:

means for obtaining data related to the ability of the network to transport the video stream to the computer and related to the ability of the computer to decode the video stream; and

means for modifying the values of the one or more parameters according to which the video stream is being encoded based on the obtained data.

17. The system of claim 16, wherein the one or more parameters according to which the video stream is being encoded includes a frame resolution;

and

wherein the means for modifying comprises means for modifying the frame resolution value based on the obtained data.

18. The system of claim 16, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate;

and

wherein the means for modifying comprises modifying the frame rate value based on the obtained data.

19. The system of claim 16, wherein the means for obtaining comprises means for obtaining the data related to the computer or the network in RTCP packets received from the computer.

20. The system of claim 16, wherein the means for obtaining comprises means for obtaining a measurement representing the computer processor power available at the computer for decoding the video stream being delivered to the computer.

21. The system of claim 16, wherein the means for obtaining comprises means for obtaining a measurement representing the packet loss associated with the delivery of the video stream through the network to the computer.

22. The system of claim 16, wherein the means for obtaining comprises means for obtaining a measurement representing the bytes transmitted and the bytes received associated with the delivery of the video stream through the network to the computer.

23. The system of claim 16, wherein the means for obtaining comprises means for obtaining a measurement representing a bit error rate associated with the delivery of the video stream through the network to the computer.

24. A system for facilitating the modification of a video stream being encoded by a first computer according to the values of one or more parameters and being transmitted by the first computer through a network to a second computer, the system comprising:

means for gathering data at the second computer related to the ability of the network to transport the video stream to the second computer and related to the ability of the second computer to decode the video stream; and

means for transmitting the gathered data to the first computer to enable the modification of the values of the one or more parameters according to which the first computer is encoding the video stream.

25. The system of claim 24, wherein the means for transmitting comprises means for transmitting the gathered data in the application specific portion of RTCP packets being sent to the first computer.

26. A computer program product comprising a computer usable medium having computer readable code embodied therein, the computer readable code, when executed, causing a computer to implement a method for modifying a video stream being encoded according to the values of one or more parameters and being delivered through a network, the method comprising:

obtaining data related at least to the ability of the network to transport the video stream; and

modifying the values of the one or more parameters according to which the video stream is being encoded based on the obtained data.

27. A computer program product comprising a computer usable medium having computer readable code embodied therein, the computer readable code, when executed, causing a computer to implement a method for modifying a video stream being encoded according to the values of one or more parameters and being delivered to a computer through a network, the method comprising:

obtaining data related to the ability of the network to transport the video stream to the computer and related to the ability of the computer to decode the video stream;

modifying the values of the one or more parameters according to which the video stream is being encoded based on the obtained data.

28. The computer program product of claim 27, wherein the one or more parameters according to which the video stream is being encoded includes a frame resolution;

and

wherein, in the implemented method, the modifying comprises modifying the frame resolution value based on the obtained data.

29. The computer program product of claim 27, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate;

and

wherein, in the implemented method, the modifying comprises modifying the frame rate value based on the obtained data.

30. The computer program product of claim 27, wherein, in the implemented method, the obtaining comprises obtaining the data related to the computer or the network in RTCP packets received from the computer.

31. The computer program product of claim 27, wherein, in the implemented method, the obtaining comprises obtaining a measurement representing the computer processor power available at the computer for decoding the video stream being delivered to the computer.

32. The computer program product of claim 27, wherein, in the implemented method, the obtaining comprises obtaining a measurement representing the packet loss associated with the delivery of the video stream through the network to the computer.

33. The computer program product of claim 27, wherein, in the implemented method, the obtaining comprises obtaining a measurement representing the bytes transmitted and the bytes received associated with the delivery of the video stream through the network to the computer.

34. The computer program product of claim 27, wherein, in the implemented method, the obtaining comprises obtaining a measurement representing a bit error rate associated with the delivery of the video stream through the network to the computer.

35. A computer program product comprising a computer usable medium having computer readable code embodied therein, the computer readable code, when executed, causing a computer to implement a method for facilitating the modification of a video stream being encoded by a first computer according to the values of one or more parameters and being transmitted by the first computer through a network to a second computer, the method comprising:

gathering data at the second computer related to the ability of the network to transport the video stream to the second computer and related to the ability of the second computer to decode the video stream; and

transmitting the gathered data to the first computer to enable the modification of the values of the one or more parameters according to which the first computer is encoding the video stream.

36. The computer program product of claim 35, wherein, in the implemented method, the transmitting comprises transmitting the gathered data in the application specific portion of RTCP packets being sent to the first computer.