System and method for modifying a video stream based on a client or network environment

• US 8,352,991 B2
• Filed: 12/13/2002
• Issued: 01/08/2013
• Est. Priority Date: 12/09/2002
• Status: Active Grant

• Current Assignee: InterDigital Patent Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Cahnbley, Jens, Richardson, John William
• Primary Examiner(s): SHANG, ANNAN Q
• Application Number:
  US10/498,737
• Publication Number:
  US 20040261135A1
• Time in Patent Office: 3,679 Days
• Field of Search: 725 87-118, 725/181, 725/146, 725/148, 209217-231
• US Class Current: 725/93
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4424 Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used error monitoring in general G06F11/30; arrangements for monitoring conditions of receiving stations in broadcast systems H04H60/32; diagnosis, testing or measuring for television receivers H04N17/04
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38

Abstract

A Video Server (VS 100) encodes a video stream according to the values of parameters and transmits the video stream over a Network to a Video Client (VC 200) that decodes the received video stream for presentation to a user. As the video stream is being received, (VC 200 continually gathers data regarding at least the condition of Network sends this data to (VS 100). (VS 100) modifies the values of the parameters based on the data received from (VC 200), which in turn modifies the encoding of the video stream.

Claims

1. A method for modifying a video stream being encoded according to the values of one or more parameters and being delivered through a network, the method comprising:

obtaining data related at least to the ability of the network to transport the video stream to a client device and related to the ability of the client to decode the video stream during the delivery of the encoded video stream, wherein the obtaining comprises obtaining a measurement representing resources available at the client device for decoding the video stream being delivered to the client device including at least one of;

available processor power able to be used by the client device in decoding the video stream, associated packet loss, and associated bytes transmitted and received; and

modifying the values of the one or more parameters according to which the video stream is being encoded based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate and wherein the modifying comprises modifying the frame rate value based on the obtained data; and

adjusting encoding of the video stream in response to modifying the values of the one or more parameters.

2. The method of claim 1, wherein the client device comprises a computer.

3. The method of claim 1, wherein the client device comprises a cell phone.

4. The method of claim 1, wherein the client device comprises a handheld device.

5. A method for modifying a video stream being encoded according to the values of one or more parameters and being delivered to a computer through a network, the method comprising:

obtaining data related to the ability of the network to transport the video stream to the computer and related to the ability of the computer to decode the video stream during the delivery of the encoded video stream, wherein the obtaining comprises obtaining a measurement representing resources available at the computer for decoding the video stream being delivered to the computer including at least one of;

available processor power able to be used in decoding the video stream, associated packet loss, and associated bytes transmitted and received; and

modifying the values of the one or more parameters according to which the video stream is being encoded based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate and wherein the modifying comprises modifying the frame rate value based on the obtained data; and

adjusting encoding of the video stream in response to modifying the values of the one or more parameters.

6. The method of claim 5, wherein the one or more parameters according to which the video stream is being encoded includes a frame resolution;

and

wherein the modifying comprises modifying the frame resolution value based on the obtained data.

7. The method of claim 5, wherein the obtaining comprises obtaining the data related to the computer or the network in RTCP packets received from the computer.

8. The method of claim 5, wherein the obtaining comprises obtaining the data related to the computer or the network in the application specific portion of the RTCP packets received from the computer.

9. The method of claim 5, wherein the obtaining comprises obtaining a measurement representing a bit error rate associated with the delivery of the video stream through the network to the computer.

10. The method of claim 5, wherein the obtaining comprises:

gathering the data at the computer; and

receiving the gathered data from the computer.

11. A method for facilitating the modification of a video stream being encoded by a first computer according to the values of one or more parameters and being transmitted by the first computer through a network to a second computer, the method comprising:

gathering data at the second computer during the transmission of the encoded video stream by the first computer related to the ability of the network to transport the video stream to the second computer and related to the ability of the second computer to decode the video stream, wherein the gathering data comprises obtaining a measurement representing resources available at the second computer for decoding the video stream being delivered to the second computer including at least one of;

available processor power able to be used by the second computer in decoding the video stream, associated packet loss, and associated bytes transmitted and received; and

transmitting the gathered data to the first computer during the transmission of the encoded video stream by the first computer to enable the modification of the values of the one or more parameters according to which the first computer is encoding the video stream based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges and enable the adjustment of the encoding of the video stream in response to the modification of the values of the one or more parameters, wherein the transmitting comprises transmitting the gathered data in the application specific portion of RTCP packets being sent to the first computer.

12. The method of claim 11 wherein the one or more parameters includes a frame rate.

13. A system for modifying a video stream being encoded according to the values of one or more parameters and being delivered through a network, the system comprising:

means for obtaining data related at least to the ability of the network to transport the video stream during the delivery of the encoded video stream, wherein the obtained data relates to the ability of the network to transport the video stream to a client device and relates to the ability of the client device to decode the video stream, and wherein the means for obtaining comprises means for obtaining a measurement representing resources available at the client device for decoding the video stream being delivered to the client device including at least one of;

available processor power able to be used by the client device in decoding the video stream, associated packet loss, and bytes transmitted and received; and

means for modifying the values of the one or more parameters according to which the video stream is being encoded based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate, and wherein the means for modifying comprises modifying the frame rate value based on the obtained data; and

means for adjusting encoding of the video stream in response to modifying the values of the one or more parameters.

14. The method of claim 13, wherein the client device comprises a computer.

15. The method of claim 13, wherein the client device comprises a cell phone.

16. The method of claim 13, wherein the client device comprises a hand-held device.

17. A system for modifying a video stream being encoded according to the values of one or more parameters and being delivered to a computer through a network, the system comprising:

means for obtaining data related to the ability of the network to transport the video stream to the computer and related to the ability of the computer to decode the video stream during the delivery of the encoded video stream, wherein the means for obtaining comprises means for obtaining a measurement representing resources available at the computer for decoding the video stream being delivered to the computer including at least one of;

available processor power able to be used by the computer in decoding the video stream, associated packet loss, and bytes transmitted and received; and

means for modifying the values of the one or more parameters according to which the video stream is being encoded based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate, and wherein the means for modifying comprises modifying the frame rate value based on the obtained data; and

means for adjusting encoding of the video stream in response to modifying the values of the one or more parameters.

18. The system of claim 17, wherein the one or more parameters according to which the video stream is being encoded includes a frame resolution;

and

wherein the means for modifying comprises means for modifying the frame resolution value based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges.

19. The system of claim 17, wherein the means for obtaining comprises means for obtaining the data related to the computer or the network in RTCP packets received from the computer.

20. The system of claim 17, wherein the means for obtaining comprises means for obtaining a measurement representing a bit error rate associated with the delivery of the video stream through the network to the computer.

21. A system for facilitating the modification of a video stream being encoded by a first computer according to the values of one or more parameters and being transmitted by the first computer through a network to a second computer, the system comprising:

means for gathering data at the second computer during the transmission of the encoded video stream by the first computer related to the ability of the network to transport the video stream to the second computer and related to the ability of the second computer to decode the video stream, wherein the means for gathering data comprises means for obtaining a measurement representing resources available at the second computer for decoding the video stream being delivered to the second computer including at least one of;

available processor power able to be used by the second computer in decoding the video stream, associated packet loss, and bytes transmitted and received;

means for transmitting the gathered data to the first computer during the transmission of the encoded video stream by the first computer to enable the modification of the values of the one or more parameters according to which the first computer is encoding the video stream based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges and enable the adjustment of the encoding of the video stream in response to the modification of the values of the one or more parameters, wherein the means for transmitting comprises means for transmitting the gathered data in the application specific portion of RTCP packets being sent to the first computer.

22. The system of claim 21 wherein the one or more parameters includes a frame rate.

23. A computer program product comprising a computer usable medium having computer readable code embodied therein, the computer readable code, when executed, causing a computer to implement a method for modifying a video stream being encoded according to the values of one or more parameters and being delivered through a network, the method comprising:

obtaining data related at least to the ability of the network to transport the video stream to a client device and related to the ability of the client device to decode the video during the delivery of the encoded video stream, wherein the obtaining comprises obtaining a measurement representing resources available at the client device for decoding the video stream being delivered to the client device including at least one of;

available processor power able to be used by the client device in decoding the video stream, associated packet loss, and bytes transmitted and received; and

modifying the values of the one or more parameters according to which the video stream is being encoded based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate, and wherein the modifying comprises modifying the frame rate value based on the obtained data; and

adjusting encoding of the video stream in response to modifying the values of the one or more parameters.

24. A computer program product comprising a computer usable medium having computer readable code embodied therein, the computer readable code, when executed, causing a computing device to implement a method for modifying a video stream being encoded according to the values of one or more parameters and being delivered to a computer through a network, the method comprising:

obtaining data related to the ability of the network to transport the video stream to the computer and related to the ability of the computer to decode the video stream during the delivery of the encoded video stream, wherein the obtaining comprises obtaining a measurement representing resources-available at the computer for decoding the video stream being delivered to the computer including at least one of;

available processor power able to be used by the computer in decoding the video stream, associated packet loss, and bytes transmitted and received; and

modifying the values of the one or more parameters according to which the video stream is being encoded based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges, wherein the one or more parameters according to which the video stream is being encoded includes a frame rate, and wherein the modifying comprises modifying the frame rate value based on the obtained data; and

adjusting encoding of the video stream in response to modifying the values of the one or more parameters.

25. The computer program product of claim 24, wherein the one or more parameters according to which the video stream is being encoded includes a frame resolution;

and

wherein, in the implemented method, the modifying comprises modifying the frame resolution value based on the obtained data.

26. The computer program product of claim 24, wherein, in the implemented method, the obtaining comprises obtaining the data related to the computer or the network in RTCP packets received from the computer.

27. The computer program product of claim 24, wherein, in the implemented method, the obtaining comprises obtaining a measurement representing a bit error rate associated with the delivery of the video stream through the network to the computer.

28. A computer program product comprising a computer usable medium having computer readable code embodied therein, the computer readable code, when executed, causing a computer to implement a method for facilitating the modification of a video stream being encoded by a first computer according to the values of one or more parameters and being transmitted by the first computer through a network to a second computer, the method comprising:

gathering data at the second computer related to the ability of the network to transport the video stream to the second computer and related to the ability of the second computer to decode the video stream during the transmission of the encoded video stream by the first computer, wherein the gathering comprises obtaining a measurement representing resources available at the second computer for decoding the video stream being delivered to the second computer including at least one of;

available processor power able to be used by the second computer in decoding the video stream, associated packet loss, and bytes transmitted and received; and

transmitting the gathered data during the transmission of the encoded video stream by the first computer to the first computer to enable the modification of the values of the one or more parameters according to which the first computer is encoding the video stream based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges and enable the adjustment of the encoding of the video stream in response to the modification of the values of the one or more parameters, wherein the transmitting comprises transmitting the gathered data in the application specific portion of RTCP packets being sent to the first computer.

29. The computer program product of claim 28 wherein the one or more parameters includes a frame rate.

30. A method for facilitating the modification of a video stream being encoded by a computer according to the values of one or more parameters and being transmitted by the computer through a network to a client device, the method comprising:

gathering data at the client device related to the ability of the network to transport the video stream to the client device and related to the ability of the client device to decode the video stream during the transmission of the encoded video stream, wherein the gathering comprises obtaining a measurement representing resources available at the client device for decoding the video stream being delivered to the client device including at least one of;

available processor power able to be used by the client device in decoding the video stream, associated packet loss, and bytes transmitted and received; and

transmitting the gathered data to the computer to enable the modification of the values of the one or more parameters according to which the computer is encoding the video stream based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges and enable the adjustment of the encoding of the video stream in response to the modification of the values of the one or more parameters, wherein the transmitting comprises transmitting the gathered data in the application specific portion of RTCP packets being sent to the computer.

31. The method of claim 30 wherein the one or more parameters includes a frame rate.

32. A system for facilitating the modification of a video stream being encoded by a computer according to the values of one or more parameters and being transmitted by the computer though a network to a client device, the system comprising:

means for gathering data at the client device related to the ability of the network to transport the video stream to the client device and related to the ability of the client device to decode the video stream during the transmission of the encoded video stream, wherein the means for gathering comprises means for obtaining a measurement representing resources available at the client device for decoding the video stream being delivered to the client device including at least one of;

available processor power able to be used by the client device in decoding the video stream, associated packet loss, and bytes transmitted and received; and

means for transmitting the gathered data to the computer to enable the modification of the values of the one or more parameters according to which the computer is encoding the video stream based on tables of predefined ranges for the obtained data and predefined values corresponding to the predefined ranges and enable the adjustment of the encoding of the video stream in response to the modification of the values of the one or more parameters, wherein the means for transmitting comprises means for transmitting the gathered data in the application specific portion of RTCP packets being sent to the computer.

33. The system of claim 32 wherein the one or more parameters includes a frame rate.