Congestion control bitrate algorithm

• US 9,998,388 B2
• Filed: 02/06/2014
• Issued: 06/12/2018
• Est. Priority Date: 02/06/2014
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Inventors: Rickeby, Christian, Yong, Kelvin
• Primary Examiner(s): Crutchfield, Christopher
• Assistant Examiner(s): LINDENBAUM, ALAN LOUIS
• Application Number:
  US14/174,747
• Publication Number:
  US 20150222555A1
• Time in Patent Office: 1,587 Days
• Field of Search: None
• CPC Class Codes: H04L 1/0009 by adapting the channel coding H04L1/1812 takes precedence
• CPC Class Codes: H04L 1/0057 Block codes H04L1/0061, H04L1/0064 take precedence
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/34 ensuring sequence integrity, e.g. using sequence numbers

Abstract

The method may include sending, via an unreliable protocol, a stream of data packets to at least one recipient device over a network. The stream of data packets may include source packets and forward error correction (FEC) packets. The method may include, during said sending, receiving one or more feedback reports from the at least one recipient device, each said periodic feedback report characterizing packet loss during a corresponding period of time. The method may also include, during said sending, adjusting a rate at which said data packets are sent in the stream in response to at least one of said feedback reports. Adjusting the rate may include increasing a FEC rate at which the FEC packets are sent while maintaining a source rate at which the source packets are sent in response to a one of the feedback reports which characterizes the packet loss as within an acceptable level.

Claims

1. A method comprising, with a sender computing system:

sending, via an unreliable protocol, a stream of data packets to one or more recipient devices over a network, the stream of data packets including source packets and forward error correction (FEC) packets;

during said sending, determining a predetermined amount of data packets that will be sent during respective periods of time corresponding to regular streaming periods for periodic feedback reports;

during said sending, receiving one or more feedback reports from the one or more recipient devices, each said periodic feedback report characterizing packet loss during one of said respective periods of time;

normalizing the packet loss in at least one of the feedback reports to the predetermined amount of data packets when a number of data packets sent by the sender computing system during the respective period of time is less than the predetermined amount; and

during said sending, adjusting a rate at which said data packets are sent in the stream in response to at least one of said feedback reports.

2. The method of claim 1,

wherein the unreliable protocol is User Datagram Protocol (UDP).

3. The method of claim 1, further comprising:

with said sender computing system, stamping each said data packet with a sequence number.

4. The method of claim 1, further comprising:

with said sender computing system, stamping each said data packet with a sequence number,

wherein said at least one of the one or more recipient devices characterizes the packet loss in each said feedback report by accumulating the data packets during the respective period of time, and by determining a number of the data packets actually received and a number of the data packets expected to be received from the sequence numbers of the data packets received by the recipient device during the respective period of time.

5. The method of claim 1, further comprising:

with said sender computing system, stamping each said data packet with sequence number;

with at least one of said one or more recipient devices, characterizing the packet loss in each said feedback report by accumulating the data packets during the respective period of time, and by determining a number of the data packets actually received and a number of the data packets expected to be received from the sequence numbers of the data packets received by the recipient device during the respective period of time.

6. The method of claim 1, wherein said adjusting the rate further comprises:

increasing a ratio of the FEC rate to the source rate while maintaining a total rate at which the data packets are sent in response to a particular one of the feedback reports which characterizes the packet loss as outside of an acceptable level.

7. The method of claim 1,

wherein said data packets include audio packets and video packets,

wherein said increasing a FEC rate at which the FEC packets are sent includes increasing both a FEC audio rate at which the FEC audio packets are sent and a FEC video rate at which the FEC video packets are sent,

wherein said increasing both the FEC audio rate and the FEC video rate includes increasing the FEC audio rate by a greater degree than the FEC video rate.

8. The method of claim 1,

wherein said data packets include audio packets and video packets,

wherein said increasing a FEC rate at which the FEC packets are sent includes increasing both a FEC audio rate at which the FEC audio packets are sent and a FEC video rate at which the FEC video packets are sent,

wherein said increasing both the FEC audio rate and the FEC video rate includes increasing the FEC audio rate by two to ten times more than the FEC video rate increase.

9. The method of claim 1,

wherein the one or more feedback reports are a plurality of periodic feedback reports having a pre-defined time interval between generation of each of the feedback reports.

10. The method of claim 1,

wherein the one or more feedback reports are a plurality of periodic feedback reports having a pre-defined time interval between generation of each of the feedback reports,

wherein the time interval is between 100 milliseconds and 1 second.

11. The method of claim 1,

wherein said one or more recipient devices is a plurality of recipient devices.

12. The method of claim 1,

wherein the unreliable protocol is connectionless.

13. The method of claim 1,

wherein the particular one of the feedback reports which indicates the packet loss as within the acceptable level indicates the packet loss as steady relative to a prior one of the feedback reports.

14. The method of claim 1, wherein said adjusting the rate comprises increasing a FEC rate at which the FEC packets are sent while maintaining a source rate at which the source packets are sent in response to a particular one of the feedback reports which characterizes the packet loss as within an acceptable level.

15. A sender computing system comprising:

at least one processor unit;

at least one memory unit coupled to the at least one processor unit;

wherein the at least one processor unit and the at least one memory unit are configured to perform a method, the method comprising;

sending, via an unreliable protocol, a stream of data packets to one or more recipient devices over a network, the stream of data packets including source packets and forward error correction (FEC) packets;

during said sending, determining a predetermined amount of data packets that will be sent during respective periods of time corresponding to regular streaming periods for periodic feedback reports;

during said sending, receiving one or more feedback reports from the one or more recipient devices, each said periodic feedback report characterizing packet loss during one of said respective periods of time;

normalizing the packet loss in at least one of the feedback reports to the predetermined amount of data packets when a number of data packets sent by the sender computing system during the respective period of time is less than the predetermined amount; and

during said sending, adjusting a rate at which said data packets are sent in the stream in response to at least one of said feedback reports,

wherein said adjusting the rate comprises increasing a FEC rate at which the FEC packets are sent while maintaining a source rate at which the source packets are sent in response to a particular one of the feedback reports which characterizes the packet loss as within an acceptable level.

16. The computing system of claim 15, further comprising:

computer readable instructions embodied the at least one memory unit, wherein the instructions are executable by the at least one processor unit to cause the computing system to perform the method.

17. The computing system of claim 15,

wherein the unreliable protocol is UDP.

18. The computing system of claim 15, the method further comprising:

stamping each said data packet with sequence number.

19. The computing system of claim 15, the method further comprising:

stamping each said data packet with sequence number,

wherein said one or more recipient devices characterizes the packet loss in each said feedback report by accumulating the data packets during the respective period of time, and by determining a number of the data packets actually received and a number of the data packets expected to be received from the sequence numbers of the data packets received by the recipient device during the respective period of time.

20. The computing system of claim 15, wherein said adjusting the rate further comprises:

increasing a ratio of the FEC rate to the source rate while maintaining a total rate at which the data packets are sent in response to a particular one of the feedback reports which characterizes the packet loss as outside of an acceptable level.

21. The computing system of claim 15,

wherein said data packets include audio packets and video packets,

wherein said increasing a FEC rate at which the FEC packets are sent includes increasing both a FEC audio rate at which the FEC audio packets are sent and a FEC video rate at which the FEC video packets are sent,

wherein said increasing both the FEC audio rate and the FEC video rate includes increasing the FEC audio rate by a greater degree than the FEC video rate.

22. The computing system of claim 15,

wherein said data packets include audio packets and video packets,

wherein said increasing a FEC rate at which the FEC packets are sent includes increasing both a FEC audio rate at which the FEC audio packets are sent and a FEC video rate at which the FEC video packets are sent,

wherein said increasing both the FEC audio rate and the FEC video rate includes increasing the FEC audio rate by two to ten times more than the FEC video rate increase.

23. The computing system of claim 15,

wherein the one or more feedback reports are a plurality of periodic feedback reports having a pre-defined time interval between generation of each of the feedback reports.

24. The computing system of claim 15,

wherein the one or more feedback reports are a plurality of periodic feedback reports having a pre-defined time interval between generation of each of the feedback reports,

wherein the time interval is between 100 milliseconds and 1 second.

25. The computing system of claim 15,

wherein the one or more recipient devices is a plurality of recipient devices.

26. The computing system of claim 15,

wherein the unreliable protocol is connectionless.

27. The computing system of claim 15,

wherein the particular one of the feedback reports which indicates the packet loss as within the acceptable level indicates the packet loss as steady relative to a prior one of the feedback reports.

28. The computing system of claim 15, wherein said adjusting the rate comprises increasing a FEC rate at which the FEC packets are sent while maintaining a source rate at which the source packets are sent in response to a particular one of the feedback reports which characterizes the packet loss as within an acceptable level.

29. A non-transitory computer readable medium having computer readable instructions embodied therein, the computer readable instructions being configured to implement a method when executed, the method comprising:

sending, via an unreliable protocol, a stream of data packets to one or more recipient devices over a network, the stream of data packets including source packets and forward error correction (FEC) packets;

during said sending, determining a predetermined amount of data packets that will be sent during respective periods of time corresponding to regular streaming periods for periodic feedback reports;

during said sending, receiving one or more feedback reports from the one or more recipient devices, each said periodic feedback report characterizing packet loss during one of said respective periods of time;

during said sending, normalizing the packet loss in at least one of the feedback reports to the predetermined amount of the data packets when a number of data packets sent during the respective period of time is less than the predetermined amount; and

during said sending, adjusting a rate at which said data packets are sent in the stream in response to at least one of said feedback reports.

30. The non-transitory computer readable medium of claim 29, wherein said adjusting the rate comprises increasing a FEC rate at which the FEC packets are sent while maintaining a source rate at which the source packets are sent in response to a particular one of the feedback reports which characterizes the packet loss as within an acceptable level.