Distributed leaky bucket based multi-modem scheduler for multimedia streams

• US 10,284,475 B2
• Filed: 11/11/2017
• Issued: 05/07/2019
• Est. Priority Date: 11/14/2016
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Gholmieh, Ralph Akram, Veerepalli, Sivaramakrishna, Wang, Min, Yadagiri, Susheel Kumar Yadav, Tutpetkeshavamurthy, Varun, Vishin, Sanjay
• Primary Examiner(s): Nguyen, Thai
• Application Number:
  US15/810,045
• Publication Number:
  US 20180139140A1
• Time in Patent Office: 542 Days
• CPC Class Codes: B60W 2556/45 External transmission of data to or from the vehicle
• CPC Class Codes: G08C 2201/42 Transmitting or receiving remote control signals via a network
• CPC Class Codes: H04L 2012/5637 Leaky Buckets
• CPC Class Codes: H04L 47/00 Traffic control in data switching networks arrangements for detecting or preventing errors in the information received H04L1/00
• CPC Class Codes: H04L 47/21 using leaky-bucket
• CPC Class Codes: H04W 28/02 Traffic management, e.g. flow control or congestion control
• CPC Class Codes: H04W 28/22 Negotiating communication rate

Abstract

Systems, methods, and devices of the various embodiments provide a multipath communication scheduler for an in-vehicle computing device, such as a vehicle'"'"'s autonomous driving system, vehicle'"'"'s telematics unit, vehicle'"'"'s control system, etc. In various embodiments, a distributed leaky bucket based scheduler for an in-vehicle computing device may assign packets for transport to a plurality of modems based at least in part on the determined delivery delays. In various embodiments, delivery delays may be determined based on leaky bucket levels, burst sizes, delivery rates, and end to end delay estimates for each of the plurality of modems. In various embodiments, the scheduler may be one of a plurality of schedulers each associated with a separate stream of packets assigned to the plurality of modems and the leaky bucket levels may be determined on a per stream basis.

Claims

1. A method for multi path transmission from a vehicle, comprising:

receiving, in a scheduler running on a processor of an in-vehicle computing device, a packet for transport;

determining, in the scheduler, delivery delays associated with a plurality of modems based at least in part on leaky bucket levels of packet streams associated with each modem of the plurality of modems; and

assigning, by the scheduler, the packet to two or more of the plurality of modems based at least in part on the determined delivery delays,

wherein the scheduler determines the delivery delays associated with the plurality of modems and assigns the packet to two or more of the plurality of modems in response to a determination that a scenario for multipath transmission is occurring.

2. The method of claim 1, wherein determining the delivery delays associated with the plurality of modems based at least in part on the leaky bucket levels of packet streams associated with each modem of the plurality of modems comprises determining, in the scheduler, the delivery delays based at least in part on the leaky bucket levels of packet streams and delivery rates for each delivery path associated with each of the plurality of modems.

3. The method of claim 2, wherein the delivery delays are further determined based on end to end delay estimates for each of the plurality of modems.

4. The method of claim 1, wherein:

the scheduler is one of a plurality of schedulers each associated with a separate stream of packets assigned to the plurality of modems; and

the leaky bucket levels of packet streams are determined on a per packet stream basis.

5. The method of claim 4, wherein:

a leaky bucket rate and burst size are determined based on aggregate rate feedback from each modem of the plurality of modems at each update time of the leaky bucket rate and burst size.

6. The method of claim 5, wherein the leaky bucket levels of packet streams are adjusted based at least in part on queue feedback from the plurality of modems.

7. The method of claim 4, wherein the plurality of modems is three or more modems and the plurality of schedulers is three or more schedulers.

8. The method of claim 1, wherein assigning, by the scheduler, the packet to two or more of the plurality of modems based at least in part on the determined delivery delays comprises assigning, by the scheduler, the packet to two or more of the plurality of modems based at least in part on the determined delivery delays and a path priority.

9. The method of claim 1, further comprising:

determining, in the scheduler, an adjusted media generation rate based at least in part on an available bandwidth; and

controlling, by the scheduler, one or more encoders providing packets to the scheduler for transport according to the adjusted media generation rate.

10. The method of claim 1, wherein the plurality of modems is three or more modems.

11. The method of claim 1, wherein the scenario for multipath transmission is an ongoing scenario during vehicle operation.

12. The method of claim 1, wherein:

the packet for transport supports remote teleoperation of the vehicle in which the in-vehicle computing device is installed; and

the scenario for multi path transmission is a scenario for remote teleoperation of the vehicle.

13. The method of claim 12, further comprising transmitting the packet from the assigned two or more of the plurality of modems to a remote teleoperator computing device.

14. The method of claim 13, wherein the transmission is a Multipath Real-Time Transport Protocol (MPRTP) transmission.

15. An in-vehicle computing device, comprising:

a processor configured with processor-executable instructions to perform operations comprising;

receiving a packet for transport;

determining delivery delays associated with a plurality of modems based at least in part on leaky bucket levels of packet streams associated with each modem of the plurality of modems; and

assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays,

wherein determining the delivery delays associated with the plurality of modems and assigning the packet to two or more of the plurality of modems are performed in response to a determination that a scenario for multi path transmission is occurring.

16. The in-vehicle computing device of claim 15, wherein the processor is configured with processor-executable instructions to perform operations such that determining the delivery delays associated with the plurality of modems based at least in part on the leaky bucket levels of packet streams associated with each modem of the plurality of modems comprises determining the delivery delays associated with the plurality of modems based at least in part on the leaky bucket levels of packet streams and delivery rates for each delivery path associated with each of the plurality of modems.

17. The in-vehicle computing device of claim 16, wherein the processor is configured with processor-executable instructions to perform operations such that the delivery delays are further determined based on end to end delay estimates for each of the plurality of modems.

18. The in-vehicle computing device of claim 15, wherein the processor is configured with processor-executable instructions to perform operations such that:

each one of a plurality of schedulers is associated with a separate stream of packets assigned to the plurality of modems; and

the leaky bucket levels of packet streams are determined on a per packet stream basis.

19. The in-vehicle computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations such that:

a leaky bucket rate and burst size are determined based on aggregate rate feedback from each modem of the plurality of modems at each update time of the leaky bucket rate and burst size.

20. The in-vehicle computing device of claim 19, wherein the processor is configured with processor-executable instructions to perform operations such that the leaky bucket levels of packet streams are adjusted based at least in part on queue feedback from the plurality of modems.

21. The in-vehicle computing device of claim 18, wherein the processor is configured with processor-executable instructions to perform operations such that the plurality of modems is three or more modems and the plurality of schedulers is three or more schedulers.

22. The in-vehicle computing device of claim 15, wherein the processor is configured with processor-executable instructions to perform operations such that assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays comprises assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays and a path priority.

23. The in-vehicle computing device of claim 15, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

determining an adjusted media generation rate based at least in part on an available bandwidth; and

controlling one or more encoders providing packets for transport according to the adjusted media generation rate.

24. The in-vehicle computing device of claim 15, wherein the processor is configured with processor-executable instructions to perform operations such that the plurality of modems is three or more modems.

25. The in-vehicle computing device of claim 15, wherein the processor is configured with processor-executable instructions to perform operations such that the scenario for multipath transmission is an ongoing scenario during vehicle operation.

26. The in-vehicle computing device of claim 15, wherein the processor is configured with processor-executable instructions to perform operations such that:

the packet for transport supports remote teleoperation of a vehicle in which the in-vehicle computing device is installed; and

the scenario for multipath transmission is a scenario for remote teleoperation of the vehicle.

27. The in-vehicle computing device of claim 26, wherein the processor is configured with processor-executable instructions to perform operations further comprising transmitting the packet from the assigned two or more of the plurality of modems to a remote teleoperator computing device.

28. The in-vehicle computing device of claim 27, wherein the processor is configured with processor-executable instructions to perform operations such that the transmission is a Multipath Real-Time Transport Protocol (MPRTP) transmission.

29. An in-vehicle computing device, comprising:

means for receiving a packet for transport;

means for determining delivery delays associated with a plurality of modems based at least in part on leaky bucket levels of packet streams associated with each modem of the plurality of modems; and

means for assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays,

wherein determining the delivery delays associated with the plurality of modems and assigning the packet to two or more of the plurality of modems are performed in response to a determination that a scenario for multipath transmission is occurring.

30. The in-vehicle computing device of claim 29, wherein the means for determining the delivery delays associated with the plurality of modems based at least in part on the leaky bucket levels of packet streams associated with each modem of the plurality of modems comprises means for determining the delivery delays associated with the plurality of modems based at least in part on the leaky bucket levels of packet streams and delivery rates for each delivery path associated with each of the plurality of modems.

31. The in-vehicle computing device of claim 30, wherein the means for the determining delivery delays based at least in part on the leaky bucket levels of packet streams and the delivery rates for each delivery path associated with each of the plurality of modems comprises means for determining the delivery delays based at least in part on the leaky bucket levels of packet streams, the delivery rates for each delivery path associated with each of the plurality of modems, and end to end delay estimates for each of the plurality of modems.

32. The in-vehicle computing device of claim 29, wherein:

each one of a plurality of schedulers is associated with a separate stream of packets assigned to the plurality of modems; and

the leaky bucket levels of packet streams are determined on a per packet stream basis.

33. The in-vehicle computing device of claim 32, wherein:

a leaky bucket rate and burst size are determined based on aggregate rate feedback from each modem of the plurality of modems at each update time of the leaky bucket rate and burst size.

34. The in-vehicle computing device of claim 33, wherein the leaky bucket levels of packet streams are adjusted based at least in part on queue feedback from the plurality of modems.

35. The in-vehicle computing device of claim 32, wherein the plurality of modems is three or more modems and the plurality of schedulers is three or more schedulers.

36. The in-vehicle computing device of claim 29, wherein the means for assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays comprises means for assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays and a path priority.

37. The in-vehicle computing device of claim 29, further comprising:

means for determining an adjusted media generation rate based at least in part on an available bandwidth; and

means for controlling one or more encoders providing packets for transport according to the adjusted media generation rate.

38. The in-vehicle computing device of claim 29, wherein the plurality of modems is three or more modems.

39. The in-vehicle computing device of claim 29, wherein the scenario for multipath transmission is an ongoing scenario during vehicle operation.

40. The in-vehicle computing device of claim 29, wherein:

the packet for transport supports remote teleoperation of a vehicle in which the in-vehicle computing device is installed; and

the scenario for multipath transmission is a scenario for remote teleoperation of the vehicle.

41. The in-vehicle computing device of claim 40, further comprising means for transmitting the packet from the assigned two or more of the plurality of modems to a remote teleoperator computing device.

42. The in-vehicle computing device of claim 41, wherein the transmission is a Multipath Real-Time Transport Protocol (MPRTP) transmission.

43. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of an in-vehicle computing device to perform operations comprising:

receiving a packet for transport;

determining delivery delays associated with a plurality of modems based at least in part on leaky bucket levels of packet streams associated with each modem of the plurality of modems; and

assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays,

wherein determining the delivery delays associated with the plurality of modems and assigning the packet to two or more of the plurality of modems are performed in response to a determination that a scenario for multipath transmission is occurring.

44. The non-transitory processor-readable storage medium of claim 43, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that determining the delivery delays associated with a plurality of modems based at least in part on the leaky bucket levels of packet streams associated with each modem of the plurality of modems comprises determining the delivery delays associated with the plurality of modems based at least in part on the leaky bucket levels of packet streams and delivery rates for each delivery path associated with each of the plurality of modems.

45. The non-transitory processor-readable storage medium of claim 44, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that the delivery delays are further determined based on end to end delay estimates for each of the plurality of modems.

46. The non-transitory processor-readable storage medium of claim 43, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that:

each one of a plurality of schedulers is associated with a separate stream of packets assigned to the plurality of modems; and

the leaky bucket levels of packet streams are determined on a per packet stream basis.

47. The non-transitory processor-readable storage medium of claim 46, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that:

a leaky bucket rate and burst size are determined based on aggregate rate feedback from each modem of the plurality of modems at each update time of the leaky bucket rate and burst size.

48. The non-transitory processor-readable storage medium of claim 47, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that the leaky bucket levels of packet streams are adjusted based at least in part on queue feedback from the plurality of modems.

49. The non-transitory processor-readable storage medium of claim 46, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that the plurality of modems is three or more modems and the plurality of schedulers is three or more schedulers.

50. The non-transitory processor-readable storage medium of claim 43, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays comprises assigning the packet to two or more of the plurality of modems based at least in part on the determined delivery delays and a path priority.

51. The non-transitory processor-readable storage medium of claim 43, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations further comprising:

determining an adjusted media generation rate based at least in part on an available bandwidth; and

controlling one or more encoders providing packets for transport according to the adjusted media generation rate.

52. The non-transitory processor-readable storage medium of claim 43, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that the plurality of modems is three or more modems.

53. The non-transitory processor-readable storage medium of claim 43, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that the scenario for multipath transmission is an ongoing scenario during vehicle operation.

54. The non-transitory processor-readable storage medium of claim 43, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that:

the packet for transport supports remote teleoperation of a vehicle in which the in-vehicle computing device is installed; and

the scenario for multi path transmission is a scenario for remote teleoperation of the vehicle.

55. The non-transitory processor-readable storage medium of claim 54, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations further comprising transmitting the packet from the assigned two or more of the plurality of modems to a remote teleoperator computing device.

56. The non-transitory processor-readable storage medium of claim 55, wherein the stored processor-executable instructions are configured to cause the processor of the in-vehicle computing device to perform operations such that the transmission is a Multipath Real-Time Transport Protocol (MPRTP) transmission.