Content- and link-dependent coding adaptation for multimedia telephony

• US 8,537,197 B2
• Filed: 01/10/2008
• Issued: 09/17/2013
• Est. Priority Date: 01/10/2007
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Garudadri, Harinath, Sundarraman, Chandru, Vij, Gajinder, Srinivasamurthy, Naveen B., Sagetong, Phoom, Chung, Hyukjune
• Primary Examiner(s): NGUYEN, TUAN DUC
• Application Number:
  US11/972,594
• Publication Number:
  US 20090021572A1
• Time in Patent Office: 2,077 Days
• Field of Search: 348/14.01
• US Class Current: 348/14.12
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 65/1059 End-user terminal functionalities specially adapted for real-time communication
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04W 72/54 based on quality criteria

Abstract

This disclosure describes techniques that can facilitate multimedia telephony. In one example, a method for communication of multimedia data comprises determining a first level of throughput associated with multimedia data communication from a first access terminal to a network, determining a second level of throughput associated with multimedia data communication from the network to a second access terminal based on feedback from the second access terminal to the first access terminal via the network, determining a budget associated with communication of a video unit of the multimedia data, and coding the video unit of the multimedia data based on the budget and the first and second levels of throughput.

Claims

1. A method for communication of multimedia data, the method comprising:

determining a first level of throughput associated with multimedia data communication from a first access terminal to a network;

determining a second level of throughput associated with multimedia data communication from the network to a second access terminal based on feedback from the second access terminal to the first access terminal via the network;

determining a budget associated with communication of a video unit of the multimedia data; and

coding the video unit of the multimedia data based on the budget and the first and second levels of throughput.

2. The method of claim 1, wherein coding the video unit of the multimedia data based on the budget and the first and second levels of throughput comprises:

coding the video unit to have a size that is a function of the budget and the first and second levels of throughput.

3. The method of claim 1, wherein coding the video unit of the multimedia data based on the budget and the first and second levels of throughput comprises:

coding the video unit according to the budget if the budget is less than the first and second levels of throughput.

4. The method of claim 1, wherein the network comprises

a first access point that sends and receives data to and from the first access terminal;

and

a second access point that sends and receives data to and from the second access terminal, wherein the first and second access points are communicatively coupled to one another in the network.

5. The method of claim 1, further comprising sending the coded video unit of the multimedia data from the first access terminal to the second access terminal via the network.

6. The method of claim 1, further comprising:

maintaining at least two token buckets at the first access terminal, wherein a first token bucket stores information indicative of the first level of throughput and the second token bucket stores information indicative of the second level of throughput,

wherein coding the video unit of the multimedia data comprises coding the video unit with a size that is a function of the budget and occupancies of the first and second token buckets.

7. The method of claim 6, further comprising:

updating the first token bucket to reflect the first level of throughput measured at the first access terminal; and

updating the second token bucket to reflect the second level of throughput measured at the second access terminal.

8. The method of claim 7, wherein updating the first and second token buckets is based on negotiated quality of service (QoS) between the first and second access terminals, current buffer occupancy of the first and second token buckets and elapsed time.

9. The method of claim 6, further comprising:

reducing contents from at least one of the first and second token buckets in the first access terminal upon coding the video unit of multimedia data.

10. The method of claim 1, wherein the video unit of multimedia data comprises a video frame.

11. The method of claim 10, further comprising:

coding audio information associated with the video frame and sending the coded audio information from the first access terminal to the second access terminal over the network regardless of whether the video frame is coded.

12. The method of claim 1, further comprising:

skipping coding of the video unit of multimedia data if the budget is greater than either the first level of throughput or the second level of throughput.

13. The method of claim 12, further comprising upon skipping coding of the video unit of multimedia data:

updating the first level of throughput based on measurements at the first access terminal;

updating the second level of throughput based on measurements at the second access terminal;

re-determining the budget associated with communication of a subsequent video unit of multimedia data; and

coding the subsequent video unit of multimedia data if the re-determined budget is less than the updated first and second levels of throughput.

14. The method of claim 13,

wherein the video unit of multimedia data comprises a video frame,

wherein the first and second access terminals define a frame rate for communication of video frames of the multimedia data during a session, and

wherein upon skipping coding of a given video frame of multimedia data, the updating, re-determining and coding of a subsequent video frame occur prior to a next cycle defined by the frame rate of the session.

15. The method of claim 1, further comprising:

determining a third level of throughput associated with multimedia data communication from the network to a third access terminal based on feedback from the third access terminal to the first access terminal via the network; and

coding the video unit of the multimedia data when the budget is less than the first, second and third levels of throughput.

16. The method of claim 15, further comprising:

maintaining at least three token buckets at the first access terminal, wherein a first token bucket stores information indicative of the first level of throughput, the second token bucket stores information indicative of the second level of throughput, and the third token bucket stores information indicative of the third level of throughput.

17. An apparatus for communication of multimedia data, the apparatus comprising:

means for determining a first level of throughput associated with multimedia data communication from the apparatus to a network;

means for determining a second level of throughput associated with multimedia data communication from the network to an access terminal based on feedback from the access terminal to the apparatus via the network;

means for determining a budget associated with communication of a video unit of the multimedia data; and

means for coding the video unit of the multimedia data based on the budget and the first and second levels of throughput.

18. The apparatus of claim 17, wherein means for coding the video unit of the multimedia data based on the budget and the first and second levels of throughput comprises:

means for coding the video unit to have a size that is a function of the budget and the first and second levels of throughput.

19. The apparatus of claim 17, wherein means for coding the video unit of the multimedia data based on the budget and the first and second levels of throughput comprises:

means for coding the video unit according to the budget if the budget is less than the first and second levels of throughput.

20. The apparatus of claim 17, wherein the network comprises:

a first access point that sends and receives data to and from the apparatus; and

a second access point that sends and receives data to and from the access terminal, wherein the first and second access points are communicatively coupled to one another in the network.

21. The apparatus of claim 17, further comprising means for sending the coded video unit of the multimedia data from the apparatus to the access terminal via the network.

22. The apparatus of claim 17, further comprising:

means for maintaining at least two token buckets at the apparatus, wherein a first token bucket stores information indicative of the first level of throughput and the second token bucket stores information indicative of the second level of throughput,

wherein means for coding the video unit of the multimedia data comprises means for coding the video unit with a size that is a function of the budget and occupancies of the first and second token buckets.

23. The apparatus of claim 22, further comprising:

means for updating the first token bucket to reflect the first level of throughput measured at the apparatus; and

means for updating the second token bucket to reflect the second level of throughput measured at the access terminal.

24. The apparatus of claim 23, wherein means for updating the first and second token buckets comprises means for updating based on negotiated quality of service (QoS) between the apparatus and the access terminal, current buffer occupancy of the first and second token buckets and elapsed time.

25. The apparatus of claim 17, wherein the apparatus comprises one or more integrated circuits.

26. The apparatus of claim 22, further comprising:

means for reducing contents from at least one of the first and second token buckets in the apparatus upon coding the video unit of multimedia data.

27. The apparatus of claim 17, wherein the video unit of multimedia data comprises a video frame.

28. The apparatus of claim 27, further comprising:

means for coding audio information associated with the video frame and means for sending the coded audio information from the apparatus to the access terminal over the network regardless of whether the video frame is coded.

29. The apparatus of claim 17, further comprising:

means for skipping coding of the video unit of multimedia data if the budget is greater than either the first level of throughput or the second level of throughput.

30. The apparatus of claim 29, further comprising upon skipping coding of the video unit of multimedia data:

means for updating the first level of throughput based on measurements at the apparatus;

means for updating the second level of throughput based on measurements at the access terminal;

means for re-determining the budget associated with communication of a subsequent video unit of multimedia data; and

means for coding the subsequent video unit of multimedia data if the re-determined budget is less than the updated first and second levels of throughput.

31. The apparatus of claim 30,

wherein the video unit of multimedia data comprises a video frame,

wherein the apparatus and the access terminal define a frame rate for communication of video frames of the multimedia data during a session, and

wherein upon skipping coding of a given video frame of multimedia data, the updating, re-determining and coding of a subsequent video frame occur prior to a next cycle defined by the frame rate of the session.

32. The apparatus of claim 17, further comprising:

means for determining a third level of throughput associated with multimedia data communication from the network to another access terminal based on feedback from the another access terminal to the apparatus via the network; and

means for coding the video unit of the multimedia data when the budget is less than the first, second and third levels of throughput.

33. The apparatus of claim 32, further comprising:

means for maintaining at least three token buckets at the apparatus, wherein a first token bucket stores information indicative of the first level of throughput, the second token bucket stores information indicative of the second level of throughput, and the third token bucket stores information indicative of the third level of throughput.

34. A computer program product including a non-transitory computer readable medium comprising instructions that are executable to:

determine a first level of throughput associated with multimedia data communication from a first access terminal to a network;

determine a second level of throughput associated with multimedia data communication from the network to a second access terminal based on feedback from the second access terminal to the first access terminal via the network;

determine a budget associated with communication of a video unit of the multimedia data; and

code the video unit of the multimedia data based on the budget and the first and second levels of throughput.