Telecommunication and multimedia management method and apparatus

• US 8,391,312 B2
• Filed: 08/22/2008
• Issued: 03/05/2013
• Est. Priority Date: 10/19/2007
• Status: Expired due to Fees

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Mattis, Jason
• Assistant Examiner(s): Duffy, James P
• Application Number:
  US12/197,135
• Publication Number:
  US 20090103527A1
• Time in Patent Office: 1,656 Days
• Field of Search: None
• US Class Current: 370/465
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/23 Reliability checks, e.g. acknowledgments or fault reporting
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/4053 without floor control
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

An method for improving the ability of a recipient to review time-sensitive media upon receipt when network conditions are poor. The method includes ascertaining if media to be sent from a sending node to a receiving node is time-sensitive and ascertaining if there is sufficient bandwidth for transmitting a full bit rate representation of the media at a first bit rate and at a first packetization interval. If the bandwidth is sufficient, the full bit rate representation is transmitted. If the bandwidth is insufficient, then a reduced bit rate representation of the media is generated and transmitted. The reduced bit rate representation is generated by performing one or more of the following (i) using fewer bits per unit time of media when packetizing the media relative to the full bit rate representation; (ii) increasing the packetization interval for the packets used to transmit the reduced bit rate representation; and (iii) adjusting the rate of transmission of the packets used to packetized the reduced bit rate representation of the media.

Claims

1. A method, comprising:

ascertaining whether media to be sent from a sending node to a receiving node is time-sensitive, the time-sensitivity of the media being ascertained from an intent of a recipient to review the media upon receipt;

transmitting the media ascertained as time-sensitive from the sending node to the receiving node, the media initially transmitted at a first bit rate and at a first packetization interval, the first bit rate and the first packetization interval sufficient for a full bit rate representation of the media to be reviewed upon receipt, the full bit rate representation of the media being derived from when the media was originally encoded;

receiving at the sending node receipt reports from the receiving node, the receipt reports including parameters indicative of media loss on the network between the sending node and the receiving node;

ascertaining at the sending node available bandwidth on the network between the sending node and the receiving node based on the receipt reports;

ascertaining if the available bandwidth on the network is sufficient to support the continued transmission of the full bit rate representation of the media ascertained as time-sensitive at the first bit rate and the first packetization interval; and

selectively performing;

a. continuing the transmission of the full bit rate representation of the media ascertained as time-sensitive at the first bit rate and the first packetization interval when the available bandwidth on the network is sufficient;

b. transmitting a reduced bit rate representation of the media ascertained as time-sensitive when the available bandwidth on the network is not sufficient for the full bit rate representation but is above a minimum bandwidth for the reduced bit rate representation, the reduced bit rate representation of the media generated by performing one or more of the following;

(i) using fewer bits of media per unit of time when packetizing the reduced bit rate representation of the media relative to the full bit rate representation of the media;

(ii) adjusting the packetization interval for packets used to packetized the reduced bit rate representation of the media; and

(iii) adjusting the rate of transmission of the packets used to packetized the reduced bit rate representation of the media, and

c. transmitting the media ascertained as time sensitive as a time-shifted communication when the available bandwidth is lower than the minimum bandwidth for the reduced bit rate representation;

whereby the transmission of the reduced bit rate representation of the media ascertained as time-sensitive enhances the timeliness of the delivery of the media so as to increase the ability of the recipient to review the media upon receipt when the available bandwidth on the network is not sufficient to transmit the full bit rate representation of the media at the first bit rate and the first packetization interval.

2. The method of claim 1, wherein continuing the transmission of the full bit rate representation of the media ascertained as time-sensitive further comprises:

ascertaining a data transfer rate sufficient for transmitting the full bit rate representation of the time-sensitive media at the first bit rate and the first packetization interval; and

transmitting the full bit rate representation of the media at the first bit rate and the first packetization interval when the available bandwidth on the network exceeds the ascertained data transfer rate.

3. The method of claim 1, wherein using fewer bits of media per unit of time when packetizing the reduced bit rate representation of the media further comprises progressively lowering the number of bits used to represent the media per unit of time when packetizing the reduced bit rate representation of the media.

4. The method of claim 3, using fewer bits per unit of time of media when packetizing the reduced bit rate representation of the media further comprises:

(a) adjusting codec settings, (b) using different codecs, or (c) a compression algorithm;

or (d) any combination of (a) through (c).

5. The method of claim 1, wherein adjusting the packetization interval further comprises progressively adjusting the time interval of the packets to progressively meet the ascertained bandwidth on the network.

6. The method of claim 5, wherein progressively adjusting the time interval further comprises:

progressively increasing the packetization interval of the packets as the available bandwidth on the network decreases;

or

progressively decreasing the packetization interval of the packets as the available bandwidth on the network increases.

7. The method of claim 1, wherein generating the reduced bit rate representation of the media further comprises successively performing (i), (ii) and (iii) as needed to meet the ascertained bandwidth on the network.

8. The method of claim 1, wherein adjusting the rate of transmission of the packets used to packetize the reduced bit rate representation of the media further comprises adjusting the rate of transmission of the packets to meet the available bandwidth on the network.

9. The method of claim 1, wherein the parameters indicative of the media loss on the network comprise one or more of the following network parameters:

throughput, loss and jitter.

10. The method of claim 1, wherein ascertaining if available bandwidth is sufficient further comprises ascertaining if the amount of media loss on the network exceeds a predetermined media loss threshold.

11. The method of claim 1, further comprising generating the receipt reports at the receiving node by:

checking the media received at the receiving node from the sending node;

noting missing, corrupted or the reduced bit rate representation of the media as the media is received at the receiving node;

maintaining a data quality store at the receiving node for the noted media;

scanning the data quality store; and

including in the generated receipt reports requests for retransmission of the media noted in the data quality store.

12. The method of claim 11, further comprising:

receiving the retransmitted noted media at the receiving node; and

removing the notation of the received retransmitted media from the data quality store.

13. The method of claim 1, wherein the media is ascertained as time-sensitive when the recipient has indicated an intention to review the media as it is received over the network in a near real-time mode.

14. The method of claim 1, wherein the media is ascertained as time-sensitive when the recipient retrieves the media from a remote storage location on the network and the recipient has indicated an intent to immediately review the media upon receipt.

15. The method of claim 1, wherein the intent of the recipient to review the media either upon receipt or at a later time is explicitly declared by the recipient.

16. The method of claim 1, wherein the intent of the recipient to review the media either—

upon receipt or at a later time is inferred from the behavior of the recipient.

17. The method of claim 1, wherein the sending node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

18. The method of claim 1, wherein the receiving node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

19. The method of claim 1, wherein the media is locally generated at the sending node.

20. The method of claim 1, wherein the sending node is a hop on the network between a remote device transmitting the media and the receiving node.

21. The method of claim 1, wherein the receiving node is a hop on the network between the sending node and the recipient.

22. The method claim 1, wherein the media further comprises one or more of the following types of media:

voice, video, text, sensor data, position or GPS information, radio signals, or a combination thereof.

23. The method of claim 1, wherein the recipient of the transmitted media is a person.

24. The method of claim 1, wherein the recipient of the transmitted media is a service running on a device connected to the network.

25. The method of claim 1, further comprising prioritizing the time-sensitive media over other non time-sensitive media when the available bandwidth on the network is not sufficient to support the continued transmission of the full bit rate representation of the media ascertained as time-sensitive.

26. The method of claim 25, wherein the bit rate of non time-sensitive media is lowered when the available bandwidth on the network is not sufficient to support the continued transmission of the full bit rate representation of the media ascertained as time-sensitive.

27. A method, comprising:

ascertaining whether media to be sent from a sending node to a receiving node is time-sensitive, the time-sensitivity of the media being ascertained from an intent of a recipient to review the media upon receipt;

transmitting the media ascertained as time-sensitive from the sending node to the receiving node, the media initially transmitted at a first bit rate and at a first packetization interval, the first bit rate and the first packetization interval sufficient for a full bit rate representation of the media to be reviewed upon receipt, the full bit rate representation of the media being derived from when the media was originally encoded; and

receiving at the sending node receipt reports from the receiving node, the receipt reports including parameters indicative of media loss on the network between the sending node and the receiving node;

ascertaining at the sending node available bandwidth on the network between the sending node and the receiving node based on the receipt reports;

ascertaining if the available bandwidth on the network is sufficient to support the continued transmission of the full bit rate representation of the media ascertained as time-sensitive at the first bit rate and the first packetization interval; and

either;

continuing the transmission of the full bit rate representation of the media ascertained as time-sensitive at the first bit rate and the first packetization interval when the available bandwidth on the network is sufficient;

or

transmitting a reduced bit rate representation of the media ascertained as time-sensitive when the available bandwidth on the network is not sufficient, the reduced bit rate representation of the media generated by performing one or more of the following;

(i) using fewer bits of media per unit of time when packetizing the reduced bit rate representation of the media relative to the full bit rate representation of the media;

(ii) adjusting the packetization interval for packets used to packetized the reduced bit rate representation of the media;

or

(iii) adjusting the rate of transmission of the packets used to packetized the reduced bit rate representation of the media,

whereby the transmission of the reduced bit rate representation of the media ascertained as time-sensitive enhances the timeliness of the delivery of the media so as to increase the ability of the recipient to review the media upon receipt when the available bandwidth on the network is not sufficient to transmit the full bit rate representation of the media at the first bit rate and the first packetization interval; and

wherein the time-sensitive media corresponds to a conversation with the conversation being provided;

     1) as a live conversation at the full bit rate representation when the available bandwidth on the network is sufficient,

     2) as a live conversation at a lowered bit rate when the available bandwidth on the network is insufficient to support the full bit rate representation but above a minimum bandwidth, and

     3) a time-shifted communication for the available bandwidth being lower than the minimum bandwidth.

28. The method of claim 27, wherein continuing the transmission of the full bit rate representation of the media ascertained as time-sensitive further comprises:

ascertaining a data transfer rate sufficient for transmitting the full bit rate representation of the time-sensitive media at the first bit rate and the first packetization interval; and

transmitting the full bit rate representation of the media at the first bit rate and the first packetization interval when the available bandwidth on the network exceeds the ascertained data transfer rate.

29. The method of claim 27, wherein using fewer bits of media per unit of time when packetizing the reduced bit rate representation of the media further comprises progressively lowering the number of bits used to represent the media per unit of time when packetizing the reduced bit rate representation of the media.

30. The method of claim 29, using fewer bits per unit of time of media when packetizing the reduced bit rate representation of the media further comprises:

(a) adjusting codec settings, (b) using different codecs, or (c) a compression algorithm;

or (d) any combination of (a) through (c).

31. The method of claim 27, wherein adjusting the packetization interval further comprises progressively adjusting the time interval of the packets to progressively meet the ascertained bandwidth on the network.

32. The method of claim 31, wherein progressively adjusting the time interval further comprises:

progressively increasing the packetization interval of the packets as the available bandwidth on the network decreases;

or

progressively decreasing the packetization interval of the packets as the available bandwidth on the network increases.

33. The method of claim 27, wherein generating the reduced bit rate representation of the media further comprises successively performing (i), (ii) and (iii) as needed to meet the ascertained bandwidth on the network.

34. The method of claim 27, wherein adjusting the rate of transmission of the packets used to packetize the reduced bit rate representation of the media further comprises adjusting the rate of transmission of the packets to meet the available bandwidth on the network.

35. The method of claim 27, wherein the parameters indicative of the media loss on the network comprise one or more of the following network parameters:

throughput, loss and jitter.

36. The method of claim 27, wherein ascertaining if available bandwidth is sufficient further comprises ascertaining if the amount of media loss on the network exceeds a predetermined media loss threshold.

37. The method of claim 27, further comprising generating the receipt reports at the receiving node by:

checking the media received at the receiving node from the sending node;

noting missing, corrupted or the reduced bit rate representations of the media as the media is received at the receiving node;

maintaining a data quality store at the receiving node for the noted media;

scanning the data quality store; and

including in the generated receipt reports requests for retransmission of the media noted in the data quality store.

38. The method of claim 27, further comprising:

receiving the retransmitted noted media at the receiving node; and

removing the notation of the received retransmitted media from the data quality store.

39. The method of claim 27, wherein the media is ascertained as time-sensitive when the recipient has indicated an intention to review the media as it is received over the network in a near real-time mode.

40. The method of claim 27, wherein the media is ascertained as time-sensitive when the recipient retrieves the media from a remote storage location on the network and the recipient has indicated an intent to immediately review the media upon receipt.

41. The method of claim 27, wherein the intent of the recipient to review the media either upon receipt or at a later time is explicitly declared by the recipient.

42. The method of claim 27, wherein the intent of the recipient to review the media either upon receipt or at a later time is inferred from the behavior of the recipient.

43. The method of claim 27, wherein the sending node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

44. The method of claim 27, wherein the receiving node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

45. The method of claim 27, wherein the media is locally generated at the sending node.

46. The method of claim 27, wherein the sending node is a hop on the network between a remote device transmitting the media and the receiving node.

47. The method of claim 27, wherein the receiving node is a hop on the network between the sending node and the recipient.

48. The method claim 27, wherein the media further comprises one or more of the following types of media:

voice, video, text, sensor data, position or GPS information, radio signals, or a combination thereof.

49. The method of claim 27, wherein the recipient of the transmitted media is a person.

50. The method of claim 27, wherein the recipient of the transmitted media is a service running on a device connected to the network.

51. The method of claim 27, further comprising prioritizing the time-sensitive media over other non time-sensitive media when the available bandwidth on the network is not sufficient to support the continued transmission of the full bit rate representation of the media ascertained as time-sensitive.

52. The method of claim 51, wherein the bit rate of non time-sensitive media is lowered when the available bandwidth on the network is not sufficient to support the continued transmission of the full bit rate representation of the media ascertained as time-sensitive.