Telecommunication and multimedia management method and apparatus

• US 8,380,874 B2
• Filed: 08/22/2008
• Issued: 02/19/2013
• Est. Priority Date: 10/19/2007
• Status: Expired due to Fees

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): SALAD, ABDULLAHI ELMI
• Application Number:
  US12/197,151
• Publication Number:
  US 20090103522A1
• Time in Patent Office: 1,642 Days
• Field of Search: 709230-235, 709/238, 709/240, 370/468, 370/470
• US Class Current: 709/240
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/226 Delivery according to priorities
• CPC Class Codes: H04L 51/23 Reliability checks, e.g. acknowledgments or fault reporting
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/4053 without floor control
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

An apparatus for transferring a complete copy of media designated as time sensitive over a network. The apparatus includes a sending node including a network ascertaining element configured to ascertain if conditions on the network are adequate to transmit a full bit rate representation of media designated as time-sensitive at a first bit rate and a first packetization interval between the sending node and a receiving node over the network, where the full bit rate representation being derived from when the time-sensitive media was originally encoded. If the network conditions are ascertained as being inadequate, then a transmitter at the sending node generates and transmits a reduced bit rate representation of the media designated as time-sensitive. The transmitting node is also configured to receive receipt reports from the receiving node that identify the received reduced bit rate representation of the media. In response to the receipt reports, the transmitter at the sending node retransmits the corresponding full bit rate representation of the media. Eventually a complete full bit representation of the media is obtained at the receiving node after the retransmitted media is received.

Claims

1. An apparatus for transferring a complete copy of media designated as time sensitive over a network, the apparatus comprising:

a sending node, the sending node including;

a network ascertaining element configured to ascertain if conditions on the network are adequate to transmit a first bit rate representation of media designated as time-sensitive between the sending node and a receiving node over the network, the first bit rate representation derived from when the time-sensitive media was originally encoded;

a transmitter configured to generate and transmit a reduced bit rate representation of the media designated as time-sensitive if the network ascertaining element ascertains that network conditions are inadequate to transmit the first bit rate representation at a first bit rate and a first packetization interval sufficient for the media to be decipherable when rendered upon receipt by a recipient;

the network ascertaining element further configured to receive over the network receipt reports from the receiving node, the received receipt reports identifying the received reduced bit rate representation of the media and including a first priority request for retransmission of the identified media; and

the transmitter further configured to retransmit, from the sending node to the receiving node, the first bit rate representation of the media corresponding to the media identified in the receipt reports in response to the first priority request, the retransmission ensuring that a complete copy of the first bit representation of the media is transferred from the sending node to the receiving node so that the first bit rate representation of the media is available for rendering by the recipient in a time-shifted mode.

2. The apparatus of claim 1, wherein the receipt reports received at the sending node include the first priority request for retransmission of the identified reduced bit rate representation of the media when a predefined acceptable network transmission loss level is met at the receiving node.

3. The apparatus of claim 1, wherein the receipt reports received at the sending node further include a second priority request instead of the first priority request, the second priority request defining a request for retransmission of the identified reduced bit rate representation of the media when a predefined acceptable network transmission loss level is not met at the receiving node.

4. The apparatus of claim 3, wherein the transmitter of the sending node is further configured to prioritize the retransmission of the reduced bit rate representation of the media in response to the receipt reports including the second priority request over the transmission of media designated as time-sensitive and not time-sensitive.

5. The apparatus of claim 1, wherein the receiving node further comprises a data quality store configured to note the received reduced bit rate representation of the media as the media is received at the receiving node.

6. The apparatus of claim 5, wherein the receiving node further comprises a receipt report generator, the receipt report generator configured to generate the receipt reports by:

scanning the data quality store;

ascertaining the noted reduced bit rate representation of the media in the data quality store; and

generating the receipt reports identifying the media noted in the data quality store.

7. The apparatus of claim 6, wherein the receiving node is further configured to remove the notation of the media noted in the data quality store when the first bit rate representation of the media is received after retransmission.

8. The apparatus of claim 1, wherein the network ascertaining element of the sending node ascertains if conditions on the network are adequate by:

measuring a maximum transmission rate available on the network, the maximum transmission rate on the network varying based on instantaneous network conditions; and

comparing the maximum transmission rate with a transmission rate needed to transmit the first bit rate representation of the media at the first bit rate and the first packetization interval.

9. The apparatus of claim 8, wherein the transmitter at the sending node is further configured to transmit the reduced bit rate representation of the media if the measured maximum transmission rate on the network is less than the transmission rate needed to transmit the first bit representation of the media at the first bit rate and first packetization interval.

10. The apparatus of claim 1, wherein the transmitter is further configured to generate the reduced bit rate representation of the media by using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the first bit rate representation of the media.

11. The apparatus of claim 1, wherein the transmitter is further configured to generate the reduced bit rate representation of the media by using (a) one or more different codec settings, (b) one or more different codecs, (c) a compression algorithm;

or (d) any combination of (a) through (c) when packetizing the media for transmission.

12. The apparatus of claim 1, wherein generating the reduced bit rate representation of the media designated as time-sensitive further comprises increasing the packetization interval for packets used to packetize the time-sensitive media.

13. The apparatus of claim 1, wherein the transmitter is further configured to generate the reduced bit rate representation of the media by adjusting the rate at which packets containing the time-sensitive media are transmitted.

14. The apparatus of claim 1, wherein the transmitter is further configured to generate the reduced bit rate representation of the media by performing one or more of the following:

(i) using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the first bit rate representation of the media;

(ii) increasing the packetization interval when transmitting the time-sensitive media;

(iii) adjusting the rate at which packets containing the time-sensitive media are transmitted;

or

(iv) any combination of (i) through (iii).

15. The apparatus of claim 1, wherein the media is designated as time-sensitive when a recipient has indicated an intention to review the media as it is created and received over the network in a near real-time mode,

wherein the intention of the recipient is either a declared intent or inferred from the behavior of the recipient.

16. The apparatus of claim 1, wherein the media is designated as time-sensitive when a recipient retrieves the media from a remote storage location on the network and the recipient has indicated an intent to immediately review the media upon receipt,

wherein the intention of the recipient is either a declared intent or inferred from the behavior of the recipient.

17. The apparatus of claim 1, wherein the sending node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

18. The apparatus of claim 1, wherein the receiving node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

19. The apparatus of claim 1, wherein the media is locally generated at the sending node.

20. The apparatus of claim 1, wherein the sending node is a hop on the network between a remote device transmitting the media and the receiving node.

21. The apparatus of claim 1, wherein the receiving node is a hop on the network between the sending node and the recipient.

22. The apparatus claim 1, wherein the media further comprises one or more of the following types of media:

voice, video, text, sensor data, position or GPS information, radio signals, or a combination thereof.

23. The apparatus of claim 1, wherein the recipient of the transmitted media is a person.

24. The apparatus of claim 1, wherein the recipient of the transmitted media is a service running on a device connected to the network.

25. An apparatus for transferring a complete copy of media designated as time sensitive over a network, the apparatus comprising:

a sending node, the sending node including;

a network ascertaining element configured to ascertain if conditions on the network are adequate to transmit a first bit rate representation of media designated as time-sensitive at a first bit rate between the sending node and a receiving node over the network, the first bit rate representation derived from when the time-sensitive media was originally encoded;

a transmitter configured to generate and transmit a reduced bit rate representation of the media designated as time-sensitive if the network ascertaining element ascertains that network conditions are inadequate to transmit the first bit rate representation at a first bit rate and a first packetization interval sufficient for the media to be decipherable when rendered upon receipt by a recipient;

the network ascertaining element further configured to receive over the network receipt reports from the receiving node, the received receipt reports identifying the received reduced bit rate representation of the media and including a first priority request for retransmission of the identified media; and

the transmitter further configured to retransmit, from the sending node to the receiving node, the first bit rate representation of the media corresponding to the media identified in the receipt reports the retransmission ensuring that a complete copy of the media at the first bit rate representation is transferred from the sending node to the receiving node so that the first bit rate representation of the media is available for rendering by the recipient in a time-shifted mode, wherein the retransmission is deferred until bandwidth on the network in excess of what is needed for the transmission of any media designated as time sensitive becomes available so that the retransmission does not impede the transmission of media designated as time sensitive.

26. A method for transferring a complete copy of media designated as time sensitive over a network, comprising:

ascertaining if conditions on the network are adequate to transmit a first bit rate representation of media designated as time-sensitive at a first bit rate between a sending node and a receiving node over the network, the first bit rate representation derived from when the time-sensitive media was originally encoded;

generating a reduced bit rate representation of the media designated as time-sensitive if network conditions are ascertained as being inadequate to transmit the first bit rate representation at a first bit rate and a first packetization interval sufficient for the media to be decipherable when rendered upon receipt by a recipient;

transmitting the reduced bit rate representation of the media from the sending node to the receiving node if network conditions are ascertained as being inadequate;

receiving receipt reports at the sending node, the receipt reports generated by the receiving node and identifying the reduced bit rate representation of the media received at the receiving node and including a first priority request for retransmission of the identified media;

retransmitting, from the sending node to the receiving node, the first bit rate representation of the media corresponding to the media identified in the receipt reports; and

obtaining a complete first bit representation of the media at the receiving node after the retransmitted media is received wherein the retransmitting ensures that a complete copy of the media at the first bit representation is received so that the first bit rate representation of the media is available for rendering by the recipient in a time-shifted mode.

27. The method of claim 26, wherein receiving the receipt reports further comprises receiving the first priority request for retransmission of the identified reduced bit rate representation of the media when a predefined acceptable network transmission loss level is met at the receiving node.

28. The method of claim 26, wherein receiving the receipt reports further comprises receiving a second priority request in stead of the first priority request, the second priority request defining a request for retransmission of the identified reduced bit rate representation of the media when a predefined acceptable network transmission loss level is not met at the receiving node.

29. The method of claim 28, wherein retransmitting the reduced bit rate representation of the media in response to the receipt reports including the second priority request further comprises prioritizing the retransmission over the transmission of media designated as time-sensitive and not time-sensitive.

30. The method of claim 26, further comprising:

receiving the reduced bit rate representation of the media at the receiving node;

noting the reduced bit rate representation of the media as the media is received at the receiving node; and

maintaining a data quality store at the receiving node for the noted reduced bit rate representation of the media.

31. The method of claim 30, further comprising generating the receipt reports at the receiving node by:

scanning the data quality store;

ascertaining the noted reduced bit rate representation of the media in the data quality store; and

generating the receipt reports identifying the media noted in the data quality store.

32. The method of claim 31, further comprising removing the notation of the media noted in the data quality store when the first bit rate representation of the media is received after retransmission.

33. The method of claim 26, wherein ascertaining if conditions on the network are adequate further comprise:

measuring a maximum transmission rate on the network, the maximum transmission rate on the network varying based on instantaneous network conditions; and

comparing the maximum transmission rate with a transmission rate needed to transmit the first bit rate representation of the media at the first bit rate and the first packetization interval.

34. The method of claim 33, further comprising transmitting the reduced bit rate representation of the media if the measured maximum transmission rate on the network is less than the transmission rate needed to transmit the first bit representation of the media at the first bit rate and first packetization interval.

35. The method of claim 26, wherein generating the reduced bit rate representation of the media further comprises using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the first bit rate representation of the media.

36. The method of claim 26, wherein generating the reduced bit rate representation of the media further comprises using (a) one or more different codec settings, (b) one or more different codecs, (c) a compression algorithm;

or (d) any combination of (a) through (c) when packetizing the media for transmission.

37. The method of claim 26, wherein generating the reduced bit rate representation of the media further comprises increasing the packetization interval for packets used to packetize the time-sensitive media.

38. The method of claim 26, wherein generating the reduced bit rate representation of the media comprises adjusting the rate at which packets containing the time-sensitive media are transmitted.

39. The method of claim 26, wherein generating the reduced bit rate representation of the media further comprises performing one or more of the following:

(i) using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the first bit rate representation of the media;

(ii) increasing the packetization interval when transmitting the time-sensitive media;

(iii) adjusting the rate at which packets containing the time-sensitive media are transmitted;

or

(iv) any combination of (i) through (iii).

40. The method of claim 26, wherein the media is designated as time-sensitive when a recipient has indicated an intention to review the media as it is created and received over the network in a near real-time mode,

wherein the intention of the recipient is either a declared intent or inferred from the behavior of the recipient.

41. The method of claim 26, wherein the media is designated as time-sensitive when a recipient retrieves the media from a remote storage location on the network and the recipient has indicated an intent to immediately review the media upon receipt,

wherein the intention of the recipient is either a declared intent or inferred from the behavior of the recipient.

42. The method of claim 26, wherein the sending node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

43. The method of claim 26, wherein the receiving node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

44. The method of claim 26, wherein the media is locally generated at the sending node.

45. The method of claim 26, wherein the sending node is a hop on the network between a remote device transmitting the media and the receiving node.

46. The method of claim 26, wherein the receiving node is a hop on the network between the sending node and the recipient.

47. The method claim 26, wherein the media further comprises one or more of the following types of media:

voice, video, text, sensor data, position or GPS information, radio signals, or a combination thereof.

48. The method of claim 26, wherein the recipient of the transmitted media is a person.

49. The method of claim 26, wherein the recipient of the transmitted media is a service running on a device connected to the network.

50. A method for transferring a complete copy of media designated as time sensitive over a network, comprising:

ascertaining if conditions on the network are adequate to transmit a first bit rate representation of media designated as time-sensitive at a first bit rate between a sending node and a receiving node over the network, the first bit rate representation derived from when the time-sensitive media was originally encoded;

generating a reduced bit rate representation of the media designated as time-sensitive if network conditions are ascertained as being inadequate to transmit the first bit rate representation at a first bit rate and a first packetization interval sufficient for the media to be decipherable when rendered upon receipt by a recipient;

transmitting the reduced bit rate representation of the media from the sending node to the receiving node if network conditions are ascertained as being inadequate;

receiving receipt reports at the sending node, the receipt reports generated by the receiving node and identifying the reduced bit rate representation of the media received at the receiving node and including a first priority request for retransmission of the identified media;

retransmitting, from the sending node to the receiving node, the first bit rate representation of the media corresponding to the media identified in the receipt reports; and

obtaining a complete first bit representation of the media at the receiving node after the retransmitted media is received wherein the retransmitting ensures that a complete copy of the media at the first bit rate representation is received so that the first bit rate representation of the media is available for rendering by the recipient in a time-shifted mode;

wherein the retransmitting is deferred until bandwidth on the network in excess of what is needed for the transmission of any media designated as time sensitive becomes available so that the retransmitting does not impede the transmission of media designated as time sensitive.

51. A computer readable application embedded in a non-transitory computer readable medium and intended to run a sending node, the application comprising:

a network ascertaining module configured to ascertain if conditions on the network are adequate to transmit a first bit rate representation of media designated as time-sensitive at a first bit rate between the sending node and a receiving node over the network, the first bit rate representation derived from when the time-sensitive media was originally encoded;

a transmitter module configured to generate and transmit a reduced bit rate representation of the media designated as time-sensitive if the network ascertaining module ascertains that network conditions are inadequate to transmit the first bit rate representation at a first bit rate and a first packetization interval sufficient for the media to be decipherable when rendered upon receipt by a recipient;

the network ascertaining module further configured to receive over the network receipt reports from the receiving node, the received receipt reports identifying the received reduced bit rate representation of the media and including a first priority request for retransmission of the identified media; and

the transmitter module further configured to retransmit, from the sending node to the receiving node, the first bit rate representation of the media corresponding to the media identified in the receipt reports to ensure that a complete copy of the first bit representation of the media is transferred from the sending node to the receiving node so that the first bit rate representation of the media is available for rendering by the recipient in a time-shifted mode.

52. The application of claim 51, wherein the received receipt reports include the first priority request for retransmission of the identified reduced bit rate representation of the media when a predefined acceptable network transmission loss level is met at the receiving node.

53. The application of claim 51, wherein the receipt reports further include a second priority request instead of the first priority request, the second priority request defining a request for retransmission of the identified reduced bit rate representation of the media when a predefined acceptable network transmission loss level is not met at the receiving node.

54. The application of claim 53, wherein the transmitter module is further configured to prioritize the retransmission of the reduced bit rate representation of the media in response to the receipt reports including the second priority request over the transmission of media designated as time-sensitive and not time-sensitive.

55. The application of claim 51, wherein the network ascertaining module of the sending node ascertains if conditions on the network are adequate by:

measuring a maximum transmission rate available on the network, the maximum transmission rate on the network varying based on instantaneous network conditions; and

comparing the maximum transmission rate with a transmission rate needed to transmit the first bit rate representation of the media at the first bit rate and the first packetization interval.

56. The application of claim 55 wherein the transmitter module is further configured to transmit the reduced bit rate representation of the media if the measured maximum transmission rate on the network is less than the transmission rate needed to transmit the first bit representation of the media at the first bit rate and first packetization interval.

57. The application of claim 51, wherein the transmitter module is further configured to generate the reduced bit rate representation of the media by using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the first bit rate representation of the media.

58. The application of claim 51, wherein the transmitter module is further configured to generate the reduced bit rate representation of the media by using (a) one or more different codec settings, (b) one or more different codecs, (c) a compression algorithm;

or (d) any combination of (a) through (c) when packetizing the media for transmission.

59. The application of claim 51, wherein the transmitter module is further configured to generate the reduced bit rate representation of the media designated as time-sensitive by increasing the packetization interval for packets used to packetize the time-sensitive media.

60. The application of claim 51, wherein the transmitter module is further configured to generate the reduced bit rate representation of the media by adjusting the rate at which packets containing the time-sensitive media are transmitted.

61. The application of claim 51, wherein the transmitter module is further configured to generate the reduced bit rate representation of the media by performing one or more of the following:

(i) using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the first bit rate representation of the media;

(ii) increasing the packetization interval when transmitting the time-sensitive media;

(iii) adjusting the rate at which packets containing the time-sensitive media are transmitted;

or

(iv) any combination of (i) through (iii).

62. The application of claim 51, wherein the media is designated as time-sensitive when a recipient has indicated an intention to review the media as it is created and received over the network in a near real-time mode,

wherein the intention of the recipient is either a declared intent or inferred from the behavior of the recipient.

63. The application of claim 51, wherein the media is designated as time-sensitive when a recipient retrieves the media from a remote storage location on the network and the recipient has indicated an intent to immediately review the media upon receipt,

wherein the intention of the recipient is either a declared intent or inferred from the behavior of the recipient.

64. The application of claim 51, wherein the sending node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

65. The application of claim 51, wherein the media is locally generated at the sending node.

66. The application of claim 51, wherein the sending node is a hop on the network between a remote device transmitting the media and the receiving node.

67. The application of claim 51, wherein the media further comprises one or more of the following types of media:

voice, video, text, sensor data, position or GPS information, radio signals, or a combination thereof.

68. A computer readable application embedded in a non-transitory computer readable medium and intended to run a sending node, the application comprising:

a network ascertaining module configured to ascertain if conditions on the network are adequate to transmit a first bit rate representation of media designated as time-sensitive at a first bit rate between the sending node and a receiving node over the network, the first bit rate representation derived from when the time-sensitive media was originally encoded;

a transmitter module configured to generate and transmit a reduced bit rate representation of the media designated as time-sensitive if the network ascertaining module ascertains that network conditions are inadequate to transmit the first bit rate representation at a first bit rate and a first packetization interval sufficient for the media to be decipherable when rendered upon receipt by a recipient;

the network ascertaining module further configured to receive over the network receipt reports from the receiving node, the received receipt reports identifying the received reduced bit rate representation of the media and including a first priority request for retransmission of the identified media; and

the transmitter module further configured to retransmit, from the sending node to the receiving node, the first bit rate representation of the media corresponding to the media identified in the receipt reports to ensure that a complete copy of the first bit representation of the media is transferred from the sending node to the receiving node so that the first bit rate representation of the media is available for rendering by the recipient in a time-shifted mode;

wherein retransmission is deferred until bandwidth on the network in excess of what is needed for the transmission of any media designated as time sensitive becomes available so that the retransmission does not impede the transmission of media designated as time sensitive.