Telecommunication and multimedia management method and apparatus

• US 8,145,780 B2
• Filed: 08/15/2008
• Issued: 03/27/2012
• Est. Priority Date: 10/19/2007
• Status: Expired due to Fees

• Current Assignee: Voxer IP LLC (Voxer, Inc.)
• Original Assignee: Voxer IP LLC (Voxer, Inc.)
• Inventors: Katis, Thomas E., Panttaja, James T., Panttaja, Mary G., Ranney, Matthew J.
• Primary Examiner(s): Jacobs, LaShonda T
• Application Number:
  US12/192,406
• Publication Number:
  US 20090106617A1
• Time in Patent Office: 1,320 Days
• Field of Search: 709/231, 709/203, 709/217, 709/219, 709/223, 709/224, 370/395.64, 370/395.65, 725/25
• US Class Current: 709/231
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/226 Delivery according to priorities
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/4053 without floor control
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

An apparatus for reliably transferring media over a network from a sending node to a receiving node. The sending node includes a media ascertaining element configured to ascertain if media to be transmitted from the sending node to the receiving node is either time-sensitive or not time-sensitive. The sending node also includes a transmission element that is configured to (i) transmit the non time-sensitive media from the sending node to the receiving node by adjusting the rate of transmission of the non time-sensitive media at the sending node based on network conditions and (ii) transmit the time-sensitive media from the sending node to the receiving node. The receiving node includes a media loss ascertaining element configured to ascertain at the receiving node if a predetermined acceptable network transmission loss level is met. The receiving node also includes a receipt report generator configured to (iii) generate one or more low priority requests for the retransmission of any missing time-sensitive media lost during transmission if the predetermined acceptable network transmission loss level is met and (iv) generate one or more low priority requests for the retransmission of any missing non time-sensitive media lost during the transmission. The transmission element of the sending node retransmits the missing time-sensitive media in response to the low priority requests when bandwidth on the network becomes available in excess of what is needed for the transmission of time-sensitive media.

Claims

1. An apparatus for reliably transferring media over a network, comprising:

a sending node connected to the network, the sending node including;

a media ascertaining element configured to ascertain if media to be transmitted from the sending node to a receiving node is either time-sensitive or not time-sensitive, the time-sensitivity of the media based on an intent of a recipient to review the media either immediately upon receipt or at a later time after receipt; and

a transmission element, the transmission element configured to;

(i) transmit the non time-sensitive media from the sending node to the receiving node by adjusting the rate of transmission of the non time-sensitive media at the sending node based on network conditions; and

(ii) transmit the time-sensitive media from the sending node to the receiving node;

the receiving node including;

a media loss ascertaining element configured to ascertain at the receiving node if a predetermined acceptable network transmission loss level is met; and

a receipt report generator, the receipt report generator configured to;

(iii) generate one or more low priority requests for the retransmission of any missing time-sensitive media lost during transmission if the predetermined acceptable network transmission loss level is met; and

(iv) generate one or more low priority requests for the retransmission of any missing non time-sensitive media lost during the transmission;

the transmission element of the sending node further configured to retransmit the missing time-sensitive and not time-sensitive media in response to the low priority requests when bandwidth on the network becomes available in excess of what is needed for the transmission of time-sensitive media.

2. The apparatus of claim 1, wherein the media loss ascertaining element is further configured to ascertain at the receiving node if the predetermined acceptable network transmission loss level is not met and the receipt report generator is further configured to generate at the receiving node one or more high priority requests for the retransmission of any missing time-sensitive media lost during the transmission if the predetermined acceptable network transmission loss level is not met,

whereby all of the media to be transmitted from the sending node to the receiving node is eventually reliably transferred as the high and the low priority requests for retransmission are fulfilled.

3. The apparatus of claim 1, wherein the transmission element of the sending node is further configured to adjust the rate of transmission of the non time-sensitive media by:

continuously ascertaining available bandwidth on the network in excess of bandwidth needed for transmitting media ascertained as time-sensitive;

setting a packetization interval for transmitting packets of the media ascertained as not time-sensitive for network efficiency and adjusting the rate at which the packets are transmitted based on the ascertained available bandwidth,

whereby the adjusted rate of transmission of the media ascertained as not time-sensitive is set for network efficiency and reliable delivery relative to the timeliness of the delivery of the media ascertained as time-sensitive.

4. The apparatus of claim 3, wherein the continuously ascertained bandwidth is the instantaneous maximum bandwidth on the network in excess of what is needed for transmitting media ascertained as time-sensitive.

5. The apparatus of claim 1, wherein the transmission element transmits the time-sensitive media from the sending node to the receiving node by:

ascertaining available bandwidth on the network when the time-sensitive media is to be transmitted;

ascertaining if the available bandwidth is sufficient to transmit a full bit representation of the time-sensitive media at a bit rate and a packetization interval sufficient for the full bit rate representation of the media to be reviewed upon receipt, and either;

(v) transmitting the full bit rate representation of the time-sensitive media at the bit rate and the packetization interval if the available bandwidth on the network is sufficient;

or

(vi) transmitting a reduced bit rate representation of the time-sensitive media if the available bandwidth on the network is insufficient, the reduced bit rate representation of the media enhancing the ability of the recipient to review the media ascertained as time-sensitive upon receipt when the available bandwidth on the network is insufficient for transmitting the full bit rate representation.

6. The apparatus of claim 5, wherein the transmission element generates the reduced bit rate representation of the time-sensitive media by using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the full bit rate representation of the media.

7. The apparatus of claim 5, wherein the transmission element generates the reduced bit rate representation of the time-sensitive media using (a) one or more different codec settings, (b) one or more different codecs, (c) a compression algorithm;

or (d) any combination of (a) through (c) when packetizing the media for transmission.

8. The apparatus of claim 5, wherein the transmission element is further configured to generate the reduced bit rate representation of the time-sensitive media by increasing the packetization interval when for transmitting the media.

9. The apparatus of claim 7, wherein the transmission element is further configured to generate the reduced bit rate representation by adjusting the rate at which packets are transmitted.

10. The apparatus of claim 5, wherein the transmission element is further configured to generate the reduced bit rate representation by:

(i) using fewer bits per unit of time when packetizing the reduced bit rate representation of the media relative to the full bit rate representation of the media;

(ii) increasing the packetization interval when transmitting the time-sensitive media;

(iii) adjusting the rate at which packets containing the time-sensitive media are transmitted;

or

(iv) any combination of (i) through (iii).

11. The apparatus of claim 2, wherein the receipt report generator is further configured to:

check the non time-sensitive and the time-sensitive media received at the receiving node from the sending node;

note any missing media as the non time-sensitive and the time-sensitive media is received at the receiving node; and

maintain a data quality store at the receiving node for the media noted as missing.

12. The apparatus of claim 11, wherein the receipt report generator generates the one or more low priority request for the retransmission of the missing non time-sensitive media by:

scanning the data quality store;

ascertaining the not time-sensitive media noted in the data quality store; and

generating and transmitting to the sending node one or more receipt reports, each of the receipt reports including the low priority request for the retransmission of the noted missing not time-sensitive media.

13. The apparatus of claim 11, wherein the receipt report generator generates the one or more low priority requests for the retransmission of the noted missing time-sensitive media by:

scanning the data quality store;

ascertaining the time-sensitive media noted in the data quality store; and

generating and transmitting to the sending node one or more receipt reports, each of the receipt reports including the low priority request for retransmission of the noted missing time-sensitive media when the predetermined acceptable network transmission loss level is met.

14. The apparatus of claim 11, wherein the receipt report generator generates at the receiving node the one or more high priority requests for the retransmission of the missing time-sensitive media by:

scanning the data quality store;

ascertaining the time-sensitive media noted in the data quality store; and

generating and transmitting to the sending node one or more receipt reports, each of the receipt reports including the high priority request for retransmission of the noted missing time-sensitive media when the predetermined acceptable network transmission loss level is not met.

15. The apparatus of claim 11, wherein the receipt report generator is further configured to continually remove the notation of the missing media from the data quality store as the noted media is received at the receiving node as the requests for retransmission are fulfilled.

16. The apparatus of claim 1, wherein the transmission element is further configured to defer the retransmission of the missing time-sensitive media in response to the low priority requests until bandwidth on the network in excess of what is needed for the transmission of any time-sensitive media becomes available.

17. The apparatus of claim 1, wherein the transmission element is further configured to prioritize the transmission of the time-sensitive media over the retransmission of the missing time-sensitive media corresponding to the low priority requests for retransmission.

18. The apparatus of claim 1, wherein the transmission element is further configured to prioritize the transmission of the time-sensitive media over the retransmission of the missing non time-sensitive media in response to the low priority requests for retransmission.

19. The apparatus of claim 2, wherein the transmission element is further configured to prioritize the retransmission of the time-sensitive media in response to the high priority requests over the transmission of the time-sensitive media.

20. The apparatus of claim 1, wherein the transmission element is further configured to simultaneously transmit the time-sensitive media and the non time-sensitive media when both types of media are available for transmission and the bandwidth on the network is sufficient to support the transmission of both types of media.

21. The apparatus of claim 1, wherein the transmission element is further configured to prioritize the transmission and the retransmission of the time-sensitive media over the transmission of the non-time sensitive media when both types of media are available for transmission and the bandwidth on the network is insufficient to support the transmission of both types of media.

22. The apparatus of claim 1, wherein the media ascertaining element ascertains if media is time-sensitive based on if the recipient has indicated an intention to review the media as it is created and received over the network in a near real-time mode.

23. The apparatus of claim 1, wherein the media ascertaining element ascertains media as time-sensitive when the recipient retrieves the media from a remote storage location on the network and the recipient has indicated an intent to immediately review the media upon receipt.

24. The apparatus of claim 1, wherein the intent of the recipient to review the media either immediately upon receipt or at the later time is explicitly declared by the recipient.

25. The apparatus of claim 1, wherein the intent of the recipient to review the media either immediately upon receipt or at the later time is inferred from the behavior of the recipient.

26. The apparatus of claim 1, wherein the sending node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

27. The apparatus of claim 1, wherein the receiving node comprises a communication device, the communication device consisting of one of the following:

land-line phone, wireless phone, cellular phone, satellite phone, computer, radio, server, satellite radio, tactical radio or tactical phone.

28. The apparatus of claim 1, wherein the media is locally generated at the sending node.

29. The apparatus of claim 1, wherein the sending node is a hop on the network between a remote device transmitting the media and the receiving node.

30. The apparatus of claim 1, wherein the receiving node is a hop on the network between the sending node and the recipient.

31. The apparatus claim 1, wherein the media further comprises one or more of the following types of media:

voice, video, text, sensor data, position or GPS information, radio signals, or a combination thereof.

32. The apparatus of claim 1, wherein the recipient of the transmitted media is a person.

33. The apparatus of claim 1, wherein the recipient of the transmitted media is a service running on a device connected to the network.