Broadband transmitter, broadband receiver, and methods thereof

• US 9,826,565 B2
• Filed: 12/01/2016
• Issued: 11/21/2017
• Est. Priority Date: 09/26/2006
• Status: Active Grant

• Current Assignee: LiveU Ltd. (LiveU, Inc.)
• Original Assignee: LiveU Ltd. (LiveU, Inc.)
• Inventors: Ohayon, Rony Haim, Cohen, Avichai
• Primary Examiner(s): Nguyen, Brian D
• Application Number:
  US15/365,958
• Publication Number:
  US 20170086244A1
• Time in Patent Office: 355 Days
• CPC Class Codes: H04B 7/0697 using spatial multiplexing
• CPC Class Codes: H04L 1/0041 Arrangements at the transmitter end
• CPC Class Codes: H04L 1/0045 Arrangements at the receiver end
• CPC Class Codes: H04L 1/0058 Block-coded modulation
• CPC Class Codes: H04L 1/0071 Use of interleaving interleaving per se H03M13/27
• CPC Class Codes: H04L 2212/00 Encapsulation of packets
• CPC Class Codes: H04L 25/02 Details ; arrangements for supplying electrical power along data transmission lines systems for transmitting signals via power distribution lines H04B3/54
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions
• CPC Class Codes: H04L 49/9057 Arrangements for supporting packet reassembly or resequencing
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 69/324 in the data link layer [OSI layer 2], e.g. HDLC
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/6131 involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6143 involving transmission via a satellite
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
• CPC Class Codes: H04N 21/6375 for requesting retransmission , e.g. of data packets lost or corrupted during transmission from serverARQ protocols H04L1/18; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16
• CPC Class Codes: H04W 24/02 Arrangements for optimising operational condition
• CPC Class Codes: H04W 72/21 : in the uplink direction of a wireless link, i.e. towards the network
• CPC Class Codes: H04W 72/542 : using measured or perceived quality
• CPC Class Codes: H04W 76/15 : Setup of multiple wireless link connections

Abstract

A virtual broadband transmitting unit includes a stream generator to generate a multiplicity of data streams from an incoming media datastream, and a transmission manager to control the upload of the multiplicity of data streams along a multiplicity of transmission channels to at least one wireless communication network. A virtual broadband receiver includes means to receive a multiplicity of media data streams from a multiplicity of data connections, and an assembly engine to assemble the data streams into a single media stream.

Claims

1. A broadband transmitting unit comprising:

a transmission manager to manage and control an uplink transmission of a multiplicity of data streams along a multiplicity of transmission channels to a single recipient device via at least one wireless communication network,

wherein said broadband transmitting unit utilizes several transmitting modems to transmit media data in concert through at least two wireless communication networks that comprise;

(A) a first wireless communication network which is a cellular communication network, and (B) a second wireless communication network which is a wireless network selected from the group consisting of;

(B1) another, different, cellular communication network, (B2) a Wi-Fi communication network, (B3) a satellite communication network;

wherein the broadband transmitting unit uses multiple transmitting modems in concert to create a broadband upload connection that uploads said multiplicity of data streams to said single recipient device, wherein the sum total of the upload capacity of said multiple transmitting modems represent enough combined bandwidth for a generally live media transmission towards said single recipient device;

wherein the broadband transmitting unit transmits the media data as packets that are inequitably distributed amongst the transmitting modems by using at least one buffer;

wherein each transmitting modem is able to perform at different levels over time;

wherein at least one transmitting modem transmits said media packets at a rate that is adapted under current prevailing conditions;

wherein each transmitting modem generates a separate logical channel, and wherein the separate logical channels constitute said broadband upload connection;

wherein said broadband upload connection is comprised of a multiplicity of logical channels being transmitted in concert to one or more wireless network operators, each of which network operators operating one or more wireless networks;

wherein at least two of the multiplicity of modems transmit said media packets over at least two different wireless networks to said single recipient device via one or more routes, and wherein at least two of the multiplicity of modems have at least one of;

(I) different momentary latency, (II) different momentary error rate, (III) different momentary bandwidth.

2. The broadband transmitting unit of claim 1, further comprising at least one of:

a forward error correction (FEC) processor to provide FEC codes to said data stream;

a packet encapsulator to generate numbered data packets from said data stream;

an interleaver to shuffle said data packets.

3. The broadband transmitting unit of claim 1, further comprising:

a queue buffer to receive said data packets from said transmission manager.

4. The broadband transmitting unit of claim 1, wherein said transmission manager is associated with (I) a queue buffer to receive said data packets from a packet generator, and with (II) a retransmission queue to store copies of said packets for retransmission.

5. The broadband transmitting unit of claim 1, wherein each of said transmitting modems operates to pull a next data packet from a data packet generator for transmission via said transmitting modem.

6. The broadband transmitting unit of claim 1, further comprising:

a back channel for receiving from said single recipient device feedback regarding at least one of the timeliness and quality of said multiplicity of data streams.

7. The broadband transmitting unit of claim 6, wherein said feedback indicates at least one of:

missing data packets, reconstructed data packets, serial numbers and time stamps of packets received, and requests for retransmission of data.

8. The broadband transmitting unit of claim 6, wherein said transmission manager comprises means to search a retransmission queue to locate a copy of at least one of said missing data packets and to forward at least one packet associated with found copy for retransmission by one of said multiplicity of modems.

9. The broadband transmitting unit of claim 6, wherein said transmission manager is associated with a traffic analyzer (I) to analyze said feedback, and (II) to adjust settings of at least one of said multiplicity of transmitting modems in response to analysis of said feedback.

10. The broadband transmitting unit of claim 6, wherein said transmission manager is associated with a traffic analyzer (I) to analyze said feedback, and (II) to adjust settings of at least one of a group of components in response to analysis of said feedback, wherein said group of components comprises at least:

a video encoder, a Forward Error Correction (FEC) processor, a packet encapsulator, an interleaver, a queue buffer.

11. The broadband transmitting unit of claim 1, wherein said broadband transmitting unit is implemented as a virtual broadband transmitting unit which utilizes said multiplicity of transmitting modems to transmit in concert packets of said media data stream through multiple logical channels to said single recipient device, wherein each transmitting modem creates a separate logical channel, and wherein said multiplicity of transmitting modems provide sufficient bandwidth for a generally live media transmission towards said single recipient device.

12. A virtual broadband transmitting unit comprising:

a stream generator to generate a multiplicity of data streams from a media data stream that is intended for uplink transmission to a single recipient device;

a transmission manager to control the uplink transmission of said multiplicity of data streams along a multiplicity of transmission channels via at least one wireless communication network,

wherein said virtual broadband transmitting unit utilizes several transmitting modems in concert to transmit media data through a virtual broadband upload connection via two or more different wireless communication networks,

wherein packets are inequitably distributed amongst the transmitting modems by using at least one buffer;

wherein each transmitting modem is able to perform at different levels over time;

wherein at least one of said transmitting modems transmits its portion of said packets at a rate changing under current prevailing conditions

wherein at least one transmitting modem transmits at least some of its packets at performance characteristics different than those of at least one other transmitting modem, wherein said different performance characteristics comprise one or more of;

(I) different momentary error rate, (II) different momentary bandwidth, (III) different momentary latency;

wherein each transmitting modem generates a separate logical channel, and wherein the separate logical channels constitute a virtual broadband connection;

wherein the multiplicity of transmitting modems transmit packets through one or more wireless network operators, each of which operator operating one or more wireless networks;

wherein said packets are transported to said single receiving device via one or more routes, wherein at least one of said routes comprises at least one of;

a cellular communication network, a Wi-Fi network, a satellite network;

wherein the actual performance of each transmitting modem is impacted by one or more factors selected from the group consisting of;

modem speed, modem reliability, connection quality, operating license limitations, and network congestion.

13. The virtual broadband transmitting unit of claim 12, wherein the virtual broadband transmitting unit is associated with a video encoder to encode said media data stream.

14. The virtual broadband transmitting unit of claim 12, wherein the virtual broadband transmitting unit is associated with a video encoder to encode said media data stream;

wherein video encoding parameters of said video encoder are modified based on momentary performance characteristics of at least one of said multiple transmitting modems.

15. The virtual broadband transmitting unit of claim 12, wherein the multiplicity of transmitting modems comprises at least:

(I) a first cellular modem transmitting through a first cellular network, and (II) a second cellular modem transmitting in concert through a second, different, cellular network;

wherein at least some packets of said media data stream are transmitted to said single recipient device by said first cellular modem through said first cellular network;

wherein at least some other packets of said media data stream are transmitted to said single recipient device by said second cellular modem through said second, different, cellular network.

16. The virtual broadband transmitting unit of claim 12, wherein the multiplicity of transmitting modems comprises at least:

(I) a cellular modem transmitting through a cellular network, and (II) a Wi-Fi modem transmitting in concert through a Wi-Fi network;

wherein at least some packets of said media data stream are transmitted to said single recipient device by said cellular modem through said cellular network;

wherein at least some different packets of said media data stream are transmitted to said single recipient device by said Wi-Fi modem through said Wi-Fi network.

17. The virtual broadband transmitting unit of claim 12, wherein the multiplicity of transmitting modems comprises at least:

(I) a cellular modem transmitting through a first cellular network, and (II) a satellite modem transmitting in concert through a satellite network;

wherein at least some packets of said media data stream are transmitted to said single recipient device by said cellular modem through said cellular network;

wherein at least some different packets of said media data stream are transmitted to said single recipient device by said satellite modem through said satellite network.

18. The virtual broadband transmitting unit of claim 12, wherein the multiplicity of transmitting modems comprises at least:

(I) a first cellular modem transmitting through a cellular network, and (II) a second cellular modem transmitting in concert through same said cellular network;

wherein at least some packets of said media data stream are transmitted to said single recipient device by said first cellular modem through said cellular network;

wherein at least some other packets of said media data stream are transmitted to said single recipient device by said second cellular modem through said same cellular network.

19. A method of virtual broadband transmission, comprising:

organizing into data packets, a media data stream that is intended for upload towards a single recipient device;

generating a multiplicity of data streams from said media data stream;

uploading said data packets via a multiplicity of transmitting modems through at least one wireless communication network, by inequitably distributing said data packets for uplink transmission by two or more wireless modems having different momentary performance characteristics,

wherein said uploading comprises;

controlling the uplink transmission of said multiplicity of data streams along a multiplicity of transmission channels through at least two wireless communication networks,

wherein said uploading is performed via multiple transmitting modems in concert, and creates a virtual broadband upload connection in which the sum total of the upload capacity of said multiple transmitting modems represent enough combined bandwidth for a generally live media transmission;

wherein said packets are inequitably distributed amongst the transmitting modems by using at least one buffer;

wherein the virtual broadband connection is comprised of a multiplicity of logical channels being transmitted;

wherein said uploading comprises transporting said multiplicity of logical channels to said single recipient device via two or more wireless routes;

wherein each transmitting modem is capable of having different performance characteristics, and wherein the actual performance of each transmitting modem is impacted by one or more factors selected from the group consisting of;

modem speed, modem reliability, connection quality, operating license limitations, and network congestion.

20. The method of claim 19, further comprising:

receiving feedback regarding the success of said uploading;

analyzing said feedback; and

adjusting operational settings for said organizing and said multiplicity of modems in response to results of said analyzing of said feedback.

21. The method of claim 19, further comprising:

generating packets with forward error correction (FEC) codes;

receiving retransmission requests for at least one improperly received data packet;

retransmitting said at least one improperly received data packet.

22. The method of claim 19,

wherein at least two of the multiplicity of modems transmit said media packets over at least two different wireless networks, and wherein at least two of the multiplicity of modems have at least one of:

(I) different momentary latency, (II) different momentary error rate, (III) different momentary bandwidth.

23. A virtual receiver system, comprising:

a receiving and processing element to receive a plurality of incoming media data streams carrying packets of encoded media from a plurality of routes, wherein each incoming media data packet was transmitted by a virtual broadband transmitter from a location along a transmission route that comprises at least one wireless communication network accessible from said location;

an assembly engine (a) to receive as input the packets of said plurality of incoming media data packets per their order of arrival, and (b) to assemble said plurality of incoming media data packets into a single serial media stream of packets forming a media transmission from said location;

wherein the assembly engine is associated with an output rate controller to regulate a rate at which packets of the re-assembled media stream are released from said assembly engine;

wherein said packets arrive to said receiving and processing element in a generally non-serial order and are placed in a receiving window of a jitter buffer of said assembly engine.

24. A broadband transmitting unit, comprising:

a transmission manager to control an uplink transmission of a multiplicity of data streams along a multiplicity of wireless transmission channels via at least one wireless communication network to a single recipient device,

wherein said broadband transmitting unit utilizes at least two transmitting modems to transmit in concert media data through at least one cellular network;

wherein the broadband transmitting unit utilizes said at least two transmitting modems in concert to create a virtual broadband upload connection, in which the sum total of the upload capacity of said at least two transmitting modems represent enough combined bandwidth for a generally live media transmission;

wherein the at least two transmitting modems transmit the media data to a single recipient device via one or more routes;

wherein the broadband transmitting unit transmits the media data as packets inequitably distributed amongst the at least two transmitting modems;

wherein the inequitable distribution of said packets amongst said at least two transmitting modems is changed over time, based on at least one of;

(I) different prevailing conditions of at least one of said routes, (II) momentary performance characteristics of said at least two transmitting modems;

wherein each transmitting modem generates a separate logical channel, and wherein the separate logical channels constitute said virtual broadband upload connection.

25. The broadband transmitting unit of claim 24,

wherein the inequitable distribution of said packets amongst said transmitting modems is changed over time by said transmission manager, based on at least one of:

(I) momentary latency, (II) momentary error rate, (III) momentary bandwidth.

26. The broadband transmitting unit of claim 24,

wherein said transmission manager uses at least one wireless modem to retransmit a packet that is associated with a previously-transmitted packet, based on at least one of:

(I) different momentary latency of said transmitting modems, (II) different momentary error rate of said transmitting modems, (III) different momentary bandwidth of said transmitting modems.

27. The broadband transmitting unit of claim 24, further comprising:

a stream generator to generate a multiplicity of packets from a media data stream that is intended for uplink transmission controlled by said transmission manager.

28. The broadband transmitting unit of claim 24, wherein the multiplicity of transmitting modems comprises at least:

(I) a cellular modem transmitting through a cellular network, and (II) a Wi-Fi modem transmitting in concert through a Wi-Fi network;

wherein at least some packets of said media data stream are transmitted to said single recipient device by said cellular modem through said cellular network;

wherein at least some different packets of said media data stream are transmitted to said single recipient device by said Wi-Fi modem through said Wi-Fi network.

29. The broadband transmitting unit of claim 24, wherein the multiplicity of transmitting modems comprises at least:

(I) a cellular modem transmitting through a first cellular network, and (II) a satellite modem transmitting in concert through a satellite network;

wherein at least some packets of said media data stream are transmitted to said single recipient device by said cellular modem through said cellular network;

wherein at least some different packets of said media data stream are transmitted to said single recipient device by said satellite modem through said satellite network.

30. The broadband transmitting unit of claim 24, wherein the multiplicity of transmitting modems comprises at least:

(I) a first cellular modem transmitting through a first cellular network, and (II) a second cellular modem transmitting in concert through a second, different, cellular network;

wherein at least some packets of said media data stream are transmitted to said single recipient device by said first cellular modem through said first cellular network;

wherein at least some other packets of said media data stream are transmitted to said single recipient device by said second cellular modem through said second, different, cellular network.

31. The broadband transmitting unit of claim 24, further comprising at least one of:

a stream generator to generate a multiplicity of data streams from a media data stream that is intended for uplink transmission to said single recipient device;

a forward error correction (FEC) processor to provide FEC codes to said data stream;

a packet encapsulator to generate numbered data packets from said data stream.

32. A broadband transmitting unit comprising:

a transmission manager to control an uplink transmission of a multiplicity of data streams along a multiplicity of transmission channels to a single recipient device

wherein said broadband transmitting unit utilizes several transmitting modems to transmit media data in concert through at least two wireless communication networks that comprise;

(A) a first satellite-based wireless communication network, and (B) a second satellite-based communication network which is selected from the group consisting of;

(B1) the same first satellite-based wireless communication network, (B2) another, different, satellite-based wireless communication network;

wherein the broadband transmitting unit uses multiple transmitting modems in concert to create a broadband upload connection that uploads said multiplicity of data streams to said single recipient device via two or more satellite-based communication links, wherein the sum total of the upload capacity of said multiple transmitting modems represent enough combined bandwidth for a generally live media transmission towards said single recipient device;

wherein the broadband transmitting unit transmits the media data as packets that are inequitably distributed amongst the wireless transmitting modems by using at least one buffer;

wherein each satellite-communication-based transmitting modem is able to perform at different levels over time;

wherein at least one satellite-communication-based transmitting modem transmits said media packets at a rate that is adapted under current prevailing conditions;

wherein each wireless transmitting modem generates a separate logical channel, and wherein the separate logical channels constitute said broadband upload connection;

wherein said broadband upload connection is comprised of a multiplicity of logical channels being transmitted in concert to one or more wireless network operators, each of which network operators operating one or more wireless networks;

wherein at least two of the multiplicity of satellite-communication-based modems transmit said media packets to said single recipient device via one or more routes.

33. The broadband transmitting unit of claim 32,

wherein the first satellite-communication-based modem and the second satellite-communication-based modem transmit packets to said single recipient device via two different satellite routes.

34. The broadband transmitting unit of claim 32,

wherein the first satellite-communication-based modem and the second satellite-communication-based modem transmit packets to said single recipient device via a single transmit antenna.

35. The broadband transmitting unit of claim 32,

wherein the transmission manager is to inequitably distribute packets, to be transmitted towards said single recipient device, amongst:

(i) the first satellite-communication-based modem, and (ii) the second satellite-communication-based modem, and (iii) a Wi-Fi modem of said broadband transmitting unit.

36. The broadband transmitting unit of claim 32,

wherein the transmission manager is to inequitably distribute packets, to be transmitted towards said single recipient device, amongst:

(i) the first satellite-communication-based modem, and (ii) the second satellite-communication-based modem, and (iii) a cellular modem of said broadband transmitting unit.

37. The broadband transmitting unit of claim 32, further comprising:

a back channel for receiving from said single recipient device feedback regarding at least one of the timeliness and quality of said multiplicity of data streams that are transmitted via said first and second satellite-communication-based modems.

38. The broadband transmitting unit of claim 32, wherein the transmission manager is to inequitably distribute packets for uploading via said first and second satellite-communication-based modems, based on feedback received from said single recipient device via a feedback channel, wherein said feedback indicates at least one of:

missing data packets, reconstructed data packets, serial numbers and time stamps of packets received, and requests for retransmission of data.

39. The broadband transmitting unit of claim 32, wherein at least two of the multiplicity of satellite-communication-based modems have at least one of:

(I) different momentary latency, (II) different momentary error rate, (III) different momentary bandwidth.