System and method for implementation of dynamic encoding rates for mobile devices

• US 9,585,062 B2
• Filed: 04/04/2012
• Issued: 02/28/2017
• Est. Priority Date: 07/15/2010
• Status: Active Grant

• Current Assignee: Dejero Labs, Inc.
• Original Assignee: Dejero Labs, Inc.
• Inventors: Kaye, Hagen, Mallet, Wayne, Sze, David
• Primary Examiner(s): Rao, Andy
• Application Number:
  US13/439,352
• Publication Number:
  US 20120250762A1
• Time in Patent Office: 1,791 Days
• Field of Search: 37524001-24026
• US Class Current: 1/1
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions
• CPC Class Codes: H04L 47/28 in relation to timing considerations
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70
• CPC Class Codes: H04L 69/14 Multichannel or multilink protocols
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/44029 for generating different versions
• CPC Class Codes: H04N 21/44245 Monitoring the upstream path of the transmission network, e.g. its availability, bandwidth
• CPC Class Codes: H04N 21/6181 involving transmission via a mobile phone network arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004
• CPC Class Codes: H04W 28/0231 based on communication conditions dynamic wireless traffic scheduling definition based on channel quality criteria H04W72/54
• CPC Class Codes: H04W 28/14 : using intermediate storage
• CPC Class Codes: H04W 8/04 : Registration at HLR or HSS [Home Subscriber Server]

Abstract

There is disclosed a system and method for transmission of data signals from a mobile device to a network. In an embodiment, the method comprises encoding video data at a first encoding rate into a plurality of video frames using a first encoding module; encoding video data at a second encoding rate into a plurality of video frames using a second encoding module; detecting a change in the availability of wireless bandwidth in the network; and switching a selector to retrieve frames from either the first encoding module or the second encoding module for transmission in dependence upon the available wireless bandwidth. The encoding rate of whichever one of the first encoding module and the second encoding module is currently not selected is successively increased or decreased, and a selector is switched to retrieve frames from either the first encoding module or the second encoding module.

Claims

1. A method of transmission of data signals from a mobile device to a network comprising:

encoding video data at a first encoding rate into a plurality of video frames using a first encoder;

concurrently with the encoding using the first encoder, encoding the video data at a second encoding rate into a plurality of video frames using a second encoder;

retrieving frames encoded by the first encoder;

delivering the retrieved frames encoded by the first encoder for transmission over a network interface;

detecting an availability of wireless bandwidth in the network;

switching to retrieve frames encoded by the second encoder in response to the availability of wireless bandwidth in the network; and

delivering the retrieved frames encoded by the second encoder over the same network interface.

2. The method of claim 1, further comprising:

alternating, at successively increasing or decreasing encoding rates in a stair-step manner until a failure is detected in a channel feedback from the network, between retrieving of frames encoded by the first encoder and retrieving frames encoded by the second encoder wherein the alternating includes;

upon switching to retrieve frames encoded by the second encoder;

detecting for the failure in the channel feedback from the network, wherein when no failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at an increased or decreased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the first encoder.

3. The method of claim 1, further comprising transmitting the delivered frames encoded by either the first encoder or the second encoder utilizing a transmitter wirelessly connected to the network.

4. The method of claim 1, wherein the availability of wireless bandwidth in the network is detected via a transmitter.

5. The method of claim 1, wherein the switching to retrieve frames encoded by the second encoder comprises:

applying timestamps to the video data, whereby the timestamps are applied to the plurality of video frames encoded by the first encoder and to the plurality of video frames encoded by the second encoder;

retrieving frames encoded by the first and second encoders;

comparing the timestamps of the frames retrieved from the first encoder and the timestamps of the frames retrieved from the second encoder to establish a transition frame;

delivering the frames retrieved from the first encoder until the transition frame is reached; and

delivering the frames retrieved from the second encoder starting at the transition frame, such that there is a seamless transition between the delivery of the frames encoded by the first encoder and the delivery of the frames encoded by the second encoder without dropping a frame.

17. The method of claim 2, further comprising:

upon switching to retrieve frames encoded by the first encoder;

detecting for the failure in the channel feedback from the network, wherein when no failure is detected;

shutting down the encoding by the second encoder;

re-initiating encoding of the video data by the second encoder, at an increased or decreased encoding rate compared to the current encoding rate of the first encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the second encoder.

18. The method of claim 2, wherein prior to the start of encoding, an approximate stable bandwidth for the connection is unknown;

and the method further comprises;

determining the approximate stable bandwidth for the connection based at least on when the failure arising from the alternation of the encoding rates in the stair-step manner is detected.

6. A system for transmission of data signals from a mobile device to a network comprising:

a first encoder for encoding video data at a first encoding rate into a plurality of video frames;

a second encoder for encoding, concurrently with the first encoder, the video data at a second encoding rate into a plurality of video frames;

a controller configured to;

retrieve frames encoded by the first encoder;

deliver the retrieved frames encoded by the first encoder for transmission over a network interface;

detect an availability of wireless bandwidth in the network;

switch a selector to retrieve frames encoded by the second encoder in response to the availability of wireless bandwidth in the network; and

deliver the retrieved frames encoded by the second encoder for transmission over the same network interface.

7. The system of claim 6, wherein the first encoder and the second encoder are configured encoding at a plurality of encoding rates;

and

the controller is configured to;

detect for a failure in a channel feedback from the network;

alternate the selector to retrieve frames, at successively increasing or decreasing encoding rates in a stair-step manner until the failure is detected, between the frames encoded by the first encoder and the frames encoded by the second encoder for transmission in response to the availability of wireless bandwidth in the network, wherein the alternating comprises;

upon switching the selector to retrieve frames encoded by the second encoder and when no failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at an increased or decreased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching the selector to retrieve frames encoded by the first encoder.

8. The system of claim 6, further comprising a transmitter for transmitting the frames encoded by either the first encoder or the second encoder, the transmitter wirelessly connected to the network.

9. The system of claim 8, wherein the transmitter is adapted to detect the availability of wireless bandwidth in the network.

10. The system of claim 6, wherein the controller is configured to:

apply timestamps to the video data, whereby the timestamps are applied to the plurality of video frames encoded by the first encoder and to the plurality of video frames encoded by the second encoder; and

switch the selector to;

retrieve frames encoded by

the first and second encoders;

compare the timestamps of the retrieved frames encoded by the first encoder and the retrieved frames encoded by the second encoder to establish a transition frame;

deliver the frames retrieved from the first encoder until the transition frame is reached; and

deliver the frames retrieved from the second encoder starting at the transition frame, such that there a seamless transition between is a seamless transition between the delivery of the frames encoded by the first encoder and the delivery of the frames encoded by the second encoder without dropping a frame.

19. The system of claim 6, wherein the first encoder and the second encoder are configured encoding at a plurality of encoding rates;

and

the controller is configured to;

detect for a failure in a channel feedback from the network;

alternate the selector to retrieve frames, at successively decreasing encoding rates in a stair-step manner until no failure is detected, between the frames encoded by the first encoder and the frames encoded by the second encoder for transmission in response to the availability of wireless bandwidth in the network, wherein the alternating comprises;

upon switching the selector to retrieve frames encoded by the second encoder and when the failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at a decreased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching the selector to retrieve frames encoded by the first encoder; and

upon switching to retrieve frames encoded by the first encoder and when the failure is detected;

shutting down the encoding by the second encoder;

re-initiating encoding of the video data by the second encoder, at a decreased encoding rate compared to the current encoding rate of the first encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the second encoder.

20. The system of claim 6, wherein the first encoder and the second encoder are configured encoding at a plurality of encoding rates;

and

the controller is configured to;

detect for a failure in a channel feedback from the network;

alternate the selector to retrieve frames, at successively increasing or decreasing encoding rates in a stair-step manner until the failure is detected or no failure is detected, between the frames encoded by the first encoder and the frames encoded by the second encoder for transmission in response to the availability of wireless bandwidth in the network, wherein the alternating comprises;

upon switching the selector to retrieve frames encoded by the second encoder,

when no failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at an increased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching the selector to retrieve frames encoded by the first encoder; and

when the failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at a decreased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching the selector to retrieve frames encoded by the first encoder; and

upon switching to retrieve frames encoded by the first encoder,

when no failure is detected;

shutting down the encoding by the second encoder;

re-initiating encoding of the video data by the second encoder, at an increased encoding rate compared to the current encoding rate of the first encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the second encoder; and

when the failure is detected;

shutting down the encoding by the second encoder;

re-initiating encoding of the video data by the second encoder, at a decreased encoding rate compared to the current encoding rate of the first encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the second encoder.

11. A computer readable medium storing computer code that when executed on a mobile device configures the device to perform a method of transmission of data signals from the mobile device to a network, the computer readable medium comprising:

code for encoding video data at a first encoding rate into a plurality of video frames using a first encoder;

code for concurrently with the encoding using the first encoder, encoding the video data at a second encoding rate into a plurality of video frames using a second encoder;

code for retrieving frames encoded by the first encoder;

code for delivering the retrieved frames encoded by the first encoder for transmission over a network interface;

code for detecting an availability of wireless bandwidth in the network;

code for switching to retrieve frames encoder the second encoder in response to the availability of wireless bandwidth in the network; and

code for delivering the retrieved frames encoded by the second encoder over the same network interface.

12. The computer readable medium of claim 11, further comprising:

code for detecting a failure in a channel feedback from the network;

code for alternating, at successively increasing or decreasing encoding rates in a stair-step manner until the failure is detected in the channel feedback from the network, between retrieving of frames encoded by the first encoder and retrieving frames encoded by the second encoder, wherein the alternating includes;

upon switching to retrieve frames encoded by the second encoder and when no failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at an increased or decreased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the first encoder.

13. The computer readable medium of claim 11, further comprising code for transmitting the delivered frames encoded utilizing a transmitter wirelessly connected to the network.

14. The computer readable medium of claim 11, further comprising code for detecting the availability of wireless bandwidth in the network via a transmitter.

21. The computer readable medium of claim 11, further comprising:

code for detecting a failure is detected in a channel feedback from the network

code for alternating, at successively decreasing encoding rates in a stair-step manner until no failure is detected, between retrieving of frames encoded by the first encoder and retrieving frames encoded by the second encoder, wherein the alternating includes;

upon switching to retrieve frames encoded by the second encoder and when the failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at an decreased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the first encoder; and

upon switching to retrieve frames encoded by the first encoder and when the failure is detected;

shutting down the encoding by the second encoder;

re-initiating encoding of the video data by the second encoder, at an decreased encoding rate compared to the current encoding rate of the first encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the second encoder.

22. The computer readable medium of claim 11, further comprising:

code for detecting a failure in a channel feedback from the network; and

code for alternating, at successively increasing or decreasing encoding rates in a stair-step manner until a failure is detected or no failure is detected in the channel feedback from the network, between retrieving of frames encoded by the first encoder and retrieving frames encoded by the second encoder, wherein the alternating includes;

upon switching to retrieve frames encoded by the second encoder;

when no failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at an increased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the first encoder; and

when the failure is detected;

shutting down the encoding by the first encoder;

re-initiating encoding of the video data by the first encoder, at an decreased encoding rate compared to the current encoding rate of the second encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the first encoder; and

upon switching to retrieve frames encoded by the first encoder;

when no failure is detected;

shutting down the encoding by the second encoder;

re-initiating encoding of the video data by the second encoder, at an increased encoding rate compared to the current encoding rate of the first encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the second encoder; and

when the failure is detected;

shutting down the encoding by the second encoder;

re-initiating encoding of the video data by the second encoder, at an decreased encoding rate compared to the current encoding rate of the first encoder, into a plurality of video frames; and

switching to retrieve frames encoded by the second encoder.

15. A method of transmission of data signals from a mobile device to a network comprising:

applying a first transmission session parameter value so as to define a first set of video frames using a first encoder;

applying a second transmission parameter value so as to define a concurrent second set of video frames using a second encoder;

detecting an availability of wireless bandwidth in the network; and

switching a selector to selectively retrieve frames encoded by either the first encoder or the second encoder for transmission in response to the available wireless bandwidth.

16. The method of claim 15, wherein the transmission parameter value consists of frame rate, resolution and/or aspect ratio.