Wireless transmission of real-time media

• US 9,532,043 B2
• Filed: 08/02/2013
• Issued: 12/27/2016
• Est. Priority Date: 08/02/2013
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Pavel, Sandy, Smadi, Mohammed Nawaf, Kezys, Vytautas Robertas
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): AYNALEM, NATHNAEL B
• Application Number:
  US13/957,786
• Publication Number:
  US 20150036733A1
• Time in Patent Office: 1,243 Days
• Field of Search: 382/233, 382/238, 37524001-24029, 709/232, 709/239
• US Class Current: 1/1
• CPC Class Codes: G06F 1/3278 Power saving in modem or I/O interface
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04N 19/10 using adaptive coding
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 21/44227 Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811
• CPC Class Codes: H04W 28/18 Negotiating wireless communication parameters
• CPC Class Codes: H04W 52/0216 using a pre-established activity schedule, e.g. traffic indication frame
• CPC Class Codes: H04W 76/14 Direct-mode setup
• CPC Class Codes: Y02D 10/00 : Energy efficient computing, e.g. low power processors, power management or thermal management
• CPC Class Codes: Y02D 30/70 : in wireless communication networks

Abstract

A method, wireless communication device, and computer readable medium, are disclosed, for wireless transmission of real-time media from a source to a sink over a wireless transmission channel. The wireless device initiates a peer-to-peer communication session between the sink and the source, and determines based on a time-allocation for the wireless transmission, an available bandwidth for the wireless transmission. The wireless device encodes the real-time media for the wireless transmission such that a time-required for transmission of the first frame-type is less than or equal to a period-of-availability for transmission defined in the time-allocation for the wireless transmission.

Claims

1. A method for wireless transmission of a real-time media from a source device to a sink device over a wireless transmission channel, wherein the real-time media comprises a plurality of frames, the method comprising:

determining an available bandwidth between the source device and the sink device for the wireless transmission based on a time-allocation of the source device for wireless transmission defined by a Notice-of-Absence schedule;

determining a time-required for wireless transmission of a frame of a first frame-type based on the time-allocation of the source device for wireless transmission defined by the Notice-of-Absence schedule; and

encoding the real-time media into the first frame-type for wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device and such that the time-required for transmission of the frame of the first frame-type is less than or equal to the time-allocation for the wireless transmission.

2. The method of claim 1, further comprising:

aligning a start of transmission of the frame of the first frame-type with a start of the time-allocation.

3. The method of claim 1, further comprising:

determining, based on a hardware limitation associated with one or both of the source device and the sink device, the throughput constraint for the wireless transmission;

when the available bandwidth is less than the throughout constraint, encoding the real-time media for the wireless transmission based on the available bandwidth; and

when the available bandwidth is greater than or equal to the throughput constraint, encoding the real-time media for the wireless transmission based on the throughput constraint.

4. The method of claim 1, further comprising setting the time-allocation of the source device for wireless transmission using the Notice-of-Absence schedule.

5. The method of claim 1, further comprising initiating a peer-to-peer (P2P) communication session between the sink device and the source device.

6. The method of claim 1, wherein the real-time media is a Miracast video-stream.

7. The method of claim 1, wherein the time-allocation is a period-of-availability defined by the Notice-of-Absence schedule.

8. The method of claim 1, wherein the throughput constraint is a maximum throughput constraint between the source device and the sink device.

9. A method for wireless transmission of a real-time media from a source device to a sink device over a wireless transmission channel, wherein the real-time media comprises a plurality of frames, the method comprising:

determining an available bandwidth between the source device and the sink device for the wireless transmission based on a time-allocation of the source device for wireless transmission defined by a Notice-of-Absence schedule;

when a frame of a first frame-type is queued for transmission,

determining a time-required for wireless transmission of the frame of the first frame-type queued for transmission based on the available bandwidth;

encoding the real-time media into the first frame-type for wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device; and

setting a new time-allocation for wireless transmission such that the time-allocation of the source device for wireless transmission is greater than or equal to the time-required for transmission of the first frame-type.

10. The method of claim 9, further comprising:

determining a frame-type of a frame queued for transmission, the frame-type being either the first frame-type or a second frame-type;

when a frame of the second frame-type is queued for transmission,

determining a time-required for wireless transmission of the frame of the second frame-type queued for transmission based on the available bandwidth;

encoding the real-time media into the second frame-type for the wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device; and

setting a new time-allocation for wireless transmission such that the time-allocation of the source device for wireless transmission is greater than or equal to a time-required for transmission of the second frame-type.

11. The method of claim 10, wherein the first frame-type is an Intra-Frame, and the second frame-type is a Predicted-Frame.

12. The method of claim 9, wherein the time-allocation is a period-of-availability defined by the Notice-of-Absence schedule.

13. The method of claim 9, wherein the throughput constraint is a maximum throughput constraint between the source device and the sink device.

14. The method of claim 9, further comprising:

determining, based on a hardware limitation associated with one or both of the source device and the sink device, the throughput constraint for the wireless transmission;

when the available bandwidth is less than the throughput constraint, encoding the real-time media for the wireless transmission based on the available bandwidth; and

when the available bandwidth is greater than or equal to the throughput constraint, encoding the real-time media for the wireless transmission based on the throughput constraint.

15. The method of claim 9, further comprising:

aligning a start of transmission of the frame of the first frame-type with a start of the time-allocation.

16. A wireless communication device, comprising:

a processor;

a memory storing media and instructions for wireless transmission of the media from a source device to a sink device over a wireless transmission channel, wherein the processor is configured to;

determine an available bandwidth between the source device and the sink device for the wireless transmission based on a time-allocation of the source device for wireless transmission defined by a Notice-of-Absence schedule;

determine a time-required for wireless transmission of a frame of a first frame-type based on the time-allocation of the source device for wireless transmission defined by the Notice-of-Absence schedule; and

encode the real-time media into the first frame-type for wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device and such that the time-required for transmission of the frame of the first frame-type is less than or equal to the time-allocation for the wireless transmission.

17. The wireless communication device of claim 16, wherein the processor is further configured to align a start of transmission of the frame of the first frame-type with a start of the time-allocation.

18. The wireless communication device of claim 16, wherein the processor is further configured to:

determine, based on a hardware limitation associated with one or both of the source device and the sink device, the throughput constraint for the wireless transmission;

when the available bandwidth is less than the throughput constraint, encode the real-time media for the wireless transmission based on the available bandwidth; and

when the available bandwidth is greater than or equal to the throughput constraint, encode the real-time media for the wireless transmission based on the throughput constraint.

19. The wireless communication device of claim 16, wherein the processor is further configured to set the time-allocation of the source device for wireless transmission using the Notice-of-Absence schedule.

20. The wireless communication device of claim 16, wherein the processor is further configured to initiate a peer-to-peer (P2P) communication session between the sink device and the source device.

21. The wireless communication device of claim 16, wherein the real-time media is a Miracast video-stream.

22. A wireless communication device, comprising:

a processor;

a memory storing media and instructions for wireless transmission of the media from a source device to a sink device over a wireless transmission channel, wherein the processor is configured to;

determine an available bandwidth between the source device and the sink device for the wireless transmission based on a time-allocation of the source device for wireless transmission defined by a Notice-of-Absence schedule;

when a frame of a first frame-type is queued for transmission,

determine a time-required for wireless transmission of the frame of the first frame-type queued for transmission based on the available bandwidth;

encode the real-time media into the first frame-type for wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device;

set a new time-allocation for wireless transmission such that the time-allocation of the source device for wireless transmission is greater than or equal to the time-required for transmission of the first frame-type.

23. The wireless communication device claim 22, wherein the processor is further configured to:

determine a frame-type of a frame queued for transmission, the frame-type being either the first frame-type or a second frame-type;

when a frame of the second frame-type is queued for transmission,

determine a time-required for wireless transmission of the frame of the second frame-type queued for transmission based on the available bandwidth;

encode the real-time media into the second frame-type for the wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device; and

set a new time-allocation for wireless transmission such that the time-allocation of the source device for wireless transmission is greater than or equal to a time-required for transmission of the second frame-type.

24. The wireless communication device of claim 23, wherein the first frame-type is an Intra-Frame, and the second frame-type is a Predicted-Frame.

25. A non-transitory machine readable medium having tangibly stored thereon executable instructions for execution by a processor of a wireless communication device to perform a method for encoding real-time media for wireless transmission from a source device to a sink device over a wireless transmission channel, wherein the executable instructions, when executed by the processor of the wireless communication device, cause the processor to:

determine an available bandwidth between the source device and the sink device for the wireless transmission based on a time-allocation of the source device for wireless transmission defined by a Notice-of-Absence schedule;

determine a time-required for wireless transmission of a frame of a first frame-type based on the time-allocation of the source device for wireless transmission defined by the Notice-of-Absence schedule; and

encode the real-time media into the first frame-type for wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device and such that the time-required for transmission of the frame of the first frame-type is less than or equal to the time-allocation for the wireless transmission.

26. A non-transitory machine readable medium having tangibly stored thereon executable instructions for execution by a processor of a wireless communication device to perform a method for encoding real-time media for wireless transmission from a source device to a sink device over a wireless transmission channel, wherein the executable instructions, when executed by the processor of the wireless communication device, cause the processor to:

determine an available bandwidth between the source device and the sink device for the wireless transmission based on a time-allocation of the source device for wireless transmission defined by a Notice-of-Absence schedule;

when a frame of a first frame-type is queued for transmission,

determine a time-required for wireless transmission of the frame of the first frame-type queued for transmission based on the available bandwidth;

encode the real-time media into the first frame-type for wireless transmission based on a minimum of the available bandwidth between the source device and the sink device or a throughput constraint between the source device and the sink device;

set a new time-allocation for wireless transmission such that the time-allocation of the source device for wireless transmission is greater than or equal to the time-required for transmission of the first frame-type.