High quality multimedia transmission from a mobile device for live and on-demand viewing

• US 9,420,232 B2
• Filed: 10/27/2014
• Issued: 08/16/2016
• Est. Priority Date: 11/21/2007
• Status: Active Grant

• Current Assignee: Skype Ireland Technologies Holdings Limited (Microsoft Corporation)
• Original Assignee: Skype Ireland Technologies Holdings Limited (Microsoft Corporation)
• Inventors: Abkairov, Nikolay, Timanovsky, Alexey
• Primary Examiner(s): Tran, Hai V
• Application Number:
  US14/524,925
• Publication Number:
  US 20150089555A1
• Time in Patent Office: 659 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/440227 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/44029 for generating different versions
• CPC Class Codes: H04N 21/44245 Monitoring the upstream path of the transmission network, e.g. its availability, bandwidth
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

Techniques are provided for transmitting high quality multimedia data from a mobile device for live and on-demand viewing. The mobile device adjusts the quality of a single multimedia data stream based on one or more factors, such as the available bandwidth of a wireless link with a server, whether there are any “live” subscribers of the multimedia data stream, whether any “live” subscribers are interacting with the mobile device, and a change in the privacy settings of the user of the mobile device. Any data that was removed from the multimedia data stream before it was transmitted to a server is subsequently sent to the server. The server generates multiple versions of the multimedia data stream that vary in terms of quality. The server selects which version of the multimedia data stream to transmit to a subscriber of the multimedia data stream based on one or more criteria.

Claims

1. A method comprising:

capturing a multimedia data stream on a device;

while the device is in a real-time streaming mode, sending, to a server via a network, a lower quality version of the multimedia data stream to enable real time streaming of the lower quality version of the multimedia data stream, the lower quality version of the multimedia data stream generated by removing data from the captured multimedia data stream; and

sending, to the server via the network, the removed data of the captured multimedia data stream effective to cause the server to combine the removed data with the lower quality version of the multimedia data stream to generate a higher quality version of the multimedia data stream.

2. The method of claim 1, wherein the sending the removed data causes the server to store the higher quality version of the multimedia data stream for on-demand viewing.

3. The method of claim 1, wherein the lower quality version of the multimedia data stream is encoded with a lower bit rate than the higher quality version of the multimedia data stream.

4. The method of claim 1, wherein prior to sending the lower quality version of the multimedia data stream the method further comprises:

sending a highest quality version of the multimedia data stream to the server; and

sending the lower quality version of the multimedia data stream responsive to detecting network delays.

5. The method of claim 1, wherein prior to sending the lower quality version of the multimedia data stream the method further comprises:

sending a highest quality version of the multimedia data stream to the server; and

sending the lower quality version of the multimedia data stream responsive to detecting that one or more viewers have subscribed to a live viewing of the multimedia data stream.

6. The method of claim 1, wherein the lower quality version of the multimedia data stream is sent to the server without exceeding a pre-defined latency threshold between capturing the multimedia data stream and sending the lower quality version of the multimedia data stream.

7. A mobile device comprising:

a camera for capturing a multimedia data stream; and

at least a memory and a processor to perform operations comprising;

while the mobile device is in a real-time streaming mode, sending, to a server via a network, a lower quality version of the multimedia data stream to enable real time streaming of the lower quality version of the multimedia data stream, the lower quality version of the multimedia data stream generated by removing data from the captured multimedia data stream; and

sending, to the server via the network, the removed data of the multimedia data stream effective to cause the server to combine the removed data with the lower quality version of the multimedia data stream to generate a higher quality version of the multimedia data stream.

8. The mobile device of claim 7, wherein the sending the removed data of the multimedia data stream further causes the server to store the higher quality version of the multimedia data stream for on-demand viewing.

9. The mobile device of claim 7, wherein the lower quality version of the multimedia data stream is encoded with a lower bit rate than the higher quality version of the multimedia data stream.

10. The mobile device of claim 7, wherein the removed data of the multimedia data stream comprises frames of the multimedia data stream that was removed from the multimedia data stream in order to generate the lower quality version of the multimedia data stream.

11. The mobile device of claim 7, wherein prior to sending the lower quality version of the multimedia data stream, the operations further comprise:

sending a highest quality version of the multimedia data stream to the server; and

sending the lower quality version of the multimedia data stream responsive to detecting network delays.

12. The mobile device of claim 7, wherein prior to sending the lower quality version of the multimedia data stream, the operations further comprise:

sending a highest quality version of the multimedia data stream to the server; and

sending the lower quality version of the multimedia data stream responsive to detecting that one or more viewers have subscribed to a live viewing of the multimedia data stream.

13. The mobile device of claim 7, wherein the lower quality version of the multimedia data stream is sent to the server without exceeding a pre-defined latency threshold between capturing the multimedia data stream and sending the lower quality version of the multimedia data stream.

14. A system comprising:

at least a memory and a processor to perform operations comprising;

capturing a multimedia data stream on a device;

while the device is in a real-time streaming mode, sending, to a server via a network, a lower quality version of the multimedia data stream to enable real time streaming of the lower quality version of the multimedia data stream, the lower quality version of the multimedia data stream generated by removing data from the captured multimedia data stream; and

sending, to the server via the network, the removed data of the captured multimedia data stream effective to cause the server to combine the removed data with the lower quality version of the multimedia data stream to generate a higher quality version of the multimedia data stream.

15. The system of claim 14, wherein the sending the removed data of the multimedia data stream causes the server to store the higher quality version of the multimedia data stream for on-demand viewing.

16. The system of claim 14, wherein the lower quality version of the multimedia data stream is encoded with a lower bit rate than the higher quality version of the multimedia data stream.

17. The system of claim 14, wherein the lower quality version of the multimedia data stream is sent to the server without exceeding a pre-defined latency threshold between capturing the multimedia data stream and sending the lower quality version of the multimedia data stream.

18. The system of claim 14, wherein prior to sending the lower quality version of the multimedia data stream the operations further comprises:

sending a highest quality version of the multimedia data stream to the server; and

sending the lower quality version of the multimedia data stream responsive to detecting network delays.

19. The system of claim 14, wherein prior to sending the lower quality version of the multimedia data stream the operations further comprises:

sending a highest quality version of the multimedia data stream to the server; and

sending the lower quality version of the multimedia data stream responsive to detecting that one or more viewers have subscribed to a live viewing of the multimedia data stream.