Multimedia transcoding method and system for mobile devices

• US 9,628,831 B2
• Filed: 07/26/2012
• Issued: 04/18/2017
• Est. Priority Date: 03/25/2010
• Status: Active Grant

• Current Assignee: WhatsApp LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: WhatsApp LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Inventors: Koum, Jan, Acton, Brian
• Primary Examiner(s): Magloire, Vladimir
• Assistant Examiner(s): DONADO, FRANK E
• Application Number:
  US13/559,558
• Publication Number:
  US 20120294352A1
• Time in Patent Office: 1,727 Days
• CPC Class Codes: H04N 21/234309 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/25858 involving client software characteristics, e.g. OS identifier
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 4/20 Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals
• CPC Class Codes: H04W 88/181 Transcoding devices; Rate adaptation devices

Abstract

Aspects of the present invention include method and systems or processing multimedia data exchanged between mobile devices. Initially, a transmitting mobile device attempts to send multimedia data formatted in a primary format even though a receiving mobile device cannot process the data. The multimedia data in the primary format is then uploaded to a multimedia communication server where the multimedia data can be transcoded on demand into a secondary format that the receiving mobile device can indeed process. To track the multimedia data, the transmitting mobile device receives a multimedia identifier associated with the multimedia data uploaded to the multimedia communication server. Instead of sending the multimedia data, the transmitting mobile device forwards the multimedia identifier to the receiving mobile device allowing the receiving mobile device to demand transcoding the multimedia data into a secondary format on the server that the receiving mobile device is capable of receiving and processing.

Claims

1. A method, comprising:

identifying, on a transmitting mobile device, multimedia data formatted in accordance with a primary format to be sent to a receiving mobile device that cannot process the multimedia data formatted in the primary format;

uploading the multimedia data formatted in accordance with the primary format to a multimedia communication server;

responsive to uploading the multimedia data, receiving at the transmitting mobile device from the multimedia communication server a multimedia identifier associated with the multimedia data uploaded to the multimedia communication server; and

responsive to the receipt of the multimedia identifier received from the multimedia communication server, transmitting over a synthetic communications network the multimedia identifier received from the multimedia communication server from the transmitting mobile device to the receiving mobile device, wherein the receiving mobile device is identified on the synthetic communications network by a normalized version of a phone number in a phone directory, the normalized number originally provisioned for the receiving mobile device on a voice network and subsequently normalized to a standard format used for synchronizing members of and communication over the synthetic communications network, and without the forwarded multimedia identifier passing through the multimedia communication server, the multimedia identifier to be used by the receiving mobile device to request the multimedia data that is to be transcoded into a secondary format on the multimedia communication server that the receiving mobile device is capable of processing.

2. The method of claim 1 wherein the type of multimedia data is selected from a set of multimedia types including images, videos, sound and combinations thereof.

3. The method of claim 1 wherein messages facilitate the transmission of the multimedia data from the transmitting mobile device.

4. The method of claim 3 wherein the messages are sent over a voice network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

5. The method of claim 3 wherein the messages are sent over a data network using a messaging protocol selected from a set of protocols including;

SMS, MMS, XMPP and SIMPLE.

6. The method of claim 1 wherein the primary format and secondary format are selected from a set of video formats including:

H.261, H.263, H.264, M-JPEG, MPEG-1, MPEG-2, MPEG-4, Ogg, Theora, VC-1 as well as derivatives and combinations of these types.

7. The method of claim 1 wherein the primary format and secondary format are associated with an image format selected from a set of image formats including:

JPEG/JFIF, JPEG 2000, Exif, TIFF, RAW, PNG, GIF, BMP, PPM, PGM, PBM, PNM, WEBP, CGM, SVG, PNS, JPS, MPO as well as derivatives and combinations of these types.

8. The method of claim 1 wherein the primary format and secondary format are associated with an audio format selected from a set of audio formats including:

way, ogg, mpc, flac, TTA, aiff, raw, au, gsm, dct, vox, mmf, mp3, aac, mp4, wma, atrac, ra, rm, ram, dss, msv, dvf, IVS, m4p, iklax, mxp4, 3gp, amr, awb as well as derivatives and combinations of these types.

9. The method of claim 1 wherein the transmitting mobile device and receiving mobile device are selected from a set of mobile devices including:

a smartphone, a conventional mobile phone, a tablet computer, a netbook, and a smartbook.

10. A method, comprising:

receiving a request at a multimedia communication server from a transmitting mobile device on a synthetic communications network to upload multimedia data formatted in accordance with a primary format to the multimedia communication server to be made available by the multimedia communication server for access by one or more receiving mobile devices on the synthetic communications network that are unable to process the multimedia data in the primary format;

receiving at the multimedia communication server the multimedia data from the transmitting mobile device for storage on the multimedia communication server to be transcoded from the primary format into one or more secondary formats compatible with the one or more receiving mobile devices;

responsive to receiving the multimedia data at the multimedia communication server, transmitting from the multimedia communication server to the transmitting mobile device a multimedia identifier associated with the multimedia data stored in the primary format, the transmitted multimedia identifier to be used by the one or more receiving mobile devices to reference the location of the multimedia data on the multimedia communication server; and

transcoding the multimedia data formatted in the primary format into a secondary format selected from the one or more secondary formats that a receiving mobile device, selected from the one or more receiving mobile devices, is able to process, wherein the receiving mobile device is identified on the synthetic communications network by a normalized version of a phone number in a phone directory, the normalized number originally provisioned for the receiving mobile device on a voice network and subsequently normalized to a standard format used for synchronizing members of and communication over the synthetic communications network.

11. The method of claim 10 further comprising:

transmitting the multimedia data transcoded into the secondary format to the receiving mobile device.

12. The method of claim 10 further comprising;

receiving a download confirmation responsive to the transmission of the multimedia identifier requesting the multimedia data in a secondary format that the receiving mobile device is able to process.

13. The method of claim 10 wherein transmitting the multimedia identifier further includes sending an image associated with the multimedia data that at least one of the one or more receiving mobile devices is able to process.

14. The method of claim 10 wherein the type of multimedia data is selected from a set of multimedia types including images, videos, sound and combinations thereof.

15. The method of claim 10 wherein the multimedia communication server uses messages during the processing of the multimedia data.

16. The method of claim 15 wherein the messages are sent over a voice network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

17. The method of claim 15 wherein the messages are sent over a data network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

18. The method of claim 14 wherein the primary format and secondary format are selected from a set of video formats including:

H.261, H.263, H.264, M-JPEG, MPEG-1, MPEG-2, MPEG-4, Ogg, Theora, VC-1 as well as derivatives and combinations of these types.

19. The method of claim 14 wherein the primary format and secondary format are associated with an image format selected from a set of image formats including:

JPEG/JFIF, JPEG 2000, Exif, TIFF, RAW, PNG, GIF, BMP, PPM, PGM, PBM, PNM, WEBP, CGM, SVG, PNS, JPS, MPO as well as derivatives and combinations of these types.

20. The method of claim 14 wherein the primary format and secondary format are associated with an audio format selected from a set of audio formats including:

way, ogg, mpc, flac, TTA, aiff, raw, au, gsm, dct, vox, mmf, mp3, aac, mp4, wma, atrac, ra, rm, ram, dss, msv, dvf, IVS, m4p, iklax, mxp4, 3gp, amr, awb as well as derivatives and combinations of these types.

21. The method of claim 10 wherein the receiving mobile device is selected from a set of devices having a phone number including:

a smartphone, a conventional mobile phone, a tablet computer, a netbook, and a smartbook.

22. A method, comprising:

receiving over a synthetic communications network at a receiving mobile device from a transmitting mobile device, a message containing a multimedia identifier associated with multimedia data stored on a multimedia communication server in a primary format that cannot be processed by the receiving mobile device, wherein the received message has not been relayed through the multimedia communications server and the receiving mobile device is identified on the synthetic communications network by a normalized version of a phone number in a phone directory, the normalized number originally provisioned for the receiving mobile device on a voice network, and subsequently normalized to a standard format used for synchronizing members of and communication over the synthetic communications network;

transmitting a download confirmation responsive to the receipt of the multimedia identifier indicating a secondary format for the multimedia data that the receiving mobile device can process; and

receiving data corresponding to the multimedia data transcoded on the multimedia communication server from the primary format that the receiving mobile device cannot process into the secondary format that the receiving mobile device can process.

23. The method of claim 22 wherein the type of multimedia data is selected from a set of multimedia types including images, videos, sound and combinations thereof.

24. The method of claim 22 wherein messages facilitate the receiving of multimedia data on the receiving mobile device.

25. The method of claim 24 wherein the messages are sent over a voice network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

26. The method of claim 22 wherein the primary format and secondary format are selected from a set of video formats including:

H.261, H.263, H.264, M-JPEG, MPEG-1, MPEG-2, MPEG-4, Ogg, Theora, VC-1 as well as derivatives and combinations of these types.

27. The method of claim 22 wherein the primary format and secondary format are associated with an image format selected from a set of image formats Including:

JPEG/JFIF, JPEG 2000, Exif, TIFF, RAW, PNG, GIF, BMP, PPM, PGM, PBM, PNM, WEBP, CGM, SVG, PNS, JPS, MPO as well as derivatives and combinations of these types.

28. The method of claim 22 wherein the primary format and secondary format are associated with an audio format selected from a set of audio formats including:

way, ogg, mpc, flac, TTA, aiff, raw, au, gsm, dct, vox, mmf, mp3, aac, mp4, wma, atrac, ra, rm, ram, dss, msv, dvf, IVS, m4p, iklax, mxp4, 3gp, amr, awb as well as derivatives and combinations of these types.

29. The method of claim 22 wherein the receiving mobile device is selected from a set of mobile devices including:

a smartphone, a conventional mobile phone, a tablet computer, a netbook, and a smartbook.

30. A transmitting mobile device, comprising:

a processor that executes instructions; and

a memory having instructions when executed on the processor, that cause the transmitting mobile device to identify multimedia data formatted in accordance with a primary format that is to be communicated to a receiving mobile device, upload the multimedia data formatted in accordance with the primary format to a multimedia communication server, receive a multimedia identifier associated with the multimedia data uploaded to the multimedia communication server, and transmit over a synthetic communications network the received multimedia identifier associated with the multimedia data stored in the primary format to the receiving mobile device, wherein the receiving mobile device is identified on the synthetic communications network by a normalized version of a phone number in a phone directory, the normalized number originally provisioned for the receiving mobile device on a voice network and subsequently normalized to a standard format used for synchronizing members of and communication over the synthetic communications network, the multimedia identifier to be used by the receiving mobile device to identify the multimedia data for transcoding into a secondary format on the multimedia communication server that the receiving mobile device is capable of processing.

31. A multimedia communication server, comprising:

a processor that executes instructions; and

a memory having instructions when executed on the processor that enable the multimedia communication server to receive from a transmitting mobile on a synthetic communications network a request to upload multimedia data formatted in accordance with a primary format on the multimedia communication server and made available for access by one or more receiving mobile devices unable to process the multimedia data in the primary format, obtain data corresponding to the multimedia data for storage on the multimedia communication server to be transcoded from the primary format into one or more secondary formats compatible with the one or more receiving mobile devices, responsive to receipt of the multimedia data, transmit to the transmitting mobile device a multimedia identifier associated with the multimedia data stored in the primary format, receive from the one or more receiving mobile devices the transmitted multimedia identifier to reference the location of the multimedia data on the multimedia communication server and transcode the multimedia data formatted in the primary format into a secondary format selected from the one or more secondary formats that a receiving mobile device, selected from the one or more receiving mobile devices is able to process, wherein the selected receiving mobile device is identified on the synthetic communications network by a normalized version of a phone number in a phone directory, the normalized number originally provisioned for the selected receiving mobile device on a voice network and subsequently normalized to a standard format used for synchronizing members of and communication over the synthetic communications network.

32. A method, comprising:

receiving, at a multimedia communication server, multimedia data from a transmitting mobile device on a synthetic communications network, the data to be made available for access by one or more receiving mobile devices different from the transmitting mobile device, wherein each of the one or more receiving mobile devices is identified on the synthetic communications network by a normalized version of a phone numbers in a phone directory, the normalized numbers originally provisioned for each of the receiving mobile devices on one or more voice networks and subsequently normalized to a standard format used for synchronizing members of and communication over the synthetic communications network;

storing the received multimedia data on the multimedia communication server;

responsive to receiving, at the multimedia communication server, the multimedia data from a transmitting mobile device, transmitting a multimedia identifier from the multimedia communication server to the transmitting mobile device, the multimedia identifier associated with the storage location of the received multimedia data on the multimedia communication server; and

upon receipt of the multimedia identifier from one of the one or more receiving mobile devices, transmitting the received multimedia data to the receiving mobile device.