MULTIMEDIA TRANSCODING METHOD AND SYSTEM FOR MOBILE DEVICES

• US 20120294352A1
• Filed: 07/26/2012
• Published: 11/22/2012
• Est. Priority Date: 03/25/2010
• Status: Active Grant

• Current Assignee: WhatsApp LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: WhatsApp LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Inventors: Koum, Jan, Acton, Brian
• Granted Patent: US 9,628,831 B2
• Time in Patent Office: Days
• US Class Current: 375/240.01
• CPC Class Codes: H04N 21/234309 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/25858 involving client software characteristics, e.g. OS identifier
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 4/20 Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals
• CPC Class Codes: H04W 88/181 Transcoding devices; Rate adaptation devices

Abstract

Aspects of the present invention include method and systems or processing multimedia data exchanged between mobile devices. Initially, a transmitting mobile device attempts to send multimedia data formatted in a primary format even though a receiving mobile device cannot process the data. The multimedia data in the primary format is then uploaded to a multimedia communication server where the multimedia data can be transcoded on demand into a secondary format that the receiving mobile device can indeed process. To track the multimedia data, the transmitting mobile device receives a multimedia identifier associated with the multimedia data uploaded to the multimedia communication server. Instead of sending the multimedia data, the transmitting mobile device forwards the multimedia identifier to the receiving mobile device allowing the receiving mobile device to demand transcoding the multimedia data into a secondary format on the server that the receiving mobile device is capable of receiving and processing.

Claims

1. A processor implemented method of transmitting multimedia data from a transmitting mobile device:

identifying multimedia data formatted in accordance with a primary format to be sent to a receiving mobile device that cannot process the multimedia data formatted in the primary format;

uploading the multimedia data formatted in accordance with the primary format to a multimedia communication server;

receiving a multimedia identifier associated with the multimedia data uploaded to the multimedia communication server; and

forwarding the multimedia identifier associated with the multimedia data stored in the primary format to the receiving mobile device, the multimedia identifier to be used by the receiving mobile device to request transcoding the multimedia data into a secondary format on the multimedia communication server that the receiving mobile device is capable of processing.

2. The method of claim 1 wherein the type of multimedia data is selected from a set of multimedia types including images, videos, sound and combinations thereof.

3. The method of claim 1 wherein messages facilitate the transmission of the multimedia data from the transmitting mobile device.

4. The method of claim 3 wherein the messages are sent over a voice network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

5. The method of claim 3 wherein the messages are sent over a data network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

6. The method of claim 1 wherein the primary format and secondary format are selected from a set of videos formats including:

H.261, H.263 H.264, M-JPEG, MPEG-2, MPEG-4, Ogg, Theora, VC-1 as well as derivatives and combinations these types.

7. The method of claim 1 wherein the primary format and secondary format are associated with a image format selected from a set of image formats including:

JPEG/JFIF, JPEG 2000, Exif, TIFF, RAW, PNG, GIF, BMP, PPM, PGM, PBM, PNM, WEBP, CGM. SVG, PNS, JPS, MPO as well as derivatives and combinations these types.

8. The method of claim 1 wherein the primary format and secondary format are associated with an audio format selected from a set of audio formats including:

way, ogg, mpc, flac, TTA, aiff, raw, au, gsm, dct, vox, mmf, mp3, aac, mp4, wma, atrac, ra, rm, ram, dss, msv, dvf, IVS, m4p, iklax, mxp4, 3gp, amr, awb as well as derivatives and combinations these types.

9. The method of claim 1 wherein the transmitting mobile device and receiving mobile device are selected from a set of mobile devices including:

a smartphone, a conventional mobile phone, a tablet computer, a netbook, and a smartbook.

18. The method of claim 1 wherein the primary format and secondary format are selected from a set of videos formats including:

H.261, H.263, H.264, M-JPEG, MPEG-1 MPEG-2, MPEG-4, Ogg, Theora, VC-1 as well as derivatives and combinations these types.

10. A processor implemented method of processing multimedia data on a multimedia communication server, comprising:

receiving a request to upload multimedia data formatted in accordance with a primary format on the multimedia communication server and made available for access by one or more receiving mobile devices unable to process the multimedia data in the primary format;

obtaining data corresponding to the multimedia data for storage on the multimedia communication server to be transcoded from the primary. format into one or more secondary compatible with one or more receiving mobile devices;

transmitting a multimedia identifier associated with the multimedia data stored in the primary format to be used by the one or more receiving mobile devices to reference the location of the multimedia data on the multimedia communication server; and

transcoding the multimedia data formatted in the primary format into a secondary format selected from the one or more secondary formats that a receiving mobile device, selected from the one or more receiving mobile devices is able to process.

11. The method of claim 10 further comprising:

transmitting the multimedia data transcoded into the secondary format to the receiving mobile device that references the multimedia identifier.

12. The method of claim 10 further comprising:

receiving a download confirmation responsive to the transmission of the multimedia identifier requesting the multimedia data in a secondary format that the receiving mobile device is able to process.

13. The method of claim 10 wherein transmitting the multimedia identifier further includes sending an image associated with the multimedia data that at least one of the one or more receiving mobile devices is able to process.

14. The method of claim 10 wherein the type of multimedia data is selected from a set of multimedia types including images, videos, sound and combinations thereof.

15. The method of claim 10 wherein the multimedia communication server uses messages during the processing of the multimedia data.

16. The method of claim 15 wherein the messages are sent over a voice network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

17. The method of claim 15 wherein the messages are sent over a data network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

19. The method of claim 14 wherein the primary format and secondary format are associated with a image format selected from a set of image formats including:

JPEG/JFIF, JPEG 2000, Exif, TIFF, RAW, PNG, GIF, BMP, PPM, PGM, PBM, PNM, WEBP, CGM, SVG, PNS, JPS, MPO as well as derivatives and combinations these types.

20. The method of claim 14 wherein the primary format and secondary format are associated with an audio format selected from a set of audio formats including:

wav, ogg, mpc, flac, TTA, aiff, raw, au, gsm, dct, vox, mmf, mp3, aac, mp4, wma, atrac, ra, rm, ram, dss, msv, dvf, IVS, m4p, iklax, mxp4, 3gp, amr, awb as well as derivatives and combinations these types.

21. The method of claim 10 wherein the receiving mobile device is selected from a set of devices having a phone number including:

a smartphone, a conventional mobile phone, a tablet computer, a netbook, and a smartbook.

22. A processor implemented method of receiving multimedia data on a receiving mobile device, comprising:

receiving a multimedia identifier associated with multimedia data stored on a multimedia communication server in a primary format that cannot be processed by the receiving mobile device;

transmitting a download confirmation responsive to the receipt of the multimedia identifier indicating a secondary format for the multimedia data that the receiving mobile device can process; and

receiving data corresponding to the multimedia data transcoded on the multimedia communication server from the primary format that the receiving mobile device cannot process into the secondary format that the receiving mobile device can process.

23. The method of claim 22 wherein the type of multimedia data is selected from a set of multimedia types including images, videos, sound and combinations thereof.

24. The method of claim 22 wherein messages facilitate the receiving of multimedia data on the receiving mobile device.

25. The method of claim 24 wherein the messages are sent over a voice network using a messaging protocol selected from a set of protocols including:

SMS, MMS, XMPP and SIMPLE.

26. The method of claim 22 wherein the primary format and secondary format are selected from a set of videos formats including:

H.261, H.263, H.264, M-JPEG, MPEG-1, MPEG-2, MPEG-4, Ogg, Theora, VC-1 as well as derivatives and combinations these types.

27. The method of claim 22 wherein the primary format and secondary format are associated with a image format selected from a set of image formats including:

JPEG/JFIF, JPEG 2000, Exif, TIFF, RAW, PNG, GIF, BMP, PPM, PGM, PBM, PNM, WEBP, CGM, SVG, PNS, JPS, MPO as well as derivatives and combinations these types.

28. The method of claim 22 wherein the primary format and secondary format associated with an audio format selected from a set of audio formats including:

way, ogg, mpc, flac, TTA, aiff, raw, au, gsm, dct, vox, mmf, mp3, aac, mp4, wma, atrac, ra, rm, ram, dss, msv, dvf, IVS, m4p, iklax, mxp4, 3gp, amr, awb as well as derivatives and combinations these types.

29. The method of claim 22 wherein the receiving mobile device is selected from a set of mobile devices including:

a smartphone, a conventional mobile phone, a tablet computer, a netbook, and a smartbook.

30. An transmitting mobile device apparatus that processes multimedia data comprising:

a processor that executes instructions;

a memory having instructions when executed on the processor, that causes the mobile device apparatus to identify multimedia data formatted in accordance with a primary format to be sent to a receiving mobile device that cannot process the multimedia data formatted in the primary format, upload the multimedia data formatted in accordance with the primary format to a multimedia communication server, receive a multimedia identifier associated with the multimedia data uploaded to the multimedia communication server, and forward the multimedia identifier associated with the multimedia data stored in the primary format to the receiving mobile device, the multimedia identifier to be used by the receiving mobile device to request transcoding the multimedia data into a secondary format on the multimedia communication server that the receiving mobile device is capable of processing.

31. An receiving mobile device apparatus for processing multimedia comprising:

a processor that executes instructions;

memory having instructions when executed on the processor cause the mobile device to receive a multimedia identifier associated with multimedia data stored on a multimedia communication server in a primary format that cannot be processed by the receiving mobile device, transmit a download confirmation responsive to the receipt of the multimedia identifier indicating a secondary format for the multimedia data that the receiving mobile device can process, and receive data corresponding to the multimedia data transcoded on the multimedia communication server from the primary format that the receiving mobile device cannot process into the secondary format that the receiving mobile device can process.

32. An multimedia communication server apparatus for processing multimedia data, comprising:

a processor that executes instructions;

a memory having instructions when executed on the processor that causes the multimedia communication server to receive a request to upload multimedia data formatted in accordance with a primary format on the multimedia communication server and made available for access by one or more receiving mobile devices unable to process the multimedia data in the primary format, obtain data corresponding to the multimedia data for storage on the multimedia communication server to be transcoded from the primary format into one or more secondary formats compatible with one or more receiving mobile devices, transmit a multimedia identifier associated with the multimedia data stored in the primary format to be used by the one or more receiving mobile devices to reference the location of the multimedia data on the multimedia communication server, and transcode the multimedia data formatted in the primary format into a secondary format selected from the one or more secondary formats that a receiving mobile device, selected from the one or more receiving mobile devices is able to process.