Video processing methods and systems for portable electronic devices lacking native video support

• US 20070186250A1
• Filed: 02/01/2007
• Published: 08/09/2007
• Est. Priority Date: 02/03/2006
• Status: Abandoned Application

• Current Assignee: SONA Innovations Incorporated (Sona Mobile Holdings Corp.)
• Original Assignee: SONA Innovations Incorporated (Sona Mobile Holdings Corp.)
• Inventors: Carey, Richard Scott
• Application Number:
  US11/701,221
• Publication Number:
  US 20070186250A1
• Time in Patent Office: Days
• US Class Current: 725/62
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/4431 characterized by the use of Application Program Interface [API] libraries
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image

Abstract

Methods and systems for providing high-quality, synchronized audio/video playback on Blackberry™-type portable electronic devices lacking native video support. Synchronization intervals are determined whereby to instantiate frame rate control signals for processing and synchronizing data in the form of stored images and audio to generate the synchronized audio/video playback.

Claims

1. A method for playing synchronized audio and video on a mobile communication device including a video screen and a speaker, comprising:

identifying on the device a still image decoder;

identifying for playback by the device an audio/video media file including a series of still images, an audio signal and metadata including the total number of a series of image frames and the duration of the audio/video media file;

determining for the device a synchronization interval for displaying the series of stored still images in synchronization with the playback of the stored audio signal;

displaying, based upon the synchronization interval, the series of stored still images; and

synchronizing, based on the synchronization interval, the playback of the stored audio signal with the displaying of the series of stored still images;

whereby synchronized audio and video are played back on the device.

2. The method of claim 1 wherein the step of displaying the series of stored still images includes the steps of:

determining, based on the synchronization interval, a sleep cycle for frame rate control; and

the displaying based upon the sleep cycle.

3. The method of claim 2 wherein the step of identifying for the device a synchronization interval includes determining an initial synchronization interval.

4. The method of claim 3 wherein the determining of an initial synchronization interval is performed by processing an invisible rendering of a pre-determined number of the series of stored still images.

5. The method of claim 3 wherein the determining of an initial synchronization interval is based upon an ideal frame-per-second playback rate based upon the series of stored still images.

6. The method of claim 2 and further comprising the step of periodically adjusting the sleep cycle based upon a calculated number of frames played and an actual number of frames played.

7. The method of claim 1 wherein the series of still images and the audio signal are generated from a processed media format.

8. The method of claim 1 wherein the step of synchronizing the playback of the stored audio signal with the displaying of the series of stored still images is based on the current still image being played, the total number of stored still images and the media duration.

9. The method of claim 1 wherein the device comprises a Java 2 Mobile Edition Mobile Information Device Portfolio device lacking embedded native video decoding.

10. The method of claim 1 wherein the series of still images each comprise a format selected from the group comprising a JPEG image, a PNG image and a compressed video image.

11. The method of claim 1 wherein each image in the series of image frames is selected from the group comprising a single still image and multiple component images.

12. A method for playing synchronized audio and video on a mobile communication device including a video screen and a speaker and lacking a native video decoding function, comprising the steps of:

identifying on the device a still image decoder;

identifying on the device an audio/video media file including a series of still images and an audio signal;

the audio/video media file based upon a processed media format and including therewith metadata identifying the total number of a series of image frames and the duration of the media file;

determining for the device a synchronization interval for displaying the series of still images in synchronization with the playback of the stored audio signal, the synchronization interval based upon one of the group comprising a initial synchronization interval based upon a rendering and an initial synchronization interval based upon an ideal frame-per-second playback rate;

playing back the audio signal;

displaying in synchronization with the playing back of the audio signal, using a sleep interval based upon the synchronization interval, the series of still images; and

periodically adjusting the sleep cycle based upon a calculated number of frames played and an actual number of frames played whereby to keep the displaying of the series of still images in synchronization with the playing back of the audio signal;

whereby synchronized audio and video are played back on the device.

13. A system for playing synchronized audio and video on a mobile communication device including a video screen and a speaker, comprising:

a processor;

a memory connected to the processor and storing instructions for controlling the operation of the processor and at least a portion of an audio/video media file including a series of still images, an audio signal and metadata including the total number of a series of image frames and the duration of the audio/video media file;

a still image decoder connected to the processor;

an audio player connected to the processor;

the processor operative with the instructions to perform the steps of;

identifying for playback by the device the audio/video media file;

determining for the device a synchronization interval for displaying the series of stored still images in synchronization with the playback of the stored audio signal;

displaying using the still image decoder, based upon the synchronization interval, the series of stored still images; and

synchronizing, based on the synchronization interval, the playback through the audio player of the stored audio signal with the displaying of the series of stored still images;

whereby synchronized audio and video are played back on the device.

14. The system of claim 13 wherein the step of displaying the series of stored still images includes the steps of:

determining, based on the synchronization interval, a sleep cycle for frame rate control; and

the displaying based upon the sleep cycle.

15. The system of claim 14 wherein the step of identifying for the device a synchronization interval includes determining an initial synchronization interval.

16. The system of claim 15 wherein the determining of an initial synchronization interval is performed by processing an invisible rendering of a pre-determined number of the series of stored still images.

17. The system of claim 15 wherein the determining of an initial synchronization interval is based upon an ideal frame-per-second playback rate based upon the series of stored still images.

18. The system of claim 14 and further comprising the step of periodically adjusting the sleep cycle based upon a calculated number of frames played and an actual number of frames played.

19. The system of claim 13 wherein the series of still images and the audio signal are generated from a processed media format.

20. The system of claim 13 wherein the step of synchronizing the playback of the stored audio signal with the displaying of the series of stored still images is based on the current still image being played, the total number of stored still images and the media duration.

21. The system of claim 13 wherein the device comprises a Java 2 Mobile Edition Mobile Information Device Portfolio device lacking embedded native video decoding.

22. The system of claim 13 wherein the series of still images each comprise a format selected from the group comprising a JPEG image, a PNG image and a compressed video image.

23. The system of claim 13 wherein the series of image frames comprises one of the group of still images and component images.

24. A system for playing synchronized audio and video on a mobile communication device including a video screen and a speaker, comprising:

means for identifying on the device a still image decoder;

means for identifying for playback by the device an audio/video media file including a series of still images, an audio signal and metadata including the total number of a series of image frames and the duration of the audio/video media file;

means for determining for the device a synchronization interval for displaying the series of stored still images in synchronization with the playback of the stored audio signal;

means for displaying, based upon the synchronization interval, the series of stored still images; and

means for synchronizing, based on the synchronization interval, the playback of the stored audio signal with the displaying of the series of stored still images;

whereby synchronized audio and video are played back on the device.