Rendering of video based on overlaying of bitmapped images

• US 8,639,086 B2
• Filed: 01/06/2009
• Issued: 01/28/2014
• Est. Priority Date: 01/06/2009
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Chen, Chris C., Hai, Daniel T.
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): MESA, JOSE M
• Application Number:
  US12/349,402
• Publication Number:
  US 20130195421A1
• Time in Patent Office: 1,848 Days
• Field of Search: 386/215, 386/216, 386/218, 386/219
• US Class Current: 386/215
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 7/01 Conversion of standards , e.g. involving analogue television standards or digital television standards processed at pixel level

Abstract

According to example configurations as described herein, a media manager supports functions such as in-line display of video frame information for application of editing commands. Each of multiple frames in the in-line display can be derived from a respective bitmap. The bitmaps associated with the in-line display can be generated and cached during an editing session for easy access. After completion of the editing session and creation of a playback file specifying a media playback experience, a media manager deletes the cached bitmaps. Upon rendering of a video experience as specified by the playback file at a later time, a respective media player converts a format of video data as specified by the playback file into bitmap information again. Playback can include combining multiple frames of static images (as defined by the bitmaps) at different layers to produce a unique viewing experience.

Claims

1. A method comprising:

receiving, by a video editing application, first video data associated with a video, the first video data being in a first video format;

receiving, by the video editing application, second video data in a second format; and

generating, by the video editing application, a playback file, the playback file comprising;

at least one reference to a location corresponding to the first video data;

at least one reference to a location corresponding to the second video data; and

timing information for combining the first video data with the second video data,

wherein the playback file is configured to cause a media player, when executed by the media player, to;

retrieve the first video data associated with the video from the location corresponding to the first video data;

convert the first video data in the first video format into a first set of static images, each image in the first set of static images comprising a first image format, the first image format different than the first video format;

retrieve the second video data from the location corresponding to the second video data;

convert the second video data into a second set of static images;

generate a third set of static images, each image of a first subset of the third set of static images comprising an overlay of at least a portion of an image from the first set of static images and at least a portion of an image from the second set of static images based at least in part on the timing information; and

display a second subset of the third set of static images.

2. The method of claim 1 further comprising:

converting, by the video editing application, the first video data in the first video format into the first set of static images;

converting, by the video editing application, the second video data into the second set of static images;

displaying, by the video editing application, a first subset of the first set of static images in a first editing track in a graphical user interface associated with the video editing application;

displaying, by the video editing application, a second subset of the second set of static images in a second editing track in the graphical user interface;

generating, by the video editing application, the third set of static images; and

displaying, by the video editing application, a third subset of the third set of static images in a third editing track in the graphical user interface.

3. The method of claim 1 further comprising:

receiving, by the video editing application, selection of a media asset from a plurality of available media assets, the media asset comprising the first video data associated with the video; and

wherein receiving, by the video editing application, first video data associated with the video comprises;

retrieving, by the video editing application, the selected media asset from at least one remote source.

4. The method of claim 1 wherein each image in the second set of static images comprises a second image format, the second image format different than the second format.

5. The method of claim 2:

wherein receiving, by the video editing application, first video data associated with the video comprises;

receiving, by the video editing application, compressed video data, wherein at least a portion of the compressed video data is encoded with image difference information specifying a grouping of pixels and changes associated with the grouping of pixels from a first frame to a second frame of the video; and

wherein converting, by the video editing application, the first video data in the first video format into the first set of static images comprises;

generating a first bitmap image associated with the first frame;

utilizing the image difference information to identify pixel changes between the first frame and the second frame of the video; and

generating a second bitmap image based at least in part on the difference information, the second bitmap associated with the second frame.

6. The method of claim 1 wherein the second video data comprises at least one image for overlaying onto at least a portion of the video.

7. The method of claim 1 wherein the first video format and the second format comprise a same format.

25. The method of claim 2 further comprising:

storing, by the video editing application, each image in the first set of static images in a repository; and

storing, by the video editing application, each image in the second set of static images in the repository; and

after generating the playback file, deleting the first set of static images and the second set of static images from the repository.

26. The method of claim 25 wherein the repository comprises at least one cache.

8. A method comprising:

receiving, by a media player, a playback file, the playback file comprising;

a reference to a location corresponding to first video data;

a reference to a location corresponding to second video data; and

information for combining the first video data with the second video data,

wherein the playback file is configured to cause the media player, when received by the media player, to;

retrieve the first video data based at least in part on the reference to the location corresponding to the first video data, the first video data associated with a video, the first video data being in a first video format;

convert the first video data in the first video format into a first set of static images, each image in the first set of static images comprising a first image format, the first image format different than the first video format;

store each image in the first set of static images in a repository;

retrieve the second video data based at least in part on the reference to the location corresponding to the second video data, the second video data being in a second format;

convert the second video data into a second set of static images;

store each image in the second set of static images in the repository;

generate a third set of static images, each image of a first subset of the third set of static images comprising an overlay of at least a portion of an image from the first set of static images retrieved from the repository and at least a portion of an image from the second set of static images retrieved from the repository based at least in part on the information for combining the first video data with the second video data in the playback file; and

display a second subset of the third set of static images in a graphical user interface associated with the media player.

9. A non-transitory computer-readable medium comprising program code for:

receiving, by a video editing application, first video data associated with a video, the first video data being in a first video format;

receiving, by the video editing application, second video data in a second format; and

generating, by the video editing application, a playback file, the playback file comprising;

at least one reference to a location corresponding to the first video data;

at least one reference to a location corresponding to the second video data; and

timing information for combining the first video data with the second video data,

wherein the playback file is configured to cause a media player, when executed by the media player, to;

retrieve the first video data associated with the video from the location corresponding to the first video data;

convert the first video data in the first video format into a first set of static images, each image in the first set of static images comprising a first image format, the first image format different than the first video format;

retrieve the second video data from the location corresponding to the second video data;

convert the second video data into a second set of static images;

generate a third set of static images, each image of a first subset of the third set of static images comprising an overlay of at least a portion of an image from the first set of static images and at least a portion of an image from the second set of static images based at least in part on the timing information; and

display a second subset of the third set of static images.

10. The non-transitory computer-readable medium of claim 9 further comprising program code for:

converting, by the video editing application, the first video data in the first video format into the first set of static images;

converting, by the video editing application, the second video data into the second set of static images;

displaying, by the video editing application, a first subset of the first set of static images in a first editing track in a graphical user interface associated with the video editing application;

displaying, by the video editing application, a second subset of the second set of static images in a second editing track in the graphical user interface;

generating, by the video editing application, the third set of static images; and

displaying, by the video editing application, a third subset of the third set of static images in a third editing track in the graphical user interface.

11. The non-transitory computer-readable medium of claim 9 further comprising program code for:

receiving, by the video editing application, selection of a media asset from a plurality of available media assets, the media asset comprising the first video data associated with the video; and

wherein receiving, by the video editing application, first video data associated with the video comprises;

retrieving, by the video editing application, the selected media asset from at least one remote source.

12. The non-transitory computer-readable medium of claim 9 wherein each image in the second set of static images comprises a second image format, the second image format different than the second format.

13. The non-transitory computer-readable medium of claim 10:

wherein receiving, by the video editing application, first video data associated with the video comprises;

receiving, by the video editing application, compressed video data, wherein at least a portion of the compressed video data is encoded with image difference information specifying a grouping of pixels and changes associated with the grouping of pixels from a first frame to a second frame of the video; and

wherein converting, by the video editing application, the first video data in the first video format into the first set of static images comprises;

generating a first bitmap image associated with the first frame;

utilizing the image difference information to identify pixel changes between the first frame and the second frame of the video; and

generating a second bitmap image based at least in part on the difference information, the second bitmap associated with the second frame.

14. The non-transitory computer-readable medium of claim 9 wherein the second video data comprises at least one image for overlaying onto at least a portion of the video.

15. The non-transitory computer-readable medium of claim 9 wherein the first video format and the second format comprise a same format.

27. The non-transitory computer-readable medium of claim 10 further comprising program code for:

storing, by the video editing application, each image in the first set of static images in a repository; and

storing, by the video editing application, each image in the second set of static images in the repository; and

after generating the playback file, deleting the first set of static images and the second set of static images from the repository.

28. The non-transitory computer-readable medium of claim 27 wherein the repository comprises at least one cache.

16. A system comprising:

a display;

a repository;

a network interface; and

a processor in communication with the display, the repository, and the network interface, the processor configured for;

receiving first video data associated with a video through the network interface, the first video data being in a first video format;

receiving second video data through the network interface, the second video data being in a second format; and

generating a playback file, the playback file comprising;

at least one reference to a location corresponding to the first video data;

at least one reference to a location corresponding to the second video data; and

timing information for combining the first video data with the second video data, wherein the playback file is configured to cause a media player, when executed by the media player, to;

retrieve the first video data associated with the video from the location corresponding to the first video data;

convert the first video data in the first video format into a first set of static images, each image in the first set of static images comprising a first image format, the first image format different than the first video format;

retrieve the second video data from the location corresponding to the second video data;

convert the second video data into a second set of static images;

generate a third set of static images, each image of a first subset of the third set of static images comprising an overlay of at least a portion of an image from the first set of static images and at least a portion of an image from the second set of static images based at least in part on the timing information; and

display a second subset of the third set of static images.

17. The system of claim 16 wherein the processor is further configured for:

converting the first video data in the first video format into the first set of static images;

converting the second video data into the second set of static images;

displaying, on the display, a first subset of the first set of static images in a first editing track in a graphical user interface associated with the video editing application;

displaying, on the display, a second subset of the second set of static images in a second editing track in the graphical user interface;

generating the third set of static images; and

displaying, on the display, a third subset of the third set of static images in a third editing track in the graphical user interface.

18. The system of claim 16 wherein the processor is further configured for:

receiving selection of a media asset from a plurality of available media assets, the media asset comprising the first video data associated with the video; and

wherein receiving first video data associated with the video through the network interface comprises;

retrieving the media asset from at least one remote server through the network interface.

19. The system of claim 16 wherein each image in the second set of static images comprises a second image format, the second image format different than the second format.

20. The system of claim 17:

wherein receiving first video data associated with the video through the network interface comprises;

receiving compressed video data, wherein at least a portion of the compressed video data is encoded with image difference information specifying a grouping of pixels and changes associated with the grouping of pixels from a first frame to a second frame of the video; and

wherein converting the first video data in the first video format into the first set of static images comprises;

generating a first bitmap image associated with the first frame;

utilizing the image difference information to identify pixel changes between the first frame and the second frame of the video; and

generating a second bitmap image based at least in part on the difference information, the second bitmap associated with the second frame.

21. The system of claim 16 wherein the second video data comprises at least one image for overlaying onto at least a portion of the video.

22. The system of claim 16 wherein the first video format and the second format comprise a same format.

23. The system of claim 16 wherein the repository comprises at least one cache.

24. The system of claim 16 wherein the processor is further configured for:

receiving the first video data and the second video data through the network interface substantially simultaneously.

29. The system of claim 16 wherein the processor is further configured for:

storing, by the video editing application, each image in the first set of static images in the repository; and

storing, by the video editing application, each image in the second set of static images in the repository; and

after generating the playback file, deleting the first set of static images and the second set of static images from the repository.