Efficient Media Import

• US 20120207449A1
• Filed: 05/19/2011
• Published: 08/16/2012
• Est. Priority Date: 01/28/2011
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Angquist, Nils, Agnoli, Giovanni, Graves, Eric J.
• Granted Patent: US 8,886,015 B2
• Time in Patent Office: Days
• US Class Current: 386/278
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 9/00 Arrangements for program control, e.g. control units program control for peripheral devices G06F13/10
• CPC Class Codes: G06T 3/4092 Image resolution transcoding, e.g. by using client-server architectures
• CPC Class Codes: G11B 27/00 Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 1/00822 Selecting or setting a particular reading mode, e.g. from amongst a plurality of modes, simplex or duplex, or high or low resolution
• CPC Class Codes: H04N 1/4172 Progressive encoding, i.e. by decomposition into high and low resolution components
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 2201/212 Selecting different recording or reproducing modes, e.g. high or low resolution, field or frame
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 25/42 by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
• CPC Class Codes: H04N 5/14 Picture signal circuitry for video frequency region cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: Y10S 707/913 Multimedia

Abstract

Some embodiments provide a media-editing application. The application receives a command to import a media file into the media-editing application. The media file includes a sequence of video images. The application copies the media file to a storage location associated with the media-editing application. The method performs several analysis and transcode operations on the media file in parallel. In some embodiments, the application identifies a video image on which to the operations. The application schedules a single set of image preparation operations for the video image to generate one or more sets of image data for the operations. The method sends the image data to the different operations. A same set of image data is sent to at least two of the operations.

Claims

1. A computer readable medium storing a media-editing application for execution by a processor, the media-editing application comprising sets of instructions for:

identifying a video image on which to perform a plurality of different operations;

scheduling a single set of image preparation operations for the video image to generate one or more sets of image data for the plurality of different operations; and

sending the image data to the different operations, wherein a same set of image data is sent to at least two of the operations.

2. The computer readable medium of claim 1, wherein the operations are performed on the video image as the media-editing application imports a media file that comprises the video image.

3. The computer readable medium of claim 1, wherein the operations are performed on the video image separately from import of a media file that comprises the video image by the media-editing application.

4. The computer readable medium of claim 1, wherein the different operations comprise analysis operations that analyze pixel values in the image data.

5. The computer readable medium of claim 1, wherein the different operations comprise different encoding operations that encode the image data at different resolutions.

6. The computer readable medium of claim 1, wherein the different operations include a playback operation that outputs the image data to a display device.

7. The computer readable medium of claim 1, wherein the image preparation operations comprise a disk read operation that retrieves an encoded copy of the video image from a storage device.

8. The computer readable medium of claim 7, wherein the image preparation operations further comprise a decode operation that decodes the encoded video image to generate a plurality of pixel values for the image.

9. The computer readable medium of claim 8, wherein the image preparation operations comprise a colorspace conversion that converts the pixel values from a first colorspace to a second colorspace.

10. The computer readable medium of claim 8, wherein the pixel values define a particular number of pixels, wherein the image preparation operations comprise a resolution conversion operation that modifies the number of pixels.

11. A computer readable medium storing a media-editing application for execution by a processor, the media-editing application comprising sets of instructions for:

receiving a command to import a media file into the media-editing application, the media file comprising a sequence of video images;

copying the media file to a storage location associated with the media-editing application; and

performing a plurality of analysis and transcode operations on the media file in parallel.

12. The computer readable medium of claim 11, wherein the plurality of analysis and transcode operations are determined based on user selection of the operations.

13. The computer readable medium of claim 11 wherein the analysis operations comprise an operation to detect people in the sequence of video images.

14. The computer readable medium of claim 11, wherein the analysis operations comprise a shake detection operation to detect that a device that captured the media file was shaking while capturing the media file.

15. The computer readable medium of claim 11, wherein the analysis operations comprise a color balancing operation to modify color values of the video images.

16. The computer readable medium of claim 11, wherein the analysis operations comprise audio analysis operations.

17. The computer readable medium of claim 11, wherein the media-editing application further comprises a set of instructions for storing data files generated by the analysis operations and transcoded versions of the media file generated by the transcode operations.

18. The computer readable medium of claim 11, wherein the set of instructions for performing the plurality of analysis and transcode operations comprises a set of instructions for performing a plurality of image preparation operations only once for a particular image in the sequence of video images in order to generate a decoded image for use by the analysis and transcode operations.

19. A computer readable medium storing a media-editing application which when executed by a processor renders an output image at least two different formats, the media-editing application comprising sets of instructions for:

identifying a set of images used to generate the output image;

scheduling a single disk read operation and a single decode operation for each image in the set of images in order to create a decoded image;

scheduling a minimum number of image processing operations that modify the decoded images to generate the output images in the at least two different formats.

20. The computer readable medium of claim 19, wherein the different formats comprise different resolution images.

21. The computer readable medium of claim 19, wherein the different formats comprise images in different colorspaces.

22. The computer readable medium of claim 19, wherein the image processing operations comprise at least one of a colorspace conversion operation of a particular image, resolution conversion operation of a particular image, and a compositing operation that combines two images.

23. The computer readable medium of claim 19, wherein the set of instructions for scheduling a minimum number of image processing operations comprises sets of instructions for:

scheduling a conversion to a particular resolution before converting to a first or a second colorspace when a first format requires the particular resolution and the first colorspace and a second format requires the particular resolution and the second, different colorspace; and

scheduling a conversion to a particular colorspace before converting to a first or a second resolution when a first format requires the particular colorspace and the first resolution and a second format requires the particular colorspace and the second, different resolution.

24. The computer readable medium of claim 19, wherein the image processing operations are determined according to a render graph generated based on a composite presentation.