Flexible video editing architecture with software video effect filter components

• US 6,763,175 B1
• Filed: 09/01/2000
• Issued: 07/13/2004
• Est. Priority Date: 09/01/2000
• Status: Active Grant

• Current Assignee: Matrox Graphics Incorporated (Matrox Electronic Systems Ltd.)
• Original Assignee: Matrox Electronic Systems Ltd.
• Inventors: Lapierre, Jean, Trottier, Lorne, St-Pierre, Michel, Laframboise, André
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US09/653,703
• Time in Patent Office: 1,411 Days
• Field of Search: H04/N.593, G11/B 2.700, 386/52, 386/53, 386/55, 386/46, 386/4, 386/64, 386/65, 386/1, 345/420, 345/619, 345/629, 345/630, 345/634, 360/13
• US Class Current: 386/280
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

An architecture which allows real-time video editing using a 2D/3D graphics engine. This architecture comprises input and output buffers. It receives video streams from either compressed sources of data or non compressed sources of data. This architecture allows a flexible upgrade of the video effects using software plug ins.

Claims

1. A video editing apparatus for performing video editing with at least one 3D rendering video effect on at least two video streams, the apparatus comprising:

a graphics processor having at least two video inputs, a graphics image input and a video output, said graphics processor comprising a 3D rendering engine, a 2D graphics engine and a command interface;

a video editing controller providing a video editing user interface to receive video editing control command data defining a timed sequence of video editing effects;

a video effect control module responsive to said video editing control command data to output keyframe data defining parameters for a specific desired video editing effect; and

a plurality of video effect filter modules, each one of said filter modules managing a separate video editing effect, said video effect filter modules providing, in response to said keyframe data, a series of video processing commands to said command interface, each one of said video processing commands defining one graphics processing step part of a whole video processing effect to generate a processed field image, at least some of said video processing commands including object specification data for 3D rendering.

2. The apparatus as claimed in claim 1, wherein said desired video effect includes a combination of a video processing using said 2D graphics engine and a video processing using said 3D rendering engine.

3. The apparatus as claimed in claim 2, wherein said desired video effect is selected from the group consisting of:

wipes, dissolves, keys, borders, drop shadows, trails, sparkles, 2D and 3D DVE'"'"'s, surface and object morphing, explosions, multilayer compositing, anti-aliasing, spotlights and high lights, page curl, fade effect, 3D perspective effect, organic wipe effect.

4. The apparatus as claimed in claim 1, wherein said graphics processor has an input buffer for storing a sequence of fields of said at least two video inputs and an output buffer for storing a sequence of fields of said graphics processor video output, said graphics processor command interface providing a feedback signal to said video effects control modules to notify said modules as to the state of depletion of said output buffer.

5. The apparatus as claimed in claim 4, wherein said modules are responsive to said state of depletion by one of skipping frames and reducing an amount of video effect processing, so as to maintain realtime output from said output buffer.

6. The apparatus as claimed in claim 5, wherein said input buffer also stores input graphic image fields.

7. The apparatus as claimed in claim 1, further comprising:

a video data storage device;

at least one codec able to retrieve at least two video sources from said data storage device and output at least two uncompressed video data streams;

a video decoder having a video signal input and an uncompressed digital video output;

a video encoder having an uncompressed video data stream input and a display signal output;

a first video bus transferring data between said video output of said graphics processor and said video encoder when said apparatus is operating in a realtime video editing mode;

a second video bus transferring data between said codec and said at least two video inputs of said graphics processor when said apparatus is operating in a realtime video editing mode;

said video decoder using one of said first and said second video buses to transfer data to said video encoder in a non-editing playback mode, and said video decoder using one of said first and said second video buses to transfer data to said codec in a video capture mode.

8. The apparatus as claimed in claim 7, wherein said video decoder transfers data to said codec and to said video encoder using said first video bus.

9. The apparatus as claimed in claim 8, wherein data is transferred from said video output of said graphics processor to said codec for compression and storage in said video data storage device.

10. The apparatus as claimed in claim 7, further comprising an input for compressed digital video input from external device, one of said at least two video sources comprising said compressed digital video input.

11. The apparatus as claimed in claim 10, wherein said compressed digital video input comprises one of an IEEE 1394 interface and an SDTI interface.

12. The apparatus as claimed in claim 1, wherein said desired video effect involves processing of at least two input video inputs and said graphics input.