Apparatus and method for processing a video signal containing single frame animation material

• US 5,198,902 A
• Filed: 08/13/1991
• Issued: 03/30/1993
• Est. Priority Date: 08/31/1990
• Status: Expired due to Term

• Current Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Original Assignee: Sony Broadcast & Communications Ltd. (Sony Group Corp.)
• Inventors: Richards, John W., Galt, John, Keating, Stephen M.
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): Burgess, Glenton B.
• Application Number:
  US07/744,265
• Time in Patent Office: 595 Days
• Field of Search: 358/105, 358/22, 358/183, 358/97, 358/54, 358/214, 358/216, 358/227, 358/228, 358/182, 352/87, 352/50-54, 340/728, 340/724, 340/726
• US Class Current: 348/598
• CPC Class Codes: H04N 5/2625 for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

Apparatus for processing a video signal derived by single frame animation for subsequent merging with live action material, comprises a motion vector estimator (11) for deriving motion vectors in dependence on motion in the picture sequence represented by the video signal, and an interpolator (12) and associated circuits (14 to 16) for blurring the images represented by the video signal of objects in the picture sequence so determined as being in motion in dependence on the motion vectors.

Claims

1. A method of processing a first video data signal having a plurality of frames in which said first video data signal is obtained by filming single frame animation material, said method comprising the steps of:

detecting motion of an object having an associated trajectory path in a picture sequence formed from said frames of said first video data signal; and

blurring images represented by said frames of said first video data signal in said picture sequence of the object which is detected as being in motion so as to form a processed video data signal which is suitable for merging with a second video data signal obtained by filming live action or non-single frame animation material.

2. A method according to claim 1, in which the step of determining motion includes deriving motion vectors.

3. A method according to claim 2, in which said motion vectors are derived from a current frame and a previous frame of said first video data signal.

4. A method according to claim 2, in which said motion vectors are derived from a current frame and a subsequent frame of said first video data signal.

5. A method according to claim 1, in which the step of determining motion includes deriving a motion vector representing the motion trajectory path of said object and in which the step of blurring includes the steps of dividing the motion trajectory path of said object as represented by said motion vector into a plurality of increments each being a portion of said motion trajectory path, deriving data representing the respective image of said object at each of said increments, summing all of the image data and dividing the summed image data by the number of said increments to obtain an average image data value.

6. A method of processing a first video data signal having a plurality of input frames in which said first video data signal is obtained by filming single frame animation material, said method comprising the steps of:

detecting motion of an object in a picture sequence formed from said input frames of said first video data signal and deriving from detected motion a motion vector which represents an associated trajectory path of said object; and

blurring images of the object which is detected as being in motion by forming a plurality of intervening frames from each said motion vector and video data from a previous frame, a current frame and a subsequent frame of said first video data signal for each of said input frames and summing the intervening frames corresponding to each of said input frames to form respective output frames so as to form a processed video data signal having said plurality of output frames which is suitable for merging with a second video data signal obtained by filming live action or non-single frame animation material.

7. Apparatus for processing a first video data signal having a plurality of frames in which said video data signal is obtained by filming single frame animation material, said apparatus comprising:

motion vector estimator means for deriving motion vectors representing a motion trajectory path of an object in a picture sequence formed from said frames of said first video data signal; and

means for blurring images represented by said frames of said first video data signal in said picture sequence of the object which is determined as being in motion by said motion vectors so as to form a processed video data signal which is suitable for merging with a second video data signal obtained by filming live action or non-single frame animation material.

8. Apparatus according to claim 7, in which said motion vectors are derived from a current frame and a previous frame of said first video data signal.

9. Apparatus according to claim 7, in which said means for blurring includes vector-steered interpolator means which receives said motion vectors.

10. Apparatus according to claim 7, in which said means for blurring divides the motion trajectory path of said object as represented by one of said motion vectors into a plurality of increments each being a portion of said motion trajectory path, derives data representing the respective image of said object at each of said increments, and sums all of the image data.

11. Apparatus according to claim 7, in which said motion vectors are derived from a current frame and a subsequent frame of said first video data signal.

12. A method of processing a first video data signal having a plurality of frames in which said first video data signal is obtained by recording single frame animation material, and in which said first video data signal is recorded with a camera having a shutter which has a shutter opening characteristic associated therewith, said method comprising the steps of:

detecting motion of an object in a picture sequence formed from said frames of said first video data signal and deriving from detected motion a motion vector which represents an associated trajectory path of said object; and

blurring images represented by said frames of said first video data signal in said picture sequence of the object which is detected as being in motion by dividing the motion trajectory path of said object as represented by said motion vector into a plurality of increments each being a portion of said motion trajectory path, deriving data representing the respective image of said object at each of said increments, weighting the image data with said shutter opening characteristic of said camera, and summing all of said image data so as to form a processed video data signal which is suitable for merging with a second video data signal obtained by recording live action or non-single frame animation material.

13. Apparatus for processing a first video data signal having a plurality of frames in which said first video data signal is obtained by recording single frame animation material, and in which said first video data signal is recorded with a camera having a shutter which has a shutter opening characteristic associated therewith, said apparatus comprising:

motion vector estimator means for deriving motion vectors representing a motion trajectory path of an object in a picture sequence formed from said frames of said first video data signal; and

means, including weighting means, for blurring images represented by said frames of said first video data signal in said picture sequence of the object which is determined as being in motion by said motion vectors by dividing the motion trajectory path of said object as represented by one of said motion vectors into a plurality of increments each being a portion of said motion trajectory path, deriving data representing the respective image of said object at each of said increments, weighting the image data with said shutter opening characteristic of said camera by utilizing said weighting means, and summing all of said image data so as to form a processed video data signal which is suitable for merging with a second video data signal obtained by recording live action or non-single frame animation material.