Creating animation from a video

• US 6,278,466 B1
• Filed: 06/11/1998
• Issued: 08/21/2001
• Est. Priority Date: 06/11/1998
• Status: Expired due to Term

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Presenter.Com, Inc.
• Inventors: Chen, Shenchang Eric
• Primary Examiner(s): Vo, Cliff N.
• Application Number:
  US09/096,720
• Time in Patent Office: 1,167 Days
• Field of Search: 345/473, 345/474, 345/418, 345/433, 345/475, 345/438, 345/439
• US Class Current: 345/473
• CPC Class Codes: G06T 13/00 Animation

Abstract

An apparatus and method for creating an animation. A sequence of video images is inspected to identify a first transformation of a scene depicted in the sequence of video images. A first image and a second image are obtained from the sequence of video images, the first image representing the scene before the first transformation and the second image representing the scene after the first transformation. Information is generated that indicates the first transformation and that can be used to interpolate between the first image and the second image to produce a video effect that approximates display of the sequence of video images.

Claims

1. A computer-implemented method of creating an animation, the method comprising:

inspecting a sequence of video images to identify a first transformation of a scene depicted in the sequence of video images;

obtaining a first image and a second image from the sequence of video images, the first image representing the scene before the first transformation and the second image representing the scene after the first transformation; and

generating transformation information that describes an interpolation between the first image and the second image to produce a video effect that approximates display of the sequence of video images.

2. The method of claim 1 wherein inspecting a sequence of video images to identify a first transformation of a scene comprises determining when a difference between a selected one of the video images and a subsequent one of the video images exceeds a threshold, the selected one of the video images and the subsequent one of the video images indicating a starting image and an ending image, respectively, of a segment of the video images.

3. The method of claim 2 wherein the starting image of the segment of the video images indicates an ending image of a previous segment of the video images.

4. The method of claim 2 wherein determining when a difference between a selected one of the video images and a subsequent one of the video images exceeds a threshold comprises:

selecting from the sequence of video images a video image that succeeds the starting image;

comparing the video image that succeeds the starting image to an adjacent preceding video image from the sequence of video images to generate an incremental difference value;

adding the incremental difference value to a sum of incremental difference values; and

repeating the acts of selecting, comparing and adding until the sum of incremental difference values exceeds the threshold.

5. The method of claim 4 wherein the subsequent one of the video images is the video image used to generate an incremental difference which, when added to the sum of incremental differences, causes the sum of incremental differences to exceed the threshold.

6. The method of claim 5 wherein the ending image of the set of video images is adjacent to the subsequent one of the video images.

7. The method of claim 2 wherein the difference between the selected one of the video images and the subsequent one of the video images includes a difference caused by a change in disposition of a camera used to record the sequence of video images.

8. The method of claim 2 wherein the difference between the selected one of the video images and the subsequent one of the video images includes a difference in color.

9. The method of claim 2 wherein the difference between the selected one of the video images and the subsequent one of the video images includes a difference in time elapsed between the selected video image and the subsequent one of the video images.

10. The method of claim 2 wherein obtaining the first image and the second image from the sequence of video images comprises selecting the starting image and the ending image of the set of video images to be the first image and the second image, respectively.

11. The method of claim 2 wherein obtaining the second image from the sequence of video images comprises:

identifying one or more dynamic objects in the ending image; and

removing the one or more dynamic objects to produce the second image.

12. The method of claim 11 wherein identifying one or more dynamic objects in the ending image comprises identifying one or more features in the set of video images that undergo a second transformation in the set of video images that is not indicated by the first transformation.

13. The method of claim 12 wherein the second transformation includes a change in disposition of the one or more dynamic objects that does not result from a change in disposition of a camera used to record the sequence of video images.

14. The method of claim 1 wherein generating transformation information that describes an interpolation between the first image and the second image comprises:

generating a value that indicates a measure of change between the first image and the second image;

generating a value that indicates a time that should elapse between display of the first image and display of the second image.

15. The method of claim 14 wherein generating a value that indicates a measure of change comprises generating a value that indicates a measure of change caused by a change in disposition of a camera used to record the sequence of video images.

16. The method of claim 14 wherein generating a value that indicates a measure of change comprises generating a value that indicates a measure of color change.

17. A computer-implemented method of creating an animation, the method comprising:

identifying a first transformation of a scene depicted in a sequence of video images, the first transformation indicating a change in disposition of a camera used to record the sequence of video images;

identifying a second transformation of the scene depicted in the sequence of video images, the second transformation indicating a change in disposition of an object in the scene;

removing respective regions that contain the object from first and second images of the sequence of video images to generate first and second background images; and

generating background transformation information that describes an interpolation between the first and second background images to produce interpolated background images, the interpolated background images being displayable to approximate the first transformation of the scene.

18. The method of claim 17 further comprising:

generating first and second object images that contain the respective regions removed from the first and second images of the sequence of video images, the first object image representing the dynamic object before the second transformation and the second object image representing the dynamic object after the second transformation; and

generating object transformation information that describes an interpolation between the first and second object images to produce interpolated object images, the interpolated object images being displayable to approximate the change in disposition of the object in the scene.

19. The method of claim 18 further comprising storing the first and second background images and the background transformation information within a background track in an animation object;

and

storing the first and second object images and the object information in an object track in the animation object.

20. The method of claim 19 further comprising transmitting the animation object across a computer network in response to a request from an animation playback device.

21. An animation authoring system comprising:

a background track generator to inspect a sequence of video images and to generate a background track therefrom, the background track including a sequence of background frames and transformation information describes an interpolation between the background frames to synthesize additional images;

an object track generator to inspect the sequence of video images and to generate an object track therefrom, the object track including a sequence of object frames and transformation information that describes an interpolation between the object frames to synthesize additional object images.

22. The animation authoring system of claim 21 further comprising an animation object generator to store the background track and the object track in an animation object for later recall.

23. An animation delivery system comprising the animation authoring system of claim 22 and further comprising a communication device to receive a request to download the animation object from one or more client devices and to transmit the animation object to the one or more client devices in response.

24. The animation authoring system of claim 22 wherein playback timing information is stored in the animation object to indicate relative playback times for the object track and the background track.

25. The animation authoring system of claim 21 wherein at least one of the background track generator and the object track generator is implemented by a programmed processor.

26. The animation authoring system of claim 21 wherein the background track generator comprises:

a scene change estimator to resolve the sequence of video images into one or more video segments;

a background motion estimator to generate the transformation information based on respective transformations in the one or more video segments; and

a background frame constructor to generate the sequence of background frames based on the respective transformations in the one or more video segments.

27. The animation authoring system of claim 26 wherein the background track generator further comprises a blending estimator to generate blending information for combining background frames in the sequence of background frames.

28. The animation authoring system of claim 27 wherein the blending information indicates a cross-dissolve operation.

29. The animation authoring system of claim 26 wherein the background frame constructor generates at least one background frame of the sequence of background frames by compositing one or more images from the one or more video segments.

30. The animation authoring system of claim 29 wherein the background frame constructor composites the one or more images by stitching the one or more images into a panoramic image.

31. The animation authoring system of claim 29 wherein the background frame constructor combines the one or more images into a high resolution image.

32. A computer-readable medium having instructions stored thereon which, when executed by a processor, causes the processor to:

inspect a sequence of video images to identify a first transformation of a scene depicted in the sequence of video images;

obtain a first image and a second image from the sequence of video images, the first image representing the scene before the first transformation and the second image representing the scene after the first transformation; and

generate transformation information that describes an interpolation between the first image and the second image to produce a video effect that approximates display of the sequence of video images.

33. The computer-readable medium of claim 32 wherein the computer-readable medium includes one or more mass storage disks.

34. The computer-readable medium of claim 33 wherein the computer-readable medium is a computer data signal encoded in a carrier wave.

35. The computer-readable medium of claim 33 wherein the instructions which cause the processor to inspect the sequence of video images to identify a first transformation of a scene include instructions which, when executed, cause the processor to determine when a difference between a selected one of the video images and a subsequent one of the video images exceeds a threshold, the selected one of the video images and the subsequent one of the video images indicating a starting image and an ending image, respectively, of a set of the video images.

36. The computer-readable medium of claim 35 wherein the instructions which cause the processor to determine when a difference between a selected one of the video images and a subsequent one of the video images exceeds a threshold include instructions which, when executed, cause the processor to:

select from the sequence of video images a video image that succeeds the starting image;

compare the video image that succeeds the starting image to an adjacent preceding video image from the sequence of video images to generate an incremental difference value;

add the incremental difference value to a sum of incremental difference values; and

repeat the acts of selecting, comparing and adding until the sum of incremental difference values exceeds the threshold.