METHOD FOR PRODUCING A BLENDED VIDEO SEQUENCE

• US 20120154684A1
• Filed: 12/17/2010
• Published: 06/21/2012
• Est. Priority Date: 12/17/2010
• Status: Active Grant

• Current Assignee: Kodak Alaris Inc (KPP (no. 2) Trustees Ltd.)
• Original Assignee: Kodak Alaris Inc (KPP (no. 2) Trustees Ltd.)
• Inventors: Luo, Jiebo, Murray, Thomas Joseph, Park, Minwoo
• Granted Patent: US 8,692,940 B2
• Time in Patent Office: Days
• US Class Current: 348/700
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/14 Picture signal circuitry for video frequency region cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

A method for producing a blended video sequence that combines a still image and a video image sequence comprising: designating a first face in the still image, designating a second face in the video image sequence; detecting a series of video frames in the video image sequence containing the second face; identifying a video frame in the detected series of video frames suitable for transitioning from the first face into the second face; using a data processor to automatically produce a transition image sequence where the first face transitions into the second face, and a first background transitions into a second background; and producing the blended video sequence by concatenating the transition image sequence, and a plurality of video frames from the video image sequence starting from the identified video frame.

Claims

1. A method for producing a blended video sequence that combines a still image and a video image sequence including a plurality of video frames, comprising:

a) designating a first face in the still image,

b) designating a remaining portion of the still image excluding the first face to be a first background;

c) designating a second face in the video image sequence;

d) using a data processor to automatically detect a series of video frames in the video image sequence containing the second face;

e) using a data processor to automatically identify a video frame in the detected series of video frames suitable for transitioning from the first face into the second face;

f) designating a remaining portion of the identified video frame excluding the second face to be a second background;

g) using a data processor to automatically produce a transition image sequence where the first face transitions into the second face, and the first background transitions into the second background;

h) producing the blended video sequence by concatenating;

a plurality of video frames formed from the still image;

the transition image sequence; and

a plurality of video frames from the video image sequence starting from the identified video frame; and

i) storing the blended video sequence in a processor accessible memory.

2. The method of claim 1 wherein at least one of the first face or the second face is automatically designated using a face detection algorithm.

3. The method of claim 1 wherein at least one of the first face or the second face is manually user designated using a user interface.

4. The method of claim 3 wherein the user interface includes a face selection means for designating a face in an image, and wherein the manual user designation is accomplished by using the face selection means to select at least one of the first face in the still image or the second face in the video image sequence.

5. The method of claim 3 wherein the user interface includes a name designation means for designating the name of a person, and wherein the manual user designation is accomplished by using the name designation means to designate the name of a person and using a face recognition algorithm to locate a face corresponding to the designated person it at least one of the still image or the video image sequence.

6. The method of claim 1 wherein second face corresponds to the same person as the first face.

7. The method of claim 1 wherein the second face corresponds to a different person than the first face.

8. The method of claim 1 wherein step d) includes locating the second face in one video frame of the video image sequence and using a face tracking algorithm to track the second face in the video image sequence.

9. The method of claim 1 wherein step d) includes using a face recognition algorithm to identify video frames in the video image sequence containing the second face.

10. The method of claim 1 wherein step e) includes evaluating the series of video frames using one or more evaluation criteria.

11. The method of claim 10 wherein the evaluation criteria include a face size criterion, a face position criterion, a pose similarity criterion, a facial image quality criterion, a facial expression criterion, or a facial motion criterion.

12. The method of claim 1 wherein the transition image sequence includes a still image transition image sequence formed by progressively applying one or more image adjustments to the still image, such that the first face in the adjusted image more closely matches the second face in the identified video frame.

13. The method of claim 12 wherein the one or more image adjustments include translating, zooming or rotating the still image to improve a geometrical match between the first face and the second face in the identified video frame.

14. The method of claim 12 wherein the one or more image adjustments include applying a color transformation to the still image to improve a color appearance match between the first face and the second face in the identified video frame.

15. The method of claim 1 wherein the transition image sequence includes a face morphing sequence formed by using a morphing transformation to morph the first face into the second face.

16. The method of claim 15 wherein the morphing transformation is controlled by a set of facial feature points.

17. The method of claim 1 wherein the first background cross-dissolves into the second background during the transition image sequence.

18. The method of claim 1 wherein the first background morphs into the second background during the transition image sequence.

19. The method of claim 1 wherein the plurality of video frames from the video image sequence included in the blended video sequence include less than all of the video frames between the identified video frame and the end of the video image sequence.

20. The method of claim 1 wherein at least one of the first face or the second face is a human face.

21. The method of claim 1 wherein at least one of the first face or the second face is a representation of a human face.

22. The method of claim 1 wherein at least one of the first face or the second face is an animal face.

23. The method of claim 1 further including the step of displaying or printing the stored blended video sequence.

24. A computer program product for producing a blended video sequence that combines a still image and a video image sequence including a plurality of video frames comprising a non-transitory tangible computer readable storage medium storing an executable software application for causing a data processing system to perform the steps of:

a) designating a first face in the still image,

b) designating a remaining portion of the still image excluding the first face to be a first background;

c) designating a second face in the video image sequence;

d) automatically detecting a series of video frames in the video image sequence containing the second face;

e) automatically identifying a video frame in the detected series of video frames suitable for transitioning from the first face into the second face;

f) designating a remaining portion of the identified video frame excluding the second face to be a second background;

g) automatically producing a transition image sequence where the first face transitions into the second face, and the first background transitions into the second background;

h) producing the blended video sequence by concatenating;

a plurality of video frames formed from the still image;

the transition image sequence; and

a plurality of video frames from the video image sequence starting from the identified video frame; and

i) storing the blended video sequence in a processor accessible memory.

25. A method for producing a blended video sequence that combines a still image and a video image sequence including a plurality of video frames, comprising:

a) designating a first face in the still image,

b) designating a remaining portion of the still image excluding the first face to be a first background;

c) designating a second face in the video image sequence;

d) using a data processor to automatically detect a series of video frames in the video image sequence containing the second face;

e) using a data processor to automatically identify a video frame in the detected series of video frames suitable for transitioning from the first face into the second face;

f) designating a remaining portion of the identified video frame excluding the second face to be a second background;

g) using a data processor to automatically produce a transition image sequence where the second face transitions into the first face, and the second background transitions into the first background;

h) producing the blended video sequence by concatenating;

a plurality of video frames from the video image sequence ending at the identified video frame;

the transition image sequence; and

a plurality of video frames formed from the still image; and

i) storing the blended video sequence in a processor accessible memory.