Method and apparatus for interleaving a user image in an original image sequence

• US 20030007700A1
• Filed: 07/03/2001
• Published: 01/09/2003
• Est. Priority Date: 07/03/2001
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Trajkovic, Miroslav, Gutta, Srinivas, Colmenarez, Antonio J.
• Application Number:
  US09/898,139
• Publication Number:
  US 20030007700A1
• Time in Patent Office: Days
• US Class Current: 382/282
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

An image processing system is disclosed that allows a user to participate in a given content selection or to substitute any of the actors or characters in the content selection. A user can modify an image by replacing an image of an actor with an image of the corresponding user (or a selected third party). Various parameters associated with the actor to be replaced are estimated for each frame. A static model is obtained of the user (or the selected third party). A face synthesis technique modifies the user model according to the estimated parameters associated with the selected actor. A video integration stage superimposes the modified user model over the actor in the original image sequence to produce an output video sequence containing the user (or selected third party) in the position of the original actor.

Claims

1. A method for replacing an actor in an original image with an image of a second person, comprising:

analyzing said original image to determine at least one parameter of said actor;

obtaining a static model of said second person;

modifying said static model according to said determined parameter; and

superimposing said modified static model over at least a corresponding portion of said actor in said image.

2. The method of claim 1, wherein said superimposed image contains at least a corresponding portion of said second person in the position of said actor.

3. The method of claim 1, wherein said parameter includes a head pose of said actor.

4. The method of claim 1, wherein said parameter includes a facial expression of said actor.

5. The method of claim 1, wherein said parameter includes illumination properties of said original image.

6. The method of claim 1, wherein said static model is obtained from a database of faces.

7. The method of claim 1, wherein said static model is obtained from one or more images of said second person.

8. A method for replacing an actor in an original image with an image of a second person, comprising:

analyzing said original image to determine at least one parameter of said actor; and

replacing at least a portion of said actor in said image with a static model of second person, wherein said static model is modified according to said determined at least one parameter.

9. The method of claim 8, wherein said superimposed image contains at least a corresponding portion of said second person in the position of said actor.

10. The method of claim 8, wherein said parameter includes a head pose of said actor.

11. The method of claim 8, wherein said parameter includes a facial expression of said actor.

12. The method of claim 8, wherein said parameter includes illumination properties of said original image.

13. The method of claim 8, wherein said static model is obtained from a database of faces.

14. The method of claim 8, wherein said static model is obtained from one or more images of said second person.

15. A system for replacing an actor in an original image with an image of a second person, comprising:

a memory that stores computer-readable code; and

a processor operatively coupled to said memory, said processor configured to implement said computer-readable code, said computer-readable code configured to;

analyze said original image to determine at least one parameter of said actor;

obtain a static model of said second person;

modify said static model according to said determined parameter; and

superimpose said modified static model over at least a corresponding portion of said actor in said image.

16. A system for replacing an actor in an original image with an image of a second person, comprising:

a memory that stores computer-readable code; and

a processor operatively coupled to said memory, said processor configured to implement said computer-readable code, said computer-readable code configured to;

analyze said original image to determine at least one parameter of said actor; and

replace at least a portion of said actor in said image with a static model of second person, wherein said static model is modified according to said determined parameters.

17. An article of manufacture for replacing an actor in an original image with an image of a second person, comprising:

a computer readable medium having computer readable code means embodied thereon, said computer readable program code means comprising;

a step to analyze said original image to determine at least one parameter of said actor;

a step to obtain a static model of said second person;

a step to modify said static model according to said determined parameter; and

a step to superimpose said modified static model over at least a corresponding portion of said actor in said image.

18. An article of manufacture for replacing an actor in an original image with an image of a second person, comprising:

a computer readable medium having computer readable code means embodied thereon, said computer readable program code means comprising;

a step to analyze said original image to determine at least one parameter of said actor; and

a step to replace at least a portion of said actor in said image with a static model of second person, wherein said static model is modified according to said determined parameters.