Method for manipulating images

• US 6,283,858 B1
• Filed: 08/15/1997
• Issued: 09/04/2001
• Est. Priority Date: 02/25/1997
• Status: Expired due to Fees

• Current Assignee: BGK International, Incorporated
• Original Assignee: BGK International, Incorporated
• Inventors: Johnson, Laura Yelder, Hayes, Lucy Johnson, Hayes, Carl Douglas Jr.
• Primary Examiner(s): SAGER, MARK ALAN
• Application Number:
  US08/950,873
• Time in Patent Office: 1,481 Days
• Field of Search: 463/1, 463/30-34, 463/43, 463/36, 700/91, 273/459-461, 345/418, 345/433, 345/429, 345/435, 345/438, 345/468-469, 345/473, 382/118
• US Class Current: 463/31
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation

Abstract

A system and method is disclosed for manipulating images. The system includes a digital computer, input and output peripherals, and a program which provides a plurality of functions for manipulating various images. The images are processed to generate unique objects which may be modified by an operator. The program also allows integration and data transfer to various systems including video games, other digital computers, etc. The system may be used to transfer data to the video game in order to replace characters with the actual image of the player. The system may also be used to perform animation of an image, simulate facial movement resulting from speech, and simulate cosmetic reconstruction of a body portion in real time. The program is further capable of generating three-dimensional representations of an image being manipulated.

Claims

1. A method of customizing a video game comprising the steps:

inputting an image of a character having facial features from the video game into a digital computer;

superimposing a coordinate grid on the image of the character;

identifying landmark points for the character'"'"'s facial features;

inputting an image of a player having facial features into the digital computer;

superimposing a coordinate grid on the image of the player;

identifying landmark points for the player'"'"'s facial features;

applying mathematical equations to establish a natural layout of the character'"'"'s face and player'"'"'s face;

replacing the character'"'"'s facial features with corresponding facial features from the player for each frame to generate a resulting image; and

accessing the resulting image of each frame by the video game during play.

2. A method of customizing a video game as recited in claim 1 further comprising the step of providing an option to use the image of the player.

3. A method of customizing a video game as recited in claim 1 wherein:

the step of identifying landmark points for the character'"'"'s facial features further comprises the step of creating an object for each facial feature of the character; and

the step of identifying landmark points for the player'"'"'s facial features further comprises the step of creating an object for each facial feature of the player.

4. A method of customizing a video game as recited in claim 1 wherein the step of inputting the representation of a character further comprises the steps:

identifying all facial expressions for the character; and

saving all identified facial expressions of the character in a first library file.

5. A method of customizing a video game as recited in claim 4 wherein:

the step of superimposing a coordinate grid on the character is performed for each facial expression; and

the step of identifying landmark points for the character'"'"'s facial features is performed for each facial expression.

6. A method of customizing a video game as recited in claim 5 further comprising the step of creating a second library file containing landmark points for all facial expressions of the character.

7. A method of customizing a video game as recited in claim 6 further comprising the steps:

accessing the second library file;

retrieving landmark points for all facial expressions in the second library file;

applying landmark points for the facial features of the second library to the corresponding features of the image of the player; and

creating a third library file containing landmark points for all facial expressions of the player.

8. A method of customizing a video game as recited in claim 1 wherein:

the step of inputting a representation of a character comprises the steps;

inputting a frontal view of the character, and

inputting a side view of the character; and

the step of inputting a representation of the player comprises the steps;

inputting a frontal view of the player, and

inputting a side view of the player.

9. A method of customizing a video game as recited in claim 8 wherein the step of superimposing a coordinate grid on the image of the character comprises the steps:

superimposing a first coordinate grid on the side view of the character; and

superimposing a second coordinate grid on the frontal view of the character.

10. A method of customizing a video game as recited in claim 9 wherein:

the step of superimposing a first coordinate grid on the side view of the character further comprises the step of moving the first coordinate grid having a first origin to align the first origin with a highest point of the side view of the character defined by the tip of the nose; and

the step of superimposing a second coordinate grid having a second origin on the frontal view of the character further comprises the step of moving the second coordinate grid to align the second origin with the tip of the nose of the character;

whereby the first origin and second origin of said first and second coordinate grids are aligned with the tip of the nose of the character in three-dimensional space.

11. A method of customizing a video game as recited in claim 10 wherein the step of identifying landmark points for the character comprises the steps:

identifying landmark points on the first coordinate grid for facial features of the character using geometric shape inferences; and

identifying landmark points on the second coordinate grid for facial features of the character using geometric shape inferences.

12. A method of customizing a video game as recited in claim 8 wherein the step of superimposing a coordinate grid on the image of the player comprises the steps:

superimposing a first coordinate grid on the side view of the player; and

superimposing a second coordinate grid on the frontal view of the player.

13. A method of customizing a video game as recited in claim 12 wherein:

the step of superimposing a first coordinate grid on the side view of the player further comprises the step of moving the first coordinate grid having a first origin to align the first origin with a highest point of the side view of the player defined by the tip of the nose; and

the step of superimposing a second coordinate grid having a second origin on the frontal view of the player further comprises the step of moving the second coordinate grid to align the second origin with the tip of the nose of the player;

whereby the first origin and second origin of said first and second coordinate grids are aligned with the tip of the nose of the player in three-dimensional space.

14. A method of customizing a video game as recited in claim 13 wherein the step of identifying landmark points comprises the steps:

identifying landmark points on the first coordinate grid for facial features of the player using geometric shape inferences; and

identifying landmark points on the second coordinate grid for facial features of the player using geometric shape inferences.