IMAGE-BASED DEFORMATION OF SIMULATED CHARACTERS OF VARIED TOPOLOGY

• US 20160035142A1
• Filed: 01/15/2015
• Published: 02/04/2016
• Est. Priority Date: 08/01/2014
• Status: Active Grant

• Current Assignee: Electronic Arts Incorporated
• Original Assignee: Electronic Arts Incorporated
• Inventors: Borovikov, Igor, Nair, Srikumar, Tan Kok Yoong, Kenneth
• Granted Patent: US 9,626,808 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/56 Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
• CPC Class Codes: A63F 2300/65 for computing the condition of a game character
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 17/205 Re-meshing
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2210/16 Cloth
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

A graphical asset associated with a simulated character of a video game is received. A first image and a second image associated with the simulated character are subsequently received, the first image comprising graphical displacement mapping information for a first topology of image deformation and the second image comprising graphical displacement mapping information for a second topology of deformation. A portion of the graphical asset is then deformed using the graphical displacement mapping information from the first image and the second image to change the 3D geometry of the portion of the graphical asset.

Claims

1. A method comprising:

receiving, by a processing device, a graphical asset associated with a simulated character of a video game;

receiving, by the processing device, a first image and a second image associated with the simulated character, the first image comprising graphical displacement mapping information for a first topology of image deformation and the second image comprising graphical displacement mapping information for a second topology of deformation; and

deforming, by the processing device, a portion of the graphical asset using the graphical displacement mapping information from the first image and the second image to change a 3D geometry of the portion of the graphical asset.

2. The method of claim 1 wherein receiving the graphical asset comprises:

receiving a vertex buffer, the vertex buffer comprising an array of vertex data, wherein the vertex data comprises a vertex position, a normal vector, a deformation map texture coordinate and a vertex color.

3. The method of claim 2 wherein deforming the graphical asset comprises:

determining a pixel location in the first image and the second image in view of the deformation map texture coordinate of the vertex data;

identifying a first color value at the pixel location of the first image and a second color value at the pixel location of the second image;

calculating a total displacement value for the portion of the graphical asset in view of the first color and the second color; and

updating the portion of the graphical asset in view of the total displacement value.

4. The method of claim 3 wherein calculating the total displacement value comprises:

determining a first weight value of the first image and a second weight value of the second image in view of the vertex color;

calculating a first displacement value in view of the first color value and the first weight value;

calculating a second displacement value in view of the second color value and the second weight value; and

combining the first displacement value and the second displacement value.

5. The method of claim 3 wherein updating the portion of the graphical asset comprises:

adding the total displacement value to the vertex position of the vertex data; and

writing the modified vertex position back to the vertex buffer.

6. The method of claim 3 wherein each of the first color value and the second color value comprise a numerical color channel triplet, the triplet corresponding to a coordinate in 3D geometry space.

7. The method of claim 4 further comprising:

receiving user input from an input device to further deform the portion of the graphical asset; and

modifying the total displacement value in view of the user input.

8. The method of claim 1 wherein the graphical asset comprises a 3D geometry associated with a graphic rendering of an entire object.

9. The method of claim 8 wherein the object comprises at least one of the 3D geometry of a portion of the body of the simulated character, a shoe, a boot, a garment bottom, a garment top, a hat, or hair.

10. An apparatus, comprising:

a memory to store instructions; and

a processing device, operatively coupled to the memory, to execute the instructions, wherein the processing device is to;

receive a graphical asset associated with a simulated character of a video game;

receive a first image and a second image associated with the simulated character, the first image comprising graphical displacement mapping information for a first topology of image deformation and the second image comprising graphical displacement mapping information for a second topology of deformation; and

deform a portion of the graphical asset using the graphical displacement mapping information from the first image and the second image to change a 3D geometry of the portion of the graphical asset.

11. The apparatus of claim 10 wherein to receive the graphical asset, the processing device is to receive a vertex buffer, the vertex buffer comprising an array of vertex data, wherein the vertex data comprises a vertex position, a normal vector, a deformation map texture coordinate and a vertex color.

12. The apparatus of claim 11 wherein to deform the graphical asset, the processing device is to:

determine a pixel location in the first image and the second image in view of the deformation map texture coordinate of the vertex data;

identify a first color value at the pixel location of the first image and a second color value at the pixel location of the second image;

calculate a total displacement value for the portion of the graphical asset in view of the first color and the second color; and

update the portion of the graphical asset in view of the total displacement value.

13. The apparatus of claim 12 wherein to calculate the total displacement value, the processing device is to:

determine a first weight value of the first image and a second weight value of the second image in view of the vertex color;

calculate a first displacement value in view of the first color value and the first weight value;

calculate a second displacement value in view of the second color value and the second weight value; and

combine the first displacement value and the second displacement value.

14. The apparatus of claim 12 wherein to update the portion of the graphical asset, the processing device is to:

add the total displacement value to the vertex position of the vertex data; and

write the modified vertex position back to the vertex buffer.

15. The apparatus of claim 12 wherein each of the first color value and the second color value comprise a numerical color channel triplet, the triplet corresponding to a coordinate in 3D geometry space.

16. The apparatus of claim 13 wherein the processing device is further to:

receive user input from an input device to further deform the portion of the graphical asset; and

modify the total displacement value in view of the user input.

17. A non-transitory computer readable storage medium, having instructions stored therein, which when executed by a processing device, cause the processing device to:

receive, by the processing device, a graphical asset associated with a simulated character of a video game, the graphical asset comprising a an array of vertex data, wherein the vertex data comprises a vertex position, a normal vector, a deformation map texture coordinate and a vertex color;

receive, by the processing device, a first image and a second image associated with the simulated character, the first image comprising graphical displacement mapping information for a first topology of image deformation and the second image comprising graphical displacement mapping information for a second topology of deformation; and

deform, by the processing device, a portion of the graphical asset using the graphical displacement mapping information from the first image and the second image to change a 3D geometry of the portion of the graphical asset.

18. The non-transitory computer readable storage medium of claim 17, wherein to deform the graphical asset, the processing device is to:

determine a pixel location in the first image and the second image in view of the deformation map texture coordinate of the vertex data;

identify a first color value at the pixel location of the first image and a second color value at the pixel location of the second image;

calculate a total displacement value for the portion of the graphical asset in view of the first color and the second color;

add the total displacement value to the vertex position of the vertex data; and

write the modified vertex position back to the vertex buffer.

19. The non-transitory computer readable storage medium of claim 18, wherein to calculate the total displacement value, the processing device is to:

determine a first weight value of the first image and a second weight value of the second image in view of the vertex color;

calculate a first displacement value in view of the first color value and the first weight value;

calculate a second displacement value in view of the second color value and the second weight value; and

combine the first displacement value and the second displacement value.

20. The non-transitory computer readable storage medium of claim 17, wherein the processing device is further to:

receive, by the processing device, a third image and a fourth image associated with the simulated character, the third image comprising graphical displacement mapping information for the first topology of image deformation and the fourth image comprising graphical displacement mapping information for the second topology of deformation; and

modify, by the processing device, the normal vector of the graphical asset using the graphical displacement mapping information from the third image and the fourth image to change the 3D geometry of the portion of the graphical asset.