Method and apparatus for image-based photorealistic 3D face modeling
First Claim
1. A method for creating a 3D photorealistic head model, the method being executed by a processor and comprising:
- (a) detecting frontal and profile features in input frontal and profile images, the detecting frontal and profile features comprising;
detecting a face region, the detecting a face region comprising initializing the largest skin-colored connected component as the face region, and when there are two largest connected components having similar sizes, the initializing includes selecting one of the two largest connected components that is closer to the center of the image as the face region, anddetecting a profile region by classifying pixels into skin color pixels and non-skin color pixels and selecting the largest skin-colored connected component as the profile region;
(b) generating a 3D head model by fitting a 3D generic model using the detected face region and the detected profile region;
(c) generating a realistic texture from the input frontal and profile images; and
(d) mapping the texture onto the 3D head model.
1 Assignment
0 Petitions
Accused Products
Abstract
An apparatus and method for image-based 3D photorealistic head modeling are provided. The method for creating a 3D photorealistic head model includes: detecting frontal and profile features in input frontal and profile images; generating a 3D head model by fitting a 3D genetic model using the detected facial features; generating a realistic texture from the input frontal and profile images; and mapping the texture onto the 3D head model. In the apparatus and method, data obtained using a relatively cheap device, such as a digital camera, can be processed in an automated manner, and satisfactory results can be obtained even from imperfect input data. In other words, facial features can be extracted in an automated manner, and a robust “human-quality” face analysis algorithm is used.
-
Citations
53 Claims
-
1. A method for creating a 3D photorealistic head model, the method being executed by a processor and comprising:
-
(a) detecting frontal and profile features in input frontal and profile images, the detecting frontal and profile features comprising; detecting a face region, the detecting a face region comprising initializing the largest skin-colored connected component as the face region, and when there are two largest connected components having similar sizes, the initializing includes selecting one of the two largest connected components that is closer to the center of the image as the face region, and detecting a profile region by classifying pixels into skin color pixels and non-skin color pixels and selecting the largest skin-colored connected component as the profile region; (b) generating a 3D head model by fitting a 3D generic model using the detected face region and the detected profile region; (c) generating a realistic texture from the input frontal and profile images; and (d) mapping the texture onto the 3D head model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
-
-
30. An apparatus for creating a 3D photorealistic head model, the apparatus comprising:
-
a face feature detecting unit receiving input frontal and profile images, and including a face region initializing portion that initializes the largest skin-colored connected components as a face region, wherein when there are two largest connected components having similar sizes, the initializing includes selecting one of the two largest connected components that is closer to the center of the image as the face region, and a profile feature detecting portion that detects profile features, and includes a profile region detecting portion that detects a profile region by classifying pixels into skin color pixels and non-skin color pixels and selecting the largest skin-colored connected component as the profile region; a face model fitting unit generating a 3D head model by fitting a 3D generic model using the detected facial features; a texture generating unit generating a realistic texture from the input frontal and profile images; and a mapping unit mapping the texture onto the 3D head model generated in the face model fitting unit. - View Dependent Claims (31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52)
-
-
53. A non-transitory computer readable storage medium having embodied thereon computer readable code to control at least one processing element in a computer to implement a method for creating a 3D photorealistic head model, the method comprising:
-
detecting frontal and profile features in input frontal and profile images, the detecting frontal and profile features comprising detecting a face region, wherein the detecting a face region comprises initializing the largest skin-colored connected component as the face region, and wherein, when there are two largest connected components having similar sizes, the initializing includes selecting one of the two largest connected components that is closer to the center of the image as the face region; detecting a profile region by classifying pixels into skin color pixels and non-skin color pixels and selecting the largest skin-colored connected component as the profile region; generating a 3D head model by fitting a 3D genetic generic model using the detected face region and the detected profile region; generating a realistic texture from the input frontal and profile images; and mapping the texture onto the 3D head model.
-
Specification