Three-dimensional face capturing apparatus and method and computer-readable medium thereof
First Claim
1. An apparatus capturing a three-dimensional (3D) face, the apparatus comprising:
- a color image obtaining unit to obtain a face color image;
a depth image obtaining unit to obtain a face depth image;
an image alignment module to align the obtained face color image and the obtained face depth image;
a 3D face model generating module to perform two-dimensional (2D) modeling of the obtained face color image, and to perform covering of a modeled 2D face area on an image output by the image alignment module to obtain a 3D face model;
a first denoising module to remove depth noise of the 3D face model; and
a second denoising module to align the 3D face model and a 3D face template, and to remove residual noise based on a registration between the 3D face model and the 3D face template to obtain an accurate 3D face model,wherein the 3D face model generating module performs the 2D modeling using an ellipse face color image, andwherein the first denoising module calculates a scale-independent variance (V) in a depth direction, and compares V with a first threshold to determine whether noise exists in the 3D face model.
2 Assignments
0 Petitions
Accused Products
Abstract
Disclosed is a 3D face capturing apparatus, method and computer-readable medium. As an example, the 3D face capturing method includes obtaining a face color image, obtaining a face depth image, aligning, by a computer, the face color image and the face depth image, obtaining, by the computer, a 3D face model by 2D modeling of the face color image and covering a modeled 2D face area on an image output by an image alignment module, removing by the computer, depth noise of the 3D face model, and obtaining, by the computer, an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template.
-
Citations
20 Claims
-
1. An apparatus capturing a three-dimensional (3D) face, the apparatus comprising:
-
a color image obtaining unit to obtain a face color image; a depth image obtaining unit to obtain a face depth image; an image alignment module to align the obtained face color image and the obtained face depth image; a 3D face model generating module to perform two-dimensional (2D) modeling of the obtained face color image, and to perform covering of a modeled 2D face area on an image output by the image alignment module to obtain a 3D face model; a first denoising module to remove depth noise of the 3D face model; and a second denoising module to align the 3D face model and a 3D face template, and to remove residual noise based on a registration between the 3D face model and the 3D face template to obtain an accurate 3D face model, wherein the 3D face model generating module performs the 2D modeling using an ellipse face color image, and wherein the first denoising module calculates a scale-independent variance (V) in a depth direction, and compares V with a first threshold to determine whether noise exists in the 3D face model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method of capturing a 3D face, the method comprising:
-
obtaining a face color image; obtaining a face depth image; aligning, by a computer, the obtained face color image and the obtained face depth image; obtaining, by the computer, a 3D face model by 2D modeling of the obtained face color image and covering a modeled 2D face area on an image output by an image alignment module; removing, by the computer, depth noise of the 3D face model; and obtaining, by the computer, an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template, wherein the 2D modeling performs the 2D modeling with respect to the face color image using an ellipse, and wherein a scale-independent variance (V) is calculated in a depth direction, and compares V with a first threshold to determine whether noise exists in the 3D face model. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. At least one non-transitory computer readable recording medium comprising computer readable instructions that control at least one processor to implement a method, comprising:
-
obtaining a face color image; obtaining a face depth image; aligning the obtained face color image and the obtained face depth image; obtaining a 3D face model by 2D modeling of the obtained face color image and covering a modeled 2D face area on an image output by an image alignment module; removing depth noise of the 3D face model; and obtaining an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template, wherein the 2D modeling is performed using an ellipse face color image, and wherein a scale-independent variance (V) is calculated in a depth direction, and compares V with a first threshold to determine whether noise exists in the 3D face model.
-
Specification