FACIAL IMAGE ENHANCEMENT FOR VIDEO COMMUNICATION

• US 20140176548A1
• Filed: 12/21/2012
• Published: 06/26/2014
• Est. Priority Date: 12/21/2012
• Status: Abandoned Application

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Green, Simon
• Application Number:
  US13/724,590
• Publication Number:
  US 20140176548A1
• Time in Patent Office: Days
• US Class Current: 345/426
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 7/251 involving models

Abstract

A facial image enhancement system includes a deformable face tracker that provides a tracked face model from a facial video stream. Additionally, the facial image enhancement system includes a face enhancement image processing engine that uses the tracked face model to process the facial video stream, wherein an image enhancement of the facial video stream provides an enhanced facial video stream. A facial image enhancement method is also provided.

Claims

1. A facial image enhancement system, comprising:

a deformable face tracker that provides a tracked face model from a facial video stream; and

a face enhancement image processing engine that uses the tracked face model to process the facial video stream, wherein an image enhancement of the facial video stream provides an enhanced facial video stream.

2. The system as recited in claim 1 wherein the image enhancement is processed in real time.

3. The system as recited in claim 1 wherein the image enhancement employs an image mask that identifies specific regions in a face image.

4. The system as recited in claim 3 wherein the image mask includes a feathered region resulting in a fade out or blended region at a feature region edge.

5. The system as recited in claim 1 wherein the image enhancement employs an edge-preserving blur or smoothing filter.

6. The system as recited in claim 1 wherein the image enhancement employs an in-painting technique.

7. The system as recited in claim 1 wherein the image enhancement employs preselected parameters that are provided for user selection.

8. The system as recited in claim 7 wherein the preselected parameters are provided in a catalog or listing for selection.

9. The system as recited in claim 1 wherein a three dimensional model pertaining to the tracked face model is constructed from a list of points and a list of triangles that join together these points.

10. The system as recited in claim 9 wherein texturing mapping using a video image as a texture is applied to the list of triangles to render the three dimensional model.

11. The system as recited in claim 1 wherein a shader program calculates an image filter that averages a group of neighboring pixels to calculate a final color.

12. A facial image enhancement method, comprising:

providing a facial video stream;

providing a tracked face model from the facial video stream; and

processing the facial video stream with an image enhancement of the tracked face model to provide an enhanced facial video stream.

13. The method as recited in claim 12 wherein the image enhancement is processed in real time.

14. The method as recited in claim 12 wherein the image enhancement employs an image mask that identifies specific regions in a face image.

15. The method as recited in claim 14 wherein the image mask includes a feathered region resulting in a fade out or blended region at a feature region edge.

16. The method as recited in claim 12 wherein the image enhancement employs an edge-preserving blur or smoothing filter.

17. The method as recited in claim 12 wherein the image enhancement employs an in-painting technique.

18. The method as recited in claim 12 wherein the image enhancement employs preselected parameters that are provided for selection.

19. The method as recited in claim 18 wherein the preselected parameters are provided in a catalog or listing for selection.

20. The method as recited in claim 12 wherein a three dimensional model pertaining to the tracked face model is constructed from a list of points and a list of triangles that join together these points.

21. The method as recited in claim 20 wherein texturing mapping using a video image as a texture is applied to the list of triangles to render the three dimensional model.

22. The method as recited in claim 12 wherein a shader program calculates an image filter that averages a group of neighboring pixels to calculate a final color.