3D IDENTIFICATION SYSTEM WITH FACIAL FORECAST

• US 20160314616A1
• Filed: 04/21/2016
• Published: 10/27/2016
• Est. Priority Date: 04/23/2015
• Status: Abandoned Application

• Current Assignee: Ugo3d, Inc.
• Original Assignee: Ugo3d, Inc.
• Inventors: Su, Sungwook
• Application Number:
  US15/135,536
• Publication Number:
  US 20160314616A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10008 from scanner, fax or copier
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/344 involving models
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/68 of symmetry
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/76 based on eigen-space representations, e.g. from pose or different illumination conditions; Shape manifolds
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

Some embodiments provide a system for reconstructing an object from scanned data. In reconstructing, the system captures a visual representation and a volumetric representation. The visual representation is captured to reconstruct the object, while the volumetric representation is captured to identify the object from a group of other objects. In some embodiments, the object is a human being, and the visual and volumetric representations are used for a full facial dimension (FFD) identification system (FFDIS).

Claims

1. A non-transitory machine readable medium storing a program for reconstructing an object, the program comprising sets of instructions for:

receiving captured data of a scene that includes the object;

analyzing the scanned data to detect the object;

from a number of different base models, selecting a base model in accordance with the detected object; and

based on the captured data, deforming the base model to produce a 3D representation of the object in the scene.

2. The non-transitory machine readable medium of claim 1, wherein program further includes sets of instructions for identifying the object and selecting a particular base model based on the identification.

3. The non-transitory machine readable medium of claim 2, wherein program further includes a set of instructions for creating a new 3D model upon failure to identify the object.

4. The non-transitory machine readable medium of claim 1, wherein the program further comprises a set of instructions for extracting depth information from the scanned data in order to display the 3D model as having depth.

5. The non-transitory machine readable medium of claim 1, wherein the program further comprises a set of instructions for extracting color information from the scanned data in order to display the 3D model with color.

6. The non-transitory machine readable medium of claim 1, wherein the program further comprises a set of instructions for filtering the captured data to remove unwanted data.

7. The non-transitory machine readable medium of claim 1, wherein the program further comprises a set of instructions for reconstructing a part of the 3D representation.

8. The non-transitory machine readable medium of claim 1, wherein the program further comprises a set of instructions for providing a set of tools to change the shape of a feature of the 3D model.

9. The non-transitory machine readable medium of claim 1, wherein the object in the scene is a part of person or a person.

10. A method of reconstructing an object, the method comprising:

receiving captured data of a scene that includes the object;

analyzing the scanned data to detect the object;

from a number of different base models, selecting a base model in accordance with the detected object; and

based on the captured data, deforming the base model to produce a 3D representation of the object in the scene.

11. The method of claim 10 further comprising:

identifying the object; and

selecting a particular base model based on the identification.

12. The method of claim 11 further comprising creating a new 3D model upon failure to identify the object.

13. The method of claim 10 further comprising saving a set of depth maps associated with the scanned data in order to display a high-resolution version of the 3D model of the object.

14. The method of claim 10 further comprising saving at least one of a set color maps and a set of photos associated with the scanned data in order to display the 3D model.

15. The method of claim 10 further comprising filtering the captured data to remove unwanted data, wherein the filtering comprises identifying discontinuity of data points on the outer edge of the object and eliminating the data points from the captured data.

16. The method of claim 10 further comprising filtering the captured data to remove unwanted data, wherein the filtering comprises eliminating data points that are outside a given threshold range of the object.

17. The method of claim 10 further comprising identifying an abnormality in the 3D model and using object symmetry to reconstruct a part of the 3D model.

18. The method of claim 10 further comprising:

receiving a user input to change the shape of a feature of the 3D model; and

modifying the 3D model in accord with the input.

19. A system comprising:

a capturing device having a set of one or more cameras and a set of sensors to capture data relating to an object; and

a computing device having a set of processors and a set of storages that stores a program having sets of instructions for execution by the set of processors, including;

receiving captured data of a scene that includes the object;

analyzing the scanned data to detect the object;

from a number of different base models, selecting a base model in accordance with the detected object; and

based on the captured data, deforming the base model to produce a 3D representation of the object in the scene.

20. The system of claim 19, wherein the program that is executing on the computing device has a set of instructions for identifying the object and selecting a particular base model based on the identification.