Three-dimensional CG model generator and recording medium storing processing program thereof

• US 6,545,673 B1
• Filed: 11/23/1999
• Issued: 04/08/2003
• Est. Priority Date: 03/08/1999
• Status: Expired due to Term

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Shiitani, Shuichi, Watanabe, Masaki
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Sealey, Lance W.
• Application Number:
  US09/447,053
• Time in Patent Office: 1,232 Days
• Field of Search: 345/418-419, 345/424, 345/426, 345/443, 345/474, 345/420, 345/473, 382/154, 382/285
• US Class Current: 345/418
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation

Abstract

The present invention provides a three-dimensional CG model generator allowing input assistance for matching a supplied actually captured image and a basic model to be simplified so that a three-dimensional CG model can be generated without special skills. An actually captured image is input from an image inputting part, and an image displaying part displays the input image on a display. A pose information designating part designates a pose by designating the positions of the vertexes and the edges connecting the vertexes of the object represented in the actually captured image. A pose matching part performs pose matching by comparing the designated pose and the basic pose registered in the basic pose information storing part. An automatic fitting part performs fine adjustment of the length of the edge, the angle of the vertexes, the torsion relationship or the like, based on the geometry and the pose, and a texture image extracted from the actually captured image by a texture processing part is attached so that a three-dimensional CG model is generated.

Claims

1. A three-dimensional CG model generator for generating a three-dimensional CG model of a three-dimensional object represented in a two-dimensional image, based on information from the two-dimensional image representing the three-dimensional object supplied thereto, comprising:

an image inputting part for receiving image data of the object taken from a certain viewpoint;

a basic pose information storing part of storing pose information on all patterns of a basic geometric model as basic pose information, the pose information indicating a pose with relationships of vertexes and edges of the image projected two-dimensionally;

a pose information designating part for acquiring the pose information be designating a vertex and an edge of the object represented in the supplied image projected two-dimensionally;

a pose matching part for performing pose matching be comparing the pose information acquired by the pose information designating part and the basic pose information stored in the basic pose information storing part, and specifying a basic geometric model having corresponding pose information and a corresponding pose; and

an automatic fitting part for deforming and adjusting the pose of the basic geometric model specified by the pose matching part so as to conform to the pose of the supplied image;

wherein the three-dimensional CG model of the object is generated based on the pose information of the supplied image.

2. The three-dimensional CG model generator according to claim 1, comprising a basic geometric model candidate displaying and selecting part for presenting a plurality of basic geometric models to a user as candidates for selection by the user, when as a result of the pose matching, the plurality of basic geometric models are obtained as those having corresponding pose information.

3. The three-dimensional CG model generator according to claim 2, comprising a pose matching history information storing part for storing history information of results of past pose matching,

wherein the basic geometric model candidate displaying and selecting part displays the plurality of candidates with priorities that are assigned based on the pose matching history information when the plurality of candidates are displayed.

4. The three-dimensional CG model generator according to claim 1, comprising an attribute designating part for designating an attribute of the object represented in the supplied image,

wherein the pose matching part limits the basic pose information stored in the basic pose information storing part based on the designated attribute before performing the pose matching.

5. The three-dimensional CG model generator according to claim 1, wherein a plurality of images of the object from which a three-dimensional CG model is generated are supplied, and the pose matching part performs pose matching with respect to each of the images, and a basic geometric model of the object is determined from results of the plurality of pose matching.

6. The three-dimensional CG model generator according to claim 1, wherein

in a process of designating vertexes and edges of the supplied image sequentially by inputting the vertexes and the edges from the pose information designating part, the pose matching part comprises:

a partial pose matching part for finding a match between information on a portion of a pose of the basic geometric model stored in the basic pose information storing part and information based on a portion of a pose that is constituted by the designated and input vertexes and edges; and

a basic geometric model candidate displaying and selecting part for presenting a corresponding basic geometric model obtained as a result of the partial pose matching by the partial pose matching part,

wherein the results of the partial pose matching are updated and presented in response to information on a vertex and an edge of the supplied image being input from the pose information designating part.

7. The three-dimensional CG model generator according to claim 6, wherein the pose matching part comprises a basic geometric model selecting part for selecting one basic geometric model from candidates presented by the basic geometric model candidate displaying and selecting part, thereby assisting pose designation of a user.

8. The three-dimensional CG model generator according to claim 1, comprising a basic pose extracting part for receiving a three-dimensional CG model as a basic geometric model, generating a two-dimensional image of the basic geometric model which is a projected image from one viewpoint, extracting pose information from the generated two-dimensional image, changing the viewpoint, repeating the extraction of the pose information so that all patterns of poses that the basic geometric model can take are extracted.

9. The three-dimensional CG model generator according to claim 1, wherein when the pose information input from the pose information designating part with respect to the supplied image is not stored in the pose information storing part, the input pose information is registered and stored in the pose information storing part as pose information of a basic geometric model.

10. A computer-readable recording medium storing a program for realizing a three-dimensional CG model generator for generating a three-dimensional CG model of a three-dimensional object represented in a two-dimensional image, based on information from the two-dimensional image representing the three-dimensional object supplied thereto, the program comprising:

a basic pose information storing processing step for storing pose information on all patterns of a basic geometric model as basic pose information, the pose information indicating a pose with relationships of vertexes and edges of the image projected two-dimensionally taken from a certain viewpoint;

a pose information designating processing step for acquiring the pose information by designating a vertex and an edge of the object represented in the supplied image projected two-dimensionally;

a pose matching processing step for performing pose matching by comparing the pose information acquired by the pose information designating processing step and the basic pose information stored in the basic pose information storing processing step, and specifying a basic geometric model having corresponding pose information and a corresponding pose; and

an automatic fitting processing step for deforming and adjusting the pose of the basic geometric model specified by the pose matching processing step so as to conform to the pose of the supplied image.