Method and apparatus for reproducing a shape and a pattern in a three-dimensional scene
First Claim
1. A method for reproducing a shape and a pattern in a three-dimensional scene forming a three-dimensional model used for computer graphics based on a plurality of images, comprising:
- capturing the plurality of images, storing the captured images, selecting a plurality of frames to which processing is applied from the stored images, and extracting correspondence between the plurality of images;
inputting the three-dimensional model to be a base, storing the input three-dimensional model, selecting the three-dimensional model that defines geometric properties of a target object in the images, and specifying correspondence between the images and the three-dimensional model;
deforming the three-dimensional model while satisfying both the obtained correspondence between the images and the obtained correspondence between the images and the three-dimensional model;
generating a pattern image to be attached to a surface of the three-dimensional model, based on a shape of the final three-dimensional model obtained by the deforming, and the specified correspondence between the final three-dimensional model and the images; and
outputting the completed final three-dimensional model.
1 Assignment
0 Petitions
Accused Products
Abstract
A method and apparatus for reproducing a shape and a pattern in a three-dimensional scene with good precision, based on a plurality of images, by realizing processing that considers a three-dimensional model from the beginning of the processing. A plurality of images are captured, a plurality of frames to which processing is applied are selected from the captured images, correspondence between a plurality of images are extracted, a three-dimensional model to be a base is input, a three-dimensional model that defines geometric properties in a target object in the images is selected, correspondence between the images and the three-dimensional model is specified, the three-dimensional model is deformed while satisfying both the correspondence between the images and the correspondence between the images and the three-dimensional model, a pattern image to be attached to a surface is generated based on a shape of the three-dimensional model and the correspondence between the three-dimensional model and the images, and the final three-dimensional model is output.
68 Citations
17 Claims
-
1. A method for reproducing a shape and a pattern in a three-dimensional scene forming a three-dimensional model used for computer graphics based on a plurality of images, comprising:
-
capturing the plurality of images, storing the captured images, selecting a plurality of frames to which processing is applied from the stored images, and extracting correspondence between the plurality of images;
inputting the three-dimensional model to be a base, storing the input three-dimensional model, selecting the three-dimensional model that defines geometric properties of a target object in the images, and specifying correspondence between the images and the three-dimensional model;
deforming the three-dimensional model while satisfying both the obtained correspondence between the images and the obtained correspondence between the images and the three-dimensional model;
generating a pattern image to be attached to a surface of the three-dimensional model, based on a shape of the final three-dimensional model obtained by the deforming, and the specified correspondence between the final three-dimensional model and the images; and
outputting the completed final three-dimensional model. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method for reproducing a shape and a pattern in a three-dimensional scene forming a three-dimensional model used for computer graphics based on a plurality of images, comprising:
-
capturing the plurality of images, storing the captured images, and selecting a plurality of frames to which processing is applied from the stored images;
inputting the three-dimensional model to be a base, storing the input three-dimensional model, selecting the three-dimensional model that defines geometric properties of a target object in the images, and specifying correspondence between the images and the three-dimensional model;
deforming the three-dimensional model while investigating portions, between the images, which satisfy the obtained correspondence between the images and the three-dimensional model;
generating a pattern image to be attached to a surface of the three-dimensional model, based on a shape of the final three-dimensional model obtained by the deforming, and the specified correspondence between the final three-dimensional model and the images; and
outputting the completed final three-dimensional model. - View Dependent Claims (7, 8)
-
-
9. An apparatus for reproducing a shape and a pattern in a three-dimensional scene forming a three-dimensional model used for computer graphics based on a plurality of images, comprising:
-
an image input part for capturing the plurality of images;
an image storing part for storing the images captured from the image input part;
an image selecting part for selecting a plurality of frames to which processing is applied from the images stored in the image storing part;
an inter-image correspondence obtaining part for extracting correspondence between the plurality of images;
a three-dimensional model input part for inputting the three-dimensional model to be a base;
a three-dimensional model storing part for storing the three-dimensional model input from the three-dimensional mode input part;
a three-dimensional model selecting part for selecting the three-dimensional model that defines geometric properties of a target object in the images;
an image—
three-dimensional model correspondence obtaining part for specifying correspondence between the images and the three-dimensional model;
a three-dimensional information reproducing part for deforming the three-dimensional model while satisfying both the correspondence between the images obtained in the inter-image correspondence obtaining part and the correspondence between the images and the three-dimensional model obtained in the image—
three-dimensional model correspondence obtaining part;
a pattern image generating part for generating a pattern image to be attached to a surface of the three-dimensional model, based on a shape of the final three-dimensional model obtained in the three-dimensional information reproducing part, and the specified correspondence between the final three-dimensional model and the images; and
a generated model output part for outputting the completed final three-dimensional model. - View Dependent Claims (10, 11, 12, 13)
-
-
14. An apparatus for reproducing a shape and a pattern in a three-dimensional scene forming a three-dimensional model used for computer graphics based on a plurality of images, comprising:
-
an image input part for capturing the plurality of images;
an image storing part for storing the images captured from the image input part;
an image selecting part for selecting a plurality of frames to which processing is applied from the images stored in the image storing part;
a three-dimensional model input part for inputting the three-dimensional model to be a base;
a three-dimensional model storing part for storing the three-dimensional model input from the three-dimensional mode input part;
a three-dimensional model selecting part for selecting the three-dimensional model that defines geometric properties of a target object in the images;
an image—
three-dimensional model correspondence obtaining part for specifying correspondence between the images and the three-dimensional model;
a part for simultaneously executing investigation of inter-image correspondence and reproduction of three-dimensional information for deforming the three-dimensional model while investigating portions, between the images, which satisfy the correspondence between the images and the three-dimensional model obtained in the image—
three-dimensional model correspondence obtaining part;
a pattern image generating part for generating a pattern image to be attached to a surface of the three-dimensional model, based on a shape of the final three-dimensional model obtained in the part for simultaneously executing investigation of inter-image correspondence and reproduction of three-dimensional information, and the specified correspondence between the final three-dimensional model and the images; and
a generated model output part for outputting the completed final three-dimensional model. - View Dependent Claims (15, 16)
-
-
17. A computer-readable recording medium storing a program to be executed by a computer for creating a three-dimensional model used for computer graphics based on a plurality of images, the program comprising:
-
capturing the plurality of images;
storing the captured images;
selecting a plurality of frames to which processing is applied from the stored images;
extracting correspondence between the plurality of images;
inputting the three-dimensional model to be a base;
storing the input three-dimensional model;
selecting the three-dimensional model that defines geometric properties of a target object in the images;
specifying correspondence between the images and the three-dimensional model;
deforming the three-dimensional model while satisfying both the obtained correspondence between the images and the obtained correspondence between the images and the three-dimensional model;
generating a pattern image to be attached to a surface of the three-dimensional model, based on a shape of the final three-dimensional model obtained by the deforming, and the specified correspondence between the final three-dimensional model and the images; and
outputting the completed final three-dimensional model.
-
Specification