Simple techniques for three-dimensional modeling

• US 8,571,698 B2
• Filed: 01/28/2009
• Issued: 10/29/2013
• Est. Priority Date: 01/28/2008
• Status: Active Grant

• Current Assignee: Netvirta, LLC
• Original Assignee: Netvirta, LLC
• Inventors: Chen, Jian, Eow, Andy, Ma, Xiaoxu
• Primary Examiner(s): Worrell, Danny
• Application Number:
  US12/864,870
• Publication Number:
  US 20100319100A1
• Time in Patent Office: 1,735 Days
• Field of Search: 700/118, 700/131, 700/132, 700/130, 700/135, 382/111, 382/108, 382/195, 382/204
• US Class Current: 700/135
• CPC Class Codes: G01B 11/2513 with several lines being projected in more than one direction, e.g. grids, patterns
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30208 Marker matrix
• CPC Class Codes: G06T 7/579 from motion
• CPC Class Codes: G16B 99/00 Subject matter not provided for in other groups of this subclass

Abstract

Techniques which employ structure-from-motion modeling techniques to produce 3-D models of any desired accuracy of any surface I the techniques, a pattern is applied to the surface to be modeled The pattern includes elements which are unique within the pattern as applied to the surface and which have a density in the pattern such that when two-dimensional images are made of the surface, correlatable features having the density required for the desired accuracy may be extracted from the two dimensional images In one example of the techniques, a consumer may make the images required to produce a model of his or her body by donning a garment with a pattern having the necessary uniqueness and density, and then using any digital camera to take pictures of their body wearing the garment The model may then be produced from the pictures.

Claims

1. A method of obtaining a set of images from which a three-dimensional model of a surface may be made, the method comprising the steps of:

applying a covering having a pattern to the surface to be modeled, the pattern of the covering as applied to the surface including locally non-repetitive pattern elements that have a uniqueness within the surface; and

making the set of images of the surface after the covering has been applied, the pattern elements being perceptible in the images, features needed to make the model being extractable from the perceptible pattern elements, and the uniqueness of the perceptible pattern elements being used to correlate the extracted features.

2. The method set forth in claim 1 wherein:

the three-dimensional model is required to have a particular accuracy; and

the pattern'"'"'s elements have a density in the pattern such that the features that are extractable from the perceptible pattern elements have a density in the model which is sufficient give the three-dimensional model the particular accuracy.

3. The method set forth in claim 2 wherein:

the three-dimensional model includes submodels that are required to have different particular accuracies; and

the pattern is applied to the surface such that the densities of the pattern'"'"'s elements in the areas of the object corresponding to the submodels are sufficient to give the extracted features the particular accuracies in the submodels, wherein feature density in the pattern elements is higher in at least one of (a) areas corresponding with submodels where higher accuracy is needed than in areas corresponding with submodels where lower accuracy is needed and (b) areas corresponding with submodels having greater local curvature than in areas corresponding with submodels having lesser local curvature.

4. The method set forth in claim 1 wherein:

the image is made using a camera; and

in the step of making a set of images, information concerning the camera'"'"'s position relative to the surface when the image was made need not be associated with the image.

5. The method set forth in claim 4 wherein:

the images are made using an indication of favored camera locations for making the images.

6. The method set forth in claim 1 further comprising the step of:

providing a reference object for use in the step of making the images, the reference object appearing in an image of the set and indicating a scale of the model.

7. The method set forth in claim 1 wherein:

in the step of making the set of images, the surface to be modeled is in motion as the set of images is made; and

the three-dimensional model of the surface is a dynamic model.

8. The method set forth in claim 1 wherein:

the covering with the pattern is applied to the surface by conforming the covering with the pattern to the surface.

9. The method set forth in claim 1 wherein:

the surface to be modeled is a portion of a living entity'"'"'s body; and

the covering is a garment worn by the entity, the garment covering the portion of the body whose surface is to be modeled.

10. The method set forth in claim 9 further comprising the steps of:

receiving the garment; and

providing the set of images to a model making entity.

11. The method set forth in claim 10 wherein:

the step of making the set of images is performed using a camera to which a processor has access;

the processor and the model making entity have access to a network; and

the processor performs the step of providing the set of images to the model making entity via the network.

31. The method of claim 1, wherein the uniqueness of the pattern elements includes unique color combinations in the pattern elements.

12. A method of making a three-dimensional model of a surface from a set of images of the surface, the images in the set having been made of the surface after application of a covering having a pattern to the surface, the pattern as applied including locally non-repetitive pattern elements that have a uniqueness within the surface and the pattern elements being perceptible in the images of the set, the method comprising the steps of:

extracting the features needed to make the model from the perceptible pattern elements;

using the uniqueness of the perceptible pattern elements to correlate the extracted features; and

using the correlated extracted features to make the three-dimensional model.

13. The method set forth in claim 12 further comprising the step of:

making a use of the three-dimensional model.

14. The method set forth in claim 12 further comprising the step of:

providing the 3-dimensional model to a model using entity for a use.

15. The method set forth in claim 12 further comprising the steps of:

receiving information from a model using entity for a use; and

performing the use for the model using entity.

16. The method set forth in claim 12 wherein:

the use of the three-dimensional model is making a copy of the surface.

17. The method set forth in claim 12 wherein:

the use of the three-dimensional model of the surface is fitting an item to the surface.

18. The method set forth in claim 12 wherein:

the surface of which the model is to be made is a portion of a living entity'"'"'s body;

the covering is in the form of a garment; and

the pattern is applied to the surface by covering the portion with the garment that has the pattern and is worn by the entity.

19. The method set forth in claim 18 wherein:

the use of the three-dimensional model is fitting an item of clothing to the entity.

20. The method set forth in claim 18 wherein:

the use of the three-dimensional model is constructing an avatar of the entity.

21. The method set forth in claim 20 wherein:

the avatar represents the entity in a virtual world.

22. The method set forth in claim 20 wherein:

the avatar is used to display an item of merchandise for the avatar'"'"'s entity.

23. A storage medium which is accessible to a processor, the storage medium being characterized in that:

the storage medium includes code which, when executed by the processor, performs the method set forth claim 12.

30. The method of claim 12 further comprising the step of providing the covering having the pattern to a user for applying to the surface to be modeled.

24. A covering for use in making a three-dimensional model of a surface from images of the surface as covered by the covering,

the covering being characterized in that:

the covering is conformable to the surface to be modeled;

the covering has a pattern which includes locally non-repetitive pattern elements having a uniqueness within the surface as covered, the pattern elements being perceptible in the images, features needed to make the model being extractable from the perceptible pattern elements. and the uniqueness of the perceptible pattern elements being used to correlate the extracted features.

25. The covering set forth in claim 24 wherein:

the surface of which the model is to be made is a portion of a living entity'"'"'s body; and

the covering is a garment worn by the entity, the garment covering the portion of the body whose surface is to be modeled.

26. A kit for use in making a set of images from which a three-dimensional model of a surface may be made, the kit comprising:

a covering that is conformable to the surface to be modeled and that has a pattern which includes pattern elements having a uniqueness within the surface as covered by the covering, the pattern elements being perceptible in the images, features needed to make the model being extractable from the perceptible pattern elements, and the uniqueness of the perceptible pattern elements being used to correlate the extracted features; and

at least one aid to making the set of images.

27. The kit set forth in claim 26 wherein:

the images are made without precise calibration of camera location; and

the aid is an indication of favored camera locations for making the images.

28. The kit set forth in claim 26 wherein:

the aid is a reference object for use in making the images, the reference object appearing in an image of the set and indicating a scale of the model.

29. The kit set forth in claim 28 wherein:

the reference object is a component of the covering.