Method and system for providing a volumetric representation of a three-dimensional object

• US 7,327,362 B2
• Filed: 09/28/2005
• Issued: 02/05/2008
• Est. Priority Date: 09/28/2004
• Status: Active Grant

• Current Assignee: British Broadcasting Corporation
• Original Assignee: British Broadcasting Corporation
• Inventors: Grau, Oliver
• Primary Examiner(s): Nguyen; Kimbinh T.
• Application Number:
  US11/238,119
• Publication Number:
  US 20060066614A1
• Time in Patent Office: 860 Days
• Field of Search: 345/419, 345/423, 345/424, 345/427, 382/103
• US Class Current: 345/423
• CPC Class Codes: G06T 17/005 Tree description, e.g. octree, quadtree
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 2207/20016 Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
• CPC Class Codes: G06T 7/564 from contours
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

A method of providing a volumetric representation of a three dimensional object includes defining a plurality of voxels in a three dimensional space, categorizing voxels as foreground or background according to at least one silhouette image of the object, foreground voxels being assigned a first binary value, and background voxels being assigned a second binary value, and assigning to at least some voxels a value intermediate between the first and second binary values.

Claims

1. A method of providing a volumetric representation of a three dimensional object, comprising:

defining a plurality of voxels in a three dimensional space,

categorizing voxels as foreground or background according to at least one silhouette image of the object, foreground voxels being assigned a first binary value, and background voxels being assigned a second binary value,

assigning to at least some voxels a value intermediate to the first and second binary values; and

at least in part on the basis of the assigned value, outputting data representative of the three-dimensional object.

2. The method of claim 1, wherein the intermediate value is based on an estimate the ratio of foreground to background contained within the voxel.

3. The method of claim 2, wherein the estimate is derived by dividing the voxel into volume fractions, assigning volume fractions as background or foreground, and forming a fractional sum.

4. The method of claim 2, wherein the estimate is derived by projecting the voxel onto the silhouette image, assigning areas of the projection as foreground or background, and taking an area ratio.

5. The method of claim 1, wherein voxels are defined by a recursive division algorithm.

6. The method of claim 5, wherein the dividing into volume fractions comprises performing one or more additional stages of the recursive division algorithm.

7. The method of claim 1, wherein the intermediate values are used by a marching cubes algorithm to produce a 3D surface.

8. A method of providing a volumetric representation of a three dimensional object, in which a three dimensional space is comprised of a plurality of voxels, and wherein voxels are categorized as foreground or background according to at least one silhouette image of the object, the method comprising:

subsampling the at least one silhouette image,

comparing a projection of at least one voxel with the sub-sampled image to categorize the voxel; and

outputting data representative of the comparison.

9. The method of claim 8, further comprising, for at least one silhouette image, storing a plurality of equivalent images at different resolutions.

10. The method of claim 9, wherein for each projection, an image from the plurality of equivalent images is selected for comparison.

11. The method of claim 10, wherein one of the plurality of equivalent images is selected according to the size of the voxel.

12. The method of claim 8, wherein subsampling maintains the aspect ratio of the at least one silhouette image.

13. The method of claim 8, wherein subsampling is by a factor of 2.

14. A method of providing a volumetric representation of a three dimensional object as the intersection of generalized cones of at least one silhouette image of that object, the method comprising

deriving one or more geometry parameters in dependence on the geometry of the intersections of the generalized cones,

selectively removing volume from the representation in dependence on the geometry parameters;

and

outputting data representative of the representation from which the volume has been selectively removed.

15. The method of claim 14, wherein the one or more geometry parameters includes the length of the intersection.

16. The method of claim 14, wherein the one or more geometry parameters includes the distance of that volume from the intersection.

17. The method of claim 14, wherein the one or more geometry parameters includes the angle of intersection.

18. The method of claim 14, further comprising selecting a set of surface points on the representation in dependence on distance to the nearest intersection, fitting a spline function to the set of points, and removing volume based on the spline function.

19. A method of providing a volumetric representation of a three dimensional object, in which a three dimensional space is comprised of a plurality of voxels, and wherein voxels are categorized as foreground or background according to at least one silhouette image of the object, the method comprising:

representing the object over a period of time as a 4D model defining a hyper-surface,

applying a smoothing operator to the 4D hyper-surface; and

outputting data representative of the three dimensional object at least in part on the basis of the smoothed 4D hyper surface.

20. The method of claim 19, wherein the 4D model reduces the variation with time of a 3D parameter of the object.

21. The method of claim 19, wherein the 4D model reduces the variation with time of the volume of the object.

22. A manufacture comprising a computer software product for providing a volumetric representation of a three-dimensional object the product comprising a computer readable medium in which program instructions are stored, the instructions, when read by a computer, causing the computer to

define a plurality of voxels in a three dimensional space,

categorize voxels as foreground or background according to at least one silhouette image of the object, foreground voxels being assigned a first binary value, and background voxels being assigned a second binary value, and

assign to at least some voxels a value intermediate the first and second binary values.