ALIGNMENT OF IMAGES OF A THREE-DIMENSIONAL OBJECT

• US 20170109888A1
• Filed: 10/20/2015
• Published: 04/20/2017
• Est. Priority Date: 10/20/2015
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: de Lima, Diogo S., Dibenedetto, Dante, Saranin, Arsenii, Sharma, Divya, Gerasimets, Ilya
• Granted Patent: US 10,447,999 B2
• Time in Patent Office: Days
• CPC Class Codes: G01S 17/00 Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 7/4808 Evaluating distance, position or velocity data
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 3/147 using affine transformations
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: H04N 13/257 Colour aspects

Abstract

In one example implementation, a system for aligning of images of a three-dimensional (3D) object includes a select engine to select a first image and a second image from a sequence of images of a 3D object taken at different object orientations from a capture cycle of a scanner, a combine engine to combine first metadata from the first image and second metadata from the second image to form combined metadata, an orientation engine to select a third image from the sequence of images, where the third image is from an opposite object orientation relative to a first object orientation of the first image or a second object orientation of the second image, and an align engine to align the sequence of images based on the combined metadata and third metadata from the third image.

Claims

1. A system, comprising:

a select engine to select a first image and a second image from a sequence of images of a three-dimensional (3D) object taken at different object orientations from a capture cycle of a scanner;

a combine engine to combine first metadata from the first image and second metadata from the second image to form combined metadata;

an orientation engine to select a third image from the sequence of images, wherein the third image is from an opposite object orientation relative to a first object orientation of the first image or a second object orientation of the second image; and

an align engine to align the sequence of images based on the combined metadata and third metadata from the third image.

2. The system of claim 1, wherein the first image and the second image are from adjacent object orientations.

3. The system of claim 1, comprising a model engine to generate a 3D model of the 3D object using the aligned sequence of images.

4. The system of claim 1, wherein the combined metadata includes metadata representative of respective geometries of the 3D object as viewed from the first object orientation and the second object orientation.

5. The system of claim 1, wherein the capture cycle comprises a sequence of at least six different object orientations.

6. The system of claim 1, wherein a total number of object orientations included in the capture cycle is an even number.

7. The system of claim 6, wherein the opposite object orientation is about 180 degrees of rotation along the capture cycle from the first object orientation or the second object orientation.

8. The system of claim 1, wherein the scanner includes:

a depth-sensor camera; and

a red, green, and blue (RGB) camera.

9. A non-transitory computer readable medium storing instructions executable by a processing resource to cause a computing device to:

receive a sequence of images of a three-dimensional (3D) object taken at different object orientations from a capture cycle of a scanner;

select a first image and a second image from a sequence of images;

combine metadata of the first image with metadata of the second image to form combined metadata;

select a third image from the sequence of images from an opposite object orientation relative to a first object orientation of the first image or a second object orientation of the second image;

align an image of the sequence of images based on the combined metadata and metadata of the third image; and

generate at least a portion of a 3D model of the 3D object using the aligned sequence of images.

10. The medium of claim 9, wherein the instructions to align include instructions to rotate and translate a point cloud of an image of the sequence of images by a rotation angle matrix determined based on the combined metadata and the metadata of the third image.

11. The medium of claim 9, wherein the instructions to select the first image and the second image include instructions to select two images from the sequence of images having a desired alignment.

12. A method, comprising:

receiving first metadata of a first image of a three-dimensional (3D) object at a first object orientation and second metadata of a second image of the 3D object at a second object orientation adjacent to the first object orientation along a sequence of object orientations corresponding to a sequence of images from a capture cycle of a scanner;

combining the second metadata and the second metadata to form combined metadata;

receiving third metadata from a third image of the 3D object at a third object orientation opposite from the first object orientation or the second object orientation; and

aligning the sequence of images to generate at least a portion of a 3D model of the 3D object based on the combined metadata and the third metadata.

13. The method of claim 12, comprising selecting the first image and the second image from the sequence of images from the capture cycle of the scanner.

14. The method of claim 12, comprising rotating the 3D object within a single plane at a fixed angle relative the scanner during the capture cycle.

15. The method of claim 12, further comprising aligning the sequence of images based on a pair of metadata that includes the combined metadata and the metadata of the third image without other metadata of other images included in the sequence of images.