Three-dimensional shape data processing apparatus and three-dimensional shape data processing method

• US 8,712,016 B2
• Filed: 12/17/2009
• Issued: 04/29/2014
• Est. Priority Date: 12/26/2008
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Endo, Takaaki, Uchiyama, Shinji
• Primary Examiner(s): SONG, HOON K
• Application Number:
  US12/640,285
• Publication Number:
  US 20100166280A1
• Time in Patent Office: 1,594 Days
• Field of Search: 382/131, 378/21, 378 4- 20
• US Class Current: 378/131
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

A three-dimensional shape data processing apparatus includes a data input unit configured to input data of a first tomographic image group including a plurality of tomographic images and data of a second tomographic image group including a plurality of tomographic images, wherein at least a part of an image capturing area of the second tomographic image group is overlapped with at least a part of an image taking area of the first tomographic image groups, and a combination unit configured to combine first three-dimensional shape data and second three-dimensional shape data into one piece of three-dimensional shape data according to an estimated accuracy estimated values of the first and second three-dimensional shape data at a plurality of positions.

Claims

1. A three-dimensional data processing apparatus comprising:

a data input unit configured to input data of a first tomographic image group including a plurality of tomographic images and data of a second tomographic image group including a plurality of tomographic images, wherein at least a part of an image capturing area of the second tomographic image group is overlapped with at least a part of an image capturing area of the first tomographic image group;

an estimation unit configured to estimate accuracy values at each of a plurality of points related to the first tomographic image group and the second tomographic image group, based on a first direction of at least a part of the tomographic images included in the first tomographic image group and a second direction of at least a part of the tomographic images included in the second tomographic image group, wherein the first direction differs from the second direction; and

a combination unit configured to combine the first tomographic image group and the second tomographic image group into one piece of three-dimensional data based on the accuracy values estimated by the estimation unit.

2. The three-dimensional data processing apparatus according to claim 1, wherein the first three-dimensional data and second three-dimensional data is volume data.

3. The three-dimensional data processing apparatus according to claim 1, wherein the combination unit is configured to extract a characteristic point from the first three-dimensional data and the second three-dimensional data, and execute the combination processing according to association between the extracted characteristic points.

4. The three-dimensional data processing apparatus according to claim 1,

wherein the restoration unit is configured to restore first luminance value arrangement data as the first three-dimensional data and second luminance value arrangement data as the second three-dimensional data,

wherein the estimation unit is configured to estimate accuracy values at each of a plurality of points inside the first and second luminance value arrangement data, and

wherein the combination unit is configured to generate data of a first surface shape model based on the first luminance value arrangement data, generate data of a second surface shape model based on the second luminance value arrangement data, and combine the data of the first and second surface shape models based on the estimated accuracy values to generate one piece of surface shape model data corresponding to the one piece of three-dimensional data.

5. The three-dimensional data processing apparatus according to claim 4, wherein the combination unit is configured, in combining the data of the first and second surface shape models, to deform each of surface shape model data so that a shape of a surface of the first and second surface shape model data becomes substantially the same as each other based on the estimated accuracy values, and combine the deformed surface shape model data into one piece of surface shape model data.

6. The three-dimensional data processing apparatus according to claim 1, wherein the estimation unit is configured to estimate the accuracy values based on capturing time difference between adjacent pixels of each of the plurality of tomographic images, and a measurement error that occurs in measuring a position and orientation of each of the tomographic images.

7. The three-dimensional data processing apparatus according to claim 1, wherein the data of the first and second tomographic image groups are acquired by an optical coherence tomography.

8. The three-dimensional data processing apparatus according to claim 1, wherein the data of the first and second tomographic image groups are acquired by an ultrasonic image diagnostic apparatus.

9. The three-dimensional data processing apparatus according to claim 1, wherein a normal direction of at least a part of the first tomographic image group is different from a normal direction of at least a part of the second tomographic image group by an angle of approximately 90 degrees.

10. A three-dimensional data processing method comprising:

inputting data of a first tomographic image group including a plurality of tomographic images and data of a second tomographic image group including a plurality of tomographic images, wherein at least a part of an image capturing area of the second tomographic image group is overlapped with at least a part of an image capturing area of the first tomographic image group;

estimating accuracy values at each of a plurality of points related to the first tomographic image group and the second tomographic image group, based on a first direction of at least a part of the tomographic images included in the first tomographic image group and a second direction of at least a part of the tomographic images included in the second tomographic image group, wherein the first direction differs from the second direction; and

combining the first tomographic image group and the second tomographic image group into one piece of three-dimensional data based on the accuracy values estimated by the estimation step.

11. A computer-readable storage medium storing computer-executable instructions which, when executed by a computer, cause the computer to perform three-dimensional data processing operations comprising:

inputting data of a first tomographic image group including a plurality of tomographic images and data of a second tomographic image group including a plurality of tomographic images, wherein at least a part of an image taking area of the second tomographic image group is overlapped with at least a part of an image taking area of the first tomographic image groups;

estimating accuracy values at each of a plurality of points related to the first tomographic image group and the second tomographic image group, based on a first direction of at least a part of the tomographic images included in the first tomographic image group and a second direction of at least a part of the tomographic images included in the second tomographic image group, wherein the first direction differs from the second direction; and

combining the first tomographic image group and the second tomographic image group into one piece of three-dimensional data based on the accuracy values estimated by the estimation step.

12. A three-dimensional data processing apparatus comprising:

a data input unit configured to input data of a first image group including a plurality of tomographic images and data of a second image group including a plurality of tomographic images, wherein at least a part of an image capturing area of the second image group is overlapped with at least a part of an image capturing area of the first image group;

an estimation unit configured to estimate accuracy values at each of a plurality of points related to the first image group and the second image group, based on a first direction of at least a part of the images included in the first image group and a second direction of at least a part of the images included in the second image group, wherein the first direction differs from the second direction; and

a combination unit configured to combine the first image group and the second image group into one piece of three-dimensional data based on the accuracy values estimated by the estimation unit.

13. A three-dimensional data processing apparatus comprising:

a data input unit configured to input data of a first tomographic image group including a plurality of tomographic images and data of a second tomographic image group including a plurality of tomographic images, wherein at least a part of an image capturing area of the second tomographic image group is overlapped with at least a part of an image capturing area of the first tomographic image group, and wherein first direction of at least a part of the tomographic images included in the first tomographic image group differs from second direction of at least a part of the tomographic images included in the second tomographic image group;

an estimation unit configured to estimate accuracy values at each of a plurality of points related to the first image group and second image group; and

a combination unit configured to combine the first tomographic image group and the second tomographic image group into one piece of three-dimensional data based on the accuracy values estimated by the estimation unit.

14. A three-dimensional data processing method comprising:

inputting data of a first tomographic image group including a plurality of tomographic images and data of a second tomographic image group including a plurality of tomographic images, wherein at least a part of an image capturing area of the second tomographic image group is overlapped with at least a part of an image capturing area of the first tomographic image group, and wherein first direction of at least a part of the tomographic images included in the first tomographic image group differs from second direction of at least a part of the tomographic images included in the second tomographic image group;

estimating accuracy values at each of a plurality of points related to the first image group and second image group; and

combining the first tomographic image group and the second tomographic image group into one piece of three-dimensional data based on the accuracy values estimated by the estimating step.

15. A computer-readable storage medium storing computer-executable instructions which, when executed by a computer, cause the computer to perform three-dimensional data processing operations comprising:

inputting data of a first tomographic image group including a plurality of tomographic images and data of a second tomographic image group including a plurality of tomographic images, wherein at least a part of an image capturing area of the second tomographic image group is overlapped with at least a part of an image capturing area of the first tomographic image group, and wherein first direction of at least a part of the tomographic images included in the first tomographic image group differs from second direction of at least a part of the tomographic images included in the second tomographic image group;

estimating accuracy values at each of a plurality of points related to the first image group and second image group; and

combining the first tomographic image group and the second tomographic image group into one piece of three-dimensional data based on the accuracy values estimated by the estimating step.