Device for acquiring information relating to position displacement of multiple image data sets, method, and program

• US 10,445,897 B2
• Filed: 07/04/2016
• Issued: 10/15/2019
• Est. Priority Date: 07/09/2015
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Ishikawa, Ryo
• Primary Examiner(s): Jia, Xin
• Application Number:
  US15/742,336
• Publication Number:
  US 20180204349A1
• Time in Patent Office: 1,198 Days
• CPC Class Codes: A61B 5/0095 by applying light and detecting acoustic waves, i.e. photoacoustic measurements
• CPC Class Codes: A61B 5/7207 of noise induced by motion artifacts
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

An apparatus includes a first acquisition unit acquiring first multiple image data sets, a second acquisition unit acquiring first composited image data using first two or more image data sets of the first multiple image data sets, a third acquisition unit acquiring second composited volume data, using second two or more image data sets of the first multiple image data sets, the second two or more image data sets different from the first two or more image data sets, a fourth acquisition unit acquiring information relating to positional displacement between the first the second composited volume data, using the first the second composited image data, and a fifth acquisition unit acquiring information relating to positional displacement of the first multiple of image data sets, using information relating to the positional displacement between the first the second composited image data.

Claims

1. An apparatus comprising:

a first acquisition unit configured to acquire a first plurality of image data sets;

a second acquisition unit configured to acquire first composited image data using a first two or more image data sets of the first plurality of image data sets;

a third acquisition unit configured to acquire second composited image data, using a second two or more image data sets of the first plurality of image data sets, the second two or more image data sets being a combination different from the first two or more image data sets;

a fourth acquisition unit configured to acquire information relating to positional displacement between the first composited image data and the second composited image data, using the first composited image data and the second composited image data; and

a fifth acquisition unit configured to acquire information relating to positional displacement of the first plurality of image data sets, using information relating to the positional displacement between the first composited image data and the second composited image data.

2. The apparatus according to claim 1, further comprising:

a sixth acquisition unit configured to acquire third composited image data, by positioning the first plurality of image data sets using information relating to the positional displacement of the first plurality of image data sets.

3. The apparatus according to claim 1, further comprising:

a reception unit configured to receive acoustic waves generated from an object by being irradiated by light a plurality of times; and

a signal acquisition unit configured to acquire a plurality of signals corresponding to the plurality of times of irradiation by light, output by the receiving unit having received the acoustic waves;

wherein the first acquisition unit acquires the first plurality of image data sets using the plurality of signals.

4. The apparatus according to claim 3,

wherein the second acquisition unit selects, from the first plurality of image data sets, the first two or more image data sets corresponding to two or more irradiations by light performed during a first period,

and wherein the third acquisition unit selects, from the first plurality of image data sets, the second two or more image data sets corresponding to two or more irradiations by light performed during a second period that is different form the first period.

5. The apparatus according to claim 4,

wherein the second acquisition unit selects, from the plurality of image data sets, the first two or more image data sets corresponding to two or more irradiations by light performed temporally consecutively within the first period,

and wherein the third acquisition unit selects, from the plurality of image data sets, the second two or more image data sets corresponding to two or more irradiations by light performed temporally consecutively within the second period.

6. The apparatus according to claim 4, further comprising:

a sixth acquisition unit configured to acquire third composited image data, by positioning the first plurality of image data sets using information relating to the positional displacement of the first plurality of image data sets,

wherein the second acquisition unit

acquires information relating to image quality of the third composited image data, using the third composited image data, and

selects the first two or more image data sets from the plurality of image data sets, using information relating to image quality of the third composited image data.

7. The apparatus according to claim 3, further comprising:

a seventh acquisition unit configured to acquire information relating to the position of the reception unit during the plurality of times of irradiation by light, using information relating to positional displacement of the first plurality of image data sets, and acquire image data using the information relating to position and the plurality of signals.

8. The apparatus according to claim 7,

wherein the seventh acquisition unit

acquires a second plurality of image data sets corresponding to the plurality of times of irradiation by light, using the information relating to position and the plurality of signals, and

acquires the image data by positioning the second plurality of image data sets.

9. The apparatus according to claim 1,

wherein the fifth acquisition unit performs interpolation processing regarding information relating to positional displacement between the first composited image data and the second composited image data, to acquire information relating to positional displacement of the plurality of image data sets.

10. The apparatus according to claim 1,

wherein the second acquisition unit and the third acquisition unit select the first two or more image data sets and the second two or more image data sets such that the first composited image data and the second composited image data overlap.

11. The apparatus according to claim 1,

wherein the fourth acquisition unit

acquires a reliability of a similarity function representing a relationship between a relative position between the first composited image data and the second composited image data, and a similarity between the first composited image data and the second composited image data, and

acquires information relating to positional displacement between the first composited image data and the second composited image data, using the reliability of the similarity function.

12. The apparatus according to claim 11,

wherein the fourth acquisition unit acquires an acutance of the similarity function at the relative position where the similarity is largest, as the reliability of the similarity function.

13. The apparatus according to claim 11,

wherein the fourth acquisition unit acquires a secondary differentiation of the similarity function at the relative position where the similarity is largest, as the reliability of the similarity function.

14. The apparatus according to claim 11,

wherein the fourth acquisition unit acquires information relating to position of the plurality of image data sets where a cost function is smallest, the cost function defined by weighting by the reliability of the similarity an evaluation function based on difference between the relative position as an argument and the relative position where the similarity is the greatest.

15. The apparatus according to claim 1, further comprising:

a light irradiation unit; and

a reception unit configured to output signals by receiving acoustic waves generated from an object that has been irradiated by light from the light irradiation unit,

wherein the light irradiation unit irradiates the object with light a plurality of times,

wherein the reception unit outputs a plurality of signals corresponding to the plurality of irradiations by light, by receiving photoacoustic waves generated from the object from the plurality of times of irradiation by light,

wherein the first acquisition unit acquires a plurality of image data sets of the object corresponding to the plurality of times of irradiation by light, based on the plurality of signals,

wherein the second acquisition unit selects, from the plurality of image data sets, the first two or more image data sets corresponding to the two or more irradiations by light performed during the first period,

and wherein the third acquisition unit selects, from the plurality of image data sets, the second two or more image data sets corresponding to the two or more irradiations by light performed during the second period that is different from the first period.

16. The apparatus according to claim 15, further comprising:

a driving unit configured to move the reception unit during a period where the plurality of irradiations by light are performed.

17. The apparatus according to claim 16,

wherein the first acquisition unit acquires the first plurality of image data sets, by acquiring image data in a region larger than the amount of movement of the reception unit during an interval of time of irradiation by light, using signals corresponding to irradiation by light for one time.

18. A method comprising:

acquiring a first plurality of image data sets;

acquiring first composited image data using a first two or more image data sets of the first plurality of image data sets;

acquiring second composited image data, using a second two or more image data sets of the first plurality of image data sets, the second two or more image data sets being a combination different from the first two or more image data sets;

acquiring information relating to positional displacement between the first composited image data and the second composited image data, using the first composited image data and the second composited image data; and

acquiring information relating to positional displacement of the first plurality of image data sets, using information relating to the positional displacement between the first composited image data and the second composited image data.

19. A non-transitory computer-readable storage medium storing a program to execute a method, the method comprising:

acquiring a first plurality of image data sets;

acquiring first composited image data using a first two or more image data sets of the first plurality of image data sets;

acquiring second composited image data, using a second two or more image data sets of the first plurality of image data sets, the second two or more image data sets being a combination different from the first two or more image data sets;

acquiring information relating to positional displacement between the first composited image data and the second composited image data, using the first composited image data and the second composited image data; and

acquiring information relating to positional displacement of the first plurality of image data sets, using information relating to the positional displacement between the first composited image data and the second composited image data.