Image processing apparatus, image processing method, and storage medium

• US 10,395,380 B2
• Filed: 01/23/2017
• Issued: 08/27/2019
• Est. Priority Date: 07/16/2014
• Status: Active Grant

• Current Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Original Assignee: Canon Ayutthaya Limited (Canon Inc.)
• Inventors: Otomaru, Itaru, Ishida, Takuya, Miyasa, Kazuhiro, Satoh, Kiyohide
• Primary Examiner(s): Wu, Jingge
• Application Number:
  US15/412,633
• Publication Number:
  US 20170132797A1
• Time in Patent Office: 946 Days
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 2207/20101 Interactive definition of point of interest, landmark or seed
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

First, a displacement field (first displacement field) for deforming a first image so as to associate the first image with a second image is calculated based on information on an input corresponding point group. Then, upon a corresponding point candidate pair being input, a displacement field (second displacement field) for deforming the first image so as to associate the first image with the second image is calculated with the corresponding point candidate pair taken into consideration as well. Thereafter, a matching degree is calculated based on a difference between the two displacement fields, and a determination result indicating a match or a mismatch is displayed on a display unit.

Claims

1. An information processing apparatus, comprising:

at least one processor coupled to at least one memory, the at least one processor being programmed to implement operations comprising;

acquiring a corresponding point group between a first image and a second image, wherein the corresponding point group includes a plurality of corresponding point pairs each of which is a pair of a point in the first image and a point in the second image associated with the point in the first image;

calculating a first displacement field between the first image and the second image using the corresponding point group, and calculating a second displacement field between the first image and the second image using a remaining corresponding point group excluding a corresponding point pair selected from the corresponding point group;

calculating a matching degree of the corresponding point pair with respect to the remaining corresponding point group based on the first displacement field and the second displacement field; and

repeating the calculation of the first displacement field using the corresponding point group, and the second displacement field using the remaining corresponding point group excluding the corresponding point pair selected from the corresponding point group, and the calculation of the matching degree, until all the corresponding point pairs from the corresponding point group are selected.

2. The information processing apparatus according to claim 1,

wherein the matching degree is calculated based on a difference between the first displacement field and the second displacement field.

3. The information processing apparatus according to claim 1, wherein the operations further comprises:

determining whether or not the corresponding point pair match the remaining corresponding point group based on the matching degree of the corresponding point pair.

4. The information processing apparatus according to claim 3, wherein the operations further comprises:

causing a display unit to display a result of the determining.

5. The information processing apparatus according to claim 1, wherein the acquiring includes acquiring the remaining corresponding point group,

wherein the calculating includes calculating a matching degree of the remaining corresponding point group.

6. An information processing method comprising:

acquiring a corresponding point group between a first image and a second image, wherein the corresponding point group includes a plurality of corresponding point pairs each of which is a pair of a point in the first image and a point in the second image associated with the point in the first image;

calculating a first displacement field between the first image and the second image using the corresponding point group, and calculating a second displacement field between the first image and the second image using a remaining corresponding point group excluding a corresponding point pair selected from the corresponding point group;

calculating a matching degree of the corresponding point pair with respect to the remaining corresponding point group based on the first displacement field and the second displacement field; and

repeating the calculation of the first displacement field using the corresponding point group, and the second displacement field using the remaining corresponding point group excluding the corresponding point pair selected from the corresponding point group, and the calculation of the matching degree, until all the corresponding point pairs from the corresponding point group are selected.

7. An information processing system comprising:

at least one processor coupled to at least one memory, the at least one processor being programmed to implement operations comprising;

acquiring a corresponding point group between a first image and a second image, wherein the corresponding point group includes a plurality of corresponding point pairs each of which is a pair of a point in the first image and a point in the second image associated with the point in the first image;

calculating a first displacement field between the first image and the second image using the corresponding point group, and calculating a second displacement field between the first image and the second image using a remaining corresponding point group excluding a corresponding point pair selected from the corresponding point group;

calculating a matching degree of the corresponding point pair with respect to the remaining corresponding point group based on the first displacement field and the second displacement field; and

repeating the calculation of the first displacement field using the corresponding point group, and the second displacement field using the remaining corresponding point group excluding the corresponding point pair selected from the corresponding point group, and the calculation of the matching degree, until all the corresponding point pairs from the corresponding point group are selected.

8. An information processing apparatus, comprising:

at least one processor coupled to at least one memory, the at least one processor being programmed to implement operations comprising;

acquiring a corresponding point group between a first image and a second image, wherein the corresponding point group includes a plurality of corresponding point pairs each of which is a pair of a point in the first image and a point in the second image associated with the point in the first image;

calculating a first displacement field between the first image and the second image using the corresponding point group, and calculating a second displacement field between the first image and the second image using a remaining corresponding point group excluding a corresponding point pair sequentially selected from the corresponding point group;

calculating a matching degree of the corresponding point pair with respect to the remaining corresponding point group based on the first displacement field and the second displacement field; and

determining whether the corresponding point pairs selected from the corresponding point group match, based on the matching degree.

9. An information processing method comprising:

acquiring a corresponding point group between a first image and a second image, wherein the corresponding point group includes a plurality of corresponding point pairs each of which is a pair of a point in the first image and a point in the second image associated with the point in the first image;

calculating a first displacement field between the first image and the second image using the corresponding point group, and calculating a second displacement field between the first image and the second image using a remaining corresponding point group excluding a corresponding point pair sequentially selected from the corresponding point group;

calculating a matching degree of the corresponding point pair with respect to the remaining corresponding point group based on the first displacement field and the second displacement field; and

determining whether the corresponding point pairs selected from the corresponding point group match, based on the matching degree.