Image processing apparatus, image processing method, and program

• US 9,275,473 B2
• Filed: 12/10/2013
• Issued: 03/01/2016
• Est. Priority Date: 06/16/2011
• Status: Active Grant

• Current Assignee: Evident Corporation
• Original Assignee: Olympus Corporation
• Inventors: Hori, Fumio
• Primary Examiner(s): CHAUHAN, ULKA J
• Assistant Examiner(s): Mazumder, Saptarshi
• Application Number:
  US14/102,455
• Publication Number:
  US 20140098091A1
• Time in Patent Office: 812 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10068 Endoscopic image
• CPC Class Codes: G06T 2207/20101 Interactive definition of point of interest, landmark or seed
• CPC Class Codes: G06T 2207/30164 Workpiece; Machine component
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume

Abstract

An image processing apparatus includes a display unit that displays an image of a measurement object and an image of an object which corresponds to the measurement object and has a 3-dimensional (3D) shape which is calculated in advance, a designating unit that designates a first point on the image of the measurement object and a second point on the image of the object, a calculating unit that performs a geometric calculation of a first figure, an adjusting unit that adjusts a pose or a position of at least one of the image of the measurement object and the image of the object based on a result of the geometric calculation, and a measuring unit that calculates spatial coordinates on the object corresponding to a measurement position designated after the pose or the position is adjusted, and calculates a size of the object based on the calculated spatial coordinates.

Claims

1. An image processing apparatus, comprising:

a display unit configured to display an image of a measurement object and an image of an object which corresponds to the measurement object and has a 3-dimensional (3D) shape which is calculated in advance;

a designating unit configured to designate first points on the image of the measurement object and second points on the image of the object having the 3D shape based on an instruction input through an input device, the first points including three or more points, and the second points including three or more points;

a calculating unit configured to perform a calculation of a rotational angle by which an angle of view of at least one of the image of the measurement object and the image of the object having the 3D shape is to be adjusted to thereby adjust a pose or a position of said at last one of the image of the measurement object and the image of the object having the 3D shape, wherein the calculating unit performs the calculation of the rotational angle by performing a geometric calculation to achieve a minimum difference between (i) a first vertex angle included in a first figure formed by the first points designated on the image of the measurement object and (ii) a second vertex angle included in a second figure formed by the second points designated on the image of the object having the 3D shape, wherein the second vertex angle in the second figure corresponds to the first vertex angle in the first figure;

an adjusting unit configured to adjust the pose or the position of said at least one of the image of the measurement object and the image of the object having the 3D shape at least by adjusting the angle of view by the rotational angle that achieves the minimum difference between the first vertex angle and the second vertex angle, according to a result of the geometric calculation; and

a measuring unit configured to calculate spatial coordinates on the object corresponding to a measurement position designated based on an instruction input through the input device after the pose or the position is adjusted, and to calculate a size of the measurement object based on the calculated spatial coordinates.

2. The image processing apparatus according to claim 1, wherein the calculating unit performs the geometric calculation such that the first points are associated with the second points based on an order in which the first points are designated and an order in which the second points are designated.

3. The image processing apparatus according to claim 1, wherein the designating unit further sets a transparency of the image of the object having the 3D shape such that when the first points are designated, the transparency of the image of the object having the 3D shape is set to be higher than the transparency of the image of the object having the 3D shape which is set when the second points are designated.

4. The image processing apparatus according to claim 1, wherein the display unit maintains poses and positions of the image of the measurement object and the image of the object having the 3D shape until the geometric calculation ends after displaying the image of the measurement object and the image of the object having the 3D shape, and re-displays the image of the measurement object and the image of the object having the 3D shape whose pose or position has been adjusted after the geometric calculation ends.

5. The image processing apparatus according to claim 1, wherein the calculating unit performs the calculation of the rotational angle by performing the geometric calculation to achieve a minimum average of the difference between the first vertex angle and the second vertex angle corresponding to the first vertex angle.

6. The image processing apparatus according to claim 1,

wherein the angle of view is rotated according to the calculated rotational angle in at least one of a pan direction and a tilt direction, and

wherein the pose or the position of said at least one of the image of the measurement object and the image of the object having the 3D shape is adjusted in accordance with the angle of view which is rotated in said at least one of the pan direction and the tilt direction according to the rotational angle.

7. The image processing apparatus according to claim 1,

wherein the calculating unit further performs a calculation of a second rotational angle by performing a geometric calculation to achieve a minimum difference between a first relative angle and a second relative angle corresponding to the first relative angle,

wherein the first relative angle is an angle formed by the first figure with respect to a predetermined direction and the second relative angle is an angle formed by the second figure with respect to the predetermined direction,

wherein the angle of view is rotated according to the calculated second rotational angle in a roll direction, and

wherein the pose or the position of said at least one of the image of the measurement object and the image of the object having the 3D shape is adjusted in accordance with the angle of view which is rotated in the roll direction.

8. An image processing method, comprising:

displaying, on a display, an image of a measurement object and an image of an object which corresponds to the measurement object and has a 3-dimensional (3D) shape which is calculated in advance;

designating first points on the image of the measurement object and second points on the image of the object having the 3D shape based on an instruction input through an input device, the first points including three or more points, and the second points including three or more points;

performing a calculation of a rotational angle by which an angle of view of at least one of the image of the measurement object and the image of the object having the 3D shape is to be adjusted to thereby adjust a pose or a position of said at last one of the image of the measurement object and the image of the object having the 3D shape, wherein the calculation of the rotational angle is performed by performing a geometric calculation to achieve a minimum difference between (i) a first vertex angle included in a first figure formed by the first points designated on the image of the measurement object and (ii) a second vertex angle included in a second figure formed by the second points designated on the image of the object having the 3D shape, wherein the second vertex angle in the second figure corresponds to the first vertex angle in the first figure;

adjusting the pose or the position of said at least one of the image of the measurement object and the image of the object at least by adjusting the angle of view by the rotational angle that achieves the minimum difference between the first vertex angle and the second vertex angle, according to a result of the geometric calculation; and

calculating spatial coordinates on the object corresponding to a measurement position designated based on an instruction input through the input device after the pose or the position is adjusted, and calculating a size of the measurement object based on the calculated spatial coordinates.