Image processing apparatus, image processing method, and computer-readable recording medium

• US 8,620,042 B2
• Filed: 08/23/2011
• Issued: 12/31/2013
• Est. Priority Date: 08/24/2010
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Kitamura, Makoto, Kanda, Yamato, Matsuda, Takehiro, Kono, Takashi, Hirota, Masashi
• Primary Examiner(s): Carter, Aaron W
• Application Number:
  US13/215,599
• Publication Number:
  US 20120051654A1
• Time in Patent Office: 861 Days
• Field of Search: 382/103, 382/128, 382/131, 382/132, 382/173, 382/199, 382/266, 382/282
• US Class Current: 382/128
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/149 involving deformable models, e.g. active contour models

Abstract

An apparatus includes a calculating unit that calculates gradient strength of respective pixel values based on an intraluminal image, an extracting unit that extracts a closed region from the image, and a detecting unit that detects an abnormal portion of the closed region. The closed region satisfies conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with predetermined curvature or higher toward an inner side of the closed region. The extracting unit includes a setting unit that sets an initial closed region based on the gradient strength, an energy calculating unit that calculates values of types of energies based on an outer shape of the closed region and the gradient strength, and an energy weighted-sum calculating unit that calculates a weighted sum of the types of energy.

Claims

1. An image processing apparatus comprising:

a gradient strength calculating unit that calculates gradient strength of a pixel value of each pixel of an intraluminal image that is a captured image of an intralumen;

a closed region extracting unit that extracts a closed region from the intraluminal image, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with predetermined curvature or higher toward an inner side of the closed region; and

an abnormal portion detecting unit that detects an abnormal portion located inside the closed region,

wherein the closed region extracting unit includes

an initial closed region setting unit that sets an initial closed region having an initial shape of the closed region based on the gradient strength;

an energy calculating unit that calculates values of a plurality of types of energy that at least include energy determined based on an outer shape of the closed region and energy determined based on the gradient strength on the boundary of the closed region; and

an energy weighted-sum calculating unit that calculates a weighted sum of the plurality of types of energy,

the closed region is extracted by transforming the initial closed region based on the weighted sum, and

the initial closed region setting unit includes a range determining unit that determines a set range of the initial closed region based on the gradient strength.

2. The image processing apparatus according to claim 1, wherein the energy calculating unit includes

an internal energy calculating unit that calculates internal energy representing a smaller value as the shape of the closed region is smoother;

an image energy calculating unit that calculates image energy representing a smaller value as a value of the gradient strength on the boundary of the closed region is larger; and

an external energy calculating unit that calculates external energy representing a smaller value as a size of the closed region is larger, and

wherein the closed region extracting unit extracts the closed region by transforming the initial closed region such that a weighted sum of at least two of the internal energy, the image energy, and the external energy is a minimum.

3. The image processing apparatus according to claim 1, wherein the range determining unit includes a flat area extracting unit that extracts a flat area made up of a plurality of pixels of which values of the gradient strength are close to one another from the intraluminal image and determines the set range within the flat area.

4. The image processing apparatus according to claim 3, wherein the range determining unit includes an area shape information calculating unit that calculates shape information of the flat area and determines the set range based on the shape information of the flat area.

5. The image processing apparatus according to claim 4, wherein

the area shape information calculating unit includes

a central line calculating unit that calculates a central line of the flat area;

and

a curvature calculating unit that calculates curvature of the central line, and

sets the curvature of the central line as the shape information of the flat area.

6. The image processing apparatus according to claim 1, wherein the range determining unit includes an edge extracting unit that extracts pixels of which the gradient strength is a predetermined value or higher from the each pixel of the intraluminal image as an edge and determines the set range based on the edge.

7. The image processing apparatus according to claim 6, wherein the range determining unit includes

an end point detecting unit that detects an end point of the edge;

and

a direction calculating unit that calculates a direction of the edge that is continuous to the end point as an end point direction, and determines the set range based on the end point direction.

8. The image processing apparatus according to claim 6, wherein the range determining unit includes a distance image calculating unit that calculates a distance image representing a distance from the edge and determines the set range based on the distance image.

9. The image processing apparatus according to claim 8, wherein the initial closed region setting unit sets the initial closed region at a position at which a pixel value is large based on pixel values of pixels, which are located in the set range, in the distance image.

10. The image processing apparatus according to claim 8, wherein the initial closed region setting unit includes a closed region size determining unit that determines a size of the initial closed region based on pixel values of the pixels, which are located in the set range, in the distance image.

11. The image processing apparatus according to claim 8, wherein the range determining unit includes a ridge detecting unit that detects a ridge of the distance image and determines the set range based on the ridge.

12. The image processing apparatus according to claim 11, wherein the initial closed region setting unit sets the initial closed region at a position at which a pixel value is large based on pixel values of the pixels located on the ridge included in the set range in the distance image.

13. The image processing apparatus according to claim 11, wherein the range determining unit includes a ridge shape information calculating unit that calculates shape information of the ridge and determines the set range based on the shape information of the ridge.

14. The image processing apparatus according to claim 13, wherein the ridge shape information calculating unit includes a ridge curvature calculating unit that calculates curvature of the ridge and sets the curvature of the ridge as the shape information of the ridge.

15. The image processing apparatus according to claim 1, wherein the initial closed region setting unit includes a closed region size determining unit that determines a size of the initial closed region based on the set range.

16. The image processing apparatus according to claim 15, wherein the closed region size determining unit includes an inscription area size determining unit that has a predetermined shape and determines a size inscribed in the set range as the size of the initial closed region.

17. The image processing apparatus according to claim 15, further comprising:

an edge extracting unit that extracts pixels of which the gradient strength is a predetermined value or higher from the each pixel of the intraluminal image as an edge;

a distance image calculating unit that calculates a distance image representing a distance from the edge; and

a ridge detecting unit that detects a ridge of the distance image,

wherein the closed region size determining unit includes a ridge closed region size determining unit that determines the size of the initial closed region based on a distance from the edge to the ridge.

18. The image processing apparatus according to claim 15, wherein

the initial closed region is set by joining a plurality of control points and is transformed by moving the control points, and

the initial closed region setting unit includes a control point number determining unit that determines the number of the control points based on the size of the initial closed region.

19. The image processing apparatus according to claim 18, wherein the control point number determining unit includes an area calculating unit that calculates an area of the initial closed region and determines the number of the control points based on the area.

20. The image processing apparatus according to claim 18, wherein the control point number determining unit includes a perimeter calculating unit that calculates a perimeter of the initial closed region and determines the number of the control points based on the perimeter.

21. An image processing apparatus comprising:

a gradient strength calculating unit that calculates gradient strength of a pixel value of each pixel of an intraluminal image that is a captured image of an intralumen;

a closed region extracting unit that extracts a closed region from the intraluminal image, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with predetermined curvature or higher toward an inner side of the closed region; and

an abnormal portion detecting unit that detects an abnormal portion located inside the closed region,

wherein the closed region extracting unit includes

an initial closed region setting unit that sets an initial closed region having an initial shape of the closed region based on the gradient strength;

an energy calculating unit that calculates values of a plurality of types of energy that at least include energy determined based on an outer shape of the closed region and energy determined based on the gradient strength on the boundary of the closed region;

an energy weighting factor setting unit that sets a weighting factor for at least one type of energy among the plurality of types of energy based on a position of the initial closed region; and

an energy weighted-sum calculating unit that calculates a weighted sum of the plurality of types of energy, and

wherein the closed region is extracted by transforming the initial closed region based on the weighted sum.

22. The image processing apparatus according to claim 21, wherein

the initial closed region is set by joining a plurality of the control points and is transformed by moving the control points,

the image processing apparatus further comprises a control point number determining unit that determines the number of control points based on a size of the initial closed region, and

the energy weighting factor setting unit sets the weighting factor according to the number of the control points.

23. The image processing apparatus according to claim 21, wherein

the initial closed region setting unit sets the initial closed region inside the flat area made up of a plurality of pixels of which values of the gradient strength inside the intraluminal image are close to one another,

the image processing apparatus further comprises an area shape information calculating unit that calculates shape information of a flat area, and

the energy weighting factor setting unit includes an area shape weighting factor setting unit that sets a weighing factor according to a shape of the flat area at a position at which the initial closed region is set based on shape information of the flat area.

24. The image processing apparatus according to claim 23, wherein

the area shape information calculating unit includes

a central line calculating unit that calculates a central line of the flat area;

and

a curvature calculating unit that calculates curvature of the central line, and

wherein the area shape weighting factor setting unit sets a weighting factor for the energy determined based on the outer shape of the closed region to be larger as the curvature of the central line is larger.

25. The image processing apparatus according to claim 21, wherein

the initial closed region setting unit sets the initial closed region based on the edge on which a value of the gradient strength inside the intraluminal image is a predetermined value or higher,

the image processing apparatus further comprises

an end point detecting unit that detects an end point of an edge;

and

a direction calculating unit that calculates a direction of the edge that is continuous to the end point as an end point direction, and

the energy weighting factor setting unit sets the weighting factor based on a position at which the initial closed region is set and the end point direction.

26. The image processing apparatus according to claim 25, wherein the energy weighting factor setting unit sets the weighting factor for the energy determined based on the outer shape of the closed region to be larger as an angle formed by a straight line joining the end point and the position, at which the initial closed region is set, and the end point direction is larger.

27. The image processing apparatus according to claim 21, wherein

the initial closed region setting unit sets the initial closed region based on the edge on which a value of the gradient strength inside the intraluminal image is a predetermined value or higher,

the image processing apparatus further comprises

a distance image calculating unit that calculates a distance image representing a distance from an edge;

a ridge detecting unit that detects a ridge of the distance image; and

a ridge shape information calculating unit that calculates shape information of the ridge, and

the energy weighting factor setting unit includes a ridge shape weighting factor setting unit that sets a weighting factor according to a shape of the ridge at the position at which the initial closed region is set based on the shape information of the ridge.

28. The image processing apparatus according to claim 27, wherein

the ridge shape information calculating unit includes a ridge curvature calculating unit that calculates curvature of the ridge, and

the ridge shape weighting factor setting unit sets a weighting factor for the energy determined based on the outer shape of the closed region to be larger as the curvature of the ridge is higher.

29. An image processing method comprising:

calculating gradient strength of a pixel value of each pixel of an intraluminal image that a captured image of an intralumen;

extracting a closed region from the intraluminal image, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with predetermined curvature or higher toward an inner side of the closed region; and

detecting an abnormal portion located inside the closed region,

wherein the extracting includes

setting an initial closed region that is an initial shape of the closed region based on the gradient strength;

calculating values of a plurality of types of energy that at least include energy determined based on an outer shape of the closed region and energy determined based on the gradient strength on the boundary of the closed region; and

calculating a weighted sum of the plurality of types of energy,

the closed region is extracted by transforming the initial closed region based on the weighted sum, and

the setting includes determining a set range of the initial closed region based on the gradient strength.

30. An image processing method comprising:

calculating gradient strength of a pixel value of each pixel of an intraluminal image that is a captured image of an intralumen;

extracting a closed region from the intraluminal image, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with predetermined curvature or higher toward an inner side of the closed region; and

detecting an abnormal portion located inside the closed region,

wherein the extracting includes

setting an initial closed region having an initial shape of the closed region based on the gradient strength;

calculating values of a plurality of types of energy that at least include energy determined based on an outer shape of the closed region and energy determined based on the gradient strength on the boundary of the closed region;

setting a weighting factor for at least one type of energy among the plurality of types of energy based on a position of the initial closed region; and

calculating a weighted sum of the plurality of types of energy, and

the closed region is extracted by transforming the initial closed region based on the weighted sum.

31. A non-transitory computer-readable storage medium with an executable program stored thereon, wherein the program instructs a processor to perform:

calculating gradient strength of a pixel value of each pixel of an intraluminal image that is a captured image of an intralumen;

extracting a closed region from the intraluminal image, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with predetermined curvature or higher toward an inner side of the closed region; and

detecting an abnormal portion located inside the closed region,

wherein the extracting includes

setting an initial closed region having an initial shape of the closed region based on the gradient strength;

calculating values of a plurality of types of energy that at least include energy determined based on an outer shape of the closed region and energy determined based on the gradient strength on the boundary of the closed region; and

calculating a weighted sum of the plurality of types of energy,

the closed region is extracted by transforming the initial closed region based on the weighted sum, and

the setting includes determining a set range of the initial closed region based on the gradient strength.

32. A non-transitory computer-readable storage medium with an executable program stored thereon, wherein the program instructs a processor to perform:

calculating gradient strength of a pixel value of each pixel of an intraluminal image that is a captured image of an intralumen;

extracting a closed region from the intraluminal image, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with predetermined curvature or higher toward an inner side of the closed region; and

detecting an abnormal portion located inside the closed region,

wherein the extracting includes

setting an initial closed region having an initial shape of the closed region based on the gradient strength;

calculating values of a plurality of types of energy that at least include energy determined based on an outer shape of the closed region and energy determined based on the gradient strength on the boundary of the closed region;

setting a weighting factor for at least one type of energy among the plurality of types of energy based on a position of the initial closed region; and

calculating a weighted sum of the plurality of types of energy, and

the closed region is extracted by transforming the initial closed region based on the weighted sum.