SYSTEMS AND METHODS FOR ESTIMATION OF OBJECTS FROM AN IMAGE

• US 20150294182A1
• Filed: 04/13/2014
• Published: 10/15/2015
• Est. Priority Date: 04/13/2014
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: KENIG, Tal, YERUSHALMY, Ido, GOLDENTOUCH, Lev
• Application Number:
  US14/251,607
• Publication Number:
  US 20150294182A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2132 based on discrimination criteria, e.g. discriminant analysis
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 2207/30008 Bone
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06V 10/7715 Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
• CPC Class Codes: G06V 2201/033 of skeletal patterns

Abstract

There is provided a method for estimating semi-transparent object(s) from an image comprising: receiving an image having semi-transparent and overlaid object(s) for estimation; calculating a probability map of the object(s), the probability map comprising multiple pixels corresponding to the plurality of pixels of the received image, wherein each probability map pixel has a value proportional to the probability that the pixel of the received image contains the object(s); calculating an approximation image of an object suppressed image based on the object probability map, wherein the approximation image is substantially equal to corresponding regions of the received image at portions with low probability values, and the approximation image denotes a smooth approximation of the image with the object(s) suppressed at portions with high probability values of the object probability map; and calculating the object(s) for estimation based on the calculated approximation of the object suppressed image.

Claims

1. A method for estimating one or more semi-transparent objects from an image comprising:

receiving an image having at least one object for estimation, the at least one object being semi-transparent and overlaid over at least one other object, the image having a plurality of pixels;

calculating a probability map of the at least one object, the probability map comprising a plurality of pixels corresponding to the plurality of pixels of the received image, wherein each probability map pixel has a value proportional to the probability that the pixel of the received image contains the at least one object;

calculating an approximation image of an object suppressed image based on the object probability map, wherein the approximation image is substantially equal to corresponding regions of the received image at portions with low probability values, and the approximation image denotes a smooth approximation of the image with the at least one object suppressed at portions with high probability values of the object probability map; and

calculating the at least one object for estimation based on the calculated approximation of the object suppressed image.

2. The method of claim 1, wherein the pixels of the probability map do not correspond to the pixels of the received image in a bijective manner.

3. The method of claim 1, wherein calculating the probability map comprises:

applying a transformation to the received image to generate a transformed image;

extracting features from the transformed image; and

calculating the probability values by applying a regression function to the extracted features.

4. The method of claim 3, wherein the transformation function is selected to reduce the variability of the extracted features.

5. The method of claim 4, wherein the transformation function comprises a grey level normalization and a geometric transformation.

6. The method of claim 3, wherein the extracted features comprise one or more of:

responses to linear filters at different scales, orders and directions, grey values from the transformed images, and responses to nonlinear filters promoting specific structures.

7. The method of claim 3, wherein the regression function is pre-trained using training images.

8. The method of claim 7, wherein the regression function is a k nearest neighbors (kNN) regression.

9. The method of claim 1, wherein calculating the at least one object estimation based on the calculated approximation of the object suppressed image comprises:

calculating a difference image by subtracting the approximation image from the received image, wherein at regions of low object probability based on the object probability map pixels of the difference image have substantially zero value, and at regions of high object probability based on the object probability map the pixels have substantially equivalent value to the pixels of the at least one object overlaid on fine background image details; and

calculating an estimation of the objects as a low order approximation of the difference image.

10. The method of claim 1, wherein the smooth approximation of the object suppressed image is a weighted low-pass filtered image, the filter cutoff frequency being lower than an expected object frequency along at least one dimension.

11. The method of claim 1, wherein the smooth approximation of the object suppressed image is a weighted polynomial regression.

12. The method of claim 9, wherein low order object approximation is comprised of:

delineating the objects by applying a segmentation process to the probability map, or by detecting the objects by applying an object detection and/or ridge detection process;

dividing the objects into a plurality of segments;

constructing a generative model from the plurality of segments; and

applying the generative model to the plurality of segments to generate low-order approximations of the segments; and

re-combining the low-order approximations of the segments into a low order approximation of the object.

13. The method of claim 12, wherein the generative model is a Principal Components Analysis model.

14. The method of claim 12, wherein the object segments are linear segments extracted from the object along a substantially fixed direction relative to an estimated direction of the at least one object.

15. The method of claim 12, wherein the object segments are image patches extracted from the object along a substantially fixed direction relative to an estimated direction of the at least one object.

16. The method of claim 14, wherein the substantially fixed direction is selected such that the variability within extracted object segments is reduced.

17. The method of claim 12, further comprising pre-processing the at least one object segments before constructing the generative model, the pre-processing selected to reduce variability within segment sets of same instances of the at least one object.

18. The method of claim 12, wherein re-combining comprises re-positioning the approximated object segments back to the location in an image domain where the corresponding object segment is extracted from.

19. The method of claim 18, wherein re-positioning the object segments is performed in a weighted manner when the extracted objects segments overlap.

20. The method of claim 1, wherein the received image is acquired by an x-ray based imaging modality.

21. The method of claim 1, wherein the received image is a chest x-ray or an angiogram, and wherein the at least one object is one or more of:

ribs, clavicles, contrast enhanced blood vessels, tubes, wires.

22. The method of claim 3, further comprising calculating the image with the at least one object suppressed, by subtracting the approximated at least one object from the received image, and at least one of outputting, displaying, and forwarding the image with the at least one object suppressed.

23. The method of claim 22, wherein subtracting comprises weighted subtracting, wherein subtraction weights are determined individually for the different approximations of the at least one object, the weights selected to reduce the probability of creating visually distinguishable artifacts on the border of the subtracted object approximations.

24. A method for generating a trained regression function for use in a process to estimate semi-transparent objects from an image, comprising:

receiving a plurality of pairs of training images, each pair of training images comprises a training image with at least one object for estimation and an object image of the at least one object for estimation, the at least one object being semi-transparent and overlaid over at least one other object, wherein each of the pairs of training images comprise a plurality of pixels; and

training a regression function to generate an object probability map for an acquired image with at least one semi-transparent object for estimation, the training based on the pairs of training images, the object probability map comprising a plurality of pixels corresponding to the plurality of pixels of the received image, wherein each probability map pixel has a value proportional to the probability that the pixel of the received image contains the at least one object.

25. A method for suppressing semi-transparent objects in an image comprising:

receiving an image having at least one object for suppression, the at least one object being semi-transparent and overlaid over at least one other object, the image having a plurality of pixels;

receiving an object probability map, the object probability map is an object probability map comprising a plurality of pixels corresponding to the plurality of pixels of the received image, wherein each probability map pixel has a value proportional to the probability that the pixel of the received image is for suppression;

receiving a difference image or calculating the difference image based on the received image and received object probability map, wherein regions of the difference image corresponding to at least one portion of the object probability map for suppression have substantially zero value, and regions of the difference image corresponding to portions other than the at least one portion of the object probability map for suppression have substantially equivalent value to the regions of the at least one object overlaid on fine background image details;

identifying separate instances of the at least one object within the difference image based on the object probability map;

dividing the identified instances of the at least one object within the difference image into segments; and

calculating a generative model based on the segments, for generating an approximation image of the at least one object for suppression.

26. The method of claim 25, wherein the image comprises a chest x-ray, the at least one object comprises ribs, and identifying comprises identifying separate ribs and clavicles.

27. The method of claim 25, wherein dividing comprises dividing the identified instances of the at least one object into overlapping image patches to induce regularity along an approximation of the at least one object.

28. The method of claim 25, further comprising pre-processing the at least one object segments before constructing the generative model, the pre-processing selected to compensate for accurate segmentation of the at least one object and to reduce variability within segment sets of different instances of the at least one object.

29. The method of claim 25, further comprising:

approximating the object segments to a pre-determined order based on the generative model;

generating an approximation of the at least one object based on the object segment approximations; and

generating the image with the at least one object suppressed by subtracting the approximation of the at least one object from the received image having the at least one object for suppression.