Systems and methods for component separation in medical imaging

• US 10,309,936 B2
• Filed: 10/13/2014
• Issued: 06/04/2019
• Est. Priority Date: 10/11/2013
• Status: Active Grant

• Current Assignee: Seno Medical Instruments, Inc.
• Original Assignee: Seno Medical Instruments, Inc.
• Inventors: Zalev, Jason, Clingman, Bryan, Herzog, Donald G.
• Primary Examiner(s): Roy, Baisakhi
• Application Number:
  US14/512,896
• Publication Number:
  US 20150101411A1
• Time in Patent Office: 1,695 Days
• CPC Class Codes: A61B 2560/0223 of calibration, e.g. protocols for calibrating sensors
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0035 adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography
• CPC Class Codes: A61B 5/0066 Optical coherence imaging
• CPC Class Codes: A61B 5/0095 by applying light and detecting acoustic waves, i.e. photoacoustic measurements
• CPC Class Codes: A61B 5/7203 for noise prevention, reduction or removal
• CPC Class Codes: A61B 8/4281 characterised by sound-transmitting media or devices for coupling the transducer to the tissue
• CPC Class Codes: A61B 8/4416 related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions
• CPC Class Codes: G01N 2291/023 Solids
• CPC Class Codes: G01N 2291/02475 Tissue characterisation
• CPC Class Codes: G01N 29/0654 Imaging
• CPC Class Codes: G01N 29/2418 using optoacoustic interaction with the material, e.g. laser radiation, photoacoustics photoacoustic cells G01N21/1702; measuring characteristics of vibrations by using radiation-sensitive means G01H9/00; acousto-optical conversion techniques for short-range imaging G01S15/8965; sound-producing devices using laser bundle G10K15/046
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: H01L 2924/0002 Not covered by any one of groups H01L24/00, H01L24/00 and H01L2224/00

Abstract

A system is provided for component separation. In an embodiment, a light source or other source of electromagnetic energy delivers energy to a volume of tissue. A transducer array or other sensor receives a resulting acoustic signal, and a processing subsystem processes the acoustic signal to separate a direct acoustic return component from a secondary acoustic return component of the acoustic signal. An output and/or storage device presents and/or stores information about the direct acoustic return component, the secondary acoustic return component, or both. Other embodiments include a coded probe, a probe having an isolator that produces a wavefront, a sensor for measuring intensity of an acoustic wave produced by absorbed photons, and a system that receives acoustic signals from surface targets to determine an optical parameter of the volume.

Claims

1. A medical imaging system, comprising:

at least one light source for delivering light energy to a volume of tissue;

a transducer array for receiving an acoustic signal in response to the delivery of light energy, the acoustic signal comprising at least a direct acoustic return component and a secondary acoustic return component, the secondary acoustic return component comprising an acoustic response that is substantially reflected or scattered before arriving at the transducer array;

a processing subsystem for processing the acoustic signal to separate the direct acoustic return component from the secondary acoustic return component of thereof by applying at least one of a simulation, reconstruction, point spread function, error calculation, or correction function to the acoustic signal; and

,

an output device for presenting information about at least one of the direct acoustic return component and the secondary acoustic return component.

2. The medical imaging system according to claim 1, wherein the output device comprises a display for displaying an image that utilizes the information about the direct acoustic return component, the secondary acoustic return component, or both.

3. The medical imaging system according to claim 1, wherein the output device comprises a storage device for storing the information about the direct acoustic return component, the secondary acoustic return component, or both.

4. The medical imaging system according to claim 1, wherein the processing subsystem applies a simulation function that comprises:

a sub-module for reconstructing secondary acoustic return spatial representations from the secondary acoustic return components;

a sub-module for reconstructing direct acoustic return spatial representations from the direct acoustic return components;

a sub-module for simulating secondary acoustic return signals from the secondary acoustic return spatial representations; and

a sub-module for simulating direct acoustic return signals from the direct acoustic return spatial representations.

5. The medical imaging system according to claim 4, wherein the processing subsystem is configured to apply the point spread function to a current estimate of a direct acoustic return representation and a current estimate of a secondary acoustic return representation.

6. The medical imaging system according to claim 5, wherein the point spread function is applied according to steps comprising:

simulating the current direct acoustic return estimate to produce a direct acoustic return sinogram using the direct acoustic return simulation sub-module;

simulating the current secondary acoustic return estimate to produce a secondary acoustic return sinogram using the direct acoustic return simulation sub-module;

adding the direct acoustic return sinogram to the secondary acoustic return sinogram to produce an overall sinogram;

reconstructing direct acoustic return from the overall sinogram to produce a direct acoustic return PSF representation using the direct acoustic return reconstruction sub-module; and

,

reconstructing secondary acoustic return from the overall sinogram to produce a secondary acoustic return PSF representation using the secondary acoustic return reconstruction sub-module.

7. The medical imaging system according to claim 4, wherein the processing subsystem is configured to execute a process for component separation, comprising the steps of:

a) producing a reference representation for direct acoustic return and a reference representation for secondary acoustic return by reconstructing the recorded acoustic return signals using the direct acoustic return sub-module and the secondary acoustic return sub-module; and

,

b) computing at least one iteration comprising the steps of;

i) applying a point spread function to current estimates of direct acoustic return and secondary acoustic return;

ii) computing residuals between the reference representations and PSF representations;

iii) multiplying the residuals by a weight to give weighted residuals;

iv) adding the weighted residuals to the current estimates of direct acoustic return and secondary acoustic return; and

,

v) applying thresholding to produce the next estimates of direct acoustic return and secondary acoustic return.

8. The medical imaging system according to claim 4, further comprising:

a sub-module for computing a residual between a simulated estimate of electromagnetically absorbent targets within the volume and a reference based on recorded direct acoustic return signals;

a sub-module for computing a residual between a simulated estimate of acoustically reflective targets within the volume and a reference based on recorded secondary acoustic return signals;

a sub-module for modifying the estimates of the targets based on computed residuals; and

,

a sub-module for outputting final estimates of spatial or signal representations of the targets.

9. The medical imaging system according to claim 4, wherein the direct acoustic return simulation sub-module and direct acoustic return reconstruction sub-module use delays based on voxel to transducer element distances, and wherein the secondary acoustic return simulation sub-module and secondary acoustic return reconstruction sub-module use delays based on wavefront source to voxel to transducer element distances.

10. The medical imaging system according to claim 1, further comprising a probe with a distal surface, wherein the acoustic impedance of at least a portion of the distal surface is acoustically mismatched to the volume of tissue and the secondary acoustic return component comprises reflections from targets in the volume by a wavefront originating proximate to the distal surface and in response to the delivery of light energy, the wavefront produced as a result of the acoustic mismatch following the light delivery.

11. The system of claim 1, wherein the processing subsystem is configured to separate the direct and secondary acoustic return components that are received during a common sample cycle.

12. The system of claim 1, wherein the processing subsystem is configured to separate the direct and secondary acoustic return components based on at least one of a time delay, propagation time, speed of sound profile, or simulation look-up table.

13. The system of claim 1, wherein the secondary acoustic return component travels from a wavefront source to a target in the volume of tissue and then from the target to the transducer array.

14. The system of claim 13, wherein the wavefront source is located proximate to a surface of the volume of tissue and generates a wavefront in response to the light energy.

15. A system, comprising:

an energy source configured to deliver electromagnetic energy to a volume comprising one or more acoustic targets;

a probe with an outer surface to form a coupling interface between itself and a surface of the volume;

one or more elements on the outer surface of the probe to produce a predictable wavefront pattern originating substantially at the coupling interface as a result of the delivered energy; and

,

an acoustic receiver to receive an acoustic return comprising direct acoustic return signals and secondary acoustic return signals, the secondary acoustic return signals comprising at least a portion of the predictable wavefront pattern that is scattered by the one or more acoustic targets; and

,

a processing subsystem configured to process the acoustic signal to separate the direct acoustic return signals from the secondary acoustic return signals by applying a received wavefront resulting from the predictable wavefront pattern.

16. The system of claim 15, wherein the coupling interface is coupled using a coupling medium.

17. The opto-acoustic probe of claim 16, wherein the secondary acoustic return component is used to produce an image separate from a produced direct acoustic return image.

18. The system of claim 15, wherein the processing subsystem is configured to use the received wavefront by forming a direct acoustic return representation with a distinguishable secondary acoustic return component.

19. The opto-acoustic probe of claim 18, configured such that the distinguishable secondary acoustic return component can be recognized by computer processing without substantially distorting a produced direct acoustic return image to be perceived by a human.

20. The system of claim 15, wherein the one or more featured elements comprises an optically absorbing line source.

21. The system of claim 20, wherein the optically absorbing line source meets with other optically absorbing line sources to form a rectangle.

22. The system of claim 15, wherein the predictable wavefront pattern resulting from featured elements on the outer surface of the probe comprises a wavefront produced by an air-tissue interface surrounding the outer surface.

23. The system of claim 15, wherein the received secondary acoustic return signals are used to produce an image, which can be separately displayed or co-registered with a direct acoustic return image.

24. A method, comprising:

placing a surface of a probe proximate to a surface of a volume;

delivering light from a light source to the volume, wherein a portion of the light from the light source is absorbed by patterns on the surface of the probe;

receiving acoustic signals from the volume, wherein the received acoustic signals comprise probe acoustic backscatter (PAB) components of acoustic signal resulting from scattering of wavefronts produced by the patterns on the surface of the probe in response to absorbing the portion of the light;

processing the received acoustic signals to identify a first PAB component that resulted due to scattering by a target at a first position in the volume, wherein a first acoustic front due to the patterns on the surface of the probe targeting the first position in the volume is distinguishably different from a second acoustic front due to the patterns on the surface of the probe targeting a second position in the volume, wherein a second PAB component of a target at the second position interferes with the first PAB component and wherein prediction of acoustic fronts due to the patterns on the surface of the probe reaching positions in the volume is used to identify the first PAB component;

outputting an intensity of the first PAB component at the first position in the volume; and

separating a direct acoustic return component from the acoustic signals based on the first PAB component.

25. The method of claim 24, wherein the received acoustic signals are received by at least one receiver located on the surface of the probe and the surface of the probe further comprises at least one exit port to deliver the light from the light source to the volume, wherein a portion of the light from the light source exiting the exit port is absorbed by optically absorbing targets in the volume.

26. The method of 24, further comprising forming an image of a portion of the volume, wherein the image comprises voxels and a voxel of the image is computed by computing a voxel intensity that is outputted by the step of outputting wherein the first position in the volume corresponds to the position of the voxel.

27. The method of claim 26, wherein the second position in the volume in computing the computed voxel intensity corresponds to a position in the volume that is outside of the imaged portion of the volume and thus does not correspond to a voxel in the image.

28. The method of claim 26, wherein the step of forming an image of a portion of the volume comprises performing an iterative process comprising:

simulating received signals from a target at one position and from an interfering target at another position to produce simulated signals; and

,

reconstructing a spatial representation of the volume from the simulated signals.

29. The method of claim 28, wherein the received acoustic signals are received by an array of receivers incident with an imaging plane partitioning the volume and the method is used to suppress out-of-plane objects in the image and the portion of the volume in the image is within the imaging plane.

30. The method of claim 26, further comprising:

receiving direct acoustic return from the volume;

forming a direct acoustic return spatial representation of the volume from the received direct acoustic return;

using the formed image to identify and suppress out-of-plane objects m the direct acoustic return spatial representation; and

,

displaying the direct acoustic return spatial representation on a display.

31. The method of claim 26, further comprising displaying the image on a display.

32. A method, comprising:

placing an opto-acoustic probe comprising a distal surface into contact with a surface of a volume to form a coupling interface, wherein the distal surface comprises a detector array;

delivering energy to the volume;

receiving acoustic signals comprising;

a direct component due to acoustic return signals produced within the volume; and

,

a surface component due to an acoustic wavefront propagating substantially proximate to the distal surface where the wavefront reaches elements of the detector array in a sequence, wherein the surface component varies according to at least one parameter that is dependent on properties of the coupling interface or materials proximate thereto;

processing the acoustic signals to determine the at least one parameter;

separating the direct component based on the at least one parameter;

forming an image using the acoustic signals that is spatially representative of the volume, wherein formation of the image is dependent on the direct component and the at least one parameter; and

,

outputting the image to a display.

33. The method of claim 32, wherein the elements of the detector array are aligned in a row and spaced equidistantly so that the acoustic signals arrange to form a sinogram with the surface component presented substantially as a diagonal line, the step of processing further comprising a step selected from the group consisting of:

using slope of the diagonal line to infer a speed of sound;

using an intercept of the at least one diagonal line to infer the position of origin of a wavefront; and

,

using change of intensity of the at least one diagonal line to infer an attenuation coefficient.

34. The method of claim 32, wherein the parameter is selected from the group consisting of:

a shear wave velocity or sound speed;

a longitudinal wave velocity or sound speed;

a coupling medium thickness;

a status of whether the probe is in contact with the volume;

a position beyond which the distal surface is not in contact with the volume;

a thickness of an epidermal layer;

mechanical property of the coupling interface;

a position where a surface wavefront originates;

a parameter for mitigating an artifact;

an attenuation coefficient;

or,

an acoustic impedance.

35. The method of claim 32, wherein the wavefront is produced at a discontinuity of a feature of the probe.

36. The method of claim 35, wherein the discontinuity is of a property selected from the group consisting of:

optical absorption and acoustic impedance.

37. The method of claim 35, wherein formation of the image comprises the step of mitigating the surface component so that an artifact from the surface component is not displayed in the image.

38. The method of claim 32, wherein a portion of the surface of the volume that is not in contact with the opto-acoustic probe is exposed to air, and the discontinuity is at a boundary where probe, air and tissue meet.

39. A computer implemented method comprising:

receiving a plurality of acoustic return signals at a transducer array, each signal received from a position proximate to an outer surface of a volume in response to delivery of electromagnetic energy to the volume;

utilizing one or more processors for;

applying a pattern detection classifier to each received signal to produce a plurality of classifier output signals, each classifier output signal is representative of an indicator strength as a function of time in each received signal;

reconstructing a spatial representation of the volume from the plurality of classifier output signals;

receiving a direct acoustic return component, at the transducer array, from the volume in response to delivery of electromagnetic energy to the volume; and

,

outputting an image based on the direct acoustic return component and the reconstructed spatial representation.

40. The method of claim 39, wherein the indicator strength is tuned to acoustic signals resulting from a pattern on the surface of a probe acoustically coupled to the volume.

41. The method of claim 39, wherein the step of reconstructing a spatial representation comprises using an iterative minimization.

42. A computer implemented method for performing medical imaging, comprising:

delivering light energy to a volume of tissue from a light source;

receiving, at a transducer array, an acoustic signal in response to the delivery of light energy, the acoustic signal comprising at least a direct acoustic return component and a secondary acoustic return component, the secondary acoustic return component comprising an acoustic response that is substantially reflected or scattered before arriving at the transducer array;

utilizing one or more processors to process the acoustic signal to separate the direct acoustic return component from the secondary acoustic return component of thereof by applying at least one of a simulation, reconstruction, point spread function, error calculation, or correction function to the acoustic signal; and

,

presenting information about at least one of the direct acoustic return component and the secondary acoustic return component.

43. The method according to claim 42, wherein the presenting comprises displaying an image that utilizes the information about the direct acoustic return component, the secondary acoustic return component, or both.

44. The method according to claim 42, wherein the presenting comprises storing the information about the direct acoustic return component, the secondary acoustic return component, or both.

45. The method according to claim 42, wherein the processing applies the simulation function that comprises:

reconstructing secondary acoustic return spatial representations from the secondary acoustic return components;

reconstructing direct acoustic return spatial representations from the direct acoustic return components;

simulating secondary acoustic return signals from the secondary acoustic return spatial representations; and

simulating direct acoustic return signals from the direct acoustic return spatial representations.

46. The method according to claim 42, wherein the processing comprises applying a point spread function based on estimates associated with the direct and secondary acoustic return components.

47. The method according to claim 46, wherein the point spread function is applied according to steps comprising:

simulating a current direct acoustic return estimate to produce a direct acoustic return sinogram;

simulating a current secondary acoustic return estimate to produce a secondary acoustic return sinogram;

adding the direct acoustic return sinogram to the secondary acoustic return sinogram to produce an overall sinogram;

reconstructing a direct acoustic return from the overall sinogram to produce a direct acoustic return PSF representation; and

,

reconstructing a secondary acoustic return from the overall sinogram to produce a secondary acoustic return PSF representation.

48. The method according to claim 46, wherein the process for component separation, comprising the steps of:

a) producing a reference representation for direct acoustic return and a reference representation for secondary acoustic return by reconstructing the recorded acoustic return signals using the direct acoustic return sub-module and the secondary acoustic return sub-module; and

,

b) computing at least one iteration comprising the steps of;

vi) applying a point spread function to current estimates of direct acoustic return and secondary acoustic return;

vii) computing residuals between the reference representations and PSF representations;

viii) multiplying the residuals by a weight to give weighted residuals;

ix) adding the weighted residuals to the current estimates of direct acoustic return and secondary acoustic return; and

,

x) applying thresholding to produce the next estimates of direct acoustic return and secondary acoustic return.

49. The method according to claim 46, further comprising:

computing a residual between a simulated estimate of electromagnetically absorbent targets within the volume and a reference based on recorded direct acoustic return signals;

computing a residual between a simulated estimate of acoustically reflective targets within the volume and a reference based on recorded secondary acoustic return signals;

modifying the estimates of the targets based on computed residuals; and

,

outputting final estimates of spatial or signal representations of the targets.