System and method for determining audio characteristics from within a body

• US 10,321,825 B2
• Filed: 05/30/2016
• Issued: 06/18/2019
• Est. Priority Date: 06/01/2015
• Status: Active Grant

• Current Assignee: C4i Ltd., Elbit Systems Land and C4I - Tadiran Limited (Elbit Systems Limited)
• Original Assignee: Elbit Systems Land and C4I - Tadiran Limited (Elbit Systems Limited)
• Inventors: Leizerson, Ilya, Alfassi, Barak
• Primary Examiner(s): Abouelela, May A
• Application Number:
  US15/578,618
• Publication Number:
  US 20180168453A1
• Time in Patent Office: 1,114 Days
• Field of Search: 600300, 600310, 600586, 600314, 382107
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/0066 Optical coherence imaging
• CPC Class Codes: A61B 5/7207 of noise induced by motion artifacts
• CPC Class Codes: A61B 5/7435 Displaying user selection data, e.g. icons in a graphical user interface
• CPC Class Codes: A61B 7/00 Instruments for auscultation
• CPC Class Codes: A61B 8/08 Detecting organic movements or changes, e.g. tumours, cysts, swellings A61B8/02 - A61B8/06 take precedence
• CPC Class Codes: G01H 9/00 Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves by using radiation-sensitive means, e.g. optical means
• CPC Class Codes: G01H 9/002 for representing acoustic field distribution sonar systems for imaging G01S7/56, G01S15/89; acoustic holography G03H3/00
• CPC Class Codes: G01N 2021/479 Speckle
• CPC Class Codes: G01N 21/4788 Diffraction for sizing particles G01N15/0205
• CPC Class Codes: G02B 27/48 Laser speckle optics
• CPC Class Codes: G06T 2207/30048 Heart; Cardiac
• CPC Class Codes: G06T 2207/30076 Plethysmography
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/248 involving reference images or patches

Abstract

A system for simultaneously detecting audio-characteristics within a body over multiple body surface locations comprising a coherent light source directing at least one coherent light beam toward the body surface locations, an imager acquiring a plurality of defocused images, each is of reflections of the coherent light beam from the body surface locations. Each image includes at least one speckle pattern, each corresponding to a respective coherent light beam and further associated with a time-tag. A processor, coupled with the imager, determines in-image displacements over time of each of a plurality of regional speckle patterns according to said acquired images. Each one of the regional speckle patterns is at least a portion of a respective speckle pattern. Each regional speckle pattern is associated with a respective different body surface location. The processor determines the audio-characteristics according to the in-image displacements over time of the regional speckle patterns.

Claims

1. A system for simultaneously detecting audio characteristics within a body of a subject, over multiple body surface locations, the system comprising a coherent light source, configured to direct a plurality of coherent light beams toward said body surface locations, said plurality of coherent light beams impinging on said body surface locations;

an imager, configured to acquire a plurality of defocused images, each image being of reflections of said plurality of coherent light beams from said body surface locations, each image including a plurality of speckle patterns, each speckle pattern corresponding to a respective one of said plurality of coherent light beams, each image being further associated with a time-tag;

a processor, coupled with said imager, said processor configured to determine in-image displacements over time of each of a plurality of regional speckle patterns according to said acquired images, said in-image displacements over time being due to both vibrations caused by sound produced from within the body and relative motion between said imager and said body, each one of said regional speckle patterns being at least a portion of a respective one of said plurality of speckle patterns, each one of said regional speckle patterns being associated with a respective different one of said body surface locations, said processor further configured to determine said audio characteristics from said in-image displacements over time of said regional speckle patterns due to said vibrations caused by sound produced from within the body, said processor further configured to separate said in-image displacements due to said vibrations caused by sound produced from within the body from said in-image displacements due to both said vibrations and said relative motion between said imager and said body, by estimating said in-image displacements of each said regional speckle pattern due to said vibration of each body region of interest corresponding to the body surface locations, from said in-image displacements of each said regional speckle patterns due to both said vibrations of each corresponding body region of interest and said relative motion between said imager and said body.

2. The system according to claim 1, further including a memory, said memory being for storing audio characteristics corresponding to known physiological conditions.

3. The system according to claim 2, wherein said processor is further configured to determine whether said determined audio characteristics corresponds to at least one known physiological condition by comparing said determined audio characteristics corresponding to each selected one of body surface locations of interest with said stored audio characteristics corresponding to known physiological conditions.

4. The system according to claim 2, wherein said processor is further configured to determine whether said determined audio characteristics corresponds to at least one known physiological by comparing the audio characteristics corresponding to each body surface locations of interest with the audio characteristics corresponding to other ones of selected body surface locations of interest.

5. The system according to claim 1, further including an audio reproduction subsystem comprising computer-executable instructions that, when executed by a processor, cause the processor to re-produce sounds corresponding to said audio characteristics.

6. The system according to claim 5, wherein said audio reproduction subsystem is a three-dimension audio reproduction system reproducing sound corresponding to said audio characteristics, which a user hears as originating from the source of the sound.

7. The system according to claim 6, wherein said computer-executable instructions employ a Head Related Transfer Function to produce a binaural sound to be reproduced on headphones.

8. The system according to claim 1, wherein said body surface locations are configured to be located on a region of interest, and wherein said region of interest is configured to be one of a thorax and an abdomen of the subject.

9. The system according to claim 1, wherein said audio characteristics are at least one of:

an audio signal;

an audio spectrogram;

spectrum;

sound pressure level;

sound power;

time delay between signals measured on different body surface locations;

or

energy.

10. The system according to claim 1, wherein a compensating effects of the relative motion compensates said effects according to the following:

{right arrow over (s)}(t)={right arrow over (S)}(t)−

M[M^TM]<sup>−

1</sup>M^T{right arrow over (S)}(t)

wherein {right arrow over (s)}(t) relates to the in image displacement of said regional speckle pattern corresponding to said body surface locations only due to the vibration of said body surface locations, {right arrow over (S)}(t) relates to the in image displacement of the regional speckle pattern corresponding to said body surface locations due to both the relative motion between said imager and each of said body surface locations and the vibrations of said body surface locations and M is a motion compensation matrix.

11. The system according to claim 1, further including a display for displaying at least one of:

said speckle patterns;

or

a visual representation of said audio characteristics.

12. The system according to claim, 11 further including a user interface, said user interface including said display configured to receive a user selection, said user selection being for selecting said body surface locations according to one of predefined options and user defined locations.

13. The system according to claim 12, wherein, said body surface locations are selected according to an inner body location for which said audio characteristics are to be determined.

14. A method for simultaneously detecting audio characteristics within a body of a subject, over multiple body surface locations, the method comprising the procedures of:

directing, by a coherent light source, a plurality of coherent light beams toward said body surface locations, said plurality of coherent light beams impinging on said body surface locations;

acquiring, by an imager, a plurality of defocused images of said body surface locations, each image being of reflections of said plurality of coherent light beams from said body surface locations, each image including a plurality of speckle patterns, each speckle pattern corresponding to a respective one of said plurality of coherent light beams, each image being associated with a time-tag;

determining, by at least one processor, the-in-image displacement over time in each of a plurality of regional speckle patterns according to said acquired images, said in-image displacement over time being due to both vibrations caused by sound produced from within the body and relative motion between said imager and said body, each one of said regional speckle patterns being at least a portion of a respective one of said plurality of speckle patterns, each one of said regional speckle patterns being associated with a respective different one of said body surface locations;

determining, by the at least one processor, the audio characteristics originating from within the body at each of said body surface locations from the in-image displacement over time in said respective regional speckle pattern due to said vibrations caused by sound produced from within the body;

and separating said in-image displacement due to vibrations caused by sound produced from within the body from said in-image displacement due to both said vibrations and said relative motion between said imager and said body by estimating said in-image displacement of each said regional speckle pattern due to said vibration of each body region of interest corresponding to the body surface locations, from said in-image displacement of each said regional speckle patterns due to both said vibrations of each corresponding body region of interest and said relative motion between said imager and said body.

15. The method according to claim 14, wherein said determined audio characteristics corresponding to each selected one of body surface are compared, by the at least one processor, with reference audio characteristics corresponding to substantially the same body surface location thereby detecting at least one physiological condition.

16. The method according to claim 14, wherein said determined audio characteristics corresponding to each body surface locations of interest are compared, by the at least one processor, with the audio characteristics corresponding to other ones of selected body surface locations of interest.

17. The method according to claim 14, wherein an effect of relative motion between the body and the imager is compensated according to the following:

{right arrow over (s)}(t)={right arrow over (S)}(t)−

M[M^TM]<sup>−

1</sup>M^T{right arrow over (S)}(t)

wherein {right arrow over (s)}(t) relates to the in image displacement of said regional speckle pattern corresponding to said body surface locations only due to the vibration of said body surface locations, {right arrow over (S)}(t) relates to the in image displacement of the regional speckle pattern corresponding to said body surface locations due to both the relative motion between said imager and each of said body surface locations and the vibrations of said body surface locations and M is a motion compensation matrix.

18. The method according to claim 14, wherein said body surface locations are configured to be located on a region of interest, and wherein said region of interest is configured to be one of a thorax and an abdomen of the subject.

19. The method according to claim 14, wherein said audio characteristics are at least one of:

an audio signal;

an audio spectrogram;

spectrum;

sound pressure level;

sound power;

time delay between signals measured on different body surface locations;

or

energy.

20. The method according to claim 14, wherein said body surface locations are selected, by the at least one processor, according to one of predefined options and user defined locations.

21. The system according to claim 14, wherein, said body surface locations are selected, by the at least one processor, according to an inner body location for which said audio characteristics are to be determined.