Methods of non-touch optical detection of vital signs from multiple filters

• US 9,262,826 B2
• Filed: 08/11/2014
• Issued: 02/16/2016
• Est. Priority Date: 07/04/2014
• Status: Active Grant

• Current Assignee: ARC Devices, Ltd.
• Original Assignee: Arc Devices (Ni) Limited
• Inventors: Khachaturian, Mark, Smith, Michael G.
• Primary Examiner(s): Akhavannik, Hadi
• Application Number:
  US14/457,018
• Publication Number:
  US 20160005165A1
• Time in Patent Office: 554 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 2560/0214 of power generation or supply
• CPC Class Codes: A61B 2560/0475 Special features of memory means, e.g. removable memory cards
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/015 By temperature mapping of body part
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/02416 using photoplethysmograph signals, e.g. generated by infrared radiation A61B5/14552 takes precedence
• CPC Class Codes: A61B 5/02433 for infrared radiation
• CPC Class Codes: A61B 5/0261 using optical means, e.g. infrared light
• CPC Class Codes: A61B 5/0816 Measuring devices for examining respiratory frequency measuring frequency of electric signals G01R23/00
• CPC Class Codes: A61B 5/1455 using optical sensors, e.g. spectral photometrical oximeters
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/14552 : Details of sensors specially adapted therefor
• CPC Class Codes: A61B 5/33 : specially adapted for cooperation with other devices
• CPC Class Codes: A61B 5/441 : Skin evaluation, e.g. for skin disorder diagnosis
• CPC Class Codes: A61B 5/6898 : Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/7225 : Details of analog processing, e.g. isolation amplifier, gain or sensitivity adjustment, filtering, baseline or drift compensation A61B5/30, A61B5/316 take precedence; transformers for specific applications H01F38/00; amplifiers H03F
• CPC Class Codes: A61B 5/725 : using specific filters therefor, e.g. Kalman or adaptive filters A61B5/316 take precedence
• CPC Class Codes: A61B 5/7257 : using Fourier transforms
• CPC Class Codes: A61B 5/7264 : Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/7267 : involving training the classification device
• CPC Class Codes: A61B 5/7275 : Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor
• CPC Class Codes: A61B 5/7278 : Artificial waveform generation or derivation, e.g. synthesising signals from measured signals A61B5/327 takes precedence
• CPC Class Codes: A61B 5/742 : using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 5/7425 : Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: A61B 5/743 : Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: G01J 2005/0077 : Imaging
• CPC Class Codes: G01J 5/0025 : Living bodies ear thermometers G01J5/0011; detecting, measuring or recording for diagnostic purposes A61B5/00
• CPC Class Codes: G01J 5/025 : Interfacing a pyrometer to an external device or network; User interface
• CPC Class Codes: G01J 5/0893 : Arrangements to attach devices to a pyrometer, i.e. attaching an optical interface; Spatial relative arrangement of optical elements, e.g. folded beam path G01J5/049 takes precedence
• CPC Class Codes: G01J 5/30 : Electrical features thereof
• CPC Class Codes: G01K 1/02 : Means for indicating or recording specially adapted for thermometers
• CPC Class Codes: G01K 13/223 : Infrared clinical thermometers, e.g. tympanic
• CPC Class Codes: G06F 18/23 : Clustering techniques
• CPC Class Codes: G06F 3/042 : by opto-electronic means
• CPC Class Codes: G06T 2207/10004 : Still image; Photographic image
• CPC Class Codes: G06T 2207/10016 : Video; Image sequence
• CPC Class Codes: G06T 2207/10024 : Color image
• CPC Class Codes: G06T 2207/10048 : Infrared image
• CPC Class Codes: G06T 2207/20024 : Filtering details
• CPC Class Codes: G06T 2207/20076 : Probabilistic image processing
• CPC Class Codes: G06T 2207/20132 : Image cropping
• CPC Class Codes: G06T 2207/30004 : Biomedical image processing
• CPC Class Codes: G06T 2207/30088 : Skin; Dermal
• CPC Class Codes: G06T 2207/30104 : Vascular flow; Blood flow; Perfusion
• CPC Class Codes: G06T 2207/30201 : Face
• CPC Class Codes: G06T 2210/22 : Cropping
• CPC Class Codes: G06T 3/40 : Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 5/00 : Image enhancement or restoration
• CPC Class Codes: G06T 5/10 : using non-spatial domain filtering
• CPC Class Codes: G06T 5/20 : using local operators
• CPC Class Codes: G06T 7/0012 : Biomedical image inspection
• CPC Class Codes: G06T 7/0016 : involving temporal comparison
• CPC Class Codes: G06T 7/13 : Edge detection
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/90 : Determination of colour characteristics
• CPC Class Codes: G06V 20/40 : in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 30/413 : Classification of content, e.g. text, photographs or tables
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/164 : using holistic features
• CPC Class Codes: G06V 40/168 : Feature extraction; Face representation
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G16H 30/20 : for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: H04N 25/75 : Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A microprocessor is operably coupled to a camera from which patient vital signs are determined. A temporal variation of images from the camera is generated from multiple filters and then amplified from which the patient vital sign, such as heart rate or respiratory rate, can be determined and then displayed or stored.

Claims

1. A method of displaying a biological vital sign, the method comprising:

identifying pixel values of at least two images in a first location in a memory that are representative of skin of an animal, resulting in identified pixel values that are stored in a second location the memory;

applying a first frequency filter to the identified pixel values that are stored in the second location of the memory, generating frequency filtered identified pixel values of the skin that are stored in a third location of the memory;

applying spatial clustering to the frequency filtered identified pixel values of the skin that are stored in the third location of the memory, yielding spatial clustered frequency filtered identified pixel values of the skin that are stored in a fourth location of the memory;

applying a second frequency filter to the spatial clustered frequency filtered identified pixel values of skin that are stored in the fourth location of the memory, yielding a temporal variation that is stored in a fifth location in the memory;

generating the biological vital sign in a sixth location of the memory from the temporal variation; and

displaying the biological vital sign from sixth location of the memory.

2. The method of claim 1, wherein the first frequency filter further comprises:

a high pass filter.

3. The method of claim 1, wherein the biological vital sign further comprises:

a pattern of blood flow.

4. The method of claim 3, wherein generating the pattern of blood flow from the temporal variation further comprises:

generating the pattern flow of blood from motion changes in the pixels and color changes of the temporal variation in the skin.

5. The method of claim 1, wherein the biological vital sign further comprises:

a heartrate.

6. The method of claim 5, wherein generating the heartrate from the temporal variation further comprises:

generating the heartrate from a frequency spectrum of the temporal variation in a frequency range for heart beats.

7. The method of claim 1, wherein the biological vital sign further comprises:

a respiratory rate.

8. The method of claim 7, wherein generating the respiratory rate from the temporal variation further comprises:

generating respiratory rate from a motion of the pixels in a frequency range for respiration.

9. The method of claim 1, wherein the biological vital sign further comprises:

a blood pressure.

10. The method of claim 9, wherein generating the blood pressure from the temporal variation further comprises:

analyzing a motion of the pixels and at least one color change based on a clustering process and potentially temporal data from an infrared sensor.

11. A method of displaying a biological vital sign, the method comprising:

identifying pixel values of at least two images that are representative of skin, resulting in identified pixel values;

applying a first frequency filter to the identified pixel values, yielding frequency filtered identified pixel values of the skin;

applying spatial clustering to the frequency filtered identified pixel values of the skin, yielding spatial clustered frequency filtered identified pixel values of the skin;

applying a second frequency filter to the spatial clustered frequency filtered identified pixel values of skin, yielding a temporal variation;

generating the biological vital sign from the temporal variation; and

displaying the biological vital sign.

12. The method of claim 11, wherein the first frequency filter further comprises:

a high pass filter.

13. The method of claim 11, wherein the biological vital sign further comprises:

a pattern of blood flow.

14. The method of claim 13, wherein generating the pattern of blood flow from the temporal variation further comprises:

generating the pattern flow of blood from motion changes in the pixels and color changes of the temporal variation in the skin.

15. The method of claim 11, wherein the biological vital sign further comprises:

a heartrate.

16. The method of claim 15, wherein generating the heartrate from the temporal variation further comprises:

generating the heartrate from a frequency spectrum of the temporal variation in a frequency range for heart beats.

17. The method of claim 11, wherein the biological vital sign further comprises:

a respiratory rate.

18. The method of claim 17, wherein generating the respiratory rate from the temporal variation further comprises:

generating respiratory rate from a motion of the pixels in a frequency range for respiration.

19. The method of claim 11, wherein the biological vital sign further comprises:

a blood pressure.

20. The method of claim 19, wherein generating the blood pressure from the temporal variation further comprises:

analyzing a motion of the pixels and at least one color change based on a clustering process and potentially temporal data from an infrared sensor.