System and method for determining video-based pulse transit time with time-series signals

• US 9,351,649 B2
• Filed: 09/13/2013
• Issued: 05/31/2016
• Est. Priority Date: 02/21/2012
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Mestha, Lalit Keshav, Kyal, Survi
• Primary Examiner(s): Chen, Tse
• Assistant Examiner(s): HOFFMAN, JOANNE M
• Application Number:
  US14/026,739
• Publication Number:
  US 20140012142A1
• Time in Patent Office: 991 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/02125 of pulse wave propagation time
• CPC Class Codes: A61B 5/02427 Details of sensor
• CPC Class Codes: G06T 2207/30076 Plethysmography
• CPC Class Codes: G06T 2207/30104 Vascular flow; Blood flow; Perfusion
• CPC Class Codes: G06T 7/0012 Biomedical image inspection

Abstract

What is disclosed is a system and method for determining a subject of interest'"'"'s arterial pulse transit time from time-varying source signals generated from video images. In one embodiment, a video imaging system is used to capture a time-varying source signal of a proximal and distal region of a subject of interest. The image frames are processed to isolate localized areas of a proximal and distal region of exposed skin of the subject. A time-series signal for each of the proximal and distal regions is extracted from the source video images. A phase angle is computed with respect to frequency for each of the time-series signals to produce respective phase v/s frequency curves for each region. Slopes within a selected cardiac frequency range are extracted from each of the phase curves and a difference is computed between the two slopes to obtain an arterial pulse transit time for the subject.

Claims

1. A method for determining an arterial pulse transit time between a proximal and distal region of a subject of interest from source video images acquired using a video imaging system, the method comprising:

receiving time-varying source images acquired over at least one channel of a video imaging system, said source images comprising video images captured of a proximal and distal region of an area of exposed skin of a subject of interest in which plethysmographic signals can be registered and at least one background region in which plethysmographic signals cannot be registered, and said proximal and distal regions and said background region being exposed to the same environmental factors;

extracting, from said source images a first time-series signal for said proximal region and a second times series signal for said distal region and at least one background region time-series signal;

subtracting said first time-series signal and said background region times-series signal to obtain environmentally compensated time-series signal for said proximal region;

subtracting said second time-series signal and said background region times-series signal to obtain environmentally compensated time-series signal for said distal region;

computing a first phase angle φ

₁(ω

) with respect to frequency ω

of said environmentally compensated time-series signal for said proximal region;

computing a second phase angle φ

₂(ω

) with respect to frequency ω

of said environmentally compensated time-series signal for said distal region;

plotting said computed phases with respect to frequency to obtain respective phase vs frequency curves for each of said proximal and distal regions;

computing respective slopes T₁=∂

φ

₁/∂

ω and

T₂=∂

φ

₂/∂

ω

within a defined cardiac frequency range between 0.75 to 4.0 Hz from each of said respective phase vs frequency curves;

computing a difference between said slopes T₁ and T₂, said difference comprising an arterial pulse transit time for said subject between said proximal and distal regions; and

storing, using a processor, said arterial pulse transit time to a storage device.

2. The method of claim 1, wherein said time-varying source signal comprises any combination of:

NIR images, RGB images, RGB with NIR images, multispectral images, thermal images, and hyperspectral images.

3. The method of claim 1, further comprising determining, from said arterial pulse transit time, any of:

a blood pressure in said subject'"'"'s vascular network, a blood vessel dilation over time, a blood vessel blockage, a blood flow velocity, and the existence of a peripheral neuropathy.

4. The method of claim 1, further comprising:

processing said video images to determine a region of skin; and

isolating said proximal and distal regions from said skin regions.

5. The method of claim 1, wherein said video images are acquired by a single NIR channel, further comprising:

partitioning frames from said channel for each region into a non-skin region and a skin region; and

performing source separation to obtain both a heart rate signal and said phase vs frequency curve.

6. The method of claim 1, wherein, in advance of extracting said time-series signals, further comprising compensating for any of:

a motion induced blur, an imaging blur, harmonics which are not related to components of said subject'"'"'s cardiac pulse, and slow illuminant variation.

7. The method of claim 1, wherein said video imaging system used to acquire said time-varying source images of said proximal and distal regions comprises two video cameras, a first video camera acquiring a first video of said proximal region and a second video camera acquiring a second video of said distal region.

8. The method of claim 7, wherein, in advance of extracting said time-series signals, further comprising synchronizing said first and second videos with respect to time.

9. The method of claim 1, wherein the video imaging system is used in a non-contact, remote sensing environment.

19. The method of claim 1, wherein said time-varying source is a single color channel.

20. The method of claim 19, wherein said single color channel is a green color channel.

21. The method of claim 1, wherein said computing said respective slopes includes fitting a polynomial equation to each of said phase vs frequency curves.

22. The method of claim 1, wherein said computing said respective slopes includes computing a derivative with respect to frequency.

10. A video based system for determining an arterial pulse transit time between a proximal and distal region of a subject of interest from source video images acquired using a video camera, the system comprising:

a video imaging system for capturing a time-varying source images over at least one channel, said source images comprising video images captured of a proximal and distal region of an exposed area of skin of a subject of interest where an arterial pulse transit time is desired to be determined; and

a processor in communication with said video camera and a memory, said processor executing machine readable instructions for performing;

receiving time-varying source images acquired over at least one channel of a video imaging system, said source images comprising video images captured of a proximal and distal region of an area of exposed skin of a subject of interest in which plethysmographic signals can be registered and at least one background region in which plethysmographic signals cannot be registered, and said proximal and distal regions and said background region being exposed to the same environmental factors;

extracting, from said source images a first time-series signal for said proximal region and a second times series signal for said distal region and at least one background region time-series signal;

subtracting said first time-series signal and said background region times-series signal to obtain environmentally compensated time-series signal for said proximal region;

subtracting said second time-series signal and said background region times-series signal to obtain environmentally compensated time-series signal for said distal region;

computing a first phase angle φ

₁(ω

) with respect to frequency ω

of said environmentally compensated time-series signal for said proximal region;

computing a second phase angle φ

₂(ω

) with respect to frequency ω

of said environmentally compensated time-series signal for said distal region;

plotting said computed phases with respect to frequency to obtain respective phase vs frequency curves for each of said proximal and distal regions;

computing respective slopes T₁=∂

φ

₁/∂

ω and

T₂=∂

φ

₂/∂

ω

within a defined cardiac frequency range between 0.75 to 4.0 Hz from each of said respective phase vs frequency curves;

computing a difference between said slopes T₁ and T₂, said difference comprising an arterial pulse transit time for said subject between said proximal and distal regions; and

storing, using a processor, said arterial pulse transit time to a storage device.

11. The system of claim 10, wherein said time-varying source signal comprises any combination of:

NIR images, RGB images, RGB with NIR images, multispectral images, thermal images, and hyperspectral images.

12. The system of claim 10, further comprising determining, from said arterial pulse transit time, any of:

a blood pressure in said subject'"'"'s vascular network, a blood vessel dilation over time, a blood vessel blockage, a blood flow velocity, and the existence of a peripheral neuropathy.

13. The system of claim 10, further comprising:

processing said video images to determine a region of skin; and

isolating said proximal and distal regions from said skin regions.

14. The system of claim 10, wherein said video images are acquired by a single NIR channel, further comprising:

partitioning frames from said channel for each region into a non-skin region and a skin region; and

performing source separation to obtain both a heart rate signal and said phase vs frequency curve.

15. The system of claim 10, wherein, in advance of extracting said time-series signals, further comprising compensating for any of:

a motion induced blur, an imaging blur, harmonics which are not related to components of said subject'"'"'s cardiac pulse, and slow illuminant variation.

16. The system of claim 10, wherein said video imaging system used to acquire said time-varying source images of said proximal and distal regions comprises two video cameras, a first video camera acquiring a first video of said proximal region and a second video camera acquiring a second video of said distal region.

17. The system of claim 16, wherein, in advance of extracting said time-series signals, further comprising synchronizing said first and second videos with respect to time.

18. The system of claim 10, wherein the video imaging system is used in a non-contact, remote sensing environment.

23. The system of claim 10, wherein said time-varying source is a single color channel.

24. The system of claim 23, wherein said single color channel is a green color channel.

25. The system of claim 10, wherein said computing said respective slopes includes fitting a polynomial equation to each of said phase vs frequency curves.

26. The system of claim 10, wherein said computing said respective slopes includes computing a derivative with respect to frequency.