Method and system for processing a signal including at least a component representative of a periodic phenomenon in a living being

• US 8,649,562 B2
• Filed: 10/05/2010
• Issued: 02/11/2014
• Est. Priority Date: 10/06/2009
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips N.V.
• Inventors: De Haan, Gerard, Kirenko, Ihor Olehovych, Van Leest, Adriaan Johan
• Primary Examiner(s): Mehta, Bhavesh
• Assistant Examiner(s): Harandi, Siamak
• Application Number:
  US13/500,172
• Publication Number:
  US 20120195473A1
• Time in Patent Office: 1,225 Days
• Field of Search: None
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/30076 Plethysmography
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

A method of processing a signal including at least a component representative of a periodic phenomenon in a living being includes obtaining a sequence of images showing the living being, extracting at least one first signal having at least a component representative of a periodic phenomenon in a living being from the sequence of images using remote plethysmography. Separate data representative of at least a periodic component of motion of the living being are obtained by carrying out motion analysis of the sequence of images. The data are used at least to suppress a component of the first signal corresponding to the periodic component of motion of the living being. The method is unobtrusive to the living being, and the living being can be in motion.

Claims

1. Method of processing a signal including at least a component representative of a periodic phenomenon in a living being, including:

receiving a sequence of images showing the living being;

extracting at least one first signal having at least a component representative of a periodic phenomenon in a living being from the sequence of images using remote plethysmography;

obtaining separate data representative of at least a periodic component of motion of the living being by carrying out motion analysis of the sequence of images; and

using the data at least to suppress a component of the first signal corresponding to the periodic component of motion of the living being, wherein the method is unobtrusive to the living being, and wherein the living being can be in motion.

2. Method according to claim 1, wherein extracting the at least one first signal from the sequence of images includes obtaining values of a variable corresponding to a combination of pixel values from a respective image.

3. Method according to claim 2, wherein extracting the at least one first signal from the sequence includes determining only variations in the variable over the sequence.

4. Method according to claim 1, including calculating at least one motion vector for at least one subject represented in the images and analyzing a repetitiveness of motion vector values.

5. Method according to claim 4, including calculating motion vector values for each of a plurality of parts of a subject represented in the images.

6. Method according to claim 1, wherein obtaining separate data representative of at least a periodic component of motion includes quantifying spatial displacements of at least part of the living being.

7. Method according to claim 1, including

calculating at least one motion vector for at least one subject represented in the images,

filtering said at least one motion vector, and

subtracting the filtered motion vector from said first signal to suppress a component of the first signal corresponding to the periodic component of motion of the living being and to obtain a disturbance reduced first signal.

8. Method according to claim 7, wherein said filtering comprises adaptive filtering, wherein the coefficients of said filtering are adaptively updated.

9. Method according to claim 8, wherein the coefficients of said filtering are updated such that the energy of the disturbance reduced first signal is minimized.

10. Method according to claim 7, wherein at least two motion vectors, in particular in a first direction and a second direction perpendicular to the first direction, are separately calculated and separately filtered.

11. Method according to claim 1, including

selecting multiple regions of interest in the sequence of images,

extracting at least one first signal having at least a component representative of a periodic phenomenon in a living being from the sequence of images using remote plethysmography for each region of interest,

obtaining separate data representative of at least a periodic component of motion of the living being for each region of interest separately, and

determining if motion of the various regions of interest differs by less or more than a predetermined amount.

12. Method according to claim 11, including using the separate data at least to suppress a component of the first signal corresponding to the periodic component of motion of the living being individually for each region of interest using the associated separate data of the associated region of interest, if motion of the various regions of interest differs by more than said predetermined amount,

or based on single separate data formed based on the separate data associated with the regions of interest, if motion of the various regions of interest differs by less than said predetermined amount.

13. System for processing a signal including at least a component representative of a periodic phenomenon in a living being, including:

an interface for receiving a sequence of images showing the living being in an unobtrusive manner,

a processing system for extracting at least one first signal having at least a component representative of a periodic phenomenon in a living being from the sequence of images using remote plethysmography;

for obtaining separate data representative of at least a periodic component of motion of the living being;

for carrying out motion analysis of the sequence of images; and

for using the data to at least suppress a component of the first signal corresponding to the periodic component of motion of the living being, wherein the living being can be in motion.

14. A non-transitory computer readable storage medium storing a program which, when executed by a computer, causes the computer to perform a method of processing a signal including at least a component representative of a periodic phenomenon in a living being, said method comprising:

receiving a sequence of images showing the living being;

extracting at least one first signal having at least a component representative of a periodic phenomenon in a living being from the sequence of images using remote plethysmography;

obtaining separate data representative of at least a periodic component of motion of the living being by carrying out motion analysis of the sequence of images; and

using the data at least to suppress a component of the first signal corresponding to the periodic component of motion of the living being, wherein the method is unobtrusive to the living being, and wherein the living being can be in motion.

15. Method of processing a signal including at least a component representative of a periodic phenomenon in a living being, including:

extracting at least one first signal having at least a component representative of a periodic phenomenon in a living being;

obtaining separate data representative of at least a periodic component of motion of the living being, by obtaining a sequence of images showing the living being, synchronized with the at least one first signal, and carrying out motion analysis of the sequence of images;

using the data at least to suppress a component of the first signal corresponding to the periodic component of motion of the living being;

calculating at least one motion vector for at least one subject represented in the images;

filtering said at least one motion vector; and

subtracting the filtered motion vector from said first signal to suppress a component of the first signal corresponding to the periodic component of motion of the living being and to obtain a disturbance reduced first signal.

16. Method according to claim 15, wherein said filtering comprises adaptive filtering, wherein the coefficients of said filtering are adaptively updated.

17. Method according to claim 16, wherein the coefficients of said filtering are updated such that the energy of the disturbance reduced first signal is minimized.

18. Method according to claim 15, wherein at least two motion vectors, in particular in a first direction and a second direction perpendicular to the first direction, are separately calculated and separately filtered.