Detection of breathing in the bedroom

• US 9,993,193 B2
• Filed: 01/10/2012
• Issued: 06/12/2018
• Est. Priority Date: 01/12/2011
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Van Vugt, Henriette Christine, Derkx, Rene Martinus Maria, Heinrich, Adrienne
• Primary Examiner(s): Cheng, Jacqueline
• Assistant Examiner(s): PORTILLO, JAIRO H
• Application Number:
  US13/976,225
• Publication Number:
  US 20130289432A1
• Time in Patent Office: 2,345 Days
• Field of Search: None
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/0803 Recording apparatus specially adapted therefor
• CPC Class Codes: A61B 5/0816 Measuring devices for examining respiratory frequency measuring frequency of electric signals G01R23/00
• CPC Class Codes: A61B 5/1116 Determining posture transitions
• CPC Class Codes: A61B 5/4806 Sleep evaluation A61B5/4821 takes precedence; devices for inducing sleep A61M21/02
• CPC Class Codes: A61B 5/4809 Sleep detection, i.e. determining whether a subject is asleep or not
• CPC Class Codes: A61B 5/4818 Sleep apnoea
• CPC Class Codes: A61B 5/6891 Furniture
• CPC Class Codes: A61B 7/003 Detecting lung or respiration noise

Abstract

A method and a system for unobtrusively measuring a person'"'"'s respiration, wherein at least two microphones positioned at either side of a person'"'"'s head are utilized based on a distance of the persons head to the microphones and an identification of which microphone is in a line of sight and which is out of the line of site of the person'"'"'s breathing as computed on the basis of images captured by a video camera.

Claims

1. A method of operating a system for unobtrusively measuring a person'"'"'s respiration, the method comprising acts of:

capturing images of a person lying down or lying in bed, by at least one video camera,

analyzing the images, to determine the rotation of the head of the person about the longitudinal axis of a body of the person,

determining by the video processor, from the images and rotation of the head which of at least two microphones is a microphone in a line-of-sight of the person'"'"'s breathing and which of the at least two microphones is a microphone not in the line-of-sight of the person'"'"'s breathing,

computing from the images by the video processor, a distance from the person'"'"'s head to each of the at least two microphones positioned on opposite sides of the person'"'"'s head, and

measuring by an audio analyzer, the person'"'"'s respiration depending on the distances from the head to each microphone computed by the video processor and on the determination by the video processor of which of the at least two microphones is the microphone in the line-of-sight and which of the at least two microphones is the microphone not in the line-of-sight, as parameters.

2. The method according to claim 1, comprising acts of analyzing the captured images for motion of a whole body of the person, determining a main body axis of the person, and extracting a last top movement of the main body axis.

3. The method according to claim 1, comprising acts of analyzing the images for a distribution and/or pattern of light reflected from a blanket covering the person, and determining a position the person is lying in.

4. The method according to claim 1, comprising an act of steering the at least two microphones using the parameters such that the microphone in the line-of-sight is steered towards the person'"'"'s head and the microphone not in the line-of-sight is steered perpendicular to a noise source.

5. The method according to claim 4, wherein the at least two microphones are steered mechanically or electronically.

6. The method according to claim 1, comprising an act of processing signals from the at least two microphones using a digital signal processor leading to an enhanced signal output from the digital signal processor.

7. The method according to claim 1, comprising an act of adaptively filtering signals from the at least two microphones wherein a signal from the microphone out of the line-of-sight of the person'"'"'s breathing is used to estimate noise in the microphone in the line-of-sight of the person'"'"'s breathing wherein the noise is subtracted from the signal of the microphone in the line-of-sight of the person'"'"'s breathing, the adaptive filtering leading to an enhanced signal output from the adaptive filter.

8. The method according to claim 1, wherein the act of analyzing the images comprises acts of determining when the person'"'"'s head first touches a pillow on the bed, deter mining an orientation of the person'"'"'s head relative to the at least two microphones and computing motion vectors to track the position and orientation of the persons head relative to the at least two microphones to provide an updated position and orientation of the person'"'"'s head relative to the at least two microphones as the person moves.

9. The method according to claim 1, wherein the act of analyzing the images comprises an act of determining whether the person is lying in a supine position, a prone position, a lateral position facing left or a lateral position facing right.

10. The method according to claim 1, comprising an act of steering the at least two microphones using the parameters such that the microphone in line-of-sight is steered towards the person'"'"'s head and the microphone not in line-of-sight is steered to place a spatial notch of the microphone towards a noise source.

11. A system for unobtrusively measuring a person'"'"'s respiration, the system comprising:

at least one video camera configured to capture images of a person lying down or lying in bed,

at least two microphones positioned on opposite sides of the person'"'"'s head,

a video processor configured to analyze the images, to determine the rotation of a head of the person about the longitudinal axis of a body of the person,

the video processor configured to determine from the rotation of the head and the images, which of the at least two microphones is a microphone in a line-of-sight of the person'"'"'s breathing and which of the at least two microphones is a microphone not in the line-of-sight of the person'"'"'s breathing,

the video processor configure to compute a distance from the person'"'"'s head to each of the at least two microphones positioned on opposite sides of the person'"'"'s head, and

an audio analyzer configured to measure the person'"'"'s respiration depending on the distances from the head to each microphone computed by the video processor, and depending on the determination of which of the at least two microphones is the microphone in the line-of-sight and which of the at least two microphones is the microphone not in the line-of-sight, as parameters.

12. The system of claim 11, wherein the audio analyzer comprises one or more of:

a digital signal processor and an adaptive filter.