BABY MONITOR

• US 20180053392A1
• Filed: 07/24/2017
• Published: 02/22/2018
• Est. Priority Date: 08/19/2016
• Status: Abandoned Application

• Current Assignee: Miku, Inc.
• Original Assignee: EGW Technologies LLC
• Inventors: White, Eric Gregory, Abrams, David Robert
• Application Number:
  US15/658,271
• Publication Number:
  US 20180053392A1
• Time in Patent Office: Days
• CPC Class Codes: A61B 2503/04 Babies, e.g. for SIDS detection
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/725 using specific filters therefor, e.g. Kalman or adaptive filters A61B5/316 take precedence
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/7278 Artificial waveform generation or derivation, e.g. synthesising signals from measured signals A61B5/327 takes precedence
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 7/00 Instruments for auscultation
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30076 Plethysmography
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G08B 21/0208 Combination with audio or video communication, e.g. combination with "baby phone" function
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Systems and methods are described herein for monitoring and capturing information associated with target subjects, such as babies. For example, the systems and methods provide a capture device, such as a camera, that captures capture time of flight (TOF) data from a target subject. Using the TOF data, the systems and methods, via a display device associated with (e.g., paired to) the capture device, present information about the target subject, such as information indicating movement of the target subject, information indicating a breathing rate of the target subject, information indicating a heart rate of the target subject, and so on.

Claims

1. A baby monitor, comprising:

a capture device that monitors a baby, the capture device including;

one or more infrared light components;

an infrared sensor that captures infrared measurements for the monitored baby;

a time of flight (TOF) sensor that captures TOF data for the monitored baby; and

a movement determination module that determines a state of movement of the monitored baby based on the TOF data for the monitored baby that is captured by the TOF sensor.

2. The baby monitor of claim 1, further comprising:

a display device that displays a visual image of the monitored baby based on data received from the capture device, the display device including;

an indication module that causes the display device to;

present a first indicator associated with movement of the monitored baby; and

present a second indicator associated with breathing of the monitored baby.

3. The baby monitor of claim 1, wherein the TOF sensor captures depth images associated with the monitored baby that include pixels representing distances to one or more areas of the monitored baby.

4. The baby monitor of claim 1, wherein the TOF sensor captures depth images associated with a torso of the monitored baby.

5. The baby monitor of claim 1, wherein the TOF sensor captures depth images associated with one or more limbs of the monitored baby.

6. The baby monitor of claim 1, wherein the capture device includes a stand configured to position the TOF sensor proximate to the monitored baby or a mount configured to attach the capture device to a crib in which the monitored baby is sleeping.

7. The baby monitor of claim 1, wherein the capture device further includes:

an RGB camera configured to capture RGB images of the monitored baby; and

a microphone configured to capture audio data associated with the monitored baby.

8. A system for presenting images of a monitored baby, the system comprising:

a display module that causes a user interface associated with the system to present a visual image of the monitored baby based on RGB data or infrared data captured by one or more image sensors proximate to the monitored baby;

a movement determination module that determines a state of movement of the monitored baby based on TOF data for the monitored baby that is captured by a TOF sensor proximate to the monitored baby; and

an indication module that causes the user interface to;

present a first indicator associated with movement of the monitored baby based on the determined state of movement of the monitored baby; and

present a second indicator associated with breathing of the monitored baby based on the determined state of movement of the monitored baby.

9. The system of claim 8, wherein the display module is part of a stand-alone display device that is communicatively paired to a capture device that is positioned proximate to the monitored baby and includes the movement determination module.

10. The system of claim 8, wherein the display module is part of a mobile device that receives data from a capture device that is positioned proximate to the monitored baby and includes the movement determination module.

11. The system of claim 8, wherein the TOF data includes depth images associated with the monitored baby that include pixels representing distances to one or more areas of the monitored baby.

12. The system of claim 8, wherein the indication module presents the first indicator associated with movement of the monitored baby over an image of an area of the monitored baby determined to be moving based on the determined state of movement.

13. The system of claim 8, wherein the indication module presents the second indicator associated with breathing of the monitored baby over an image of a torso of the monitored baby when the monitored baby is determined to be breathing based on the determined state of movement.

14. The system of claim 8, wherein the indication module further presents present a third indicator associated with a heart rate of the monitored baby based on the determined state of movement of the monitored baby.

15. The system of claim 8, further comprising:

an alert module that invokes an alert when the determined state of movement falls outside a threshold range of values associated with a suitable breathing rate for the monitored baby.

16. The system of claim 8, further comprising:

an alert module that invokes an alert when the determined state of movement falls outside a threshold range of values associated with movement of the monitored baby.

17. The system of claim 8, wherein the movement determination module determines the state of movement of the monitored baby based on determining pixel velocities for one or more areas of the monitored baby that are based on the TOF data.

18. A method performed by a baby monitor, the method comprising:

receiving depth image data from a depth image sensor proximate to a target subject; and

determining a movement status and breathing status of the target subject based on the received depth image data.

19. The method of claim 18, wherein the received depth image data includes time of flight (TOF) depth images associated with the target subject that include pixels representing distances to one or more areas of the target subject.

20. The method of claim 18, wherein determining a movement status and breathing status of the target subject based on the received depth image data includes determining pixel velocities for pixels representing one or more areas of the target subject that are based on the depth image data.