Method for extracting heart information based on micro movements of human body

• US 10,102,343 B2
• Filed: 04/14/2015
• Issued: 10/16/2018
• Est. Priority Date: 11/18/2014
• Status: Active Grant

• Current Assignee: Sangmyung University Industry-Academy Cooperation Foundation
• Original Assignee: Sangmyung University Industry-Academy Cooperation Foundation
• Inventors: Hwang, Sung Teac, Whang, Min Cheol, Park, Sang In, Lee, Dong Won
• Primary Examiner(s): Strege, John
• Application Number:
  US15/526,784
• Publication Number:
  US 20170323072A1
• Time in Patent Office: 1,281 Days
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/02028 Determining haemodynamic parameters not otherwise provided for, e.g. cardiac contractility or left ventricular ejection fraction
• CPC Class Codes: A61B 5/0255 Recording instruments specially adapted therefor
• CPC Class Codes: A61B 5/1102 Ballistocardiography
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/15 Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

A method of extracting heart information from a body micro-movement is provided. The method includes a face tracking step, a frame difference averaging step, smoothing filtering step, and a sliding peak detection step.

Claims

1. A method of detecting heart information from a body micro-movement, the method comprising:

generating image data by photographing a micro-movement of a subject;

performing face tracking on the subject while generating the image data;

extracting body micro-movement information of the subject by processing the image data;

performing sliding peak detection; and

extracting heart information from the body micro-movement information

wherein the extracting of the body micro-movement information comprises extracting an amount of an entirety of the micro-movement by calculating a difference between average movements in a previous state and a current state by calculating a difference between average of frames of movement data of an image measured at regular intervals.

2. The method of claim 1, wherein the body micro-movement information undergoes smoothing filtering to increase accuracy of peak detection.

3. A system for detecting heart information from a body micro-movement by performing the method of claim 1, the system comprising:

a camera configured to generate the image data;

a data processor configured to process the image data from the camera; and

an analyzer configured to analyze data obtained by the data processor to detect a micro-movement and detect the heart information from the micro-movement.

4. The system of claim 3, wherein the analyzer is configured to also perform smoothing filtering to remove noise from the body micro-movement information, before performing the sliding peak detection.

5. A system for detecting heart information from a body micro-movement by performing the method of claim 2, the system comprising:

a camera configured to generate the image data;

a data processor configured to process the image data from the camera; and

an analyzer configured to analyze data obtained by the data processor to detect a micro-movement and detect the heart information from the micro-movement.

6. The system of claim 5, wherein the analyzer is configured to also perform smoothing filtering to remove noise from the body micro-movement information, before performing the sliding peak detection.