Holistic hospital patient care and management system and method for automated facial biological recognition

• US 10,593,426 B2
• Filed: 04/09/2015
• Issued: 03/17/2020
• Est. Priority Date: 09/13/2012
• Status: Active Grant

• Current Assignee: Pieces Technologies, Inc.
• Original Assignee: Parkland Center for Clinical Innovation
• Inventors: Amarasingham, Rubendran, Oliver, George R., Shah, Anand R., Siva, Vaidyanatha, Lucena, Brian O., Shah, Monal, Cherian, Praseetha, Ballard, Spencer, McGinn, Jason
• Primary Examiner(s): Pellett, Daniel T
• Application Number:
  US14/682,745
• Publication Number:
  US 20150213207A1
• Time in Patent Office: 1,804 Days
• Field of Search: None
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: G16H 50/70 for mining of medical data, e.g. analysing previous cases of other patients

Abstract

A holistic hospital patient care and management system comprises a data store operable to receive and store patient data including clinical and non-clinical data; a plurality of video cameras to capture images of the patients; a plurality of presence detection sensors to detect the presence and location of the patients; a risk logic module configured to apply at least one predictive model to the clinical and non-clinical data, including the captured images, to determine at least one risk score associated with the patients; a facial biological change logic module configured to receive location data from the plurality of presence detection sensors, the risk score and medical condition associated with the patients, and captured images of the patients, and generating an alert in response to a detected change in biological change of a patient.

Claims

1. A holistic hospital patient care and management system comprising:

a data store operable to receive and store data associated with a plurality of patients including clinical and non-clinical data, the clinical data are selected from at least one member of the group consisting of;

vital signs and other physiological data;

data associated with physical exams by a physician, nurse, or allied health professional;

medical history;

allergy and adverse medical reactions;

family medical information;

prior surgical information;

emergency room records;

medication administration records;

culture results;

dictated clinical notes and records;

gynecological and obstetric information;

mental status examination;

vaccination records;

radiological imaging exams;

invasive visualization procedures;

psychiatric treatment information;

prior histological specimens;

laboratory data;

genetic information;

physician'"'"'s and nurses'"'"' notes;

networked devices and monitors;

pharmaceutical and supplement intake information; and

focused genotype testing; and

the non-clinical data are selected from at least one member of the group consisting of;

social, behavioral, lifestyle, and economic data;

type and nature of employment data;

job history data;

medical insurance information;

hospital utilization patterns;

exercise information;

addictive substance use data;

occupational chemical exposure records;

frequency of physician or health system contact logs;

location and frequency of habitation change data;

predictive screening health questionnaires;

personality tests;

census and demographic data;

neighborhood environment data;

dietary data;

participation in food, housing, and utilities assistance registries;

gender;

marital status;

education data;

proximity and number of family or care-giving assistant data;

address data;

housing status data;

social media data;

educational level data; and

data entered by patients;

a plurality of video cameras installed at various locations in the hospital configured for capturing facial images of at least one of the plurality of patients;

a plurality of presence detection sensors configured to detect a plurality of tags associated with a plurality of patients to enable real-time tracking location and status;

at least one predictive model including a plurality of weighted risk variables and risk thresholds in consideration of the clinical and non-clinical data including patient location and captured images, and configured to identify at least one medical condition associated with the at least one patient;

a risk logic module configured to apply the at least one predictive model to the clinical and non-clinical data, including the captured facial images, to determine at least one risk score associated with each of the plurality of patients, and to stratify the risks associated with the at least one patient in response to the risk scores;

a facial biological change logic module configured to receive location data from the plurality of presence detection sensors, the risk score and medical condition associated with the at least one patient, and captured facial images of the at least one patient, analyze the captured facial images, and generating an alert in response to a detected change in biological change of the at least one patient; and

a data presentation module configured to present the alert to a medical staff via a specified device.

2. The system of claim 1, wherein the specified device is selected from the group consisting of a mobile telephone, a laptop, a desktop computer, and a display monitor.

3. The system of claim 1, wherein the risk logic module further comprises a disease identification logic module configured to analyze the clinical and non-clinical data, including the captured facial images, associated with the at least one patient and identify the at least one medical condition associated with the at least one patient.

4. The system of claim 1, wherein the risk logic module further comprises a natural language processing and generation logic module configured to process and analyze clinical and non-clinical data expressed in natural language, and to generate an output expressed in natural language.

5. The system of claim 1, wherein the risk logic module further comprises an artificial intelligence logic module configured to detect, analyze, and verify trends indicated in the clinical and non-clinical data and modify the plurality of weighted risk variables and risk thresholds in response to detected and verified trends indicated in the clinical and non-clinical data.

6. The system of claim 1, wherein the data presentation module is configured to display a list of patients and location and alert status thereof.

7. The system of claim 1, wherein the facial biological change logic module is configured to analyze changes in color and expression in the patient'"'"'s face.

8. A holistic hospital patient care and management system, comprising:

a repository of patient data including clinical and non-clinical data associated with a plurality of patients updated and received from a plurality of clinical and social service organizations and data sources;

a plurality of presence detection sensors configured to detect a plurality of tags associated with a plurality of medical resources and supplies to enable real-time tracking location and status;

a plurality of presence detection sensors configured to detect a plurality of tags associated with a plurality of patients to enable real-time tracking location and status;

a plurality of cameras distributed in the hospital and configured to capture facial images of the plurality of patients;

at least one predictive model using clinical and social factors derived from the patient data to extract both explicitly encoded information and implicit information about the patient'"'"'s clinical and non-clinical data, including the captured facial images, to identify at least one medical condition requiring medical care associated with at least one patient;

a risk logic module configured to apply the at least one predictive model to the clinical and non-clinical data, including the captured facial images, to determine at least one risk score associated with the at least one patient, and to stratify the patient'"'"'s risk associated with the at least one patient related to the at least one medical condition in response to the risk score;

a facial biological change logic module configured to receive location data from the plurality of presence detection sensors associated with the plurality of patients, the risk score and medical condition associated with the at least one patient, and captured facial images of the at least one patient, analyze the captured facial images, and generating an alert in response to a detected facial change associated in the at least one patient; and

a data presentation module configured to present the alert to a medical staff via a specified device.

9. The system of claim 8, wherein the specified device is selected from the group consisting of a mobile telephone, a laptop, a desktop computer, and a display monitor.

10. The system of claim 8, wherein the risk logic module further comprises a disease identification logic module configured to analyze the clinical and non-clinical data, including the captured facial images, associated with a particular patient and identify the at least one medical condition associated with the patient.

11. The system of claim 8, wherein the risk logic module further comprises a natural language processing and generation logic module configured to process and analyze clinical and non-clinical data expressed in natural language, and to generate an output expressed in natural language.

12. The system of claim 8, wherein the risk logic module further comprises an artificial intelligence logic module configured to detect, analyze, and verify trends indicated in the clinical and non-clinical data, including the captured facial images, and modify the plurality of weighted risk variables and risk thresholds in response to detected and verified trends indicated in the clinical and non-clinical data.

13. The system of claim 8, wherein the data presentation module is configured to identify the at least one patient and an alert associated with the at least one patient.

14. The system of claim 8, wherein the facial biological change logic module is configured to analyze changes in color and expression in the patient'"'"'s face.

15. A holistic hospital patient care and management method, comprising:

receiving real-time patient data including clinical and non-clinical data associated with a plurality of patients admitted to a hospital;

receiving real-time location data from a plurality of RFID sensors configured to detect a plurality of RFID tags associated with the plurality of patients;

receiving real-time facial images of the plurality of patients and analyzing the facial images for biological changes in the plurality of patients;

applying a set of at least one predictive model using clinical and social factors derived from the patient data to extract and translate both structured and unstructured information about the patient'"'"'s clinical and non-clinical data, including the captured facial images, to identify at least one patient having at least one medical condition requiring medical care;

accessing the patient data associated with the plurality of patients, pre-processing the patient data, and applying a predictive model to analyze the patient data for the plurality of patients; and

generating an alert in response to detecting an adverse biological change in at least one of the plurality of patients.

16. The method of claim 15, further comprising analyzing the clinical and non-clinical data, including the captured facial images, associated with a particular patient and identifying the at least one medical condition associated with the patient.

17. The method of claim 15, further comprising processing and analyzing clinical and non-clinical data expressed in natural language, and to generate an output expressed in natural language.

18. The method of claim 15, wherein analyzing the facial images comprises identifying certain facial expressions indicative of adverse biological changes.

19. The method of claim 15, wherein analyzing the facial images comprises identifying certain changes in facial coloration indicative of adverse biological changes.