Wireless Augmented Video System and Method to Detect and Prevent Insurance Billing Fraud and Physical Assault for Remote Mobile Application
1. The wireless augmented video name badge system for monitoring caregivers comprising:
- A cloud system monitoring center;
A wireless wearable monitoring devices which includes;
(i) a wireless wearable nametag apparatus with main housing body configured to house the electronic components devices;
wherein the electronic devices and components includes;
at least one processor with analyzing algorithms configured to collect and analyze data from all the electronic devices and components and to transmit augmented data to the cloud system monitoring center;
a plurality of wide angle web cameras in communication with processor configured for omnidirectional 360 degree monitoring and recording;
at least one fingerprint scanner in communication with processor configured for providing one biometric key for the three step biometric authentication of caregiver;
at least one infrared thermal imaging camera with IFR lights configured to scan face and retina as second step of three step biometric authentication of caregiver;
at least microphone and speaker configured to record audio communication and to sound an alarm respectively;
at least one GPS unit configured to transfer real time location data to the cloud monitoring system in respect of predefined geo-fenced location of the patient;
at least one SIM slot with SIM card configured to communicate and send/receive the augmented data over cellular network;
at least one color touch screen configured to display information of caregiver;
at least one Bluetooth module configured to allow communication between wireless wearable monitoring devices; and
at least one of Status indicating LEDs USB port, Power port, HDMI port, memory unit, Wi-Fi module and RFID receiver.and;
(ii) a wearable wristband.
The present invention discloses a wireless augmented multi camera video system and method for remote and mobile application and necessary to the collection and processing of geospatial, thermodynamic, biomechanical and biometric data need to monitor a caregiver and their actions and movements in a plurality of patient location; the collected data is encrypted then embedded in an augmented audio and visual compressed binary stream transmitted in real time to detect and provide actionable intelligence supported by verifiable empirical sensor evidence of possible medical insurance billing fraud, drug or other theft and elder patient or child abuse by the caregivers. The wireless augmented system comprises; a wireless augmented monitoring devices, a cloud system monitoring center, a caregiver employing agency, a caregiver and a person in need of care. The wireless wearable augmented monitoring devices further includes a smart wearable nametag apparatus and smart wearable wristband which are configured to receive the video data, biometric and other sensor data, and location information of the caregiver to generate augmented video stream by periodically marking the video data with contemporaneous location information and sensor data; and a wireless cellular transceiver configured within the nametag apparatus to automatically stream the augmented video stream in response to an event detected via at least one of the one or more sensors or in response to a determined location, embedded in captured audio and video data are time stamps, the home health care agency operator'"'"'s unique user identification number [UUID], the unique user biometric identification number [UUBID] of the current user, the GPS data, and the sensor data. The nametag apparatus also incorporates a memory element to buffer the augmented data prior to transmission, a SIM card to connect to any available data cellular network, a Bluetooth to connect peripheral devices, a Wi-Fi component, color LCD screen for displaying current caregiver'"'"'s name and photograph on the name tag, and LED power status display, a microphone, speaker and a micro USB port.
- 1. The wireless augmented video name badge system for monitoring caregivers comprising:
A cloud system monitoring center; A wireless wearable monitoring devices which includes; (i) a wireless wearable nametag apparatus with main housing body configured to house the electronic components devices;
wherein the electronic devices and components includes;
at least one processor with analyzing algorithms configured to collect and analyze data from all the electronic devices and components and to transmit augmented data to the cloud system monitoring center; a plurality of wide angle web cameras in communication with processor configured for omnidirectional 360 degree monitoring and recording; at least one fingerprint scanner in communication with processor configured for providing one biometric key for the three step biometric authentication of caregiver; at least one infrared thermal imaging camera with IFR lights configured to scan face and retina as second step of three step biometric authentication of caregiver; at least microphone and speaker configured to record audio communication and to sound an alarm respectively; at least one GPS unit configured to transfer real time location data to the cloud monitoring system in respect of predefined geo-fenced location of the patient; at least one SIM slot with SIM card configured to communicate and send/receive the augmented data over cellular network; at least one color touch screen configured to display information of caregiver; at least one Bluetooth module configured to allow communication between wireless wearable monitoring devices; and at least one of Status indicating LEDs USB port, Power port, HDMI port, memory unit, Wi-Fi module and RFID receiver. and; (ii) a wearable wristband.
- View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 18)
- 15. The wireless wearable nametag apparatus comprises:
A main housing body configured to house the electronic components devices; wherein the electronic devices and components includes; at least one GPS unit configured to transfer real time location data to the cloud monitoring system; at least one color touch screen configured to display information of caregiver;
- View Dependent Claims (16, 17)
- 19. (canceled)
- 20. (canceled)
- 21. (canceled)
- 22. (canceled)
- 23. (canceled)
- 24. (canceled)
The present invention relates to a remote caregiver monitoring system and method, and more particularly, an augmented real time multiple video streams that provide geospatial motion detection and thermodynamics monitoring and biometric data as encrypted actionable intelligence on the identity, actions and movements of one or more caregivers in confined spaces to detect possible medical insurance billing or physical abuse as they interact with patients.
Today, there is a major shift towards “aging in place” as most adults prefer the comfort and privacy of their own homes for as long as possible. The result is that healthcare in the home is now an increasing focus for members of the public, whether as patients, family members, relatives or friends; healthcare professionals; politicians; healthcare administrators; and the media. The public focus is not on cost savings, but rather on the personalization of institutions and the public expectation that care would be better at home.
Development in technologies are also driving the change in sites of care from the acute care hospital to many other settings including long term care settings, nursing homes, group homes, daycare and care in the home. Public spending on federal healthcare programs is growing rapidly, primarily driven by (1) the rising enrollment-streaming from the aging of the population and (2) expansion of federal abuse and its prevention programs increasing the spending per enrollee.
According to one survey National health expenditure for elderly care in the U.S alone was worth more than $300 billion in 2016. It is estimated by the U.S Census Bureau that in the year 2050, there will be 83.7 million people in the United States alone who will be 65 years old or older.
This rapid growth in federal and state funding of home care has seen an increase in the number of agencies and caregivers required to service a growing public demand for in-home health care. A consequence of this growth is a greater frequency of compliance and billing concerns leading to fraud and elder abuse. Home health has long been recognized as a program area vulnerable to fraud, waste and abuse.
State and federal funding to aged care providers is delivered in three streams: behavioral assistance, physical assistance, and complex care needs.
All these three streams are delivered to elders and the disabled in private homes or assisted living facilities. In all three cases caregivers spend significant amounts of unmonitored time alone with the person under their care.
There is caregiver interaction when alone with a patient. The absence of any reliable caregiver and patient real time monitoring tool, provides opportunity for both fraud and elder abuse. The government centers for Medicare (CMS), state Medicaid agencies (SMA) and the Medicaid Fraud Control Units (MFCU) of the US government have committed significant financial and human resources to advancing the fight against the home health fraud, waste, physical and mental abuse. They have mandated to partner with private sector partners to save and recoup taxpayer money.
The aggregate financial loss to government and the private sector is estimated in the tens of billions of dollars annually. In fiscal 2015, the CMS estimated that government agencies alone made more than $10 billion improper payments to home healthcare agencies resulting in more than 350 criminal and civil actions that year alone.
Collaboration with private sector partners is critical for development of hardware and software tools capable of (1) detecting billing fraud at the source and in real time when committed by caregivers or homecare agency providers when reporting billing hours or services delivered by otherwise unmonitored caregivers; (2) deterring physical and mental abuse of patients by unmonitored caregivers; (3) preventing occurrence of false claims by patients or family members of alleged physical and mental abuse by an unmonitored caregivers.
The principle problem with current billing fraud detection methods is that detection occurs only after the fact of an insurance payment and looks for a long pattern of accounting anomalies making it unreliable, slow and costly. Current fraud detection, reporting and investigative methodologies, strategies and techniques exclusively rely on accounting entries and a pattern of statistically significant fraudulent payouts to occur before detection is possible. Again the problem with this current method of data analysis, statistical sampling, predictive modeling and investigation support analytics to uncover health care billing fraud detection is that it is possible only after the fact of a payout. As a result, this requires taxpayers and private insurers to suffer significant financial losses before statically significant accounting data is collected for any successful incorporation into a criminal or civil case thereby making the recovery of taxpayer money unlikely and prevention almost impossible.
Furthermore, current government methods of data analytical techniques cannot visualize physical or mental abuse of patients by caregivers as a pattern, and cannot prove or disprove claims of physical or mental abuse.
Additional problems include caregiver dependent time and location tracking authentication system collecting billing and services data that cannot be independently or objectively confirmed. Real time data being reported to and under the exclusive control of a person or company committing the fraud or abuse. These private sector devices and software application solutions collect caregiver GAS tracking, time management and reporting information using personal devices provided to the caregiver. The key problems with current industry solutions are: poor user authentication as devices are not securely paired to an individual caregiver; the need for proactive action on the part of caregiver to (a) activate the device and (b) enter time and service data into the device; remotely collected data which is received only by the caregiver'"'"'s employer and therefore not subject to an independent verification, the majority of medical insurance billing fraud is on the part of the employing home healthcare agency; any personal mobile device software applications and standard operating system [OS] is easily spoofed; and none of the current solutions monitor the conduct of the caregiver with the patient.
Another key problem is that the collected or reported data by these personal devices is not securely paired to the caregiver during registration, authentication or use. The current devices used to collect billing or services data from a particular caregiver lack secure multi-factor data, devices and caregiver identification pairing where the data and device are paired to particular caregiver and patient authentication and/or lack independent and real time service validation before payment is rendered to the caregiver or the private home healthcare agency by the government insurer or private payer. This security failure leaves the door open to fraudulent criminal activity.
The most significant single problem with current methods and technologies is that there is no device, no software and no established methods for the real time detection and recording of mental or physical abuse during caregiver and patient interactions. There is no wearable home healthcare device for monitoring and reporting abuse of patients and the elderly.
Therefore, there is a need of a system that solve the above-mentioned problems by outfitting caregivers and patient homes and rooms with a smart device that can track, monitor and analyze caregiver and patient geospatial movement and interactions within the immediate area of the caregiver and patient using a number of sensors, and to then encrypt, compress, buffer and then securely transmit the collected data as a real time augmented video data stream carrying real time actionable intelligence. Further there is a need of such a system to provide secure cloud storage and continuous monitoring from a remote location tagging the collected data with the unique biometric information of the caregiver and their exact geo-location.
The present invention relates to a caregiver remote geospatial tracking and monitoring system or a system for monitoring home healthcare agency personnel, the operators or caregivers at a plurality of private patient homes and at other locations of patients using associated devices paired to the system that monitor, track, record and analyze real time geospatial data on movement, buffers and then securely transmits the data as actionable real time intelligence as video, audio and other sensory data collected by the device within the immediate environment of the caregiver and their direct field of vision. According to an embodiment, the devices are a mobile monitoring and reporting apparatuses equipped with a multitude of biometric sensors, and electronic modules to detect, record and report instances of insurance billing fraud, property or prescription drug theft, health risk to patient or recipient of their services and cases of elder or child abuse.
The system of said invention is equipped with devices worn by or within the immediate proximity of the caregiver and able to collect a multitude of geospatial, thermal, biometric and biomechanical data necessary to establishing and recording a pattern of geospatial movements made as a caregiver provides a medical treatment or non-medical service; and to determine from the collected data if the observed real time pattern of movement falls within acceptable tolerances for similar stored geospatial and thermal data know to be empirically consistent with such movements during the delivery a particular medical treatment or non-medical service. For an example, in one instance, a physician may order physical therapy. the devices of the system use cameras to tracks geospatial movement and human thermodynamic flow, with biometric and biomechanical data to compare with the systems database and confirm that a caregiver is in fact performing the physical therapy. Simultaneously, the system is capable to track other data such as GPS location, or departure and arrival times along with audio and visual data which can be correlated with the biomechanical movements of the caregiver to ensure that the caregiver is performing his or her duties as ordered required according to an approved plan of care. Additionally, the system sends alter notifications to monitoring station if its analysis of the data via machine learning artificial intelligence and analytical models detects any mismatch between the collected real time tracking data on caregiver and patient movement, biometrics and spatial interactions with the medical insurance billing code paired to such data.
In addition to tracking caregiver geospatial movements and interactions with the patient to ensure there is no activity that suggests possible medical insurance billing fraud, the system uses the same cameras and audio data to track geospatial movement and human thermodynamic flow, biomechanical, and empirical data for detection of the possible physical or mental abuse of the patients. In many instances, caregivers are found to repeatedly deliver physical abuse to patients. To insure the safety and well being of the patient, the described invention will detect possible elder abuse using real time data collected via the monitoring devices tracking and recording the geospatial and biomechanical movements of the caregiver in proximity to the patient within the GPS fenced and digitally mapped location; biometric information is used to identify the specific caregiver and patient. Each group of information or data taken of the caregiving environment or the caregiver or patient is analyzed and compared repeatedly for possible signs of possible abuse of a patient.
The invention discloses a wireless augmented video system used to digitally capture and record a visual and thermal map of all objects in its immediate surroundings, including caregivers and patients and to track the geospatial movements and interactions of these objects in that space compared to previously learned information in the system database searching for anomalies that might suggest possible medical insurance billing fraud, property or prescription drug theft, a health risk to a patient or an instance elder or child abuse. The wireless augmented video system comprising of; different embodiments of wireless augmented monitoring devices worn by the caregiver to monitor caregiver actions, patient well-being, and the caregiving environment to detect possible patient abuse and healthcare billing fraud which are: smart nametag apparatus, smart wearable wristband, a neck wearable device, Ear worn device or a combination thereof; and cloud system monitoring center to monitor, store and analyze the real time augmented data from the monitoring device to detect fraud or abuse and inform such to the employer of the caregiving personnel, government organization and other personnel paying the bills.
Each device of the invention are different embodiments of a wireless augmented device that contains a plethora of sensors to both track statistics of the caregiver, the caregiving environment, and the client or recipient of services. An imperative feature of the devices is its ability to be non-reliant on local Wi-Fi networks, or user operation. The devices of the invention will always contain supporting electronics to connect to a 4G/LTE network or better. This is to ensure that the user, in this case a caregiver, cannot interfere, damage, turn-off, or interrupt monitoring of the environment or themselves.
The smart nametag apparatus of wireless augmented monitoring devices is a compact body wearable box like apparatus comprising within an embodiment of; a processor, a Bluetooth module, a rechargeable battery, an internet module, a Wi-Fi module, a RFID receiver, a wide angle cameras, microphone and speakers, Face to face IR camera with light, a LTE network connection module, set of indication LED lights, a fingerprint scanner, a color touch display, a thermal imaging camera with IFR lights, GPS module, USB and power ports and micro HDMI port. While the wireless wearable wristband of the augmented monitoring devices comprises of plurality of different sensors to collect and transmit geospatial movements and biometric information of the caregiver in real time for analysis toward the detection the elder or abuse as well billing fraud and drug theft which are; photoplethysmography sensor which measures blood volume pulse (BVP) from which heart rate, heart rate variability (HRV) and other cardiovascular features are collected; a 3-axis accelerometer captures motion-based activity, to report disturbance in the caregiver'"'"'s balance such as fall; (3) an EDA sensor (GSR sensor) electrodermal activity sensor used to measure sympathetic nervous system arousal and to derive features related to stress, engagement and excitement; an infrared thermopile that reads peripheral skin temperature, to detect, among other things, fever; and a transdermal transmission sensor to measure blood alcohol levels. The neck wearable embodiment of the augmented device also comprises multitude of sensors ranging from electrode arrays, optical, visual, location, vibration and position sensors while the ear wearable embodiment of the device equipped with a visual sensor, to take thermo-graphic imaging and near infrared imaging of the client or recipient of services, optical sensor and inner ear optical sensor.
The wireless augmented monitoring devices are small light weight mobile monitoring and reporting apparatuses relying on the LIE: data network for use in homes, nursing or healthcare facilities and child daycare centers. The monitoring devices manages all the monitoring, analyze, recording, reporting and incident alerts in real time and without relying on the integrity or habits of human operators. The monitoring devices continuously monitors the exact time of caregiver coming and goings, as well as all physical actions, motion and movement, and health and mental state of each caregiver(s) entering the pre-defined geo-fenced perimeter assigned to each individual set of monitoring devices. Monitoring, recording, transmitting and analysis functions are activated only after the system detects, verifies and successfully pairs with the wireless wearable devices biometrically associated to a specific caregiver. Once activated by three step biometric authentication, the wireless monitoring devices collects data from multiple biometric, audio visual and geospatial components and sensors embodied within the devices and located within its geo-fenced perimeter, including the infrared captured by its 360 degree camera view and sounds recorded by its directional microphones. All the collected data is analyzed by monitoring devices and monitoring centers against the baseline data of the particular caregiver associated with the wireless sensing and monitoring devices. Certain conditions detected by the monitoring devices triggers audible and silent alerts to responsible persons for intervention. Some of these alert conditions includes but not limited to potential health hazards to a patient or child.
The invention solves medical insurance billing fraud by, inter alia, relying on only real time recorded empirical data collected on site; the data is used to verify or challenge any medical insurance billing request for payment by a medical or non-medical service provider; the collected empirical data is specifically tagged and uniquely encrypted to the one patient, the care or service provider billing code and the specific caregiver present during a treatment or service period are also embedded in the augmented data stream; this uniquely recorded data is also stamped with the exact time, date, location and medical or non-medical treatment service code as submitted by the care provider, the information is managed by an independent monitoring body, a non-government organization; (a) who securely stores and then (b) distributes alerts to all parties when the empirical (i) does not factually correspond to the accounting data as submitted in an medical insurance claim request for payment; (ii) suggests elder or patient physical or mental abuse; and (c) distributes alerts in such cases to authorize persons or bodies, inter alia, (i) the patient, (ii) the physician, (iii) the home healthcare agency, (iv) the family employing the particular caregiver, (v) government and (vi) private sector payers, and (vii) judicial authorities on subpoena.
To guarantee the integrity of the collected data, the invention utilizes among other things, device and data pairing to each current user of the device. The wearable user authentication and pairing process requires (1) multiple biometric keys collected from the caregiver/user at time of registration and later during each activation or login to the device; (2) the post login collection of that particular user caregiver'"'"'s schedule of (a) patient GPS location; (b) time of service at the location and (c) a series geofencing triggers are all obtained wirelessly from the cloud system and used for self-activation and deactivation of data collection process; the user caregiver has no control over device function; (3) further, self-activation and deactivation of the device can occur according to other changes detected by an array of internal and peripheral sensors.
To additionally guarantee the authenticity of wireless transmitted data, the device embeds as part of an augmented data stream (1) GPS location data; (2) real time biometric information on the caregiver; (3) the unique user biometric identification [UUBID] key collected during login; and (4) the unique user identification [UUID] key of the caregiver'"'"'s employer.
To additionally guarantee the securing of buffered and the wirelessly transmitted data, the device; (1) compresses and encrypts each data packet or stream before wirelessly transmitting; (2) transmits the encrypted data to an independently operated remote cloud storage and caregiver monitoring facility; (3) the file is then stored utilizing high entropy encryption algorithms, including a quantum key, random number security token, as part of a three key retrieval system where 2 of 3 keys are required to access and decrypt video data.
to additionally guarantee the securing of data buffered by the device, the device only dynamically stores all real time data and then deletes that data, (1) on a verification from the cloud system confirming delivery of the buffered data; (2) in the event of a lengthy timeout in its connection to the cloud system, (3) loss of power and (4) any attempt to tamper with the device instances (2)-(4) initiates an alarm on the device and at the monitoring station.
furthermore, the object of the invention is to provide a wireless augmented video system to collect, record and interpret other forms of environmental data, including but not limited to use of video, image and other biometric data of the caregiver to detect if a patient falls, is physically or mentally abused, unauthorized access, if the caregiver misbehave, fraud and theft etc.
Another objective of the invention is to provide a wireless augmented video system to geo-track and video record each action, location and movement of a specified caregiver including but not limited to use of artificial intelligence and image recognition to determine delivery of care, quality of care, time on site, action on site and possible elder or child abuse.
These and the other aspects of the embodiment herein will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following descriptions, while indicating preferred embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein without departing from the spirit thereof, and the embodiments herein include all such modifications.
The embodiment herein and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments and detailed in the following description. Descriptions of well-known components and processing techniques are omitted so as to not unnecessarily obscure the embodiments herein. The examples used herein are intended merely to facilitate an understanding of ways in which the embodiments herein may be practiced and to further enable those of skill in the art to practice the embodiments herein. Accordingly, the examples should not be construed as limiting the scope of the embodiments herein.
According to an embodiment, the present invention provides a system for detection and reporting of insurance billing fraud, physical and mental abuse possibly possibly by the caregivers to the elderly or a child or a patient when providing medical or non-medical care through the use of a cloud data monitoring facility and non-medical wearable monitoring worn as a as a smart nametag apparatus, a wearable wristband, a neck and ear wearable device all of which are just different embodiments of the augmented monitoring device with plethora of sensors and other electronic components to track the geospatial movement and changes in human thermodynamics of the caregiver in the caregiving environment, during interactions with the patient or other recipients of services.
The smart nametag apparatus, in real time, monitors, buffers, and then securely transmits video, audio and ocher sensory data collected by the apparatus within immediate environment of the caregiver and the direct field of view of the apparatus; the collected data is then transmitted and tagged with the caregiver unique biometric information and location, which is then remotely stored and continuously monitored in a secure cloud data monitoring facility.
According to an embodiment, the caregiver monitoring system 100 requires a wireless augmented monitoring devices 103 of a system 100 to be activated and paired to a caregiver and a licensed home health care operator using a three step biometric authentication and verification process which are fingerprint verification, facial or iris verification and certain unique properties of electrocardiogram and other bodily biometrics. After the biometric authentication of caregiver or licensed home health care operator only, the smart nametag apparatus of the wireless augmented monitoring devices 103 starts monitoring and transmits real time data such as video, audio and other sensory data collected by the devices within the immediate environment of the caregiver and their direct field of vision to the cloud data monitoring center 104 which stores the received data for monitoring and analysis of billing fraud as well as abuse to the patient by the caregiver or the abuse from the patient or family to the caregiver personnel.
The smart nametag apparatus 200 of monitoring devices 103 is sized to be worn on user'"'"'s body as a nametag configured to be mounted in a forward looking location when carried by the caregiver and mounted to the caregiver'"'"'s body, or on an article of clothing. The smart nametag device 200 of the monitoring devices 103 sends and receives data from the multiple cameras and sensors to and from cloud monitoring and management center 104 of system 100.
According to an embodiment and as mentioned before the smart nametag apparatus is sized to be worn on a caregiver'"'"'s body as a nametag in which wide angle cameras 201 placed over four upper corners of the embodiment of nametag apparatus 200 is configured for omnidirectional 360 degree monitoring and recording when carried by the caregiver and mounted to the caregiver'"'"'s body, or an article of clothing. The microphone 203 within the embodiment of the nametag apparatus 200 is configured to record the audio data such as communication between the caregiver and patient or elderly to detect the abuse, when the nametag apparatus 200 of the system 100 further embodied with the speakers 204 configured to activate an alarm informing the caregiver of any emergency conditions. Further, the nametag apparatus comprises a slot of a SIM card that allows placement of the SIM within the embodiment of the apparatus allowing it to connect to any available cellular network to communicate and send/receive the augmented data over the network collected by the apparatus 200. According to an embodiment, the nametag apparatus 200 further includes a status LED'"'"'s such as network connection status LED 206 and a battery status LED 207 that inform the caregiver about the connection of the apparatus with other monitoring devices as well as the cloud monitoring center and the status of the level of charge in the battery respectively.
The fingerprint scanning device 208 housed as a part of body of the smart nametag apparatus 200 is configured to capture one or more fingerprints placed on the main display at the capture location. It is further configured to capture one or more orientations of one or more fingers of a caregivers placed on the main display at the capture location. Logic is provided to the controller of the apparatus 200 to capture the fingerprints of the wearer using the fingerprint sensor. The controller of the nametag apparatus 200 wirelessly transmits the data to the cloud system monitoring center 104 to determine an identity of the wearer using the one or more captured fingerprints. If the fingerprint belongs to an authorized caregiver, the cloud system monitoring center 104 returns a positive UUIBD verification and the nametag apparatus 200 prompts the caregiver to proceed to the next sequence of the authenticity verification stage.
The face to face infrared camera and light 202 and infrared thermal imaging and IFR light 209 located within the housing of the nametag apparatus 200 is configured to be used as a part of (1) a multifactor biometric security sequence for iris recognition of caregiver; (2) for thermal imaging of caregiver'"'"'s face where the IFR camera detects a body temperature of 38° C. or higher and transfers the image to the processor housed within the apparatus 200 which automatically highlight those area of caregiver'"'"'s face in bright red as the IFR video is streams to the cloud system monitoring center 104. If a body temperature of the caregiver goes out of range, a speaker 204 housed within the apparatus 200 sounds an alarm and alerts the caregiver as well the processor sends data to the operator of the cloud monitoring center to the prospect of the wearers (caregivers) elevated body temperature which in turns alerts caregiver'"'"'s employer. The IR and IFR cameras 202 and 209 of the apparatus 200 further configured for thermal imaging of patient under the wearer'"'"'s care, body temperature indicates multiple health problems. The processor with the analyzing algorithm of the nametag apparatus 200 of the monitoring devices 103 continuously analyzes real time data from the cameras and sensors for irregularities in geospatial movements and human thermodynamics of all objects within the IFR camera field of view including patient and caregivers. By detecting geospatial and temperature changes in the objects, including human thermodynamics shifts in body core temperature of a patient or caregiver, the nametag apparatus 200 of the monitoring devices 103 alerts the monitoring center 104 which in turn alerts all authorized caregivers to, inter alia, vascular dysfunction potentially associated with onset of cardiovascular disease (CVD), for monitoring breast health and changes associated with breast disease, area of chronic pain, inflammation, wound healing and disease is evaluated thermo-graphically to assist with a diagnosis and treatment plan, detects thermal indicators as they relate to infection, inflammation or fibrocystic disease, angiogenic or blood vessel significance that would require further evaluation, undetermined pain disorders such as muscular skeletal disorders including wound healing and chronic pain and impaired peripheral circulation including varicosities, peripheral vascular disease or blood viscosity concerns and neuropathies. The collected human thermodynamic data is used to detect and alert care providers of any anomalies that may require intervention by a caregiver for further evaluation and made available to physicians of the patient for long term diagnosis and care.
Furthermore, The IR cameras 202 and 209 are configured to provide second of the three biometric authentication keys needed for binding the wearer to the monitoring devices 103 to activate the system 100. The Infrared Camera 209 housed within the apparatus 200 gets activated after a successful authentication using the user'"'"'s fingerprint. The wearer is instructed to point the Infrared (IR) camera 209 towards his/her eyes with respect to the IR camera. A time of exposure by the IR camera for the portion of the IR camera field of view filled by the detected eye is determined. The eye is then illuminated by activating an IR light during the time of exposure and deactivating the IR light after the time of exposure needed to capture an image of one retina of either eye or to scan the selected retina. This IFR image or scan of the wearer'"'"'s retina is then wirelessly relayed to the cloud system monitoring center 104 where algorithms compares the real time IFR images of the retina with sorted images of the retina associated only to the authenticated fingerprint of the wearer taken in step one of the biometric authentication process. If the collected retina record is that of the fingerprint owner, and belongs to an authorized user the authentication is considered successful and will prompt the wearer to proceed to the next sequence of the system'"'"'s 100 multifactor biometric security, the pairing of a wearable on-body biometric authentication wristband.
The color touch screen 210 of the nametag apparatus 200 of present embodiment is configured to display name and photograph of the current Caregiver after completing all three steps of biometric authentication, USB and Power port 211 configured to allow the nametag apparatus to connect to other devices of the system using USB cable and also to recharge the rechargeable battery of the apparatus 200 and a micro HDMI port is also configured to allow the apparatus 200 to transfer uncompressed video data and compressed or uncompressed digital audio data to the HDMI compatible system devices 103 and to the monitoring center 104.
Furthermore, the embodiment of the nametag apparatus further comprises of a global positioning system (GPS) receiver which is configured to determine wearer/caregiver'"'"'s location information in relationship with the wearers/caregiver'"'"'s movement to, from, and within the patient'"'"'s location. The method provides for autonomous personal movement tracking, and conserves the battery consumption, and provides longer period of portable unit operation by allowing the GPS to manage power consumption. The GPS tracker (not shown) is designed to communicate at specified time interval with the cloud monitoring system 104. The nametag apparatus 200 is programmed to trigger one or more actions in events where the GPS unit presents real time GPS coordinates data within a predefined proximity of a pre-defined geographic area to the cloud system monitoring center 104. This “Pre-defined geo-fenced area”, may include but is not limited to the home of patient location; a circumference from the center of predetermined proximity of the aforesaid predetermined area of the patient'"'"'s home, or where the caregiver is approaching but still not within the four longitude and latitude pairs that define the predetermined “geo-fenced” area or the apex points of the perimeter of an area of interest in the vicinity of the patient geo-fenced area that is the patient location. In another aspect of the embodiment described herein, another version of a defined geographic area is a single longitude/latitude pair and a predetermined radius of a circular perimeter used to define a single geographic area, a specific room in the patient location. In yet another version of a defined geographic area any number of longitude/latitude pairs can be used to determine the corner points of any area, regardless of the number of line segments bounding the shape defined as lines between any numbers of longitude/latitude pairs that form a closed chain of lines. According to present embodiment of caregiver monitoring system 100, the real world geographic area is typically arranged about or within a residential or institutional environment, for an example, the home of a patient or the room of a patient at home or institution utilizing wide area augmentation system technology.
In the preceding GPS embodiment of the invention is fundamental to its operation and intended use, once the remote cloud monitoring system 104 determines the caregiver to be within the proximity of one of the predetermined perimeters, the geo-fenced areas, the monitoring system 100 remotely implements a method of initiating one or more actions on the wearable devices 103. The method is an aspect of an embodiment, includes, monitoring system 100 that remotely tests a first condition to determine the state of the condition, specifically are the reported fence co-ordinates belong to a specific patient geo-fence location and the location assigned to the authenticated caregiver; testing a second condition, monitoring system 100 remotely determines the state of the second condition; if the first condition is true, then determining the time and date reported by the GPS are consistent with the time and date for the caregiver'"'"'s scheduled attendance at the verified patient GPS location; if both the first and second states of the conditions are true then; initiating one more actions.
In the particular instance of this GPS embodiment, all power circuitry to the embodiment'"'"'s video and sound recording devices is managed by the GPS and the main controller housed as part of the first embodiment of the invention. Record “on” and record “off” camera states are controlled exclusively by the GPS and by remotely by the cloud system monitoring station 104. Real time wearer/caregiver location data is transmitted by the GPS to the cloud monitoring system 104 where the data is cross referenced to a database of patient geo-fenced locations and the first and second condition tests are applied to the GPS data. If both conditions are TRUE, the cloud monitoring system 104 transmits a “power on” instruction to the GPS unit for activation of camera and sound recording. This “Power on” condition continues for as long as the caregiver remains within the established GPS perimeters of the patient geo-fenced location. This “power on” condition will allow for the live streaming of video, to the cloud monitoring system 104, the video stream augmented with data collected by the GPS and other embodiments of the system 100 and monitoring devices 103 used to identify both the caregiver and specified patient at the geo-fenced location and provides necessary information for unique encryption of the data.
In the alternate, when the GPS unit reports GPS location coordinates where one of the two or both the required conditions are FALSE and the caregiver no longer within the established GPS perimeter of the patients geo-fenced location, the GPS unit (1) independently “power off”; (2) can be remotely powered off by the cloud monitoring system 104; or (3) independently “power off” within a predetermined time when the GPS detects a communication signal loss with the cloud monitoring system 104.
GPS location detection, geo-fencing location methods and systems 100 and the GPS device power management as described of sensors and cameras housed in the first embodiment of the invention is integral to the purpose of the invention. Certain embodiments of the inventions are only to be in a “power up” and “continues activate reporting state” when within proximity of an approved and known geo-fenced location, and the streamed augmented video data must be uniquely identified. This unique GPS data is quality essential to the primary purpose and reporting of billing fraud and patient abuse in real time and protection of the first amendment right of the caregiver and the patient.
According to an embodiment, the nametag apparatus 200 of the monitoring devices 103 comprises an electronic circuitry board (not shown) that further includes a processor and controller that collects augmented data such as audio, video from the surrounding environment and other biometric sensory data of caregiver, analyzes the augmented data using predefined algorithms and transmits the analyzed augmented and tagged data in real time to the cloud monitoring center 104 where the augmented data get stored and further analyzed in search for billing fraud, drug theft or abuse of patient from caregiver. Moreover, the processor of the nametag apparatus 200 further manages power consumption within the apparatus and minimizes power consumption, when the caregiver is not in the geo-fencing perimeter of the patient or the person allotted to the caregiver for care. Furthermore, a memory unit is included within the embodiment of the nametag apparatus 200 configured to store data temporarily for the processor to analyze it before transmitting it in real time to the cloud monitoring center 104, a rechargeable battery is configured within the electronic circuitry of the apparatus 200 allowing it to be re-charged by connecting using power port 211, an internet module is configured to allow the system to communicate, share, receive data over the internet, a Wi-Fi module configured to allow the wireless monitoring devices 103 to connect the Local Wi-Fi network to communicate in case of cellular network connection loss, and a Bluetooth module configured within the embodiment of the nametag apparatus 200 of the monitoring devices 103 to allow internal connection between all the monitoring devices 103 of system 100.
According to another main exemplary embodiment, the foregoing wireless augmented video system 100 includes a wireless wearable wristband (not shown in any drawing) that is one of the wireless augmented monitoring device 103 designed and configured to pair with the nametag apparatus 200 using Bluetooth to complete caregiver'"'"'s three stage authentication sequence. The wireless wristband as name states is worn on the wrist of the caregiver and features multiple biometric sensors providing continuous stream of biometric data about the caregiver. The collected data is processed and delivered in real time to the processor of the smart nametag device 200 and which then relays the tagged and augmented data to the cloud monitoring and management center 103.
The wireless wristband of the segmented monitoring devices 103 remotely monitors in real time the general physical and emotional state of the caregiver. According to an exemplary embodiment, the biometric sensors embodied in the wireless wristband provides the following data, inter alia; a photoplethysmography sensor which measures blood volume pulse (BVP) from which heart rate, heart rate variability (HRV) and other cardiovascular features are collected; a 3-axis accelerometer captures motion-based activity, to report disturbance in the caregiver'"'"'s balance such as fall; (3) an EDA sensor (GSR sensor) electro dermal activity sensor used to measure sympathetic nervous system arousal and to derive features related to stress, engagement and excitement; an infrared thermopile that reads peripheral skin temperature to detect, among other things, fever; and a transdermal transmission sensor to measure blood alcohol levels.
The information collected in the aforementioned wireless wearable wristband is collected by the nametag apparatus 200 of the monitoring devices 103 and relayed to the cloud system monitoring center 104 where it is analyzed and recorded to, among other things; (1) alert the caregiver 102 (wearer), caregiver'"'"'s employer 105 and cloud system monitoring center 103 that the health of the caregiver 102 may be compromised and may represent a threat to the health of patient 101, a common cold or flu could infect elderly or immunosuppressed cancer or transplant patients; (2) alerts the caregiver'"'"'s employer 105 and cloud system monitoring center 104 if the caregiver is experiencing unusual physical and mental stress, a sign if possible patient'"'"'s physical or mental abuse; (3) may have fallen or experienced some other bodily trauma possibly putting the caregiver and patient at risk; and (4) detect unacceptable blood alcohol levels that would compromise the quality of care. This embodiment of the wireless wristband exists solely to ensure that the caregiver do not act as conduit for disease that could prove fatal to those under their care.
For present augmented video monitoring system 100, integral to privacy and security during the use of devices 103 is the requirement that each home healthcare agency operator and each employee caregiver register their profile within the system 100 and obtain respectively a UUID and UUBID for pairing to the augmented video data stream, and to be identifiable to government, non-government or private company charged with real time monitoring of the devices, collection and secure storing and viewing of the uniquely encrypted video data stream and for managing access and distribution of the collected data according to the any terms and conditions and prevailing civil and criminal laws.
The exemplary embodiment requires the monitoring devices 103 to be activated and paired to a caregiver and licensed home healthcare operator using a three step multifactor biometric verification process, step (1) requires the caregiver to provide the biometric security key previously collected during the registration of the caregiver within the system 100, this requires the caregiver to use the device fingerprint scanner 208 for fingerprint scanning and recognition, the monitoring nametag apparatus 200 collects and transmits this biometric data to the cloud servers of the monitoring body 104 as a UUBID, the first biometric security key, where the system decrypts, isolates and confirms the specific caregiver UUBID against the UUBID stored with the monitoring body 104, the cloud server system then returns a verification code to the nametag apparatus 200 and prompts the apparatus 200 to activate its infrared thermal camera for facial recognition or iris/retina scanning that also collected and transmitted by the devices 103 to the cloud server of the monitoring body 104 as another UUBID, the second biometric security key, which is decrypted, isolated and confirmed by the system 100 for the specific second caregiver UUBID against the UUBID stored in the monitoring body 104 of the same caregiver. After two biometric key authentication, the cloud server system 104 then returns a verification code to the device and prompts the device to activate its Bluetooth connection and pair to a multifactor biometric sensor wristband also worn by the same caregiver user, if no wristband detected, the nametag apparatus 200 will restart the verification again, in third step the nametag apparatus 200 waits for the Bluetooth paired biometric wristband or any other wearable devices to provide certain unique properties of caregiver'"'"'s electrocardiogram (ECG) for an example as a continues, on-body authentication and then present this new continues biometric data via Bluetooth to the nametag apparatus 200 that now transmits this wristband continues biometric stream as a third security key UUBID to the cloud servers of the monitoring body 104 where the system 100 decrypts, isolates and confirms the caregiver third security UUBID against the data stored with the monitoring body 104, the cloud server system then return a verification code to the device together with profile information on the caregiver to the display on the nametag apparatus 200 color LCD screen 210, this includes the caregiver'"'"'s name, photo and organization name and employee ID number. The apparatus 200 then remotely instructed by the cloud monitoring system 104 to fully activate and begin continues streaming of selected real time sensor data to the monitoring bodies cloud servers. Any lengthy interruption of the continuous, on-body authentication biometric device will result in the device altering the wearer and the remote monitoring center and eventual self-deactivation of the device and an end to the data transmission, this data is required to validate the claimed healthcare skilled or unskilled service and necessary to obtain payment from an insurance providers or other payer, the absence of this data will result in non-payment.
According to one another embodiment of system, the system can be equipped with other devices or embodiments of the devices that are worn by the caregivers or care receiver in the caregiving environment, each of which comprising a plethora of sensors to track a multitude of bio-metric and biomechanical data to establish pattern to ensure caregivers are performing services ordered by the care receiver, further this embodiment of the devices also tracks other data such as GPS location, or departure and arrival time of the caregiver, audio and visual data etc. which is analyzed by the system via artificial intelligence and analytical models that when finds mismatch between the caregiver data, environmental data or billing data, sends a notification to caregiving agencies, billing departments, clients and their respective families. According to present embodiment, the monitoring devices and embodiment of the devices is not limited just to a nametag apparatus or to a wrist wearable device, but without departing from the scope of the invention, the system may use other monitoring devices such as neck wearable device in conjunction with the ear wearable device and other body wearable devices having plethora of sensors and electronic components to provide foregoing application of system of monitoring. Some of such other embodiments of devices of system is described using drawings in details below:
In addition, optical 502, visual and audio sensors 503 work in tandem to monitor the caregiving environment, the actions of the patients and the actions of the caregiver. In one embodiment of the invention, optical imaging can be in the form of thermo-graphic readings where each thermo-graphic image is processed by data processing to assess the patient'"'"'s well-being. The thermo-graphic images can be used for a wide variety of assessments such as but not limited to detection of diabetic ulcers, infection of wounds, detection of fractures to bone structure, or detection of fevers or probability of illness. Additionally, thermo-graphic imaging may be used to determine if the caregiver sanitized their hands before treating or interacting with the patient physically to deliver therapy or other procedures. In another embodiment of the invention optical imaging can be in the form of UV or black light in the detection of bacteria to reduce the probability of infection. Infrared imaging can be used to monitor and map the geospatial to aid in tracking the movements and actions of objects or persons and used to ensure visibility of the patient even in darkness. In another embodiment of the invention, the visual and optical cameras can also be used to detect differing facial states of the clients or patients via facial recognition data analysis. In this embodiment, a stressed facial expression, a startled facial expression, an upset facial expression, can be detected by facial recognition.
In addition, the electrode array 501 can serve as a method to identify the caregiver and to ensure the caregiver is wearing the device in this embodiment. Identification of a person through the subtle and minute differences in electrical impulse characteristics taken from an electrode array 501 at the spine may be used to identify which caregiver is wearing the device of the invention and if they are wearing it. Like any other physical being, there are minute differences that constituent the personal identity of that being. In this case, the minute differences that are detected are via the electronic impulses sent through the spine wherein amplitude, frequency, and other characteristics of the impulses can be compared to identify each caregiver.
The optical sensors 601 of the device are used to gather a variety of biometrics of the caregiver like the neck piece 500 to ensure the device is used by the caregiver, and to capture differing actions of the caregiver. In addition, health statistics of the caregiver can be gathered to ensure no illness is spread over to a patient that is elderly or infirmed.
In another embodiment 700 of the invention, the aforesaid monitoring devices 701 can be integrated into the clothing 702 of the caregiver or moved from clothing item to clothing item of the caregiver which is shown in
According to an exemplary embodiment, the method for mobile application of wireless augmented video system comprises steps which are mere exemplary and not limiting, without departing from the scope of invention steps and sequence can be altered and the steps are: Registration of caregiver or homecare personnel within the system using personal biometric data with other personal details, preferred location for work, previous work track record, experience and specialty. Registration of the caregiver within the system allows the employer of caregivers, monitoring bodies and other organizations such as government organization and insurance companies to monitor the caregiver in real time and detect any billing fraud as well human welfare and care department and law and order department to monitor and analyze caregiver and patient for mental or physical abuse or any property or drug theft; Determination and Geo-fencing of location of person requested for care at home or at any other remote location where the system with the request from the person need in care, detects location and creates Geo-fenced perimeter around the location of that person using the aforesaid methods of four longitude/latitude pair method in which system determines four longitude and latitude pairs around the location of said person and the perimeter covered by that four longitude/latitude pair is counted as Geo-fenced area while in another method, system uses single longitude/latitude pair for location and circle of predetermined radius around the pair is considered as a Geo-fenced area; After Geo-fencing the system allots one or more registered caregiver to the person requested for care by sending information and location of the person to the caregivers; After allotment, the system starts tracking and monitoring real time location of the caregiver with respect to the allotted Geo-fenced location of the person by which system determines and informs the time of work of the caregiver within the Geo-fenced perimeter which allows determination of billing fraud in term of time of service; Verification of biometrics of caregiver with already registered and stored biometric data of same caregiver at Geo-fenced location of patient or person in need of care to initiate functioning of monitoring devices of the system to collect real time environmental data, where the system allows the caregiver to start working within the perimeter of the geo-fenced location after completing three step biometric verification of Fingerprint, Retina/Iris/Facial verification and other from many of aforementioned body biometrics such as, but not limited to, some unique features of ECG waveform of caregiver with the already registered biometrics of same caregiver; Collection of real time Biometric, location and geospatial and thermodynamic environmental data using the monitoring devices of system, where the system allows monitoring and collecting of real time data of Audio data, video data, image data, scanned biometric data of fingerprint, retina, iris, face, real time location data of caregiver with respect of geo-fenced location, and other sensory data such as, but not limited to, Blood Volume Pulse (BVP), 3-axis accelerometer data, electro dermal activity data, skin and body temperature data and blood alcohol level data etc.; Transmitting or relaying the collected real time biometric and geospatial and thermodynamic environmental data to the cloud system monitoring center to receive, store and analyze received data to detect billing fraud, property or drug theft and mental or physical abuse to the patient or person in need of care and to inform and alert the caregiver himself, the employer of caregiver, associated government organization, patient and his/her family members or any person or organization associated with system in case of detection of any of the situations such as, but not limited to, billing fraud, property or drug theft and mental or physical abuse to the patient or person in need of care.
The foregoing description of the specific embodiments will so fully reveal the general nature of the embodiments herein that others can, by applying current knowledge, readily modify and/or adapt for various applications such specific embodiments without departing from the generic concept, and, therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments. It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modification within the spirit and scope of the embodiments as described herein.