Apparatus and method for recognition of patient activities when obtaining protocol adherence data
First Claim
Patent Images
1. A medication administration confirmation apparatus, comprising:
- a memory for storing on a local device a predetermined video sequence corresponding to a particular predetermined prescription regimen, the predetermined video sequence further comprising a plurality of predetermined video steps;
a display associated with the local device for displaying one or more instruction prompts associated with each of the plurality of predetermined video steps of the stored predetermined video sequence, and for displaying one or more graphical guidance indicators directing movement in accordance with each of the plurality of predetermined video steps of the stored predetermined video sequence;
a video capture device associated with the local device for sequentially capturing one or more video sequences of a user administering medication following the one or more instruction prompts and one or more guidance indicators to a video capture memory associated with the local device; and
a processor associated with the local device, wherein the processor is operable to;
a) output to the display at least one instruction prompt instructing the user to perform one or more actions and at least one graphical guidance indicator guiding a user'"'"'s movement relative to the display and/or the video capture device, wherein the at least one instruction prompt and the at least one graphical guidance indicator direct the user to perform motions depicted in a corresponding predetermined video step of the predetermined video sequence,b) receive from the video capture device the sequentially captured one or more video sequences following the output of the at least one instruction prompt and the at least one guidance indicator to the display,c) in response to receiving the sequentially captured one or more video sequences, compare, in accordance with one or more of facial recognition, activity recognition or gesture recognition, at least one of the sequentially captured video sequences to a corresponding predetermined video sequence of the predetermined video sequence,d) determine, from the comparison, whether the user incorrectly followed a step in the predetermined prescription regimen,e) in response to determining that the user incorrectly followed the step in the predetermined prescription regimen, output feedback to the display in real time and execute b)-d) again, the feedback comprising a prompt to perform the sequence of actions for following the predetermined prescription regimen again, andf) in response to determining that the user correctly followed the step in the predetermined prescription regimen, output to the display at least one other instruction prompt and at least one other guidance indicator, wherein each of the at least one other instruction prompt and the at least one other guidance indicator direct the user to perform motions depicted on the display and associated with a next predetermined video step of the predetermined video sequence.
2 Assignments
0 Petitions
Accused Products
Abstract
A medication confirmation method and apparatus. The method of an embodiment of the invention includes the steps of capturing one or more video sequences of a user administering medication, storing the captured one or more video sequences, and comparing at least one of the stored video sequences with a corresponding one or more prerecorded video sequences to confirm that the user has properly administered the medication.
-
Citations
20 Claims
-
1. A medication administration confirmation apparatus, comprising:
-
a memory for storing on a local device a predetermined video sequence corresponding to a particular predetermined prescription regimen, the predetermined video sequence further comprising a plurality of predetermined video steps; a display associated with the local device for displaying one or more instruction prompts associated with each of the plurality of predetermined video steps of the stored predetermined video sequence, and for displaying one or more graphical guidance indicators directing movement in accordance with each of the plurality of predetermined video steps of the stored predetermined video sequence; a video capture device associated with the local device for sequentially capturing one or more video sequences of a user administering medication following the one or more instruction prompts and one or more guidance indicators to a video capture memory associated with the local device; and a processor associated with the local device, wherein the processor is operable to; a) output to the display at least one instruction prompt instructing the user to perform one or more actions and at least one graphical guidance indicator guiding a user'"'"'s movement relative to the display and/or the video capture device, wherein the at least one instruction prompt and the at least one graphical guidance indicator direct the user to perform motions depicted in a corresponding predetermined video step of the predetermined video sequence, b) receive from the video capture device the sequentially captured one or more video sequences following the output of the at least one instruction prompt and the at least one guidance indicator to the display, c) in response to receiving the sequentially captured one or more video sequences, compare, in accordance with one or more of facial recognition, activity recognition or gesture recognition, at least one of the sequentially captured video sequences to a corresponding predetermined video sequence of the predetermined video sequence, d) determine, from the comparison, whether the user incorrectly followed a step in the predetermined prescription regimen, e) in response to determining that the user incorrectly followed the step in the predetermined prescription regimen, output feedback to the display in real time and execute b)-d) again, the feedback comprising a prompt to perform the sequence of actions for following the predetermined prescription regimen again, and f) in response to determining that the user correctly followed the step in the predetermined prescription regimen, output to the display at least one other instruction prompt and at least one other guidance indicator, wherein each of the at least one other instruction prompt and the at least one other guidance indicator direct the user to perform motions depicted on the display and associated with a next predetermined video step of the predetermined video sequence. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A medication administration confirmation method employing a computing device, comprising:
-
a) outputting, from a processor of the computing device, to a display communicatively coupled to the computing device, one or more instruction prompts that direct a user to perform one or more actions in a step of a plurality of predetermined steps indicative of proper administration of medication according to a particular predetermined prescription regimen, wherein the one or more actions in the step comprise motions depicted in a corresponding predetermined video sequence; b) capturing by a video capture device associated with the computing device a video sequence of a user performing the step of the plurality of predetermined steps indicative of the user properly administering medication following the display of the one or more instruction prompts, in accordance with a the particular predetermined prescription regimen; c) storing the captured video sequence to a computer readable non-transitory storage medium associated with the computing device; d) comparing automatically by the computing device, in accordance with one or more of facial recognition, activity recognition and gesture recognition, the captured video sequence upon capture thereof to the corresponding predetermined video sequence, to determine if the step of the plurality of predetermined steps indicative of administration of the medication has been performed incorrectly; e) responsive to determining that the step of the plurality of predetermined steps has been performed by the user incorrectly, outputting, from the processor to the display, feedback to the user in real time, the feedback comprising one or more instruction prompts to prompt the user to perform the step of the plurality of predetermined steps again, and performing by the processor b)-d) again; f) responsive to determining that the step of the plurality of predetermined steps has been performed by the user correctly, performing by the processor a)-f) for a next step of the plurality of predetermined steps or confirming by the processor that the user has properly performed the predetermined steps indicative of proper medication administration. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15)
-
-
16. A medication administration confirmation method, comprising:
-
a) determining, by a processor associated with a local device, a sequence of a plurality of steps to be performed by a user indicative of ingestion of a medication; b) outputting from the processor to a display on the local device at least one instruction prompt and at least one graphical guidance indicator to aid in proper performance of each step of the determined sequence of steps, wherein the at least one instruction prompt and the at least one graphical guidance indicator direct the user to perform motions depicted in a corresponding predetermined video steps of the predetermined video sequence; c) capturing, by a video capture device associated with the local device, performance of a step of the determined sequence of steps; d) storing the captured performed step of the determined sequence of steps to a computer readable, non-transitory storage medium associated with the local device; e) determining automatically by the processor, in accordance with one or more of facial recognition, activity recognition and gesture recognition, whether the captured performed step of the determined sequence of steps has been performed by the user incorrectly using facial recognition, activity recognition and/or gesture recognition; f) responsive to determining that the step of the determined sequence of steps has been performed by the user incorrectly, providing from the processor feedback to the display of the local device, the feedback comprising a further one or more instruction prompts and graphical guidance indicators to further aid in proper performance of the step of the determined sequence of steps, and performing by the processor in real time b)-e) again; g) responsive to determining that the step of the determined sequence of steps has been performed correctly, performing by the processor b)-g) for a next available step of the predetermined steps or confirming by the processor that the user has properly administered the medication when each step in the sequence of the plurality of steps has been performed correctly. - View Dependent Claims (17, 18, 19, 20)
-
Specification