Method and apparatus for pattern tracking
First Claim
1. A method for confirming ingestion of a medication pill by a patient, comprising:
- displaying to a patient on a display one or more instructions encouraging proper administration of a medication pill;
receiving one or more images by a camera associated with a computing apparatus of a patient ingesting a medication pill that is visible to the camera in response to the one or more instructions;
performing a foreground detection process on the one or more images to determine a hand-pill-hand region by the computing apparatus;
performing image segmentation on the hand-pill-hand region to separate the determined hand portion of the hand-pill-hand region from the pill portion thereof by the computing apparatus;
displaying to the patient, in response to a difficulty in performing image segmentation, and in response to the output of a proximity detector associated with the computing device, one or more instructions to bring the medication pill closer to the camera;
confirming the identity of the pill portion by comparing one or more characteristics of the pill portion to one or more corresponding characteristics of one or more reference images stored to a recording medium associated with the computing apparatus, thereby confirming an expected pill in the hand of the patient;
performing a further foreground detection process on the one or more images to determine a pill positioned in a patient'"'"'s mouth by recognizing the pill portion surrounded by an unbroken ring of color corresponding to the inner portion of the mouth of the patient by the computing apparatus;
wherein upon confirmation of the expected pill in the hand of the patient and the expected pill in the mouth of the patient, medication administration is confirmed; and
displaying on a display associated with the computing apparatus an indication of the confirmation of the medication administration.
3 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus for pattern tracking. The method includes the steps of performing a foreground detection process to determine a hand-pill-hand region, performing image segmentation to separate the determined hand portion of the hand-pill-hand region from the pill portion thereof, building three reference models, one for each hand region and one for the pill region, initializing a dynamic model for tracking the hand-pill-hand region, determining N possible next positions for the hand-pill-hand region, for each such determined position, determining various features, building a new model for that region in accordance with the determined position, for each position, comparing the new model and a reference model, determining a position whose new model generates a highest similarity score, determining whether that similarity score is greater than a predetermined threshold, and wherein if it is determined that the similarity score is greater than the predetermined threshold, the object is tracked.
153 Citations
20 Claims
-
1. A method for confirming ingestion of a medication pill by a patient, comprising:
-
displaying to a patient on a display one or more instructions encouraging proper administration of a medication pill; receiving one or more images by a camera associated with a computing apparatus of a patient ingesting a medication pill that is visible to the camera in response to the one or more instructions; performing a foreground detection process on the one or more images to determine a hand-pill-hand region by the computing apparatus; performing image segmentation on the hand-pill-hand region to separate the determined hand portion of the hand-pill-hand region from the pill portion thereof by the computing apparatus; displaying to the patient, in response to a difficulty in performing image segmentation, and in response to the output of a proximity detector associated with the computing device, one or more instructions to bring the medication pill closer to the camera; confirming the identity of the pill portion by comparing one or more characteristics of the pill portion to one or more corresponding characteristics of one or more reference images stored to a recording medium associated with the computing apparatus, thereby confirming an expected pill in the hand of the patient; performing a further foreground detection process on the one or more images to determine a pill positioned in a patient'"'"'s mouth by recognizing the pill portion surrounded by an unbroken ring of color corresponding to the inner portion of the mouth of the patient by the computing apparatus; wherein upon confirmation of the expected pill in the hand of the patient and the expected pill in the mouth of the patient, medication administration is confirmed; and displaying on a display associated with the computing apparatus an indication of the confirmation of the medication administration. - View Dependent Claims (2, 3, 19)
-
-
4. A method for confirming ingestion of a medication pill by a patient, comprising:
-
displaying to a patient on a display one or more instructions encouraging proper administration of a medication pill; receiving one or more images by a camera associated with a computing apparatus of a patient ingesting a medication pill that is visible to the camera in response to the one or more instructions; performing a foreground detection process of an image or series of images of the one or more received images to determine a mouth-pill-mouth region by the computing apparatus; performing image segmentation of the image or series of images to separate the determined mouth portion of the mouth-pill-mouth region from the pill portion thereof by the computing apparatus, wherein performing image segmentation comprises performing a further foreground detection process of the image or series of images to determine a pill positioned in a patient'"'"'s mouth by recognizing the rill portion surrounded by an unbroken ring of color corresponding to an inner portion of the mouth of the patient by the computing apparatus; displaying to the patient, in response to a difficulty in performing image segmentation, and in response to the output of a proximity detector associated with the computing device, one or more instructions to bring the medication pill closer to the camera; confirming the identity of the pill portion in the mouth of the patient by comparing one or more characteristics of the pill portion to one or more corresponding characteristics of one or more reference images, thereby confirming ingestion of the pill portion by the patient by the computing apparatus; and displaying on a display associated with the computing apparatus an indication of the confirmation of the medication administration. - View Dependent Claims (5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 20)
-
Specification