Virtual Hand-Washing Coach

• US 20150302769A1
• Filed: 05/06/2015
• Published: 10/22/2015
• Est. Priority Date: 12/05/2011
• Status: Abandoned Application

• Current Assignee: Raymond C. Johnson
• Original Assignee: Raymond C. Johnson
• Inventors: Johnson, Raymond C.
• Application Number:
  US14/705,683
• Publication Number:
  US 20150302769A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G09B 19/0076 Body hygiene; Dressing; Knot tying

Abstract

An interactive monitoring system for arbitrarily complex hand-washing processes from simple hand-washing to full surgical scrub comprising user identification, multi-camera monitoring of hand-washing motions, various media for instructional or other feedback to the user, and a central computing system for storing hand-washing and instructional rules, instructional and other media, user-specific characteristics and rules and data on the status, quality and compliance of all hand-washing events monitored.

Claims

1. A system for monitoring an arbitrarily complex hand-washing process or any part thereof, comprising:

a computing device connected to one or more of;

a user ID subsystem,

a set of two or more hand-washing monitoring cameras mounted in proximity to a sink and oriented

so as to view all hand and/or arm motions of a user performing said set of hand-washing motions

and further oriented so as to allow the computing system to reconstruct sequences of three dimensional images of the hand and/or arm motions from the composited camera images,

a video monitor positioned so as to be visible to the user,

one or more speakers positioned so that audio emitted from the speakers is audible to the user;

said computing device containing an algorithm for identifying a user based on input from the user ID

subsystem;

said computing device providing audio and/or video instructions to the user on how to perform each

step of said processes;

said computing device containing an algorithm for analyzing images from said set of hand-washing monitoring cameras and making a determination whether the user has satisfactorily performed each

step of said processes;

said computing device informing the user via audio and/or video feedback if any step or series of steps of said processes has not been performed satisfactorily, determining appropriate possible actions for the user to take based on a set of rules about the degree of compliance required for a particular step or series of steps and requesting that the user select from among those possible actions

and perform the selected action.

2. The system of claim 1, further comprising:

a microphone positioned so as to detect speech from the user;

said computing device containing an algorithm for analyzing a user'"'"'s speech recorded by said microphone, to determine if user has issued a known command to the system, and for responding to

any such commands.

3. The system of claim 1 wherein the user ID system is a microphone and said computing device contains an algorithm for identifying a user by speech recognition or voice ID based on audio recorded by said microphone.

4. The system of claim 1 wherein the user ID system is a single camera mounted in proximity to a sink and directed so as to view the face of a user performing the hand-washing processes and said computing device contains an algorithm for identifying a user by face recognition based on video recorded from said camera.

5. The system of claim 1 wherein the user ID system is an RFID badge reader mounted in proximity to a hand-washing sink and said computing device contains an algorithm for identifying the user based on information read from the user'"'"'s RFID badge.

6. The systems of claims 1, wherein said system further comprises a microphone positioned so as to detect speech from the user and said computing device contains an algorithm for analyzing a user'"'"'s speech recorded by said microphone, to determine if the user has issued a known command to the system, and for responding to any such command, said computing device further contains databases for logging data from each hand-washing process event including but not limited to any subset of the following:

location of the hand-washing event;

identity of the user performing the hand-washing processes;

date and time of the beginning and end of the full hand-washing processes performed or any parts thereof;

any specific steps in the hand-washing process which were not satisfactorily performed by the user and the reason said step was not satisfactorily performed and user'"'"'s action in response to being informed of non-satisfactory performance of said step;

a video recording of a hand-washing process or any part thereof;

a video image of a user;

audio recordings of any audio spoken by the user during a hand-washing process including audio spoken for user identification, audio commands spoken to the system and/or audio responses spoken

by user in response to system instructions or information.

7. The system of claim 6, wherein said computing device is able to run a program to allow management of users performing hand-washing processes to view any detailed information regarding the hand-washing processes contained in the computing device database.

8. The system of claim 6, wherein said computing device provides immediate alerts to management when a user has not satisfactorily performed a hand-washing process or any part thereof.

9. The system of claim 6, wherein, in response to spoken commands by the user or based on user-specific system setup parameters, the monitor displays educational or entertainment video to the user during the hand-washing processes instead of video hand-washing instructions.

10. The system of claim 6, wherein, in response to spoken commands by the user or based on user-specific system setup parameters, the system plays musical content specific to the identified user, during the hand-washing process instead of spoken hand-washing instructions.

11. The system of claim 1, wherein, said computing device is able to run a program which, by repeated analysis of an individual user'"'"'s hand-washing motion, the system learns what the individual'"'"'s hand-washing motions look like so that the system can more accurately determine whether the specific user'"'"'s hand-washing motions are in compliance with system protocols when monitoring a hand-washing event for the user.

12. The system of claim 1, wherein said computing device is able to run a program to train or program the system to know what an individual user'"'"'s hands look like so that the system can more accurately determine whether the specific user'"'"'s hand-washing motions are in compliance with system protocols when monitoring a hand-washing event for the user.

13. The system of claim 1, wherein the cameras oriented toward the user'"'"'s hands are mounted, oriented and instructed or programmed to view only a particular spatial region of interest, creating a zone of privacy which the cameras cannot see and a zone of visibility which the cameras can see.

14. The system of claim 1, wherein the instruction or communication to the user by the computer system via a video display is replaced with communication via a holographic projection.

15. The system of claim 1, wherein the user can select a particular voice to perform the audio hand-washing instruction from a standard group of voices or can download voice files to pick a unique personalized voice to perform the audio hand-washing instruction.

16. The system of claim 1, wherein the user can select the image of a particular person to perform the video hand-washing instruction from a standard group of images of persons or can download image files to pick a unique personalized image of a person to perform the video hand-washing instruction.

17. The system of claim 1, wherein said computing device contains a database that allows management to set up rules about the degree of compliance necessary for each step or series of steps in the hand-washing process, what user actions are appropriate in response to each degree of non-compliance, how the system will instruct the user and/or log the degree of compliance with said rule and what level of instruction the system will provide based on the level of expertise of the user.

18. The system of claim 14, wherein the holographic display may rotate or zoom the instructional images to better show the instructions for the step being performed, based on system monitoring of the current or historical performance of said step by the user.