Interactive virtual care

• US 8,771,206 B2
• Filed: 08/19/2011
• Issued: 07/08/2014
• Est. Priority Date: 08/19/2011
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services Limited (Accenture PLC)
• Inventors: Gettelman, Craig A., Wan, Dadong, Pogula, Ankur, Reierson, Ben, Erickson, Terrianne
• Primary Examiner(s): Towa, Rene
• Assistant Examiner(s): ABOUELELA, MAY A
• Application Number:
  US13/213,930
• Publication Number:
  US 20130046149A1
• Time in Patent Office: 1,054 Days
• Field of Search: 600/587, 600/595, 600/592, 600/300, 600/301, 473/516, 473/615, D21/513, D21/514, D21/575, D21/576, D21/585
• US Class Current: 600/587
• CPC Class Codes: A61B 2505/07 Home care
• CPC Class Codes: A61B 3/0041 characterised by display arrangements
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/0062 Arrangements for scanning
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/0014 using an image reference approach
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: G16H 50/70 : for mining of medical data, e.g. analysing previous cases of other patients
• CPC Class Codes: G16Z 99/00 : Subject matter not provided for in other main groups of this subclass

Abstract

An interactive virtual care system may include a user sensory module to acquire multi-modal user data related to user movement. A data analysis module may compare the multi-modal user data to predetermined historical user data and/or statistical norm data for users to identify an anomaly in the user movement.

Claims

1. An interactive virtual care system comprising:

a user sensory module to acquire multi-modal user data related to user movement of at least one portion of a user'"'"'s body, wherein the user movement of the at least one portion of the user'"'"'s body is to be performed at a distance away from the user sensory module, wherein the user sensory module includes a depth camera to acquire the multi-modal user data, and wherein the user sensory module is to provide real-time digitization of the user movement, based on an interpretation of the user movement by the user sensory module, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user'"'"'s body;

a responder sensory module to acquire multi-modal responder data related to responder movement performed at a distance away from the responder sensory module; and

a data analysis module, executed by a processor, to compare the multi-modal user data to predetermined historical user data and statistical norm data for users, and to compare the multi-modal user data to the multi-modal responder data to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable.

2. The system of claim 1, wherein the user sensory module includes a microphone array to acquire multi-modal user data related to speech.

3. The system of claim 1, wherein the responder sensory module is disposed at a remote location from a user.

4. The system of claim 1, further comprising a responder interface module to display the computer-generated version of the user movement, wherein the data analysis module is to further highlight the at least one anomaly in the user movement in the computer-generated version of the user movement for display by the responder interface module.

5. The system of claim 4, wherein the responder interface module is to further display a real-time version of the user movement at least one of adjacent to and superimposed on the computer-generated version of the user movement.

6. The system of claim 1, further comprising a user interface module to display the computer-generated version of the user movement and a real-time version of the user movement at least one of adjacent to and superimposed on the computer-generated version of the user movement.

7. The system of claim 1, further comprising a user interface module to display the computer-generated version of the user movement and highlight the at least one anomaly in the user movement in the computer-generated version of the user movement.

8. The system of claim 1, wherein the user movement includes walking.

9. The system of claim 1, wherein the responder sensory module is to further acquire the multi-modal responder data related to responder movement of at least one portion of a responder'"'"'s body, wherein the responder movement of the at least one portion of the responder'"'"'s body is to be performed at the distance away from the responder sensory module.

10. The system of claim 1, further comprising a user interface module to display the computer-generated version of the user movement and a real-time version of the user movement superimposed on the computer-generated version of the user movement.

11. The system of claim 1, wherein the computer-generated version of the user movement includes at least one of joints of the user'"'"'s body displayed as connectors and bones of the user'"'"'s body displayed as line segments between the connectors.

12. The system of claim 1, wherein the highlights of movement of the at least one portion of the user'"'"'s body include a computer-generated display of at least one internal feature of the at least one portion of the user'"'"'s body.

13. The system of claim 1, wherein the predetermined historical user data and statistical norm data for users respectively include computer-generated versions of movements of the at least one portion of the user'"'"'s body and movements of the at least one portion of bodies of the users.

14. A method for interactive virtual care, the method comprising:

acquiring multi-modal user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module, wherein the user movement of the at least one portion of the user'"'"'s body is to be performed at a distance away from the user sensory module;

performing real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user'"'"'s body;

acquiring multi-modal responder data related to responder movement performed at a distance away from a responder sensory module;

comparing, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users, and the multi-modal user data to the multi-modal responder data, to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable;

displaying the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user'"'"'s body; and

highlighting the at least one anomaly in the user movement in the computer-generated version of the user movement.

15. The method of claim 14, further comprising:

displaying a real-time version of the user movement at least one of adjacent to and superimposed on the computer-generated version of the user movement.

16. The method of claim 14, further comprising:

generating metrics related to a degree of the anomaly in the user movement of the at least one portion of the user'"'"'s body.

17. The method of claim 14, further comprising:

displaying a real-time version of the user movement superimposed on the computer-generated version of the user movement.

18. A non-transitory computer readable medium having stored thereon a computer executable program to provide interactive virtual care, the computer executable program when executed causes a computer system to:

acquire multi-modal user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module, wherein the user movement of the at least one portion of the user'"'"'s body is to be performed at a distance away from the user sensory module;

perform real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user'"'"'s body;

acquire multi-modal responder data related to responder movement performed at a distance away from a responder sensory module;

compare, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users, and the multi-modal user data to the multi-modal responder data, to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable;

display the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user'"'"'s body; and

highlight the at least one anomaly in the user movement in the computer-generated version of the user movement.

19. A method for interactive virtual care, the method comprising:

acquiring multi-modal user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module, wherein the user movement of the at least one portion of the user'"'"'s body is to be performed at a distance away from the user sensory module;

performing real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user'"'"'s body;

comparing, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable;

displaying the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user'"'"'s body;

highlighting the at least one anomaly in the user movement in the computer-generated version of the user movement; and

displaying predetermined user data for viewing by the user without receiving the predetermined user data.

20. A method for interactive virtual care, the method comprising:

acquiring multi-modal user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module, wherein the user movement of the at least one portion of the user'"'"'s body is to be performed at a distance away from the user sensory module;

performing real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user'"'"'s body;

comparing, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable;

displaying the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user'"'"'s body;

highlighting the at least one anomaly in the user movement in the computer-generated version of the user movement; and

displaying predetermined user data for viewing by a responder without receiving the predetermined user data.