Interactive virtual care

• US 9,149,209 B2
• Filed: 10/14/2014
• Issued: 10/06/2015
• Est. Priority Date: 08/19/2011
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services Limited (Accenture PLC)
• Inventors: Gettelman, Craig A., Wan, Dadong, Pogula, Ankur, Reierson, Ben, Erickson, Terrianne
• Primary Examiner(s): Towa, Rene
• Assistant Examiner(s): ABOUELELA, MAY A
• Application Number:
  US14/513,960
• Publication Number:
  US 20150045646A1
• Time in Patent Office: 357 Days
• Field of Search: 600/300, 600/301, 600/587, 600/592, 600/595, 473/615
• US Class Current: 1/1
• CPC Class Codes: A61B 2505/07 Home care
• CPC Class Codes: A61B 3/0041 characterised by display arrangements
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/0062 Arrangements for scanning
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/0014 using an image reference approach
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: G16H 50/70 : for mining of medical data, e.g. analysing previous cases of other patients
• CPC Class Codes: G16Z 99/00 : Subject matter not provided for in other main groups of this subclass

Abstract

An interactive virtual care system may include a user sensory module to acquire multi-modal user data related to user movement. A data analysis module may compare the multi-modal user data to predetermined historical user data and/or statistical norm data for users to identify an anomaly in the user movement.

Claims

1. An interactive virtual care system comprising:

a user sensory module comprising at least one video sensory device to acquire user data related to user movement of at least one portion of a user'"'"'s body, the user movement of the at least one portion of the user'"'"'s body being performed at a distance away from the user sensory module,

wherein the user sensory module is further configured to;

digitize, in real-time, the user movement of the at least one portion of the user'"'"'s body based on an interpretation of the acquired user data by the user sensory module, and

produce a computer-generated version of the user movement of the at least one portion of the user'"'"'s body, and transmit a signal of the digitized user movement of the at least one portion of the user'"'"'s body based on the interpretation of the acquired user data by the user sensory module and the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, wherein the signal is structured to provide for a display of the digitized user movement of the at least one portion of the user'"'"'s body, and highlighting of the digitized user movement of the at least one portion of the user'"'"'s body in the display of the digitized user movement of the at least one portion of the user'"'"'s body, wherein the computer-generated version of the user movement of the at least one portion of the user'"'"'s body includes joints of the user'"'"'s body displayed as connectors and/or skeletal features of the user'"'"'s body displayed as line segments between the connectors;

a data analysis module, executed by a processor, to cause the processor to;

receive the acquired user data from the user sensory module, and

compare the acquired user data to predetermined historical user data and/or statistical norm data for other users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body; and

a responder interface module comprising a display,

wherein the responder interface module is configured to;

display the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, highlighting the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body identified by the data analysis module.

2. The system of claim 1, wherein the at least one video sensory device comprises a video sensor to acquire a video stream of the user movement of the at least one portion of the user'"'"'s body.

3. The system of claim 1, wherein the at least one video sensory device comprises an audio sensor to acquire user data related to speech.

4. The system of claim 1, wherein the responder interface module is further configured to:

display a real-time version of the user movement of the at least one portion of the user'"'"'s body adjacent to and/or superimposed on the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

5. The system of claim 1, further comprising:

a user interface module comprising a display,

wherein the user interface module is configured to;

display the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, and

additionally display a real-time version of the user movement adjacent to and/or superimposed on the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

6. The system of claim 1, further comprising:

a user interface module comprising a display,

wherein the user interface module is configured to;

display the computer-generated version of the user movement of the at least one portion of the user'"'"'s body and highlight the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body identified by the data analysis module in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

7. The system of claim 1, wherein the user movement of the at least one portion of the user'"'"'s body includes walking, and the at least one portion of the user'"'"'s body comprises one or both of the user'"'"'s legs.

8. The system of claim 1, wherein the highlights of the digitized user movement of the at least one portion of the user'"'"'s body include a computer-generated display of at least one internal feature of the at least one portion of the user'"'"'s body.

9. The system of claim 1, wherein the predetermined historical user data and the statistical norm data for the other users respectively include computer-generated versions of movements of the at least one portion of the user'"'"'s body and movements of the same at least one portion of bodies of the other users.

10. A method for interactive virtual care, the method comprising:

acquiring user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module comprising at least one video sensory device, the user movement of the at least one portion of the user'"'"'s body being performed at a distance away from the user sensory module;

digitizing the user movement of the at least one portion of the user'"'"'s body based on an interpretation of the acquired user data by the user sensory module;

producing a computer-generated version of the user movement of the at least one portion of the user'"'"'s body;

generating a signal of the digitized user movement of the at least one portion of the user'"'"'s body based on the interpretation of the acquired user data by the user sensory module and the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, wherein the signal is structured to provide for a display of the digitized user movement of the at least one portion of the user'"'"'s body, and highlighting of the digitized user movement of the at least one portion of the user'"'"'s body in the display of the digitized user movement of the at least one portion of the user'"'"'s body, wherein the highlights of the digitized user movement of the at least one portion of the user'"'"'s body include a computer-generated display of at least one internal feature of the at least one portion of the user'"'"'s body;

comparing, by a processor, the acquired user data to predetermined historical user data and/or statistical norm data for other users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body;

highlighting the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body; and

providing for display, using the signal, the highlights of the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body.

11. The method of claim 10, further comprising:

providing for display a real-time version of the user movement of the at least one portion of the user'"'"'s body adjacent to and/or superimposed on the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

12. The method of claim 10, further comprising:

generating metrics related to a degree of the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body.

13. The method of claim 10, further comprising:

providing for display joints of the user'"'"'s body as connectors and/or skeletal features of the user'"'"'s body as line segments between the connectors in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

14. A non-transitory computer readable medium having stored thereon a computer executable program to provide interactive virtual care, the computer executable program when executed causes a computer system to:

acquire user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module comprising at least one video sensory device, the user movement of the at least one portion of the user'"'"'s body being performed at a distance away from the user sensory module;

digitize the user movement of the at least one portion of the user'"'"'s body based on an interpretation of the acquired user data by the user sensory module;

produce, a computer-generated version of the user movement of the at least one portion of the user'"'"'s body;

generate a signal of the digitized user movement of the at least one portion of the user'"'"'s body based on the interpretation of the acquired user data by the user sensory module and the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, wherein the signal is structured to provide for a display of the digitized user movement of the at least one portion of the user'"'"'s body, and highlighting of the digitized user movement of the at least one portion of the user'"'"'s body in Rail the display of the digitized user movement of the at least one portion of the user'"'"'s body;

compare, by a processor, the acquired user data to predetermined historical user data and/or statistical norm data for other users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body, wherein the predetermined historical user data and the statistical norm data for the other users respectively include computer-generated versions of movements of the at least one portion of the user'"'"'s body and movements of the same at least one portion of bodies of the other users;

highlight the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body; and

provide for display, using the signal, the highlights of the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body.

15. The non-transitory computer readable medium of claim 14, the computer executable program when executed further causes the computer system to:

providing for display joints of the user'"'"'s body as connectors and/or skeletal features of the user'"'"'s body as line segments between the connectors in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

16. The non-transitory computer readable medium of claim 14, wherein the highlights of the digitized user movement of the at least one portion of the user'"'"'s body include a computer-generated display of at least one internal feature of the at least one portion of the user'"'"'s body.