Interactive virtual care

• US 9,629,573 B2
• Filed: 05/24/2016
• Issued: 04/25/2017
• Est. Priority Date: 08/19/2011
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services Limited (Accenture PLC)
• Inventors: Gettelman, Craig A., Wan, Dadong, Pogula, Ankur, Reierson, Ben, Erickson, Terrianne
• Primary Examiner(s): Towa, Rene
• Assistant Examiner(s): ABOUELELA, MAY A
• Application Number:
  US15/163,192
• Publication Number:
  US 20160262660A1
• Time in Patent Office: 336 Days
• Field of Search: 600300, 600301, 600587, 600595
• CPC Class Codes: A61B 2505/07 Home care
• CPC Class Codes: A61B 3/0041 characterised by display arrangements
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/0062 Arrangements for scanning
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/0014 using an image reference approach
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: G16H 50/70 : for mining of medical data, e.g. analysing previous cases of other patients
• CPC Class Codes: G16Z 99/00 : Subject matter not provided for in other main groups of this subclass

Abstract

An interactive virtual care system may include a user sensory module to acquire multi-modal user data related to user movement. A data analysis module may compare the multi-modal user data to predetermined historical user data and/or statistical norm data for users to identify an anomaly in the user movement.

Claims

1. An interactive virtual care system comprising:

at least one processor;

and a memory storing machine readable instructions that when executed by the at least one processor cause the at least one processor to acquire, by at least one sensory device, user data related to user movement of at least one portion of a user'"'"'s body, the user movement of the at least one portion of the user'"'"'s body being performed at a distance away from the at least one sensory device;

digitize, in real-time, the user movement of the at least one portion of the user'"'"'s body based on an interpretation of the acquired user data;

produce a computer-generated version of the user movement of the at least one portion of the user'"'"'s body;

transmit a signal of the digitized user movement of the at least one portion of the user'"'"'s body based on the interpretation of the acquired user data and the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, wherein the signal is to provide for a display of the digitized user movement of the at least one portion of the user'"'"'s body, and highlighting of the digitized user movement of the at least one portion of the user'"'"'s body in the display of the digitized user movement of the at least one portion of the user'"'"'s body, wherein the computer-generated version of the user movement of the at least one portion of the user'"'"'s body includes joints of the user'"'"'s body displayed as connectors and/or skeletal features of the user'"'"'s body displayed as line segments between the connectors;

compare the acquired user data to predetermined historical user data and/or statistical norm data for other users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body; and

display the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, highlighting the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body identified to provide interactive virtual care.

2. The system of claim 1, wherein the at least one sensory device comprises a video sensor to acquire a video stream of the user movement of the at least one portion of the user'"'"'s body.

3. The system of claim 1, wherein the at least one sensory device comprises an audio sensor to acquire user data related to speech.

4. The system of claim 1, wherein the machine readable instructions when executed by the at least one processor further cause the at least one processor to:

display a real-time version of the user movement of the at least one portion of the user'"'"'s body adjacent to and/or superimposed on the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

5. The system of claim 1, wherein the machine readable instructions when executed by the at least one processor further cause the at least one processor to:

display the computer-generated version of the user movement of the at least one portion of the user'"'"'s body; and

additionally display a real-time version of the user movement adjacent to and/or superimposed on the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

6. The system of claim 1, wherein the machine readable instructions when executed by the at least one processor further cause the at least one processor to:

display the computer-generated version of the user movement of the at least one portion of the user'"'"'s body; and

highlight the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body identified in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

7. The system of claim 1, wherein the user movement of the at least one portion of the user'"'"'s body includes walking, and the at least one portion of the user'"'"'s body comprises one or both of the user'"'"'s legs.

8. The system of claim 1, wherein the highlights of the digitized user movement of the at least one portion of the user'"'"'s body include a computer-generated display of at least one internal feature of the at least one portion of the user'"'"'s body.

9. The system of claim 1, wherein the predetermined historical user data and the statistical norm data for the other users respectively include computer-generated versions of movements of the at least one portion of the user'"'"'s body and movements of the same at least one portion of bodies of the other users.

10. A method for interactive virtual care, the method comprising:

acquiring, by at least one processor, user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module comprising at least one sensory device, the user movement of the at least one portion of the user'"'"'s body being performed at a distance away from the user sensory module;

digitizing, by the at least one processor, the user movement of the at least one portion of the user'"'"'s body based on an interpretation of the acquired user data by the user sensory module;

producing, by the at least one processor, a computer-generated version of the user movement of the at least one portion of the user'"'"'s body;

generating, by the at least one processor, a signal of the digitized user movement of the at least one portion of the user'"'"'s body based on the interpretation of the acquired user data by the user sensory module and the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, wherein the signal is to provide for a display of the digitized user movement of the at least one portion of the user'"'"'s body, and highlighting of the digitized user movement of the at least one portion of the user'"'"'s body in the display of the digitized user movement of the at least one portion of the user'"'"'s body, wherein the highlights of the digitized user movement of the at least one portion of the user'"'"'s body include a computer-generated display of at least one internal feature of the at least one portion of the user'"'"'s body;

comparing, by the at least one processor, the acquired user data to predetermined historical user data and/or statistical norm data for other users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body;

highlighting, by the at least one processor, the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body; and

providing, by the at least one processor, for display, using the signal, the highlights of the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body to provide interactive virtual care.

11. The method of claim 10, further comprising:

providing, by the at least one processor, for display a real-time version of the user movement of the at least one portion of the user'"'"'s body adjacent to and/or superimposed on the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

12. The method of claim 10, further comprising:

generating, by the at least one processor, metrics related to a degree of the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body.

13. The method of claim 10, further comprising:

providing, by the at least one processor, for display joints of the user'"'"'s body as connectors and/or skeletal features of the user'"'"'s body as line segments between the connectors in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

14. The method of claim 10, wherein the at least one sensory device comprises a video sensor to acquire a video stream of the user movement of the at least one portion of the user'"'"'s body.

15. The method of claim 10, wherein the at least one sensory device comprises an audio sensor to acquire user data related to speech.

16. A non-transitory computer readable medium having stored thereon a computer executable program to provide interactive virtual care, the computer executable program when executed causes a computer system to:

acquire, by at least one processor, user data related to user movement of at least one portion of a user'"'"'s body by using a user sensory module comprising at least one sensory device, the user movement of the at least one portion of the user'"'"'s body being performed at a distance away from the user sensory module;

digitize, by the at least one processor, the user movement of the at least one portion of the user'"'"'s body based on an interpretation of the acquired user data by the user sensory module;

produce, by the at least one processor, a computer-generated version of the user movement of the at least one portion of the user'"'"'s body;

generate, by the at least one processor, a signal of the digitized user movement of the at least one portion of the user'"'"'s body based on the interpretation of the acquired user data by the user sensory module and the computer-generated version of the user movement of the at least one portion of the user'"'"'s body, wherein the signal is to provide for a display of the digitized user movement of the at least one portion of the user'"'"'s body, and highlighting of the digitized user movement of the at least one portion of the user'"'"'s body in the display of the digitized user movement of the at least one portion of the user'"'"'s body;

compare, by the at least one processor, the acquired user data to predetermined historical user data and/or statistical norm data for other users to identify at least one anomaly in the user movement of the at least one portion of the user'"'"'s body, wherein the predetermined historical user data and the statistical norm data for the other users respectively include computer-generated versions of movements of the at least one portion of the user'"'"'s body and movements of the same at least one portion of bodies of the other users;

highlight, by the at least one processor, the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body; and

provide, by the at least one processor, for display, using the signal, the highlights of the at least one anomaly in the user movement of the at least one portion of the user'"'"'s body to provide interactive virtual care.

17. The non-transitory computer readable medium of claim 16, the computer executable program when executed further causes the computer system to:

provide, by the at least one processor, for display joints of the user'"'"'s body as connectors and/or skeletal features of the user'"'"'s body as line segments between the connectors in the computer-generated version of the user movement of the at least one portion of the user'"'"'s body.

18. The non-transitory computer readable medium of claim 16, wherein the highlights of the digitized user movement of the at least one portion of the user'"'"'s body include a computer-generated display of at least one internal feature of the at least one portion of the user'"'"'s body.

19. The non-transitory computer readable medium of claim 16, wherein the at least one sensory device comprises a video sensor to acquire a video stream of the user movement of the at least one portion of the user'"'"'s body.

20. The non-transitory computer readable medium of claim 16, wherein the at least one sensory device comprises an audio sensor to acquire user data related to speech.