Computer interfaces including physiologically guided avatars

• US 20070050715A1
• Filed: 07/24/2006
• Published: 03/01/2007
• Est. Priority Date: 07/26/2005
• Status: Active Grant

• Current Assignee: Adidas AG
• Original Assignee: VivoMetrics, Inc.
• Inventors: Behar, Andrew
• Granted Patent: US 8,033,996 B2
• Time in Patent Office: Days
• US Class Current: 715/706
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/0531 Measuring skin impedance
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/1116 Determining posture transitions
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/6801 specially adapted to be attached to or worn on the body surface
• CPC Class Codes: A61B 5/6805 Vests
• CPC Class Codes: A61B 5/6831 Straps, bands or harnesses
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 2207/30104 Vascular flow; Blood flow; Perfusion
• CPC Class Codes: G06T 2210/41 : Medical
• CPC Class Codes: G06T 2215/16 : Using real world measurements to influence rendering
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: Y10S 128/92 : Computer assisted medical diagnostics

Abstract

This invention provides user interfaces that more intuitively display physiological data obtained from physiological monitoring of one or more subjects. Specifically, the user interfaces of this invention create and display one or more avatars having behaviors guided by physiological monitoring data. The monitoring data is preferably obtained when the subject is performing normal tasks without substantial restraint. This invention provides a range of implementations that accommodate user having varying processing and graphics capabilities, e.g., from handheld electronic devices to ordinary PC-type computers and to systems with enhanced graphics capabilities.

Claims

1. A computer-implemented method for displaying a user interface (“

UI”

) comprising;

receiving physiological monitoring data reflecting moment-by-moment values of one or more physiological parameters of a monitored subject during one or more time intervals; and

displaying a computer UI comprising at least one avatar having a visual representation reflecting the physiology of the monitored subject;

wherein the moment-by-moment appearance of the visual representation of the avatar is controlled in dependence on one or more of the received physiological parameters.

2. The method of claim 1 wherein the physiological parameters comprise one or more of a respiratory rate, a tidal volume, a cardiac rate, a cardiac stroke volume, a temperature, an activity indicator, and a physiological stress indicator.

3. The method of claim 1 wherein a plurality of avatars are displayed, each different avatar reflecting different received physiological parameters.

4. The method of claim 3 wherein at least one avatar reflects respiratory activity and at least one avatar reflects cardiac activity.

5. The method of claim 1 wherein at least one avatar is controlled by respiratory parameters so that a portion or all of its visual representation expands and contracts with a timing reflecting inspirations and expirations

6. The method of claim 5 wherein the respiration-avatar visual representation comprises images of at least one lung that are controlled to expand and contract with an amplitude reflecting tidal volumes.

7. The method of claim 1 wherein at least one avatar is controlled by cardiac parameters so that a portion or all of its visual representation expands and contracts with a timing reflecting diastoles and systoles.

8. The method of claim 7 wherein the cardiac-avatar visual representation comprises images of at least one heart that are controlled to expand and contract with an amplitude reflecting stroke volumes.

9. The method of claim 1 wherein at least one avatar is controlled by indications of subject activity level and has a visual representation comprising images that are controlled to depict a corresponding activity level.

10. The method of claim 9 wherein the activity-level avatar images comprise a representation of a person.

37. A removable computer-readable memory comprising encoded instructions for causing a processor to perform steps of claim 1 or of claim 11.

11. A computer-implemented method for displaying a user interface (“

UI”

) comprising;

receiving physiological monitoring data reflecting moment-by-moment values of one or more physiological parameters of a monitored subject during one or more time intervals;

retrieving descriptions in a graphic-description language of a visual representation of at least one avatar, wherein the avatar description further comprises instructions for controlling the avatar to reflect the physiology of the monitored subject;

generating a plurality of computer UI images in dependence on the received monitoring data and on the retrieved descriptions that provide a moment-by-moment visual representation of the avatar that is controlled in dependence on one or more of the received physiological parameters; and

displaying the generated images comprising the avatar.

12. The method of claim 11 wherein the physiological parameters comprise one or more of a respiratory rate, a tidal volume, a cardiac rate, a cardiac stroke volume, a temperature, an activity indicator, and a physiological stress indicator.

13. The method of claim 11 wherein a plurality of avatars are displayed, each different avatar reflecting different received physiological parameters.

14. The method of claim 13 wherein at least one avatar reflects respiratory activity and at least one avatar reflects cardiac activity.

15. The method of claim 11 wherein the avatar descriptions comprise at least one vector describing a portion of a generated image.

16. The method of claim 11 wherein the avatar descriptions comprise at least one polygon describing a portion of a generated image.

17. The method of claim 11 wherein the avatar descriptions comprise at least one displayable image for display in a generated image.

18. The method of claim 11 wherein the avatar descriptions comprise at least one animation sequence.

19. The method of claim 18 wherein the animation is displayed in the UI at a rate controlled by one or more received physiological parameters reflecting a physiological rate,

20. A computer user interface comprising:

at least one avatar;

wherein the avatar has a visual representation reflecting the physiology of the monitored subject; and

wherein the moment-by-moment appearance of the visual representation of the avatar is controlled in dependence on one or more physiological parameters of a monitored subject.

22. The method of claim 20 further comprising a plurality of avatars, each different avatar reflecting different physiological parameters.

23. The method of claim 20 further comprising at least one avatar reflecting respiratory activity and at least one avatar reflecting cardiac activity.

21. The user interface of 20 wherein the physiological parameters comprise one or more of a respiratory rate, a tidal volume, a cardiac rate, a cardiac stroke volume, a temperature, an activity indicator, and a physiological stress indicator.

24. A computer system for displaying a user interface (“

UI”

), the system comprising a computer-readable memory, the computer-readable memory having stored therein encoded instructions for causing a processor to perform steps of;

receiving physiological monitoring data reflecting moment-by-moment values of one or more physiological parameters of a monitored subject during one or more time intervals; and

displaying a computer UI comprising at least one avatar having a visual representation reflecting the physiology of the monitored subject;

wherein the moment-by-moment appearance of the visual representation of the avatar is controlled in dependence on one or more of the received physiological parameters.

25. The computer system of claim 24 further comprising a wearable item comprising one or more physiological sensors from which the physiological monitoring data is received.

26. The computer system of claim 25 wherein the wearable item is configured and arranged so that the monitored subject can perform normal daily activities in a substantially unrestrained manner.

27. The computer system of claim 25 wherein the physiological sensors comprise one or more cardiac sensors, respiratory sensors, accelerometers, electrocardiogram sensors, electroencephalogram sensors, electro-oculogram sensors, electro-myogram sensors, body temperature sensor, body core temperature sensors, blood oxygen sensors, sound sensors, ultrasound sensors, and electrical impedance sensors.

28. The computer system of claim 25 wherein at least one of the physiological sensors is based on inductive plethysmographic (“

IP”

) technologies.

29. The computer system of claim 28 wherein at least one of the IP-technology sensors is positioned at the mid-thorax for returning thoracocardiographic signals.

30. The computer system of claim 25 further comprising a wireless network link over which monitoring data is conveyed from the wearable item to the receiving computer system.

31. The computer system of claim 24 wherein the physiological parameters comprise one or more of a respiratory rate, a tidal volume, a cardiac rate, a cardiac stroke volume, a temperature, an activity indicator, and a physiological stress indicator.

32. The computer system of claim 24 wherein a plurality of avatars are displayed, each different avatar reflecting different received physiological parameters.

33. The computer system of claim 24 wherein at least one avatar reflects respiratory activity and at least one avatar reflects cardiac activity.

34. The computer system of claim 24 wherein displaying further comprises

retrieving descriptions in a graphic-description language of a visual representation of at least one avatar, wherein the avatar description further comprises instructions for controlling the avatar to reflect the physiology of the monitored subject;

and

generating a plurality of computer UI images in dependence on the received monitoring data and on the retrieved descriptions that provide a moment-by-moment visual representation of the avatar that is controlled in dependence on one or more of the received physiological parameters.

35. The computer system of claim 34 further comprising a plurality of computers, a first computer displaying a generated UI and at least one other computer for retrieving one or more avatar descriptions and for generating one or more UI images from the retrieved avatar descriptions.

36. The computer system of claims 24 further comprising one or more of a training simulator with a display, a personal digital assistant with a display, a handheld PC with a display, a cell phone with a display, a handheld electronic device with a display, a digital camera with a display, a wrist mounted device with a display, and a digital wrist watch with a display.

38. An method for individual training or rehabilitation comprising:

receiving physiological monitoring data reflecting moment-by-moment values of one or more physiological parameters from a monitored subject during one or more training periods; and

displaying to the subject during the training periods a computer UI comprising

one or more avatars, wherein the moment-by-moment appearance of a visual representation of the avatar is controlled in dependence on one or more of the received physiological parameters so that the avatars reflect in real time the moment-by-moment physiology of the subject during training, and

information concerning one or more of a training plan, training progress, and training goals.

39. The method of claim 38 wherein the physiological parameters comprise one or more of a respiratory rate, a tidal volume, a cardiac rate, a cardiac stroke volume, a temperature, an activity indicator, and a physiological stress indicator.

40. The method of claim 38 wherein a plurality of avatars are displayed, each different avatar reflecting different received physiological parameters.

41. The method of claim 40 wherein at least one avatar reflects respiratory activity and at least one avatar reflects cardiac activity.

42. The method of claim 38 wherein the computer UI further comprises:

an avatar having a visual representation reflecting one or more of a training plan of the subject, training progress of the subject, and training goals of the subject.

43. A system for individual training or rehabilitation comprising:

a wearable item comprising one or more physiological sensors that is configured and arranged so that a monitored subject wearing the item can perform normal training activities in a substantially unrestrained manner;

a training device comprising a user display; and

a computer system comprising a computer-readable memory, the computer-readable memory having stored therein encoded instructions for causing a processor to perform steps of;

receiving physiological monitoring data reflecting moment-by-moment values of one or more physiological parameters from a monitored subject during one or more training periods; and

displaying to the subject during the training periods a computer UI comprising

one or more avatars, wherein the moment-by-moment appearance of a visual representation of the avatar is controlled in dependence on one or more of the received physiological parameters so that the avatars reflect in real time the moment-by-moment physiology of the subject during training, and

information concerning one or more of a training plan, training progress, and training goals.

44. The system of claim 43 wherein the physiological sensors comprise one or more cardiac sensors, respiratory sensors, accelerometers, electrocardiogram sensors, electroencephalogram sensors, electro-oculogram sensors, electro-myogram sensors, body temperature sensor, body core temperature sensors, blood oxygen sensors, sound sensors, ultrasound sensors, and electrical impedance sensors.

45. The system of claim 43 wherein the wearable item further comprising a wireless device for transmitting monitoring data to the computer system.

46. The system of claim 43 wherein the physiological parameters comprise one or more of a respiratory rate, a tidal volume, a cardiac rate, a cardiac stroke volume, a temperature, an activity indicator, and a physiological stress indicator.

47. The system of claim 43 wherein a plurality of avatars are displayed, each different avatar reflecting different received physiological parameters.

48. The system of claim 47 wherein at least one displayed avatar reflects respiratory activity and at least one avatar reflects cardiac activity.

49. The system of claim 47 wherein the computer UI further comprises an avatar having a visual representation reflecting one or more of a training plan of the subject, training progress of the subject, and training goals of the subject.