Augmented Reality Biofeedback Display

• US 20150243083A1
• Filed: 10/17/2013
• Published: 08/27/2015
• Est. Priority Date: 10/01/2012
• Status: Abandoned Application

• Current Assignee: Guy Coggins
• Original Assignee: Guy Coggins
• Inventors: Coggins, George Guy
• Application Number:
  US14/432,177
• Publication Number:
  US 20150243083A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/053 Measuring electrical impedance or conductance of a portion of the body
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/14532 for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/14546 for measuring analytes not otherwise provided for, e.g. ions, cytochromes
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: A61B 5/7445 Display arrangements, e.g. multiple display units
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes

Abstract

A system and method where at least one user'"'"'s biofeedback information is captured or recorded using biofeedback devices, while the information of their physical properties are captured or recorded using at least one camera. Both sets of information is sent to computers to be processed into at least one information stream in a style of the choice of the user. The information stream(s) are then outputted to at least one device which they can be consumed by the user, such as (but not limited to) viewed on two-dimensional or three-dimensional screens, televisions and monitors, viewed through virtual/augmented reality devices, viewed on mobile devices, printed with printers, created with three-dimensional model printers, created using product printing services, saved on the Cloud, uploaded to websites/blogs and shown using image projectors. This combined visual information stream will usually take the form of (among other things) a live video or still image showing the user(s) with their biofeedback information interpreted as colors surrounding them, painted onto a model of the user(s), as colors projected onto the user(s) themselves, or as a color field appearing to surround or project from the user'"'"'s body or musical instrument.

Claims

1. A system for displaying biofeedback information, comprising:

a first biofeedback sensor module for continuously capturing biological information from a human, animal, or plant first user;

a first camera for continuously capturing a real-world scene that includes the first user;

a first biofeedback processing module for processing information received from the first biofeedback sensor module into visual information;

a first image analysis module for detecting the location of the first user'"'"'s body;

a first display unit that overlays the visual information on the real-world scene in such a way that the location of the visual information depends on the location of the first user'"'"'s body.

2. The system of claim 1, where the display unit is one of the following:

a computer screen, a television screen, a smartphone screen, a tablet screen, virtual-reality glasses, wearable display, image projector, 3D display, printer, 3D printer.

3. The system of claim 1, where the display unit projects the visual information onto the user'"'"'s body.

4. The system of claim 1, where the biofeedback sensor module is a sensor that measures at least one of the following parameters:

body temperature, skin conductance, galvanic resistance, brainwaves, heart rate and rate variation, muscle signals, blood pressure, blood sugar, blood oxygen level, blood alcohol content.

5. The system of claim 1, where the biofeedback sensor module is a sensor that measures the levels of a medication in a user'"'"'s bloodstream.

6. The system of claim 1, where the first biofeedback processing module and the first image analysis module are contained within a computer.

7. The system of claim 1, where the first biofeedback processing module and the first image analysis module are contained within the first camera.

8. The system of claim 1, where the visual information comprises a color field that appears around the image of the first user'"'"'s body or musical instrument.

9. The system of claim 1, where the visual information comprises advertisements.

10. The system of claim 1, where the visual information comprises text.

11. The system of claim 1, further comprising:

at least one second biofeedback sensor module for continuously capturing biological information from at least one second user;

at least one second camera for continuously capturing a real-world scene that includes at least one second user;

at least one second biofeedback processing module for processing information received from the second biofeedback sensor module into visual information;

at least one second image analysis module for detecting the location of the at least one second user'"'"'s body;

at least one second display unit that overlays the visual information on the real-world scene in such a way that the location of the visual information depends on the location of the at least one second user'"'"'s body,

such that the at least one second display unit can be viewed by the first user and the first display unit can be viewed by the at least one second user.

12. The system of claim 10, where the at least one second biofeedback processing module, the at least one second image analysis module, the first biofeedback processing module, and the first image analysis module are contained within a computer.

13. The system of claim 10, where the first biofeedback processing module and the first image analysis module are contained within a first computer, and the at least one second biofeedback processing module and the at least one second image analysis module are contained within at least one second computer.

15. The system of claim 13, where the display unit is one of the following:

a computer screen, a television screen, a smartphone screen, a tablet screen, virtual-reality glasses, image projector, 3D display.

16. The system of claim 13, where the display unit projects the visual information onto a user'"'"'s body.

17. The system of claim 13, where the sound sensor module gathers data from a musical instrument.

18. The system of claim 13, where the visual information comprises a color field that appears to surround a user'"'"'s body.

19. The system of claim 13, where the information received from the sound sensor module comprises pitch information.

20. The system of claim 13, where the information received from the sound sensor module comprises timbre information.

14. A system for enhancing a musical performance, comprising:

a sound sensor module for continuously capturing musical sound made by a source of musical sound;

a camera for continuously capturing a real-world scene that includes the source of musical sound;

a computer capable of processing information received from the sound sensor module into visual information, and capable of detecting the location of the user'"'"'s body in the real-world scene;

a display unit that displays the visual information overlaid on top of the real-world scene in such a way that the location of the visual information depends on the location of the source of musical sound.