Multidimensional halo-based visualization system

• US 10,008,013 B2
• Filed: 09/29/2015
• Issued: 06/26/2018
• Est. Priority Date: 10/01/2014
• Status: Active Grant

• Current Assignee: Ora, Inc.
• Original Assignee: Ora, Inc.
• Inventors: Crnokrak, Peter
• Primary Examiner(s): Caschera, Antonio A
• Application Number:
  US14/868,702
• Publication Number:
  US 20160098847A1
• Time in Patent Office: 1,001 Days
• CPC Class Codes: A61B 5/0015 characterised by features of the telemetry system
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/1102 Ballistocardiography
• CPC Class Codes: A61B 5/1112 Global tracking of patients, e.g. by using GPS
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/4812 Detecting sleep stages or cycles
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/203 Drawing of straight lines or curves
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Systems, methods, and machine readable media for visualizing complex data, including real-time data streams from wearable device sensors, may use a halo-based representation. Halos are comprised of multiple rings that can be used to efficiently convey, for example, information about the status of a subject, such as a subject'"'"'s heart rate, activity level, and calories burned at particular times throughout a day.

Claims

1. A method for transforming complex state data into a visualization of the status of a subject at a range of time points, comprising:

receiving, at a computing device, at least one data stream comprising state data for the subject, wherein the state data includes a plurality of metrics capturing information regarding the status of the subject at a series of time points;

providing each metric in the plurality of metrics as a respective parameter to a description of a halo comprised of a plurality of rings, each respective ring corresponding to a time point, wherein at least two parameters are selected from the group consisting of;

size, wherein size scales the spacing between respective rings,

color, wherein color defines the color of respective rings,

complexity, wherein complexity scales the magnitude and frequency of distortions in respective rings,

speed, wherein speed scales the rate of movement of respective rings,

brightness, wherein brightness scales the opacity of respective rings,

height, wherein height scales the magnitude of extension of distortions in respective rings outside of the plane of the halo,

movement type, wherein movement type scales the asymmetry of movement of respective rings,

rotation, wherein the halo rotates clockwise or counterclockwise,

pulsation, wherein pulsation scales the frequency of a sequence of contraction and expansion of the width of the halo,

radiation, wherein radiation scales the magnitude or frequency of a sequential alteration of the appearance of a subset of the plurality of rings, such that the sequence progresses from the center of the halo to the edge or the reverse,

glow, wherein glow scales the magnitude or frequency of highlighting applied to the plurality of rings, and

line type, wherein line type selects between the display of respective rings using solid, dashed, and dotted lines;

rendering the description of the halo at a processor, and

providing the rendered description of the halo to a display.

2. The method of claim 1, wherein the at least one data stream includes heart rate data, accelerometer data, altimeter data, gyroscope data, or GPS data.

3. The method of claim 2, wherein one or more respective data stream of the at least one data stream is a real time data stream from a sensor on a wearable computing device.

4. The method of claim 1, wherein the at least one data stream includes data from an online database.

5. The method of claim 1, wherein the state data are transformed into the plurality of metrics.

6. The method of claim 1, wherein the plurality of metrics include heart rate, distance travelled, elevation climbed, step count, standing duration, activity duration, speed of movement, intensity of movement, calories burned, sleep cycle, hydration, electrical skin conductance, or tremor detection.

7. The method of claim 1, further comprising:

comparing the halo to a second halo by calculating difference parameters representing the difference between corresponding parameters underlying the halo and the second halo;

rendering a description of a third halo based on the difference parameters; and

providing the rendered description of the third halo to a display.

8. The method of claim 7, wherein (1) the second halo is based on historical data associated with the subject, or (2) the second halo represents a target halo for the subject, or (3) the second halo represents an undesirable state, or (4) the second halo is based on data associated with a friend of the subject.

9. The method of claim 1, wherein the display is the touch screen display of a mobile device and the processor is located on a different mobile device.

10. The method of claim 1, wherein the display is the display of a computing device and the processor is located at a server.

11. A method for transforming complex state data into a visualization of the status of a subject, comprising:

receiving, at a computing device, at least one data set comprising state data for the subject, wherein the at least one data set includes a plurality of metrics capturing information regarding the status of the subject;

providing each metric in the plurality of metrics as a respective parameter to a description of a halo comprised of a plurality of rings, wherein at least three parameters are selected from the group consisting of;

size, wherein size scales the width of the halo,

color, wherein color defines the color of the plurality of rings,

complexity, wherein complexity scales the magnitude and frequency of distortions in respective rings,

speed, wherein speed scales the rate of movement of respective rings,

brightness, wherein brightness scales the opacity of the plurality of rings,

height, wherein height scales the magnitude of extension of distortions in respective rings outside of the plane of the halo,

movement type, wherein movement type scales the asymmetry of movement of the plurality of rings,

rotation, wherein the halo rotates clockwise or counterclockwise,

pulsation, wherein pulsation scales the frequency of a sequence of contraction and expansion of the width of the halo,

radiation, wherein radiation scales the magnitude or frequency of a sequential alteration of the appearance of a subset of the plurality of rings, such that the sequence progresses from the center of the halo to the edge or the reverse,

glow, wherein glow scales the magnitude or frequency of highlighting applied to the plurality of rings,

line type, wherein line type selects between the display of respective rings using solid, dashed, and dotted lines, and

growth, wherein growth scales a change in the number of rings displayed;

rendering the description of the halo at a processor, and

providing the rendered description of the halo to a display.

12. The method of claim 11, wherein the at least one data set includes heart rate data, accelerometer data, altimeter data, gyroscope data, or GPS data.

13. The method of claim 12, wherein one or more respective data set of the at least one data set is a real time data stream from a sensor on a wearable computing device.

14. The method of claim 11, wherein the at least one data set includes data from an online database.

15. The method of claim 11, wherein the state data are transformed into the plurality of metrics.

16. The method of claim 11, wherein the plurality of metrics include heart rate, distance travelled, elevation climbed, step count, standing duration, activity duration, speed of movement, intensity of movement, calories burned, sleep cycle, hydration, electrical skin conductance, or tremor detection.

17. The method of claim 16, wherein (1) the second halo is based on historical data associated with the subject, or (2) the second halo represents a target halo for the subject, or (3) the second halo represents an undesirable state, or (4) the second halo is based on data associated with a friend of the subject.

18. The method of claim 11, further comprising:

comparing the halo to a second halo by calculating difference parameters representing the difference between corresponding parameters underlying the halo and the second halo;

rendering a description of a third halo based on the difference parameters; and

providing the rendered description of the third halo to a display.

19. The method of claim 11, wherein the display is the touch screen display of a mobile device and the processor is located on a different mobile device.

20. The method of claim 11, wherein the display is the display of a computing device and the processor is located at a server.