Methods and systems for metrics analysis and interactive rendering, including events having combined activity and location information

• US 10,546,480 B2
• Filed: 09/08/2014
• Issued: 01/28/2020
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: Fitbit, Inc. (Alphabet Inc.)
• Original Assignee: Fitbit, Inc. (Alphabet Inc.)
• Inventors: Yuen, Shelten Gee Jao, Park, James, Lee, Hans Christiansen
• Primary Examiner(s): Nghiem, Michael P
• Assistant Examiner(s): Ngo, Dacthang P
• Application Number:
  US14/480,576
• Publication Number:
  US 20140375452A1
• Time in Patent Office: 1,968 Days
• Field of Search: 702142, 702149, 702150, 702152-153, 702179
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 2560/045 with a separable interface unit, e.g. for communication
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/1112 Global tracking of patients, e.g. by using GPS
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/222 combined with detection or measurement of physiological parameters, e.g. heart rate
• CPC Class Codes: A61B 5/4806 Sleep evaluation A61B5/4821 takes precedence; devices for inducing sleep A61M21/02
• CPC Class Codes: A61B 5/681 Wristwatch-type devices
• CPC Class Codes: A61B 5/6838 Clamps or clips
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G01C 22/006 Pedometers
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G08B 21/18 Status alarms G08B21/02 takes precedence
• CPC Class Codes: G16H 20/30 : relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/40 : relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: H04W 4/029 : Location-based management or tracking services

Abstract

A method includes receiving location data of a monitoring device when carried by a user and receiving motion data of the monitoring device. The motion data is associated with a time of occurrence and the location data. The method includes processing the received motion data to identify a group of the motion data having a substantially common characteristic and processing the location data for the group of the motion data. The group of motion data by way of processing the location data provides an activity identifier. The motion data includes metric data that identifies characteristics of the motion data. The method includes transferring the activity identifier and the characteristics of the motion data to a screen of a device for display. The activity identifier being a graphical user interface that receives an input for rendering more or less of the characteristics of the motion data.

Claims

1. A server system, the server system comprising:

a network interface configured to communicate with an activity tracking device via a computer network, wherein the activity tracking device is configured to be worn by a user;

a memory device configured to store a rules database including inference rules of the activity tracking device; and

one or more processors communicatively coupled to the memory device and configured to;

receive geo-location data from the activity tracking device via the network interface, the geo-location data indicating one or more geo-locations;

receive motion data from the activity tracking device, the motion data generated by the activity tracking device while the user is performing one or more motions, the motion data associated with a time interval of occurrence of the one or more motions and the one or more geo-locations;

identify a type of activity performed by the user based at least on a comparison between the motion data and identifiable activity patterns corresponding to a plurality of predefined types of activity;

determine based on the inference rules, that the identified type of activity is consistent with the one or more geo-locations, the inference rules correlating the motion data and the geo-location data of the activity tracking device to the predefined types of activity;

determine, based at least on the geo-location data and the time interval, that the user is performing the identified type of activity at a place of occurrence;

select a first graphical identifier that identifies the place of occurrence;

select a second graphical identifier that identifies the type of activity;

store information indicating the first graphical identifier, the second graphical identifier, and the time interval of occurrence of the one or more motions in a database such that the first graphical identifier is associated with the second graphical identifier, and the time interval of occurrence of the one or more motions is associated with the first and second graphical identifier; and

cause display of the first and second graphical identifiers corresponding to a distinct time segment of a graphical timeline, the graphical timeline comprising a) a first axis representing time and b) the first and second graphical identifiers such that the graphical timeline provides a graphical representation of the type of activity that was performed at the place of occurrence during the time interval of occurrence of the one or more motions.

2. The server system of claim 1, wherein the one or more processors are configured to generate a text summary based on the type of activity and a level of the activity.

3. The server system of claim 1, wherein the geo-location data includes an altitude of the activity tracking device.

4. The server system of claim 1, wherein the activity tracking device is in the form of a watch, or a wristband, or a bracelet, or a clip.

5. The server system of claim 1, wherein the one or more processors are configured to provide access to a user account to view the type of activity and an activity level of the type of activity.

6. The server system of claim 1, wherein the one or more processors are configured to provide access to a user account to view the type of activity, an activity level of the type of activity, and the place of occurrence identified by the first graphical identifier.

7. The server system of claim 1, wherein the motion data includes one or more positions of the activity tracking device.

8. The server system of claim 1, wherein the motion data is associated with the time interval of occurrence of the one or more motions when an amount of time at which a number of positions reached by the activity tracking device is monitored.

9. The server system of claim 1, wherein the one or more processors are configured to determine that the place of occurrence identified by the first graphical identifier is consistent with the type of activity.

10. The server system of claim 1, wherein the one or more processors are configured to determine, based on the motion data, a distance covered by the user during the time interval of occurrence of the one or more motions.

11. The server system of claim 1, wherein the one or more processors are configured to match the type of activity with the place of occurrence identified by the first graphical identifier when the one or more processors determine that the place of occurrence identified by the first graphical identifier is consistent with the type of activity.

12. The server system of claim 1, wherein the one or more processors are configured to allow the type of activity, an activity level of the type of activity, and the place of occurrence identified by the first graphical identifier to be accessed via a user account.

13. The server system of claim 1, wherein the one or more processors are configured to allow, via a user account, filtering of the one or more places of occurrence visited by the user while performing the type of activity and other types of activities.

14. The server system of claim 1, wherein the one or more processors are configured to allow, via a user account, a selection of user groups who can view the type of activity and the place of occurrence identified by the first graphical identifier.

15. The server system of claim 1, wherein the one or more processors are configured to receive the geo-location data and the motion data from the activity tracking device via the computer network.

16. The server system of claim 1, wherein the one or more processors communicatively coupled to the memory device are further configured to select a third graphical identifier identifying a different place of occurrence than the place of occurrence associated with the first graphical identifier, and wherein the third graphical identifier is associated with a second time segment of the electronic-based graphical timeline.

17. A system, comprising:

(a) a server, including;

a memory device configured to store a rules database including inference rules of an activity tracking device configured to be worn by a user,

a network interface, and

a processor coupled to the memory device; and

(b) the activity tracking device, including;

a device locator configured to determine geo-location data of the activity tracking device, the geo-location data indicating one or more geo-locations,

a position sensor configured to determine motion tracking data, the motion tracking data is associated with a time interval of occurrence of one or more motions performed by the user and with the geo-location data,

a display, and

a wireless communication device coupled to the device locator and the position sensor and configured to communicate the geo-location data and the motion tracking data to the server, wherein the processor of the server is configured to;

receive the geo-location data and the motion tracking data from the activity tracking device via the network interface,

identify a type of activity performed by the user based at least on a comparison between the motion tracking data and identifiable activity patterns corresponding to a plurality of predefined types of activity,

determine, based on the inference rules, that the identified type of activity is consistent with the one or more geo-locations, the inference rules correlating the motion tracking data and the geo-location data of the activity tracking device to the predefined types of activity,

determine from the geo-location data and the time interval that the user is performing the type of activity at a place of occurrence,

select a first graphical identifier that identifies the corresponding place of occurrence,

select a second graphical identifier that identifies the type of the activity,

store information indicating the first and second graphical identifiers in a database, and

transmit the information indicating the first and second graphical identifiers to the activity tracking device, and wherein the activity tracking device is configured to display the first and second graphical identifiers corresponding to a distinct time segment of a graphical timeline, the graphical timeline comprising a) a first axis representing time and b) the first and second graphical identifiers indicating that the type of activity was performed at the place of occurrence.

18. The system of claim 17, wherein the geolocation data includes an altitude of the activity tracking device.

19. The system of claim 17, wherein the processor of the server is configured to generate a sentence summary based on the type of activity and a level of the activity.

20. A method for generating an electronic-based graphical timeline to be displayed to a user, the method comprising:

receiving, via a network interface from an activity tracking device, multiple geo-locations associated with the activity tracking device, the activity tracking device for use by the user while performing an activity, the user having a user account that has the activity tracking device associated therewith, and each of the geo-locations including a longitude and a latitude obtained by a global positioning system transceiver;

receiving, via the network interface from the activity tracking device, metric data associated with the activity, the metric data measured using the activity tracking device while the activity is performed by the user, the metric data including an activity level of the activity;

identifying, via a processor of a server operatively coupled to the network interface, a type of activity performed by the user based at least on a comparison between the metric data and identifiable activity patterns corresponding to a plurality of predefined types of activity;

determining, via the processor and based on inference rules stored in a memory device operatively coupled to the processor, that the identified type of activity is consistent with one or more of the geo-locations, the inference rules correlating the metric data and the one or more geo-locations of the activity tracking device to the predefined types of activity;

determining, via the processor, a descriptive location of the activity tracking device based on the geo-locations and the identified type of activity;

calculating, via the processor, a time period for which the activity tracking device is at the descriptive location;

providing, via the processor, the time period and the descriptive location to the activity tracking device or a computing device for display;

selecting, via the processor, a first graphical identifier that identifies the corresponding descriptive location;

selecting, via the processor, a second graphical identifier that identifies the type of activity;

causing, by the processor, information indicating the first graphical identifier, the second graphical identifier, and the time period to be stored such that the first graphical identifier and the second graphical identifier are both associated with the time period; and

causing display of the first graphical identifier and the second graphical identifier corresponding to a distinct time segment of a graphical timeline on the activity tracking device or the computing device, the graphical timeline comprising a) an axis representing time and b) the first graphical identifier and the second graphical identifier such that the graphical timeline provides a graphical representation of the type of activity that was performed at the place of occurrence during the time period of the occurrence of the activity.

21. The method of claim 20, wherein determining the descriptive location identified by the first graphical identifier comprises:

determining a location of the activity tracking device based on the geo-locations;

determining a location of the activity tracking device based on the result of the comparison;

determining that the location determined based on the geo-locations is consistent with the location determined based on the result of the comparison; and

determining the descriptive location at which the activity is performed to be the location determined based on the result of the comparison in response to determining that the location determined based on the geo-locations is consistent with the location determined based on the result of the comparison.

22. The method of claim 20, wherein the descriptive location identified by the first graphical identifier is received via an input device of the computing device from the user account of the user, the user account used to access activity levels graphically representing the metric data.

23. The method of claim 20, wherein calculating the time period comprises summing multiple intermittent time periods during which the activity tracking device is at the multiple geo-locations.

24. The method of claim 20, wherein each of the geo-locations includes an altitude of the activity tracking device.

25. The method of claim 20, wherein the activity tracking device is configured to be worn externally by the user.

26. The method of claim 25, wherein the activity tracking device is configured to be worn on a portion of a body of the user.

27. A method comprising:

receiving, via a network interface from an activity tracking device, a number of geo-locations associated with the activity tracking device, the activity tracking device for use by a user during performance of an activity, the user having a user account that has the activity tracking device associated therewith, and the geo-locations including a longitude and a latitude obtained by a global positioning system transceiver;

receiving, via the network interface from the activity tracking device, metric data measured using the activity tracking device, the metric data including an activity level of the activity;

identifying, via a processor of a server operatively coupled to the network interface, a type of activity performed by the user based at least on a) one or more of the geo-locations and b) a comparison between the metric data and identifiable activity patterns corresponding to a plurality of predefined types of activity;

determining, via the processor and based on inference rules stored in a memory device operatively coupled to the processor, that the identified type of activity is consistent with the one or more of the geo-locations, the inference rules correlating the metric data and the one or more geo-locations of the activity tracking device to the predefined types of activity;

determining, via the processor, a descriptive location of the activity tracking device based on the geo-locations and the identified type of activity;

computing, via the processor, a time period for which the type of activity is performed at the descriptive location;

sending, via the processor, the time period, the descriptive location, and the type of activity to a computing device for display;

identifying, via the processor, a first graphical identifier that identifies the corresponding descriptive location;

identifying, via the processor, a second graphical identifier that identifies the type of activity;

causing, via the processor, information indicating the first graphical identifier, the second graphical identifier, and the time period to be stored such that the first graphical identifier and the second graphical identifier are associated with the time period; and

causing display of the first graphical identifier and the second graphical identifier corresponding to a distinct time segment of a graphical timeline on the computing device, the graphical timeline comprising a) an axis representing time and b) the first graphical identifier and the second graphical identifier such that the graphical timeline provides a graphical representation of the type of activity that was performed at the descriptive location during the time period of the occurrence of the activity.

28. The method of claim 27, wherein determining the descriptive location of the activity tracking device based on the geo-locations and the metric data comprises:

determining a location of the activity tracking device based on the geo-locations;

determining a location of the activity tracking device based on the result of the comparison;

determining that the location determined based on the geo-locations is consistent with the location determined based on the result of the comparison; and

determining the descriptive location identified by the first graphical identifier to be the location determined based on the result of the comparison in response to determining that the location determined based on the geo-locations is consistent with the location determined based on the result of the comparison.

29. The method of claim 27, wherein the activity tracking device is configured to be worn externally by the user on the user.