Tracking user physical activity with multiple devices

• US 8,849,610 B2
• Filed: 02/11/2014
• Issued: 09/30/2014
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: Fitbit, Inc. (Alphabet Inc.)
• Original Assignee: Fitbit, Inc. (Alphabet Inc.)
• Inventors: Molettiere, Peter Andrew, Yuen, Shelten Gee Jao, Hong, Jung Ook, Axley, Andrew Cole, Park, James
• Primary Examiner(s): Raymond, Edward
• Application Number:
  US14/178,232
• Publication Number:
  US 20140164611A1
• Time in Patent Office: 231 Days
• Field of Search: 702/160, 702/155, 702182-185, 702/188
• US Class Current: 702/160
• CPC Class Codes: A61B 2560/0214 of power generation or supply
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/1112 Global tracking of patients, e.g. by using GPS
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/222 combined with detection or measurement of physiological parameters, e.g. heart rate
• CPC Class Codes: A61B 5/4809 Sleep detection, i.e. determining whether a subject is asleep or not
• CPC Class Codes: A61B 5/4812 Detecting sleep stages or cycles
• CPC Class Codes: A61B 5/4815 Sleep quality
• CPC Class Codes: A61B 5/6838 Clamps or clips
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: A63B 2220/72 Temperature
• CPC Class Codes: A63B 2220/73 Altitude
• CPC Class Codes: A63B 2230/06 heartbeat rate only
• CPC Class Codes: A63B 2230/50 : temperature
• CPC Class Codes: A63B 2230/70 : body fat
• CPC Class Codes: A63B 2230/75 : calorie expenditure
• CPC Class Codes: A63B 24/0062 : Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 71/0686 : Timers, rhythm indicators or pacing apparatus using electric or electronic means
• CPC Class Codes: G01C 22/00 : Measuring distance traversed on the ground by vehicles, persons, animals or other moving solid bodies, e.g. using odometers, using pedometers
• CPC Class Codes: G01C 22/006 : Pedometers
• CPC Class Codes: G06F 15/00 : Digital computers in general details G06F1/00 – G06F13/00; Data processing equipment in general
• CPC Class Codes: G16H 20/30 : relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: H04L 67/535 : Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Methods, devices, and computer programs are presented for creating a unified data stream from multiple data streams acquired from multiple devices. One method includes an operation for receiving activity data streams from the devices, each activity data stream being associated with physical activity data of a user. Further, the method includes an operation for assembling the unified activity data stream for a period of time. The unified activity data stream includes data segments from the data streams of at least two devices, and the data segments are organized time-wise over the period of time.

Claims

1. A method comprising:

receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time, wherein assembling the unified activity data stream further includes;

detecting a first time period with data available from two or more devices;

identifying a priority for each of the two or more devices; and

adding to the unified activity data stream a first data segment covering the first time period, the first data segment having the data from a device with a higher priority from two or more devices, wherein operations of the method are executed by a processor.

2. A method comprising:

receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time, wherein assembling the unified activity data stream further includes;

detecting a second time period with data available from a single device from the plurality of devices; and

adding to the unified activity data stream a second data segment covering the second time period, the second data segment having the data from the single device, wherein operations of the method are executed by a processor.

3. A method comprising:

receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time

generating display data for the unified activity data stream, the display data configured for presentation on an interactive user interface, the interactive user interface enabling user selection of at least one of the data segments to identify additional information for the data segment and further identify which of the plurality of devices produced the physical activity data of the user for the selected data segment, wherein operations of the method are executed by a processor.

4. The method as recited in claim 3, further including:

identifying an activity being performed by the user during at least one of the data segments; and

presenting the activity in the interactive user interface.

5. The method as recited in claim 4, wherein identifying the activity being performed by the user is calculated based on one or more of data in a calendar of the user, or a pattern found in the data of one or more devices from the plurality of devices, or information entered by the user regarding the activity.

6. A method comprising:

receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time

sending at least part of the unified activity data stream to one or more of the plurality of devices, wherein operations of the method are executed by a processor.

7. A method comprising:

receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time

analyzing the unified activity data stream to identify a stride length of the user; and

sending the stride length of the user to one or more devices from the plurality of devices, wherein operations of the method are executed by a processor.

8. A method comprising:

receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time

parsing the received plurality of data streams, before assembling the unified activity data stream, to identify data types and respective data values in the data streams, wherein operations of the method are executed by a processor.

9. A method comprising:

receiving data streams regarding activity of a user, each data stream being associated with a respective device of a plurality of devices;

evaluating one or more rules for consolidating the data streams into a unified activity data stream, wherein evaluating the one or more rules further includes;

identifying first time segments where data is available from a single device from the plurality of devices;

adding the available data to the unified activity data stream for the first time segments;

identifying second time segments where data exists from two or more devices from the plurality of devices; and

adding data to the second time segments based on the existing data from the two or more devices and based on the one or more rules; and

storing the unified activity data stream for presentation to the user, wherein operations of the method are executed by a processor.

10. The method as recited in claim 9, wherein adding data to the second time segments further includes:

identifying a priority for each of the plurality of devices; and

for each second time segment, selecting the data from a device with a highest priority from the plurality of devices having data for the second time segment.

11. The method as recited in claim 9, wherein adding data to the second time segments further includes:

for each second time segment, calculating a statistical measure of the data from devices having data for the second time segment, wherein the statistical measure is one of mean, or mode, or median, or maximum, or minimum; and

adding the calculated statistical measure to the unified activity data stream for the respective second time segment.

12. The method as recited in claim 9, wherein adding data to the second time segments further includes:

for each second time segment, calculating unified data for the respective second time segment according to a voting system that selects data based on a grouping of the data, wherein the voting system identifies clusters of data points and selects a cluster with most data points.

13. The method as recited in claim 9, wherein the evaluating the one or more rules further includes:

identifying an activity being performed by the user, wherein at least one of the rules from the one or more rules is based on which activity is being performed by the user.

14. The method as recited in claim 9, wherein each rule includes a trigger and an action, wherein the trigger includes one or more conditions, wherein the action is performed based on the one or more conditions.

15. The method as recited in claim 9, further including:

sending at least part of the unified activity data stream the one or more of the plurality of devices.

16. The method as recited in claim 9, further including:

analyzing the unified activity data stream to identify a stride length of the user; and

sending the stride length of the user to one or more devices from the plurality of devices.

17. The method as recited in claim 9, further including:

receiving environmental data about an environment of the user, wherein at least one rule from the one or more rules is based on the environmental data.

18. The method as recited in claim 9, wherein operations of the method are performed by a computer program when executed by one or more processors, the computer program being embedded in a non-transitory computer-readable storage medium.

19. The method as recited in claim 9, further including:

detecting that the user is performing a joint activity with a friend; and

adding exercise data received from a device associated with the friend to the unified activity data stream.

20. A server comprising:

a communications module operable to receive a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user;

a memory for storing the plurality of activity data streams and a unified activity data stream that includes data segments from the data streams of at least two devices of the plurality of devices; and

a processor operable to assemble the unified activity data stream for the user over a period of time, the data segments being organized time-wise over the period of time, wherein the processor generates display data for the unified activity data stream, the display data configured for presentation on an interactive user interface, the interactive user interface enabling user selection of at least one of the data segments to identify additional information for the data segment and further identify which of the plurality of devices produced the physical activity data of the user for the selected data segment, wherein the interactive user interface includes one or more of an activity summary, the activity summary including a number of steps taken daily, a number of floors climbed daily, a distance traveled daily, or a number of calories burned daily.

21. The server as recited in claim 20, wherein the interactive user interface provides options to the user for selecting which devices to include in the unified activity data stream, and for prioritizing the devices for inclusion in the unified activity data stream.

22. The server as recited in claim 20, wherein the interactive user interface includes an activity display interface including:

activities detected during a day; and

a graphical representation identifying activity levels throughout the day.

23. A server comprising:

a communications module operable to receive a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user;

a memory for storing the plurality of activity data streams and a unified activity data stream that includes data segments from the data streams of at least two devices of the plurality of devices; and

a processor operable to assemble the unified activity data stream for the user over a period of time, the data segments being organized time-wise over the period of time, wherein the server is coupled to a time series database for storing the plurality of activity data streams and the unified activity data stream.

24. A server comprising:

a communications module operable to receive a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user;

a memory for storing the plurality of activity data streams and a unified activity data stream that includes data segments from the data streams of at least two devices of the plurality of devices; and

a processor operable to assemble the unified activity data stream for the user over a period of time, the data segments being organized time-wise over the period of time, wherein the processor assembles the unified activity data stream by utilizing one or more rules, each rule including a trigger and an action, wherein the trigger includes one or more conditions, wherein the action is performed based on the one or more conditions.

25. A server comprising:

a communications module operable to receive a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user;

a memory for storing the plurality of activity data streams and a unified activity data stream that includes data segments from the data streams of at least two devices of the plurality of devices; and

a processor operable to assemble the unified activity data stream for the user over a period of time, the data segments being organized time-wise over the period of time, wherein the unified activity data stream is associated with a measurement selected from a group consisting of steps taken, energy expenditure, vertical distance ascended or descended, heart rate, heart rate variability, heart rate recovery, location, heading, elevation, speed, distance traveled, swimming laps, blood pressure, blood glucose, skin conduction, body temperature, electromyography, electroencephalography, weight, body fat, caloric intake, medication intake, sleep state, sleep phase, sleep quality, sleep duration, or restoration rate.

26. A non-transitory computer-readable storage medium storing a computer program, the computer-readable storage medium comprising:

program instructions for receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

program instructions for assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time, wherein assembling the unified activity data stream further includes;

program instructions for detecting a first time period with data available from two or more devices;

program instructions for identifying a priority for each of the two or more devices;

program instructions for adding to the unified activity data stream a first data segment covering the first time period, the first data segment having the data from a device with a highest priority from two or more devices;

program instructions for detecting a second time period with data available from a single device from the plurality of devices; and

program instructions for adding to the unified activity data stream a second data segment covering the second time period, the second data segment having the data from the single device.

27. A non-transitory computer-readable storage medium storing a computer program, the computer-readable storage medium comprising:

program instructions for receiving a plurality of activity data streams from a plurality of devices, each activity data stream being associated with physical activity data of a user; and

program instructions for assembling a unified activity data stream for the user over a period of time, the unified activity data stream including data segments from the data streams of at least two devices of the plurality of devices, the data segments being organized time-wise over the period of time; and

program instructions for generating display data for the unified activity data stream, the display data configured for presentation on an interactive user interface, the interactive user interface enabling user selection of at least one of the data segments to identify additional information for the data segment and further identify which of the plurality of devices produced the physical activity data of the user for the selected data segment.