Systems and methods for real-time data quantification, acquisition, analysis and feedback

• US 10,089,763 B2
• Filed: 09/01/2017
• Issued: 10/02/2018
• Est. Priority Date: 12/29/2016
• Status: Active Grant

• Current Assignee: BioMech Sensor LLC
• Original Assignee: BioMech Sensor LLC
• Inventors: Douglas, John, Fornari, Frank
• Primary Examiner(s): Ma, Tize
• Application Number:
  US15/694,705
• Publication Number:
  US 20180189989A1
• Time in Patent Office: 396 Days
• Field of Search: None
• CPC Class Codes: A01K 87/007 with built-in accessories, e.g. lighting means or measuring devices
• CPC Class Codes: A43B 3/34 with electrical or electronic arrangements
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/1124 Determining motor skills
• CPC Class Codes: A63B 2024/0012 Comparing movements or motion sequences with a registered reference
• CPC Class Codes: A63B 2024/0015 Comparing movements or motion sequences with computerised simulations of movements or motion sequences, e.g. for generating an ideal template as reference to be achieved by the user
• CPC Class Codes: A63B 2060/464 Means for indicating or measuring the pressure on the grip
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0627 when used improperly, e.g. by giving a warning
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2071/0655 Tactile feedback
• CPC Class Codes: A63B 2220/16 Angular positions
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/34 Angular speed
• CPC Class Codes: A63B 2220/35 Spin
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/44 Angular acceleration
• CPC Class Codes: A63B 2220/56 Pressure
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2225/74 : with powered illuminating means, e.g. lights
• CPC Class Codes: A63B 24/0006 : Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 31/10 : held by, or attachable to, the hands or feet
• CPC Class Codes: A63B 60/06 : Handles
• CPC Class Codes: A63B 60/46 : Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
• CPC Class Codes: A63B 69/3632 : Clubs or attachments on clubs, e.g. for measuring, aligning A63B69/3614 takes precedence; clubs for swinging exercises in general A63B15/00
• CPC Class Codes: A63B 69/3685 : Putters or attachments on putters, e.g. for measuring, aligning A63B69/3614 takes precedence
• CPC Class Codes: A63B 69/38 : for tennis A63B61/006, A63B69/0073 and A63B69/0097 take precedence
• CPC Class Codes: A63B 71/0622 : Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 : with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04845 : for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/14 : Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 11/206 : Drawing of charts or graphs
• CPC Class Codes: G06V 40/23 : Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/93 : Regeneration of the television signal or of selected parts thereof

Abstract

This disclosure relates to systems, media, and methods for quantifying and monitoring exercise parameters and/or motion parameters, including performing data acquisition, analysis, and providing scientifically valid, clinically relevant, and/or actionable diagnostic feedback. Disclosed embodiments may receive real-time sensor data from a motion sensor or sensors mounted on a user and/or equipment while a user performs a test motion. Disclosed embodiments may also calculate a test motion profile based on the real-time sensor data, the test motion profile describing a multi-dimensional representation of the test motion performed by the user or computed motion profiles. Disclosed embodiments may include comparing the test motion profile to a template motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile. Still further embodiments may correlate test motion profiles over time with health indicators.

Claims

1. A method for monitoring motion parameters and providing near-instantaneous user feedback from real-time motion sensor data comprising:

loading a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receiving, from one or more inertial measurement units, real-time sensor data from a motion sensor while a user performs a test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a test motion profile based on the real-time sensor data from the one or more inertial measurement units, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

comparing the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile by calculating the aggregate difference between the test motion profile and template motion profile over a predefined period of time using the real-time sensor data from the one or more inertial measurement units;

providing to the user, responsive to determining the calculated aggregate difference between the test motion profile and template motion profile exceeds a predetermined threshold aggregate difference amount, feedback based on a magnitude of the calculated aggregate difference, wherein the user receives the feedback between 5 and 20 milliseconds after receiving the real-time sensor data from the motion sensor;

receiving, from the one or more inertial measurement units, a plurality of sets of motion sensor data from a motion sensor, each of the plurality of sets of sensor data being captured while the user performs the test motion at chronologically distinct time periods, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a plurality of test motion profiles corresponding to the received plurality of sets of motion sensor data at the chronologically distinct time periods, the test motion profiles describing position and orientation of the motion sensor over time while the user performs the test motion;

comparing the plurality of test motion profiles to the template motion profile to determine a change in deviation from the template motion profile over time and an average deviation between each of the plurality of the test motion profiles at the chronologically distinct time periods; and

if it is determined that the change in deviation over time decreases at a rate that is greater than a pre-determined threshold rate or determined that the average deviation is less than a pre-determined deviation threshold, then generating an updated template motion profile and generating instructions for the user to perform an updated motion corresponding to the updated template motion profile.

2. The method of claim 1, wherein comparing the template motion profile to the test motion profile further comprises determining the magnitude of the differences between the template motion profile and the test motion profile.

3. The method of claim 1, wherein comparing the template motion profile to the test motion profile further comprises determining whether the test motion profile differs from the template motion profile by more than a threshold amount at a predefined set of points in time.

4. The method of claim 1, wherein comparing the template motion profile to the test motion profile further comprises processing the test motion profile against an event model that includes performing a least squares difference calculation.

5. The method of claim 1, further comprising:

transmitting the updated template motion profile, the updated motion corresponding to the updated motion profile, and the change in deviation over time or the average deviation to a computing device of a third party; and

responsive to receiving approval from the computing device of the third party, providing to the user the generated updated template motion profile and the generated instructions for the user to perform the updated motion.

6. The method of claim 1, wherein the template motion profile corresponds to a first exercise, the updated template motion profile corresponds to a second exercise, and the second exercise is an alternative to the first exercise.

7. A method for monitoring motion parameters and providing near-instantaneous user feedback from real-time motion sensor data comprising:

loading a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receiving, from one or more inertial measurement units, real-time sensor data from a motion sensor while a user performs a test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a test motion profile based on the real-time sensor data from the one or more inertial measurement units, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

comparing the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile by calculating the aggregate difference between the test motion profile and template motion profile over a predefined period of time using the real-time sensor data from the one or more inertial measurement units;

providing to the user, responsive to determining the calculated aggregate difference between the test motion profile and template motion profile exceeds a predetermined threshold aggregate difference amount, feedback based on a magnitude of the calculated aggregate difference, wherein the user receives the feedback between 5 and 20 milliseconds after receiving the real-time sensor data from the motion sensor;

receiving, from the one or more inertial measurement units, a plurality of sets of motion sensor data from a motion sensor, each of the plurality of sets of sensor data being captured while the user performs the test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a plurality of test motion profiles corresponding to the received plurality of sets of motion sensor data, the test motion profiles describing position and orientation of the motion sensor over time while the user performs the test motion;

comparing the plurality of test motion profiles to the template motion profile to determine a deviation from the template motion profile over time and an average deviation;

providing to a third party, using a graphical user interface and in real-time, a visual indication of the plurality of test motion profiles in relation to the template motion profile, the deviation from the template motion profile over time, and the average deviation, the graphical user interface including a selection area for the third party to provide feedback to the user, including selecting a feedback mechanism to provide the feedback and an output pattern for the selected feedback mechanism; and

responsive to receiving a selection from the third party at the selection area of the graphical user interface, generating a signal to provide real-time feedback to the user based on the selected feedback mechanism and the selected output pattern for the selected feedback mechanism.

8. The method of claim 7, wherein responsive to receiving a selection from the third party at a second selection area of the graphical user interface, generating a signal to set one or more threshold levels for the deviation that, when the deviation exceeds at least one of the one or more threshold levels, feedback is automatically provided to the user.

9. A system for monitoring motion parameters and providing near-instantaneous user feedback from real-time motion sensor data comprising:

a motion sensor that includes one or more inertial measurement units;

a non-transitory computer readable storage medium configured to store instructions; and

one or more processors programmed to execute the stored instructions to;

load a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receive, from the one or more inertial measurement units, real-time sensor data from a motion sensor while a user performs a test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculate a test motion profile based on the real-time sensor data from the one or more inertial measurement units, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

compare the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile by calculating the aggregate difference between the test motion profile and template motion profile over a predefined period of time using the real-time sensor data from the one or more inertial measurement units;

provide to the user, responsive to determining the calculated aggregate difference between the test motion profile and template motion profile exceeds a predetermined threshold aggregate difference amount, feedback based on a magnitude of the calculated aggregate difference, wherein the user receives the feedback between 5 and 20 milliseconds after receiving the real-time sensor data from the motion sensor;

receive, from the one or more inertial measurement units, a plurality of sets of motion sensor data from a motion sensor, each of the plurality of sets of sensor data being captured while the user performs the test motion at chronologically distinct time periods, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculate a plurality of test motion profiles corresponding to the received plurality of sets of motion sensor data at the chronologically distinct time periods, the test motion profiles describing position and orientation of the motion sensor over time while the user performs the test motion;

compare the plurality of test motion profiles to the template motion profile to determine a change in deviation from the template motion profile over time and an average deviation between each of the plurality of the test motion profiles at the chronologically distinct time periods; and

if it is determined that the change in deviation over time decreases at a rate that is greater than a pre-determined threshold rate or determined that the average deviation is less than a pre-determined deviation threshold, then generating an updated template motion profile and generating instructions for the user to perform an updated motion corresponding to the updated template motion profile.

10. The system of claim 9, wherein comparing the template motion profile to the test motion profile further comprises determining the magnitude of the differences between the template motion profile and the test motion profile.

11. The system of claim 9, wherein comparing the template motion profile to the test motion profile further comprises determining whether the test motion profile differs from the template motion profile by more than a threshold amount at a predefined set of points in time.

12. The system of claim 9, wherein comparing the template motion profile to the test motion profile further comprises processing the test motion profile against an event model that includes performing a least squares difference calculation.

13. The system of claim 9, wherein the one or more processors are programmed to execute the stored instructions further to:

transmitting the updated template motion profile, the updated motion corresponding to the updated motion profile, and the change in deviation over time or the average deviation to a computing device of a third party; and

responsive to receiving approval from the computing device of the third party, providing to the user the generated updated template motion profile and the generated instructions for the user to perform the updated motion.

14. The system of claim 9, wherein the template motion profile corresponds to a first exercise, the updated template motion profile corresponds to a second exercise, and the second exercise is an alternative to the first exercise.

15. A system for monitoring motion parameters and providing near-instantaneous user feedback from real-time motion sensor data comprising:

a motion sensor that includes one or more inertial measurement units;

a non-transitory computer readable storage medium configured to store instructions; and

one or more processors programmed to execute the stored instructions to;

load a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receive, from the one or more inertial measurement units, real-time sensor data from a motion sensor while a user performs a test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculate a test motion profile based on the real-time sensor data from the one or more inertial measurement units, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

compare the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile by calculating the aggregate difference between the test motion profile and template motion profile over a predefined period of time using the real-time sensor data from the one or more inertial measurement units;

provide to the user, responsive to determining the calculated aggregate difference between the test motion profile and template motion profile exceeds a predetermined threshold aggregate difference amount, feedback based on a magnitude of the calculated aggregate difference, wherein the user receives the feedback between 5 and 20 milliseconds after receiving the real-time sensor data from the motion sensor;

receive, from one or more inertial measurement units, a plurality of sets of motion sensor data from a motion sensor, each of the plurality of sets of sensor data being captured while the user performs the test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculate a plurality of test motion profiles corresponding to the received plurality of sets of motion sensor data, the test motion profiles describing position and orientation of the motion sensor over time while the user performs the test motion;

compare the plurality of test motion profiles to the template motion profile to determine a deviation from the template motion profile over time and an average deviation;

provide to a third party, using a graphical user interface and in real-time, a visual indication of the plurality of test motion profiles in relation to the template motion profile, the deviation from the template motion profile over time, and the average deviation, the graphical user interface including a selection area for the third party to provide feedback to the user, including selecting a feedback mechanism to provide the feedback and an output pattern for the selected feedback mechanism; and

responsive to receiving a selection from the third party at the selection area of the graphical user interface, generate a signal to provide real-time feedback to the user based on the selected feedback mechanism and the selected output pattern for the selected feedback mechanism.

16. The system of claim 15, wherein responsive to receiving a selection from the third party at a second selection area of the graphical user interface, generating a signal to set one or more threshold levels for the deviation that, when the deviation exceeds at least one of the one or more threshold levels, feedback is automatically provided to the user.

17. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

loading a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receiving, from one or more inertial measurement units, real-time sensor data from a motion sensor while a user performs a test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a test motion profile based on the real-time sensor data from the one or more inertial measurement units, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

comparing the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile by calculating the aggregate difference between the test motion profile and template motion profile over a predefined period of time using the real-time sensor data from the one or more inertial measurement units;

providing to the user, responsive to determining the calculated aggregate difference between the test motion profile and template motion profile exceeds a predetermined threshold aggregate difference amount, feedback based on a magnitude of the calculated aggregate difference, wherein the user receives the feedback between 5 and 20 milliseconds after receiving the real-time sensor data from the motion sensor;

receiving, from the one or more inertial measurement units, a plurality of sets of motion sensor data from a motion sensor, each of the plurality of sets of sensor data being captured while the user performs the test motion at chronologically distinct time periods, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a plurality of test motion profiles corresponding to the received plurality of sets of motion sensor data at the chronologically distinct time periods, the test motion profiles describing position and orientation of the motion sensor over time while the user performs the test motion;

comparing the plurality of test motion profiles to the template motion profile to determine a change in deviation from the template motion profile over time and an average deviation between each of the plurality of the test motion profiles at the chronologically distinct time periods; and

if it is determined that the change in deviation over time decreases at a rate that is greater than a pre-determined threshold rate or determined that the average deviation is less than a pre-determined deviation threshold, then generating an updated template motion profile and generating instructions for the user to perform an updated motion corresponding to the updated template motion profile.

18. The medium of claim 17, wherein comparing the template motion profile to the test motion profile further comprises determining the magnitude of the differences between the template motion profile and the test motion profile.

19. The medium of claim 17, wherein comparing the template motion profile to the test motion profile further comprises determining whether the test motion profile differs from the template motion profile by more than a threshold amount at a predefined set of points in time.

20. The medium of claim 17, wherein comparing the template motion profile to the test motion profile further comprises processing the test motion profile against an event model that includes performing a least squares difference calculation.

21. The medium of claim 17, the operations further comprising:

transmitting the updated template motion profile, the updated motion corresponding to the updated motion profile, and the change in deviation over time or the average deviation to a computing device of a third party; and

responsive to receiving approval from the computing device of the third party, providing to the user the generated updated template motion profile and the generated instructions for the user to perform the updated motion.

22. The medium of claim 17, wherein the template motion profile corresponds to a first exercise, the updated template motion profile corresponds to a second exercise, and the second exercise is an alternative to the first exercise.

23. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

loading a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receiving, from one or more inertial measurement units, real-time sensor data from a motion sensor while a user performs a test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a test motion profile based on the real-time sensor data from the one or more inertial measurement units, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

comparing the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile by calculating the aggregate difference between the test motion profile and template motion profile over a predefined period of time using the real-time sensor data from the one or more inertial measurement units;

providing to the user, responsive to determining the calculated aggregate difference between the test motion profile and template motion profile exceeds a predetermined threshold aggregate difference amount, feedback based on a magnitude of the calculated aggregate difference, wherein the user receives the feedback between 5 and 20 milliseconds after receiving the real-time sensor data from the motion sensor;

receiving, from the one or more inertial measurement units, a plurality of sets of motion sensor data from a motion sensor, each of the plurality of sets of sensor data being captured while the user performs the test motion, the motion sensor being attached to the user or equipment operated by the user with which the user performs the test motion;

calculating a plurality of test motion profiles corresponding to the received plurality of sets of motion sensor data, the test motion profiles describing position and orientation of the motion sensor over time while the user performs the test motion;

comparing the plurality of test motion profiles to the template motion profile to determine a deviation from the template motion profile over time and an average deviation;

providing to a third party, using a graphical user interface and in real-time, a visual indication of the plurality of test motion profiles in relation to the template motion profile, the deviation from the template motion profile over time, and the average deviation, the graphical user interface including a selection area for the third party to provide feedback to the user, including selecting a feedback mechanism to provide the feedback and an output pattern for the selected feedback mechanism; and

responsive to receiving a selection from the third party at the selection area of the graphical user interface, generating a signal to provide real-time feedback to the user based on the selected feedback mechanism and the selected output pattern for the selected feedback mechanism.

24. The medium of claim 23, wherein responsive to receiving a selection from the third party at a second selection area of the graphical user interface, generating a signal to set one or more threshold levels for the deviation that, when the deviation exceeds at least one of the one or more threshold levels, feedback is automatically provided to the user.