Systems and methods for real-time data quantification, acquisition, analysis, and feedback

• US 9,773,330 B1
• Filed: 12/29/2016
• Issued: 09/26/2017
• Est. Priority Date: 12/29/2016
• Status: Active Grant

• Current Assignee: BioMech Sensor LLC
• Original Assignee: BioMech Sensor LLC
• Inventors: Douglas, John, Fornari, Frank
• Primary Examiner(s): Ma, Tize
• Application Number:
  US15/394,779
• Time in Patent Office: 271 Days
• Field of Search: None
• CPC Class Codes: A01K 87/007 with built-in accessories, e.g. lighting means or measuring devices
• CPC Class Codes: A43B 3/34 with electrical or electronic arrangements
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/1124 Determining motor skills
• CPC Class Codes: A63B 2024/0012 Comparing movements or motion sequences with a registered reference
• CPC Class Codes: A63B 2024/0015 Comparing movements or motion sequences with computerised simulations of movements or motion sequences, e.g. for generating an ideal template as reference to be achieved by the user
• CPC Class Codes: A63B 2060/464 Means for indicating or measuring the pressure on the grip
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0627 when used improperly, e.g. by giving a warning
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2071/0655 Tactile feedback
• CPC Class Codes: A63B 2220/16 Angular positions
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/34 Angular speed
• CPC Class Codes: A63B 2220/35 Spin
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/44 Angular acceleration
• CPC Class Codes: A63B 2220/56 Pressure
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2225/74 : with powered illuminating means, e.g. lights
• CPC Class Codes: A63B 24/0006 : Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 31/10 : held by, or attachable to, the hands or feet
• CPC Class Codes: A63B 60/06 : Handles
• CPC Class Codes: A63B 60/46 : Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
• CPC Class Codes: A63B 69/3632 : Clubs or attachments on clubs, e.g. for measuring, aligning A63B69/3614 takes precedence; clubs for swinging exercises in general A63B15/00
• CPC Class Codes: A63B 69/3685 : Putters or attachments on putters, e.g. for measuring, aligning A63B69/3614 takes precedence
• CPC Class Codes: A63B 69/38 : for tennis A63B61/006, A63B69/0073 and A63B69/0097 take precedence
• CPC Class Codes: A63B 71/0622 : Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 : with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04845 : for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/14 : Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 11/206 : Drawing of charts or graphs
• CPC Class Codes: G06V 40/23 : Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04N 5/77 : between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/93 : Regeneration of the television signal or of selected parts thereof

Abstract

This disclosure relates to systems, media, and methods for quantifying and monitoring exercise parameters and/or motion parameters, including performing data acquisition, analysis, and providing scientifically valid, clinically relevant, and/or actionable diagnostic feedback. Disclosed embodiments may receive real-time sensor data from a motion sensor or sensors mounted on a user and/or equipment while a user performs a test motion. Disclosed embodiments may also calculate a test motion profile based on the real-time sensor data, the test motion profile describing a multi-dimensional representation of the test motion performed by the user or computed motion profiles. Disclosed embodiments may include comparing the test motion profile to a template motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile. Still further embodiments may correlate test motion profiles over time with health indicators.

Claims

1. A method for monitoring motion parameters and providing near-instantaneous user feedback from real-time motion sensor data comprising:

loading a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receiving, from one or more inertial measurement units, real-time sensor data from a motion sensor while a user performs a test motion with equipment, the motion sensor being mounted on equipment or affixed to the user, wherein receiving the real-time sensor data from the motion sensor includes;

receiving real-time sensor data from a plurality of sensors, the sensor data measuring a common metric and being received from each of the plurality of sensors at a common frequency and a unique offset based on the frequency and number of the plurality of sensors; and

combining the real-time sensor data from the plurality of sensors by interlacing the sensor data, the interlacing resulting in the test motion profile having a sampling rate that is higher than a sampling rate of any one of the plurality of sensors;

calculating a test motion profile based on the real-time sensor data, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

comparing the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile using one or more of;

a Fourier transform and a least squares difference calculation; and

providing a graphical user interface that displays, and allows the user to manipulate a viewing angle of, a multi-dimensional rendering of the test motion profile, where the graphical user interface further displays the deviation amount in relation to the multi-dimensional rendering of the test motion profile.

2. The method of claim 1, wherein the equipment is a golf club, and the motion sensor is mounted on a shaft of the golf club at or below the base of a grip of the golf club.

3. The method of claim 2, further comprising:

providing, responsive to the comparing, real-time feedback to the user through the motion sensor mounted on the golf club based on the deviation amount.

4. The method of claim 1, further comprising:

storing the test motion profile with a plurality of additional test motion profiles,

calculating an average test motion profile for a given session,

determining differences between the average test motion profiles over time, and

providing a graphical demonstration of the differences to the user.

5. The method of claim 1, further comprising:

receiving GPS data,

identifying a geographic location based on the GPS data, and

indexing the test motion profile according to the identified geographic location.

6. The method of claim 1, further comprising:

determining, responsive to receiving the real-time sensor data, that the received real-time sensor data needs to be calibrated;

transmitting an instruction to the motion sensor to initiate a calibration procedure that includes the motion sensor aligning axes and adjusting scaling factors to increase accuracy in position and orientation data and providing an indication to the user that the calibration procedure is taking place; and

receiving, after the motion sensor has calibrated, calibrated real-time sensor data from the motion sensor while a user performs a test motion.

7. The method of claim 1, wherein the motion sensor includes a plurality of discrete motion sensor devices that each include one or more inertial measurement units and a tactile engine to provide haptic feedback, and the method further comprises:

identifying, based on at least the deviation amount for the test motion profile, a single discrete motion sensor device from the plurality of discrete motion sensor devices to provide haptic feedback;

transmitting an instruction to the identified single discrete motion sensor device causing the identified single discrete motion sensor device to provide haptic feedback to the user using the respective tactile engine of the identified single discrete motion sensor device.

8. The method of claim 1, wherein

the template motion profile further includes measurements of a plurality of additional template characteristics over time, the plurality of additional template characteristics including two or more of elevation, temperature, humidity, and light intensity;

and

the test motion profile based on the real-time sensor data includes an additional test characteristic measurement over time from the test motion performed by the user, the additional test characteristic measurement including two or more of elevation, temperature, light intensity, and pressure.

9. The method of claim 1, further comprising:

loading a plurality of template motion profiles, the template motion profiles each describing a multi-dimensional representation of acceleration and orientation over time and each having an associated feedback type, the associated feedback type being unique for each of the template motion profiles and including one or more of auditory, haptic, and visual feedback;

comparing the plurality of template motion profiles to the test motion profile to identify a matching template motion profile of the plurality of template motion profile based on one or more of;

a Fourier transform and a least squares difference calculation; and

transmitting an instruction to the motion sensor to cause the motion sensor to provide feedback to the user based on the associated feedback type corresponding to the matching template motion profile.

10. The method of claim 1, further comprising:

loading a plurality of template motion profiles, the template motion profiles each describing a multi-dimensional representation of acceleration and orientation over time and each having an associated control function of a medical device,

the medical device being an insulin pump, a pacemaker, a cardiac defibrillator, a gastric stimulator, a deep brain neurostimulator, or a cochlear implant, and

the associated control function being unique for each of the template motion profiles;

comparing the plurality of template motion profiles to the test motion profile to identify a matching template motion profile of the plurality of template motion profile based on one or more of;

a Fourier transform and a least squares difference calculation;

identifying, based on the matching template motion profile, the respective associated control function of the medical device; and

transmitting the identified associated control function to the medical device.

11. A system for monitoring motion parameters and providing near-instantaneous user feedback from real-time motion sensor data comprising:

a motion sensor that includes one or more inertial measurement units, wherein the motion sensor includes a plurality of sensors;

a non-transitory computer readable storage medium configured to store instructions; and

one or more processors programmed to execute the stored instructions to;

load a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receive real-time sensor data from the motion sensor detachably fixed to a user while a user performs a test motion, wherein the one or more processors receive the real-time sensor data from the motion sensor by;

receiving real-time sensor data from the plurality of sensors, the sensor data measuring a common metric and being received from each of the plurality of sensors at a common frequency and a unique offset based on the frequency and number of the plurality of sensors, each sensor of the plurality of sensors having a different offset; and

combining the real-time sensor data from the plurality of sensors by interlacing the sensor data, the interlacing resulting in the test motion profile having a sampling rate that is higher than a sampling rate of any one of the plurality of sensors;

calculate a test motion profile based on the real-time sensor data, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

compare the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile using one or more of;

a Fourier transform and a least squares difference calculation; and

provide a graphical user interface that displays, and allows the user to manipulate a viewing angle of, a multi-dimensional rendering of the test motion profile, where the graphical user interface further displays the deviation amount in relation to the multi-dimensional rendering of the test motion profile.

12. The system of claim 11, wherein the one or more processors are programmed to execute the stored instructions further to:

transmit, based on the deviation amount, an instruction to the motion sensor to provide one or more of haptic feedback, auditory feedback, or visual feedback to the user.

13. The system of claim 12, wherein the one or more processors programmed to execute the stored instructions further to:

provide, responsive to the comparing, real-time feedback to the user through the motion sensor based on the deviation amount.

14. The system of claim 11, wherein the one or more processors programmed to execute the stored instructions further to:

store the test motion profile with a plurality of additional test motion profiles,

calculate an average test motion profile for a given session,

determine differences between the average test motion profiles over time, and

provide a graphical demonstration of the differences to the user.

15. The system of claim 11, wherein the one or more processors programmed to execute the stored instructions further to:

receive GPS data,

identify a geographic location based on the GPS data, and

index the test motion profile according to the identified geographic location.

16. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

loading a template motion profile, the template motion profile describing a multi-dimensional representation of acceleration and orientation over time;

receiving, from one or more inertial measurement units, real-time sensor data from a motion sensor detachably fixed to a user while a user performs a test motion, wherein receiving the real-time sensor data from the motion sensor includes;

receiving real-time sensor data from a plurality of sensors, the sensor data measuring a common metric and being received from each of the plurality of sensors at a common frequency and a unique offset based on the frequency and number of the plurality of sensors, each sensor of the plurality of sensors having a different offset; and

combining the real-time sensor data from the plurality of sensors by interlacing the sensor data, the interlacing resulting in the test motion profile having a sampling rate that is higher than a sampling rate of any one of the plurality of sensors;

calculating a test motion profile based on the real-time sensor data, the test motion profile describing a multi-dimensional representation of the test motion performed by the user;

comparing the template motion profile to the test motion profile to determine a deviation amount for the test motion profile indicating how the test motion deviated from the template motion profile using one or more of;

a Fourier transform and a least squares difference calculation; and

providing a graphical user interface that displays, and allows the user to manipulate a viewing angle of, a multi-dimensional rendering of the test motion profile, where the graphical user interface further displays the deviation amount in relation to the multi-dimensional rendering of the test motion profile.

17. The medium of claim 16, the operations further comprising:

transmitting, based on the deviation amount, an instruction to the motion sensor to provide one or more of haptic feedback, auditory feedback, or visual feedback to the user.

18. The medium of claim 17, the operations further comprising:

storing the test motion profile with a plurality of additional test motion profiles,

calculating an average test motion profile for a given session,

determining differences between the average test motion profiles over time, and

providing a graphical demonstration of the differences to the user.

19. The medium of claim 17, the operations further comprising:

providing, responsive to the comparing, real-time feedback to the user through the motion sensor based on the deviation amount.

20. The medium of claim 16, the operations further comprising:

receiving GPS data,

identifying a geographic location based on the GPS data, and

indexing the test motion profile according to the identified geographic location.