Use of gyro sensors for identifying athletic maneuvers

• US 10,408,857 B2
• Filed: 03/31/2015
• Issued: 09/10/2019
• Est. Priority Date: 09/12/2012
• Status: Active Grant

• Current Assignee: AlpineReplay, Inc.
• Original Assignee: AlpineReplay, Inc.
• Inventors: Lokshin, Anatole M., Kuzkin, Vitaly A., Roberts-Thomson, Claire Louise
• Primary Examiner(s): Bloss, Stephanie E
• Application Number:
  US14/675,387
• Publication Number:
  US 20150335949A1
• Time in Patent Office: 1,624 Days
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1121 Determining geometric values, e.g. centre of rotation or angular range of movement
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/7246 using correlation, e.g. template matching or determination of similarity
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: G01P 15/14 by making use of gyroscopes gyroscopes per se G01C19/00
• CPC Class Codes: G01S 19/19 Sporting applications
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Embodiments of the present disclosure help identify athletic maneuvers performed by actors and/or their sports equipment using data from sensors, including data from at least one gyroscopic sensor. Among other things, various embodiments can help judges and spectators of extreme sports to identify and assess athletic maneuvers more easily and accurately compared to conventional methods.

Claims

1. A method comprising:

measuring, by a gyroscope, angular velocity of one or more of an actor and the actor'"'"'s equipment over a time period;

measuring, by an accelerometer, acceleration of one or more of the actor and the actor'"'"'s equipment over the time period;

monitoring, by a Hall effect sensor, a speed of the actor'"'"'s equipment before the time period, during the time period, or after the time period;

receiving, by a computer system, sensor data related to motion over the time period by one or more of the actor and the actor'"'"'s equipment, wherein the sensor data includes the measured angular velocity and the measured acceleration;

determining, by the computer system and based on the sensor data, a plurality of motion characteristics; and

identifying, based on the plurality of motion characteristics and the monitored speed of the actor'"'"'s equipment, an athletic maneuver associated with the motion during the time period.

2. The method of claim 1, wherein determining the plurality of motion characteristics is based on a rate of change in the measured angular velocity from the gyroscope.

3. The method of claim 1, wherein determining the plurality of motion characteristics includes detecting a landing by the actor.

4. The method of claim 1, wherein determining the plurality of motion characteristics includes detecting a start of a jump by the actor.

5. The method of claim 1, wherein determining the plurality of motion characteristics includes performing a fuzzy logic analysis of the measured angular velocity from the gyroscope and the measured acceleration from the accelerometer.

6. The method of claim 1, further comprising measuring, by a magnetometer, an orientation of one or more of the actor and the actor'"'"'s equipment, before the time period, during the time period, or after the time period, and wherein determining the plurality of motion characteristics includes determining an orientation for the actor based at least partially on a direction of a magnetic vector calculated using the measured orientation from the magnetometer.

7. The method of claim 1, wherein the plurality of motion characteristics are selected from the group consisting of:

position;

velocity;

acceleration;

orientation;

rotation;

translation;

deformation; and

combinations thereof.

8. The method of claim 1, wherein the sensor data further includes data from an ultrasonic sensor.

9. The method of claim 1, wherein identifying the athletic maneuver includes comparing the plurality of determined motion characteristics to one or more motion characteristics associated with a known athletic maneuver.

10. The method of claim 9, further comprising determining a level of similarity between the plurality of determined motion characteristics and the motion characteristics associated with the known athletic maneuver.

11. The method of claim 10, further comprising generating an alert in response to the level of similarity being beneath a predetermined threshold.

12. The method of claim 9, wherein the one or more motion characteristics associated with the known athletic maneuver includes one or more of:

an orientation of the actor at a start of the time period;

an angle of rotation around a local axis of the actor;

a direction of rotation of the actor around a local axis of the actor;

an angle of rotation around an absolute axis perpendicular to a plane of motion of the actor;

a direction of rotation round an absolute axis perpendicular to a plane of motion of the actor; and

a leading edge of a piece of sports equipment at a start of the time period.

13. The method of claim 9, wherein the known athletic maneuver is stored in a database with one or more associated motion characteristics.

14. The method of claim 1, further comprising:

receiving, via a user interface in communication with the computer system, input related to an athletic maneuver definition;

in response to the input, associating the athletic maneuver definition with one or more of the plurality of motion characteristics; and

storing, in a database in communication with the computer system, the athletic maneuver definition and the one or more associated motion characteristics.

15. The method of claim 1, further comprising:

overlaying information related to the athletic maneuver on video of the actor performing the athletic maneuver, wherein the information related to the athletic maneuver is based on the plurality of motion characteristics.

16. The method of claim 15, wherein overlaying the information related to the athletic maneuver includes synchronizing the overlaid information and the video based on a time measured from a common time reference.

17. The method of claim 16, wherein the common time reference is from one or more of a global positioning system and a network.

18. The method of claim 1, further comprising determining the time period of the motion by selecting the time period based on a signal from the gyroscope.

19. The method of claim 1, wherein the monitoring, by the Hall effect sensor, the speed of the actor'"'"'s equipment comprises monitoring speed of a wheel before the time period, during the time period, or after the time period.

20. A non-transitory, computer-readable medium storing instructions that, when executed, cause a computing device to:

receive sensor data related to motion over a time period by one or more of an actor and the actor'"'"'s equipment, wherein the sensor data includes data from a gyroscope and a magnetometer;

monitor, by a Hall effect sensor, a speed of the actor'"'"'s equipment before the time period, during the time period, or after the time period;

determine, based on the sensor data, a plurality of motion characteristics including determining an orientation for one or more of the actor and the actor'"'"'s equipment before the time period, during the time period, or after the time period based at least partially on a direction of a magnetic vector calculated using the data from the magnetometer; and

identify, based on the plurality of motion characteristics and the monitored speed of the actor'"'"'s equipment, an athletic maneuver associated with the motion during the time period.

21. A system comprising:

a gyroscope;

a magnetometer;

a Hall effect sensor;

at least one processor; and

memory in communication with the at least one processor and storing instructions that, when executed by the processor, cause the system to;

receive sensor data related to motion over a time period by one or more of an actor and the actor'"'"'s equipment, wherein the sensor data includes data from the gyroscope and the magnetometer;

monitor, by the Hall effect sensor, a speed of the actor'"'"'s equipment before the time period, during the time period, or after the time period;

determine, based on the sensor data, a plurality of motion characteristics including determining an orientation for one or more of the actor and the actor'"'"'s equipment before the time period, during the time period, or after the time period based at least partially on a direction of a magnetic vector calculated using the data from the magnetometer; and

identify, based on the plurality of motion characteristics and the monitored speed of the actor'"'"'s equipment, an athletic maneuver associated with the motion during the time period.