Motion capture and analysis system

• US 9,349,049 B2
• Filed: 01/26/2015
• Issued: 05/24/2016
• Est. Priority Date: 08/26/2010
• Status: Active Grant

• Current Assignee: Newlight Capital, LLC
• Original Assignee: Blast Motion Incorporated
• Inventors: Bentley, Michael, Bose, Bhaskar, Kaps, Ryan
• Primary Examiner(s): Diep, Nhon
• Assistant Examiner(s): Joisil, Berteau
• Application Number:
  US14/605,940
• Publication Number:
  US 20150269435A1
• Time in Patent Office: 484 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 2560/0223 of calibration, e.g. protocols for calibrating sensors
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 2562/0247 Pressure sensors
• CPC Class Codes: A61B 5/0015 characterised by features of the telemetry system
• CPC Class Codes: A61B 5/1038 Measuring plantar pressure during gait
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/1121 Determining geometric values, e.g. centre of rotation or angular range of movement
• CPC Class Codes: A61B 5/1122 of movement trajectories
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/6895 Sport equipment
• CPC Class Codes: A63B 69/36 for golf
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Portable wireless mobile device motion capture and analysis system and method configured to display motion capture/analysis data on a mobile device. System obtains data from motion capture elements and analyzes the data. Enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data. Ratings associated with the captured motion can also be displayed. Predicted ball flight path data can be calculated and displayed. Data shown on a time line can also be displayed to show the relative peaks of velocity for various parts of the user'"'"'s body. Based on the display of data, the user can determine the equipment that fits the best and immediately purchase the equipment, via the mobile device. Custom equipment may be ordered through an interface on the mobile device from a vendor that can assemble-to-order customer built equipment and ship the equipment.

Claims

1. A motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment,

wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture one or more values associated with an orientation, a position, a velocity, and an acceleration of said at least one motion capture element;

a first communication interface;

a microcontroller coupled with said memory, said sensor and said radio, wherein

said microcontroller is configured to

 

collect data that comprises sensor values from said sensor;

 

store said data in said memory;

 

transmit said data via said first communication interface;

said microcontroller configured to transmit said data to a computer that comprises

a display;

a second communication interface configured to

communicate with said first communication interface to obtain said data;

wherein said computer is coupled with said display and said second

communication interface, and wherein said computer is configured to

 

accept an input from a user that signifies a type of motion selected from a plurality of types of motion and recognize said at least one motion capture element associated with said user or said piece of equipment to associate said at least one motion capture element with an assigned location or assigned locations on said user or said piece of equipment based on said type of motion or

 

receive said data associated with said at least one motion capture element via said second communication interface and analyze said data to form motion analysis data and that signifies a type of motion selected from a plurality of types of motion and recognize said at least one motion capture element associated with said user or said piece of equipment to associate said at least one motion capture element with an assigned location or assigned locations on said user or said piece of equipment based on said type of motion;

 

display said motion analysis data on said display; and

,

 

store said data, or said motion analysis data, or both said data and said motion analysis data.

2. The system of claim 1 wherein said microcontroller is further configured to

detect a first value from said sensor values having a first threshold value and

detect a second value from said sensor values having a second threshold value with a time window;

signify a prospective event;

compare said prospective event to a characteristic signal associated with a typical event and eliminate any false positive events;

signify a valid event if said prospective event is not a false positive event; and

,

save said valid event in said memory as said data.

3. The system of claim 1 wherein said microcontroller is further configured to store said data in said memory at least until a communications link to said computer exists and said data has been transferred to said computer.

4. The system of claim 1 wherein said microcontroller is further configured to transmit said data in said memory after an event or periodically or when requested by said computer.

5. The system of claim 1 wherein said microcontroller is configured to power off if no motion is detected for a predefined time.

6. The system of claim 1 wherein said microcontroller is configured to power on when motion is detected via said sensor or via a passive motion detector that requires no power.

7. The system of claim 1 wherein said computer is further configured to tweet or transmit said data to a social network site.

8. The system of claim 1 further comprising a remote database coupled with said computer wherein said data in said remote database is stored, retrieved, viewed, analyzed or data mined.

9. The system of claim 8claim 1 wherein said data in said remote database is utilized to play a game comprising one or more total players wherein said game utilizes actual data obtained from said at least one motion capture element.

10. The system of claim 8 wherein data associated with a second user is obtained from said remote database located remote to said computer and wherein said data associated with said second user is utilized to play a game with said user wherein said game utilizes actual data obtained from said at least one motion capture element associated with said second user.

11. The system of claim 8 wherein data associated with a second user is obtained from said remote database located remote to said computer and wherein said data associated with said second user is utilized to play a game with said user wherein said game utilizes actual data obtained from said at least one motion capture element associated with said second user and wherein said game comprises virtual reality or augmented virtual reality.

12. The system of claim 1 wherein said computer comprises at least one camera coupled with said computer and wherein said computer is further configured to command said at least one camera to capture one or more images associated with said at least one motion capture element.

13. The system of claim 1 wherein said computer comprises at least one camera coupled with said computer and wherein said computer is further configured to command said at least one camera to capture one or more images associated with a second user associated with said at least one motion capture element.

14. The system of claim 1 further comprising one or more cameras external to said computer that are utilized to obtain one or more images that are augmented with said data, or said motion analysis data, or both said data and said motion analysis data and wherein said one or more images are then broadcast to televisions or to the Internet.

15. The system of claim 1 wherein said display of said motion analysis comprises display of

a rating or

a calculated ball flight path or

a time line showing points in time along a time axis where peak values occur or

an impact location of a ball on said piece of equipment

or any combination thereof associated with said motion analysis data.

16. The system of claim 1 wherein said display of said motion analysis comprises display of a suggest training regimen to aid said user in improving mechanics of said user.

17. The system of claim 1 wherein said computer is further configured to present an interface to enable said user to purchase said piece of equipment over said wireless communication interface.

18. The system of claim 1 wherein said computer is further configured to present an interface to enable said user to order a customer fitted piece of equipment over said wireless communication interface.

19. The system of claim 1 further comprising a battery coupled with said at least one motion capture element and further coupled with a mechanical charger.

20. The system of claim 1, wherein said sensor is further configured to power on or power off using one or more gestures, wherein said one or more gestures include one or more of motion, physical switches, contact with said sensor and wireless commands to said sensor.

21. The system of claim 1, wherein said computer receives data from a plurality of motion capture elements and compares said data from each of said motion capture sensors to determine said assigned locations on said user or said piece of equipment based on said.

22. The system of claim 1 wherein said computer is further configured to

display a location where said at least one motion capture element is currently placed or is to be placed on said user or said piece of equipment;

prompt said user to move said at least one motion capture element that is currently placed or is to be placed on said location on said user or on said piece of equipment to associate said at least one motion capture element with assigned locations on the user'"'"'s body or on said piece of equipment to acknowledge which motion capture element of said at least one motion capture element said computer is requesting identity for;

accept said data comprising an identity from said at least one motion capture element;

obtain said identity of a particular motion capture element based on said data;

assign said identity of said particular motion capture element to said location where said at least one motion capture element is currently placed or is to be placed on said user or on said piece of equipment based on said motion capture data from said at least one motion capture element obtained after said prompt.

23. The system of claim 1 wherein said computer is further configured to

display at least one image or representation of said user in association with said motion analysis data that comprises a metric or three-dimensional graphic.

24. The system of claim 1 wherein said computer is further configured to

display at least one image or representation of said user in association with said motion analysis data that comprises a metric or three-dimensional graphic from a plurality of viewpoints.

25. The system of claim 1 wherein said at least one motion capture element further comprises:

a visual marker on an external surface of said at least one motion capture element that comprises a plurality of positionally offset visual elements positioned on a background color, wherein said plurality of positionally offset visual elements are arranged in a non-linear pattern and are offset from each other and comprise positionally offset dots or non-parallel lines or both said positionally offset dots and said non-parallel lines, wherein the plurality of positionally offset visual elements enable visual determination of a rotational orientation of the visual marker, wherein each of said plurality of positionally offset visual elements comprise differing visual characteristics than said background color.

26. A motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment,

wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture one or more values associated with an orientation,

a position, a velocity, and an acceleration of said at least one motion

capture element;

a first communication interface;

a microcontroller coupled with said memory, said sensor and said radio, wherein

said microcontroller is configured to

 

collect data that comprises sensor values from said sensor;

 

store said data in said memory;

 

transmit said data via said first communication interface;

said microcontroller configured to transmit said data to a computer that comprises

a display;

a second communication interface configured to

communicate with said first communication interface to obtain said data;

wherein said computer is coupled with said display and said second

communication interface, and wherein said computer is configured to

 

accept an input from a user that signifies a type of motion selected from a plurality of types of motion and recognize said at least one motion capture element associated with said user or said piece of equipment to associate said at least one motion capture element with an assigned location or assigned locations on said user or said piece of equipment based on said type of motion and

 

receive said data associated with said at least one motion capture element via said second communication interface and analyze said data to form motion analysis data and that signifies a type of motion selected from a plurality of types of motion and recognize said at least one motion capture element associated with said user or said piece of equipment to associate said at least one motion capture element with an assigned location or assigned locations on said user or said piece of equipment based on said type of motion;

 

display said motion analysis data on said display; and

,

 

store said data, or said motion analysis data, or both said data and said motion analysis data.