Portable wireless mobile device motion capture and analysis system and method

• US 8,994,826 B2
• Filed: 08/26/2010
• Issued: 03/31/2015
• Est. Priority Date: 08/26/2010
• Status: Active Grant

• Current Assignee: Newlight Capital, LLC
• Original Assignee: Blast Motion Incorporated
• Inventors: Bentley, Michael
• Primary Examiner(s): BAILEY, FREDERICK D
• Application Number:
  US12/868,882
• Publication Number:
  US 20120050529A1
• Time in Patent Office: 1,678 Days
• Field of Search: None
• US Class Current: 348/157
• CPC Class Codes: G01S 19/19 Sporting applications
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

Portable wireless mobile device motion capture and analysis system and method configured to display motion capture/analysis data on a mobile device. System obtains data from motion capture elements and analyzes the data. Enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data. Ratings associated with the captured motion can also be displayed. Predicted ball flight path data can be calculated and displayed. Data shown on a time line can also be displayed to show the relative peaks of velocity for various parts of the user'"'"'s body. Based on the display of data, the user can determine the equipment that fits the best and immediately purchase the equipment, via the mobile device. Custom equipment may be ordered through an interface on the mobile device from a vendor that can assemble-to-order customer built equipment and ship the equipment.

Claims

1. A portable wireless mobile device motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture any combination of values associated with an orientation, position, velocity, acceleration of said at least one motion capture element;

a radio;

a microcontroller coupled with said memory, said sensor and said radio wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

store said data in said memory;

transmit said data via said radio;

a mobile device comprising

a computer;

a display coupled with said computer;

a wireless communication interface coupled with said computer wherein said wireless communication interface is configured to communicate with said radio to obtain said data;

said computer configured to

display a location where said at least one motion capture element is currently placed or is to be placed on said user or said piece of equipment;

prompt said user to move said at least one motion capture element that is currently placed or is to be placed on said location on said user or on said piece of equipment to associate said at least one motion capture element with assigned locations on the user'"'"'s body or on said piece of equipment to acknowledge which motion capture of said at least one motion capture element said computer is requesting identify for;

accept said data comprising an identity from said at least one motion capture element;

obtain said identity of a particular motion capture element based on said data;

assign said identity of said particular motion capture element to said location where said at least one motion capture element is currently placed or is to be placed on said user or on said piece of equipment based on said user moving said at least one motion capture element from said prompt;

obtain data comprising said sensor values associated with said at least one motion capture element after said at least one motion capture element is placed on said user or on said piece of equipment;

analyze said data to form motion analysis data;

display said motion analysis data on said display.

2. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said wireless communication interface is further configured to communicate a database remote to said mobile device and wherein said computer is further configured to store said data, or said motion analysis data, or both said data and said motion analysis data in said database remote to said mobile device.

3. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said analyze is performed to determine how centered a collision between a ball and said piece of equipment is based on oscillations of said at least one motion capture element coupled with said piece of equipment and display an impact location based on said motion analysis data.

4. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said mobile device comprises at least one camera coupled with said computer and wherein said computer is configured to command said at least one camera to capture one or more images of said user and/or said at least one motion capture element in order to obtain said data.

5. The portable wireless mobile device motion capture and analysis system of claim 4 further comprising one or more cameras external to said mobile device wherein said computer is configured to obtain one or more images of said user and/or said at least one motion capture element from said one or more cameras external to said mobile device and wherein said computer is configured to analyze said data comprises said computer further configured to form three-dimensional data from positions associated with said at least one motion capture element as obtained from

said camera and

said one or more cameras external to said mobile device.

6. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising two or more cameras external to said mobile device, wherein said computer is configured to obtain two or more images of said user and/or said at least one motion capture element from said two or more cameras external to said mobile device and wherein said computer is configured to analyze said data comprises said computer further configured to form three-dimensional data from positions associated with said at least one motion capture element as obtained from

said two or more cameras external to said mobile device.

7. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising two or more cameras wherein said computer is configured to obtain two or more images of said user and data associated with said at least one motion capture element, wherein said two or more images are obtained from said two or more cameras and wherein said computer is configured to generate a display that shows slow motion of the user shown from around the user at various angles at normal speed.

8. The portable wireless mobile device motion capture and analysis system of claim 4 further comprising a orientation module in said mobile device and coupled with said computer wherein said computer is configured to prompt said user to align said at least one camera along a horizontal plane based on orientation data obtained from said orientation module.

9. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said computer is configured to obtain at least one image of said user and wherein said display of said motion analysis comprises display of a three-dimensional overlay onto said at least one image of said user wherein said three-dimensional overlay is associated with said motion analysis data.

10. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said display of said motion analysis comprises display of a rating associated with said motion analysis data.

11. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said display of said motion analysis comprises display of a calculated ball flight path associated with said motion analysis data.

12. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said display of said motion analysis comprises display of a time line showing points in time along a time axis where peak values associated with said motion analysis data occur.

13. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said display of said motion analysis comprises display of a suggest training regimen to aid said user in improving mechanics of said user.

14. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said computer is further configured to present an interface to enable said user to purchase said piece of equipment over said wireless interface or order a customer fitted piece of equipment over said wireless interface.

20. The portable wireless mobile device motion capture and analysis system of claim 1, wherein said at least one motion capture element further comprises

a background color on an outside surface of said at least one motion capture element;

and,

at least one passive or active visual marker located on said outside surface of said at least one motion capture element which comprises a non-symmetrical pattern of areas that differ in color from said background color of said outside surface of said sensor.

22. The portable wireless mobile device motion capture and analysis system of claim 20 wherein said at least one passive or active visual marker comprises

at least one marker portion that is passive and does not emit light, or

at least one light emitting diode configured to emit light.

15. A portable wireless mobile device motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment wherein

said at least one motion capture element comprises

a memory;

a sensor configured to capture any combination of values associated with an orientation, position, velocity, acceleration of said at least one motion capture element;

a radio;

a microcontroller coupled with said memory, said sensor and said radio wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

store said data in said memory;

transmit said data via said radio;

a mobile device comprising

a computer;

a display coupled with said computer;

at least one camera coupled with said computer

a wireless communication interface coupled with said computer wherein said wireless communication interface is configured to communicate with said radio to obtain said data;

said computer configured to

display a location where said at least one motion capture element is currently placed or is to be placed on said piece of equipment;

prompt said user to move said at least one motion capture element that is currently placed or is to be placed on said location on said user or on said piece of equipment to associate said at least one motion capture element with assigned locations on the user'"'"'s body or on said piece of equipment to acknowledge which motion capture of said at least one motion capture element said computer is requesting identity for;

accept said data comprising an identity from said at least one motion capture element;

obtain said identity of a particular motion capture element based on said data;

assign said identity of said particular motion capture element to said location where said at least one motion capture element is currently placed or is to be placed on said user or on said piece of equipment based on said user moving said at least one motion capture element from said prompt;

command said at least one camera to capture one or more images of said user;

obtain data comprising said sensor values associated with said at least one motion capture element after said at least one motion capture element is placed on said user or on said piece of equipment;

analyze said data to form motion analysis data;

display said motion analysis data on said display in the form of any combination of one or more of

a three-dimensional overlay onto at least one of said one or more images of said user,

a rating,

a calculated ball flight path,

a time line showing points in time along a time axis where peak values occur,

an impact location of a ball on said piece of equipment,

a slow motion display of the user shown from around the user at various angles at normal speed;

present an interface to enable said user to

purchase said piece of equipment or

order a custom fitted piece of equipment

over said wireless interface.

16. The portable wireless mobile device motion capture and analysis system of claim 15 wherein said wireless communication interface is further configured to communicate a database remote to said mobile device and wherein said computer is further configured to store said data, or said motion analysis data, or both said data and said motion analysis data in said database remote to said mobile device.

17. The portable wireless mobile device motion capture and analysis system of claim 15 wherein said analyze is performed to determine how centered a collision between a ball and said piece of equipment is based on oscillations of said at least one motion capture element coupled with said piece of equipment and display an impact location based on said motion analysis data.

18. The portable wireless mobile device motion capture and analysis system of claim 15 wherein said display of said motion analysis comprises display of a suggest training regimen to aid said user in improving mechanics of said user.

19. The portable wireless mobile device motion capture and analysis system of claim 15 wherein said at least one motion capture element is configured to integrate into a weight port of a golf club.

21. The portable wireless mobile device motion capture and analysis system of claim 15, wherein said at least one motion capture element further comprises

a background color on an outside surface of said at least one motion capture element;

and,

at least one passive or active visual marker located on said outside surface of said at least one motion capture element which comprises a non-symmetrical pattern of areas that differ in color from said background color of said outside surface of said sensor.