Portable wireless mobile device motion capture and analysis system and method

• US 8,941,723 B2
• Filed: 08/26/2011
• Issued: 01/27/2015
• Est. Priority Date: 08/26/2010
• Status: Active Grant

• Current Assignee: Newlight Capital, LLC
• Original Assignee: Blast Motion Incorporated
• Inventors: Bentley, Michael, Bose, Bhaskar
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): Joisil, Berteau
• Application Number:
  US13/219,525
• Publication Number:
  US 20110305369A1
• Time in Patent Office: 1,250 Days
• Field of Search: 348/47, 348/220, 348/36, 473/223, 382/103, 600/301
• US Class Current: 348/47
• CPC Class Codes: A61B 2560/0223 of calibration, e.g. protocols for calibrating sensors
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 2562/0247 Pressure sensors
• CPC Class Codes: A61B 5/0015 characterised by features of the telemetry system
• CPC Class Codes: A61B 5/1038 Measuring plantar pressure during gait
• CPC Class Codes: A61B 5/112 Gait analysis
• CPC Class Codes: A61B 5/1121 Determining geometric values, e.g. centre of rotation or angular range of movement
• CPC Class Codes: A61B 5/1122 of movement trajectories
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/6895 Sport equipment
• CPC Class Codes: A63B 69/36 for golf
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Portable wireless mobile device motion capture and analysis system and method configured to display motion capture/analysis data on a mobile device. System obtains data from motion capture elements and analyzes the data. Enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data. Ratings associated with the captured motion can also be displayed. Predicted ball flight path data can be calculated and displayed. Data shown on a time line can also be displayed to show the relative peaks of velocity for various parts of the user'"'"'s body. Based on the display of data, the user can determine the equipment that fits the best and immediately purchase the equipment, via the mobile device. Custom equipment may be ordered through an interface on the mobile device from a vendor that can assemble-to-order customer built equipment and ship the equipment. Includes active and passive golf shot count capabilities.

Claims

1. A portable wireless mobile device motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment, wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture any combination of values associated with an orientation, a position, a velocity, and an acceleration of said at least one motion capture element;

a radio;

a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

store said data in said memory;

transmit said data via said radio;

an application configured to execute on a mobile device, wherein said mobile device comprises

a computer;

a display; and

,

a wireless communication interface configured to

communicate with said radio to obtain said data, and

communicate with a remote database that is remote to said mobile device;

wherein said computer is coupled with said display and said wireless communication interface, and wherein said computer is configured to execute said application to configure said computer to

recognize said at least one motion capture element associated with said user or said piece of equipment and associate said at least one motion capture element with assigned locations on said user or said piece of equipment based on movement of each of said at least one motion capture element respectively;

receive said data associated with said at least one motion capture element via said wireless communication interface;

analyze said data to form motion analysis data;

display said motion analysis data on said display; and

,

store said data, or said motion analysis data, or both said data and said motion analysis data in said remote database.

2. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said microcontroller is further configured to

detect a first value from said sensor values having a first threshold velocity or acceleration and

detect a second value from said sensor values having a second threshold velocity or acceleration with a time window;

signify a prospective strike;

compare said prospective strike to a characteristic signal associated with a typical swing and eliminate any false positive strikes;

signify a valid strike if said prospective strike is not a false positive strike; and

, save said valid strike in said memory.

3. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said microcontroller is further configured to store said data in said memory at least until a communications link to said computer exists and said data has been transferred to said computer.

4. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said microcontroller is further configured to transmit said data in said memory after an event or periodically or when requested by said computer.

5. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said microcontroller is configured to power on when motion is detected via said sensor or via a passive motion detector that requires no power.

6. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said computer is further configured to tweet said data to a social network site remote to said mobile device.

7. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising a remote computer wherein said data in said remote database is viewed, analyzed or data mined with said remote computer.

8. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said data in said remote database is utilized to play a game comprising one or more total players wherein said game utilizes actual data obtained from said at least one motion capture element.

9. The portable wireless mobile device motion capture and analysis system of claim 1 wherein data associated with a second user is obtained from said remote database located remote to said mobile device and wherein said data associated with said second user is utilized to play a game with said user wherein said game utilizes actual data obtained from said at least one motion capture element associated with said second user.

10. The portable wireless mobile device motion capture and analysis system of claim 1 wherein data associated with a second user is obtained from said remote database located remote to said mobile device and wherein said data associated with said second user is utilized to play a game with said user wherein said game utilizes actual data obtained from said at least one motion capture element associated with said second user and wherein said game comprises virtual reality or augmented virtual reality.

11. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said analyze is performed to determine how centered a collision between a ball and said piece of equipment is based on oscillations of said at least one motion capture element coupled with said piece of equipment and display an impact location based on said motion analysis data.

12. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said at least one motion capture element comprises a visual marker.

13. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said mobile device comprises at least one camera coupled with said computer and wherein said computer is further configured to command said at least one camera to capture one or more images of said user and/or a visual marker associated with said at least one motion capture element in order to obtain said data.

14. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said mobile device comprises at least one camera coupled with said computer and wherein said computer is further configured to command said at least one camera to capture one or more images of a second user and/or a visual marker associated with said at least one motion capture element and transmit said one or more images to a second mobile device so that a first and second user do not have to switch mobile devices to obtain performance images on their respective mobile devices.

15. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising one or more cameras external to said mobile device that are utilized to obtain one or more images that are augmented with said data, or said motion analysis data, or both said data and said motion analysis data and wherein said one or more images are then broadcast to televisions or to the Internet.

16. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising one or more cameras external to said mobile device wherein said computer is further configured to obtain one or more images of said user and/or said at least one motion capture element from said one or more cameras external to said mobile device, and wherein said computer configured to analyze said data comprises said computer further configured to form three-dimensional data from positions associated with said at least one motion capture element as obtained from

said camera and

said one or more cameras external to said mobile device.

17. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising two or more cameras external to said mobile device, wherein said computer is further configured to obtain two or more images of said user and/or said at least one motion capture element from said two or more cameras external to said mobile device, and wherein said computer configured to analyze said data comprises said computer further configured to form three-dimensional data from positions associated with said at least one motion capture element as obtained from

said two or more cameras external to said mobile device.

18. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising two or more cameras wherein said computer is further configured to obtain two or more images of said user and data associated with said at least one motion capture element, wherein said two or more images are obtained from said two or more cameras and wherein said computer is further configured to generate a display that shows slow motion of the user shown from around the user at various angles at normal speed.

19. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising at least one camera and an orientation module in said mobile device and coupled with said computer, wherein said computer is further configured to prompt said user to align said at least one camera along a horizontal plane based on orientation data obtained from said orientation module.

20. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said computer is further configured to obtain at least one image of said user and wherein said display of said motion analysis comprises display of a three-dimensional overlay onto said at least one image of said user wherein said three-dimensional overlay is associated with said motion analysis data.

21. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said display of said motion analysis comprises display of

a rating or

a calculated ball flight path or

a time line showing points in time along a time axis where peak values occur or

an impact location of a ball on said piece of equipment

or any combination thereof associated with said motion analysis data.

22. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said display of said motion analysis comprises display of a suggest training regimen to aid said user in improving mechanics of said user.

23. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said computer is further configured to present an interface to enable said user to purchase said piece of equipment over said wireless communication interface.

24. The portable wireless mobile device motion capture and analysis system of claim 1 wherein said computer is further configured present an interface to enable said user to order a customer fitted piece of equipment over said wireless communication interface.

25. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising a battery coupled with said at least one motion capture element and further coupled with a mechanical charger.

26. The portable wireless mobile device motion capture and analysis system of claim 1 further comprising:

an identifier coupled with said piece of equipment;

said mobile device further comprising

an input device configured to accept a user input from said user; and

,

said computer further configured to obtain said identifier and query said user as to whether to increment a shot count.

27. The portable wireless mobile device motion capture and analysis system of claim 26 wherein said identifier is associated with a passive RFID or is associated with said microcontroller or obtained remotely by said microcontroller over said radio.

28. The portable wireless mobile device motion capture and analysis system of claim 26 wherein said computer is further configured to query said user to increment said shot count when said user has moved over a threshold distance.

29. The portable wireless mobile device motion capture and analysis system of claim 26 wherein said mobile device further comprises an accelerometer configured as an input device to accept an input from said user to increment a shot count.

30. The portable wireless mobile device motion capture and analysis system of claim 26 wherein said mobile device comprises a position determination component configured to mark a location associated with said increment of said shot count.

31. The portable wireless mobile device motion capture and analysis system of claim 26 wherein said mobile device comprises a position determination component configured to mark a location associated with said increment of said shot count and present said location on a map shown on said display of said mobile device.

32. The portable wireless mobile device motion capture and analysis system of claim 1, wherein said sensor is further configured to power on or power off using one or more gestures, wherein said one or more gestures include one or more of motion, physical switches, contact with said sensor and wireless commands to said sensor.

33. A portable wireless mobile device motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment,

wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture any combination of values associated with an orientation, a position, a velocity, and an acceleration of said at least one motion capture element;

a radio;

a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

store said data in said memory;

transmit said data via said radio;

two or more cameras;

an application configured to execute on a mobile device, wherein said mobile device comprises

a computer;

a display; and

,

a wireless communication interface configured to

communicate with said radio to obtain said data, and

communicate with a remote database that is remote to said mobile device;

wherein said computer is coupled with said display and said wireless communication interface, and wherein said computer is configured to execute said application to configure said computer to

receive said data associated with said at least one motion capture element via said wireless communication interface;

analyze said data to form motion analysis data;

display said motion analysis data on said display;

store said data, or said motion analysis data, or both said data and said motion analysis data in said remote database; and

,

obtain two or more images of said user and data associated with said at least one motion capture element, wherein said two or more images are obtained from said two or more cameras and wherein said computer is further configured to generate a display that shows slow motion of the user shown from around the user at various angles at normal speed.

34. A portable wireless mobile device motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment,

wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture any combination of values associated with an orientation, a position, a velocity, and an acceleration of said at least one motion capture element;

a radio;

a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

store said data in said memory;

transmit said data via said radio;

an application configured to execute on a mobile device, wherein said mobile device comprises

a computer;

a display; and

,

a wireless communication interface configured to

communicate with said radio to obtain said data, and

communicate with a remote database that is remote to said mobile device;

wherein said computer is coupled with said display and said wireless communication interface, and wherein said computer is configured to execute said application to configure said computer to

receive said data associated with said at least one motion capture element via said wireless communication interface;

analyze said data to form motion analysis data;

display said motion analysis data on said display;

store said data, or said motion analysis data, or both said data and said motion analysis data in said remote database; and

,

obtain at least one image of said user and wherein said display of said motion analysis comprises display of a three-dimensional overlay onto said at least one image of said user wherein said three-dimensional overlay is associated with said motion analysis data.

35. A portable wireless mobile device motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment,

wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture any combination of values associated with an orientation, a position, a velocity, and an acceleration of said at least one motion capture element;

a radio;

a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

store said data in said memory;

transmit said data via said radio;

an application configured to execute on a mobile device, wherein said mobile device comprises

a computer;

a display; and

,

a wireless communication interface configured to

communicate with said radio to obtain said data, and

communicate with a remote database that is remote to said mobile device;

wherein said computer is coupled with said display and said wireless communication interface, and wherein said computer is configured to execute said application to configure said computer to

receive said data associated with said at least one motion capture element via said wireless communication interface;

analyze said data to form motion analysis data;

display said motion analysis data on said display;

store said data, or said motion analysis data, or both said data and said motion analysis data in said remote database; and

,

present an interface to enable said user to purchase said piece of equipment over said wireless communication interface.

36. A portable wireless mobile device motion capture and analysis system comprising:

at least one motion capture element configured to couple with a user or piece of equipment,

wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture any combination of values associated with an orientation, a position, a velocity, and an acceleration of said at least one motion capture element;

a radio;

a microcontroller coupled with said memory, said sensor and said radio, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

store said data in said memory;

transmit said data via said radio;

an identifier coupled with said piece of equipment;

an application configured to execute on a mobile device, wherein said mobile device comprises

a computer;

an input device configured to accept a user input from said user;

a display; and

,

a wireless communication interface configured to

communicate with said radio to obtain said data, and

communicate with a remote database that is remote to said mobile device;

wherein said computer is coupled with said display and said wireless communication interface, and wherein said computer is configured to execute said application to configure said computer to

receive said data associated with said at least one motion capture element via said wireless communication interface;

analyze said data to form motion analysis data;

display said motion analysis data on said display;

store said data, or said motion analysis data, or both said data and said motion analysis data in said remote database; and

,

obtain said identifier and query said user as to whether to increment a shot count.

37. The portable wireless mobile device motion capture and analysis system of claim 36 wherein said computer is further configured to query said user to increment said shot count when said user has moved over a threshold distance.

38. The portable wireless mobile device motion capture and analysis system of claim 36 wherein said mobile device further comprises an accelerometer configured as an input device to accept an input from said user to increment a shot count.

39. The portable wireless mobile device motion capture and analysis system of claim 36 wherein said mobile device comprises a position determination component configured to mark a location associated with said increment of said shot count.