Portable wireless mobile device motion capture data mining system and method

• US 10,406,399 B2
• Filed: 03/28/2017
• Issued: 09/10/2019
• Est. Priority Date: 08/26/2010
• Status: Active Grant

• Current Assignee: Newlight Capital, LLC
• Original Assignee: Blast Motion Incorporated
• Inventors: Bentley, Michael, Bose, Bhaskar
• Primary Examiner(s): Galka, Lawrence S
• Application Number:
  US15/471,599
• Publication Number:
  US 20170296868A1
• Time in Patent Office: 896 Days
• CPC Class Codes: A63B 2220/833 Sensors arranged on the exercise apparatus or sports implement
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 69/36 for golf
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/338 using television networks
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/406 : Transmission via wireless network, e.g. pager or GSM
• CPC Class Codes: A63F 2300/407 : Data transfer via internet
• CPC Class Codes: A63F 2300/554 : by saving game or status data
• CPC Class Codes: A63F 2300/69 : Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/8011 : Ball
• CPC Class Codes: G06Q 20/123 : Shopping for digital content

Abstract

Portable wireless mobile device motion capture data mining system and method configured to display motion capture/analysis data on a mobile device. System obtains data from motion capture elements, analyzes data and store data in database for data mining, which may be charged for. Enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data including ratings. Predicted ball flight path data can be calculated and shown on a time line showing relative peaks of velocity for the user'"'"'s body parts. User can determine equipment that fits best and immediately purchase the equipment, via the mobile device. Custom equipment may be ordered on the mobile device from a vendor that can assemble-to-order customer built equipment and ship the equipment. Includes active and passive golf shot count capabilities.

Claims

1. A portable wireless mobile device motion capture data mining system comprising:

at least one motion capture element configured to couple with a piece of equipment and configured to capture motion capture data during a movement of said piece of equipment performed by a first user, wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture one or more values associated with an orientation, position, velocity, and acceleration of said at least one motion capture element;

a first communication interface; and

,

a microcontroller coupled with said memory, said sensor and said first communication interface, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

detect a first value from said sensor values having a first threshold velocity or acceleration;

detect a second value from said sensor values having a second threshold velocity or acceleration within a time window;

signify a prospective event from said sensor values;

compare said prospective event to a characteristic signal associated with a typical swing, wherein said compare comprises executing a pattern matching algorithm to follow curves of each of an axis and use segments of one or more axes from said sensor values to determine if said typical swing took place, and eliminate any false positive events from said data based on said comparing;

signify a valid event if said prospective event is not a false positive event;

save said valid event in said memory;

store said data in said memory; and

,

transmit said data via said first communication interface;

a database;

an application configured to execute on a mobile device, wherein said mobile device comprises

a computer;

a wireless interface coupled with said computer;

a display;

a second communication interface configured to communicate with said first communication interface to obtain said data, and communicate with said database;

wherein said computer is coupled with said display and said second communication interface, wherein said computer executes said application to configure said computer to

receive said motion capture data from said at least one motion capture element via said second communication interface;

analyze said motion capture data to form motion analysis data;

display said motion analysis data on said display; and

,

store said motion capture data, or said motion analysis data, or both said motion capture data and said motion analysis data in said database; and

,

wherein said database is configured to enable said data from said sensor, or said motion analysis data, or both said data from said sensor and said motion analysis data to be data mined using said application,

wherein said database comprises

said data, or said motion analysis data, or both said data and said motion analysis data related to two or more users that differ from said first user,

measurements associated with said two or more users that differ from said first user,

information related to said two or more users including an age or height or weight or sex or address of said two or more users,

information related to a plurality of manufacturers and models of said piece of equipment,

information related to said data obtained from said at least one motion capture element including any combination of time or location associated with said data, and

information related to at least one pattern found in said database associated with said data,

wherein said computer executes said application to further configure said computer to

perform a comparison of said at least one measurement of said characteristic or of said movement to said database of said measurements associated with said two or more users;

based on said comparison, identify a second user of said two or more users, wherein corresponding data associated with said second user in said database is similar to said motion capture data, or said motion analysis data, or both said motion capture data and said motion analysis data associated with said first user or of said movement of said piece of equipment performed by said first user,

present information associated with a piece of equipment used by said second user to the first user to suggest said piece of equipment used by said second user or allow said first user to search for said piece of equipment used by said second user, wherein the information associated with said piece of equipment used by said second user is based on said corresponding data that is similar, and

present an interface on said mobile device to enable said first user to immediately purchase said piece of equipment over said wireless interface based on said data from said sensor, or said motion analysis data, or both said data from said sensor and said motion analysis data analyzed on said computer or as suggested or as returned via said search on said database.

2. The portable wireless mobile device motion capture data mining system of claim 1 wherein said database comprises information related to a user that data mines that enables said user that data mines to access said data obtained from said at least one motion capture element related to said two or more users.

3. The portable wireless mobile device motion capture data mining system of claim 1 wherein said database comprises information related to a user that data mines wherein said information enables said user that data mines to be charged to access said database.

4. The portable wireless mobile device motion capture data mining system of claim 1 wherein said microcontroller is configured to store said data in said memory at least until a communications link to said computer exists and said data has been transferred to said computer.

5. The portable wireless mobile device motion capture data mining system of claim 1 wherein said microcontroller is configured to transmit said data in said memory after an event or periodically or when requested by said computer.

6. The portable wireless mobile device motion capture data mining system of claim 1 wherein said computer is configured to transmit said data to said database after a communications link to said database exists or after an event or periodically or when requested by said database.

7. The portable wireless mobile device motion capture data mining system of claim 1 wherein said data in said database is utilized to play a game comprising one or more total players wherein said game utilizes actual data obtained from said at least one motion capture element.

8. The portable wireless mobile device motion capture data mining system of claim 1 further comprising at least one camera configured to capture one or more images of said first user and/or a visual marker associated with said at least one motion capture element and wherein said one or more images are stored in said database.

9. The portable wireless mobile device motion capture data mining system of claim 1 wherein said display of said motion analysis comprises display of

a rating or

a calculated ball flight path or

a time line showing points in time along a time axis where peak values occur or

an impact location of a ball on said piece of equipment

or any combination thereof associated with said motion analysis data as calculated on said computer or obtained from said database and with or without any images of said first user.

10. The portable wireless mobile device motion capture data mining system of claim 1 wherein said display of said motion analysis comprises display of a suggested training regimen to aid said first user in improving mechanics of said first user as determined via said computer or as determined from data in said database.

11. The portable wireless mobile device motion capture data mining system of claim 1 further comprising an identifier associated with a passive RFID or is associated with said microcontroller or obtained remotely by said microcontroller over said radio and wherein said identifier is stored in said database.

12. The portable wireless mobile device motion capture data mining system of claim 1 wherein said database comprises information related to elasticity and inertia related to said first user or said piece of equipment.

13. A portable wireless mobile device motion capture data mining system comprising:

at least one motion capture element configured to couple with a piece of equipment and configured to capture motion capture data during a movement of said piece of equipment performed by a first user, wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture one or more values associated with an orientation, position, velocity, and acceleration of said at least one motion capture element;

a first communication interface; and

,

a microcontroller coupled with said memory, said sensor and said first communication interface, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

detect a first value from said sensor values having a first threshold velocity or acceleration;

detect a second value from said sensor values having a second threshold velocity or acceleration within a time window;

signify a prospective event from said sensor values;

compare said prospective event to a characteristic signal associated with a typical swing, wherein said compare comprises executing a pattern matching algorithm to follow curves of each of an axis and use segments of one or more axes from said sensor values to determine if said typical swing took place, and eliminate any false positive events from said data based on said comparing;

signify a valid event if said prospective event is not a false positive event;

save said valid event in said memory;

store said data in said memory;

transmit said data via said first communication interface;

a database;

an application configured to execute on a mobile device wherein said mobile device comprises

a computer;

a wireless interface coupled with said computer;

a display;

a second communication interface configured to communicate with said first communication interface to obtain said data, and communicate with said database;

wherein said computer is coupled with said display and said second communication interface, wherein said computer executes said application to configure said computer to

receive said motion capture data from said at least one motion capture element via said second communication interface;

analyze said motion capture data to form motion analysis data;

display said motion analysis data on said display; and

,

store said motion capture data, or said motion analysis data, or both said motion capture data and said motion analysis data in said database;

wherein said database is configured to enable said data, or said motion analysis data, or both said data and said motion analysis data to be data mined using said application,

wherein said database comprises

said data, or said motion analysis data, or both said data and said motion analysis data related to two or more users that differ from said first user,

information related to said two or more users including an age or height or weight or sex or address of said two or more users,

information related to a plurality of manufacturers and models of said piece of equipment,

information related to said data obtained from said at least one motion capture element including any combination of time or location associated with said data,

information related to at least one pattern found in said database associated with said data, and

information related to a user that data mines that enables said user that data mines to access said data, or said motion analysis data, or both said data and said motion analysis data related to said two or more users;

wherein said computer executes said application to further configure said computer to perform a comparison of said motion capture data or said motion analysis data, or both

said motion capture data and said motion analysis data with said data, or said motion analysis data, or both said data and said motion analysis data related to said two or more users,

based on said comparison, identify a second user of said two or more users, wherein corresponding data associated with said second user in said database is similar to said motion capture data, or said motion analysis data, or both said motion capture data and said motion analysis data associated with said first user or of said movement of said piece of equipment performed by said first user,

present information associated with a piece of equipment used by said second user to the first user to suggest said piece of equipment used by said second user or allow said first user to search for said piece of equipment used by said second user, wherein the information associated with said piece of equipment used by said second user is based on said corresponding data that is similar, and

present an interface on said mobile device to enable said first user to immediately purchase said piece of equipment over said wireless interface based on said data from said sensor, or said motion analysis data, or both said data from said sensor and said motion analysis data analyzed on said computer or as suggested or as returned via said search on said database.

14. A portable wireless mobile device motion capture data mining system comprising:

at least one motion capture element configured to couple with a piece of equipment and configured to capture motion capture data during a movement of said piece of equipment performed by a first user, wherein said at least one motion capture element comprises

a memory;

a sensor configured to capture one or more values associated with an orientation, position, velocity, and acceleration of said at least one motion capture element;

a first communication interface; and

,

a microcontroller coupled with said memory, said sensor and said first communication interface, wherein said microcontroller is configured to

collect data that comprises sensor values from said sensor;

detect a first value from said sensor values having a first threshold velocity or acceleration;

detect a second value from said sensor values having a second threshold velocity or acceleration within a time window;

signify a prospective event from said sensor values;

compare said prospective event to a characteristic signal associated with a typical swing, wherein said compare comprises executing a pattern matching algorithm to follow curves of each of an axis and use segments of one or more axes from said sensor values to determine if said typical swing took place, and eliminate any false positive events from said data based on said comparing;

signify a valid event if said prospective event is not a false positive event;

save said valid event in said memory;

store said data in said memory;

transmit said data via said first communication interface;

a database;

an application configured to execute on a mobile device wherein said mobile device comprises

a computer;

a wireless interface coupled with said computer,

a display;

a second communication interface configured to communicate with said first communication interface to obtain said data, and communicate with said database;

wherein said computer is coupled with said display and said second communication interface, wherein said computer executes said application to configure said computer to

receive said motion capture from said at least one motion capture element via said second communication interface;

analyze said motion capture data to form motion analysis data;

display said motion analysis data on said display; and

,

store said motion capture data, or said motion analysis data, or both said motion capture data and said motion analysis data in said database;

wherein said database is configured to enable said data, or said motion analysis data, or both said data and said motion analysis data to be data mined using said application,

wherein said database comprises

said data, or said motion analysis data, or both said data and said motion analysis data related to two or more users that differ from said first user,

information related to said two or more users including an age or height or weight or sex or address of said two or more users,

information related to a plurality of manufacturers and models of said piece of equipment,

information related to said data obtained from said at least one motion capture element including any combination of time or location associated with said data,

information related to at least one pattern found in said database associated with said data,

information related to a user that data mines that enables said user that data mines to access said data, or said motion analysis data, or both said data and said motion analysis data related to said two or more users, and

wherein said database comprises information related to said user that data mines so that said user that data mines can be charged to access said database;

wherein said computer executes said application to further configure said computer to

perform a comparison of said motion capture data or said motion analysis data, or both said motion capture data and said motion analysis data with said data, or said motion analysis data, or both said data and said motion analysis data related to said two or more users,

based on said comparison, identify a second user of two or more users, wherein corresponding data associated with said second user in said database is similar to said motion capture data, or said motion analysis data, or both said motion capture data and said motion analysis data associated with said first user or of said movement of said piece of equipment performed by said first user,

present information associated with a piece of equipment used by said second user to the first user to suggest said piece of equipment used by said second user or allow said first user to search for said piece of equipment used by said second user, wherein the information associated with said piece of equipment used by said second user is based on said corresponding data that is similar, and

present an interface on said mobile device to enable said first user to immediately purchase said piece of equipment over said wireless interface based on said data from said sensor, or said motion analysis data, or both said data from said sensor and said motion analysis data analyzed on said computer or as suggested or as returned via said search on said database.