Broadcasting method for broadcasting images with augmented motion data

• US 9,039,527 B2
• Filed: 09/08/2014
• Issued: 05/26/2015
• Est. Priority Date: 08/26/2010
• Status: Active Grant

• Current Assignee: Newlight Capital, LLC
• Original Assignee: Blast Motion Incorporated
• Inventors: Bentley, Michael, Bose, Bhaskar, Kaps, Ryan
• Primary Examiner(s): Lewis, David L
• Assistant Examiner(s): Hoel, Matthew D
• Application Number:
  US14/480,557
• Publication Number:
  US 20140378194A1
• Time in Patent Office: 260 Days
• Field of Search: 463/31
• US Class Current: 463/31
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 13/86 Watching games played by other players
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training

Abstract

A broadcasting method for broadcasting images with augmented motion data, which may utilize a system having at least one camera, a computer and a wireless communication interface. The system obtains data from motion capture elements, analyzes data and optionally stores data in database for use in broadcasting applications, virtual reality applications and/or data mining. The system also recognizes at least one motion capture data element associated with a user or piece of equipment, and receives data associated with the motion capture element via the wireless communication interface. The system also enables unique displays associated with the user, such as 3D overlays onto images of the user to visually depict the captured motion data. Ratings, compliance, ball flight path data can be calculated and displayed, for example on a map or timeline or both. Furthermore, the system enables performance related equipment fitting and purchase.

Claims

1. A broadcasting method for broadcasting images with augmented motion data comprising:

capturing one or more images via at least one camera wherein said one or more images are associated with at least one motion capture element or a user that is associated with said at least one motion capture element or both said at least one motion capture element and said user;

receiving said one or more images at a computer or via a communication interface coupled with said computer;

receiving motion capture data from said at least one motion capture element via said communication interface coupled with said computer;

receiving said motion capture data after a communications link to said at least one motion capture element is available and capable of receiving information over said communication interface;

receiving said motion capture data after an event or periodically requesting said motion capture data from said at least one motion capture element;

recognizing said at least one motion capture element associated with said user or piece of equipment and associating said at least one motion capture element with assigned locations on said user or said piece of equipment based on user input from said user;

analyzing said motion capture data to form motion analysis data;

drawing

a three-dimensional overlay onto at least one avatar or at least one of said one or more images of said user or both,

a rating onto said at least one avatar or said at least one of said one or more images of said user or both,

at least one power factor value onto said at least one avatar or said at least one of said one or more images of said user or both,

a calculated ball flight path onto said at least one avatar or said at least one of said one or more images of said user or both,

a time line showing points in time along a time axis where peak values occur onto said at least one avatar or said at least one of said one or more images of said user or both,

an impact location of a ball on said piece of equipment onto said at least one avatar or said at least one of said one or more images of said user or both,

a slow motion display of the user shown from around the user at various angles at normal speed onto said at least one avatar or said at least one of said one or more images of said user or both, or

any combination thereof associated with said motion analysis data; and

,

broadcasting said at least one avatar or said one or more images or both to a multiplicity of display devices.

2. The broadcasting method according to claim 1 further comprising

accessing previously stored motion capture data or motion analysis data associated with said user or piece of equipment or previously stored motion capture data or motion analysis data associated with at least one other user or other piece of equipment;

broadcasting information comprising said at least one avatar or said at least one of said one or more images of said user associated with said user based on

said motion analysis data associated with said user or piece of equipment

and

said previously stored motion capture data or motion analysis data associated with said user or piece of equipment

 

or

said previously stored motion capture data or motion analysis data associated with at least one other user or other piece of equipment.

3. The broadcasting method according to claim 1 further comprising

broadcasting said one or more images based on

comparing

said motion analysis data associated with said user or said piece of equipment, and

previously stored motion capture data or motion analysis data associated with said user or said piece of equipment or previously stored motion capture data or said motion analysis data associated with at least one other user.

4. The broadcasting method according to claim 1 further comprising

providing an identifier coupled with said user or said piece of equipment;

coupling said computer with said identifier reader;

receiving said identifier via said identifier reader; and

,

associating said identifier with said motion analysis data.

5. The broadcasting method according to claim 1 further comprising one or of more of

broadcasting said one or more images to enable a multiplicity of viewers to purchase said piece of equipment based on said one or more images;

broadcasting an advertisement with information related to purchasing said piece of equipment based on said one or more images, and,

broadcasting said one or more images to enable a multiplicity of viewers to order a custom fitted piece of equipment over a network.

6. The broadcasting method according to claim 1 further comprising

broadcasting an alarm if said motion analysis data comprises a value below a first threshold or above a second threshold or either below said first threshold or above said second threshold.

7. The broadcasting method according to claim 1 further comprising one or more of

broadcasting said one or more images to televisions, computers, mobile devices or any combination thereof, and

broadcasting said one or more images to the Internet.

8. The broadcasting method according to claim 1 further comprising intermittently receiving said motion capture data and synchronizing said one or more images in time with said motion capture data.

9. The broadcasting method according to claim 1 further comprising intermittently receiving said motion capture data and synchronizing said one or more images in time with said motion capture data based on

location information associated with said one or more images, and

location information, an identifier and time associated with said at least one motion capture element.

10. The broadcasting method according to claim 1 further comprising intermittently receiving said motion capture data and synchronizing said one or more one or more in time with said motion capture data based on

time and an identifier associated with said images, and

time and an identifier associated with said at least one motion capture data element.

11. The broadcasting method according to claim 1 further comprising intermittently receiving said motion capture data and synchronizing said one or more images in time with said motion capture data based on

time, location information and a motion event associated with said one or more images, and

time, location information and a motion event associated with said at least one motion capture data element.

12. The broadcasting method according to claim 1 further comprising

recognizing said at least one motion capture element with newly assigned locations based on said user input after said at least one motion capture element is removed from said piece of equipment and coupled with a second piece of equipment.

13. The broadcasting method according to claim 1 wherein said recognizing said at least one motion capture element associated with a user or piece of equipment and associating said at least one motion capture element with assigned locations on said user or said piece of equipment based on said user input comprises accepting movement of each of said at least one motion capture element respectively and further comprises

displaying a location where said at least one motion capture element is currently placed or is to be placed on said user or said piece of equipment;

prompting said user to move said at least one motion capture element that is currently placed or is to be placed on said location on said user or on said piece of equipment;

accepting said data comprising an identity from said at least one motion capture element;

obtaining said identity of a particular motion capture element based on said data;

assigning said identity of said particular motion capture element to said location where said at least one motion capture element is currently placed or is to be placed on said user or on said piece of equipment.

21. The broadcasting method according to claim 1 wherein said recognizing said at least one motion capture element associated with said user or piece of equipment and associating said at least one motion capture element with assigned locations on said user or said piece of equipment comprises

analyzing motion data associated with said at least one motion capture element;

and,

determining said assigned locations.

22. The broadcasting method according to claim 1 wherein said recognizing said at least one motion capture element associated with said user or piece of equipment and associating said at least one motion capture element with assigned locations on said user or said piece of equipment comprises

displaying a list of sports or activities associated with said motion data and accepting said user input;

and,

determining said assigned locations.

23. The broadcasting method according to claim 1 further comprising

accessing previously stored motion capture data or motion analysis data associated with said user or piece of equipment;

broadcasting said at least one avatar or said one or more images or both to a multiplicity of display devices along with information based on

said motion analysis data associated with said user or piece of equipment

and

said previously stored motion capture data or motion analysis data associated with said user or piece of equipment.

24. The broadcasting method according to claim 1 further comprising

accessing previously stored motion capture data or motion analysis data associated with at least one other user or other piece of equipment;

broadcasting said at least one avatar or said one or more images or both to a multiplicity of display devices along with information based on

said motion analysis data associated with said user or piece of equipment

and

said previously stored motion capture data or motion analysis data associated with at least one other user or other piece of equipment.

14. A broadcasting method for broadcasting images with augmented motion data comprising:

capturing one or more images via at least one camera wherein said one or more images contain are associated with at least one motion capture element or a user that is associated with said at least one motion capture element or both said at least one motion capture element and said user;

receiving said one or more images at a computer or via a communication interface coupled with said computer;

receiving motion capture data from said at least one motion capture element via said communication interface coupled with said computer;

receiving said motion capture data after a communications link to said at least one motion capture element is available and capable of receiving information over said communication interface;

receiving said motion capture data after an event or periodically requesting said motion capture data from said at least one motion capture element;

analyzing said motion capture data to form motion analysis data;

drawing

a three-dimensional overlay onto at least one avatar or at least one of said one or more images of said user or both,

a rating onto said at least one avatar or said at least one of said one or more images of said user or both,

at least one power factor value onto said at least one avatar or said at least one of said one or more images of said user or both,

a calculated ball flight path onto said at least one avatar or said at least one of said one or more images of said user or both,

a time line showing points in time along a time axis where peak values occur onto said at least one avatar or said at least one of said one or more images of said user or both,

an impact location of a ball on said piece of equipment onto said at least one avatar or said at least one of said one or more images of said user or both,

a slow motion display of the user shown from around the user at various angles at normal speed onto said at least one avatar or said at least one of said one or more images of said user or both, or

any combination thereof associated with said motion analysis data;

accessing previously stored motion capture data or motion analysis data associated with said user or piece of equipment or previously stored motion capture data or motion analysis data associated with at least one other user or other piece of equipment; and

,

broadcasting said at least one avatar or said one or more images or both to a multiplicity of display devices along with information based on

said motion analysis data associated with said user or piece of equipment

and

said previously stored motion capture data or motion analysis data associated with said user or piece of equipment

 

or

said previously stored motion capture data or motion analysis data associated with at least one other user or other piece of equipment.

15. The broadcasting method according to claim 14 further comprising intermittently receiving said motion capture data and synchronizing said one or more images in time with said motion capture data.

16. The broadcasting method according to claim 14 further comprising

recognizing said at least one motion capture element with newly assigned locations based on said user input after said at least one motion capture element is removed from said piece of equipment and coupled with a second piece of equipment.

17. The broadcasting method according to claim 14 further comprising

displaying a location where said at least one motion capture element is currently placed or is to be placed on said user or said piece of equipment;

prompting said user to move said at least one motion capture element that is currently placed or is to be placed on said location on said user or on said piece of equipment;

accepting said data comprising an identity from said at least one motion capture element;

obtaining said identity of a particular motion capture element based on said data;

assigning said identity of said particular motion capture element to said location where said at least one motion capture element is currently placed or is to be placed on said user or on said piece of equipment;

obtaining data comprising said sensor values associated with said at least one motion capture element after said at least one motion capture element is placed on said user or on said piece of equipment.

18. A broadcasting method for broadcasting images with augmented motion data comprising:

capturing one or more images via at least one camera wherein said one or more images are associated with at least one motion capture element or a user that is associated with said at least one motion capture element or both said at least one motion capture element and said user;

receiving said one or more images at a computer or via a communication interface coupled with said computer;

receiving motion capture data from said at least one motion capture element via said communication interface coupled with said computer;

receiving said motion capture data after a communications link to said at least one motion capture element is available and capable of receiving information over said communication interface;

receiving said motion capture data after an event or periodically requesting said motion capture data from said at least one motion capture element;

intermittently receiving said motion capture data;

synchronizing said one or more images in time with said motion capture data;

analyzing said motion capture data to form motion analysis data;

drawing

a three-dimensional overlay onto at least one avatar or at least one of said one or more images of said user or both,

a rating onto said at least one avatar or said at least one of said one or more images of said user or both,

at least one power factor value onto said at least one avatar or said at least one of said one or more images of said user or both,

a calculated ball flight path onto said at least one avatar or said at least one of said one or more images of said user or both,

a time line showing points in time along a time axis where peak values occur onto said at least one avatar or said at least one of said one or more images of said user or both,

an impact location of a ball on said piece of equipment onto said at least one avatar or said at least one of said one or more images of said user or both,

a slow motion display of the user shown from around the user at various angles at normal speed onto said at least one avatar or said at least one of said one or more images of said user or both, or

any combination thereof associated with said motion analysis data;

broadcasting said at least one avatar or said one or more images or both to a multiplicity of display devices based on

comparing

said motion analysis data associated with said user or said piece of equipment

and

previously stored motion capture data or motion analysis data associated with said user or said piece of equipment or previously stored motion capture data or said motion analysis data associated with at least one other user.

19. The broadcasting method according to claim 18 further comprising

recognizing said at least one motion capture element with newly assigned locations based on said user input after said at least one motion capture element is removed from said piece of equipment and coupled with a second piece of equipment.

20. The broadcasting method according to claim 18 further comprising recognizing said at least one motion capture element associated with a user or piece of equipment and associating said at least one motion capture element with assigned locations on said user or said piece of equipment by

displaying a location where said at least one motion capture element is currently placed or is to be placed on said user or said piece of equipment;

prompting said user to move said at least one motion capture element that is currently placed or is to be placed on said location on said user or on said piece of equipment;

accepting said data comprising an identity from said at least one motion capture element;

obtaining said identity of a particular motion capture element based on said data;

assigning said identity of said particular motion capture element to said location where said at least one motion capture element is currently placed or is to be placed on said user or on said piece of equipment

obtaining data comprising said sensor values associated with said at least one motion capture element after said at least one motion capture element is placed on said user or on said piece of equipment.