Multi-sensor event analysis and tagging system
First Claim
1. A multi-sensor event analysis and tagging system comprising:
- a plurality of sensors, whereineach sensor of said plurality of sensors measures motion of a different object of a plurality of objects; and
,said plurality of objects comprises two or more ofa player;
a piece of equipment worn by, attached to, carried by, or used by said player; and
,a projectile configured to be contacted by said player or by said piece of equipment;
an event analysis and tagging system comprisinga communications interface configured to receive sensor data from said plurality of sensors; and
,a processor coupled to said communications interface and configured toreceive said sensor data from said communications interface;
synchronize said sensor data to a common time scale, forming synchronized sensor data; and
,analyze said synchronized sensor data todetect an event; and
,calculate one or more metrics for said event;
an event database;
wherein said event analysis and tagging system is further configured toanalyze said synchronized sensor data to determine one or more tags for said event;
store one or both of said synchronized sensor data and said one or more metrics for said event in said event database; and
,store said one or more tags in said event database with said event; and
,a manual tagging interface configured topresent said event to a user;
accept one or more user selected tags for said event from said user; and
,store said one or more user selected tags in said event database with said event.
4 Assignments
0 Petitions
Accused Products
Abstract
A system that analyzes data from multiple sensors, potentially of different types, that track motions of players, equipment, and projectiles such as balls. Data from different sensors is combined to generate integrated metrics for events and activities. Illustrative sensors may include inertial sensors, cameras, radars, and light gates. As an illustrative example, a video camera may track motion of a pitched baseball, and an inertial sensor may track motion of a bat; the system may use the combined data to analyze the effectiveness of the swing in hitting the pitch. The system may also use sensor data to automatically select or generate tags for an event; tags may represent for example activity types, players, performance levels, or scoring results. The system may analyze social media postings to confirm or augment event tags. Users may filter and analyze saved events based on the assigned tags.
371 Citations
107 Claims
-
1. A multi-sensor event analysis and tagging system comprising:
-
a plurality of sensors, wherein each sensor of said plurality of sensors measures motion of a different object of a plurality of objects; and
,said plurality of objects comprises two or more of a player; a piece of equipment worn by, attached to, carried by, or used by said player; and
,a projectile configured to be contacted by said player or by said piece of equipment; an event analysis and tagging system comprising a communications interface configured to receive sensor data from said plurality of sensors; and
,a processor coupled to said communications interface and configured to receive said sensor data from said communications interface; synchronize said sensor data to a common time scale, forming synchronized sensor data; and
,analyze said synchronized sensor data to detect an event; and
,calculate one or more metrics for said event; an event database; wherein said event analysis and tagging system is further configured to analyze said synchronized sensor data to determine one or more tags for said event; store one or both of said synchronized sensor data and said one or more metrics for said event in said event database; and
,store said one or more tags in said event database with said event; and
,a manual tagging interface configured to present said event to a user; accept one or more user selected tags for said event from said user; and
,store said one or more user selected tags in said event database with said event. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A multi-sensor event analysis and tagging system comprising:
-
a plurality of sensors, wherein each sensor of said plurality of sensors measures motion of a different object of a plurality of objects; and
,said plurality of objects comprises a piece of equipment worn by, attached to, carried by, or used by said player; and
,a projectile configured to be contacted by said player or by said piece of equipment; and
,an event analysis and tagging system comprising a communications interface configured to receive sensor data from said plurality of sensors; and
,a processor coupled to said communications interface and configured to receive said sensor data from said communications interface; synchronize said sensor data to a common time scale, forming synchronized sensor data; analyze said synchronized sensor data to detect an event; and
,calculate one or more metrics for said event, wherein said event comprises a motion of said projectile and a swing of said piece of equipment by said player to attempt to hit said projectile; calculate a projectile trajectory from said sensor data; calculate a piece of equipment trajectory from said sensor data; and
,calculate an optimal hitting point on said projectile trajectory, said optimal hitting point comprising an optimal hitting time and an optimal hitting location; and
,wherein said one or more metrics comprise one or more of
a swing accuracy metric calculated from a vector difference between said optimal hitting location and a location of said piece of equipment trajectory at said optimal hitting time;
a spatial deviation metric calculated from a vector difference between said optimal hitting location and a closest point on said piece of equipment trajectory to said optimal hitting location; and
,
a temporal deviation metric calculated from a time difference between said optimal hitting time and a time at which said piece of equipment trajectory reaches said closest point on said piece of equipment trajectory to said optimal hitting location. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43)
-
-
44. A multi-sensor event analysis and tagging system comprising:
-
a plurality of sensors, wherein each sensor of said plurality of sensors measures motion of a different object of a plurality of objects; and
,said plurality of objects comprises two or more of a player; a piece of equipment worn by, attached to, carried by, or used by said player; and
,a projectile configured to be contacted by said player or by said piece of equipment; an event analysis and tagging system comprising a communications interface configured to receive sensor data from said plurality of sensors; and
,a processor coupled to said communications interface and configured to receive said sensor data from said communications interface; synchronize said sensor data to a common time scale, forming synchronized sensor data; and
,analyze said synchronized sensor data to detect an event; and
,calculate one or more metrics for said event; an event database; wherein said event analysis and tagging system is further configured to analyze said synchronized sensor data to determine one or more tags for said event; store one or both of said synchronized sensor data and said one or more metrics for said event in said event database; store said one or more tags in said event database with said event; and
,analyze one or more of text, audio, image, and video from a computer or server to determine said one or more tags for said event, wherein said analyzing one or more of text, audio, image, and video comprises searching said text for key words or key phrases related to said event. - View Dependent Claims (45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64)
-
-
65. A multi-sensor event analysis and tagging system comprising:
-
a plurality of sensors, wherein each sensor of said plurality of sensors measures motion of a different object of a plurality of objects; and
,said plurality of objects comprises two or more of a player; a piece of equipment worn by, attached to, carried by, or used by said player; and
,a projectile configured to be contacted by said player or by said piece of equipment; an event analysis and tagging system comprising a communications interface configured to receive sensor data from said plurality of sensors; and
,a processor coupled to said communications interface and configured to receive said sensor data from said communications interface; synchronize said sensor data to a common time scale, forming synchronized sensor data; and
,analyze said synchronized sensor data to detect an event; and
,calculate one or more metrics for said event; an event database; wherein said event analysis and tagging system is further configured to analyze said synchronized sensor data to determine one or more tags for said event; store one or both of said synchronized sensor data and said one or more metrics for said event in said event database; and
,store said one or more tags in said event database with said event; and
,an event filter coupled to said event database, wherein said event filter is configured to accept one or more filter tags; and
,return one or both of said synchronized sensor data and said one or more metrics for events in said event database having tags that match said one or more filter tags. - View Dependent Claims (66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86)
-
-
87. A multi-sensor event analysis and tagging system comprising:
-
a plurality of sensors, wherein said plurality of sensors comprise a video camera; each sensor of said plurality of sensors measures motion of a different object of a plurality of objects; and
,said plurality of objects comprises two or more of a player; a piece of equipment worn by, attached to, carried by, or used by said player; and
,a projectile configured to be contacted by said player or by said piece of equipment; an event analysis and tagging system comprising a communications interface configured to receive sensor data from said plurality of sensors; and
,a processor coupled to said communications interface and configured to receive said sensor data from said communications interface; synchronize said sensor data to a common time scale, forming synchronized sensor data; and
,analyze said synchronized sensor data to detect an event; and
,calculate one or more metrics for said event; an event database; wherein said event analysis and tagging system is further configured to analyze said synchronized sensor data to determine one or more tags for said event; store one or both of said synchronized sensor data and said one or more metrics for said event in said event database; and
,store said one or more tags in said event database with said event; and
,an event filter coupled to said event database, wherein said event filter is configured to accept one or more filter tags; return one or both of said synchronized sensor data and said one or more metrics for events in said event database having tags that match said one or more filter tags; and
,create a highlight reel comprising video for said events in said event database having tags that match said one or more filter tags. - View Dependent Claims (88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107)
-
Specification