Action detection and activity classification
First Claim
Patent Images
1. A computer-implemented method comprising:
- receiving, from one or more sensors and by a sensor system, raw sensor data;
identifying, by the sensor system and from the raw sensor data, a plurality of events detected from one or more sensor signal streams during performance of athletic activity by a user, one or more events including at least physical environment characteristics and user physiology characteristics;
responsive to identifying the plurality of events, transmitting from the sensor system to an activity processing system, the sensor data;
analyzing, by the activity processing system, the physical environment characteristics and user physiology characteristics in the received sensor data to evaluate the plurality of events against one or more constraints of a first action template to determine whether the user performed a first type of action corresponding to the first action template, wherein evaluating the plurality of events against the one or more constraints includes;
selecting a first state from the first action template to evaluate; and
determining whether a first candidate event of the plurality of events meets one or more non-relative constraints of the first state;
determining whether the first candidate event meets one or more relative constraints of the first state, wherein the one or more relative constraints defines a required relationship between the first candidate event and a second candidate event,wherein the one or more relative constraints further define at least one of;
a required relative timing between a current template matching analysis and one or more past template matching analyses of one or more other events, and a required relationship with statistics regarding prior occurrences of events of a type corresponding to the first state;
determining, by the activity processing system, whether the plurality of events matches the first action template based on the evaluation of the plurality of events against the one or more constraints of the first action template; and
in response to determining that the plurality of events matches the one or more constraints of the first action template, registering, by the activity processing system, user performance of the first type of action corresponding to the first action template.
5 Assignments
0 Petitions
Accused Products
Abstract
Activities, actions and events during user performance of physical activity may be detected using various algorithms and templates. Templates may include an arrangement of one or more states that may identify particular event types and timing between events. Templates may be specific to a particular type of activity (e.g., types of sports, drills, events, etc.), user, terrain, time of day and the like.
-
Citations
17 Claims
-
1. A computer-implemented method comprising:
-
receiving, from one or more sensors and by a sensor system, raw sensor data; identifying, by the sensor system and from the raw sensor data, a plurality of events detected from one or more sensor signal streams during performance of athletic activity by a user, one or more events including at least physical environment characteristics and user physiology characteristics; responsive to identifying the plurality of events, transmitting from the sensor system to an activity processing system, the sensor data; analyzing, by the activity processing system, the physical environment characteristics and user physiology characteristics in the received sensor data to evaluate the plurality of events against one or more constraints of a first action template to determine whether the user performed a first type of action corresponding to the first action template, wherein evaluating the plurality of events against the one or more constraints includes; selecting a first state from the first action template to evaluate; and determining whether a first candidate event of the plurality of events meets one or more non-relative constraints of the first state; determining whether the first candidate event meets one or more relative constraints of the first state, wherein the one or more relative constraints defines a required relationship between the first candidate event and a second candidate event, wherein the one or more relative constraints further define at least one of;
a required relative timing between a current template matching analysis and one or more past template matching analyses of one or more other events, and a required relationship with statistics regarding prior occurrences of events of a type corresponding to the first state;determining, by the activity processing system, whether the plurality of events matches the first action template based on the evaluation of the plurality of events against the one or more constraints of the first action template; and in response to determining that the plurality of events matches the one or more constraints of the first action template, registering, by the activity processing system, user performance of the first type of action corresponding to the first action template. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system comprising:
-
a sensor system including one or more sensors, the sensor system further including; at least a first processor; and at least a first memory storing computer readable instructions that, when executed, cause the at least a first processor to; receive, from one or more sensors, raw sensor data; identify, from the raw sensor data, a plurality of events detected from one or more sensor signal streams during performance of an athletic activity by a user, the plurality of events including at least physical environment characteristics and user physiology characteristics; responsive to identifying a plurality of events, transmit to an activity processing system, the sensor data; the activity processing system, including; at least a second processor; and at least a second memory storing computer readable instructions that, when executed, cause the at least a second processor to; determine a first type of action to be performed by the user; determine, based on the first type of action, a sensor subscription for the one or more sensors; receive, based on the sensor subscription, the transmitted sensor data; obtain, based on the first type of action, a plurality of action templates; analyze the physical environment characteristics and user physiology characteristics in the received sensor data to evaluate the plurality of events against one or more constraints of a first action template to determine whether the user performed the first type of action corresponding to the first action template; determine whether the plurality of events matches the first action template based on the evaluation of the plurality of events against the one or more constraints of the first action template; and in response to determining that the plurality of events matches the one or more constraints of the first action template, register user performance of the first type of action corresponding to the first action template.
-
-
12. A computer-implemented method comprising:
-
identifying, by an activity processing system, a plurality of action templates associated with a type of physical activity; determining, based on the type of physical activity, a sensor subscription for one or more sensors; receiving, based on the sensor subscription and by a sensor system, raw sensor data from the one or more sensors; identifying, by the sensor system and from the raw sensor data, a plurality of events detected from one or more sensor signal streams during performance of the identified type of athletic activity by a user, the one or more signal streams including at least one stream from an image-capturing device and the plurality of events including at least physical environment characteristics and user physiology characteristics; responsive to identifying the plurality of events, transmitting from the sensor system to the activity processing system, the sensor data; analyzing, by activity processing system, the physical environment characteristics and user physiology characteristics in the sensor data received from the sensor system to evaluate the plurality of events against one or more constraints of the plurality of action templates to determine whether the user performed a first type of action corresponding to a first action template; determining, by the activity processing system, whether the plurality of events matches at least one action template of the plurality of action templates based on the evaluation of the plurality of events against the one or more constraints of the plurality of action templates; and in response to determining that the plurality of events matches the one or more constraints of the at least one action template of the plurality of action templates, registering, by the activity processing system, user performance of a first type of action associated with the identified physical activity and corresponding to the at least one action template of the plurality of action templates. - View Dependent Claims (13, 14, 15, 16, 17)
-
Specification