Motion attributes recognition system and methods
First Claim
Patent Images
1. A motion attribute recognition system comprising:
- a pre-processing component configured to receive a data stream including motion data and to output action exemplars comprising;
an orientation matrix conversion process configured to transform raw motion data into a quaternion suitable to measure the distance between two rotations by comparing the quaternion of a one rotation with the quaternion of the other rotation;
a spatial alignment process configured to align the starting plane of the motion data; and
a temporal segmentation process configured to locate the actual segment of the motion data within the data stream;
a non-parametric classification recognition component in communication with the pre-processing component comprising;
a database of stored action exemplars searchable to and configured to output motion attributes from a query comprising the motion data;
a database search engine configured to search the database of action exemplars for comparison with a received action exemplar from the pre-processing component; and
a non-parametric classification recognition process configured to receive action exemplars from the pre-processing component and the database search engine and to output attributes of the action exemplar received from the pre-processing component; and
a parametric classification recognition component in communication with the pre-processing component comprising;
one or more support vector machines wherein each support vector machine is configured to find one of the presence and absence of an attribute in an action exemplar received from the pre-processing component; and
a parametric classification recognition process configured to receive an action exemplar from the pre-processing component and to query the one or more support vector machines for the presence of an attribute in the action exemplar and to output one of the presence and absence of an attribute in the action exemplar;
a display; and
an user interface in communication with the database and the display and configured to receive the motion data, to query the database with the motion data, to receive attributes from the database in response to the query, and to output attribute information on the display in order to present a virtual coach.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for motion attribute recognition are defined using data stream pre-processing to orient, align and segment motion data before using non-parametric classification recognition to search a motion data exemplar database or using parametric classification recognition to find attributes by comparing pre-processed motion data with support vector machines. Results from the non-parametric classification recognition and the parametric classification recognition may be fused to produce a single result. Active learning and metric learning are used to improve searches of the database and comparisons to the support vector machines.
-
Citations
19 Claims
-
1. A motion attribute recognition system comprising:
-
a pre-processing component configured to receive a data stream including motion data and to output action exemplars comprising; an orientation matrix conversion process configured to transform raw motion data into a quaternion suitable to measure the distance between two rotations by comparing the quaternion of a one rotation with the quaternion of the other rotation; a spatial alignment process configured to align the starting plane of the motion data; and a temporal segmentation process configured to locate the actual segment of the motion data within the data stream; a non-parametric classification recognition component in communication with the pre-processing component comprising; a database of stored action exemplars searchable to and configured to output motion attributes from a query comprising the motion data; a database search engine configured to search the database of action exemplars for comparison with a received action exemplar from the pre-processing component; and a non-parametric classification recognition process configured to receive action exemplars from the pre-processing component and the database search engine and to output attributes of the action exemplar received from the pre-processing component; and a parametric classification recognition component in communication with the pre-processing component comprising; one or more support vector machines wherein each support vector machine is configured to find one of the presence and absence of an attribute in an action exemplar received from the pre-processing component; and a parametric classification recognition process configured to receive an action exemplar from the pre-processing component and to query the one or more support vector machines for the presence of an attribute in the action exemplar and to output one of the presence and absence of an attribute in the action exemplar; a display; and an user interface in communication with the database and the display and configured to receive the motion data, to query the database with the motion data, to receive attributes from the database in response to the query, and to output attribute information on the display in order to present a virtual coach. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A virtual golf coaching system comprising:
-
a first electronic device attachable to a golf club that transmits motion data from a swinging golf club describing the golf club movement; and a second electronic device comprising; a display; a motion attribute recognition system comprising a database of stored golf swing exemplars searchable to and configured to output golf swing attributes from a query comprising the motion data; and an application in communication with the first electronic device, the database and the display and configured to receive the motion data transmitted from the first electronic device, to query the database with the motion data, to receive attributes from the database in response to the query, and to output attribute information on the display; a pre-processing component configured to receive a data stream including the motion data and to output golf swing exemplars comprising; an orientation matrix conversion process configured to transform raw motion data into a quaternion suitable to measure the distance between two rotations by comparing the quaternion of a one rotation with the quaternion of the other rotation; a spatial alignment process configured to align the starting plane of the motion data; and a temporal segmentation process configured to locate the actual segment of the motion data within the data stream; a non-parametric classification recognition component in communication with the pre-processing component comprising; the database of stored golf swing exemplars; a database search engine configured to search the database of stored golf swing exemplars for comparison with a received golf swing exemplar from the pre-processing component; and a non-parametric classification recognition process configured to receive golf swing exemplars from the pre-processing component and the database search engine and to output attributes of the golf swing exemplar received from the pre-processing component; and a parametric classification recognition component in communication with the pre-processing component comprising; one or more support vector machines wherein each support vector machine is configured to find one of the presence and absence of an attribute in a golf swing exemplar received from the pre-processing component; and a parametric classification recognition process configured to receive a golf swing exemplar from the pre-processing component and to query the one or more support vector machines for the presence of an attribute in the golf swing exemplar and to output one of the presence and absence of an attribute in the golf swing exemplar. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
-
19. A method for virtual golf coaching comprising:
-
attaching a first electronic device to a golf club that transmits motion data from a swinging golf club describing the golf club movement; swinging the golf club; providing a second electronic device comprising; providing a display; providing a database of stored golf swing exemplars searchable to and configured to output golf swing attributes from a query comprising the motion data; and providing a motion attribute recognition system comprising; pre-processing a received a data stream including the motion data and outputting golf swing exemplars comprising; transforming raw motion data into a quaternion suitable to measure the distance between two rotations by comparing the quaternion of a one rotation with the quaternion of the other rotation using an orientation matrix conversion process; aligning the starting plane of the motion data using a spatial alignment process; and locating the actual segment of the motion data within the data stream using a temporal segmentation process; providing a non-parametric classification recognition component in communication with the pre-processing component comprising; storing golf swing exemplars in the database; searching the database of stored golf swing exemplars for comparison with a received golf swing exemplar from the pre-processing component using a database search engine; and receiving golf swing exemplars from the pre-processing component and the database search engine and outputting attributes of the golf swing exemplar received from the pre-processing component using a non-parametric classification recognition process; and providing a parametric classification recognition component in communication with the pre-processing component comprising; finding one of the presence and absence of an attribute in a golf swing exemplar received from the pre-processing component using one or more support vector machines; and receiving a golf swing exemplar from the pre-processing component and querying the one or more support vector machines for the presence of an attribute in the golf swing exemplar and outputting one of the presence and absence of an attribute in the golf swing exemplar using a parametric classification recognition process; and configuring an application in communication with the first electronic device, the database and the display to receive the motion data transmitted from the first electronic device, to query the database with the motion data, to receive attributes from the database in response to the query, and to output attribute information on the display.
-
Specification