Logic arrangement, data structure, system and method for multilinear representation of multimodal data ensembles for synthesis recognition and compression

• US 7,603,323 B2
• Filed: 10/08/2007
• Issued: 10/13/2009
• Est. Priority Date: 12/06/2001
• Status: Expired due to Fees

• Current Assignee: New York University
• Original Assignee: New York University
• Inventors: Vasilescu, Manuela O.
• Primary Examiner(s): Holmes; Michael B
• Application Number:
  US11/868,852
• Publication Number:
  US 20080109474A1
• Time in Patent Office: 736 Days
• Field of Search: 706/1
• US Class Current: 706/1
• CPC Class Codes: G06F 18/2135 based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06V 10/7715 Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/25 Recognition of walking or running movements, e.g. gait recognition

Abstract

A data structure, method, storage medium and logic arrangement are provided for use in collecting and analyzing multilinear data describing various characteristics of different objects. In particular it is possible to recognize an unknown individual, an unknown object, an unknown action being performed by an individual, an unknown expression being formed by an individual, as well as synthesize a known action never before recorded as being performed by an individual, synthesize an expression never before recorded as being formed by an individual, and reduce the amount of stored data describing an object or action by using dimensionality reduction techniques, and the like.

Claims

1. A computer-accessible medium which includes a computer program thereon for generating digital information associated with at least one individual, wherein when the computer program is executed by a processing arrangement, the processing arrangement is configured to provide the procedures comprising:

using the processing arrangement, generating a data structure relating to motions of a plurality of individuals; and

using the processing arrangement, generating a plurality of data elements relating to an invariance of the motions across the individuals, wherein the data elements are generated using an orthonormal decomposition of motion data relating to each of the individuals performing one or more of the motions.

2. The computer-accessible medium of claim 1, wherein the orthonormal decomposition is an n-mode singular value decomposition.

3. The computer-accessible medium of claim 1, wherein the motion data includes joint angles.

7. The computer-accessible medium of claim 1, wherein, when the computer program is executed by the processing arrangement, the processing arrangement is configured to at least one of display or store the digital information in a storage arrangement in at least one of a user-accessible format or a user-readable format, and wherein the digital information includes at least one of the data structure or the plurality of data elements.

4. A computer-accessible medium which includes a computer program thereon for generating digital information associated with at least one subject, wherein when the computer program is executed by a processing arrangement, the processing arrangement is configured to provide the procedures comprising:

using the processing arrangement, generating a data structure relating to motions of a plurality of subjects and a plurality of actions; and

using the processing arrangement, generating a plurality of data elements relating to an invariance across each of the actions for at least one respective subject, wherein the data elements are generated using an orthonormal decomposition of motion data relating to each of the subjects performing one or more of the motions.

5. The computer-accessible medium of claim 4, wherein the orthonormal decomposition is an n-mode singular value decomposition.

6. The computer-accessible medium of claim 4, wherein the action data includes joint angles.

8. The computer-accessible medium of claim 4, wherein, when the computer program is executed by the processing arrangement, the processing arrangement is configured to at least one of display or store the digital information in a storage arrangement in at least one of a user-accessible format or a user-readable format, and wherein the digital information includes at least one of the data structure or the plurality of data elements.