Logic arrangement, data structure, system and method for multilinear representation of multimodal data ensembles for synthesis, rotation and compression

• US 7,379,925 B2
• Filed: 08/08/2005
• Issued: 05/27/2008
• Est. Priority Date: 07/25/2003
• Status: Expired due to Fees

• Current Assignee: New York University
• Original Assignee: New York University
• Inventors: Terzopoulos, Demetri, Vasilescu, Manuela Alex O.
• Primary Examiner(s): Holmes; Michael B.
• Application Number:
  US11/200,479
• Publication Number:
  US 20060143142A1
• Time in Patent Office: 1,023 Days
• Field of Search: 706/1, 706/20, 707/100
• US Class Current: 706/20
• CPC Class Codes: G06F 18/2135 based on approximation criteria, e.g. principal component analysis
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 15/50 Lighting effects

Abstract

A data structure, method, storage medium and logic arrangement are provided for use in collecting and analyzing multilinear data describing various characteristics of different objects. In particular it is possible to recognize an unknown object or an unknown viewpoint of an object, as well as synthesize a known viewpoint never before recorded of an object, and reduce the amount of stored data describing an object or viewpoint by using dimensionality reduction techniques, and the like.

Claims

1. A storage medium storing a software program that is adapted for generating an object descriptor of at least one object, wherein the software program, when executed by a processing arrangement, is configured to cause the processing arrangement to execute the operations comprising:

collecting a plurality of first data elements which contain information regarding at least one characteristic of the at least one object;

obtaining the object descriptor based on the information of the first data elements, wherein the object descriptor is related to the at least one characteristic and a further characteristic of the at least one object; and

generating a plurality of second data elements which contain information regarding the further characteristic of the at least one object based on the object descriptor, wherein each of the second data elements is one of an identity of an object, a viewpoint, an illumination, or a pixel.

2. The storage medium of claim 1, wherein the operations further comprise generating an image associated with the second data elements.

3. The storage medium of claim 2, wherein the operation of generating an image associated with the second data elements comprises applying a texture to a surface, the texture being associated with the plurality of second data elements.

4. The storage medium of claim 3, wherein the operations further comprise updating the texture to account for one of a motion of the surface or a motion of a viewpoint.

5. The storage medium of claim 1, wherein the at least one characteristic of the at least one object is at least one of a viewpoint, an illumination, or a pixel.

6. The storage medium of claim 1, wherein the first data elements are defined by at least two primitives.

7. The storage medium of claim 5, wherein the primitives include at least one of an identity of an object, a viewpoint, an illumination, or a pixel.

8. The storage medium of claim 6, wherein the first data elements form a tensor organized based on the primitives.

9. The storage medium of claim 1, wherein the second data elements are defined by at least two primitives.

10. The storage medium of claim 1, wherein the object descriptor is obtained using an n-mode orthonormal decomposition procedure.

11. A storage medium including a software program for identifying a sample object based upon a sample object descriptor, wherein the software program, when executed by a processing arrangement, is configured to cause the processing arrangement to execute the operations comprising:

collecting a plurality of data elements which are defined by at least two primitives;

obtaining at least one of a plurality of object descriptors based on the information of the data elements; and

comparing the sample object descriptor to at least one of the object descriptors for determining whether the sample object descriptor is identifiable as one of the object descriptors, wherein each of the object descriptors is associated with a respective one of a plurality of objects, wherein the sample object is one of an identity of an object, a viewpoint, an illumination, and a pixel.

12. The storage medium of claim 11, wherein the first primitives include at least one of an identity of an object, a viewpoint, an illumination, and a pixel.

13. The storage medium of claim 11, wherein the second primitives include at least one of an identity of an object, a viewpoint, an illumination, and a pixel.

14. The storage medium of claim 11, wherein the first data elements form a tensor organized based on the first primitives.

15. The storage medium of claim 11, wherein the second data elements form a tensor organized based on the second primitives.

16. The storage medium of claim 11, wherein each of the object descriptors and the sample object descriptor are obtained using an n-mode single value decomposition procedure.

17. The storage medium of claim 11, wherein a magnitude of the sample object descriptor is compared to respective magnitudes of the object descriptors to determine whether the sample object is potentially identifiable as one of the objects.

18. A storage medium storing a software program that is adapted for generating an object descriptor, wherein the software program, when executed by a processing arrangement, is configured to cause the processing arrangement to execute the operations comprising:

collecting a plurality of data elements which are defined by at least two primitives; and

obtaining the object descriptor based on the information of the data elements using an n-mode orthonormal decomposition process.

19. The storage medium of claim 18, wherein the object descriptor is one of an identity of an object, a viewpoint, an illumination, or a pixel.

20. The storage medium of claim 18, wherein the n-mode orthonormal decomposition procedure is an n-mode singular value decomposition procedure.

21. The storage medium of claim 20, wherein the n-mode singular value decomposition procedure is capable of decomposing the tensor into a core tensor and at least two orthonormal matrices.

22. The storage medium of claim 18, wherein the object descriptor is a texture of an object.

23. A storage medium storing a software program for reducing a dimensionality of one of at least two object descriptors, wherein the software program, when executed by a processing arrangement, is configured to cause the processing arrangement to execute the operations comprising:

collecting a plurality of data elements which are defined by at least two primitives;

obtaining the one of the object descriptors based on the information of the data elements; and

reducing the dimensionality of the one of the object descriptors, wherein the one of the object descriptors is one of an identity of an object, a viewpoint, an illumination, and a pixel.

24. The storage medium of claim 23, wherein each of the object descriptors except for the one of the object descriptors having the reduced dimensionality maintain full dimensionality.

25. The storage medium of claim 23, wherein the data elements form a tensor organized based on the primitives.

26. The storage medium of claim 23, wherein the one of the at least two object descriptors is obtained using an n-mode single value decomposition procedure.

27. The storage medium of claim 23, wherein the dimensionality of the one of the object descriptors is reduced using an n-mode orthogonal iteration procedure.