Surface light field decomposition using non-negative factorization

• US 20040249615A1
• Filed: 12/21/2001
• Published: 12/09/2004
• Est. Priority Date: 12/21/2001
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Grzeszczuk, Radek, Bouget, Jean-Yves, Chu, Michael H.
• Granted Patent: US 7,062,419 B2
• Time in Patent Office: Days
• US Class Current: 703/2
• CPC Class Codes: G06F 17/16 Matrix or vector computation , e.g. matrix-matrix or matrix-vector multiplication, matrix factorization matrix transposition G06F7/78
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: G06T 9/20 Contour coding, e.g. using detection of edges

Abstract

A system and method are provided for compressing a graphical representation that describes the appearance of an object from a plurality of viewing directions. Compressing includes accessing the graphical representation, removing redundant descriptive information from the graphical representation using sign consistent matrix factorization and approximation techniques, and representing the remaining information for efficient rendering, such as rendering with hardware-assisted computation.

Claims

1. A method comprising:

accessing a first multi-dimensional graphical matrix representation that describes the appearance of a plurality of points of an object from a plurality of viewing directions, the appearance varying from point to point and viewing direction to viewing direction;

creating a second graphical representation that approximates the first graphical representation and that includes at least one expression having a fewer dimensions than the first multi-dimensional graphical representation by decomposing the first multi-dimensional graphical representation into the second graphical representation, the decomposing including sign consistent matrix factorization to selectively represent information from the first graphical representation.

2. The method of claim 1, wherein the sign consistent matrix factorization comprises non-negative matrix factorization.

3. The method of claim 1, wherein the sign consistent matrix factorization comprises alternating sign matrix factorization.

4. The method of claim 1, further comprising:

accessing a third multi-dimensional graphical representation that describes the appearance of a second plurality of points of the object from a plurality of viewing directions, the second plurality of points including the first plurality of points, and the appearance varying from point to point and viewing direction to viewing direction; and

partitioning the third multi-dimensional graphical representation into a plurality of smaller multi-dimensional graphical representations each associated with a primitive of a polygonal representation of the geometry of the object, the plurality of smaller multi-dimensional graphical representations including the first multi-dimensional graphical representation.

16. The system of claim 1, further comprising:

a submodule of the hardware module that accesses a third multi-dimensional graphical representation that describes the appearance of a second plurality of points of the object from a plurality of viewing directions, the second plurality of points including the first plurality of points, and the appearance varying from point to point and viewing direction to viewing direction; and

further partitions the third multi-dimensional graphical representation into a plurality of smaller multi-dimensional graphical representations each associated with a primitive of a polygonal representation of the geometry of the object, the plurality of smaller multi-dimensional graphical representations including the first multi-dimensional graphical representation.

5. A machine-readable medium having stored thereon data representing sequences of instructions that when executed cause a machine to perform operations comprising:

access of a first multi-dimensional graphical matrix representation that describes the appearance of a plurality of points of an object from a plurality of viewing directions, the appearance varying from point to point and viewing direction to viewing direction;

creation of a second graphical representation that approximates the first graphical representation and that includes at least one expression having a fewer dimensions than the first multi-dimensional graphical representation by decomposing the first multi-dimensional graphical representation into the second graphical representation, the decomposing including sign consistent matrix factorization to selectively represent information from the first graphical representation.

6. A machine-readable medium of claim 5 having stored thereon data representing sequences of instructions that when executed cause a machine to perform operations comprising a non-negative matrix factorization when performing the sign consistent matrix factorization.

7. A machine-readable medium of claim 5 having stored thereon data representing sequences of instructions that when executed cause a machine to perform operations comprising an alternating sign matrix factorization when performing the sign consistent matrix factorization.

8. A machine-readable medium of claim 5 having stored thereon data representing sequences of instructions that when executed cause a machine to perform operations comprising

access of a third multi-dimensional graphical representation that describes the appearance of a second plurality of points of the object from a plurality of viewing directions, the second plurality of points including the first plurality of points, and the appearance varying from point to point and viewing direction to viewing direction;

and

partition of the third multi-dimensional graphical representation into a plurality of smaller multi-dimensional graphical representations each associated with a primitive of a polygonal representation of the geometry of the object, the plurality of smaller multi-dimensional graphical representations including the first multi-dimensional graphical representation.

9. A data structure comprising

at least a first portion and a second portion, the second portion including a second plurality of view-dependent subportions including a first view-dependent matrix that corresponds to a first viewing direction and a second view-dependent matrix that corresponds to a second viewing direction, wherein the first portion and the first view-dependent subportion are combinable using multitexturing hardware that allows multiple textures to be concurrently applied to a primitive in a single rendering pass to display a plurality of points of an object with a first appearance corresponding to a first viewing direction, and wherein the first portion and the second view-dependent subportion are linearly combinable using the multitexturing hardware and a sign consistent matrix factorization to display the plurality of points of the object with a second appearance corresponding to a second viewing direction.

10. The data structure of claim 9, wherein the data structure is derived from a plurality of images acquired for the object by selectively representing information from the plurality of images that is important to describe the appearance of the object and selectively removing information from the plurality of images that is redundant.

11. The data structure of claim 9, wherein the first portion and the first view-dependent subportion are combinable without decompression using the multitexturing hardware.

12. The data structure of claim 9, wherein the first portion and the second portion are created by decompressing a corresponding compressed first portion and a corresponding compressed second portion of another data structure.

13. A system comprising

a hardware module that accesses a first multi-dimensional graphical matrix representation that describes the appearance of a plurality of points of an object from a plurality of viewing directions, the appearance varying from point to point and viewing direction to viewing direction;

a matrix multiplication module in the hardware module that computes a second graphical representation that approximates the first graphical representation and that includes at least one expression having a fewer dimensions than the first multi-dimensional graphical representation by decomposing the first multi-dimensional graphical representation into the second graphical representation, the decomposing including sign consistent matrix factorization to selectively represent information from the first graphical representation.

14. The system of claim 13, wherein the sign consistent matrix factorization comprises non-negative matrix factorization.

15. The system of claim 13, wherein the sign consistent matrix factorization comprises alternating sign matrix factorization.