Non-negative matrix factorization from the data in the multi-dimensional data table using the specification and to store metadata representing the built relational database management system

• US 7,734,652 B2
• Filed: 08/27/2004
• Issued: 06/08/2010
• Est. Priority Date: 08/29/2003
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Milenova, Boriana L., Tamayo, Pablo, Tang, George G., Jagannath, Mahesh K., Kuntala, Pavani, McCracken, Mark A., Campos, Marcos M., Yarmus, Joseph S.
• Primary Examiner(s): CHANNAVAJJALA, SRIRAMA T
• Application Number:
  US10/927,083
• Publication Number:
  US 20050246354A1
• Time in Patent Office: 2,111 Days
• Field of Search: 707 1- 3, 707 9- 10, 707100-101, 707/600, 707/790, 707/792, 707/810, 706 45- 50
• US Class Current: 707/792
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

An implementation of NMF functionality integrated into a relational database management system provides the capability to apply NMF to relational datasets and to sparse datasets. A database management system comprises a multi-dimensional data table operable to store data and a processing unit operable to perform non-negative matrix factorization on data stored in the multi-dimensional data table and to generate a plurality of data tables, each data table being smaller than the multi-dimensional data table and having reduced dimensionality relative to the multi-dimensional data table. The multi-dimensional data table may be a relational data table.

Claims

1. A database management system comprising:

a processor to execute computer program instructions and process data;

a memory to store the computer program instructions executable by the processor and a multi-dimensional data table to store data; and

computer program instructions stored in the memory and executable to generate a plurality of data tables from the data stored in the multi-dimensional data table using non-negative matrix factorization, wherein each one of the plurality of data tables is an approximate factor of the multi-dimensional data table;

wherein the computer program instructions are further executable to implement;

a server application programming interface to provide an interface to client software to construct a specification for a relational database model including non-negative matrix factorization model as the result of a build task performed by a build unit;

the build unit to build the relational database model including non-negative matrix factorization from the data in the multi-dimensional data table using the specification and to store metadata representing the built relational database model including non-negative matrix factorization in a database; and

an apply unit to apply the relational database model including non-negative matrix factorization stored in the database to the data in the multi-dimensional data table, wherein at least one of the build unit and the apply unit is operable to un-nest nested table columns in the multi-dimensional data table and to explode categorical attributes in the multi-dimensional data table into a series of binary attributes.

2. The database management system of claim 1, wherein the multi-dimensional data table is a relational data table.

3. The database management system of claim 1, wherein the build unit comprises a table function.

4. The database management system of claim 1, wherein the build unit comprises kernel code.

5. The database management system of claim 1, wherein the apply unit comprises a table function.

6. The database management system of claim 1, wherein the apply unit comprises kernel code.

7. The database management system of claim 1, wherein the multi-dimensional data table is a relational data table.

8. A method of operating a database management system comprising a processor to execute computer program instructions and process data, a memory to store the computer program instructions executable by the processor and computer program instructions stored in the memory and executable to perform the steps of:

storing data in a multi-dimensional data table; and

generating a plurality of data tables from the data stored in the multi-dimensional data table using non-negative matrix factorization, wherein each one of the plurality of data tables is an approximate factor of the multi-dimensional data table;

providing a server application programming interface to provide an interface to client software to construct a specification for a relational database model including non-negative matrix factorization as the result of a build task;

performing a build task to build the relational database model including non-negative matrix factorization from the data in the multi-dimensional data table using the specification and to store metadata representing the built relational database model including non-negative matrix factorization in a database; and

performing an apply task to apply the relational database model including non-negative matrix factorization stored in the database to the data in the multi-dimensional data table, wherein at least one of the building step and the applying step comprises;

un-nesting nested table columns in the multi-dimensional data table; and

exploding categorical attributes in the multi-dimensional data table into a series of binary attributes.

9. The method of claim 8, wherein the multi-dimensional data table is a relational data table.

10. The method of claim 9, wherein the non-negative matrix factorization model is built using a table function.

11. The method of claim 9, wherein the non-negative matrix factorization model is built using kernel code.

12. The method of claim 9, wherein the non-negative matrix factorization model is applied using a table function.

13. The method of claim 9, wherein the non-negative matrix factorization model is applied using kernel code.

14. The method of claim 9, wherein the multi-dimensional data table is a relational data table.

15. A computer program product for operating a database management system comprising a processor to execute computer program instructions and process data, and a memory to store the computer program instructions executable by the processor, the computer program product comprising a computer readable recordable-type storage medium, and computer program instructions, recorded on the computer readable recordable-type storage medium, executable by a processor, for performing the steps of:

storing data in a multi-dimensional data table; and

generating a plurality of data tables from the data stored in the multi-dimensional data table using non-negative matrix factorization, wherein each one of the plurality of data tables is an approximate factor of the multi-dimensional data table;

providing a server application programming interface to provide an interface to client software to construct a specification for a relational database model including non-negative matrix factorization as the result of a build task;

performing a build task to build the relational database model including non-negative matrix factorization from the data in the multi-dimensional data table using the specification and to store metadata representing the built relational database model including non-negative matrix factorization in a database; and

performing an apply task to apply the relational database model including non-negative matrix factorization stored in the database to the data in the multi-dimensional data table, wherein at least one of the building step and the applying step comprises;

un-nesting nested table columns in the multi-dimensional data table; and

exploding categorical attributes in the multi-dimensional data table into a series of binary attributes.

16. The computer program product of claim 15, wherein the multi-dimensional data table is a relational data table.

17. The computer program product of claim 15, wherein the non-negative matrix factorization model is built using a table function.

18. The computer program product of claim 15, wherein the non-negative matrix factorization model is built using kernel code.

19. The computer program product of claim 15, wherein the non-negative matrix factorization model is applied using a table function.

20. The computer program product of claim 15, wherein the non-negative matrix factorization model is applied using kernel code.

21. The computer program product of claim 15, wherein the multi-dimensional data table is a relational data table.