Performing data mining operations within a columnar database management system
First Claim
1. A method, comprising:
- receiving, by a columnar database management system from a client device over a network, a data mining request, the columnar database management system comprising stored columns of data, data mining operations, and a database engine, the data mining request containing a description of requested calculations and information about data items to be processed;
parsing, by the database engine, the description of the requested calculations, the parsing identifying a data mining operation of the data mining operations;
generating, by the database engine, a data mining processing plan for processing the data items specified by the data mining request, the generating comprising;
identifying, based on the data mining operation identified from the parsing or an internal table or data structure of the columnar database management system, any other data mining operation necessary to complete processing of the data mining request;
acquiring any resource needed for processing the data items indicated by the data mining request;
performing a pre-allocation procedure on any resource thus acquired; and
performing orchestration tasks, the orchestration tasks including a coordination procedure, the coordination procedure including determining an order of execution for different parts of identified data mining operations that are to be applied to the stored columns of data;
wherein the data mining processing plan thus generated by the database engine comprises the data items and the identified mining operations to be used, the order of execution in which the identified mining operations are to be executed, the resources to be used during execution, and a coordination of the identified data mining operations and the resources to be used during execution;
executing, by the database engine, the data mining processing plan, the executing producing data mining results; and
responsive to the data mining request, returning the data mining results for presentation on the client device.
2 Assignments
0 Petitions
Accused Products
Abstract
Data mining operations are performed within a columnar database management system. The columnar database management system stores input sets of data for a data mining operation. An input set of data is represented as a column of data in the columnar database management system. The columnar database management system stores instructions to perform one or more data mining operations for processing the input sets of data. The columnar database management system receives requests for performing data mining operations and performs the processing of the data mining operation within the columnar database management system. As a result, the processing of data mining operations is performed without requiring multiple data transfers between an application implementing the data mining operations and the columnar database management system.
37 Citations
20 Claims
-
1. A method, comprising:
-
receiving, by a columnar database management system from a client device over a network, a data mining request, the columnar database management system comprising stored columns of data, data mining operations, and a database engine, the data mining request containing a description of requested calculations and information about data items to be processed; parsing, by the database engine, the description of the requested calculations, the parsing identifying a data mining operation of the data mining operations; generating, by the database engine, a data mining processing plan for processing the data items specified by the data mining request, the generating comprising; identifying, based on the data mining operation identified from the parsing or an internal table or data structure of the columnar database management system, any other data mining operation necessary to complete processing of the data mining request; acquiring any resource needed for processing the data items indicated by the data mining request; performing a pre-allocation procedure on any resource thus acquired; and performing orchestration tasks, the orchestration tasks including a coordination procedure, the coordination procedure including determining an order of execution for different parts of identified data mining operations that are to be applied to the stored columns of data; wherein the data mining processing plan thus generated by the database engine comprises the data items and the identified mining operations to be used, the order of execution in which the identified mining operations are to be executed, the resources to be used during execution, and a coordination of the identified data mining operations and the resources to be used during execution; executing, by the database engine, the data mining processing plan, the executing producing data mining results; and responsive to the data mining request, returning the data mining results for presentation on the client device. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A columnar database management system, comprising:
-
a processor; a non-transitory computer-readable medium; stored columns of data embodied on the non-transitory computer-readable medium; data mining operations embodied on the non-transitory computer-readable medium; and stored instructions embodied on the non-transitory computer-readable medium and translatable by the processor to implement a database engine for processing a data mining request received from a client device over a network, the data mining request containing a description of requested calculations and information about data items to be processed, the processing by the database engine comprising; parsing the description of the requested calculations, the parsing identifying a data mining operation of the data mining operations; generating a data mining processing plan for processing the data items specified by the data mining request, the generating comprising; identifying, based on the data mining operation identified from the parsing or an internal table or data structure of the columnar database management system, any other data mining operation necessary to complete processing of the data mining request; acquiring any resource needed for processing the data items indicated by the data mining request; performing a pre-allocation procedure on any resource thus acquired; and performing orchestration tasks, the orchestration tasks including a coordination procedure, the coordination procedure including determining an order of execution for different parts of identified data mining operations that are to be applied to the stored columns of data; wherein the data mining processing plan thus generated by the database engine comprises the data items and the identified mining operations to be used, the order of execution in which the identified mining operations are to be executed, the resources to be used during execution, and a coordination of the identified data mining operations and the resources to be used during execution; executing the data mining processing plan, the executing producing data mining results; and responsive to the data mining request, returning the data mining results for presentation on the client device. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer program product comprising a non-transitory computer-readable medium storing instructions translatable by a processor of a columnar database management system for:
-
receiving a data mining request received from a client device over a network, the columnar database management system comprising stored columns of data and data mining operations, the data mining request containing a description of requested calculations and information about data items to be processed; parsing the description of the requested calculations, the parsing identifying a data mining operation of the data mining operations; generating a data mining processing plan for processing the data items specified by the data mining request, the generating comprising; identifying, based on the data mining operation identified from the parsing or an internal table or data structure of the columnar database management system, any other data mining operation necessary to complete processing of the data mining request; acquiring any resource needed for processing the data items indicated by the data mining request; performing a pre-allocation procedure on any resource thus acquired; and performing orchestration tasks, the orchestration tasks including a coordination procedure, the coordination procedure including determining an order of execution for different parts of identified data mining operations that are to be applied to the stored columns of data; wherein the data mining processing plan thus generated by the database engine comprises the data items and the identified mining operations to be used, the order of execution in which the identified mining operations are to be executed, the resources to be used during execution, and a coordination of the identified data mining operations and the resources to be used during execution; executing the data mining processing plan, the executing producing data mining results; and responsive to the data mining request, returning the data mining results for presentation on the client device. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification