Data storage and retrieval system with parameterized category definitions for families of categories and dynamically generated search indices

• US 20060161579A1
• Filed: 08/17/2005
• Published: 07/20/2006
• Est. Priority Date: 01/20/2005
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: Pi Corp. (Dell Technologies Inc.)
• Inventors: Venguerov, Mark
• Granted Patent: US 7,480,674 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2272 Management thereof
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99936 Pattern matching access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

A data storage and retrieval system with parameterized category definitions and dynamically generated search indices. A parameterized category definition for a family of categories is obtained consisting of a parameterized predicate, such that parameter values can be provided with a search query to identify information items that match a category within the family of categories. The parameterized category definition is divided into a parameterized part and a static part. The static part is used to create associations between information items and the family of categories. The disclosed system processes the parameterized part of the category family definition to dynamically generate one or more search indices. The disclosed system determines whether any existing indices match the parameters of the parameterized part, and can accordingly be re-used. In the case where one or more indices are missing that are needed to support the parameterized part of the category family definition, the disclosed system operates to create them based on information items associated with the family of categories based on the static part of the parameterized category definition. Queries supplying values for the parameters of the parameterized category definition for the family of categories are subsequently processed to identify information items belonging to specific, dynamically defined categories within the family of categories.

Claims

1. A method of providing categories for information items stored in an information storage and retrieval system, comprising:

obtaining a parameterized category definition for a family of categories;

logically separating a parameterized part of said parameterized category definition from a static part of said parameterized category definition;

associating those of said information items matching said static part of said parameterized category definition with said family of categories;

generating at least one search index associating those of said information items associated with said family of categories and having properties matching said parameterized part of said parameterized category definition with parameter values for said parameterized part of said parameterized category definition;

obtaining a search query including an indication of said family of categories and parameter values for said parameterized part; and

determining, responsive to said indication of said family of categories, said parameter values of said parameterized part, and said at least one search index, which of said information items match said search query.

2. The method of claim 1, wherein said generating said at least one search index comprises identifying one or more existing search indices matching at least a portion of said parameterized part of said parameterized category definition and sharing said existing search indices with another family of categories.

3. The method of claim 1, wherein said generating said at least one search index comprises dynamically creating at least one index by, at least in part, indexing said information items associated with said family of categories to determine which of said information items associated with said family of categories match said parameterized part of said parameterized category definition.

4. The method of claim 1, wherein said obtaining said parameterized category definition comprises obtaining said parameterized family definition at run time from a separate application program.

5. The method of claim 1, wherein said parameterized category definition comprises a parameterized predicate, wherein said parameterized predicate, in combination with a set of dynamically obtained parameter values for said parameterized part, provides a test for an information item to which said parameterized predicate is applied, the result of which indicates whether said information item is a member of a dynamically defined category defined by said category family definition and said parameter values.

6. The method of claim 1, further comprising:

converting said parameterized predicate into a conjunctive normal form logical representation; and

dividing said parameterized predicate into a static part and a parameterized part.

7. A system including a computer readable medium, said computer readable medium having a computer program stored thereon for providing categories for information items stored in an information storage and retrieval system, said computer program comprising:

program code for obtaining a parameterized category definition for a family of categories;

program code for logically separating a parameterized part of said parameterized category definition from a static part of said parameterized category definition;

program code for associating those of said information items matching said static part of said parameterized category definition with said family of categories;

program code for generating at least one search index associating those of said information items associated with said family of categories and having properties matching said parameterized part of said parameterized category definition with parameter values for said parameterized part of said parameterized category definition;

program code for obtaining a search query including an indication of said family of categories and parameter values for said parameterized part; and

program code for determining, responsive to said indication of said family of categories, said parameter values of said parameterized part, and said at least one search index, which of said information items match said search query.

8. The system of claim 7, wherein said program code for generating said at least one search index comprises:

program code for identifying one or more existing search indices matching at least a portion of said parameterized part of said parameterized category definition; and

program code for sharing said existing search indices with another family of categories.

9. The system of claim 7, wherein said program code for generating said at least one search index comprises program code for dynamically creating at least one index by, at least in part, indexing said information items associated with said family of categories to determine which of said information items associated with said family of categories match said parameterized part of said parameterized category definition.

10. The system of claim 7, wherein said program code for obtaining said parameterized category definition comprises program code for obtaining said parameterized family definition at run time from a separate application program.

11. The system of claim 7, wherein said parameterized category definition comprises a parameterized predicate, wherein said parameterized predicate, in combination with a set of dynamically obtained parameter values for said parameterized part, provides a test for an information item to which said parameterized predicate is applied, the result of which indicates whether said information item is a member of a dynamically defined category defined by said category family definition and said parameter values.

12. The system of claim 7, further comprising:

program code for converting said parameterized predicate into a conjunctive normal form logical representation; and

program code for dividing said parameterized predicate into a static part and a parameterized part.

13. A computer program product including a computer readable medium, said computer readable medium having stored thereon a computer program for providing categories for information items stored in an information storage and retrieval system, said computer program comprising:

program code for obtaining a parameterized category definition for a family of categories;

program code for logically separating a parameterized part of said parameterized category definition from a static part of said parameterized category definition;

program code for associating those of said information items matching said static part of said parameterized category definition with said family of categories;

program code for generating at least one search index associating those of said information items associated with said family of categories and having properties matching said parameterized part of said parameterized category definition with parameter values for said parameterized part of said parameterized category definition;

program code for obtaining a search query including an indication of said family of categories and parameter values for said parameterized part; and

program code for determining, responsive to said indication of said family of categories, said parameter values of said parameterized part, and said at least one search index, which of said information items match said search query.

14. A computer data signal embodied in a carrier wave, said computer data signal including at least one computer program for providing categories for information items stored in an information storage and retrieval system, said computer program comprising:

program code for obtaining a parameterized category definition for a family of categories;

program code for logically separating a parameterized part of said parameterized category definition from a static part of said parameterized category definition;

program code for associating those of said information items matching said static part of said parameterized category definition with said family of categories;

program code for generating at least one search index associating those of said information items associated with said family of categories and having properties matching said parameterized part of said parameterized category definition with parameter values for said parameterized part of said parameterized category definition;

program code for obtaining a search query including an indication of said family of categories and parameter values for said parameterized part; and

program code for determining, responsive to said indication of said family of categories, said parameter values of said parameterized part, and said at least one search index, which of said information items match said search query.

15. A system for providing categories for information items stored in an information storage and retrieval system, said computer program comprising:

program code for obtaining a parameterized category definition for a family of categories;

means for logically separating a parameterized part of said parameterized category definition from a static part of said parameterized category definition;

means for associating those of said information items matching said static part of said parameterized category definition with said family of categories;

means for generating at least one search index associating those of said information items associated with said family of categories and having properties matching said parameterized part of said parameterized category definition with parameter values for said parameterized part of said parameterized category definition;

means for obtaining a search query including an indication of said family of categories and parameter values for said parameterized part; and

means for determining, responsive to said indication of said family of categories, said parameter values of said parameterized part, and said at least one search index, which of said information items match said search query.