SYSTEM, METHODS, AND MEDIA FOR COMPRESSING NON-RELATIONAL DATABASE OBJECTS

• US 20140052762A1
• Filed: 10/28/2013
• Published: 02/20/2014
• Est. Priority Date: 09/28/2010
• Status: Active Grant

• Current Assignee: Redis SRL
• Original Assignee: Redis Labs, Inc. (Redis Ltd.)
• Inventors: Shoolman, Yiftach, Bengal, Ofer
• Granted Patent: US 9,727,629 B2
• Time in Patent Office: Days
• US Class Current: 707/803
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/214 Database migration support
• CPC Class Codes: G06F 16/28 Databases characterised by their database models, e.g. relational or object models
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/289 Object oriented databases
• CPC Class Codes: H03M 7/3088 employing the use of a dictionary, e.g. LZ78
• CPC Class Codes: H03M 7/707 Structured documents, e.g. XML

Abstract

Method, media, and systems for compressing objects, comprising: receiving a request to write a first object including a first key and a first value, wherein the first object is of a given type; receiving a request to write a second object including a second key and a second value, wherein the second object is of the given type; classifying the first object to a compression dictionary according to at least one rule based on a value of the first object and/or the key of the first object; classifying the second object to the compression dictionary according to at least one rule based on a value of the second object and/or the key of the second object; and compressing the first object and the second object based on the compression dictionary.

Claims

1. A method for compressing objects, comprising:

receiving a request to write a first object including a first key and a first value, wherein the first object is of a given type;

receiving a request to write a second object including a second key and a second value, wherein the second object is of the given type;

classifying the first object to a compression dictionary according to at least one rule based on a value of the first object and/or the key of the first object;

classifying the second object to the compression dictionary according to at least one rule based on a value of the second object and/or the key of the second object; and

compressing the first object and the second object based on the compression dictionary.

2. The method of claim 1, further comprising automatically identifying classification rules for classifying objects.

3. The method of claim 1, further comprising writing the first object to in-memory, non-relational data store as an uncompressed object before the first object is compressed, and overwriting the uncompressed object with a compressed form of the first objected when the first object is compressed.

4. The method of claim 3, further comprising determining when multiple uncompressed versions of an object have been written to in-memory, non-relational data store before the compressed form of a first of the versions has been formed, and preventing the compressed form from overwriting a subsequent version of the object written to in-memory, non-relational data store.

5. The method of claim 1, further comprising removing an object from in-memory, non-relational storage if it has been expired or based on total hits on the object during a predefined period and an amount of time since the object was last requested.

6. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for compressing objects, the method comprising:

receiving a request to write a first object including a first key and a first value, wherein the first object is of a given type;

receiving a request to write a second object including a second key and a second value, wherein the second object is of the given type;

classifying the first object to a compression dictionary according to at least one rule based on a value of the first object and/or the key of the first object;

classifying the second object to the compression dictionary according to at least one rule based on a value of the second object and/or the key of the second object; and

compressing the first object and the second object based on the compression dictionary.

7. The non-transitory medium of claim 6, the method further comprising automatically identifying classification rules for classifying objects.

8. The non-transitory medium of claim 6, the method further comprising writing the first object to in-memory, non-relational data store as an uncompressed object before the first object is compressed, and overwriting the uncompressed object with a compressed form of the first objected when the first object is compressed.

9. The non-transitory medium of claim 8, the method further comprising determining when multiple uncompressed versions of an object have been written to in-memory, non-relational data store before the compressed form of a first of the versions has been formed, and preventing the compressed form from overwriting a subsequent version of the object written to in-memory, non-relational data store.

10. The non-transitory medium of claim 6, the method further comprising removing an object from in-memory, non-relational storage if it has been expired or based on total hits on the object during a predefined period and an amount of time since the object was last requested.

11. A system for compressing objects, comprising:

at least one hardware processor that;

receives a request to write a first object including a first key and a first value, wherein the first object is of a given type;

receives a request to write a second object including a second key and a second value, wherein the second object is of the given type;

classifies the first object to a compression dictionary according to at least one rule based on a value of the first object and/or the key of the first object;

classifies the second object to the compression dictionary according to at least one rule based on a value of the second object and/or the key of the second object; and

compresses the first object and the second object based on the compression dictionary.

12. The system of claim 11, wherein the at least one hardware processor also automatically identifies classification rules for classifying objects.

13. The system of claim 11, wherein the at least one hardware processor also writes the first object to an in-memory, non-relational data store as an uncompressed object before the first object is compressed, and overwrites the uncompressed object with a compressed form of the first object when the first object is compressed.

14. The system of claim 13, wherein the at least one hardware processor also determines when multiple uncompressed versions of an object have been written to the in-memory, non-relational data store before the compressed form of a first of the versions has been formed, and prevents the compressed form from overwriting a subsequent version of the object written to the in-memory, non-relational data store.

15. The system of claim 11, wherein the at least one hardware processor also removes an object from an in-memory, non-relational store when it has been expired or based on total hits on the object during a predefined period and an amount of time since the object was last requested.