Apparatus and method to improve compression and storage data

• US 9,736,081 B2
• Filed: 06/04/2015
• Issued: 08/15/2017
• Est. Priority Date: 06/04/2015
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Vishnyakov, Andrew
• Primary Examiner(s): DUONG, CHRISTINE T
• Application Number:
  US14/730,854
• Publication Number:
  US 20160359760A1
• Time in Patent Office: 803 Days
• Field of Search: None
• CPC Class Codes: H04L 1/00 Arrangements for detecting or preventing errors in the information received correcting synchronisation H04L7/00
• CPC Class Codes: H04L 47/2483 involving identification of individual flows
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate

Abstract

Methods, computer-readable media and apparatuses to improve storage and compression of data are disclosed. A processor receives a data stream, wherein the data stream comprises multiplexed data from a plurality of different sources, analyzes the data stream to identify a source of the plurality of different sources for each block of data of the data stream, demultiplexes the data stream based on the source of the each block of data of the data stream and applies a compression to the data stream that is demultiplexed based on the source of the each block of data of the data stream.

Claims

1. A method, comprising:

receiving, by a processor, a data stream, wherein the data stream comprises blocks of data that are multiplexed from a plurality of different source devices;

analyzing, by the processor, the data stream to identify a source device of the plurality of different source devices for each of the blocks of data of the data stream;

demultiplexing, by the processor, the data stream based on the source device of the each of the blocks of data of the data stream;

identifying, by the processor, a common dimension between blocks of data of the data stream from a common source device;

estimating, by the processor, a density of the blocks of data of the data stream from the common source device that have the common dimension;

combining, by the processor, the blocks of data of the data stream from the common source device that have the common dimension when the density that is estimated is greater than a predefined threshold; and

applying, by the processor, a compression to the data stream that is demultiplexed based on the source device of the each of the blocks of data of the data stream and the blocks of data of the data stream from the common source device that have the common dimension and that are combined.

2. The method of claim 1, wherein the compression comprises a predictive coding or an arithmetic coding.

3. The method of claim 1, wherein the data stream comprises different types of data having different dimensions.

4. The method of claim 1, further comprising:

writing, by the processor, the data stream that is compressed to a file system.

5. A non-transitory computer-readable medium storing instructions which, when executed by a processor, cause the processor to perform operations, the operations comprising:

receiving a data stream, wherein the data stream comprises blocks of data that are multiplexed from a plurality of different source devices;

analyzing the data stream to identify a source device of the plurality of different source devices for each of the blocks of data of the data stream;

demultiplexing the data stream based on the source device of the each of the blocks of data of the data stream;

identifying a common dimension between the blocks of data of the data stream from a common source device;

estimating a density of the blocks of data of the data stream from the common source device that have the common dimension;

combining the blocks of data of the data stream from the common source device that have the common dimension when the density that is estimated is greater than a predefined threshold; and

applying a compression to the data stream that is demultiplexed based on the source device of the each of the blocks of data of the data stream.

6. The non-transitory computer-readable medium of claim 5, wherein the compression comprises a predictive coding or an arithmetic coding.

7. The non-transitory computer-readable medium of claim 5, wherein the data stream comprises different types of data having different dimensions.

8. The non-transitory computer-readable medium of claim 5, the operations further comprising:

writing the data stream that is compressed to a file system.

9. An apparatus, comprising:

a processor; and

a computer-readable storage device storing a plurality of instructions which, when executed by the processor, cause the processor to perform operations, the operations comprising;

receiving a data stream, wherein the data stream comprises blocks of data that are multiplexed from a plurality of different source devices;

analyzing the data stream to identify a source device of the plurality of different source devices for each of the blocks of data of the data stream;

demultiplexing the data stream based on the source device of the each of the blocks of data of the data stream;

identifying a common dimension between the blocks of data of the data stream from a common source device;

estimating a density of the blocks of data of the data stream from the common source device that have the common dimension;

combining the blocks of data of the data stream from the common source device that have the common dimension when the density that is estimated is greater than a predefined threshold; and

applying a compression to the data stream that is demultiplexed based on the source device of the each of the blocks of data of the data stream.

10. The apparatus of claim 9, wherein the compression comprises a predictive coding or an arithmetic coding.

11. The apparatus of claim 9, wherein the data stream comprises different types of data having different dimensions.

12. The apparatus of claim 9, the operations further comprising:

writing the data stream that is compressed to a file system.