Apparatus and method to improve compression and storage of data

• US 10,171,367 B2
• Filed: 08/14/2017
• Issued: 01/01/2019
• Est. Priority Date: 06/04/2015
• Status: Expired due to Fees

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Vishnyakov, Andrew
• Primary Examiner(s): Duong, Christine T
• Application Number:
  US15/676,733
• Publication Number:
  US 20180013688A1
• Time in Patent Office: 505 Days
• Field of Search: None
• CPC Class Codes: H04L 1/00 Arrangements for detecting or preventing errors in the information received correcting synchronisation H04L7/00
• CPC Class Codes: H04L 47/2483 involving identification of individual flows
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate

Abstract

Methods, computer-readable media and apparatuses to improve storage and compression of data are disclosed. A processor receives a data stream, wherein the data stream comprises multiplexed data from a plurality of different sources, analyzes the data stream to identify a source of the plurality of different sources for each block of data of the data stream, demultiplexes the data stream based on the source of the each block of data of the data stream and applies a compression to the data stream that is demultiplexed based on the source of the each block of data of the data stream.

Claims

1. A method comprising:

receiving, by a processor, a data stream, wherein the data stream comprises multiplexed data from a plurality of different source devices, wherein the plurality of different source devices comprises different types of devices, wherein the data stream comprises blocks of data;

analyzing, by the processor, the data stream to identify a source device of the plurality of different source devices for each of the blocks of data of the data stream;

demultiplexing, by the processor, the data stream based on the source device of the each of the blocks of data of the data stream;

identifying, by the processor, a common dimension between the blocks of data of the data stream from a common source device;

estimating, by the processor, a density of the blocks of data of the data stream from the common source device that have the common dimension;

combining, by the processor, the blocks of data of the data stream from the common source device that have the common dimension when the density is greater than a predefined threshold;

applying, by the processor, a compression to the blocks of data of the data stream that are combined.

2. The method of claim 1, wherein the compression comprises a predictive coding or an arithmetic coding.

3. The method of claim 1, wherein the data stream comprises different types of data having different dimensions.

4. The method of claim 1, further comprising:

writing, by the processor, the blocks of data that are compressed to a file system.

5. A non-transitory computer-readable medium storing instructions which, when executed by a processor, cause the processor to perform operations, the operations comprising:

receiving a data stream, wherein the data stream comprises multiplexed data from a plurality of different source devices, wherein the plurality of different source devices comprises different types of devices, wherein the data stream comprises blocks of data;

analyzing the data stream to identify a source device of the plurality of different source devices for each of the blocks of data of the data stream;

demultiplexing the data stream based on the source device of the each of the blocks of data of the data stream;

identifying a common dimension between the blocks of data of the data stream from a common source device;

estimating a density of the blocks of data of the data stream from the common source device that have the common dimension;

combining the blocks of data of the data stream from the common source device that have the common dimension when the density is greater than a predefined threshold;

applying a compression to the blocks of data of the data stream that are combined.

6. The non-transitory computer-readable medium of claim 5, wherein the compression comprises a predictive coding or an arithmetic coding.

7. The non-transitory computer-readable medium of claim 5, wherein the data stream comprises different types of data having different dimensions.

8. The non-transitory computer-readable medium of claim 5, the operations further comprising:

writing the blocks of data that are compressed to a file system.

9. An apparatus comprising:

a processor; and

a computer-readable storage device storing a plurality of instructions which, when executed by the processor, cause the processor to perform operations, the operations comprising;

receiving a data stream, wherein the data stream comprises multiplexed data from a plurality of different source devices, wherein the plurality of different source devices comprises different types of devices, wherein the data stream comprises blocks of data;

analyzing the data stream to identify a source device of the plurality of different source devices for each of the blocks of data of the data stream;

demultiplexing the data stream based on the source device of the each of the blocks of data of the data stream;

identifying a common dimension between the blocks of data of the data stream from a common source device;

estimating a density of the blocks of data of the data stream from the common source device that have the common dimension;

combining the blocks of data of the data stream from the common source device that have the common dimension when the density is greater than a predefined threshold;

applying a compression to the blocks of data of the data stream that are combined.

10. The apparatus of claim 9, wherein the compression comprises a predictive coding or an arithmetic coding.

11. The apparatus of claim 9, wherein the data stream comprises different types of data having different dimensions.

12. The apparatus of claim 9, the operations further comprising:

writing the blocks of data that are compressed to a file system.