System and method for encoding image data and other data types into one data format and decoding of same

• US 10,187,443 B2
• Filed: 10/16/2017
• Issued: 01/22/2019
• Est. Priority Date: 06/12/2017
• Status: Active Grant

• Current Assignee: C-Hear, Inc.
• Original Assignee: C-Hear, Inc.
• Inventors: Gong, Changhong, Gong, Charles, Collard-Harmon, Adena, Kadado, Taha, Collard, Jesse
• Primary Examiner(s): Zhang, Shirley X
• Application Number:
  US15/785,148
• Publication Number:
  US 20180359302A1
• Time in Patent Office: 463 Days
• Field of Search: None
• CPC Class Codes: G06F 16/116 Details of conversion of file system types or formats
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/176 Support for shared access to files; File sharing support
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 1/32128 attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2362 Generation or processing of Service Information [SI]
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format
• CPC Class Codes: H04N 2201/3261 of multimedia information, e.g. a sound signal

Abstract

A method for encoding data streams into a combined file and decoding of same, including accessing a first file having a first plurality of data bytes, accessing a second file having a second plurality of data bytes, combining the first file and the second file, comprising the steps of storing a block of data bytes of a first byte block size in the body of the combined file as a first file byte block, storing a block of data bytes of a second byte block size in the body of the combined file as a second file byte block, repeating the first and second storing steps to sequentially store all of the data bytes in the first file and the second file in the combined file, and decoding the combined file to separate the bytes of the first file and the bytes of the second file from the combined file.

Claims

1. A method of a codec for encoding data streams into a combined file, comprising:

accessing a first file including a first plurality of data bytes;

accessing a second file including a second plurality of data bytes; and

combining the first file and the second file to provide the combined file including only one header and one body, comprising the steps of;

in a first storing step, sequentially storing a first file byte block of a first byte block size in the body of the combined file, wherein the first file byte block includes one or more bytes of data from the first plurality of data bytes of the first file,

in a second storing step, sequentially storing a second file byte block of a second byte block size in the body of the combined file, wherein the second file byte block includes one or more bytes of data from the second plurality of data bytes of the second file,

repeating the first and second storing steps to sequentially store the first plurality of data bytes of the first file and the second plurality of data bytes of the second file in the body of the combined file,

wherein the first plurality of data bytes and the second plurality of data bytes are both stored in the one body of the combined file in association with only the one header separate from the body, and

wherein no byte block from the first file is stored adjacent another byte block from the first file, and no byte block from the second file is stored adjacent another byte block from the second file, and

storing, in the header of the combined file, a number of bytes of the first file and the second file, the first byte block size, and the second byte block size, wherein the first byte block size and the second byte block size are determined according to a file size relationship between the first file and the second file for use in a decoding process of the combined file.

2. The method of claim 1, wherein the first file is of a first file format and the second file is of a second file format.

3. The method of claim 2, wherein the first file is an image file and the second file is a non-image file.

4. The method of claim 1, wherein the first file byte block and the second file byte block are stored in sequential and adjacent storage locations in the combined file.

5. The method of claim 1, further comprising:

transferring the combined file to an application processing block to decode the combined file into the first and second files by the steps of;

reading the header to determine the first byte block size and the second byte block size,

sequentially accessing a first number of bytes corresponding to the first byte block size and a second number of bytes corresponding to the second byte block size, and

creating the first and second files with the accessed first number of bytes and the accessed second number of bytes, respectively.

6. The method of claim 1, further comprising calculating the first byte block size and the second byte block size in accordance with a ratio that is a number of bytes of the first file to a number of bytes of the second file.

7. The method of claim 1, further comprising calculating the first byte block size and the second byte block size, including:

determining which of the first file and the second file includes a greater number of bytes;

dividing a number of bytes of the first file or the second file that includes the greater number of bytes by the other one of the first file or the second file to produce a result;

determining if the result includes a remainder and, if so, rounding the result up to an integer that is a next integer up from the result; and

for the first file or the second file that includes the greater number of bytes, setting the first byte block size of the first file or the second byte block size of the second file to be equal to the integer.

8. The method of claim 7, wherein if a total number of data blocks in either of the first file or the second file causes, after all previous bytes in the first file or the second file are written, there to be a number of bytes left in either the first file or the second file that is, for the first file, less than the first byte block size, or, for the second file, less than the second byte block size, the method further comprises:

storing a partial byte block in the combined file, wherein the partial byte block is associated with one of the first file or the second file and wherein the partial byte block includes a number of data bytes less than the first byte block size or the second byte block size of the first file or the second file, respectively, that is associated with the partial byte block.

9. The method of claim 8, wherein calculating the first byte block size and the second byte block size further includes:

setting the second byte block size to one byte; and

determining if a speed multiplier is to be set and, if so, setting the speed multiplier, wherein the speed multiplier is a value to manipulate the first byte block size and the second byte block size to set the first byte block size to a result of the value multiplied by the first byte block size and to set the second byte block size to a result of the value multiplied by the second byte block size.

10. The method of claim 1, further comprising:

creating a plurality of combined files from a plurality of files in accordance with the first and second storing steps, and the repeating step; and

assembling each of the plurality of combined files into a binder file, wherein the binder file includes a number of combined files for simultaneous decoding and presentation.

11. A method of a codec for decoding a data stream of a combined file into separate data streams, comprising:

analyzing header data included in a header of the combined file, wherein the combined file includes only one header and includes both data from a first data stream of a first original file and data from a second data stream of a second original file in one body of the combined file in association with only the one header separate from the body;

reading from the header data a number of bytes of the first original file and the second original file, and a byte block size for each of a first data stream and a second data stream, wherein a byte block includes one or more bytes of data within a file, and wherein the byte block size for each of the first data stream and the second data stream are determined according to a file size relationship between the first original file and the second original file;

reading a first file byte block included in the combined file, wherein the first file byte block includes a number of bytes in the combined file corresponding to the byte block size for the first data stream read from the header of the combined file;

writing the first file byte block to a first file;

reading a second file byte block included in the combined file, wherein the second file byte block includes a number of bytes in the combined file corresponding to the byte block size for the second data stream read from the header of the combined file; and

writing the second file byte block to a second file.

12. The method of claim 11, wherein the first file is of a first file type and the second file is of a second file type.

13. The method of claim 12, wherein the first file is an image file and the second file is a non-image file.

14. The method of claim 11, further comprising:

determining if each byte included within the combined file has been read from the combined file and written to one of the first file or the second file; and

repeating, upon a determination that each of the bytes included within the combined file have not been written to one of the first file or the second file, the reading, writing, and determining steps.

15. The method of claim 11, wherein the byte block sizes for each of the first data stream and the second data stream are byte block sizes used during creation of the combined file.

16. The method of claim 11, further comprising:

receiving by the codec a binder file from a source over a network, wherein the binder file includes a plurality of combined files;

decoding the plurality of combined files into a plurality of data streams, wherein decoding of each combined file is performed in accordance with the analyzing, reading, and writing steps; and

simultaneously presenting each of the plurality of data streams in distinct portions of a screen of a computing device, wherein each of the plurality of data streams is of a different data type.

17. The method of claim 11, wherein the first file is a text file type and the second file is an audio file type, the method further comprising:

receiving by the codec the combined file from a source over a network;

determining that the first file decoded from the combined file includes textual user authentication information;

determining that the second file decoded from the combined file includes voice data;

comparing the textual user authentication information from the decoded first file to user credentials stored on a server;

performing speech recognition on the voice data from the decoded second file with speech data stored on the server in association with the user credentials; and

granting access to a resource if the voice data matches the speech data and if the textual user authentication information matches the user credentials.

18. A system for encoding data streams into a combined file and decoding the combined file into separate data streams, comprising:

a network interface coupled to a processor; and

a memory coupled to the processor,

the processor configured to;

access a first file including a first plurality of data bytes;

access a second file including a second plurality of data bytes; and

combine the first file and the second file to provide the combined file including only one header and one body, wherein, during combining, the processor is further configured to;

in a first storing step, sequentially store a first file byte block of a first byte block size in the body of the combined file, wherein the first file byte block includes one or more bytes of data from the first plurality of data bytes of the first file,

in a second storing step, sequentially store a second file byte block of a second byte block size in the body of the combined file, wherein the second file byte block includes one or more bytes of data from the second plurality of data bytes of the second file,

repeat the first and second storing steps to sequentially store the first plurality of data bytes of the first file and the second plurality of data bytes of the second file in the body of the combined file,

wherein the first plurality of data bytes and the second plurality of data bytes are both stored in the one body of the combined file in association with only the one header separate from the body, and

wherein no byte block from the first file is stored adjacent another byte block from the first file, and no byte block from the second file is stored adjacent another byte block from the second file, and

store, in the header, information relating to a number of bytes of the first file and the second file, the first byte block size, and the second byte block size, wherein the first byte block size and the second byte block size are determined according to a file size relationship between the first file and the second file for use in a decoding process of the combined file.

19. The system of claim 18, wherein the first file is of a first file format and the second file is of a second file format.

20. The system of claim 19, wherein the first file is an image file and the second file is a non-image file.

21. The system of claim 18, wherein the processor is further configured to:

calculate the first byte block size and the second byte block size, including;

determine which of the first file and the second file includes a greater number of bytes;

divide the number of bytes of the first file or the second file that includes the greater number of bytes by the other one of the first file or the second file to produce a result;

determine if the result includes a remainder and, if so, rounding the result up to an integer that is a next integer up from the result; and

for the first file or the second file that includes the greater number of bytes, set the first byte block size of the first file or the second byte block size of the second file to be equal to the integer.

22. The system of claim 18, wherein the processor is further configured to:

analyze header data included in the combined file;

calculate a byte block size for each of the first file and the second file based on byte block size data included in the header data;

read a combined file byte block included in the combined file, wherein the combined file byte block includes a number of bytes in the combined file corresponding to the byte block size calculated for the first file;

write the combined file byte block to a third file;

read a next combined file byte block included in the combined file, wherein the next combined file byte block includes a number of bytes in the combined file corresponding to the byte block size calculated for the second file; and

write the next combined file byte block to a fourth file.

23. The system of claim 22, wherein the processor is further configured to:

determine whether each byte included within the combined file has been read from the combined file and written to one of the third file or the fourth file; and

repeat, upon a determination that each of the bytes included within the combined file have not been written to one of the third file or the fourth file, the read, write, and determine steps.