System and method for manipulating data records

• US 9,529,811 B2
• Filed: 11/18/2013
• Issued: 12/27/2016
• Est. Priority Date: 11/19/2012
• Status: Active Grant

• Current Assignee: Melvin Lawerence Dey
• Original Assignee: Melvin Lawerence Dey
• Inventors: Dey, Melvin Lawerence
• Primary Examiner(s): NGUYEN, KIM T
• Application Number:
  US14/083,064
• Publication Number:
  US 20140143210A1
• Time in Patent Office: 1,135 Days
• Field of Search: 707/687, 707/809
• US Class Current: 1/1
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/16 File or folder operations, e.g. details of user interfaces specifically adapted to file systems
• CPC Class Codes: G06F 16/211 Schema design and management

Abstract

Systems and methods for manipulating data records in a byte accessible format are provided. Records may be loaded into one of two byte accessible files or arrays, with a determined record length added to the beginning and/or end of each record. Records may then be slewed between the two files and records added, removed, or modified at the split between the two files.

Claims

1. A method of manipulating data records comprising:

reading a plurality of data records from a record source, for each of the plurality of data records;

determining a length of the data record; and

adding the data record and associated length to a first file at a first position;

receiving a new data record to be added to the plurality of data records;

determining a length of the new data record;

slewing the data records between the first file and a second file until the new record should be added after a last feed record of the first file or before a last takeup record of the second file based on a comparison of values of the new data record and the data records being slewed between the first file and the second file, wherein slewing the data records comprises;

moving a data record from the first file to a transfer buffer;

comparing the new data record to the data record of the transfer buffer to determine if the new data record should be added between the record in the transfer buffer and the last record in the second file;

if the new data record should be added between the data record in the transfer buffer and the last record in the second file, adding the new transfer record to the second file; and

if the new data record should not be added between the data record in the transfer buffer and the last record in the second file, moving the data record from the transfer buffer to the second file and moving another data record from the first file to the transfer buffer; and

adding the new record and associated length to either the end of the first file or the second file.

2. The method of claim 1, wherein the record source is a database.

3. The method of claim 2, further comprising:

retrieving the plurality of data records from the database; and

storing the data records from the first file and second file to the database after the new data record has been added.

4. The method of claim 3, further comprising:

modifying contents of one or more data records.

5. The method of claim 4, wherein modifying contents of one or more data records comprises updating the associated length of the modified one or more data records.

6. The method of claim 1, wherein slewing the data records further comprises:

comparing a further new data record to be added to the data record of the transfer buffer to determine if the further new data record should be added between the record in the transfer buffer and the last record in the second file or between the record in the transfer buffer and the last record in the first file;

if the further new data record should be added between the data record in the transfer buffer and the last record in the second file, adding the further new transfer record to the second file;

if the further new data record should be added between the data record in the transfer buffer and the last record in the first file, adding the further new transfer record to the first file; and

if the further new data record should not be added between the data record in the transfer buffer and the last record in the second file or the last record in the first file;

determining a slew direction for slewing the data records between the first file and the second file based on where the further new data record should be added; and

slewing the data records between the first file and the second file in the determined slew direction.

7. The method of claim 6, wherein:

if the slew direction indicates slewing data records from the first file to the second file, the further new data record may be added to the second file; and

if the slew direction indicates slewing data records from the second file to the first file, the further new data record may be added to the first file.

8. The method of claim 7, where the determined slew direction indicates whether the data records should be slewed from the first file to the second file or from the second file to the first file.

9. The method of claim 1, wherein the associated length is stored at the end of the respective data record.

10. The method of claim 1, wherein the associated length is stored at the beginning of the respective data record.

11. The method of claim 1, wherein the associated length is stored at the beginning and at the end of the respective data record.

12. The method of claim 1, wherein each data record comprises a plurality of data fields.

13. The method of claim 12, further comprising using a sort sequence specifying an order of two or more of the plurality of data fields when determining where the new data record should be added between the plurality of data records.

14. The method of claim 13, wherein the sort sequence defines a sort order as ascending or descending for each of the two or more data fields.

15. The method of claim 1, wherein the data records are grouped into a plurality of segments.

16. The method of claim 15, further comprising:

slewing segments of data records between the first file and the second file.

17. A system for manipulating data records comprising:

a processor for executing instructions; and

a memory for storing instruction, which when executed by the processor configure the system to;

read a plurality of data records from a record source, and for each of the plurality of data records;

determine a length of the data record; and

add the data record and associated length to a first file at a first position;

receive new data record to be added to the plurality of data records;

determine a length of the new data record;

slew the data records between the first file and a second file until the new record should be added after a last feed record of the first file or before a last takeup record of the second file based on a comparison of values of the new data record and the data records being slewed between the first file and the second file, wherein slewing the data records comprises;

moving a data record from the first file to a transfer buffer;

comparing the new data record to the data record of the transfer buffer to determine if the new data record should be added between the record in the transfer buffer and the last record in the second file;

if the new data record should be added between the data record in the transfer buffer and the last record in the second file, adding the new transfer record to the second file; and

if the new data record should not be added between the data record in the transfer buffer and the last record in the second file, moving the data record from the transfer buffer to the second file and moving another data record from the first file to the transfer buffer; and

add the new record and associated length to either the end of the first file or the second file.

18. A non-transitory computer readable memory storing instruction, which when executed by a processor of a computing system configure the computing system to:

read a plurality of data records from a record source, and for each of the plurality of data records;

determine a length of the data record; and

add the data record and associated length to a first file at a first position;

receive a new data record to be added to the plurality of data records;

determine a length of the new data record;

slew the data records between the first file and a second file until the new record should be added after a last feed record of the first file or before a last takeup record of the second file based on a comparison of values of the new data record and the data records being slewed between the first file and the second file, wherein slewing the data records comprises;

moving a data record from the first file to a transfer buffer;

comparing the new data record to the data record of the transfer buffer to determine if the new data record should be added between the record in the transfer buffer and the last record in the second file;

if the new data record should be added between the data record in the transfer buffer and the last record in the second file, adding the new transfer record to the second file; and

if the new data record should not be added between the data record in the transfer buffer and the last record in the second file, moving the data record from the transfer buffer to the second file and moving another data record from the first file to the transfer buffer; and

add the new record and associated length to either the end of the first file or the second file.