Dequeuing using queue batch numbers
First Claim
1. A method for processing records that belong to a set of records, where records are repeatedly being added to said set of records, where each record in said set of records has to be processed once for each of a plurality of entities, the method comprising the steps of:
- marking each record that is added to said set of records with a default batch value;
for each entity of said plurality of entities, processing a batch of said records by performing the steps of;
reading a last batch value associated with said entity;
processing the records in said set of records that are marked with batch values that are more recent than said last batch value associated with said entity; and
updating the last batch value associated with said entity to a most recent batch value of the records processed for said entity;
between processing consecutive batches for an entity of said plurality of entities, marking said set of records by performing the steps of;
updating a batch counter value to reflect a more recent batch number; and
marking all records in said set of records that have said default batch value with said batch counter value.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system are provided for processing records from a set of records, where records are repeatedly being added to the set of records, and where each record in the set of records has to be processed once for each of a plurality of entities. According to the method, each record that is added to the set of records is marked with a default batch value. For each entity of the plurality of entities, a batch of the records is processed by performing the steps of: reading a last batch value associated with the entity, processing the records in the set of records that are marked with batch values that are more recent than the last batch value associated with the entity, and updating the last batch value associated with the entity to a most recent batch value of the records processed for the entity. Between processing consecutive batches for an entity of the plurality of entities, the set of records are marked by performing the steps of: updating a batch counter value to reflect a more recent batch number; and marking all records in the set of records that have the default batch value with the batch counter value.
-
Citations
27 Claims
-
1. A method for processing records that belong to a set of records, where records are repeatedly being added to said set of records, where each record in said set of records has to be processed once for each of a plurality of entities, the method comprising the steps of:
-
marking each record that is added to said set of records with a default batch value; for each entity of said plurality of entities, processing a batch of said records by performing the steps of; reading a last batch value associated with said entity; processing the records in said set of records that are marked with batch values that are more recent than said last batch value associated with said entity; and updating the last batch value associated with said entity to a most recent batch value of the records processed for said entity; between processing consecutive batches for an entity of said plurality of entities, marking said set of records by performing the steps of; updating a batch counter value to reflect a more recent batch number; and marking all records in said set of records that have said default batch value with said batch counter value. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method for processing records that have been added to a set of records, where records are repeatedly being added to said set of records, where each record in said set of records has to be processed once for each of a plurality of entities, the method comprising the steps of:
-
assigning each record that is added to said set of records to a temporary batch that is marked older than any prior batch; for each entity of said plurality of entities, processing said records by repeatedly performing the steps of; determining a last batch processed for said entity; and processing the records in all batches that are newer than said last batch processed for said entity; and between processing said records twice for an entity of said plurality of entities, marking said temporary batch as newer than any prior batch. - View Dependent Claims (9, 10, 11, 12)
-
-
13. A computer-readable medium having stored thereon sequences of instructions for processing records that have been added to a set of records, where records are repeatedly being added to said set of records, where each record in said set of records has to be processed once for each of a plurality of entities, the sequences of instructions including sequences of instructions for performing the steps of:
-
assigning each record that is added to said set of records to a temporary batch that is marked older than any prior batch; for each of said entities, processing said records by repeatedly performing the steps of; determining a last batch processed for said entity; and processing the records in all batches that are newer than said last batch processed for said entity; and between processing said records twice for an entity of said plurality of entities, marking said temporary batch as newer than any prior batch. - View Dependent Claims (14, 15, 16, 17)
-
-
18. A method for processing records that have been added to a set of records, where records are repeatedly being added to said set of records, where each record in said set of records has to be processed once for each of a plurality of entities, the method comprising the steps of:
-
assigning each record that is added to said set of records to a temporary batch that is marked older than any prior batch; processing for an entity of said plurality of entities the records in all batches that are newer than a last batch processed for said entity; and before processing said records again for said entity, marking said temporary batch as newer than any prior batch. - View Dependent Claims (19)
-
-
20. A computer-readable medium having stored thereon sequences of instructions for processing records that belong to a set of records, where records are repeatedly being added to said set of records, where each record in said set of records has to be processed once for each of a plurality of entities, the sequences of instructions including sequences of instructions for performing the steps of:
-
marking each record that is added to said set of records with a default batch value; for each entity of said plurality of entities, processing a batch of said records by performing the steps of; reading a last batch value associated with said entity; processing the records in said set of records that are marked with batch values that are more recent than said last batch value associated with said entity; and updating the last batch value associated with said entity to a most recent batch value of the records processed for said entity; between processing consecutive batches for an entity of said plurality of entities, marking said set of records by performing the steps of; updating a batch counter value to reflect a more recent batch number; and marking all records in said set of records that have said default batch value with said batch counter value. - View Dependent Claims (21, 22, 23, 24, 25, 26)
-
-
27. A system for processing records, the system comprising:
-
a plurality of entities; a scheduler heap containing a set of records, wherein records are repeatedly being added to said set of records; a propagation mechanism, wherein the propagation mechanism is configured to process each record in said set of records, wherein each record in said set of records is processed once for each of the plurality of entities by performing the steps of; marking each record that is added to said set of records with a default batch value; for each entity of said plurality of entities, processing a batch of said records by performing the steps of; reading a last batch value associated with said entity; processing the records in said set of records that are marked with batch values that are more recent than said last batch value associated with said entity; and updating the last batch value associated with said entity to a most recent batch value of the records processed for said entity; between processing consecutive batches for an entity of said plurality of entities, marking said set of records by performing the steps of; updating a batch counter value to reflect a more recent batch number; and marking all records in said set of records that have said default batch value with said batch counter value.
-
Specification