Aggregating data from a work queue

• US 8,645,377 B2
• Filed: 01/15/2010
• Issued: 02/04/2014
• Est. Priority Date: 01/15/2010
• Status: Active Grant

• Current Assignee: Zhigu Holdings Limited
• Original Assignee: Microsoft Corporation
• Inventors: Ness, Andrew, Mallet, Alexander, Copeland, Bruce, Rickman, Christopher, Viswanathan, Rajesh
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): VU, THONG H
• Application Number:
  US12/688,040
• Publication Number:
  US 20110179028A1
• Time in Patent Office: 1,481 Days
• Field of Search: 707/101, 707/6, 707/102, 707/10, 707/2, 707/5, 707/768, 707/752, 707/706, 707/726, 709/224
• US Class Current: 707/737
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning

Abstract

One or more techniques and/or systems are disclosed herein for aggregating web-based data stored in a distributed data store so that it can be retrieved in a first-in, first-out (FIFO) manner. A unique aggregation key is generated for respective one or more data generated from a web-based event, where the one or more data are added to the distributed data store, and the aggregation key corresponds merely to the data generated from the web-based event. The one or more data from the web based event is aggregated in a FIFO queue and stored in a same partition of the distributed data store, based on the aggregation key.

Claims

1. A method, comprising:

identifying a first message within a first message feed of a first user;

computing a first aggregation key based upon the first message;

appending the first aggregation key to the first message as at least one of a first prefix or a first suffix;

selectively storing the first message within a first data partition, but not a second data partition, designated for storing message data associated with the first aggregation key;

identifying a second message within the first message feed of the first user, the second message corresponding to a status update with respect to the first message;

responsive to determining the second message corresponds to the status update with respect to the first message, appending the first aggregation key to the second message as at least one of a second prefix or a second suffix;

selectively storing the second message within the first data partition, but not the second data partition;

identifying a third message within a second message feed of a second user;

computing a second aggregation key based upon the third message;

appending the second aggregation key to the third message as at least one of a third prefix or a third suffix; and

selectively storing the third message within the second data partition, but not the first data partition, designated for storing message data associated with the second aggregation key.

2. The method of claim 1, the first data partition corresponding to a first virtual storage structure stored across a first physical storage device and a second physical storage device.

3. The method of claim 2, the selectively storing the first message comprising storing the first message within the first physical storage device, and the selectively storing the second message comprising storing the second message within the second physical storage device.

4. The method of claim 1, comprising:

maintaining a first-in, first-out (FIFO) queue within the first data partition for messages associated with the first aggregation key; and

facilitating retrieval of at least one message from the first data partition in a FIFO manner utilizing the FIFO queue.

5. The method of claim 4, the facilitating retrieval of at least one message comprising:

retrieving the first message before the second message.

6. The method of claim 2, comprising:

maintaining a first-in, first-out (FIFO) queue within the first data partition, the FIFO queue stored within a third physical storage device across which the first virtual storage structure is stored.

7. The method of claim 2, the second data partition corresponding to a second virtual storage structure stored across a third physical storage device and a fourth physical storage device, the selectively storing the third message comprising storing the third message within the third physical storage device.

8. The method of claim 7, comprising:

maintaining a second first-in, first-out (FIFO) queue within the fourth physical storage device for messages associated with the second aggregation key; and

facilitating retrieval of at least one message from the second data partition in a FIFO manner utilizing the second FIFO queue.

9. A computer readable storage device comprising instructions that when executed perform a method comprising:

identifying a first message within a first message feed of a first user;

computing a first aggregation key based upon the first message;

appending the first aggregation key to the first message as at least one of a first prefix or a first suffix;

selectively storing the first message within a first data partition, but not a second data partition, designated for storing message data associated with the first aggregation key;

identifying a second message within the first message feed of the first user, the second message corresponding to a status update with respect to the first message;

responsive to determining the second message corresponds to the status update with respect to the first message, appending the first aggregation key to the second message as at least one of a second prefix or a second suffix;

selectively storing the second message within the first data partition, but not the second data partition;

identifying a third message within a second message feed of a second user;

computing a second aggregation key based upon the third message;

appending the second aggregation key to the third message as at least one of a third prefix or a third suffix; and

selectively storing the third message within the second data partition, but not the first data partition, designated for storing message data associated with the second aggregation key.

10. The computer readable storage device of claim 9, the first data partition corresponding to a first virtual storage structure stored across a first physical storage device and a second physical storage device.

11. The computer readable storage device of claim 10, the selectively storing the first message comprising storing the first message within the first physical storage device, and the selectively storing the second message comprising storing the second message within the second physical storage device.

12. The computer readable storage device of claim 9, comprising:

maintaining a first-in, first-out (FIFO) queue within the first data partition for messages associated with the first aggregation key; and

facilitating retrieval of at least one message from the first data partition in a FIFO manner utilizing the FIFO queue.

13. The computer readable storage device of claim 12, the facilitating retrieval of at least one message comprising:

retrieving the first message before the second message.

14. The computer readable storage device of claim 10, comprising:

maintaining a first-in, first-out (FIFO) queue within the first data partition, the FIFO queue stored within a third physical storage device across which the first virtual storage structure is stored.

15. The computer readable storage device of claim 10, the second data partition corresponding to a second virtual storage structure stored across a third physical storage device and a fourth physical storage device, the selectively storing the third message comprising storing the third message within the third physical storage device.

16. The computer readable storage device of claim 15, comprising:

maintaining a second first-in, first-out (FIFO) queue within the fourth physical storage device for messages associated with the second aggregation key; and

facilitating retrieval of at least one message from the second data partition in a FIFO manner utilizing the second FIFO queue.

17. A system, comprising:

a storing component configured to;

identify a first message within a first message feed of a first user;

compute a first aggregation key based upon the first message;

append the first aggregation key to the first message as at least one of a first prefix or a first suffix;

selectively store the first message within a first data partition, but not a second data partition, designated for storing message data associated with the first aggregation key;

identify a second message within the first message feed of the first user, the second message corresponding to a status update with respect to the first message;

responsive to determining the second message corresponds to the status update with respect to the first message, append the first aggregation key to the second message as at least one of a second prefix or a second suffix;

selectively store the second message within the first data partition, but not the second data partition;

identify a third message within a second message feed of a second user;

compute a second aggregation key based upon the third message;

append the second aggregation key to the third message as at least one of a third prefix or a third suffix; and

selectively store the third message within the second data partition, but not the first data partition, designated for storing message data associated with the second aggregation key.

18. The system of claim 17, comprising:

a data retrieval component configured to;

maintain a first-in, first-out (FIFO) queue within the first data partition for messages associated with the first aggregation key; and

facilitate retrieval of at least one message from the first data partition in a FIFO manner utilizing the FIFO queue, such that the first message is retrieved before the second message.

19. The system of claim 17, the first data partition corresponding to a first virtual storage structure stored across a first physical storage device and a second physical storage device.

20. The system of claim 19, the storing component configured to:

store the first message within the first physical storage device; and

store the second message within the second physical storage device.