FACILITATING WORKLOAD-AWARE SHUFFLING AND MANAGEMENT OF MESSAGE TYPES IN MESSAGE QUEUES IN AN ON-DEMAND SERVICES ENVIRONMENT

• US 20160119244A1
• Filed: 10/28/2014
• Published: 04/28/2016
• Est. Priority Date: 10/28/2014
• Status: Active Grant

• Current Assignee: Salesforce.com, Inc.
• Original Assignee: Salesforce.com, Inc.
• Inventors: WANG, XIAODAN, DEVADHAR, VIJAYANTH
• Granted Patent: US 10,904,122 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04L 41/5051 Service on demand, e.g. definition and deployment of services in real time
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level

Abstract

In accordance with embodiments, there are provided mechanisms and methods for facilitating dynamic workload-aware shuffling of message types in message queues in an on-demand services environment in a multi-tenant environment according to one embodiment. In one embodiment and by way of example, a method includes monitoring, in runtime, workload patterns associated with incoming workloads, where each workload is associated with a plurality of message types and the plurality of message types are inspected and processed in a predetermined order. The method may further include collecting, in runtime, information regarding each message type based on a workload pattern of its associated workload, and dynamically shuffling the order based on the information, where shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

Claims

1. A database system-implemented method, comprising:

monitoring, in runtime, by and incorporating into the database system, workload patterns associated with incoming workloads, wherein each workload is associated with a plurality of message types and the plurality of message types are at least one of inspected and processed in a pre-determined order;

collecting, in runtime, by the database system, information regarding each message type based on a workload pattern of its associated workload; and

dynamically shuffling, in runtime, by the database system, the order based on the information, wherein shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

2. The method of claim 1, further comprising segmenting, based on the information, the plurality of message types into a first group having the first set of message types, and a second group having the second set of message types, wherein segmenting is performed based on traffic levels associated with the plurality of message types based on corresponding workload patterns.

3. The method of claim 2, further comprising constructing, based on the segmentation, a list having the first and second groups having the first and second sets of message types, wherein the first set of message types comprises high traffic message types, and the second set of message types comprises low traffic message types.

4. The method of claim 3, wherein the first group is placed in front of the list, and the second group placed in rear of the list, wherein a list placement order of the first and second groups in the list corresponds to an order in which messages are dequeued and processed from queues belonging to the first and second sets of message types.

5. The method of claim 4, further comprising randomly shuffling the high traffic message types within the first group, wherein the low traffic message types are shuffled within the second group.

6. The method of claim 1, further comprising evaluating the information, wherein evaluating includes determining the traffic levels, wherein a traffic level is associated with each message type of the plurality of message types, wherein the traffic level includes at least one of a high traffic level and a low traffic level.

7. The method of claim 6, wherein the high traffic level is associated with the high traffic message types, and the low traffic level is associated with the low traffic message types.

8. The method of claim 6, further comprising resetting data associated with the traffic levels over predetermined periods of time, wherein resetting includes facilitating the determination of the traffic levels over the predetermined periods of time, and detecting changes in the data associated with the traffic levels, wherein resetting further includes modifying the list based on the changes in the data.

9. A system comprising:

a processor and a memory to execute instructions at the system; and

a mechanism to;

monitor, in runtime, workload patterns associated with incoming workloads, wherein each workload is associated with a plurality of message types and the plurality of message types are at least one of inspected and processed in a pre-determined order;

collect, in runtime, information regarding each message type based on a workload pattern of its associated workload; and

dynamically shuffle, in runtime, the order based on the information, wherein shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

10. The system of claim 9, wherein the mechanism is further to segment, based on the information, the plurality of message types into a first group having the first set of message types, and a second group having the second set of message types, wherein segmenting is performed based on traffic levels associated with the plurality of message types based on corresponding workload patterns.

11. The system of claim 10, wherein the mechanism is further to construct, based on the segmentation, a list having the first and second groups having the first and second sets of message types, wherein the first set of message types comprises high traffic message types, and the second set of message types comprises low traffic message types.

12. The system of claim 11, wherein the first group is placed in front of the list, and the second group placed in rear of the list, wherein a list placement order of the first and second groups in the list corresponds to an order in which messages are dequeued and processed from queues belonging to the first and second sets of message types.

13. The system of claim 12, wherein the mechanism is further to randomly shuffle the high traffic message types within the first group, wherein the low traffic message types are shuffled within the second group.

14. The system of claim 9, wherein the mechanism is further to evaluate the information, wherein evaluating includes determining the traffic levels, wherein a traffic level is associated with each message type of the plurality of message types, wherein the traffic level includes at least one of a high traffic level and a low traffic level.

15. The system of claim 14, wherein the high traffic level is associated with the high traffic message types, and the low traffic level is associated with the low traffic message types.

16. The system of claim 14, wherein the mechanism is further to reset data associated with the traffic levels over predetermined periods of time, wherein resetting includes facilitating the determination of the traffic levels over the predetermined periods of time, and detecting changes in the data associated with the traffic levels, wherein resetting further includes modifying the list based on the changes in the data.

17. A machine-readable medium comprising a plurality of instructions which, when executed by a processing device, cause the processing device to perform one or more operations comprising:

monitoring, in runtime, workload patterns associated with incoming workloads, wherein each workload is associated with a plurality of message types and the plurality of message types are at least one of inspected and processed in a pre-determined order;

collecting, in runtime, information regarding each message type based on a workload pattern of its associated workload; and

dynamically shuffling, in runtime, the order based on the information, wherein shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

18. The machine-readable medium of claim 17, wherein the one or more operations comprise segmenting, based on the information, the plurality of message types into a first group having the first set of message types, and a second group having the second set of message types, wherein segmenting is performed based on traffic levels associated with the plurality of message types based on corresponding workload patterns.

19. The machine-readable medium of claim 18, wherein the one or more operations comprise constructing, based on the segmentation, a list having the first and second groups having the first and second sets of message types, wherein the first set of message types comprises high traffic message types, and the second set of message types comprises low traffic message types.

20. The machine-readable medium of claim 19, wherein the first group is placed in front of the list, and the second group placed in rear of the list, wherein a list placement order of the first and second groups in the list corresponds to an order in which messages are dequeued and processed from queues belonging to the first and second sets of message types.

21. The machine-readable medium of claim 20, wherein the one or more operations comprise randomly shuffling the high traffic message types within the first group, wherein the low traffic message types are shuffled within the second group.

22. The machine-readable medium of claim 17, wherein the one or more operations comprise evaluating the information, wherein evaluating includes determining the traffic levels, wherein a traffic level is associated with each message type of the plurality of message types, wherein the traffic level includes at least one of a high traffic level and a low traffic level.

23. The machine-readable medium of claim 22, wherein the high traffic level is associated with the high traffic message types, and the low traffic level is associated with the low traffic message types.

24. The machine-readable medium of claim 22, wherein the one or more operations comprise resetting data associated with the traffic levels over predetermined periods of time, wherein resetting includes facilitating the determination of the traffic levels over the predetermined periods of time, and detecting changes in the data associated with the traffic levels, wherein resetting further includes modifying the list based on the changes in the data.