You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are multiple projects with items to process. Because items from one project always have priority over others multiple queues are used. Processing these items takes a lot of resources, so running one worker for each queue is not feasible.
Suggested solution
Add the possibility to configure multiple input queues with precedence in the same order as the queues are added. Then check each queue in order for a new message until the first message is retrieved. This way, any subsequent queue will only be queried if the queue before was empty, ensuring expected precendence of processing.
would mean that first all messages from input.priority1 will be processed. When input.priority1 is empty, then messages from input.priority2 will be processed. And if input.priority1 and input.priority2 are both empty, then messages from input.priority3 will be processed.
The text was updated successfully, but these errors were encountered:
Use Case
There are multiple projects with items to process. Because items from one project always have priority over others multiple queues are used. Processing these items takes a lot of resources, so running one worker for each queue is not feasible.
Suggested solution
Add the possibility to configure multiple input queues with precedence in the same order as the queues are added. Then check each queue in order for a new message until the first message is retrieved. This way, any subsequent queue will only be queried if the queue before was empty, ensuring expected precendence of processing.
Example:
would mean that first all messages from
input.priority1
will be processed. Wheninput.priority1
is empty, then messages frominput.priority2
will be processed. And ifinput.priority1
andinput.priority2
are both empty, then messages frominput.priority3
will be processed.The text was updated successfully, but these errors were encountered: