You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It's critical that I'm able to specify the following:
The total number of simultaneous workers that can run at any given time. (e.g. 1 per each cpu core for a total of 4)
The total number of simultaneous tasks that can run at any given time (per queue).
Given the following queues:
queue_one
queue_two
Only one task from queue_one can run at any given time.
Any number of tasks from queue_two can run at any given time.
e.g.
queue_one [<task 1>, <task 3>, <task 5>]
queue_two [<task 2>, <task 4>, <task 6>]
worker_1 processing <task 1> from queue_one
worker_2 processing <task 2> from queue_two
worker_3 processing <task 4> from queue_two
worker_4 processing <task 6> from queue_two
The point here is that a total of 4 tasks can be processed simultaneously as per the "worker concurrency count" but only 1 task from queue_one can be processed simultaneously as per the "queue concurrency count".
This is a critical feature for me as there are types of tasks that would interfere with each other if they were run at the same time. Therefore they would be in the same queue and that queue would have a concurrency count of 1. aka only one of those tasks can run at a time.
Please let me know if this ability exists in this package. Thank you.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
It's critical that I'm able to specify the following:
The total number of simultaneous workers that can run at any given time. (e.g. 1 per each cpu core for a total of 4)
The total number of simultaneous tasks that can run at any given time (per queue).
Given the following queues:
queue_one
queue_two
Only one task from queue_one can run at any given time.
Any number of tasks from queue_two can run at any given time.
e.g.
queue_one [<task 1>, <task 3>, <task 5>]
queue_two [<task 2>, <task 4>, <task 6>]
worker_1 processing <task 1> from queue_one
worker_2 processing <task 2> from queue_two
worker_3 processing <task 4> from queue_two
worker_4 processing <task 6> from queue_two
The point here is that a total of 4 tasks can be processed simultaneously as per the "worker concurrency count" but only 1 task from queue_one can be processed simultaneously as per the "queue concurrency count".
This is a critical feature for me as there are types of tasks that would interfere with each other if they were run at the same time. Therefore they would be in the same queue and that queue would have a concurrency count of 1. aka only one of those tasks can run at a time.
Please let me know if this ability exists in this package. Thank you.
Beta Was this translation helpful? Give feedback.
All reactions