Throttle for Job Strategy
Reported by Matt | September 2nd, 2011 @ 03:05 AM
When running jobs on nodes tagged with x. It could be a nice feature to have a throttle for the strategy. This could be a set default on the job creation, with an option to change the threshold on execution.
I know the same outcome could be had from Jobs calling other Jobs with slightly different nodes tagged.
Strategy step-orientated, run on 5 out of 10 nodes tagged. If the job completes on those 5, the job could be scheduled again to run on 10 out of the 10 nodes.
Comments and changes to this ticket
-
Greg Schueler September 2nd, 2011 @ 10:52 AM
Can you explain what you mean by throttle more?
do you mean a time-based throttle, as in only run X nodes per-minute or something?
or do you simply want a way of limiting how many executions run at once? if you set the threadcount to 5, then only a max of 5 nodes will be executed on simultaneously
-
Matt September 5th, 2011 @ 12:02 AM
Throttle is probably the wrong word, limit maybe is a better one.
I have 10 nodes tagged with myapp. I have a job that does a bunch of tasks on nodes tagged with myapp.
I want to run the job in parallel (more threads) for speed, but not all at once, here I can do what you suggest and say run 5 threads. But that's only if i've chosen step-oriented rather than node-oriented (I think that's right?).
I want node-oriented, as if the job fails on one node, I don't want the job to continue to execute and take down all myapp nodes.
So I was thinking of a limit, maybe based on percentage, or a number. So the first time I execute the job I can specify it to run 50% or 5 of the 10 nodes tagged. If the job returned successful, I could schedule again with 100% etc.
Please Sign in or create a free account to add a new ticket.
With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
(DEPRECATED) Please use github issues for issue tracking at http://github.com/dtolabs/rundeck/issues