Commit Graph

12 Commits

Author SHA1 Message Date
Aaron Tan
5287e5c111 Implement workflow job failure
Relates #264.

This PR proposed and implemented a way of defining workflow failure
state:

A workflow job fails if one of the conditions below satisfies.
* At least one node runs into states `canceled` or `error`.
* At least one leaf node runs into states `failed`, but no child node is
  spawned to run (no error handler).

Signed-off-by: Aaron Tan <jangsutsr@gmail.com>
2017-10-12 11:08:33 -04:00
AlanCoding
8f259f2bb7 handle case of node with null UJT 2017-01-10 18:50:52 -05:00
Aaron Tan
9e4655419e Fix flake8 E302 errors. 2016-11-15 20:59:39 -05:00
Aaron Tan
9e244b640b Simplify internal node job cancel mechanism. 2016-11-08 11:32:33 -05:00
Aaron Tan
3778914aa9 Implement recursive spawned job cancel. 2016-11-08 11:31:06 -05:00
Alan Rominger
a5aa2df681 Merge pull request #3838 from AlanCoding/wf_dag_prefetch
Keep queries for building WF DAG to a minimum
2016-11-02 14:47:16 -04:00
Aaron Tan
0a634d7baf Enforce wfj to ignore errored jobs. 2016-10-31 14:44:15 -04:00
Aaron Tan
aa119e0102 Enforce wfj to ignore canceled jobs. 2016-10-31 12:09:14 -04:00
AlanCoding
47de8c5963 keep queries for building WF DAG to a minimum 2016-10-28 11:20:25 -04:00
Aaron Tan
5ca25b924e Add missing always_node check in bfs 2016-10-24 11:06:25 -04:00
Chris Meyers
cdb65ccac9 replace task manager with event driven scheduler 2016-09-27 14:16:18 -04:00
Chris Meyers
cc90204b0f task manager using messages
* First pass, adapt singleton task manager to process messages and run
jobs based on events instead of a busy loop.
* Still need to make message handing run in celery, not in a consumption
loop
2016-09-27 14:05:29 -04:00