Changeset [d80a26da1278ce1936ba4bce10de42a3b1427d96] by Shayan Pooya
June 5th, 2014 @ 08:01 AM
jobpack: Add the concurrent flag to the pipeline stages.
The stage() type has been modified to include a third field
showing whether the
stage should run concurrently or sequentially. By default, all of
the stages
should run sequentially but it will be changed into a configurable
option so
that it can be turned on for specific stages in the pipeline
model.
https://github.com/discoproject/disco/commit/d80a26da1278ce1936ba4b...
Committed by Shayan Pooya
- M lib/disco/worker/pipeline/worker.py
- M master/include/pipeline.hrl
- M master/src/disco_web.erl
- M master/src/job_coordinator.erl
- M master/src/jobpack.erl
- M master/src/pipeline_utils.erl
- M master/test/pipeline_utils_test.erl
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.