Changeset [40ee23966af8fb2a5790437be55df8d320eb4d85] by Shayan Pooya
July 28th, 2014 @ 08:51 AM
job_coordinator: avoid extra tries to submit tasks for non-concurrent stages
When a stage is not concurrent, we do not want the extra
overhead of creating
the inputs and create the pending tasks. Instead, we'd like to wait
until the
stage finishes and then create the tasks of the next stage.
https://github.com/discoproject/disco/commit/40ee23966af8fb2a579043...
Committed by Shayan Pooya
- M master/src/job_coordinator.erl
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.