Changeset [963d1a209511cfca6461d72d08119e5db4a0b53e] by Shayan Pooya
June 3rd, 2014 @ 12:46 PM
job_coordinator: add the tasks which are scheduled for re_run to the pending list.
One of the benefits of this approach is that when a new input is
available for
this task, we know that it is not finished yet and needs the task
spec to be
updated. Otherwise, the task will be re-launched with all of the
inputs but
still waiting for more inputs.
https://github.com/discoproject/disco/commit/963d1a209511cfca6461d7...
Committed by Shayan Pooya
- M master/src/job_coordinator.erl
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.