Changeset [cf32ddc237c6b9193f5f26293ad5a78663fb9bd5] by Shayan Pooya
March 27th, 2014 @ 12:33 PM
JobCoordinator: Retry the task submission for a limited number of failures.
There is a lot of contension on the disco server so the task
submission may
timeout. We should not use large timeouts for submitting the tasks
because
meanwhile the job coordinator process is blocked.
A benefit of smaller timeout is that job_coordinator can still
process the
messages from other processes.
https://github.com/discoproject/disco/commit/cf32ddc237c6b9193f5f26...
Committed by Shayan Pooya
- M master/src/job_coordinator.erl
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.