Changeset [b8aaecf78eeda4ad636bc57c6e4a78c70e6756fb] by Shayan Pooya
May 9th, 2014 @ 10:53 AM
worker: Increase the worker protocol timeout.
Disco might have to prepare the inputs for the tasks and it
certianly needs more
than 10 minutes to do that. For concurrent stages, for some type of
groupings,
Disco needs all of the tasks of the previous stage to finish.
The current timeout (3 days) is just a large value. If any
worker failed with a
timeout, we have to increase this value.
https://github.com/discoproject/disco/commit/b8aaecf78eeda4ad636bc5...
Committed by Shayan Pooya
- M lib/disco/worker/__init__.py
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.