Changeset [c9c42d23b05c06253537d9d623b1391589562f0f] by Shayan Pooya
May 13th, 2014 @ 01:49 PM
worker_runtime: Add a producer-consumer structure.
The runtime used to tell the worker that there is no more inputs
in all of the
cases. In the new model, the runtime will tell the worker that
there is more
inputs in case there is more inputs to come.
At the moment, the runtime has all of the inputs when the task
starts but this
will change with the concurrent stages.
https://github.com/discoproject/disco/commit/c9c42d23b05c06253537d9...
Committed by Shayan Pooya
- M master/src/disco_worker.erl
- M master/src/worker_inputs.erl
- M master/src/worker_runtime.erl
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.