Changeset [bed19bed28182abf6acfda6b3f73b8f35b09a3ab] by Shayan Pooya
May 28th, 2014 @ 07:50 AM
job_coordinator: maintain a per-stage group_map gbtree.
This gb_tree is used to lookup the tasks based on their inputs.
We have to
maintain a per-stage gb_tree to avoid assigning the inputs to tasks
of the wrong
stages.
https://github.com/discoproject/disco/commit/bed19bed28182abf6acfda...
Committed by Shayan Pooya
- M master/include/job_coordinator.hrl
- M master/src/job_coordinator.erl
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.