Changeset [f5f67db5992e4bb1bd78ca286364d6dbbb7f4e6d] by Shayan Pooya
April 16th, 2014 @ 10:07 AM
ddfs master: Randomly choose the replica locations based on the node weights.
The more free space a node has, the higher its probability of
hosting a
replica. This is preffered to having a deterministic method for
always
choosing the nodes with the most free space.
The deterministic method puts a lot of new data into a small
subset of ndoes
and increases the contention for putting the computation on this
subset of
nodes.
https://github.com/discoproject/disco/commit/f5f67db5992e4bb1bd78ca...
Committed by Shayan Pooya
- M master/src/ddfs/ddfs_master.erl
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.