Changeset [384c5a6317f9a0006fbb4f0fba76744868b87881] by Shayan Pooya
June 3rd, 2014 @ 07:48 AM
fileutils: raise an exception if stdin reaches EOF.
This commit resolves the issue that when Disco crashes, the
zombie python
processes were consuming 100% of CPU. The problem was doing a
select on the
stdin file descriptor and if ready, reading from it.
The problem is described here:
http://stackoverflow.com/a/3301530
https://github.com/discoproject/disco/commit/384c5a6317f9a0006fbb4f...
Committed by Shayan Pooya
- M lib/disco/fileutils.py
Create new ticket
Create your profile
Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป
Disco is an open-source implementation of the Map-Reduce framework for distributed computing. As the original framework, Disco supports parallel computations over large data sets on unreliable cluster of computers.