[Labs-l] Jobs aborted?

Marc-André Pelletier mpelletier at wikimedia.org
Mon May 19 18:34:06 UTC 2014


On 05/19/2014 12:14 PM, Emilio J. Rodríguez-Posada wrote:
> So, I know I can use -mem parameter in jsub, but how can I estimate the
> memory requirements? I'm using the bz2 module for Python and the
> mediawiki-utilities framework for parsing. I'm not sure which one is
> consuming the memory.

Unless you have profiling information, the easiest way to do this is to
start with a very generous allocation, and watch the highest it actually
raises to in practice then reduce to some margin above that.

-- Marc




More information about the Labs-l mailing list