[Labs-l] Jobs aborted?
Marc-André Pelletier
mpelletier at wikimedia.org
Mon May 19 18:34:06 UTC 2014
On 05/19/2014 12:14 PM, Emilio J. RodrÃguez-Posada wrote:
> So, I know I can use -mem parameter in jsub, but how can I estimate the
> memory requirements? I'm using the bz2 module for Python and the
> mediawiki-utilities framework for parsing. I'm not sure which one is
> consuming the memory.
Unless you have profiling information, the easiest way to do this is to
start with a very generous allocation, and watch the highest it actually
raises to in practice then reduce to some margin above that.
-- Marc
More information about the Labs-l
mailing list