[Labs-l] Some questions about best batch jobs design

[Alex Brollo]

I'm very happily using login-eqiad, after a suggestion of MZMcBride about
using python virtuyalenv (thanks!).

My present work is, to launch a set of jobs, any of which is a (rather
heavy) python script.

As a "persistent beginner" into server environment, I choose a compromise
solution, t.i. I wrote a very simple shell script running -sync y jsub, and
I launch it from my tool console.

I see some alternatives:

1. to launch shell script too as a jsub;
2. to wrap the whole  batch work into a single batch python script, and to
run as a jsub;
3. to wrap into a simple python script the batch job, running from it an
os.system("jsub.....");
4. other?

One more question: I'd like to run under dev-eqiad instead of login-eqiad,
have I to repeat some step to activate it fully? Have I to repeat
"webservices start" and to build a new virtualenv, ro something else too? I
can't find any more doc about this - I know that it is somewhere, but I
forgot where it is.

Final comment: I'd be much more comfortable if a village pump could be
opened into wikitech website. :-)

Alex
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/labs-l/attachments/20140307/dfa25ac5/attachment.html>