Multiple jobs started, SGE or cron issue? - Toolserver-l

29 Nov 2012

I'm currently running a test of one of SuggestBot's scripts and noticed
that sometimes there has been two jobs running almost in parallel, which
surprised me since I only have a single cron-job.  Maybe there's an error
in my setup that's causing this, or maybe it's just a glitch in the Matrix?
 Since I have no idea if it's the former, I'd be happy if someone had any
idea about what's been causing this.

Here's the crontab entry from the submit server:
28 * * * * cronsub nettasks $HOME/SuggestBot/opentask/opentasks-nettrom.sh

So far there's been eight incidents of duplicate jobs:
jobnumber 837874, qsub_time Tue Nov 27 21:28:02 2012
jobnumber 837876, qsub_time Tue Nov 27 21:28:03 2012

jobnumber 841731, qsub_time Wed Nov 28 13:28:01 2012
jobnumber 841734, qsub_time Wed Nov 28 13:28:03 2012

jobnumber 844796, qsub_time Thu Nov 29 01:28:01 2012
jobnumber 844797, qsub_time Thu Nov 29 01:28:02 2012

jobnumber 845829, qsub_time Thu Nov 29 05:28:01 2012
jobnumber 845830, qsub_time Thu Nov 29 05:28:01 2012

jobnumber 846093, qsub_time Thu Nov 29 06:28:01 2012
jobnumber 846095, qsub_time Thu Nov 29 06:28:03 2012

jobnumber 846351, qsub_time Thu Nov 29 07:28:01 2012
jobnumber 846354, qsub_time Thu Nov 29 07:28:03 2012

jobnumber 847126, qsub_time Thu Nov 29 10:28:02 2012
jobnumber 847128, qsub_time Thu Nov 29 10:28:03 2012

jobnumber 848150, qsub_time Thu Nov 29 14:28:01 2012
jobnumber 848151, qsub_time Thu Nov 29 14:28:02 2012

Here's the shell script that's launched by cron:
nettrom@willow:~$ less SuggestBot/opentask/opentasks-nettrom.sh
#!/bin/bash

# Name the job "opentasks".
#$ -N nettasks

# Tell the server we'll be running for a maximum of 55 minutes (default is
6hrs)
#$ -l h_rt=00:55:00

# Join STDERR and STDOUT
#$ -j y

# Store output in a different place.
#$ -o $HOME/SuggestBot/logs/opentasks-nettrom.log

# Ask for 256MB of memory
#$ -l virtual_free=256M

# Need 1 SQL process on s1-rr for enwiki, and 1 SQL process on sql-user-n
for logging
#$ -l sql-s1-rr=1
#$ -l sql-user-n=1

# Until oursql is available on the Linux hosts, we have to restrict this to
Solaris,
# or rewrite it to use MySQLdb.
#$ -l arch=sol

# Engage virtualenv
source $HOME/env/default/bin/activate

# Make sure my local modules work
export PYTHONPATH=$HOME/lib/python

# Post to my userspace with 5x oversampling, pointing to the right
classifier host file
python $HOME/SuggestBot/opentask/opentasks.py -o 5
--page="User:Nettrom/sandbox/opentask" -l en \
  -f $HOME/SuggestBot/classifier/hostname.txt

Regards,
Morten