I don't receive any emails from Toolforge jobs for the tool commonsdb-registry. I've followed the instructions under Help:Toolforge/Jobs framework#Job email notifications https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Job_email_notifications. I've verified that manually sending emails to tools.commonsdb-registry@toolforge.org works.
Is there something I'm missing to get the job emails to work?
Here are the commands I ran: $ toolforge jobs run myjob --command "echo apa" --image bullseye --emails onfinish $ toolforge jobs show myjob +---------------+----------------------------------------------------------------------+ | Job name: | myjob | +---------------+----------------------------------------------------------------------+ | Command: | echo apa | +---------------+----------------------------------------------------------------------+ | Job type: | one-off | +---------------+----------------------------------------------------------------------+ | Image: | bullseye | +---------------+----------------------------------------------------------------------+ | Port: | none | +---------------+----------------------------------------------------------------------+ | File log: | yes | +---------------+----------------------------------------------------------------------+ | Output log: | /data/project/commonsdb-registry/myjob.out | +---------------+----------------------------------------------------------------------+ | Error log: | /data/project/commonsdb-registry/myjob.err | +---------------+----------------------------------------------------------------------+ | Emails: | onfinish | +---------------+----------------------------------------------------------------------+ | Resources: | mem: 0.5Gi, cpu: 0.5 | +---------------+----------------------------------------------------------------------+ | Replicas: | | +---------------+----------------------------------------------------------------------+ | Mounts: | all | +---------------+----------------------------------------------------------------------+ | Retry: | no | +---------------+----------------------------------------------------------------------+ | Timeout: | no | +---------------+----------------------------------------------------------------------+ | Health check: | none | +---------------+----------------------------------------------------------------------+ | Status: | Completed | +---------------+----------------------------------------------------------------------+ | Hints: | Last run at 2025-06-13T06:06:35Z. Pod in 'Succeeded' phase. State | | | 'terminated'. Reason 'Completed'. Started at '2025-06-13T06:06:37Z'. | | | Finished at '2025-06-13T06:06:37Z'. Exit code '0'. | +---------------+----------------------------------------------------------------------+
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
I just restarted the jobs-emailer pod, it seemed to be ignoring all events :/,
I created a task to alert when there's no emails sent in 1h, and start an investigation on why it got stuck (https://phabricator.wikimedia.org/T396850).
It should start sending emails anew, if you see any more issues feel free to add to the task too so we look at it.
Cheers!
On 06/13 08:30, Sebastian Berlin wrote:
I don't receive any emails from Toolforge jobs for the tool commonsdb-registry. I've followed the instructions under Help:Toolforge/Jobs framework#Job email notifications https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Job_email_notifications. I've verified that manually sending emails to tools.commonsdb-registry@toolforge.org works.
Is there something I'm missing to get the job emails to work?
Here are the commands I ran: $ toolforge jobs run myjob --command "echo apa" --image bullseye --emails onfinish $ toolforge jobs show myjob +---------------+----------------------------------------------------------------------+ | Job name: | myjob | +---------------+----------------------------------------------------------------------+ | Command: | echo apa | +---------------+----------------------------------------------------------------------+ | Job type: | one-off | +---------------+----------------------------------------------------------------------+ | Image: | bullseye | +---------------+----------------------------------------------------------------------+ | Port: | none | +---------------+----------------------------------------------------------------------+ | File log: | yes | +---------------+----------------------------------------------------------------------+ | Output log: | /data/project/commonsdb-registry/myjob.out | +---------------+----------------------------------------------------------------------+ | Error log: | /data/project/commonsdb-registry/myjob.err | +---------------+----------------------------------------------------------------------+ | Emails: | onfinish | +---------------+----------------------------------------------------------------------+ | Resources: | mem: 0.5Gi, cpu: 0.5 | +---------------+----------------------------------------------------------------------+ | Replicas: | | +---------------+----------------------------------------------------------------------+ | Mounts: | all | +---------------+----------------------------------------------------------------------+ | Retry: | no | +---------------+----------------------------------------------------------------------+ | Timeout: | no | +---------------+----------------------------------------------------------------------+ | Health check: | none | +---------------+----------------------------------------------------------------------+ | Status: | Completed | +---------------+----------------------------------------------------------------------+ | Hints: | Last run at 2025-06-13T06:06:35Z. Pod in 'Succeeded' phase. State | | | 'terminated'. Reason 'Completed'. Started at '2025-06-13T06:06:37Z'. | | | Finished at '2025-06-13T06:06:37Z'. Exit code '0'. | +---------------+----------------------------------------------------------------------+
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/