Hello everyone!
We are happy to announce that toolforge jobs framework now supports
multiple replicas for continuous jobs!
There are times when you might need to run multiple instances of the
same thing (e.g. multiple processes). This change allows you to do
that using the `--replicas` option.
An example command would be something like `toolforge jobs run
multi-replica-con-job --command ./command.sh --image bookworm
--continuous --replicas 5`
The log output from each of the running instances will be aggregated
and can be streamed (if you are using the --no-filelog option) or
written to the log files.
Note: This can only be configured for continuous jobs.
Note: There is no limit to the number of replicas you can specify, but
running too many replicas can exceed the resource quota assigned to
each job/tool by default. If this happens the job may fail to run,
with out-of-quota error message displayed.
Also, a reminder that you can find this and smaller user-facing updates about
the Toolforge platform features here:
https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Changelog
Original task: https://phabricator.wikimedia.org/T341066
--
Ndibe Raymond Olisaemeka
Software Engineer II - Technical Engagement
Wikimedia Foundation <https://wikimediafoundation.org/>
Hello everyone,
We will be starting the Toolforge Kubernetes upgrade to v1.27 in a few
minutes. Like we mentioned earlier, we do not expect any downtime but
do let us know if you notice any weird behaviour that'd require our
attention.
--
Ndibe Raymond Olisaemeka
Software Engineer II - Technical Engagement
Wikimedia Foundation <https://wikimediafoundation.org/>
On Tue, Sep 10, 2024 at 6:43 PM Raymond Ndibe <rndibe(a)wikimedia.org> wrote:
>
> Hello everyone!,
>
> We will be upgrading Toolforge Kubernetes to v1.27 on Monday Sep 16
> around 1:00PM UTC.
>
> We do not expect any downtime, but some jobs and webservices may
> restart as they get shuffled around to different worker nodes. Please
> report any issues you encounter.[0]
>
> For details see: https://phabricator.wikimedia.org/T359641
>
> [0] https://wikitech.wikimedia.org/wiki/Portal:Toolforge#Communication_and_supp…
>
> Cheers,
> --
> Ndibe Raymond Olisaemeka
> Software Engineer II - Technical Engagement
>
> Wikimedia Foundation <https://wikimediafoundation.org/>
Hello, quarry currently retains query results forever. This proves to be a
problem when removed data is retained in quarry. In order to improve this
while still leaving results accessible, results older than 90 days will be
removed. The queries will not be impacted by this change. And the results
can of course be regenerated (with current data) at any time by
resubmitting the query.
https://phabricator.wikimedia.org/T360041
The plan is for this to go into effect in later October (2024-10-21), could
go in earlier but I won't be here until then.
Thank you!
--
*Vivian Rook (They/Them)*
Site Reliability Engineer
Wikimedia Foundation <https://wikimediafoundation.org/>
tl;dr: Horizon login might be broken and/or look different off and on
tomorrow.
As part of ongoing gradual work to turn wikitech into an SUL wiki[0],
tomorrow we'll be switching Horizon over to use the WMF's single-sign-on
platform[1]. Here's what to expect:
- We probably won't get it right the first time, so Horizon logins might
be broken on and off tomorrow, Thursday, 2024-09-05
- Presuming all goes well, we'll leave things to use SSO, which means
the login dialog will look different from before.
- Login will use the same credentials as previously. If you're used to
logging in with your shell name, you may need to switch to using your
username instead (in other words, the name you would log into wikitech
with.)
- During this transition 2fa will no longer be required on Horizon.
Later in the process (possibly several weeks from now) the 2fa prompt
will appear in the SSO panel, at which point you'll be able to use the
same codes as before. Don't remove the codes from your 2fa app!
Bonus pointer: For account and key management which you might
historically have done on wikitech, you should now use
https://idm.wikimedia.org/. Wikitech logins remain unchanged for now but
most account-editing options have been removed.
[0] https://phabricator.wikimedia.org/T161859
[1] https://phabricator.wikimedia.org/T359590
Following several requests from users over the past eight years [0],
we are finally enabling access to ToolsDB's "public" databases (the
ones with a name ending with "_p") [1] from both Quarry [2] and
Superset [3].
The data stored in those databases have always been accessible to
every Toolforge user, but after this change they will become more
broadly accessible, as Quarry can be accessed by anyone with a
Wikimedia account, and saved queries in Quarry can be shared with
public links that require no login at all.
== This change is planned to go live on Monday, July 1st. ==
If you have any concerns or questions related to this change, please
leave a comment in the Phabricator task or one of its subtasks. [0]
Thanks to everyone for your patience and for keeping the task alive
over the years!
[0] https://phabricator.wikimedia.org/T151158
[1] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#Privileges_on_t…
[2] https://meta.wikimedia.org/wiki/Research:Quarry
[3] https://superset.wmcloud.org/
--
Francesco Negri (he/him) -- IRC: dhinus
Site Reliability Engineer, Cloud Services team
Wikimedia Foundation