Hello, all!
This email contains valuable information about the Toolforge service.
Starting today, we're initiating a process to migrate away from Debian
Stretch to Debian Buster for all of Toolforge servers, and the most
affected piece is the Grid Engine backend in particular.
Debian Stretch was released in June 2017, and long term support for it
(including security updates) will cease in June 2022. We need to shut
down all Stretch hosts before the end of support date to ensure that
Toolforge remains a secure platform. This migration will take several
months because many people still use the Stretch hosts and our users
are working on tools in their spare time.
You should be aware that our ultimate goal is to deprecate Grid Engine
entirely and replace it with Kubernetes. Read below for more information
on this.
== Initial timeline ==
Subject to change, see Wikitech[1] for living timeline.
* 2022-02-15: Availability of Debian Buster grid announced to community
* 2022-03-21: Weekly reminders via email to tool maintainers for tools
still running on Stretch
* Week of 2022-04-21:
** Daily reminders via email to tool maintainers for tools still running on
Stretch
** Switch login.toolforge.org to point to Buster bastion
* Week of 2022-05-02: Evaluate migration status and formulate plan for
final shutdown of Stretch grid
* Week of 2022-05-21: Shut down Stretch grid
== What is changing? ==
* New bastion hosts running Debian Buster with connectivity to the new job
grid
* New versions of PHP, Python3, and other language runtimes
* New versions of various support libraries
== What should I do? ==
You should migrate your Toolforge tool to a newer environment.
You have two options:
* migrate from Toolforge Stretch Grid Engine to Toolforge Kubernetes[3].
* migrate from Toolforge Stretch Grid Engine to Toolforge Buster Grid
Engine.
The Cloud Services team has created the Toolforge Stretch
deprecation[0] page on wikitech.wikimedia.org to document basic steps
needed to move web services, cron jobs, and continuous jobs from the
old Stretch grid to the new Buster grid. That page also provides more
details on the language runtime and library version changes and will
provide answers to common problems people encounter as we find them.
If the answer to your problem isn't on the wiki, ask for help using
any of our communication channels[2].
We encourage you to move to Kubernetes today if you can, see below for
more details.
For those who can't migrate to Kubernetes, the Debian Buster grid should
be adopted within the next three months.
== A note on the future of Toolforge, the Grid and Kubernetes ==
As of today, Toolforge is powered by both Grid Engine and Kubernetes.
For a number of reasons, we have decided to deprecate Grid Engine and
replace all of its functions with Kubernetes. We're not yet ready to
offer all grid-like features on Kubernetes, but we're working on it.
As soon as we are able, we will begin the process of migrating the
workloads and shutting down the grid. This is something we hope to do
between 2022 and 2023.
We share this information to encourage you to evaluate migrating your
tool away from Grid Engine to Kubernetes.
One of the most prominent missing features on Kubernetes was a friendly
command line interface to schedule jobs (like jsub). We've been working
on that, and have a beta-level interface that you can try today: the
Toolforge jobs framework [4].
[0]: https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation
[1]:
https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Time…
[2]:
https://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Commun…
[3]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes
[4]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs-Framework
Thanks.
--
Seyram Komla Sapaty
Developer Advocate
Wikimedia Cloud Services
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…
Hello again, Wikimedia Hackers!
We invite technical community members and affiliates to apply for Rapid
Fund grants to host local meetups during or around the Hackathon. Grants
can be between 500 and 5,000 USD. Please note that we cannot go above 5,000
USD per grant, so plan accordingly. The deadline to apply is March 20,
2022. This is a quick turn-around, so note that proposals do not have to be
extensive or complex.
Examples of requests include:
-
Food for community meetups before, during, or after the online Hackathon
(please keep meetups within a month of the Hackathon dates).
-
Venue rental for attendees
-
Transportation or commuting expenses
-
Scholarships to help local community members attend, which can include
data packages, childcare costs, or transportation
-
The Foundation offers this list of eligible expenses
<https://meta.wikimedia.org/wiki/Grants:Project/Rapid/Learn> (e.g., you
can use this grant money to pay for direct expenses like supplies, but you
cannot use funds to pay for an event coordinator). You cannot pay
honorariums to speakers you have at your events but you can give material
gifts (gift cards, etc.).
-
Note that at this moment, in-person meetups of 10 people or fewer can be
held without extra approval; if your meetup will be larger please follow
the steps listed for Risk Assessment.
<https://meta.wikimedia.org/wiki/Grants:Risk_assessment_during_COVID-19>
Eligibility:
-
Proposals should support the achievement of Wikimedia’s mission
<https://meta.wikimedia.org/wiki/Mission> and be related to the
Hackathon (this cannot support edit-a-thon projects for example).
-
There are some countries to which the Foundation cannot disburse funds.
If you have been ineligible for WMF funds through other opportunities,
please email hlepp(a)wikimedia.org to verify your eligibility for this
application.
-
Both individuals and organizations are welcome to apply.
-
Someone in your group must have access to a bank account which can
receive international wire transfers.
-
The Code of Conduct for Wikimedia's Technical Spaces
<https://www.mediawiki.org/wiki/Special:MyLanguage/Code_of_Conduct> will
be in effect throughout the event, on all platforms and at local meetups.
Please have a look at it and ensure you are willing and able to follow it.
How to Apply: Start your application
<https://meta.wikimedia.org/wiki/Grants:Project/Rapid/Apply#Other> in the
yellow box marked “Other”. Enter the title of your proposal: Hackathon +
[Institution/Group/Individual Name] (e.g., Hackathon University of Ghana
Legon) and click “Start my application”. Submit the application. Any
questions can be sent to hlepp(a)wikimedia.org.
Cheers,
Your Wikimedia Hackathon Committee
Hello everyone,
Thank you for participating in the first Small wiki toolkits workshop last
week!
We had a bit of a delay in the kick-off. My sincere apologies if you missed
the session due to an error in handling logistics on our end.
We have added the video recording and the slides on the workshops page that
you may now explore.
<
https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops#Intro_to_Pywi…>
[1]
Join the Telegram chat if you would like to learn about the upcoming
workshops and connect with fellow participants <
https://t.me/joinchat/Z_b1MR8O0wAzZmVh> [2]. We will also be sharing a
feedback form with participants soon on this channel.
We are looking forward to your participation in future workshops!
Cheers,
Srishti
On behalf of the SWT organizing team
[1]
https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops#Intro_to_Pywi…
[2] https://t.me/joinchat/Z_b1MR8O0wAzZmVh
*Srishti Sethi*
Senior Developer Advocate
Wikimedia Foundation <https://wikimediafoundation.org/>
On Fri, Feb 25, 2022 at 8:05 AM 4nn1l2 <4nn1l2.wiki(a)gmail.com> wrote:
> Are you holding the workshop now?
>
> On Thu, Feb 24, 2022 at 9:59 AM effe iets anders <effeietsanders(a)gmail.com>
> wrote:
>
>> I love this idea! Thank you for organizing this!
>>
>> I look forward to the videos produced for this too.
>>
>> Warmly,
>> Lodewijk
>>
>> On Wed, Feb 23, 2022 at 6:07 PM Srishti Sethi <ssethi(a)wikimedia.org>
>> wrote:
>>
>>> Hello everyone,
>>>
>>> Thank you all for signing up for the bot workshops! :)
>>>
>>> The first workshop on the topic of “Pywikibot framework introduction &
>>> installation” is coming up - it will take place on *Friday, February
>>> 25th at 16:00 UTC*.
>>>
>>> You can find more details on the workshop and a link to join here <
>>> https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops#Intro_to_Pywi…>
>>> [1].
>>>
>>> We will record this workshop and update the workshops page with the link
>>> later. Also, a quick note on the certificate distribution we shared briefly
>>> in the previous email - out of the eight planned workshops, individuals who
>>> will complete five and a final assignment will receive a digital
>>> certificate.
>>>
>>> We look forward to your participation!
>>>
>>> Cheers,
>>> Srishti
>>>
>>> (On behalf of the SWT Workshops Organization team)
>>>
>>> [1]
>>> https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops#Intro_to_Pywi…
>>>
>>>
>>> *Srishti Sethi*
>>> Senior Developer Advocate
>>> Wikimedia Foundation <https://wikimediafoundation.org/>
>>>
>>>
>>>
>>> On Mon, Jan 31, 2022 at 6:52 PM Srishti Sethi <ssethi(a)wikimedia.org>
>>> wrote:
>>>
>>>> Hi all,
>>>>
>>>> TLDR; Want to learn new technical skills to help improve your wiki?
>>>> Sign up for workshops on scripts and bot development, organized by the
>>>> small wiki toolkits initiative: <
>>>> https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops> [1].
>>>>
>>>> Small wiki toolkits (SWT) is an initiative to build technical capacity
>>>> in smaller language wikis by developing toolkits, conducting workshops, and
>>>> providing technical support <
>>>> https://meta.wikimedia.org/wiki/Small_wiki_toolkits> [2]. The first
>>>> set of workshops for 2022 will teach individuals how to automate work in
>>>> their wiki community by developing, maintaining, and hosting bots. These
>>>> trainings build upon the lessons learned from two regional initiatives in
>>>> 2021: <https://meta.wikimedia.org/wiki/Small_wiki_toolkits#Past_events>
>>>> [3].
>>>>
>>>> To sign up for a workshop, add your signature under a specific workshop
>>>> section on this page <
>>>> https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops> [4].
>>>> The first workshop is scheduled for February 25th, 16:00 UTC. The
>>>> organizing team will share more details on mailing lists and on your talk
>>>> page closer to the date of the workshop.
>>>>
>>>> The SWT Organizing Team is also exploring issuing digital certificates
>>>> and badges to attendees of these workshops. More information on that will
>>>> be available in the coming weeks.
>>>>
>>>> We look forward to your participation!
>>>>
>>>> Cheers,
>>>> Srishti
>>>>
>>>> (On behalf of the SWT Workshops Organization team)
>>>>
>>>> [1] https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops
>>>>
>>>> [2] https://meta.wikimedia.org/wiki/Small_wiki_toolkits
>>>>
>>>> [3] https://meta.wikimedia.org/wiki/Small_wiki_toolkits#Past_events
>>>>
>>>> [4] https://meta.wikimedia.org/wiki/Small_wiki_toolkits/Workshops
>>>>
>>>> *Srishti Sethi*
>>>> Senior Developer Advocate
>>>> Wikimedia Foundation <https://wikimediafoundation.org/>
>>>>
>>>> _______________________________________________
>>> Wikimedia-l mailing list -- wikimedia-l(a)lists.wikimedia.org, guidelines
>>> at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and
>>> https://meta.wikimedia.org/wiki/Wikimedia-l
>>> Public archives at
>>> https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org…
>>> To unsubscribe send an email to wikimedia-l-leave(a)lists.wikimedia.org
>>
>> _______________________________________________
>> Wikimedia-l mailing list -- wikimedia-l(a)lists.wikimedia.org, guidelines
>> at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and
>> https://meta.wikimedia.org/wiki/Wikimedia-l
>> Public archives at
>> https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org…
>> To unsubscribe send an email to wikimedia-l-leave(a)lists.wikimedia.org
>
>