Next Monday, November 25th, at around 13:00 UTC, ToolsDB will be
upgraded from MariaDB v10.4.29 to MariaDB v10.6.19. [0]
I have already created a new host "tools-db-4" that is running the new
version, and is replicating from the current primary. On Monday, I
will fail over the current primary to the new host. [1]
All connections will be dropped and the DNS will be updated to point
to the new host. Tools should automatically reconnect to the new host.
No downtime is expected but there will be a few minutes of read-only
time.
For most tools, the upgrade should be painless. However, you might
want to check the official docs listing incompatible changes
introduced in version 10.5 [2] and 10.6. [3]
If you find any issues, please let us know in the #wikimedia-cloud IRC channel.
[0] https://phabricator.wikimedia.org/T352206
[1] https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/ToolsDB#Failing_…
[2] https://mariadb.com/kb/en/upgrading-from-mariadb-10-4-to-mariadb-10-5/
[3] https://mariadb.com/kb/en/upgrading-from-mariadb-10-5-to-mariadb-10-6/
--
Francesco Negri (he/him) -- IRC: dhinus
Site Reliability Engineer, Cloud Services team
Wikimedia Foundation
On Friday I will delete the following VMs. All are running the
long-deprecated Debian Buster OS and have been shut down for several
months without user response or complaint.
Please respond directly to me if you need any of the above to be
preserved in some form. Context can be found at
https://phabricator.wikimedia.org/T331738.
centralnotice-staging:
cn-staging-3.centralnotice-staging.eqiad1.wikimedia.cloud
commons-corruption-checker:
main.commons-corruption-checker.eqiad1.wikimedia.cloud
deployment-prep:
deployment-docker-proton01.deployment-prep.eqiad1.wikimedia.cloud
deployment-echostore02.deployment-prep.eqiad1.wikimedia.cloud
deployment-maps-master01.deployment-prep.eqiad1.wikimedia.cloud
deployment-poolcounter06.deployment-prep.eqiad1.wikimedia.cloud
deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud
etytree:
etytree-a.etytree.eqiad1.wikimedia.cloud
mediawiki-vagrant:
mwv-builder-03.mediawiki-vagrant.eqiad1.wikimedia.cloud
schematreerecommender:
recommender.schematreerecommender.eqiad1.wikimedia.cloud
stress-tester.schematreerecommender.eqiad1.wikimedia.cloud
wikicommunityhealth:
backend.wikicommunityhealth.eqiad1.wikimedia.cloud
frontend.wikicommunityhealth.eqiad1.wikimedia.cloud
wikispore:
wikispore-prod.wikispore.eqiad1.wikimedia.cloud
If you are using wiki replicas to query the "wikidatawiki" database
(section s8), please be aware that we are expecting replication lag to
grow up to 10 days, because of some ongoing maintenance work [0].
Only section s8 is affected, which contains only the "wikidatawiki"
database. [1] Queries against other databases should not see any lag.
This is going to impact tools using wiki replicas, as well as queries
running on Quarry or PAWS.
You can check the current replication lag at https://replag.toolforge.org/
Thanks for your patience while we complete this maintenance work.
[0] https://phabricator.wikimedia.org/T367856
[1] https://noc.wikimedia.org/db.php#tabs-s8
--
Francesco Negri (he/him) -- IRC: dhinus
Site Reliability Engineer, Cloud Services team
Wikimedia Foundation