On Thursday we will be migrating most toolforge databases to a new server. Thiswill take place on Thursday at 17:00UTC. During this window ToolsDBwill be read-only and most tools that rely on writing to the database will fail.
This migration should take about an hour but unexpected side-effects may extend the downtime.
-- details --
DB outage Thursday: As part of the ongoing effortto upgrade user-created Toolforge databases, we willmigrate ToolsDB to a new VM that will have a more recent version of Debian and MariaDB and will use a more resilient storage solution.
The new VM is ready, and we plan to point all tools to use it on *Apr, 6 2023 at 17:00 UTC*.
This will involve about *1 hour of read-only time*for the database. Any existing database connection will be terminated, and if your tool does not reconnect automatically you might have to restart it manually.
An email will be sent shortly before starting the migration, and when it's finished.
Please also make sure your tool is connecting to the database using the canonical hostname *tools.db.svc.wikimedia.cloud*and not any other hostname or IP address.
For more details, and to report any issue, you can read or leave a comment at https://phabricator.wikimedia.org/T333471
For more context you can also check out the parent task https://phabricator.wikimedia.org/T301949
_______________________________________________ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.o...
Reminder that this is starting in 1 hour. I will send another email when this is done.
Thanks for your patience.
On Mon, Apr 3, 2023 at 6:57 PM Andrew Bogott abogott@wikimedia.org wrote:
On Thursday we will be migrating most toolforge databases to a new server. This will take place on Thursday at 17:00UTC. During this window ToolsDB will be read-only and most tools that rely on writing to the database will fail.
This migration should take about an hour but unexpected side-effects may extend the downtime.
-- details --
DB outage Thursday: As part of the ongoing effort to upgrade user-created Toolforge databases, we will migrate ToolsDB to a new VM that will have a more recent version of Debian and MariaDB and will use a more resilient storage solution.
The new VM is ready, and we plan to point all tools to use it on Apr, 6 2023 at 17:00 UTC.
This will involve about 1 hour of read-only time for the database. Any existing database connection will be terminated, and if your tool does not reconnect automatically you might have to restart it manually.
An email will be sent shortly before starting the migration, and when it's finished.
Please also make sure your tool is connecting to the database using the canonical hostname tools.db.svc.wikimedia.cloud and not any other hostname or IP address.
For more details, and to report any issue, you can read or leave a comment at https://phabricator.wikimedia.org/T333471
For more context you can also check out the parent task https://phabricator.wikimedia.org/T301949 _______________________________________________ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.o...
The migration is now complete and tools-db-1 is the new primary ToolsDB server, running MariaDB 10.4.28.
A big thank you to Andrew, David and Amir for their emotional and technical support during this maintenance. :)
If you notice anything not working as expected, please add a comment at https://phabricator.wikimedia.org/T333471 or ask in #wikimedia-cloud.
Thanks!
On Thu, Apr 6, 2023 at 6:07 PM Francesco Negri fnegri@wikimedia.org wrote:
Reminder that this is starting in 1 hour. I will send another email when this is done.
Thanks for your patience.
On Mon, Apr 3, 2023 at 6:57 PM Andrew Bogott abogott@wikimedia.org wrote:
On Thursday we will be migrating most toolforge databases to a new server. This will take place on Thursday at 17:00UTC. During this window ToolsDB will be read-only and most tools that rely on writing to the database will fail.
This migration should take about an hour but unexpected side-effects may extend the downtime.
-- details --
DB outage Thursday: As part of the ongoing effort to upgrade user-created Toolforge databases, we will migrate ToolsDB to a new VM that will have a more recent version of Debian and MariaDB and will use a more resilient storage solution.
The new VM is ready, and we plan to point all tools to use it on Apr, 6 2023 at 17:00 UTC.
This will involve about 1 hour of read-only time for the database. Any existing database connection will be terminated, and if your tool does not reconnect automatically you might have to restart it manually.
An email will be sent shortly before starting the migration, and when it's finished.
Please also make sure your tool is connecting to the database using the canonical hostname tools.db.svc.wikimedia.cloud and not any other hostname or IP address.
For more details, and to report any issue, you can read or leave a comment at https://phabricator.wikimedia.org/T333471
For more context you can also check out the parent task https://phabricator.wikimedia.org/T301949 _______________________________________________ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.o...
-- Francesco Negri (he/him) -- IRC: dhinus Site Reliability Engineer, Cloud Services team Wikimedia Foundation