This is the next step after disallowing user databases
on replicas. It
broke some of my tools but I recently rewrote them to move joining logic
into my application. I also replicate small amounts of data (e.g. page
titles for a subset of pages) into my user db for joins.
I found it quite off-putting at first. Volunteers are effectively forced
to do substantial amounts of extra work after creating tools that "work
perfectly fine".
But I can understand the need to provide more scalable infrastructure with
the ever growing projects.
On Sat, Mar 13, 2021, 3:46 PM Yetkin Sakal via Cloud <
cloud(a)lists.wikimedia.org> wrote:
I completely agree with Maarten. It would be a
step backward to stop
supporting cross-database joins on wiki replicas. This is a breaking change
and should not be applied unless a feasible solution to the problem is
found.
On Saturday, March 13, 2021, 8:17:39 PM GMT+3, Maarten Dammers <
maarten(a)mdammers.nl> wrote:
Hi Joaquin,
Completely nothing was done with the community input about not being able
to do cross wiki joins anymore [1]. In the past the WMF would do something
with community input. I guess the new strategy is to just give the
appearance of community input to legitimize a decision. Nice way to
alienate the volunteers.
Maarten
[1]
https://lists.wikimedia.org/pipermail/cloud/2020-November/thread.html#1309
On 12-03-2021 19:16, Joaquin Oltra Hernandez wrote:
TLDR:
- Instead of `*.db.svc.eqiad.wmflabs` use `*.db.svc.wikimedia.cloud` to
use the new replicas
- Quarry will migrate March 23 to use the new cluster
- In a ~month (April 15) the old cluster will start retiring. See
https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Timeli…
for more details
Hi everyone,
I'm happy to announce that the new replicas cluster is available for use
after a few weeks open for testing.
To use the new cluster, you will only need to change the hostname when
connecting to the databases. Instead of `*.db.svc.eqiad.wmflabs` you can
use `*.db.svc.wikimedia.cloud`. See:
-
https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#New_ho…
-
https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_ca…
-
https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database
This brings us to the timeline updates:
https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#Timeli…
- March 2021
- Announce new cluster domains for all users - March 12
- Migrate Quarry to use the new cluster - March 23
- April 2021
- PAWS migration - Estimated first week of April
- Migrate the old cluster to utilize new replication hosts. Replication
may stop. - April 15
- Redirect old hostnames to the new cluster - April 28
Quarry is ready so it will transition first to use the new replicas. This
will happen on March 23, at which point we will deploy the changes and
update the docs. We are publishing a note on Tech news but if there are
other venues where this information would be useful please help us spread
the word.
PAWS is in the process of being migrated. We estimate it could be ready
to use the new cluster at the beginning of April, and will publish more
details as soon as we know.
On April 15 the old cluster will be moved under the new replication
hosts, at which point there may be side effects and replication may stop.
We recommend you update your code earlier to use the new hostnames to
verify things are working normally.
Not long after, the old hostnames (`*.db.svc.eqiad.wmflabs`) will be
redirected to the new ones (`*.db.svc.wikimedia.cloud`), at which point the
old cluster will effectively be inaccessible.
If you have questions or need help please reply to
cloud(a)lists.wikimedia.org, join the #wikimedia-cloud IRC channel, or
open a ticket in Phabricator with the Data-Services tag.
Thanks,
_______________________________________________
Wikimedia Cloud Services announce mailing listCloud-announce(a)lists.wikimedia.org
(formerly
labs-announce@lists.wikimedia.org)https://lists.wikimedia.org/mailman/listinfo/cloud-announce
_______________________________________________
Wikimedia Cloud Services mailing listCloud(a)lists.wikimedia.org (formerly
labs-l@lists.wikimedia.org)https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________
Wikimedia Cloud Services mailing list
Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________
Wikimedia Cloud Services mailing list
Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________
Wikimedia Cloud Services mailing list
Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org)