[Cloud-announce] Wikireplicas: old cluster migrations start in 2 weeks. Please test your code with the new cluster - Cloud

Huji Lee

6 Apr 6 Apr

8:49 p.m.

Pardon my potentially dumb question, but how do the shorter DB names get resolved? I have python code that looks like this: *conn = mysqldb.connect(host="enwiki.labsdb", db="enwiki_p", read_default_file="~/replica.my.cnf")* How does *enwiki.labsdb* get resolved to, I am assuming, *enwiki.web.db.svc.wikimedia.cloud* and will this stop working on April 28th? On Tue, Mar 30, 2021 at 2:25 PM Joaquin Oltra Hernandez < jhernandez(a)wikimedia.org> wrote:

...

This is a reminder of the timeline dates shared on March 12, In two weeks -April 15- the old cluster will migrate to utilize new replication hosts, at which point replication may stop. In ~four weeks -April 28- the old hostnames will be redirected to the new cluster. If you can, please test your code works with the new cluster before the redirects are in place. - New host names <https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#New_host_names> - Help:Toolforge/Database <https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database> For questions and support reach out to #wikimedia-cloud on freenode IRC or email cloud(a)lists.wikimedia.org -- Joaquin Oltra Hernandez Developer Advocate - Wikimedia Foundation _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce _______________________________________________ Wikimedia Cloud Services mailing list Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

Reply

John

9:31 p.m.

Will we have a simple way to connect to the databases? One of the key reasons that "enwiki.labsdb" works so well is that from a programming level we dont have to worry about which server/slice a particular database is on. Using the <lang><project>_p at <lang><project>.labsdb created a simple uniform way to connect without having to keep track of what database moved to which slice (when that was added mid size wikis were being moved regularrly On Tue, Apr 6, 2021 at 3:11 PM Brooke Storm <bstorm(a)wikimedia.org> wrote:

...

On Apr 6, 2021, at 11:49 AM, Huji Lee <huji.huji(a)gmail.com> wrote: Pardon my potentially dumb question, but how do the shorter DB names get resolved? I have python code that looks like this: *conn = mysqldb.connect(host="enwiki.labsdb", db="enwiki_p", read_default_file="~/replica.my.cnf")* How does *enwiki.labsdb* get resolved to, I am assuming, *enwiki.web.db.svc.wikimedia.cloud* and will this stop working on April 28th? Those names were deprecated years ago and are not maintained (they only work for a certain fraction of databases). They are just CNAMES exactly like the others: enwiki.labsdb. 871 IN CNAME s1.analytics.db.svc.eqiad.wmflabs. I did mass grepping in Toolforge NFS and didn’t find any uses of them. So, I’m surprised they are still used anywhere, but recursive greps can miss things. So on those names: 1. Please don’t use them anyway because they will certainly go away at some point and only work for the oldest wikis. 2. Since they point at the old DNS names for the sections, they go wherever they go. If we redirect them to the new cluster, they’ll just keep working like before. They honestly need to be cleaned up (as part of the overall removal of “labs” names), but that’s a separate task that needs communication and so forth. —Brooke Storm _______________________________________________ Wikimedia Cloud Services mailing list Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

Reply

Huji Lee

9:47 p.m.

@Brooke: Thanks. This is an older script that I should have moved over but somehow forgot. I am surprised that you did not find it in your greps though. I will point it to the new servers momentarily. @John: I believe you still can use something similar. Instead of "enwiki.labdsdb" you can use "enwiki.web.db.svc.wikimedia.cloud" and not worry about which DB slice that belongs to. See https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#New_ho… On Tue, Apr 6, 2021 at 3:39 PM John <phoenixoverride(a)gmail.com> wrote:

...

is meta_p still supported? On Tue, Apr 6, 2021 at 3:31 PM John <phoenixoverride(a)gmail.com> wrote:

Will we have a simple way to connect to the databases? One of the key reasons that "enwiki.labsdb" works so well is that from a programming level we dont have to worry about which server/slice a particular database is on. Using the <lang><project>_p at <lang><project>.labsdb created a simple uniform way to connect without having to keep track of what database moved to which slice (when that was added mid size wikis were being moved regularrly On Tue, Apr 6, 2021 at 3:11 PM Brooke Storm <bstorm(a)wikimedia.org> wrote:

On Apr 6, 2021, at 11:49 AM, Huji Lee <huji.huji(a)gmail.com> wrote: Pardon my potentially dumb question, but how do the shorter DB names get resolved? I have python code that looks like this: *conn = mysqldb.connect(host="enwiki.labsdb", db="enwiki_p", read_default_file="~/replica.my.cnf")* How does *enwiki.labsdb* get resolved to, I am assuming, *enwiki.web.db.svc.wikimedia.cloud* and will this stop working on April 28th? Those names were deprecated years ago and are not maintained (they only work for a certain fraction of databases). They are just CNAMES exactly like the others: enwiki.labsdb. 871 IN CNAME s1.analytics.db.svc.eqiad.wmflabs. I did mass grepping in Toolforge NFS and didn’t find any uses of them. So, I’m surprised they are still used anywhere, but recursive greps can miss things. So on those names: 1. Please don’t use them anyway because they will certainly go away at some point and only work for the oldest wikis. 2. Since they point at the old DNS names for the sections, they go wherever they go. If we redirect them to the new cluster, they’ll just keep working like before. They honestly need to be cleaned up (as part of the overall removal of “labs” names), but that’s a separate task that needs communication and so forth. —Brooke Storm _______________________________________________ Wikimedia Cloud Services mailing list Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________

Wikimedia Cloud Services mailing list Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

Reply