Suggesting that joins be just done in the application logic is frankly quite naive. I have one particular application where I need to join millions of entries each on about 50 projects. I used to have an application join algorithm years ago, when the data sets were much smaller and I supported way fewer projects. It was a disaster back then with extremely long run times and frequent failures (when serves went away etc.). It doesn't scale up. On-server joins increased the performance by orders of magnitude. I won't be able to go back to the old way. It sucks. Nobody is as sad about this as I am. I feel like the floor is put away under my feet and under my creation.

On Sat, Dec 23, 2017 at 11:32 AM John <phoenixoverride@gmail.com> wrote:

That's not a join. Doing it in the application layer means that both database tables must be fully loaded into RAM to process. Please do not call them the same thing as an application layer "JOIN" and a database join are far from the same thing.

On Sat, Dec 23, 2017 at 1:27 PM, Martin Urbanec <martin.urbanec@wikimedia.cz> wrote:

You can join them, but not by using database logic. You must join them in your application.

Martin

so 23. 12. 2017 v 19:03 odesílatel Maximilian Doerr <maximilian.doerr@gmail.com> napsal:

Ah.

Cyberpower678
English Wikipedia Account Creation Team
English Wikipedia Administrator

Global User Renamer

On Dec 23, 2017, at 12:58, John <phoenixoverride@gmail.com> wrote:

You can create user databases, however those are hosted on a different server than the replicas, and we cannot join them.

On Sat, Dec 23, 2017 at 12:55 PM, Maximilian Doerr <maximilian.doerr@gmail.com> wrote:

So users can no longer create their own DBs now?  Or am I missing something?

Cyberpower678

English Wikipedia Account Creation Team

English Wikipedia Administrator

Global User Renamer

On Dec 23, 2017, at 12:44, Martin Domdey <animalia@gmx.net> wrote:

Hi Maarten!

I didn't got it by -announce, but I need it too in close future.

Cheers,
Martin ...


--
Diese Nachricht wurde von meinem Android Mobiltelefon mit GMX Mail gesendet.

Am 23.12.2017, 14:29, Maarten Dammers <maarten@mdammers.nl> schrieb:

Hi everyone,

In the new database setup user databases are no longer possible on the
same servers as where the production databases are. I noticed on
https://phabricator.wikimedia.org/T142807 Daniel saying "Death blow for
GHEL coordinate extraction and WikiMiniAtlas." and on
https://phabricator.wikimedia.org/T183066 several tools broke down.

Do we have an overview of tools that are now broken? Did the database
admins actually contact the tool maintainers about the loss of
functionality or was this just send to the -announce list?

Maarten



_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

_______________________________________________ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud