[Labs-l] Upgrading labs db replicas to MariaDB 10

[Silke Meyer]

Hi Sean, Coren, and all!

This is great news!!! Thanks for changing plans!
Once you are good to go: What do I have to do to convince you to start with s5?

Mantra s5 s5 s5 s5 s5 s5 s5 !!!!!!!!

Best Silke


2014-07-14 22:22 GMT+02:00 Sean Pringle <springle at wikimedia.org>:
> Hi!
>
> The labs db replicas run MariaDB 5.5 and currently suffer in a few ways:
>
> - FEDERATED tables are not suited to some of our traffic.
> - Load is unevenly distributed across mysqld instances.
> - Issues with disk IO, mainly write spikes.
>
> Probably people have other difficulties and pet hates :) but from Ops'
> perspective these are some core problems requiring immediate attention.
>
> After speaking with Coren, we've decided to go ahead and upgrade the labsdb
> instances to MariaDB 10 asap. This is something we've done on the production
> Analytics slaves with great success, and we think it will help labsdb too.
>
> We will gain:
>
> - Multisource replication. Each labsdb instance will gain local copies of
> the wikis currently using federated tables. Commons, wikidata, etc.
>
> - Multithreaded replication. A pool of threads will be used for replication
> in place of the old single SQL thread, to reduce lag.
>
> - TokuDB. This storage engine complements InnoDB and is particularly good
> for write-heavy environments, on-disk compression, and datasets larger than
> available memory. The wikis will use it by default.
>
> - A bunch of other stuff [1].
>
> The time frame for the upgrade is not yet finalized except to say "real soon
> now" :) There is some preparation to be done, which would place the first
> labsdb instance upgrade around the end of July. More information to follow.
>
> BR
> Sean
>
> [1]
> https://mariadb.com/kb/en/mariadb/what-is-in-the-different-mariadb-releases/what-is-mariadb-100/
>
> --
> DBA @ WMF
>
> _______________________________________________
> Labs-l mailing list
> Labs-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/labs-l
>



-- 
Silke Meyer
Internes IT-Management und Projektmanagement Toolserver

Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 260

http://wikimedia.de

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg
unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das
Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.