[Labs-l] Proposed session for the Wikimedia Developer Summit 2017: "Labsdbs for WMF tools and contributors: get more data, faster"

Jaime Crespo jcrespo at wikimedia.org
Sun Nov 27 15:11:38 UTC 2016


Hi all,

Even if I am not a developer myself, I have proposed a session for the next
Wikimedia Developer Summit 2017 [0] called "Labsdbs for WMF tools and
contributors: get more data, faster". If anyone would be interested on it
taking place, please comment/vote with an award token at the proposal page
[1]. I hope that is of interest for all tools and labs users.

Databases for Tools and labs have several issues:

* The current capacity vs. need is currently limited
* Needs of researchers doing analytical work (long running queries) are
very different from those serving webrequest tools (fast response time, no
lag).
* Using MySQL/MariaDB efficiently is hard, and not always very well
documented, and in some ways harder in the labs environment due to privacy
and legal restrictions
* Sometimes, normally by accident, certain applications take over more
resources than adequate for a multi-user environment

I intend to address those issues, hear suggestions and announce work in
progress at the proposed session, as well as provide a place to ask
questions on how to make tools run faster. Even if you do not/cannot
attend, I intend to release the materials generated (obviously) freely.


[0] <url:https://www.mediawiki.org/wiki/Wikimedia_Developer_Summit>
[1] <url:https://phabricator.wikimedia.org/T149624>
-- 
Jaime Crespo
<http://wikimedia.org>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-l/attachments/20161127/964beda8/attachment.html>


More information about the Labs-l mailing list