Hi Everyone,
just a wanted to post a quick summary of what I did today in order to significantly reduce the SiteStore related memcached traffic.
I stumbled upon this comment https://phabricator.wikimedia.org/T58602#808530 and thus poked a bit at when we load sites from memcached. During that I found that we still were loading the sites basically all the time. To get the number of that down, I uploaded the following patches that have been reviewed, merged and even deployed yet (thanks for the reviews Daniel and Katie):
* Don't lookup Sites from mc for the 'languageLinkSiteGroup' setting: https://gerrit.wikimedia.org/r/177419 * Don't load all sites for LangLinkHandler: https://gerrit.wikimedia.org/r/177429 * Don't access sites on WikibaseClient::getEntityIdForTitle: https://gerrit.wikimedia.org/r/177434
That lead to a noticeable memcached traffic change (see attachment). Memcached traffic graphs: https://ganglia.wikimedia.org/latest/graph_all_periods.php?c=Memcached% 20eqiad&m=cpu_report&r=hour&s=by% 20name&hc=4&mc=2&st=1417641558&g=network_report&z=large
I still have https://gerrit.wikimedia.org/r/177416 in review, which slightly changes the behavior of the other projects sidebar, but I think that this change also has quite some potential to reduce memcached traffic even further. Would be great if we could get that ready for backporting until Monday.
Cheers,
Marius
