Ori, Thanks for the heads up.
Can you please confirm that the problem here is not the number of requests to memcached, but the traffic volumne caused by the rather large sitelist blob? Can you tell us what the effective (compressed) size is you see in the replied from memcached?
We are currently trying to reduce the cases is which we hit memcached for the sitelist, but perhaps it would also be helpful to chop that list into smaller pieces. We rarely need all of it.
Thanks Daniel
PS: please note that wikidata-tech is the preferred list for discussing nitty gritty tech stuff, wikidata-l is (now mostly) about project contents and policy.
Am 06.09.2014 02:25, schrieb Ori Livneh:
In November of last year, Aaron noticed a spike in memcached traffic, which we were eventually able to attribute to Wikibase client fetching the SiteList on every request. When Katie fixed it, outbound memcached traffic nearly halved.
We're now back to the same rate of outbound traffic as then, and the culprit appears to be the same key.
See: http://i.imgur.com/v9ebld6.png
Tracked in https://bugzilla.wikimedia.org/show_bug.cgi?id=56602
Wikidata-l mailing list Wikidata-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-l