I wrote:
I've implemented a "maxlag" parameter to
index.php which can be used by
bots to voluntarily throttle their write rate and mitigate slave lag on
the server.
http://www.mediawiki.org/wiki/Maxlag_parameter
It came out of the discussion here:
http://en.wikipedia.org/wiki/Wikipedia:Bot_owners%27_noticeboard#Maxlag_par…
Permalink:
http://en.wikipedia.org/w/index.php?title=Wikipedia:Bot_owners%27_noticeboa…
In the long term it will probably be better to have a "nice level"
parameter, with server-defined interpretation, to signal that the bot will
understand 503/Retry-After. There are other metrics we could incorporate
apart from lag.
-- Tim Starling