On Thursday, April 21, 2016, bawolff bawolff+wn@gmail.com wrote:
When doing something like that from a read request, there's also the problem for a popular page that there might be lots of views (maybe thousands if the queue is a little backed up) before the job is processed. So if the view triggers the job, and it will only stop triggering inserting the job after the job has been executed, this might cause a large number of useless jobs to be en-queued until one of them is finally executed.
Can PoolCounter help with that? Docs are a little sparse, but it was put in place to prevent that sort of backup trying to run the same stuff over and over simultaneously.
-- brion
-- -bawolff
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org javascript:; https://lists.wikimedia.org/mailman/listinfo/wikitech-l