Thanks Dan!
On Tue, Nov 19, 2013 at 4:26 PM, Dan Andreescu <dandreescu(a)wikimedia.org>wrote;wrote:
K, so a quick follow-up on this. Jon and I worked
today and identified
two short term problems.
1.
http://mobile-reportcard.wmflabs.org/graphs/edits-monthly-5plus-editors no
longer updates because the query used for it takes too long to finish
2. the scripts run hourly even for graphs that only need to be updated
daily
For 1, I fiddled with the SQL until it performed a little better. It was
also not correct, as I believe it was getting "the number of people who
created an account in month X and made >= 5 edits anytime". I changed it
to what I assumed we wanted, which is "the number of people who created an
account and made >= 5 edits in month X". This new query (
https://gist.github.com/milimetric/7554108) takes 4 minutes to run 3
months' worth. Juliusz, any idea what the timeout is on that job? I'm
running the query now for 13 months and if it's < timeout, we can just
deploy it. Otherwise, we can maybe run one month at a time and concat
results. Let me know what you think and I'll make a Change
This is actually not correct - the query is supposed to be who created an
account in month X and made >= 5 edits ever. But, if we can't make that
kind of query performant enough... are you ok with this change, Kenan?
--
Arthur Richards
Software Engineer, Mobile
[[User:Awjrichards]]
IRC: awjr
+1-415-839-6885 x6687