see https://meta.wikimedia.org/wiki/Research:Mobile_editor_engagement/Mobile_act...
On Nov 19, 2013, at 4:04 PM, Arthur Richards arichards@wikimedia.org wrote:
Thanks Dan!
On Tue, Nov 19, 2013 at 4:26 PM, Dan Andreescu dandreescu@wikimedia.org wrote: K, so a quick follow-up on this. Jon and I worked today and identified two short term problems.
- http://mobile-reportcard.wmflabs.org/graphs/edits-monthly-5plus-editors no longer updates because the query used for it takes too long to finish
- the scripts run hourly even for graphs that only need to be updated daily
For 1, I fiddled with the SQL until it performed a little better. It was also not correct, as I believe it was getting "the number of people who created an account in month X and made >= 5 edits anytime". I changed it to what I assumed we wanted, which is "the number of people who created an account and made >= 5 edits in month X". This new query (https://gist.github.com/milimetric/7554108) takes 4 minutes to run 3 months' worth. Juliusz, any idea what the timeout is on that job? I'm running the query now for 13 months and if it's < timeout, we can just deploy it. Otherwise, we can maybe run one month at a time and concat results. Let me know what you think and I'll make a Change
This is actually not correct - the query is supposed to be who created an account in month X and made >= 5 edits ever. But, if we can't make that kind of query performant enough... are you ok with this change, Kenan?
-- Arthur Richards Software Engineer, Mobile [[User:Awjrichards]] IRC: awjr +1-415-839-6885 x6687 _______________________________________________ Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics