On what particular day did the rollout occur in December? The chart suggests 14 Dec ?

Also please let me know when the issue has been fixed.

I am asking because I hope to present better stats by extrapolation,

after discarding input from last x days of December and first y days of January.

http://stats.wikimedia.org/EN/TablesPageViewsMonthlyOriginalMobile.htm

We cannot fix the original data, those were transient, udp messages updated counter, and got discarded.

For traffic reports based on 1:1000 sampled squid/varnish log, we can filter unwanted traffic, if we know exactly what to filter out, and rerun.

Erik

From: analytics-bounces@lists.wikimedia.org [mailto:analytics-bounces@lists.wikimedia.org] On Behalf Of Max Semenik
Sent: Tuesday, January 08, 2013 3:48 PM
To: Asher Feldman
Cc: A mailing list for the Analytics Team at WMF and everybody who has an interest in Wikipedia and analytics.; Tomasz Finc; mobile-tech; Brion Vibber; Arthur Richards
Subject: Re: [Analytics] Suspicious increase in mobile pv's

Indeed, in December we've rolled out a change that removed the bogus code that previously prevented redirection to canonical URLs. However, search JS uses raw URL-encoding which results in people visiting a lot of non-canonical URLs. I attempted a fix in https://gerrit.wikimedia.org/r/#/c/42766/ - hope to squeeze it in today's deployment.

On Tue, Jan 8, 2013 at 4:47 AM, Asher Feldman <afeldman@wikimedia.org> wrote:

It looks like the December numbers are indeed skewed, possibly due to a link encoding change in mobilefrontend that is doubling many requests. 

I counted en.m.wikipedia/wiki/article requests and my total count agrees with stats.wikimedia (around 2B), but http 301 redirects went from being around 1% of responses to >18% in one random mid-december day. 

An example is:

cp1044.wikimedia.org 214632678 2013-01-08T00:27:24 0.094004869 0.0.0.0 miss/301 20 GET http://en.m.wikipedia.org/wiki/Pawn%20(chess) - text/html; charset=utf-8 http://en.m.wikipedia.org/wiki/Rules_of_chess - Mozilla/5.0%20(iPhone;%20CPU%20iPhone%20OS%206_0_1%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Version/6.0%20Mobile/10A523%20Safari/8536.25 en-us -

The correct article name for the above example is http://en.m.wikipedia.org/wiki/Pawn_(chess).  The desktop site in safari provides a correct link, but the mobile site converts the underscore to an encoded space. 

There may be some other issues as well - the number of requests with a blank referrer have increased heavily.  This is partially due to ios6 using google over ssl, but the number of blank referrers increased heavily for android as well.  My rough estimate is that mobile pageviews actually increased by around 1/3 in december.

On Mon, Jan 7, 2013 at 2:00 PM, Diederik van Liere <dvanliere@wikimedia.org> wrote:

Hi all,

It has come to our attention that there is quite a big jump in mobile pageviews on http://stats.wikimedia.org/EN/TablesPageViewsMonthlyMobile.htm

We are looking into the exact cause of it right now, but suffice to say for now, do not use these numbers for the month of December 2012.

Best,

Diederik

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics