On what particular day did the rollout occur in December? The chart suggests
14 Dec ?
Also please let me know when the issue has been fixed.
I am asking because I hope to present better stats by extrapolation,
after discarding input from last x days of December and first y days of
January.
http://stats.wikimedia.org/EN/TablesPageViewsMonthlyOriginalMobile.htm
We cannot fix the original data, those were transient, udp messages updated
counter, and got discarded.
For traffic reports based on 1:1000 sampled squid/varnish log, we can filter
unwanted traffic, if we know exactly what to filter out, and rerun.
Erik
cid:image001.png@01CDE938.42042260
From: analytics-bounces(a)lists.wikimedia.org
[mailto:analytics-bounces@lists.wikimedia.org] On Behalf Of Max Semenik
Sent: Tuesday, January 08, 2013 3:48 PM
To: Asher Feldman
Cc: A mailing list for the Analytics Team at WMF and everybody who has an
interest in Wikipedia and analytics.; Tomasz Finc; mobile-tech; Brion
Vibber; Arthur Richards
Subject: Re: [Analytics] Suspicious increase in mobile pv's
Indeed, in December we've rolled out a change that removed the bogus code
that previously prevented redirection to canonical URLs. However, search JS
uses raw URL-encoding which results in people visiting a lot of
non-canonical URLs. I attempted a fix in
https://gerrit.wikimedia.org/r/#/c/42766/ - hope to squeeze it in today's
deployment.
On Tue, Jan 8, 2013 at 4:47 AM, Asher Feldman <afeldman(a)wikimedia.org>
wrote:
It looks like the December numbers are indeed skewed, possibly due to a link
encoding change in mobilefrontend that is doubling many requests.
I counted en.m.wikipedia/wiki/article requests and my total count agrees
with stats.wikimedia (around 2B), but http 301 redirects went from being
around 1% of responses to >18% in one random mid-december day.
An example is:
cp1044.wikimedia.org 214632678 2013-01-08T00:27:24 0.094004869 0.0.0.0
miss/301 20 GET
http://en.m.wikipedia.org/wiki/Pawn%20(chess) - text/html;
charset=utf-8
http://en.m.wikipedia.org/wiki/Rules_of_chess -
Mozilla/5.0%20(iPhone;%20CPU%20iPhone%20OS%206_0_1%20like%20Mac%20OS%20X)%20
AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Version/6.0%20Mobile/10A523%2
0Safari/8536.25 en-us -
The correct article name for the above example is
http://en.m.wikipedia.org/wiki/Pawn_(chess). The desktop site in safari
provides a correct link, but the mobile site converts the underscore to an
encoded space.
There may be some other issues as well - the number of requests with a blank
referrer have increased heavily. This is partially due to ios6 using google
over ssl, but the number of blank referrers increased heavily for android as
well. My rough estimate is that mobile pageviews actually increased by
around 1/3 in december.
On Mon, Jan 7, 2013 at 2:00 PM, Diederik van Liere <dvanliere(a)wikimedia.org>
wrote:
Hi all,
It has come to our attention that there is quite a big jump in mobile
pageviews on
http://stats.wikimedia.org/EN/TablesPageViewsMonthlyMobile.htm
We are looking into the exact cause of it right now, but suffice to say for
now, do not use these numbers for the month of December 2012.
Best,
Diederik
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics