I believe there is some JS that updates links in the UI that
uses encodeURIComponent(), which create a non-canonical URL when with
things like spaces, colons, and slashes are present. I'm pretty sure we
fixed the canonical URL problem server side like Max said, be we'll double
check.
On Tue, Jan 8, 2013 at 9:34 AM, Asher Feldman <afeldman(a)wikimedia.org>wrote;wrote:
The example I gave (verified on my iPhone yesterday)
was a link to a
non-canonical URL from within article HTML mangled by MobileFrontend.
Search JS is a problem, but the bigger issue appears to be server side.
On Tuesday, January 8, 2013, Max Semenik wrote:
> Indeed, in December we've rolled out a change that removed the bogus code
> that previously prevented redirection to canonical URLs. However, search JS
> uses raw URL-encoding which results in people visiting a lot of
> non-canonical URLs. I attempted a fix in
>
https://gerrit.wikimedia.org/r/#/c/42766/ - hope to squeeze it in
> today's deployment.
>
> On Tue, Jan 8, 2013 at 4:47 AM, Asher Feldman <afeldman(a)wikimedia.org>wrote;wrote:
>
>> It looks like the December numbers are indeed skewed, possibly due to a
>> link encoding change in mobilefrontend that is doubling many requests.
>>
>> I counted en.m.wikipedia/wiki/article requests and my total count agrees
>> with stats.wikimedia (around 2B), but http 301 redirects went from being
>> around 1% of responses to >18% in one random mid-december day.
>>
>> An example is:
>>
>>
cp1044.wikimedia.org 214632678 2013-01-08T00:27:24 0.094004869 0.0.0.0
>> miss/301 20 GET
http://en.m.wikipedia.org/wiki/Pawn%20(chess) -
>> text/html; charset=utf-8
http://en.m.wikipedia.org/wiki/Rules_of_chess-
>>
Mozilla/5.0%20(iPhone;%20CPU%20iPhone%20OS%206_0_1%20like%20Mac%20OS%20X)%20AppleWebKit/536.26%20(KHTML,%20like%20Gecko)%20Version/6.0%20Mobile/10A523%20Safari/8536.25
>> en-us -
>>
>> The correct article name for the above example is
>>
http://en.m.wikipedia.org/wiki/Pawn_(chess). The desktop site in
>> safari provides a correct link, but the mobile site converts the underscore
>> to an encoded space.
>>
>> There may be some other issues as well - the number of requests with a
>> blank referrer have increased heavily. This is partially due to ios6 using
>> google over ssl, but the number of blank referrers increased heavily for
>> android as well. My rough estimate is that mobile pageviews actually
>> increased by around 1/3 in december.
>>
>> On Mon, Jan 7, 2013 at 2:00 PM, Diederik van Liere <
>> dvanliere(a)wikimedia.org> wrote:
>>
>>> Hi all,
>>>
>>>
>>> It has come to our attention that there is quite a big jump in mobile
>>> pageviews on
>>>
http://stats.wikimedia.org/EN/TablesPageViewsMonthlyMobile.htm
>>>
>>> We are looking into the exact cause of it right now, but suffice to say
>>> for now, do not use these numbers for the month of December 2012.
>>>
>>> Best,
>>> Diederik
>>>
>>>
>>> _______________________________________________
>>> Analytics mailing list
>>> Analytics(a)lists.wikimedia.org
>>>
https://lists.wikimedia.org/mailman/listinfo/analytics
>>>
>>>
>>
>
--
Arthur Richards
Software Engineer, Mobile
[[User:Awjrichards]]
IRC: awjr
+1-415-839-6885 x6687