On Wed, Dec 2, 2015 at 9:38 AM, Joseph Allemandou <jallemandou@wikimedia.org
wrote:
Food for thoughts:
Regarding the "???.." entries below, see also
https://phabricator.wikimedia.org/T117945 ; the list there shows the prevalence of the "-"s across languages, too.
(I filed that ticked almost a month ago, without a reaction so far. I take it that for the purpose of getting the attention of Analytics engineers towards such widespread anomalies, this mailing list is a far better venue than Phabricator.)
SELECT uri_host, uri_path, uri_query, COUNT(1) as c FROM wmf.webrequest WHERE webrequest_source IN ('text', 'mobile') AND <YEAR/MONTH/DAY/HOUR restricted> AND is_pageview AND pageview_info['page_title'] = '-' GROUP BY uri_host, uri_path, uri_query ORDER BY c DESC LIMIT 100;
en.m.wikipedia.org /w/index.php ?search=&fulltext=Search 1986 fr.m.wikipedia.org /w/index.php ?search=&fulltext=Rechercher 476 ar.m.wikipedia.org /w/index.php ?search=&fulltext=%D8%A7%D8%A8%D8%AD%D8%AB 461 en.wikipedia.org /w/index.php ?redirs=0&search=Calvary%20%2B%20Film%20%2B%20Brendan%20Gleeson%20%2B%202014&fulltext=Search&ns0=1 356 en.wikipedia.org /w/index.php ?redirs=0&search=The%20Woman%20in%20Black%202%3A%20Angel%20of%20Death%20%2B%20Film%20%2B%20Jeremy%20Irvine%20%2B%202014&fulltext=Search&ns0=1 317 ja.wikipedia.org /wiki/ ??? 307 ja.wikipedia.org /wiki/ ???? 258 pt.m.wikipedia.org /w/index.php ?search=&fulltext=Pesquisar 253 en.wikipedia.org /w/index.php ?redirs=0&search=We%20Are%20the%20Best%21%20%2B%20Film%20%2B%20Vanja%20Engstr%C3%B6m%20%2B%202013&fulltext=Search&ns0=1 207 en.wikipedia.org /w/index.php ?redirs=0&search=Manhattan%20%2B%20Film%20%2B%20John%20Benjamin%20Hickey%20%2B%202015&fulltext=Search&ns0=1 200 es.m.wikipedia.org /w/index.php ?search=&fulltext=Buscar 162 en.wikipedia.org /w/index.php ?redirs=0&search=Angus,%20Thongs%20and%20Perfect%20Snogging%20%2B%20Film%20%2B%20Aaron%20Taylor-Johnson%20%2B%202008&fulltext=Search&ns0=1 145 en.wikipedia.org /w/index.php 140 de.m.wikipedia.org /wiki ?search=Mordkommission%20BERLIN%201 139 ja.wikipedia.org /wiki/ ????? 134 en.m.wikipedia.org /w/index.php ?search= 120 ja.wikipedia.org /wiki/ ?? 117 ru.m.wikipedia.org /w/index.php ?search=&fulltext=%D0%9D%D0%B0%D0%B9%D1%82%D0%B8 112 de.wikipedia.org /w/index.php 100 ja.wikipedia.org /wiki/ ??????? 93 ar.wikipedia.org /wiki/ ???? 93 ja.wikipedia.org /wiki/ ???????? 83 m.wikimediafoundation.org /w/index.php ?search=&fulltext=Search 82 fa.m.wikipedia.org /w/index.php ?search=&fulltext=%D8%AC%D8%B3%D8%AA%D8%AC%D9%88 82 zh.wikipedia.org /wiki/ ??? 80 ar.m.wikipedia.org /w/index.php ?search&fulltext=%D8%A7%D8%A8%D8%AD%D8%AB 77 zh.wikipedia.org /wiki/ ???? 76 ja.wikipedia.org /wiki/ ?????? 76 ar.wikipedia.org /wiki/ ????? 72 ar.wikipedia.org /wiki/ ?????_?????? 69 en.wikipedia.org /w/index.php ?redirs=0&search=Once%20Upon%20a%20Time%20%2B%20Film%20%2B%20Ginnifer%20Goodwin%20%2B%202015&fulltext=Search&ns0=1 69 commons.m.wikimedia.org /wiki/ ?uselang=it 69 en.wikipedia.org /w/index.php ?redirs=0&search=The%20Birdcage%20%2B%20Film%20%2B%20Robin%20Williams%20%2B%201996&fulltext=Search&ns0=1 68 commons.wikimedia.org /wiki/ ?uselang=it 66 ar.wikipedia.org /wiki/ ????_????? 63 de.m.wikipedia.org /wiki ?search=Helmar%20B%C3%BCchel 58 en.m.wikipedia.org /w/index.php ?search&fulltext=Search 56 ar.wikipedia.org /wiki/ ????_??????? 54 en.m.wikipedia.org /wiki ?search=%3Cnomatch%2F%3E 53 en.wikipedia.org / ?search=+ 53 en.wikipedia.org /w/index.php ?redirs=0&search=We%20Are%20What%20We%20Are%20%2B%20Film%20%2B%20Vonia%20Arslanian%20%2B%202013&fulltext=Search&ns0=1 51 en.wikipedia.org /w/index.php ?diff=693310399&oldid=662731788 50 en.wikipedia.org /w/index.php ?redirs=0&search=We're%20the%20Millers%20%2B%20Film%20%2B%20Jason%20Sudeikis%20%2B%202013&fulltext=Search&ns0=1 48 ar.wikipedia.org /wiki/ ?????_???? 48 en.wikipedia.org /w/index.php ?diff=693310404&oldid=693207084 47 commons.m.wikimedia.org /w/index.php ?search=&fulltext=Search 44 ar.wikipedia.org /wiki/ ????_?????? 44 ar.wikipedia.org /wiki/ ?????_??????? 43 en.wikipedia.org /w/index.php ?do=/user/login/ 43 zh.wikipedia.org /zh-tw/ 43 ar.wikipedia.org /wiki/ ?????_????? 42 en.wikipedia.org /w/index.php ?diff=693313743&oldid=693310399 42 ar.wikipedia.org /wiki/ ?????? 41 en.m.wikipedia.org /w/index.php ?search=Mukamwezi.Com&fulltext=Search 41 en.wikipedia.org /w/index.php ?redirs=0&search=Marina%20%2B%20Film%20%2B%20Matteo%20Simoni%20%2B%202013&fulltext=Search&ns0=1 41 de.m.wikipedia.org /w/index.php ?search=&fulltext=Volltext 40 ar.wikipedia.org /wiki/ ????_???? 40 en.wikipedia.org /w/index.php ?do=/blog/ 37 ja.wikipedia.org /wiki/ ????????? 37 en.wikipedia.org /w/index.php ?redirs=0&search=Zurich%20%2B%20Film%20%2B%20Wende%20Snijders%20%2B%202015&fulltext=Search&ns0=1 37 ar.wikipedia.org /wiki/ ??????? 36 ar.m.wikipedia.org /w/index.php ?search=%D8%B3%D9%83%D8%B3&fulltext=%D8%A7%D8%A8%D8%AD%D8%AB 35 tr.m.wikipedia.org /w/index.php ?search=&fulltext=Ara 35 en.wikipedia.org /w/index.php ?redirs=0&search=Extraterrestre%20%2B%20Film%20%2B%20Juli%C3%A1n%20Villagr%C3%A1n%20%2B%202011&fulltext=Search&ns0=1 34 uk.wikipedia.org /w/index.php ?curid=2070033 33 ar.wikipedia.org /wiki/ ???_????? 33 es.wikipedia.org /w/index.php 33 ar.wikipedia.org /wiki/ ???_???? 32 en.wikipedia.org /w/index.php ?redirs=0&search=The%20Book%20Thief%20%2B%20Film%20%2B%20Sophie%20N%C3%A9lisse%20%2B%202013&fulltext=Search&ns0=1 32 en.wikipedia.org / ?search=Fn,..;;;: 31 en.wikipedia.org /w/index.php ?do=/user/profile/ 31 de.m.wikipedia.org /w/index.php ?search=Rtl+Deutschland 31 id.m.wikipedia.org /w/index.php ?search=&fulltext=Cari 30 de.wikipedia.org /w/index.php ?search=Mordkommission+Berlin+1 30 de.m.wikipedia.org /w/index.php ?search= 30 en.wikipedia.org /w/index.php ?do=/user/privacy/ 30 en.wikipedia.org /w/index.php ?redirs=0&search=Exodus%3A%20Gods%20and%20Kings%20%2B%20Film%20%2B%20Christian%20Bale%20%2B%202014&fulltext=Search&ns0=1 29 ar.wikipedia.org /wiki/ ??_?????? 28 ar.wikipedia.org /wiki/ ??? 28 ar.wikipedia.org /wiki/ ?????_???????? 27 en.wikipedia.org / ?curid=3392129 26 es.m.wikipedia.org /w/index.php ?search= 26 en.wikipedia.org /w/index.php ?redirs=0&search=Event%20Horizon%20%2B%20Film%20%2B%20Laurence%20Fishburne%20%2B%201997&fulltext=Search&ns0=1 26 en.m.wiktionary.org /w/index.php ?search=&fulltext=Search 25 meta.m.wikimedia.org /w/index.php ?search=&fulltext=Search 25 ar.wikipedia.org /wiki/ ??????_???????? 24 ar.wikipedia.org /wiki/ ???????? 24 zh.wikipedia.org /wiki/ ?%E6%9C%88? 24 sw.m.wikipedia.org /w/index.php ?search=&fulltext=Tafuta 24 de.m.wikipedia.org /wiki ?search=Mordkommission%20Berlin%201 24 en.m.wikipedia.org /w/index.php ?search=xnxx+xnxx+xnxx 24 zh.wikipedia.org /wiki/ ?? 24 en.wikipedia.org /w/index.php ?redirs=0&search=Hart's%20War%20%2B%20Film%20%2B%20Bruce%20Willis%20%2B%202002&fulltext=Search&ns0=1 24 m.mediawiki.org /w/index.php ?search=&fulltext=Search 23 ja.wikipedia.org /wiki/ 23 en.wikipedia.org /w/index.php ?redirs=0&search=Selma%20%2B%20Film%20%2B%20David%20Oyelowo%20%2B%202014&fulltext=Search&ns0=1 23 en.wikipedia.org /w/index.php ?redirs=0&search=The%20Bridge%20%2B%20Film%20%2B%20Sofia%20Helin%20%2B%202011&fulltext=Search&ns0=1 23 en.wikipedia.org /w/index.php ?redirs=0&search=Rob%20the%20Mob%20%2B%20Film%20%2B%20Michael%20Pitt%20%2B%202014&fulltext=Search&ns0=1 23 fr.wikipedia.org / ?search=+ 23 it.m.wikipedia.org /w/index.php ?search=&fulltext=Ricerca 22
Perhaps not a very big deal in case of "Mordkommission BERLIN", but in
general, search terms are considered https://blog.wikimedia.org/2012/09/19/what-are-readers-looking-for-wikipedia-search-data-now-available/ private data.
On Wed, Dec 2, 2015 at 6:16 PM, Oliver Keyes okeyes@wikimedia.org wrote:
I mean, now I want to know how we can have a condition where there's no page title but it registers as a pageview.
On 2 December 2015 at 12:14, Joseph Allemandou jallemandou@wikimedia.org wrote:
Double checked:
https://github.com/wikimedia/analytics-refinery-source/blob/master/refinery-...
This value is the default when no page title is found. I agree it's not very explicit. Any suggestion on changing it, or should we just make sure it is
documented
?
On Wed, Dec 2, 2015 at 6:10 PM, Oliver Keyes okeyes@wikimedia.org
wrote:
Can someone dig into it? We should really be excluding that (unless it is the page on the dash ;p)
On 2 December 2015 at 12:00, Dan Andreescu dandreescu@wikimedia.org wrote:
I always wonder about that. There's also an actual page that could theoretically be hit: https://en.wikipedia.org/w/index.php?title=-&redirect=no
On Wed, Dec 2, 2015 at 11:58 AM, Gabriel Wicke <gwicke@wikimedia.org
wrote:
Historically, I vaguely remember that we have used that title for
user
script / style loading with action=raw. I think that's gone from the skin code, but it's possible that user scripts still reference this title.
Gabriel
On Wed, Dec 2, 2015 at 8:41 AM, Oliver Keyes okeyes@wikimedia.org wrote: > One of the most prominent top articles has no page; it's "-".
What is
> this? > > -- > Oliver Keyes > Count Logula > Wikimedia Foundation > > _______________________________________________ > Analytics mailing list > Analytics@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics
-- Gabriel Wicke Principal Engineer, Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Oliver Keyes Count Logula Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Joseph Allemandou Data Engineer @ Wikimedia Foundation IRC: joal
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Oliver Keyes Count Logula Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- *Joseph Allemandou* Data Engineer @ Wikimedia Foundation IRC: joal
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics