Hi all,
There has been some recent discussion [1] on wikidata-l about making sure wikidata.org page views are part of the stats that are being collected at stats.grok.se. I did a quick check to see if page views on www.wikidata.org were showing up, and they don't appear to be.
curl --silent http://dumps.wikimedia.org/other/pagecounts-raw/2013/2013-01/pagecounts-2013... | zcat - | egrep ' Q\d+ ' de Q100 2 15502 de Q5 2 95286 en Q0 1 7815 en Q1 6 70841 en Q10 2 32918 en Q101 1 7709 en Q102 1 8128 en Q107 1 26148 en Q11 1 387 en Q19 2 14304 en Q2 7 44454 en Q3 1 8624 en Q35 1 22856 en Q4 3 40588 en Q4000 2 28866 en Q5 3 16698 en Q612 1 7152 en Q6600 2 29929 en Q7 2 16604 en Q9450 2 59452 fr Q4 2 24352 fr Q400 1 17339 hu Q10 3 105745 ja Q0 1 8685 ja Q10 36 781763 ja Q4 1 8873 ja Q400 1 25208 ko Q3 1 22350 nl Q65 2 24562 ru Q10 1 31355 ru Q4000 1 11140 sv Q10 1 365 zh Q1 1 10950 zh Q10 2 17738
Does anyone have any idea how to get stats.grok.se updated?
I think I've seen from previous conversation here that an alternate source for stats is being created? Is there any information available on how to use that if it's available yet?
//Ed
[1] http://lists.wikimedia.org/pipermail/wikidata-l/2013-January/001646.html
Hi Ed,
afaik it's the other way around: stats.grok.se aggregates the data from the pagecounts-raw dumps. The results you list are from the normal wikipedias in the different languages, so i guess wikidata stats are not collected yet. I'd also be very interested in that data to combine it with linked data…
Cheers, Jörn
On 29.01.2013, at 15:01, Ed Summers ehs@pobox.com wrote:
Hi all,
There has been some recent discussion [1] on wikidata-l about making sure wikidata.org page views are part of the stats that are being collected at stats.grok.se. I did a quick check to see if page views on www.wikidata.org were showing up, and they don't appear to be.
curl --silent http://dumps.wikimedia.org/other/pagecounts-raw/2013/2013-01/pagecounts-2013... | zcat - | egrep ' Q\d+ ' de Q100 2 15502 de Q5 2 95286 en Q0 1 7815 en Q1 6 70841 en Q10 2 32918 en Q101 1 7709 en Q102 1 8128 en Q107 1 26148 en Q11 1 387 en Q19 2 14304 en Q2 7 44454 en Q3 1 8624 en Q35 1 22856 en Q4 3 40588 en Q4000 2 28866 en Q5 3 16698 en Q612 1 7152 en Q6600 2 29929 en Q7 2 16604 en Q9450 2 59452 fr Q4 2 24352 fr Q400 1 17339 hu Q10 3 105745 ja Q0 1 8685 ja Q10 36 781763 ja Q4 1 8873 ja Q400 1 25208 ko Q3 1 22350 nl Q65 2 24562 ru Q10 1 31355 ru Q4000 1 11140 sv Q10 1 365 zh Q1 1 10950 zh Q10 2 17738
Does anyone have any idea how to get stats.grok.se updated?
I think I've seen from previous conversation here that an alternate source for stats is being created? Is there any information available on how to use that if it's available yet?
//Ed
[1] http://lists.wikimedia.org/pipermail/wikidata-l/2013-January/001646.html
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Hi Ed,
We are preparing a bunch of changes to our logging infrastructure and I will try to squeeze in support for wikidata.org as well. If all goes well, we should have these stats up and running by next week.
Best, Diederik
On Wed, Jan 30, 2013 at 4:20 PM, Jörn Hees wikistats@joernhees.de wrote:
Hi Ed,
afaik it's the other way around: stats.grok.se aggregates the data from the pagecounts-raw dumps. The results you list are from the normal wikipedias in the different languages, so i guess wikidata stats are not collected yet. I'd also be very interested in that data to combine it with linked data…
Cheers, Jörn
On 29.01.2013, at 15:01, Ed Summers ehs@pobox.com wrote:
Hi all,
There has been some recent discussion [1] on wikidata-l about making sure wikidata.org page views are part of the stats that are being collected at stats.grok.se. I did a quick check to see if page views on www.wikidata.org were showing up, and they don't appear to be.
curl --silent
http://dumps.wikimedia.org/other/pagecounts-raw/2013/2013-01/pagecounts-2013...
| zcat - | egrep ' Q\d+ ' de Q100 2 15502 de Q5 2 95286 en Q0 1 7815 en Q1 6 70841 en Q10 2 32918 en Q101 1 7709 en Q102 1 8128 en Q107 1 26148 en Q11 1 387 en Q19 2 14304 en Q2 7 44454 en Q3 1 8624 en Q35 1 22856 en Q4 3 40588 en Q4000 2 28866 en Q5 3 16698 en Q612 1 7152 en Q6600 2 29929 en Q7 2 16604 en Q9450 2 59452 fr Q4 2 24352 fr Q400 1 17339 hu Q10 3 105745 ja Q0 1 8685 ja Q10 36 781763 ja Q4 1 8873 ja Q400 1 25208 ko Q3 1 22350 nl Q65 2 24562 ru Q10 1 31355 ru Q4000 1 11140 sv Q10 1 365 zh Q1 1 10950 zh Q10 2 17738
Does anyone have any idea how to get stats.grok.se updated?
I think I've seen from previous conversation here that an alternate source for stats is being created? Is there any information available on how to use that if it's available yet?
//Ed
[1]
http://lists.wikimedia.org/pipermail/wikidata-l/2013-January/001646.html
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Hi Diederik,
Thanks for the update. Is there any documentation about how the logging infrastructure is changing? If not please don't take this as a criticism, I was just curious.
//Ed
On Wed, Jan 30, 2013 at 4:25 PM, Diederik van Liere dvanliere@wikimedia.org wrote:
Hi Ed,
We are preparing a bunch of changes to our logging infrastructure and I will try to squeeze in support for wikidata.org as well. If all goes well, we should have these stats up and running by next week.
Best, Diederik
On Wed, Jan 30, 2013 at 4:20 PM, Jörn Hees wikistats@joernhees.de wrote:
Hi Ed,
afaik it's the other way around: stats.grok.se aggregates the data from the pagecounts-raw dumps. The results you list are from the normal wikipedias in the different languages, so i guess wikidata stats are not collected yet. I'd also be very interested in that data to combine it with linked data…
Cheers, Jörn
On 29.01.2013, at 15:01, Ed Summers ehs@pobox.com wrote:
Hi all,
There has been some recent discussion [1] on wikidata-l about making sure wikidata.org page views are part of the stats that are being collected at stats.grok.se. I did a quick check to see if page views on www.wikidata.org were showing up, and they don't appear to be.
curl --silent http://dumps.wikimedia.org/other/pagecounts-raw/2013/2013-01/pagecounts-2013... | zcat - | egrep ' Q\d+ ' de Q100 2 15502 de Q5 2 95286 en Q0 1 7815 en Q1 6 70841 en Q10 2 32918 en Q101 1 7709 en Q102 1 8128 en Q107 1 26148 en Q11 1 387 en Q19 2 14304 en Q2 7 44454 en Q3 1 8624 en Q35 1 22856 en Q4 3 40588 en Q4000 2 28866 en Q5 3 16698 en Q612 1 7152 en Q6600 2 29929 en Q7 2 16604 en Q9450 2 59452 fr Q4 2 24352 fr Q400 1 17339 hu Q10 3 105745 ja Q0 1 8685 ja Q10 36 781763 ja Q4 1 8873 ja Q400 1 25208 ko Q3 1 22350 nl Q65 2 24562 ru Q10 1 31355 ru Q4000 1 11140 sv Q10 1 365 zh Q1 1 10950 zh Q10 2 17738
Does anyone have any idea how to get stats.grok.se updated?
I think I've seen from previous conversation here that an alternate source for stats is being created? Is there any information available on how to use that if it's available yet?
//Ed
[1] http://lists.wikimedia.org/pipermail/wikidata-l/2013-January/001646.html
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
On Wed, Jan 30, 2013 at 4:20 PM, Jörn Hees wikistats@joernhees.de wrote:
afaik it's the other way around: stats.grok.se aggregates the data from the pagecounts-raw dumps.
Oh right! I never noticed the hostname changing when I clicked on the "data available here" link on stats.grok.se :-) That actually makes me feel a lot better knowing the data collection is happening on a wikimedia server.
The results you list are from the normal wikipedias in the different languages, so i guess wikidata stats are not collected yet. I'd also be very interested in that data to combine it with linked data…
Does anyone know who/what collects the pagecounts-raw dumps on dumps.wikimedia.org?
//Ed
PS. re: Linked Data I think wikidata is going to be a big deal in that area yes. I just saw this morning that it's pretty easy to use the MediaWiki API to get at the entities https://gist.github.com/4681747 I think other data formats (RDF) are in the pipeline.
Ed Summers, 31/01/2013 12:14:
On Wed, Jan 30, 2013 at 4:20 PM, Jörn Hees wikistats@joernhees.de wrote:
afaik it's the other way around: stats.grok.se aggregates the data from the pagecounts-raw dumps.
Oh right! I never noticed the hostname changing when I clicked on the "data available here" link on stats.grok.se :-) That actually makes me feel a lot better knowing the data collection is happening on a wikimedia server.
The results you list are from the normal wikipedias in the different languages, so i guess wikidata stats are not collected yet. I'd also be very interested in that data to combine it with linked data…
Does anyone know who/what collects the pagecounts-raw dumps on dumps.wikimedia.org?
Technically speaking, it's called webstatscollector. For instance here wikivoyage was added: https://bugzilla.wikimedia.org/show_bug.cgi?id=42055 stats.grok.se aggregates all new data automatically although it doesn't expose it in the interface, you opnly have to know the prefix used in the raw data.
Nemo
Good news! As of Feb 1st UTC 0:00, we have pagelevel and project level counts for wikidata. the acronym for Wikidata is 'wd'. If you have any questions please let me know; bugs can be filed in Bugzilla under Analytics -> webstatscollector.
Best, Diederik
On Thu, Jan 31, 2013 at 6:54 AM, Federico Leva (Nemo) nemowiki@gmail.comwrote:
Ed Summers, 31/01/2013 12:14:
On Wed, Jan 30, 2013 at 4:20 PM, Jörn Hees wikistats@joernhees.de
wrote:
afaik it's the other way around: stats.grok.se aggregates the data from the pagecounts-raw dumps.
Oh right! I never noticed the hostname changing when I clicked on the "data available here" link on stats.grok.se :-) That actually makes me feel a lot better knowing the data collection is happening on a wikimedia server.
The results you list are from the normal wikipedias in the different
languages, so i guess wikidata stats are not collected yet. I'd also be very interested in that data to combine it with linked data…
Does anyone know who/what collects the pagecounts-raw dumps on dumps.wikimedia.org?
Technically speaking, it's called webstatscollector. For instance here wikivoyage was added: https://bugzilla.wikimedia.** org/show_bug.cgi?id=42055https://bugzilla.wikimedia.org/show_bug.cgi?id=42055 stats.grok.se aggregates all new data automatically although it doesn't expose it in the interface, you opnly have to know the prefix used in the raw data.
Nemo
______________________________**_________________ Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/**mailman/listinfo/analyticshttps://lists.wikimedia.org/mailman/listinfo/analytics
Awesome, thanks so much Diederek! I will forward your message on to the wikidata folks. Also, thanks for the pointer to webstatscollector.
//Ed
On Thu, Jan 31, 2013 at 11:10 PM, Diederik van Liere dvanliere@wikimedia.org wrote:
Good news! As of Feb 1st UTC 0:00, we have pagelevel and project level counts for wikidata. the acronym for Wikidata is 'wd'. If you have any questions please let me know; bugs can be filed in Bugzilla under Analytics -> webstatscollector.
On Thu, Jan 31, 2013 at 11:10 PM, Diederik van Liere dvanliere@wikimedia.org wrote:
Good news! As of Feb 1st UTC 0:00, we have pagelevel and project level counts for wikidata. the acronym for Wikidata is 'wd'. If you have any questions please let me know; bugs can be filed in Bugzilla under Analytics -> webstatscollector.
Best, Diederik
On Thu, Jan 31, 2013 at 6:54 AM, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Ed Summers, 31/01/2013 12:14:
On Wed, Jan 30, 2013 at 4:20 PM, Jörn Hees wikistats@joernhees.de wrote:
afaik it's the other way around: stats.grok.se aggregates the data from the pagecounts-raw dumps.
Oh right! I never noticed the hostname changing when I clicked on the "data available here" link on stats.grok.se :-) That actually makes me feel a lot better knowing the data collection is happening on a wikimedia server.
The results you list are from the normal wikipedias in the different languages, so i guess wikidata stats are not collected yet. I'd also be very interested in that data to combine it with linked data…
Does anyone know who/what collects the pagecounts-raw dumps on dumps.wikimedia.org?
Technically speaking, it's called webstatscollector. For instance here wikivoyage was added: https://bugzilla.wikimedia.org/show_bug.cgi?id=42055 stats.grok.se aggregates all new data automatically although it doesn't expose it in the interface, you opnly have to know the prefix used in the raw data.
Nemo
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics