Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end. For an example of what kind of UIs someone could build with it, check out this excellent demo http://analytics.wmflabs.org/demo/pageview-api (code) https://gist.github.com/marcelrf/49738d14116fd547fe6d#file-article-comparison-html .
The API can tell you how many times a wiki article or project is viewed over a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles https://wikimedia.org/api/rest_v1/metrics/pageviews/top/es.wikipedia/all-access/2015/11/11 on any project, on any given day or month that we have data for. We currently have data back through October and we will be able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs https://wikitech.wikimedia.org/wiki/Analytics/AQS/Pageview_API.
After many requests from the community, we were really happy to finally make this our top priority and get it done. Huge thanks to Gabriel, Marko, Petr, and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who have been so patient with us all this time.
The Research team’s Article Recommender tool http://recommend.wmflabs.org/ already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard https://dashboard.wikiedu.org/ is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans for this data like “article finder”, which will find low-rated articles with a lot of pageviews; this can be used by editors looking for high-impact work. Join the fun, we’re happy to help get you started and listen to your ideas. Also, if you find bugs or want to suggest improvements, please create a task in Phabricator and tag it with #Analytics-Backlog https://phabricator.wikimedia.org/tag/analytics-backlog/.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work with you to make a great plan for the next few quarters. Please chime in here https://phabricator.wikimedia.org/T112956 with your needs.
Team Analytics
On 16 November 2015 at 13:50, Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end. For an example of what kind of UIs someone could build with it, check out this excellent demo http://analytics.wmflabs.org/demo/pageview-api (code) https://gist.github.com/marcelrf/49738d14116fd547fe6d#file-article-comparison-html .
This is great to see. Thank you everyone for your work on this.
Yours,
This is fantastic news - thank you so much, Analytics, Services, Ops, and the communities who supported/requested this!
On Mon, Nov 16, 2015 at 1:50 PM, Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end. For an example of what kind of UIs someone could build with it, check out this excellent demo http://analytics.wmflabs.org/demo/pageview-api (code) https://gist.github.com/marcelrf/49738d14116fd547fe6d#file-article-comparison-html .
The API can tell you how many times a wiki article or project is viewed over a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles https://wikimedia.org/api/rest_v1/metrics/pageviews/top/es.wikipedia/all-access/2015/11/11 on any project, on any given day or month that we have data for. We currently have data back through October and we will be able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs https://wikitech.wikimedia.org/wiki/Analytics/AQS/Pageview_API.
After many requests from the community, we were really happy to finally make this our top priority and get it done. Huge thanks to Gabriel, Marko, Petr, and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who have been so patient with us all this time.
The Research team’s Article Recommender tool http://recommend.wmflabs.org/ already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard https://dashboard.wikiedu.org/ is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans for this data like “article finder”, which will find low-rated articles with a lot of pageviews; this can be used by editors looking for high-impact work. Join the fun, we’re happy to help get you started and listen to your ideas. Also, if you find bugs or want to suggest improvements, please create a task in Phabricator and tag it with #Analytics-Backlog https://phabricator.wikimedia.org/tag/analytics-backlog/.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work with you to make a great plan for the next few quarters. Please chime in here https://phabricator.wikimedia.org/T112956 with your needs.
Team Analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
It's nice to finally this go live. Great work guys!!
On Mon, Nov 16, 2015 at 11:50 PM, Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API. For an example of what kind of UIs someone could build with it, check out this excellent demo (code).
The API can tell you how many times a wiki article or project is viewed over a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles on any project, on any given day or month that we have data for. We currently have data back through October and we will be able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs.
After many requests from the community, we were really happy to finally make this our top priority and get it done. Huge thanks to Gabriel, Marko, Petr, and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who have been so patient with us all this time.
The Research team’s Article Recommender tool already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans for this data like “article finder”, which will find low-rated articles with a lot of pageviews; this can be used by editors looking for high-impact work. Join the fun, we’re happy to help get you started and listen to your ideas. Also, if you find bugs or want to suggest improvements, please create a task in Phabricator and tag it with #Analytics-Backlog.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work with you to make a great plan for the next few quarters. Please chime in here with your needs.
Team Analytics
Engineering mailing list Engineering@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering
This is awesome. Congratulations!
On Tue, Nov 17, 2015 at 9:28 AM, Alexandros Kosiaris < akosiaris@wikimedia.org> wrote:
It's nice to finally this go live. Great work guys!!
On Mon, Nov 16, 2015 at 11:50 PM, Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API. For an example of what kind of UIs
someone
could build with it, check out this excellent demo (code).
The API can tell you how many times a wiki article or project is viewed
over
a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles on any project, on any given day or month that
we
have data for. We currently have data back through October and we will
be
able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs.
After many requests from the community, we were really happy to finally
make
this our top priority and get it done. Huge thanks to Gabriel, Marko,
Petr,
and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who
have
been so patient with us all this time.
The Research team’s Article Recommender tool already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans
for
this data like “article finder”, which will find low-rated articles with
a
lot of pageviews; this can be used by editors looking for high-impact
work.
Join the fun, we’re happy to help get you started and listen to your
ideas.
Also, if you find bugs or want to suggest improvements, please create a
task
in Phabricator and tag it with #Analytics-Backlog.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work
with
you to make a great plan for the next few quarters. Please chime in here with your needs.
Team Analytics
Engineering mailing list Engineering@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering
-- Alexandros Kosiaris akosiaris@wikimedia.org
Engineering mailing list Engineering@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering
Le 16/11/2015 22:50, Dan Andreescu a écrit :
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end.
<snip>
Hello,
That is great. One can probably craft a MediaWiki extension to have the metric shown on the Special:Statistics
And lets be crazy, even add a statistic link in the sidebar for each pages!
https://en.wikipedia.org/wiki/Special:Statistics
That is great. One can probably craft a MediaWiki extension to have the metric shown on the Special:Statistics
And lets be crazy, even add a statistic link in the sidebar for each pages!
The actual mediawiki work for this only really involves reading JSON and throwing bugs at us if anything breaks :) So, should be easy, this was one of hour hopes as well, let's get to it!
By the way, to even better support this (with more performance / easier discovery), we plan on providing access to this api from the wiki-specific RESTBase URLs (eg. https://en.wikipedia.org/api/rest_v1/?doc). That hasn't been deployed yet because we're discussing where the best place for it is there (opinions welcome).
This is *awesome*. Excellent work Team Analytics!
On Mon, Nov 16, 2015 at 9:50 PM, Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end. For an example of what kind of UIs someone could build with it, check out this excellent demo http://analytics.wmflabs.org/demo/pageview-api (code) https://gist.github.com/marcelrf/49738d14116fd547fe6d#file-article-comparison-html .
The API can tell you how many times a wiki article or project is viewed over a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles https://wikimedia.org/api/rest_v1/metrics/pageviews/top/es.wikipedia/all-access/2015/11/11 on any project, on any given day or month that we have data for. We currently have data back through October and we will be able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs https://wikitech.wikimedia.org/wiki/Analytics/AQS/Pageview_API.
After many requests from the community, we were really happy to finally make this our top priority and get it done. Huge thanks to Gabriel, Marko, Petr, and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who have been so patient with us all this time.
The Research team’s Article Recommender tool http://recommend.wmflabs.org/ already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard https://dashboard.wikiedu.org/ is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans for this data like “article finder”, which will find low-rated articles with a lot of pageviews; this can be used by editors looking for high-impact work. Join the fun, we’re happy to help get you started and listen to your ideas. Also, if you find bugs or want to suggest improvements, please create a task in Phabricator and tag it with #Analytics-Backlog https://phabricator.wikimedia.org/tag/analytics-backlog/.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work with you to make a great plan for the next few quarters. Please chime in here https://phabricator.wikimedia.org/T112956 with your needs.
Team Analytics
Engineering mailing list Engineering@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering
Congratulations from me as well, especially since I was probably the one screaming for it the loudest (or the longest, or both...)
I'll now go and have good long lok at which tools to adapt, which to rewrite, and which to invent!
On Mon, Nov 16, 2015 at 9:50 PM Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end. For an example of what kind of UIs someone could build with it, check out this excellent demo http://analytics.wmflabs.org/demo/pageview-api (code) https://gist.github.com/marcelrf/49738d14116fd547fe6d#file-article-comparison-html .
The API can tell you how many times a wiki article or project is viewed over a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles https://wikimedia.org/api/rest_v1/metrics/pageviews/top/es.wikipedia/all-access/2015/11/11 on any project, on any given day or month that we have data for. We currently have data back through October and we will be able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs https://wikitech.wikimedia.org/wiki/Analytics/AQS/Pageview_API.
After many requests from the community, we were really happy to finally make this our top priority and get it done. Huge thanks to Gabriel, Marko, Petr, and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who have been so patient with us all this time.
The Research team’s Article Recommender tool http://recommend.wmflabs.org/ already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard https://dashboard.wikiedu.org/ is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans for this data like “article finder”, which will find low-rated articles with a lot of pageviews; this can be used by editors looking for high-impact work. Join the fun, we’re happy to help get you started and listen to your ideas. Also, if you find bugs or want to suggest improvements, please create a task in Phabricator and tag it with #Analytics-Backlog https://phabricator.wikimedia.org/tag/analytics-backlog/.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work with you to make a great plan for the next few quarters. Please chime in here https://phabricator.wikimedia.org/T112956 with your needs.
Team Analytics _______________________________________________ Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Finally! I waited so many years for a formal tool like that. Thank you!
And demo on wmflabs is great, but it will be great to add option to export the data to CSV file. Also, the data are only from the begging of October, any chance we can load past data as well?
Itzik
*Regards,Itzik Edri* Chairperson, Wikimedia Israel +972-(0)-54-5878078 | http://www.wikimedia.org.il Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment!
On Mon, Nov 16, 2015 at 11:50 PM, Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end. For an example of what kind of UIs someone could build with it, check out this excellent demo http://analytics.wmflabs.org/demo/pageview-api (code) https://gist.github.com/marcelrf/49738d14116fd547fe6d#file-article-comparison-html .
The API can tell you how many times a wiki article or project is viewed over a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles https://wikimedia.org/api/rest_v1/metrics/pageviews/top/es.wikipedia/all-access/2015/11/11 on any project, on any given day or month that we have data for. We currently have data back through October and we will be able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs https://wikitech.wikimedia.org/wiki/Analytics/AQS/Pageview_API.
After many requests from the community, we were really happy to finally make this our top priority and get it done. Huge thanks to Gabriel, Marko, Petr, and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who have been so patient with us all this time.
The Research team’s Article Recommender tool http://recommend.wmflabs.org/ already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard https://dashboard.wikiedu.org/ is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans for this data like “article finder”, which will find low-rated articles with a lot of pageviews; this can be used by editors looking for high-impact work. Join the fun, we’re happy to help get you started and listen to your ideas. Also, if you find bugs or want to suggest improvements, please create a task in Phabricator and tag it with #Analytics-Backlog https://phabricator.wikimedia.org/tag/analytics-backlog/.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work with you to make a great plan for the next few quarters. Please chime in here https://phabricator.wikimedia.org/T112956 with your needs.
Team Analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Hi Itzik,
Glad you like the API! Feel free to add a ticket to phabrictor tagging Analytics-Backlog on your feature request to export to csv, and we can discuss it there. The data will date back to May 2015, and we are in the process of loading it all into Cassandra, it should all be available RealSoon™ :)
Best,
On Tue, Nov 17, 2015 at 5:25 PM, Itzik - Wikimedia Israel < itzik@wikimedia.org.il> wrote:
Finally! I waited so many years for a formal tool like that. Thank you!
And demo on wmflabs is great, but it will be great to add option to export the data to CSV file. Also, the data are only from the begging of October, any chance we can load past data as well?
Itzik
*Regards,Itzik Edri* Chairperson, Wikimedia Israel +972-(0)-54-5878078 | http://www.wikimedia.org.il Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment!
On Mon, Nov 16, 2015 at 11:50 PM, Dan Andreescu dandreescu@wikimedia.org wrote:
Dear Data Enthusiasts,
In collaboration with the Services team, the analytics team wishes to announce a public Pageview API https://wikimedia.org/api/rest_v1/?doc#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end. For an example of what kind of UIs someone could build with it, check out this excellent demo http://analytics.wmflabs.org/demo/pageview-api (code) https://gist.github.com/marcelrf/49738d14116fd547fe6d#file-article-comparison-html .
The API can tell you how many times a wiki article or project is viewed over a certain period. You can break that down by views from web crawlers or humans, and by desktop, mobile site, or mobile app. And you can find the 1000 most viewed articles https://wikimedia.org/api/rest_v1/metrics/pageviews/top/es.wikipedia/all-access/2015/11/11 on any project, on any given day or month that we have data for. We currently have data back through October and we will be able to go back to May 2015 when the loading jobs are all done. For more information, take a look at the user docs https://wikitech.wikimedia.org/wiki/Analytics/AQS/Pageview_API.
After many requests from the community, we were really happy to finally make this our top priority and get it done. Huge thanks to Gabriel, Marko, Petr, and Eric from Services, Alexandros and all of Ops really, Henrik for maintaining stats.grok, and, of course, the many community members who have been so patient with us all this time.
The Research team’s Article Recommender tool http://recommend.wmflabs.org/ already uses the API to rank pages and determine relative importance. Wiki Education Foundation’s dashboard https://dashboard.wikiedu.org/ is going to be using it to count how many times an article has been viewed since a student edited it. And there are other grand plans for this data like “article finder”, which will find low-rated articles with a lot of pageviews; this can be used by editors looking for high-impact work. Join the fun, we’re happy to help get you started and listen to your ideas. Also, if you find bugs or want to suggest improvements, please create a task in Phabricator and tag it with #Analytics-Backlog https://phabricator.wikimedia.org/tag/analytics-backlog/.
So what’s next? We can think of too many directions to go into, for pageview data and Wikimedia project data, in general. We need to work with you to make a great plan for the next few quarters. Please chime in here https://phabricator.wikimedia.org/T112956 with your needs.
Team Analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
-- Madhumitha Software Engineer, Analytics
Finally! I waited so many years for a formal tool like that. Thank you!
Itzik, I remember your requests for this type of data from a long long time ago, when I was just starting at the foundation!! You and the many others with similar requests are the people we were thanking in the announcement :)
And demo on wmflabs is great, but it will be great to add option to export
the data to CSV file. Also, the data are only from the begging of October, any chance we can load past data as well?
So, I agree with what Madhu said that you could file a Phabricator ticket for this. But for now, we're not looking to build a UI for it that is production ready. The demo was meant just to show that it's very simple to do so. It took one of our engineers only a few days and under 300 lines of code to get this done. We'd like to be patient and see if the community at large has an interest in running something like stats.grok.se now that heavy lifting of data is no longer required, and performance is guaranteed by us within reasonable expectations.