Re: [Analytics] Calculating page views for projects in other languages

-- Best, Jan Ainali Chairman, Wikimedia Sverige http://se.wikimedia.org/wiki/Huvudsida 2012/7/23 Erik Zachte ezachte@wikimedia.org > James seeks a one page overview of most read articles for any wiki/project. > > A list of articles per project could be retrieved from the mediawiki API. > I did something similar with list of articles per category (incl subcat, x > levels deep). > Perl script on request. > > Then the machine readable version of grok could be used to retrieve article > counts. (see Dario's comment) > However this might now scale well to 1(0),000's of projects and 100,000's > pages. > > In the somewhat longer run I see two developments that might warrant > putting > this on hold: > > 1) > The new analytics cluster will be used to aggregate page and image views. > (Another use case would be aggregating image views per donating GLAM > institute) > Which aggregations precisely better be determined once the infrastructure > is > available, and capacity is known. > > 2) > There are scripts to aggregate Domas' hourly page view feeds into monthly > files. > These aggregates are so much smaller, after cruft removal only 2Gb per > month, without losing hourly resolution, easy to download and > archive/process somewhere else. > http://lists.wikimedia.org/pipermail/wikitech-l/2011-August/054644.html > These need final work, I spoke to long time dev. wikimedian EMW at > Wikimania > and he might be interested to take this upon him, starting October. From > these aggregates the 1(0),000 of projects overviews could be generated in a > batch process, mind you after month completed. > > Erik Zachte > > > -----Original Message----- > From: analytics-bounces@lists.wikimedia.org > [mailto:analytics-bounces@lists.wikimedia.org] On Behalf Of Dario > Taraborelli > Sent: Friday, July 20, 2012 6:56 PM > To: A mailinglist for the Analytics Team at WMF and everybody who has an > interest in Wikipedia and analytics. > Subject: Re: [Analytics] Calculating page views for projects in other > languages > > James, > > can you expand on this request? If you are interested in per-article > pageview stats you can use: http://stats.grok.se/ > > For example: http://stats.grok.se/fr/201207/Paris > A machine readable version: http://stats.grok.se/json/fr/201207/Paris > > Dario > > On Jul 20, 2012, at 9:38 AM, Sumana Harihareswara wrote: > > > James: Good places to add your requests to: > > > > https://lists.wikimedia.org/mailman/listinfo/toolserver-l > > > > https://www.mediawiki.org/wiki/Annoying_large_bugs > > > > > > -- > > Sumana Harihareswara > > Engineering Community Manager > > Wikimedia Foundation > > > > > > > > On 07/20/2012 12:38 PM, Diederik van Liere wrote: > >> It is always tricky to convince someone to start working on a request > for > yourself. Given the fact that there is an existing code base I would say > that your best bet is to study that and tweak it your own requirements. If > you have specific technical questions then there are enough people within > the different wikimedia communities that can help you. > >> > >> Good luck! > >> > >> Diederik > >> > >> Sent from my iPhone > >> > >> On 2012-07-20, at 11:47, James Heilman jmh649@gmail.com wrote: > >> > >>> This is something I was hoping to convince someone with programming > >>> skills to take on. What prevents me from doing it is my complete > >>> lack of programming skills thus the request here. > >>> > >>> -- > >>> James Heilman > >>> MD, CCFP-EM, Wikipedian > >>> > >>> The Wikipedia Open Textbook of Medicine > >>> www.opentextbookofmedicine.com > >>> > >>> _______________________________________________ > >>> Analytics mailing list > >>> Analytics@lists.wikimedia.org > >>> https://lists.wikimedia.org/mailman/listinfo/analytics > >> > >> _______________________________________________ > >> Analytics mailing list > >> Analytics@lists.wikimedia.org > >> https://lists.wikimedia.org/mailman/listinfo/analytics > >> > > > > > > _______________________________________________ > > Analytics mailing list > > Analytics@lists.wikimedia.org > > https://lists.wikimedia.org/mailman/listinfo/analytics > > > _______________________________________________ > Analytics mailing list > Analytics@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics > > > _______________________________________________ > Analytics mailing list > Analytics@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics >