Alvaro del Castillo, 11/11/2013 17:51: Thanks! This will be interesting for the MediaWiki wikis without regular dumps. As for mediawiki.org, in your goals what is this service going to add to the main statistics http://stats.wikimedia.org/wikispecial/EN/TablesWikipediaMEDIAWIKI.htm ? Some weirdnesses I noted: 1) Total edit counts don't match, compare e.g. Krinkle, Kgh, Jack, Jeroen: http://stats.wikimedia.org/wikispecial/EN/TablesWikipediaMEDIAWIKI.htm#wiki… . This probably means that you are considering the wrong namespaces; please use content namespaces. 2) The number of editors is not explained. I hope it matches the metrics definitions (it seems similar) but it's not clear. 3) Number of edits per month is suspiciously low in some old months, even more than (1) would seem to justify. For instance, for October 2007 you report 28 pages (new pages, I suppose) and 275 edits (to the unknown namespaces of (1), I guess) while WikiStats says 5 new countable pages per day and 1.8 k (total) edits. Nemo

On Mon, 2013-11-11 at 19:40 +0100, Federico Leva (Nemo) wrote: This is a development we're doing not in connection with our provision of metrics about MediaWiki, therefore it is not specifically aimed at improving the stats you currently have. In fact, it has been developed exactly for the scenario you mention: MediaWiki instances for which you want the get metrics via the API, not dumps. We just thought it could be interesting to have it for WMF data too, specially if it was integrated with the rest of development activity. In addition, we're completely open to suggestions about how visualizations could be useful for you. [...] Thanks a lot for these comments, they're very useful. Saludos, Jesus. -- -- Bitergia: http://bitergia.com http://blog.bitergia.com

On Tue, 2013-11-12 at 11:52 +0100, Federico Leva (Nemo) wrote: Thanks! It is pretty interesting. Our approach is a bit different: retrieve information from the wiki, store it into a database, and then produce analysis, visualization, etc from the database. But the functionality of StatMediaWiki is cool, indeed (however, it seems it still needs the dump to work, which is something we try to avoid). Saludos, Jesus. -- -- Bitergia: http://bitergia.com http://blog.bitergia.com

Hi Federico, On lun, 2013-11-11 at 19:40 +0100, Federico Leva (Nemo) wrote: Yes, this is our target. I am not sure we are going to add new things, this report is pretty exhaustive, but we are creating graphs similar to the others panels in Tech Community Metrics. We are updating also daily the data, as like the other data sources. And we are integrating user identities in the full process with the other data sources so for example, you can have the activity for a developer in git, gerrit, bugzilla, irc, mailing lists and mediawiki. I think we should link this report from Tech Community Metrics to get all details about statistics. Ok! taking a look to namespaces. It is easy to filter them using the API. The key is to understand which are content namespaces. Some recommendation? I have seen that "* Talk" pages are discussions pages name spaces so we can not include them. Yes, by default when getting allpages, we are getting just the ns=0 (Default: 0). So once this is fixed, we can recheck the data. Ok, we should research it. Queries are not so complex [0] but it is my first time with this API so I could be doing something wrong. Cheers [0] https://github.com/MetricsGrimoire/MediaWikiAnalysis/blob/master/mediawiki_… -- |\_____/| Alvaro del Castillo San Félix [o] [o] acs(a)bitergia.com - Chief Technical Officer (CTO) | V | http://www.bitergia.com | | "Bridging the gap between developers and stakeholders" -ooo-ooo-

On 11/12/2013 11:38 AM, Federico Leva (Nemo) wrote: Maybe the only namespace that would be worth filtering is User / User_talk. All the rest are equally worth in wikis of software projects (the natural scope of Metrics Grimoire and the precise example of mediawiki.org). -- Quim Gil Technical Contributor Coordinator @ Wikimedia Foundation http://www.mediawiki.org/wiki/User:Qgil

On mar, 2013-11-12 at 14:26 -0800, Quim Gil wrote: After looking to other mediawikis it seems that by default all contents goes to namespace 0. So covering this namespace is enough in this cases. In sites like mediawiki.org there are other content namespaces with lots of wiki pages. In mediawiki.org, namespaces 100+102 have the same pages as default namespace 0 (7K). Taking a look to other namespaces, I am not sure if they add information about activity or could add noise to the metrics. Quim, if you want, I can create a viz with all namespaces or add to the tool and option to use *all* namespaces available in the mediawiki based site. Cheers -- |\_____/| Alvaro del Castillo San Félix [o] [o] acs(a)bitergia.com - Chief Technical Officer (CTO) | V | http://www.bitergia.com | | "Bridging the gap between developers and stakeholders" -ooo-ooo-