Hi guys,
We are working in an analyzer to gather the activity from MediaWiki sites using the cool MediaWiki API.
Right now the idea is to get a list of wiki pages using:
"action=query&list=allpages&aplimit=500"
and then for each page get all revisions with:
action=query&prop=revisions&titles=Main%20Page&rvlimit=500
so we have all revisions activity (pretty similar to having all commits to source code) for a MediaWiki site.
We are doing it as Open Source in:
https://github.com/MetricsGrimoire/MediaWikiAnalysis
Any comments are welcomed!
After having all the data we plan to use:
https://github.com/VizGrimoire/VizGrimoireR
for data analysis (SQL+R) combination
and for doing the viz:
https://github.com/VizGrimoire/VizGrimoireJS
Kudos to Sumana Harihareswara for pointing me to this list!
Cheers
If you're using WMF sites, you'll want to download database dumps instead. See http://dumps.wikimedia.org/.
On Thu, Nov 7, 2013 at 12:52 PM, Alvaro del Castillo acs@bitergia.com wrote:
Hi guys,
We are working in an analyzer to gather the activity from MediaWiki sites using the cool MediaWiki API.
Right now the idea is to get a list of wiki pages using:
"action=query&list=allpages&aplimit=500"
and then for each page get all revisions with:
action=query&prop=revisions&titles=Main%20Page&rvlimit=500
so we have all revisions activity (pretty similar to having all commits to source code) for a MediaWiki site.
We are doing it as Open Source in:
https://github.com/MetricsGrimoire/MediaWikiAnalysis
Any comments are welcomed!
After having all the data we plan to use:
https://github.com/VizGrimoire/VizGrimoireR
for data analysis (SQL+R) combination
and for doing the viz:
https://github.com/VizGrimoire/VizGrimoireJS
Kudos to Sumana Harihareswara for pointing me to this list!
Cheers
|_____/| Alvaro del Castillo San Félix [o] [o] acs@bitergia.com - Chief Technical Officer (CTO) | V | http://www.bitergia.com | | "Bridging the gap between developers and stakeholders" -ooo-ooo-
Mediawiki-api mailing list Mediawiki-api@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
On 07/11/13 19:29, Brad Jorsch (Anomie) wrote:
If you're using WMF sites, you'll want to download database dumps instead. See http://dumps.wikimedia.org/.
Indeed. Moreover, for your usecase stub dumps may be enough for you.
On Thu, Nov 7, 2013 at 12:52 PM, Alvaro del Castillo acs@bitergia.comwrote:
Hi guys,
We are working in an analyzer to gather the activity from MediaWiki sites using the cool MediaWiki API.
Sounds like an interesting project. I am working on something similar that will start with the most recent dump and do API queries to stay up to date. Perhaps we can collaborate? I created https://www.mediawiki.org/wiki/MediaWikiAnalysis as a starting point for further on-wiki discussion, if you're interested. Thanks.
mediawiki-api@lists.wikimedia.org