I think I would be very interested in 3, or even, in having every month a dump of that month's revisions.  As I have built tools for the xml dumps, no change in format is good for me (and for WikiTrust). 

I would find incremental dumps (with occasional, yearly, full dumps) much easier to manage than full dumps. 

Luca

On Thu, Mar 31, 2011 at 2:27 PM, Yuvi Panda <yuvipanda@gmail.com> wrote:
Hi, I'm a student planning on doing GSoC this year on mediawiki.
Specifically, I'd like to work on data dumps.

I'm writing this to gauge what would be useful to the research
community. Several ideas thrown about include:
1. JSON Dumps
2. Sqlite Dumps
3. Daily dumps of revisions in last 24 hours
4. Dumps optimized for very fast import into various external storage
and smaller size (diffs)
5. JSON/CSV for Special:Import and Special:Export

Would any of these be useful? Or is there anything else that I'm
missing, that you would consider much more useful?

Feedback would be invaluable :)

Thanks :)
--
Yuvi Panda T
http://yuvi.in/blog

_______________________________________________
Wiki-research-l mailing list
Wiki-research-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l