This is great! Forwarding to wikimedia-l.

On Mon, Jun 18, 2012 at 6:17 AM, Ariel T. Glenn ariel@wikimedia.org wrote:

Folks who are interested in downloading tarballs of media for their particular project can now do so from:

http://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/

In this directory you will see two subdirectories, "fulls" and "incrs". The way this works is that once a month near the beginning of the month we will produce a series of tarballs for each project of media uploaded locally and media stored on commons. During the month, at least once but hopefully twice, we will produce tarballs containing the files uploaded locally or included from commons since the "full" tarball date.

No tarballs are being produced for commons itself, given that it's 14T and there would be no separate locally uploaded/remotely uploaded lists. Instead please use rsync to get those files directly from:

rsync://ftpmirror.your.org/wikimedia-images/wikipedia/commons/

Also, please bear in mind that for author and license information you should download the corresponding pages-meta-current.xml.bz2 file from http://dumps.wikimedia.org/ or your local mirror, and check the corresponding File: description pages for your project or commons.

And now it's time as usual for the Big Fat Disclaimer:

We're still running these manually, it's possible that we won't make the planned schedule for a given run or runs, network connectivity might be unstable, etc. etc. Its also possible we will restructure the fulls so that they take a lot less space and rely on three series of tarballs for some projects.

Thanks once again to your.org for donating the time, space and bandwidth to make this possible.

Ariel

---

Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l