[Wikimedia-l] [Wikitech-l] media tarballs announcement

[Benjamin Lees]

This is great!  Forwarding to wikimedia-l.

On Mon, Jun 18, 2012 at 6:17 AM, Ariel T. Glenn <ariel at wikimedia.org> wrote:

> Folks who are interested in downloading tarballs of media for their
> particular project can now do so from:
>
>  http://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/
>
> In this directory you will see two subdirectories, "fulls" and "incrs".
> The way this works is that once a month near the beginning of the month
> we will produce a series of tarballs for each project of media uploaded
> locally and media stored on commons.  During the month, at least once
> but hopefully twice, we will produce tarballs containing the files
> uploaded locally or included from commons since the "full" tarball
> date.
>
> No tarballs are being produced for commons itself, given that it's 14T
> and there would be no separate locally uploaded/remotely uploaded lists.
> Instead please use rsync to get those files directly from:
>
>  rsync://ftpmirror.your.org/wikimedia-images/wikipedia/commons/
>
> Also, please bear in mind that for author and license information you
> should download the corresponding pages-meta-current.xml.bz2 file from
> http://dumps.wikimedia.org/ or your local mirror, and check the
> corresponding File: description pages for your project or commons.
>
> And now it's time as usual for the Big Fat Disclaimer:
>
> We're still running these manually, it's possible that we won't make the
> planned schedule for a given run or runs, network connectivity might be
> unstable, etc. etc.  Its also possible we will restructure the fulls so
> that they take a lot less space and rely on three series of tarballs for
> some projects.
>
> Thanks once again to your.org for donating the time, space and bandwidth
> to make this possible.
>
> Ariel
>
>
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>