Maarten Dammers, 13/10/2013 13:50: There are already counts, see e.g. the descriptions I linked. This archive is mostly a "just in case", but you can never say. Probably not: WMF has very limited bandwidth even for XML dumps, it wouldn't be particularly useful. However, there are many mirrors out there, so convincing some to seed a few torrents would be nice. Archive.org has decent bandwidth and no throttling; unless you happen to reach them via the horrible he.net links (especially transatlantic), it's mostly fine. https://monitor.archive.org/weathermap/weathermap.html Nemo

+1 kudos to the whole wikiteam! On Sun, Oct 13, 2013 at 5:31 PM, Emilio J. Rodríguez-Posada <emijrp(a)gmail.com> wrote: -- Samuel Klein @metasj w:user:sj +1 617 529 4266

Brilliant! Now we just need someone with a good idea, a fast connection and huge hard drives to do cool stuff with all those images :) -- Hay On Mon, Oct 14, 2013 at 1:32 AM, Fabrice Florin <fflorin(a)wikimedia.org> wrote: On Mon, Oct 14, 2013 at 1:32 AM, Fabrice Florin <fflorin(a)wikimedia.org> wrote: -- Kind regards, -- Hay Kranen Wikipedian in Residence Koninklijke Bibliotheek & Nationaal Archief (the Netherlands) http://www.twitter.com/hayify

2013/10/14 Gerard Meijssen <gerard.meijssen(a)gmail.com> Basically, you can't. Internet Archive has this problem in several other topics, like its Wayback Machine, there is not search engine to search the billions grabbed websites by keyword of whatever. Internet Archive is a pile of hard disks and a time capsule with backups, and they try to do the best at showing the materials (media players, pdf viewers), but it is not always easy or possible.

The first step is that we now have stuff in different places. There used to be a period of time a few years ago when there weren't *any* backups of Commons images. The next step is that somebody uses these dumps for a new creative project. Maybe someone working at a university with lots of bandwidth and lots of space... On Mon, Oct 14, 2013 at 2:26 PM, Federico Leva (Nemo) <nemowiki(a)gmail.com> wrote: -- Kind regards, -- Hay Kranen Wikipedian in Residence Koninklijke Bibliotheek & Nationaal Archief (the Netherlands) http://www.twitter.com/hayify

It was not the original intention of us at WikiTeam to create these media tarballs so that researchers can use them from there. We created these tarballs so that everyone in the Wikimedia movement can be rest assured that there is one backup copy of their media on the Internet Archive. Trust me, the number of people who are going to actually use these tarballs are going to be lesser than the number of people editing the smaller wikis combined, certainly everyone is going to be using the data on Commons itself. So, we can fully focus on improving Commons to make it more data-accessible without taking the risk of having people working on the tarballs on the Internet Archive for research instead. That being said, we can't even guarantee that the images in these tarballs are up-to-date. They are all downloaded and should be regarded as a snapshot of the image at the time of download, not an effective live backup of all the images on Commons. We are looking into creating subsequent tarballs that take into account the new uploads and the re-uploads so that Commons is actually backed up. I guess the way we presented the tarballs on the Internet Archive is enough to deter anyone from conducting research directly from it, unless he/she does an in-depth mining of the data to get what he/she wants, but it certainly is going to be much tougher than mining the information from Commons directly in its current state. On Mon, Oct 14, 2013 at 8:59 PM, Gerard Meijssen <gerard.meijssen(a)gmail.com>wrote;wrote: -- Regards, Hydriz Be social, follow/add me: Facebook: http://tinyurl.com/hydrizfb Google+: http://tinyurl.com/hydrizgl Twitter: @hydrizwiki

On 14 October 2013 13:59, Gerard Meijssen <gerard.meijssen(a)gmail.com> wrote: And you need to stop right there. As in don't express a further opinion until you realise how wrong you are. You can't do any analysis on data that is lost. And non backed up data is just data that doesn't know that it is lost yet. -- geni