I'd like all the dumps from all the projects to be on line. Being realistic I think we would wind up keeping offline copies of all of it, and copies from every 6 months online, with the last several months of consecutive runs = around 20 or 30 of them also online.
Since these are en wiki we would likely just put them all up. The 2010 files we have, of course.
These being public files, I can do the "copy to google storage" routine for some of them as well, making them available for download from there once we get the kinks worked out.
In the meantime we are still looking for mirrors... no reason some mirrors couldn't keep *all* the files, if they have space.
Ariel
Στις 31-12-2010, ημέρα Παρ, και ώρα 12:00 -0500, ο/η Anthony έγραψε:
On Fri, Dec 31, 2010 at 10:54 AM, Platonides Platonides@gmail.com wrote:
Would be nice having an additional md5sum file for the uncompressed dumps.
Yes.
Here's what I found on my SATA and USB drives. I haven't had a chance to go through my IDE drives - that would take a while as I don't yet have a decent removable drive bay for IDE. I'm sure I have a bunch of old dumps on there, though.
If someone wants to host any/all of this publicly and permanently, I'd love to help them get copies of the files. If it's just to store offline under the control of the WMF, I wouldn't.
20050309_old_table.sql.bz2 en20050309.7z enwiki-20060125-pages-meta-history.xml.7z enwiki-20060125-pages-meta-history.xml.7z.note enwiki-20070402_files.xml enwiki-20070402_meta.xml enwiki-20070402-pages.csv enwiki-20070402-pages-meta-history.xml.7z enwiki-20070402-pages-meta-history.xml.bz2 enwiki-20070402-pages-meta-history.xml.bz2 enwiki-20070402-pages-meta-history.xml.bz2 enwiki-20070402-pages-meta-history.xml.bz2.info enwiki-20070402-pages-meta-history.xml.tree.xz enwiki-20070402-revisions.csv enwiki-20070908-pages-meta-current.xml.bz2 enwiki-20070908-pages-meta-current.xml.bz2.filepart enwiki-20070908-pages-meta-history.xml.bz2 enwiki-20070908-pages-meta-history.xml.bz2.filepart enwiki-20071018-md5sums.txt enwiki-20071018-pages-meta-history.xml.bz2 enwiki-20080103-abstract.xml.7z enwiki-20080103-abstract.xml.xz enwiki-20080103-all-titles-in-ns0.7z enwiki-20080103-all-titles-in-ns0.gz enwiki-20080103-categorylinks.sql.7z enwiki-20080103-categorylinks.sql.gz enwiki-20080103-externallinks.sql.7z enwiki-20080103-externallinks.sql.gz enwiki-20080103_files.xml enwiki-20080103-imagelinks.sql.7z enwiki-20080103-imagelinks.sql.gz enwiki-20080103-image.sql.7z enwiki-20080103-image.sql.gz enwiki-20080103-interwiki.sql.7z enwiki-20080103-interwiki.sql.gz enwiki-20080103-langlinks.sql.7z enwiki-20080103-langlinks.sql.gz enwiki-20080103-logging.sql.7z enwiki-20080103-logging.sql.gz enwiki-20080103-logging.sql.gz enwiki-20080103-md5sums.txt enwiki-20080103-md5sums.txt enwiki-20080103_meta.xml enwiki-20080103-oldimage.sql.7z enwiki-20080103-oldimage.sql.gz enwiki-20080312-imagelinks.sql.gz enwiki-20080312-image.sql.gz enwiki-20080312-interwiki.sql.gz enwiki-20080312-langlinks.sql.gz enwiki-20080312-logging.sql.gz enwiki-20080312-md5sums.txt enwiki-20080312-oldimage.sql.gz enwiki-20080312-pagelinks.sql.gz enwiki-20080312-page_restrictions.sql.gz enwiki-20080312-pages-articles.xml.bz2 enwiki-20080312-pages-meta-current.xml.bz2 enwiki-20080312-pages-meta-current.xml.bz2.crcs.bz2 enwiki-20080312-pages-meta-current.xml.bz2.scan.bz2 enwiki-20080312-pages-meta-current.xml.sizes.bz2 enwiki-20080312-pages-meta-history.xml.7z enwiki-20080312-pages-meta-history.xml.bz2 enwiki-20080312-page.sql.gz enwiki-20080312-redirect.sql.gz enwiki-20080312-site_stats.sql.gz enwiki-20080312-stub-articles.xml.gz enwiki-20080312-stub-articles.xml.gz enwiki-20080312-stub-meta-current.xml.gz enwiki-20080312-stub-meta-history.xml.gz enwiki-20080312-stub-meta-history.xml.gz enwiki-20080312-templatelinks.sql.gz enwiki-20080312-user_groups.sql.gz enwiki-20080524-abstract.xml enwiki-20080524-abstract.xml.xz enwiki-20080524-all-titles-in-ns0.gz enwiki-20080524-all-titles-in-ns0.gz enwiki-20080524-categorylinks.sql.gz enwiki-20080524-categorylinks.sql.gz enwiki-20080524-externallinks.sql.gz enwiki-20080524-externallinks.sql.gz enwiki-20080524-imagelinks.sql.gz enwiki-20080524-imagelinks.sql.gz enwiki-20080524-image.sql.gz enwiki-20080524-image.sql.gz enwiki-20080524-interwiki.sql.gz enwiki-20080524-interwiki.sql.gz enwiki-20080524-langlinks.sql.gz enwiki-20080524-langlinks.sql.gz enwiki-20080524-logging.sql.gz enwiki-20080524-logging.sql.gz enwiki-20080524-md5sums.txt enwiki-20080524-md5sums.txt enwiki-20080524-oldimage.sql.gz enwiki-20080524-oldimage.sql.gz enwiki-20080524-pagelinks.sql.gz enwiki-20080524-pagelinks.sql.gz enwiki-20080524-page_restrictions.sql.gz enwiki-20080524-page_restrictions.sql.gz enwiki-20080524-pages-articles.xml.bz2 enwiki-20080524-pages-articles.xml.bz2 enwiki-20080524-pages-meta-current.xml.bz2 enwiki-20080524-pages-meta-current.xml.bz2 enwiki-20080524-pages-meta-history.xml.bz2 enwiki-20080524-page.sql.gz enwiki-20080524-page.sql.gz enwiki-20080524-redirect.sql.gz enwiki-20080524-redirect.sql.gz enwiki-20080524-site_stats.sql.gz enwiki-20080524-site_stats.sql.gz enwiki-20080524-stub-articles.xml.gz enwiki-20080524-stub-articles.xml.gz enwiki-20080524-stub-meta-current.xml.gz enwiki-20080524-stub-meta-current.xml.gz enwiki-20080524-stub-meta-history.xml.gz enwiki-20080524-stub-meta-history.xml.gz enwiki-20080524-templatelinks.sql.gz enwiki-20080524-templatelinks.sql.gz enwiki-20080524-user_groups.sql.gz enwiki-20080524-user_groups.sql.gz enwiki-20080714-abstract.xml enwiki-20080714-abstract.xml.xz enwiki-20080714-all-titles-in-ns0.gz enwiki-20080714-all-titles-in-ns0.gz enwiki-20080714-categorylinks.sql.gz enwiki-20080714-categorylinks.sql.gz enwiki-20080714-category.sql.gz enwiki-20080714-category.sql.gz enwiki-20080714-externallinks.sql.gz enwiki-20080714-externallinks.sql.gz enwiki-20080714-imagelinks.sql.gz enwiki-20080714-imagelinks.sql.gz enwiki-20080714-image.sql.gz enwiki-20080714-image.sql.gz enwiki-20080714-interwiki.sql.gz enwiki-20080714-interwiki.sql.gz enwiki-20080714-langlinks.sql.gz enwiki-20080714-langlinks.sql.gz enwiki-20080714-logging.sql.gz enwiki-20080714-logging.sql.gz enwiki-20080714-md5sums.txt enwiki-20080714-md5sums.txt enwiki-20080714-oldimage.sql.gz enwiki-20080714-oldimage.sql.gz enwiki-20080714-pagelinks.sql.gz enwiki-20080714-pagelinks.sql.gz enwiki-20080714-page_props.sql.gz enwiki-20080714-page_props.sql.gz enwiki-20080714-page_restrictions.sql.gz enwiki-20080714-page_restrictions.sql.gz enwiki-20080714-pages-articles.xml.bz2 enwiki-20080714-pages-articles.xml.bz2 enwiki-20080714-pages-meta-current.xml.bz2 enwiki-20080714-pages-meta-current.xml.bz2 enwiki-20080714-page.sql.gz enwiki-20080714-page.sql.gz enwiki-20080714-protected_titles.sql.gz enwiki-20080714-protected_titles.sql.gz enwiki-20080714-redirect.sql.gz enwiki-20080714-redirect.sql.gz enwiki-20080714-site_stats.sql.gz enwiki-20080714-site_stats.sql.gz enwiki-20080714-stub-articles.xml.gz enwiki-20080714-stub-articles.xml.gz enwiki-20080714-stub-meta-current.xml.gz enwiki-20080714-stub-meta-current.xml.gz enwiki-20080714-stub-meta-history.xml.gz enwiki-20080714-stub-meta-history.xml.gz enwiki-20080714-templatelinks.sql.gz enwiki-20080714-templatelinks.sql.gz enwiki-20080714-user_groups.sql.gz enwiki-20080714-user_groups.sql.gz enwiki-20080724-abstract.xml.xz enwiki-20080724-all-titles-in-ns0.gz enwiki-20080724-categorylinks.sql.gz enwiki-20080724-category.sql.gz enwiki-20080724-externallinks.sql.gz enwiki-20080724-imagelinks.sql.gz enwiki-20080724-image.sql.gz enwiki-20080724-interwiki.sql.gz enwiki-20080724-langlinks.sql.gz enwiki-20080724-logging.sql.gz enwiki-20080724-md5sums.txt enwiki-20080724-oldimage.sql.gz enwiki-20080724-pagelinks.sql.gz enwiki-20080724-page_props.sql.gz enwiki-20080724-page_restrictions.sql.gz enwiki-20080724-pages-articles.xml.bz2 enwiki-20080724-pages-meta-current.xml.bz2 enwiki-20080724-pages-meta-history.xml.bz2 enwiki-20080724-page.sql.gz enwiki-20080724-protected_titles.sql.gz enwiki-20080724-redirect.sql.gz enwiki-20080724-site_stats.sql.gz enwiki-20080724-stub-articles.xml.gz enwiki-20080724-stub-meta-current.xml.gz enwiki-20080724-stub-meta-history.xml.gz enwiki-20080724-templatelinks.sql.gz enwiki-20080724-user_groups.sql.gz enwiki-20081008-all-titles-in-ns0.gz enwiki-20081008-categorylinks.sql.gz enwiki-20081008-category.sql.gz enwiki-20081008-externallinks.sql.gz enwiki-20081008-imagelinks.sql.gz enwiki-20081008-image.sql.gz enwiki-20081008-interwiki.sql.gz enwiki-20081008-langlinks.sql.gz enwiki-20081008-logging.sql.gz enwiki-20081008-md5sums.txt enwiki-20081008-oldimage.sql.gz enwiki-20081008-pagelinks.sql.gz enwiki-20081008-page_props.sql.gz enwiki-20081008-page_restrictions.sql.gz enwiki-20081008-pages-articles.xml.bz2 enwiki-20081008-pages-meta-current.xml.bz2 enwiki-20081008-page.sql.gz enwiki-20081008-protected_titles.sql.gz enwiki-20081008-redirect.sql.gz enwiki-20081008-site_stats.sql.gz enwiki-20081008-stub-articles.xml.gz enwiki-20081008-stub-meta-current.xml.gz enwiki-20081008-stub-meta-history.xml.gz enwiki-20081008-templatelinks.sql.gz enwiki-20081008-user_groups.sql.gz enwiki-20091009-abstract.xml.xz enwiki-20091009-all-titles-in-ns0.gz enwiki-20091009-categorylinks.sql.gz enwiki-20091009-category.sql.gz enwiki-20091009-externallinks.sql.gz enwiki-20091009-imagelinks.sql.gz enwiki-20091009-image.sql.gz enwiki-20091009-interwiki.sql.gz enwiki-20091009-langlinks.sql.gz enwiki-20091009-md5sums.txt enwiki-20091009-oldimage.sql.gz enwiki-20091009-pagelinks.sql.gz enwiki-20091009-page_props.sql.gz enwiki-20091009-page_restrictions.sql.gz enwiki-20091009-pages-articles.xml.bz2 enwiki-20091009-pages-logging.xml.gz enwiki-20091009-pages-meta-current.xml.bz2 enwiki-20091009-page.sql.gz enwiki-20091009-protected_titles.sql.gz enwiki-20091009-redirect.sql.gz enwiki-20091009-site_stats.sql.gz enwiki-20091009-stub-articles.xml.gz enwiki-20091009-stub-meta-current.xml.gz enwiki-20091009-stub-meta-history.xml.gz enwiki-20091009-templatelinks.sql.gz enwiki-20091009-user_groups.sql.gz enwiki-20091103-categorylinks.sql.bz2 enwiki-20091103-category.sql.gz enwiki-20091103-externallinks.sql.bz2 enwiki-20091103-image.sql.gz enwiki-20091103-interwiki.sql.gz enwiki-20091103-langlinks.sql.gz enwiki-20091103-pagelinks.sql.bz2 enwiki-20091103-pages-meta-current.xml.bz2 enwiki-20091103-page.sql.gz enwiki-20091128-abstract.xml.bz2 enwiki-20091128-all-titles-in-ns0.gz enwiki-20091128-categorylinks.sql.gz enwiki-20091128-category.sql.gz enwiki-20091128-externallinks.sql.gz enwiki-20091128-imagelinks.sql.gz enwiki-20091128-image.sql.gz enwiki-20091128-interwiki.sql.gz enwiki-20091128-langlinks.sql.gz enwiki-20091128-md5sums.txt enwiki-20091128-oldimage.sql.gz enwiki-20091128-pagelinks.sql.gz enwiki-20091128-page_props.sql.gz enwiki-20091128-page_restrictions.sql.gz enwiki-20091128-pages-articles.xml.bz2 enwiki-20091128-pages-logging.xml.gz enwiki-20091128-pages-meta-current.xml.bz2 enwiki-20091128-page.sql.gz enwiki-20091128-protected_titles.sql.gz enwiki-20091128-redirect.sql.gz enwiki-20091128-site_stats.sql.gz enwiki-20091128-stub-articles.xml.gz enwiki-20091128-stub-meta-current.xml.gz enwiki-20091128-stub-meta-history.xml.gz enwiki-20091128-templatelinks.sql.gz enwiki-20091128-user_groups.sql.gz enwiki-20100130-image.sql.gz enwiki-20100130-md5sums.txt enwiki-20100130-oldimage.sql.gz enwiki-20100130-pages-logging.xml.gz enwiki-20100130-pages-meta-history.xml.7z enwiki-20100130-protected_titles.sql.gz enwiki-20100130-site_stats.sql.gz enwiki-20100130-stub-meta-history.xml.gz enwiki-20100312-categorylinks.sql.gz enwiki-20100312-category.sql.gz enwiki-20100312-md5sums.txt enwiki-20100312-md5sums.txt enwiki-20100312-page.csv enwiki-20100312-page.dump.0 enwiki-20100312-page.dump.9 enwiki-20100312-pages-meta-current.xml.bz2 enwiki-20100312-pages-meta-history.xml.7z enwiki-20100312-pages-meta-history.xml.bz2 enwiki-20100312-pages-meta-history.xml.bz2 enwiki-20100312-pages-meta-history.xml.bz2.info enwiki-20100312-pages-meta-history.xml.xz enwiki-20100312-page.sql.gz enwiki-20100312-pages-meta-history.xml.xz enwiki-20100312-page.sql.gz enwiki-20100312-protected_titles.sql.gz enwiki-20100312-redirect.sql.gz enwiki-20100312-site_stats.sql.gz enwiki-20100312-stub-meta-history.xml.gz wikipedia-051105-preprocessed.tar.bz2 wikipedia-logs-2001-08-17.7z
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l