Hi!
I was wondering if there is a way to download an early English Wikipedia database xml dump (something in the first month or so). Curently, at download.wikimedia.org there are only a few recent dumps, and none of them are complete.
Thanks!
~Dimo
-------------------------------------
Не пропускай тази оферта! ПРОМО КОД `KOLEDA` незабавно ти дава до 20% отстъпка от цената на всяка поръчка за уеб хостинг от СуперХостинг.БГ http://www.superhosting.bg/mailfoot2.adv
lamiataspaska wrote:
Hi!
I was wondering if there is a way to download an early English Wikipedia database xml dump (something in the first month or so). Curently, at download.wikimedia.org there are only a few recent dumps, and none of them are complete.
Thanks!
~Dimo
Asking here for someone with a copy is probably the best way. I have an enwiki-20080103-pages-meta-history.xml.7z (18GB), but I know there was some later successful one.
2008/12/12 lamiataspaska@mail.bg:
Hi!
I was wondering if there is a way to download an early English Wikipedia database xml dump (something in the first month or so). Curently, at download.wikimedia.org there are only a few recent dumps, and none of them are complete.
You may be interested in http://nostalgia.wikipedia.org/wiki/HomePage
Dimo,
Check the internet archive http://www.archive.org/search.php?query=enwiki.
Note that since the full edit history dump includes the time stamps of each edit you could derive the state of wikipedia at any point in time.
Jeff Kubina http://claimid.com/kubina
On Fri, Dec 12, 2008 at 11:43 AM, Thomas Dalton thomas.dalton@gmail.comwrote:
2008/12/12 lamiataspaska@mail.bg:
Hi!
I was wondering if there is a way to download an early English Wikipedia database xml dump (something in the first month or so). Curently, at download.wikimedia.org there are only a few recent dumps, and none of them are complete.
You may be interested in http://nostalgia.wikipedia.org/wiki/HomePage
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Wed, Dec 17, 2008 at 10:32 AM, Jeff Kubina jeff.kubina@gmail.com wrote:
Dimo,
Check the internet archive http://www.archive.org/search.php?query=enwiki.
Note that since the full edit history dump includes the time stamps of each edit you could derive the state of wikipedia at any point in time.
Due to deletions, moves, partial undeletions (I.e. delete some revs, move the page, undelete everything) and various glitchups this is not strictly true.
2008/12/17 Gregory Maxwell gmaxwell@gmail.com:
On Wed, Dec 17, 2008 at 10:32 AM, Jeff Kubina jeff.kubina@gmail.com wrote:
Dimo,
Check the internet archive http://www.archive.org/search.php?query=enwiki.
Note that since the full edit history dump includes the time stamps of each edit you could derive the state of wikipedia at any point in time.
Due to deletions, moves, partial undeletions (I.e. delete some revs, move the page, undelete everything) and various glitchups this is not strictly true.
It's not at all true for the really early days - large amounts of the page histories from the first few months are gone for good.
On Wed, Dec 17, 2008 at 10:39 AM, Gregory Maxwell gmaxwell@gmail.comwrote:
On Wed, Dec 17, 2008 at 10:32 AM, Jeff Kubina jeff.kubina@gmail.com wrote:
Dimo,
Check the internet archive <
http://www.archive.org/search.php?query=enwiki%3E.
Note that since the full edit history dump includes the time stamps of
each
edit you could derive the state of wikipedia at any point in time.
Due to deletions, moves, partial undeletions (I.e. delete some revs, move the page, undelete everything) and various glitchups this is not strictly true.
Fortunately there's a move log for page moves after June 28, 2005. Before that, I think you have to guess, which especially sucks for GFDL compliance purposes.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Thomas Dalton wrote:
2008/12/12 lamiataspaska@mail.bg:
I was wondering if there is a way to download an early English Wikipedia database xml dump (something in the first month or so). Curently, at download.wikimedia.org there are only a few recent dumps, and none of them are complete.
You may be interested in http://nostalgia.wikipedia.org/wiki/HomePage
For background -- nostalgia.wikipedia.org is a read-only copy built from the earliest English Wikipedia backup I could find, from December 20, 2001.
I converted it to modern MediaWiki and put it up in 2005 for the 4th anniversary of Wikipedia's opening.
It's included in our regular XML data dumps, so you can pull a modern XML-style dump right here:
http://download.wikimedia.org/nostalgiawiki/20081126/nostalgiawiki-20081126-...
Revisions from 2005 are applications of automated format conversions to fix CamelCase links etc.
Unfortunately I'm not aware of any earlier Wikipedia backups still in existence; some revisions from the first few months won't be included in this dump (or in live Wikipedia) because UseModWiki, the software we originally ran on, came configured by default to delete old revisions after two weeks. :(
Some older revisions *might* still exist in the Internet Archive's Wayback Machine (http://archive.org/) but we've never done a systematic check...
- -- brion
Brion, thanks for the links to nostalgiawiki, could I please mirror (backup) the archive files on the site and upload them to the Internet Archive?
I searchedhttp://web.archive.org/web/1996-2004re_/http://download.wikimedia.orgArchive's Wayback Machine and couldn't find any full edit history dumps past this one http://ia310908.us.archive.org/3/items/enwiki-2006-11-04-backup/from 11-04-2006. I have a 20070402 dump herehttp://www.jeffkubina.org/data/wikipedia/dumps/enwiki/200704/enwiki-20070402-pages-meta-history.xml.7z .
Jeff
On 12/19/08 9:39 AM, Jeff Kubina wrote:
Brion, thanks for the links to nostalgiawiki, could I please mirror (backup) the archive files on the site and upload them to the Internet Archive?
Sure! Actually I can probably upload those under Wikimedia's account for good measure...
I searchedhttp://web.archive.org/web/1996-2004re_/http://download.wikimedia.orgArchive's Wayback Machine and couldn't find any full edit history dumps past this onehttp://ia310908.us.archive.org/3/items/enwiki-2006-11-04-backup/from 11-04-2006. I have a 20070402 dump herehttp://www.jeffkubina.org/data/wikipedia/dumps/enwiki/200704/enwiki-20070402-pages-meta-history.xml.7z
I've got a fair number of dumps from 2002-2003 sitting around offline, as well as a few from 2005-2006 (no enwiki full history in that period), but not much after that. (The downloads server was pretty aggressively expiring dumps for some time.)
We'll have more regular ones available after the dump script has been retooled to work in parallel with sane restart abilities.
-- brion
wikitech-l@lists.wikimedia.org