Hi,
It seems that some articles are missing from the full dump of Wikipedia-en with revisions enwiki-latest-pages-meta-history.xml.7z (dating from August 26): I can't find an entry for "France" or "United States" for instance. The fact that it is 5.1GB, while previous dumps from July are more than 6GB may be another indication of this fact (I haven't downloaded them yet, so I can't be sure).
Does anyone know why these entries are missing? More importantly, would there be a way to be certain that the dump is truly complete before making it available for download? Is there a dump somewhere that has all articles with their revisions?
Thanks,
Hi Pierre.
There is a little file in the same page with a dump of the (hopefully) complete list of article titles for that dump (enwiki-latest-all-titles-in-ns0.gz). That file only contains the title for the article pages (those in the main namespace, for the ns=0).
BTW, check that the dump process didn't failed at some point... Check that the total count of lines in table page agrees with the total number of articles displayed in the web page for that dump. I've experimented some problems with another languages for that reason
So far, so good. Nevertheless, if you check this list you can read previous messages about fails and pitfalls in the dump process. It's a fact that the dump process for the bigger languages, specially for english, is not working very well.
I'm currently trying to decompress that same version of the dump. When it finish, we could double check our evidences... In case it is suspicious we could try with a previous dump.
Regards.
Felipe.
Pierre Senellart pierre@senellart.com escribió: Hi,
It seems that some articles are missing from the full dump of Wikipedia-en with revisions enwiki-latest-pages-meta-history.xml.7z (dating from August 26): I can't find an entry for "France" or "United States" for instance. The fact that it is 5.1GB, while previous dumps from July are more than 6GB may be another indication of this fact (I haven't downloaded them yet, so I can't be sure).
Does anyone know why these entries are missing? More importantly, would there be a way to be certain that the dump is truly complete before making it available for download? Is there a dump somewhere that has all articles with their revisions?
Thanks,
wikitech-l@lists.wikimedia.org