Xmldatadumps-l January 2020

xmldatadumps-l@lists.wikimedia.org

4 participants
3 discussions

Ordering of revisions
by Christopher Wolfram 18 Jan '20

18 Jan '20

Hi, Perhaps there is documentation about this, but I have looked for the past hour and haven’t found anything. I was wondering if it is guaranteed that all revisions given in the enwiki-latest-pages-meta-history files are in order of parent->child->grandchild->… In a few examples, it looks like they follow this pattern. I ask because I need them in order and it would be nice if I didn’t have to do that with the <parentid> field. Thank you, Christopher

3 3

Your help requested (testing decompression)
by Ariel Glenn WMF 08 Jan '20

08 Jan '20

if you use one of the utilities listed here: https://phabricator.wikimedia.org/T239866 I'd like you to download one of the 'multistream' dumps and see if your utility decompresses it fully or not (you can compare the md5sum of the decompressed content to the regular file's decompressed content and see if they are the same). Then note the results and the version of the utility on this task. Alternatively, if you use some other utility to work with the bz2 files, please test using that, and add that on the task too. Here are two files for download and comparison of decompressed content: https://dumps.wikimedia.org/cewiki/20191201/cewiki-20191201-pages-articles.… and https://dumps.wikimedia.org/cewiki/20191201/cewiki-20191201-pages-articles-… Both are around 50 megabytes. Thank you in advance to whomever participates! Ariel

1 1

XML Dumps FAQ monthly update
by noreply.xmldatadumps＠wikimedia.org 01 Jan '20

01 Jan '20

Greetings XML Dump users and contributors! This is your automatic monthly Dumps FAQ update email. This update contains figures for the 20191201 full revision history content run. We are currently dumping 910 projects in total. --------------------- Stats for bnwiktionary on date 20191201 Total size of page content dump files for articles, current content only: 22543877 Total size of page content dump files for all pages, current content only: 34990319 Total size of page content dump files for all pages, all revisions: 181821103 --------------------- Stats for enwiki on date 20191201 Total size of page content dump files for articles, current content only: 74758773669 Total size of page content dump files for all pages, current content only: 166645226713 Total size of page content dump files for all pages, all revisions: 19963955381507 --------------------- Sincerely, Your friendly Wikimedia Dump Info Collector

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Xmldatadumps-l January 2020