Xmldatadumps-l April 2020

xmldatadumps-l@lists.wikimedia.org

5 participants
6 discussions

Wikipedia xml dumps 2009-2013
by Katja Schmahl 01 May '20

01 May '20

Hi all, I’m doing research to the existence of gender bias in Wikipedia texts over time. To do this, I need old pages-articles.xml dumps. I am still looking for dumps from 2009 and 2011-2013, does anyone know how I can get one of these or does someone have one of these stored themselves? Thanks in advance, Katja Schmahl

3 2

[OT] Help: dumps not accessible in Kubernetes
by Benjamín Valero Espinosa 27 Apr '20

27 Apr '20

Hi, First of all, excuse me as I guess this is not appropriate channel to ask this. The dumps are not accessible anymore from some Kubernetes pods in the ToolLabs server: https://phabricator.wikimedia.org/T247455 Please, could anyone help me to improve this ticket so it is taken into account? Kind regards,

2 2

New dumps available: MachineVision extension tables
by Ariel Glenn WMF 21 Apr '20

21 Apr '20

Good morning! New weekly dumps are available [1], containing the content of the tables used by the MachineVision extension [2]. For information about these tables, please see [3]. If you decide to use these tables, as with any other dumps, I would be interested to know how you use them; feel free to drop me an email. Wishing everyone good health, Ariel [1] https://dumps.wikimedia.org/other/machinevision/ [2] https://www.mediawiki.org/wiki/Extension:MachineVision [3] https://www.mediawiki.org/wiki/Extension:MachineVision/Schema

1 0

BREAKING CHANGE: feature removal (private table dumps)
by Ariel Glenn WMF 06 Apr '20

06 Apr '20

For the past few years we have not dumped private tables at all; they would not be accessible to the public in any case, and they do not suffice as a backup in case of catastrophic failure. We are therefore removing the feature to dump private tables along with public tables in a dump run. Anyone who wishes to use the dump scripts in our python repo to dump privat tables in their wiki will need to create a separate dumps configuration file and tables yaml file describing which tables to dump and where to put them, as a separate dump run. This change will be committed by April 20, 2020, in time for the second dump run of the month. Note that this does not impact the actual output of the Wikimedia SQL/XML dumps at all, since we have not been dumping private tables since late 2016. See T249508 to follow along. Ariel

1 0

Duplicate entry in last Spanish dump
by Benjamín Valero Espinosa 06 Apr '20

06 Apr '20

Hi, Sorry if this is not the right place to report this. In the last Spanish Wikipedia dump (still in progress): https://dumps.wikimedia.org/eswiki/20200401/ the "pages-articles" dump is duplicated. I guess, based on the dump from March (and also the previous ones) that they are really two different files, so the filename should reflect it as before. I am aware there had been recent modifications in the way the multistream dumps are built, so maybe there is some kind of issue there. Best Regards,

2 2

XML Dumps FAQ monthly update
by noreply.xmldatadumps＠wikimedia.org 01 Apr '20

01 Apr '20

Greetings XML Dump users and contributors! This is your automatic monthly Dumps FAQ update email. This update contains figures for the 20200301 full revision history content run. We are currently dumping 910 projects in total. --------------------- Stats for euwiktionary on date 20200301 Total size of page content dump files for articles, current content only: 67765999 Total size of page content dump files for all pages, current content only: 68901734 Total size of page content dump files for all pages, all revisions: 532573202 --------------------- Stats for enwiki on date 20200301 Total size of page content dump files for articles, current content only: 76154026008 Total size of page content dump files for all pages, current content only: 169370554542 Total size of page content dump files for all pages, all revisions: 20379079466354 --------------------- Sincerely, Your friendly Wikimedia Dump Info Collector

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Xmldatadumps-l April 2020