Xmldatadumps-l March 2016

xmldatadumps-l@lists.wikimedia.org

7 participants
8 discussions

Duplicate pages
by Sebastiano Vigna 12 Apr '16

12 Apr '16

The current dump enwiki-20160204-pages-articles.xml.bz2 contains duplicate pages. In particular, "Total Nonstop Action" and "Ida de Grey" appear twice. Is this going to be fixed or should we assume that there might be duplicated pages in the dump? This never happened to us before. Ciao, seba

2 4

Renewal of question for a dump of all .svg files in commons.
by D. Hansen 03 Apr '16

03 Apr '16

Hi! Last year I was provided very kindly with a list of all svg-files on commons, that is their then *real* http(s)-paths. (Either by John phoenixoverride(a)gmail.com or by Ariel T. Glenn aglenn(a)wikimedia.org aglenn(a)wikimedia.org.) Could I get a current version of this dump, please? (With the real paths and really existing files.) Back then the dump was > http://tools.wmflabs.org/betacommand-dev/reports/commonswiki_svg_list.txt.7z as far as I remember. (Someone told me I could create such a dump myself with some wiki-tools. Is this really possible?) Greetings John I sent this same message twice, but it didn't show up. Sorry, if it's still appearing twice maybe.

4 9

enwiki dumpls not showing up on labs.
by Bryan White 15 Mar '16

15 Mar '16

Ariel, Not sure if this is in the dumps email list domain or the lab domain. The enwiki dumps for this month are not showing up in lab's dumps directory. This was brought to my attention by another use trying to use the dump file. Bryan

2 1

Partial dumps
by Samat 05 Mar '16

05 Mar '16

Hi! What is the reason that today we generated only partial dumps for almost all wikis? https://dumps.wikimedia.org/backup-index.html Best, Samat

2 2

old dumps
by Samat 05 Mar '16

05 Mar '16

Hi, I have a related question. Last week I looked for full xml dumps of huwiki from 2013. * dumps.wikimedia.org provides dumps back to 2015-07-02 now ( https://dumps.wikimedia.org/huwiki/20150702/ ) * in Internet Archive there is a gap between 2012-06-13 and 2014-07-27 ( https://archive.org/download/huwiki20120613 ) ( https://archive.org/download/huwiki-20140727 ) Do you know any source where I could download dumps from this period? Or did we loose them forever? Thank you. Best, Samat > 2015, 2016 dumps are available at the wikimedia dumps website. > > However I would like to have access to old xml wikipedia dumps. > I've been googling all around and tried everything from Torrents to an EBS > snapshot on amazon which supposedly contained many of the xml dumps. > > Ive managed to somehow get access to random dumps for all years from 2006 > to 2016, However I would like to get specific dumps. i.e: all dumpsaround > March for the mentioned years. > > I wonder if there is a repository, or if anyone could share a them via > torrents( the current torrens don't have any seeds) > > Thanks > >

1 0

New maintenance window Mar 4 1 - 4 pm UTC (was Re: dataset1001 (dumps.wikimedia.org) maintenance window March 2 1-4pm UTC)
by Ariel Glenn WMF 04 Mar '16

04 Mar '16

Fallback is: cable up the old 1GB nic (Chris has done this and set up the port), PXE install on that, move to 10gb NIC once we're back up. Gross but it gets the job done. Set for tomorrow (Friday) 1 to 4 pm UTC, this time should be much smoother. Same caveats apply as before. Ariel On Wed, Mar 2, 2016 at 8:47 PM, Ariel Glenn WMF <ariel(a)wikimedia.org> wrote: > PXE boot from non-embedded nic failed spectacularly despite our best > efforts. This means we'll have to schedule another window once we have > someting new to try. I apologize for the extra inconvenience. All services > are back exactly the way they were. > > Ariel > > On Wed, Mar 2, 2016 at 6:01 PM, Ariel Glenn WMF <ariel(a)wikimedia.org> > wrote: > >> Extending this downtime window because we ran into unexpected issues with >> PXE boot. >> >> On Tue, Mar 1, 2016 at 3:53 PM, Ariel Glenn WMF <ariel(a)wikimedia.org> >> wrote: >> >>> Dataset1001, the host which serves dumps and other datasets to the >>> public, as well as providing access to various datasets directly on >>> stats100x, will be unavailable tomorrow for an upgrade to jessie. While I >>> don't expect to need nearly 3 hours for the upgrade, better safe than >>> sorry. In the meantime all files will be accessible via >>> ms1001.wikimedia.org via the web, and all dumps and page view files >>> from our mirrors as well. >>> >>> Thanks for your understanding. >>> >>> Ariel Glenn >>> >>> >>> >> >

2 3

Checkpoints enabled for four more large wikis
by Ariel Glenn WMF 03 Mar '16

03 Mar '16

I've turned on 'checkpointing' for the following wikis: eswiki, itwiki, ruwiki, wikidatawiki This means that, as for enwiki and now dewiki, smaller and more files will be produced with page content. See https://gerrit.wikimedia.org/r/#/c/274730/ for the changeset. I've done this for two reasons: first, the files were getting large, and second, recovery from failure in those steps will now be quicker and easier for those wikis. Ariel

1 0

dataset1001 (dumps.wikimedia.org) maintenance window March 2 1-4pm UTC
by Ariel Glenn WMF 02 Mar '16

02 Mar '16

Dataset1001, the host which serves dumps and other datasets to the public, as well as providing access to various datasets directly on stats100x, will be unavailable tomorrow for an upgrade to jessie. While I don't expect to need nearly 3 hours for the upgrade, better safe than sorry. In the meantime all files will be accessible via ms1001.wikimedia.org via the web, and all dumps and page view files from our mirrors as well. Thanks for your understanding. Ariel Glenn

1 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Xmldatadumps-l March 2016