Xmldatadumps-l

xmldatadumps-l@lists.wikimedia.org

720 discussions

XML Dumps FAQ monthly update
by noreply.xmldatadumps＠wikimedia.org 01 Jan '21

01 Jan '21

Greetings XML Dump users and contributors! This is your automatic monthly Dumps FAQ update email. This update contains figures for the 20201201 full revision history content run. We are currently dumping 927 projects in total. --------------------- Stats for uzwiktionary on date 20201201 Total size of page content dump files for articles, current content only: 174,645,628 Total size of page content dump files for all pages, current content only: 175,745,325 Total size of page content dump files for all pages, all revisions: 647,355,623 --------------------- Stats for enwiki on date 20201201 Total size of page content dump files for articles, current content only: 80,721,790,647 Total size of page content dump files for all pages, current content only: 178,890,632,277 Total size of page content dump files for all pages, all revisions: 21,850,825,222,804 --------------------- Sincerely, Your friendly Wikimedia Dump Info Collector

1 0

XML Dumps FAQ monthly update
by noreply.xmldatadumps＠wikimedia.org 02 Dec '20

02 Dec '20

Greetings XML Dump users and contributors! This is your automatic monthly Dumps FAQ update email. This update contains figures for the 20201101 full revision history content run. We are currently dumping 922 projects in total. --------------------- Stats for myvwiki on date 20201101 Total size of page content dump files for articles, current content only: 68,109,300 Total size of page content dump files for all pages, current content only: 71,478,998 Total size of page content dump files for all pages, all revisions: 915,203,844 --------------------- Stats for enwiki on date 20201101 Total size of page content dump files for articles, current content only: 80,262,262,584 Total size of page content dump files for all pages, current content only: 177,854,883,193 Total size of page content dump files for all pages, all revisions: 21,681,946,674,994 --------------------- Sincerely, Your friendly Wikimedia Dump Info Collector

1 0

Failed recombination of dump
by Nicolas Vervelle 02 Dec '20

02 Dec '20

Hi, The new dump seems to have problems recombining files... Exemple for frwiki : https://dumps.wikimedia.org/frwiki/20201201/ 2020-12-01 22:15:48 failed Recombine articles, templates, media/file descriptions, and primary meta-pages. - frwiki-20201201-pages-articles.xml.bz2 Nico <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Garanti sans virus. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

1 1

Availability of Wikidata JSON dumps after Feb, 2019
by Daniel Garijo 26 Nov '20

26 Nov '20

Hello, I am writing this message because I am analyzing the Wikidata JSON dumps available in the Internet Archive and I have found there are no dumps available after Feb 8th, 2019 (see https://archive.org/details/wikimediadownloads?and%5B%5D=%22Wikidata%20enti…). I know the latest dumps are available at https://dumps.wikimedia.org/wikidatawiki/entities/, but unfortunately they only cover the last few months. I also noticed some gaps in the years where there are JSON dumps available. For example, there are no JSON dumps available between end of Feb, 2017 and Aug 21st, 2017; or between August 21st, 2017 and Nov 16, 2017. Another strange finding is that while there are some entries for the dumps in the Internet Archive between March 19th, 2018 and Nov 26th, 2018 (e.g., https://archive.org/details/wikibase-wikidatawiki-20181104), none of them contain a JSON dump. That's another gap of more than 8 months. Does anyone on this list know where some of these missing Wikidata dumps may be found? If anyone has pointers to a server where they can be downloaded, I would highly appreciate it. Thanks in advance, Daniel

4 5

November 2nd dump run delayed half a day, wikidata full page content not ready yet
by Ariel Glenn WMF 22 Nov '20

22 Nov '20

Hello folks, I hope everyone is in good health and staying safe in these troubled times. Speaking of trouble, in the course of making an improvement to the xml/sql dumps, I introduced a bug, and so now I am doing the cleanup from that. The short version: There will be a 7z file missing from the wikidata full page content dumps, to be made available in a day or two. The corresponding bz2 file should become available later today, but it's possible that I will instead provide a slightly longer file which has a bad bz2 block on the end, and pages at the end larger than are specified in the filename. This would mean MANUAL PROCESSING IF YOU USE these full page content dumps. If this happens, I'll send an email update. The long version: See https://phabricator.wikimedia.org/T268333 IN ALL CASES the xml/dumps run for the 20th of the month (ie. today) should start late tonight UTC time, if not earlier. My apologies for the inconvenience! Ariel

1 1

Baja del servicio
by juan galvez carmona 01 Nov '20

01 Nov '20

Por favor,no me envien más notificaciones,pues quiero darme de baja del servicio de wikimedia.Gracias. Obtener Outlook para Android<https://aka.ms/ghei36>

1 0

XML Dumps FAQ monthly update
by noreply.xmldatadumps＠wikimedia.org 01 Nov '20

01 Nov '20

Greetings XML Dump users and contributors! This is your automatic monthly Dumps FAQ update email. This update contains figures for the 20201001 full revision history content run. We are currently dumping 922 projects in total. --------------------- Stats for grwikimedia on date 20201001 Total size of page content dump files for articles, current content only: 5,990 Total size of page content dump files for all pages, current content only: 5,990 Total size of page content dump files for all pages, all revisions: 8,786 --------------------- Stats for enwiki on date 20201001 Total size of page content dump files for articles, current content only: 79,784,363,895 Total size of page content dump files for all pages, current content only: 176,888,031,105 Total size of page content dump files for all pages, all revisions: 21,518,142,611,381 --------------------- Sincerely, Your friendly Wikimedia Dump Info Collector

1 0

XML Dumps FAQ monthly update
by noreply.xmldatadumps＠wikimedia.org 02 Oct '20

02 Oct '20

Greetings XML Dump users and contributors! This is your automatic monthly Dumps FAQ update email. This update contains figures for the 20200901 full revision history content run. We are currently dumping 921 projects in total. --------------------- Stats for scnwiktionary on date 20200901 Total size of page content dump files for articles, current content only: 27,195,710 Total size of page content dump files for all pages, current content only: 32,005,929 Total size of page content dump files for all pages, all revisions: 218,033,768 --------------------- Stats for enwiki on date 20200901 Total size of page content dump files for articles, current content only: 79,369,184,670 Total size of page content dump files for all pages, current content only: 175,996,145,412 Total size of page content dump files for all pages, all revisions: 21,367,001,220,118 --------------------- Sincerely, Your friendly Wikimedia Dump Info Collector

1 0

XML Dumps FAQ monthly update
by noreply.xmldatadumps＠wikimedia.org 01 Sep '20

01 Sep '20

Greetings XML Dump users and contributors! This is your automatic monthly Dumps FAQ update email. This update contains figures for the 20200801 full revision history content run. We are currently dumping 919 projects in total. --------------------- Stats for chwiktionary on date 20200801 Total size of page content dump files for articles, current content only: 14,628 Total size of page content dump files for all pages, current content only: 76,148 Total size of page content dump files for all pages, all revisions: 146,333 --------------------- Stats for enwiki on date 20200801 Total size of page content dump files for articles, current content only: 78,829,971,857 Total size of page content dump files for all pages, current content only: 174,871,893,500 Total size of page content dump files for all pages, all revisions: 21,204,857,256,509 --------------------- Sincerely, Your friendly Wikimedia Dump Info Collector

1 0

(no subject)
by Yuki Kumagai 21 Aug '20

21 Aug '20

Hiya I have a question about wikipedia xml database dump. Apologies if this wasn't an appropriate place for asking a question. On a wikipedia page, it's mentioned that the current number of articles in english is: 6,144,248 https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia However when I count the number of page elements in recent dump (excluding redirects) it's about ~10 million I was just wondering what would be the reason for this? Thank you in advance -- *Yuki Kumagai* Senior Engineer CognitionX <https://cognitionx.com/> Driving the acceleration and responsible deployment of AI Stay up-to-date with our daily All Things AI <https://confirmsubscription.com/h/d/13A269E463396CB2> newsletter

2 2

← Newer
1
...
9
10
11
12
13
14
15
...
72
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Xmldatadumps-l