Xmldatadumps-l

xmldatadumps-l@lists.wikimedia.org

720 discussions

Missing page in zh.wiktionary.org dump?: https://zh.wiktionary.org/wiki/Template:漢語寫法 or %E6%B1%89%E8%AF%AD%E5%86%99%E6%B3%95
by gnosygnu 20 Dec '13

20 Dec '13

Hi. I'm not sure if this is a dump issue, but I thought I'd start off here. I had a user report a missing page in zh.wiktionary.org: https://sourceforge.net/p/xowa/tickets/291/. It seems that a Main namespace page (學生) references a template (Template:漢語寫法) that is not in the dump. Here are more details: * The reference page is zh.wiktionary.org/wiki/學生<http://zh.wiktionary.org/wiki/%E5%AD%B8%E7%94%9F>(or %E5%AD%B8%E7%94%9F) * It uses a template from https://zh.wiktionary.org/wiki/Template:漢語寫法 or Template:%E6%BC%A2%E8%AA%9E%E5%AF%AB%E6%B3%95 * When I plug this url into my Firefox address bar, I get redirected to https://zh.wiktionary.org/wiki/Template:汉语写法 or Template:%E6%B1%89%E8%AF%AD%E5%86%99%E6%B3%95 * I can't read Chinese, but Google translate tells me that both terms mean "Chinese wording", so this looks like a redirect to me * However, unlike other redirects, I don't get a "Redirected from" link. - For example, https://zh.wiktionary.org/wiki/Template:En redirects me to Template:en but shows a link for "（重定向自Template:En)" - Template:汉语写法 doesn't show any corresponding "redirected from" link * More importantly, Template:漢語寫法 or Template:%E6%BC%A2%E8%AA%9E%E5%AF%AB%E6%B3%95 is not in the dump file * I've tried grepping the xml for both 漢語寫法</title> and %E6%BC%A2%E8%AA%9E%E5%AF%AB%E6%B3%95</title> but neither return * However, grepping for 汉语写法</title> (the redirected page) does return one match: $ grep zhwiktionary-latest-pages-articles.xml -f zhfind.txt <title>Template:汉语写法</title> Is this a configuration issue with the language / wiki? Or is the page itself defective? Any pointers / help would be appreciated. Thanks.

3 3

Re: [Xmldatadumps-l] [Mediawiki-api] The format of log events dumps is incorrect.
by Jiang BIAN 11 Dec '13

11 Dec '13

xmldatadumps-l is the maillist for this question On Wed, Dec 11, 2013 at 5:12 PM, Liu Chenheng <liuchenheng(a)gmail.com> wrote: > Hi, All, > > I found all the xml files for log event are incorrect, i.e. missing the > last </mediawiki> tag. > > For example: > http://dumps.wikimedia.org/szlwiki/20131210/szlwiki-20131210-pages-logging.… > > Thanks. > Chenheng Liu > > _______________________________________________ > Mediawiki-api mailing list > Mediawiki-api(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/mediawiki-api > > -- Jiang BIAN This email may be confidential or privileged. If you received this communication by mistake, please don't forward it to anyone else, please erase all copies and attachments, and please let me know that it went to the wrong person. Thanks.

1 1

ENwiktionary database dump issue
by Tina Lukša 10 Dec '13

10 Dec '13

Hello! I am using WikiTaxi for importing wiki databases and their offline usage. I've never had issues before but the latest two English wiktionary databases haven't been working correctly. As seen in the screenshot, the translations from various languages can't be seen - instead I can see only the code. I noticed that first in the datadump from November but thought it was an onetime issue as sometimes happens when I import a fresh database. But the same happened with the latest December dump. The latest datadump that didn't give me any issues was from september, I think. Does anyone have any ideas why this is happening now and how to make it work? Thank you in advance

3 5

Re: [Xmldatadumps-l] ftpmirror.your.org - IPv4 and IPv6 give different results
by Dr. Kent L. Miller 17 Nov '13

17 Nov '13

Dear Kevin, Thanks for your help. I can now see the index.html file (see 1 below). However, I can no longer see the other files in that directory (see 2 below). 1) index.html The following (shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ now both report HTTP/1.1 301 Moved Permanently Location: http://dumps.wikimedia.your.org/ But the following (shell)$ curl --ipv4 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/ follow the redirect and report HTTP/1.1 200 OK 2) Files Now, however, I can not get other files from that directory. For example, the following (shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt both report HTTP/1.1 301 Moved Permanently Location: http://dumps.wikimedia.your.org/r The rather odd value for "Location" makes it impossible to follow the redirect. Thus (shell)$ curl --ipv4 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt (shell)$ curl --ipv6 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt report HTTP/1.1 404 Not Found Sincerely Yours, Kent +------------------------------------------------------------------------+ pub 1024D/359E5142 2008-09-01 GPG key available on pgpkeys.mit.edu Key fingerprint = 8D4F 4485 7F7D 5406 230C 9749 B821 2572 359E 5142 uid Dr. Kent L. Miller <kent.l.miller(a)alumni.cmu.edu> +------------------------------------------------------------------------+ On Sat, 16 Nov 2013, Kevin Day wrote: > Nice catch! > > That should be fixed now, and sending a 301 redirect on both ipv4 and ipv6. > > Several of the pages on the “dumps” collection have hardcoded links that require them to be in the / (root) directory, so they require their own hostname. > > — Kevin > > On Nov 16, 2013, at 2:32 PM, Dr. Kent L. Miller <kent.l.miller(a)alumni.cmu.edu> wrote: > >> Dear Ariel, >> >> When I compare the following two commands >> >> (shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ >> (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ >> >> The first reports "HTTP/1.1 301 Moved Permanently" >> The second reports "HTTP/1.1 200 OK" >> >> Has anyone else noticed this? >> >> Sincerely Yours, >> Kent >> >> >> +------------------------------------------------------------------------+ >> pub 1024D/359E5142 2008-09-01 GPG key available on pgpkeys.mit.edu >> Key fingerprint = 8D4F 4485 7F7D 5406 230C 9749 B821 2572 359E 5142 >> uid Dr. Kent L. Miller <kent.l.miller(a)alumni.cmu.edu> >> +------------------------------------------------------------------------+ >> >> >> _______________________________________________ >> Xmldatadumps-l mailing list >> Xmldatadumps-l(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l > >

3 2

Empty incremental dumps
by Ivan 17 Nov '13

17 Nov '13

Hi, new problem occurs with incremental dumps mechanism: corrupted archives in folder: http://dumps.wikimedia.org/other/incr/wikidatawiki/20131115/ empty dumps in folder: http://dumps.wikimedia.org/other/incr/wikidatawiki/20131116/ The problem looks like there is no free space on disk drives. Sincerely, Ivan A. Krestinin

1 0

ftpmirror.your.org - IPv4 and IPv6 give different results
by Dr. Kent L. Miller 16 Nov '13

16 Nov '13

Dear Ariel, When I compare the following two commands (shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ The first reports "HTTP/1.1 301 Moved Permanently" The second reports "HTTP/1.1 200 OK" Has anyone else noticed this? Sincerely Yours, Kent +------------------------------------------------------------------------+ pub 1024D/359E5142 2008-09-01 GPG key available on pgpkeys.mit.edu Key fingerprint = 8D4F 4485 7F7D 5406 230C 9749 B821 2572 359E 5142 uid Dr. Kent L. Miller <kent.l.miller(a)alumni.cmu.edu> +------------------------------------------------------------------------+

2 1

Re: [Xmldatadumps-l] Get images of article.
by Federico Leva (Nemo) 08 Nov '13

08 Nov '13

Yannick Guigui, 08/11/2013 12:22: > I'm camerounian I built a webapp whose allows students to consult > wikipedia articles So you don't need the originals, only thumbs. > without internet connectivity,many school accepted > the application and the application is hosted on a server and shared by > wifi on each school. Nice! It seems you may want to use this existing software solution: http://kiwix.org/wiki/Kiwix-serve That way, you can use the available ZIM files with no need to generate or download (and compress) the thumbnails yourself. Example: http://www.wikimedia.fr/afripedia Your help developing the software would be very useful and you could avoid doing yourself what you don't have the resources (bandwidth) to do. > I have all the other dumps of wikipedia articles in > french and english;but I don't have any image because they are too heavy > for me to be downloaded to my side (3 TB) and I have a low bandwidth (40 > ko/s when it's fast). > > The webapp works on a browser and i don't know if the zim format can be > undecompressed to get small images (jpeg,png,svg...). Kiwix is a browser, you can save anything you want AFAIK. Nemo > > This is the video demo (3min in french) of the webapp > :https://www.youtube.com/watch?v=0f-HJhOw1-U > > If I get small images in french and english to download to the app,my > problem will revolved. > > Tank a lot Federico > > > > Le vendredi 8 novembre 2013, Federico Leva (Nemo) a écrit : > > Yannick Guigui, 08/11/2013 10:11: > > Please I want to get all images of wikipedia frensh and English, > I much > did it cost to book it on hardisk? In can't download it because > I don't > have enought bandwidth from my country. > > > What do you need them for? > Originals would be about 2+1 TB and anyone can download and ship > them for you: > http://ftpmirror.your.org/pub/__wikimedia/imagedumps/tarballs/__fulls/20121… > <http://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/20121201/> > Otherwise there are the ZIM files with thumbnails compressed, > fr.wiki is 14 GB but en.wiki is not available yet. > http://download.kiwix.org/zim/__0.9/ > <http://download.kiwix.org/zim/0.9/> > > Nemo >

1 0

Get images of article.
by Yannick Guigui 08 Nov '13

08 Nov '13

Please I want to get all images of wikipedia frensh and English, I much did it cost to book it on hardisk? In can't download it because I don't have enought bandwidth from my country. Tank's I really need it.

2 1

Question : how to import whole dumps
by Kisoong Jang 06 Nov '13

06 Nov '13

hello all, -Past mail was failed.. Sry im kisoong.jang from korea nowdays i'm interested of wikidata. I'm trying to make wikidata clone on my localhost at the moment I've installed mediawiki, wikibase client & wikibase repository successfully and i downloaded whole dumps file in http://dumps.wikimedia.org/wikidatawiki/latest/ there are many files in http://dumps.wikimedia.org/wikidatawiki/latest/

1 0

Question : Import dump files
by 장기숭 06 Nov '13

06 Nov '13

2 1

← Newer
1
...
39
40
41
42
43
44
45
...
72
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Xmldatadumps-l