Wikitech-l February 2010

wikitech-l@lists.wikimedia.org

92 participants
75 discussions

Database dumps
by Byrial Jensen 17 Apr '25

17 Apr '25

Until some weeks ago http://dumps.wikimedia.org/backup-index.html used to show 4 dumps in progress at the same time. That meant that new database dumps normally was available within about 3 weeks for all databases except for enwiki and maybe dewiki where the dump process due to size took longer time. However the 4 dumps processes at one time become 3 some weeks ago. And after massive failures at June 4, only one dump has been in progress at the same time. So at the current speed it will take several months to come thru all dumps. Is it possible to speed up the process again using several dump processes at the same time? Thank you, Byrial

3 2

User-Agent:
by Domas Mituzas 17 Apr '25

17 Apr '25

Hi! from now on specific per-bot/per-software/per-client User-Agent header is mandatory for contacting Wikimedia sites. Domas

19 61

EBNF grammar project status?
by Steve Bennett 01 Apr '25

01 Apr '25

What's the status of the project to create a grammar for Wikitext in EBNF? There are two pages: http://meta.wikimedia.org/wiki/Wikitext_Metasyntax http://www.mediawiki.org/wiki/Markup_spec Nothing seems to have happened since January this year. Also the comments on the latter page seem to indicate a lack of clear goal: is this just a fun project, is it to improve the existing parser, or is it to facilititate a new parser? It's obviously a lot of work, so it needs to be of clear benefit. Brion requested the grammar IIRC (and there's a comment to that effect at http://bugzilla.wikimedia.org/show_bug.cgi?id=7 ), so I'm wondering what became of it. Is there still a goal of replacing the parser? Or is there some alternative plan? Steve

26 217

MediaWiki to Latex Converter
by Hugo Vincent 18 Jun '12

18 Jun '12

Hi everyone, I recently set up a MediaWiki (http://server.bluewatersys.com/w90n740/) and I need to extra the content from it and convert it into LaTeX syntax for printed documentation. I have googled for a suitable OSS solution but nothing was apparent. I would prefer a script written in Python, but any recommendations would be very welcome. Do you know of anything suitable? Kind Regards, Hugo Vincent, Bluewater Systems.

6 13

Backups
by Eugene 07 Nov '10

07 Nov '10

Hi everyone, Are there any updates regarding Wikipedia's backup systems? I've created a bug to track this at https://bugzilla.wikimedia.org/show_bug.cgi?id=18255. Cheers, Eugene

4 5

implementing the Interlanguage extension
by Amir E. Aharoni 06 Aug '10

06 Aug '10

Sorry about bugging the list about it, but can anyone please explain the reason for not enabling the Interlanguage extension? See bug 15607 - https://bugzilla.wikimedia.org/show_bug.cgi?id=15607 I believe that enabling it will be very beneficial for many projects and many people expressed their support of it. I am not saying that there are no reasons to not enable it; maybe there is a good reason, but i don't understand it. I also understand that there are many other unsolved bugs, but this one seems to have a ready and rather simple solution. I am only sending it to raise the problem. If you know the answer, you may comment at the bug page. Thanks in advance. -- Amir Elisha Aharoni heb: http://haharoni.wordpress.com | eng: http://aharoni.wordpress.com cat: http://aprenent.wordpress.com | rus: http://amire80.livejournal.com "We're living in pieces, I want to live in peace." - T. Moore

6 8

Unicode equivalence
by Praveen Prakash 29 May '10

29 May '10

Hi, I am from Malayalam Wikipedia (ml.wikipedia - user:Praveenp), and my language is Malayalam. Consider our one big problem. After the release of Unicode 5.1.0, there are two kind of encoding for some characters of Malayalam alphabet (because of reverse compatibility). This cause serious problems in linking, searching etc in mediawiki software. Currently Windows 7 is the only operating system which supports Unicode 5.1.0. (? according to my knowledge), but lot of third-party tools for writing and reading Malayalam supports new version. And now large quantity of data in Wikimedia projects are in new version. It is not possible to link, or search titles encoded in pre-Unicode 5.1.0 from Unicode 5.1.0 or vice versa. Currently one of our namespace ???????? (Category) also has one such character, so it is possible to write ???????? as ?????? which renders same as first but different in encoding. It causes problem in categorization also. Is it possible to put some unicode equivalence <http://en.wikipedia.org/wiki/Unicode_equivalence> in mediawiki software? We need urgent help. Pls check http://unicode.org/versions/Unicode5.1.0/#Malayalam_Chillu_Characters also *Visual * *Representation in 5.0 and Prior* *Preferred 5.1 Representation* 1 CHILLU_NN.png 0D23, 0D4D, 200D 0D7A CHILLU_N.png 0D28, 0D4D, 200D 0D7B 3 CHILLU_RR.png 0D30, 0D4D, 200D 0D7C 4 CHILLU_L.png 0D32, 0D4D, 200D 0D7D 5 CHILLU_LL.png 0D33, 0D4D, 200D 0D7E * *Thanks Wikipedia Affiliate Button <http://wikimediafoundation.org/wiki/Support_Wikipedia/en>

13 25

enwiki complete page edit history
by Jamie Morken 03 Mar '10

03 Mar '10

This is a repost, Tomasz please get back to me about this. cheers, Jamie > Date: Fri, 19 Feb 2010 18:25:50 +0100 > From: Tomasz Finc <tfinc(a)wikimedia.org> > Subject: Re: [Wikitech-l] enwiki complete page edit history > Do you mean that the failed runs aren't web linked? If so then > I'd > rather not point people to corrupted files. Hi Tomasz, I don't think there are any (failed or successful) weblinked "pages-meta-history.xml.bz2" or "pages-meta-history.xml.7z" files for the enwiki on the wikimedia download server. I think there must be a successful enwiki "pages-meta-history" from 2009 floating around somewhere, I think that the last successful dump (guessing Sept 2009?) should always be linked for download. If you have a copy of the latest successful build of "pages-meta-history" (.bz2 or .7z) for enwiki I'd appreciate it if you posted a link, thanks cheers, Jamie

2 1

hiphop! :)
by Domas Mituzas 03 Mar '10

03 Mar '10

root@flack:/hiphop/web/phase3/includes# ab -n 100 -c 1 'http://dom.as:8085/phase3/api.php?action=query&prop=info&titles=Main%20Page' This is ApacheBench, Version 2.3 <$Revision: 655654 $> Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/ Licensed to The Apache Software Foundation, http://www.apache.org/ Benchmarking dom.as (be patient).....done Server Software: Server Hostname: dom.as Server Port: 8085 Document Path: /phase3/api.php?action=query&prop=info&titles=Main%20Page Document Length: 991 bytes Concurrency Level: 1 Time taken for tests: 0.389 seconds Complete requests: 100 Failed requests: 0 Write errors: 0 Total transferred: 116600 bytes HTML transferred: 99100 bytes Requests per second: 256.87 [#/sec] (mean) Time per request: 3.893 [ms] (mean) Time per request: 3.893 [ms] (mean, across all concurrent requests) Transfer rate: 292.49 [Kbytes/sec] received Connection Times (ms) min mean[+/-sd] median max Connect: 0 0 0.0 0 0 Processing: 3 4 0.2 4 4 Waiting: 2 4 0.4 4 4 Total: 3 4 0.2 4 4 Percentage of the requests served within a certain time (ms) 50% 4 66% 4 75% 4 80% 4 90% 4 95% 4 98% 4 99% 4 100% 4 (longest request)

12 24

Wikigalore
by Gerard Meijssen 28 Feb '10

28 Feb '10

Hoi, As far as leeches go, this takes the price as far as I am concerned. It sells scripts to leech any Wikimedia project and all this to have the rating of a website go up. Is this the kind of outfit that we act upon .. That is for you to decide.. Thanks, GerardM http://wikigalore.com/

6 5

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l February 2010