Toolserver-l September 2006

toolserver-l@lists.wikimedia.org

25 participants
23 discussions

/mnt/archiv
by Edward Chernenko 26 Sep '06

26 Sep '06

Hm... > edwardspec@hemlock:~$ ls /mnt/archiv > ls: /mnt/archiv: Permission denied > edwardspec@hemlock:~$ ls -l /mnt/archiv -l > lrwxrwxrwx 1 root root 12 Sep 19 12:30 /mnt/archiv -> aux0/archiv/ > edwardspec@hemlock:~$ ls -ld /mnt/aux0 > drwxr-x--- 2 root sys 4096 Sep 19 12:21 /mnt/aux0/ Please do chmod o+x /mnt/aux0 -- Edward Chernenko <edwardspec(a)gmail.com>

1 0

Maintance of hemlock at 18:00 CEST
by DaB. 25 Sep '06

25 Sep '06

Hello all, between 18:00 and 20:00 (CEST) I will do a little maintance on hemlock (creating a partion for logging and so). I guess, that it do not take the full 2h and will write an eMail when I'm finish. Sincerly, DaB. -- PGP: 2D3EE2D42B255885

2 2

Logo
by DaB. 24 Sep '06

24 Sep '06

Hello again, if we have one or more artists at this list, the toolserver could need an logo for the favicon and the bugzilla. Sincerly, DaB. -- PGP: 2D3EE2D42B255885

10 15

geo-broken
by Stefan Kühn 24 Sep '06

24 Sep '06

Hi, someone rename my folder again. Is there a problem? I hope not. I fix my script and it run without error-message. Thanks for information, Stefan

1 1

/ out of disk space
by Leon Weber 24 Sep '06

24 Sep '06

Hi. fyi if you get some odd errors: -:[~]$> df -h Filesystem Size Used Avail Use% Mounted on /dev/sdb1 4.0G 3.8G 0 100% / Not sure whether the broken bugzilla has to do something with it. -- Leon.

7 16

MySQL restarted
by Leon Weber 23 Sep '06

23 Sep '06

Hi, MySQL has been restarted at 7.30 - 8.00 UTC by JeLuF due to a crash. -- Leon.

1 0

Permanent tasks
by Edward Chernenko 22 Sep '06

22 Sep '06

Note to admins: 'rcbot.pl' script it's _not_ out of control - this is antivandal bot which listens to recent changes IRC channel. It should never exit (but it does nothing between two edits, of course). Please do not kill this process. -- Edward Chernenko <edwardspec(a)gmail.com>

1 0

Re: [Toolserver-l] Five questions
by valhallasw 21 Sep '06

21 Sep '06

On Thu, 21 Sep 2006 09:54:31 +0200, <toolserver-l-request(a)Wikipedia.org> wrote: > Message: 13 > Date: Thu, 21 Sep 2006 09:54:29 +0200 > From: Stefan K?hn <kuehn-s(a)gmx.net> > Subject: [Toolserver-l] Five questions > To: Mailingliste Toolserver <toolserver-l(a)Wikipedia.org> > Message-ID: <45124535.8050706(a)gmx.net> > Content-Type: text/plain; charset=ISO-8859-15; format=flowed > Can I use Perl to get some data from the database? (I work since three > weeks with Perl and CGI, so I need a small example.) Yes. I have no experience with it (I use python, which -imo- is easier than perl), but google showed http://www.codeproject.com/perl/perldbi.asp which could be useful. Perl/SQL is - for example- used at slashdot.org > Question 2: > Can I use a SQL-Question with perl? For example: I want the category's > of page "xy" in DE. See the previous link. Make a SQL query for it; something like "select * from dewiki_p.templatelinks where tl_namespace=<template namespace> and tl_title=<template title>". > Question 3. > When I scan all articles from the Dump (XML-File) for coordinates I need > with Perl in EN 45 minutes and in DE 15 minutes. If I use in the future > hopefully the MySQL-database I think this process will be to long for > the database. So that all other services have a problem. Is this right? > Or is the power of the database strong enough for this full-text search? There is no need for a full-text search. If you get all articles that have the template on it, you will only need the text from those pages. Getting the text then regexping it on hemlock (with a low priority) probably is the best way to do it. You will need the text tables for it though, and they are not yet available. > Question 4. > After the full-text search I will put the results in the database. > Therefore I need also a Perl-example. Please help me. See the same link. > Question 5. > If I can not do the full-text search at the MySQL-database I think it > would be very helpful to make one directory for all users with all dumps > (XML-files). So that every user can use this dumps. At the moment I have > the current dump (DE+EN) in my home-directory, but I am sure that other > users also have dumps. What did you think about this? Wait until the text tables are there ;) - a FULLTEXT index of the text table would be useful, but probably very space-consuming. However, if zedler is overloaded by all the database requests, it could be an idea to do xml-fulltext-searches on hemlock (on low priority). Just my $0.02 -valhallasw

1 0

More disc-space
by DaB. 21 Sep '06

21 Sep '06

Hello all, river has move some disc-space from zedler to hemlock. It can be find at /mnt/archiv/ and is writeable by all users. I had created a directory "dumps" in it for wikimedia-dumps. Because "home" is a little bit small, you should move all big files (like dumps) to /mnt/archiv/. Please note, that the files there have no backup. Sincerly, DaB. -- PGP: 2D3EE2D42B255885

3 2

Five questions
by Stefan Kühn 21 Sep '06

21 Sep '06

Hi, I work since two weeks on the tool server. In my directory home I have extract the English and German dump. So that I can scan the dumps for geocoordinates. At the moment I have a Perl script for this work. The results is the KML for Google Earth and a CSV for many other services. Now I see the most of you use the MySQL-database with all the nice tables. I have no experience with MySQL, but I know SQL. Question 1: Can I use Perl to get some data from the database? (I work since three weeks with Perl and CGI, so I need a small example.) Question 2: Can I use a SQL-Question with perl? For example: I want the category's of page "xy" in DE. Question 3. When I scan all articles from the Dump (XML-File) for coordinates I need with Perl in EN 45 minutes and in DE 15 minutes. If I use in the future hopefully the MySQL-database I think this process will be to long for the database. So that all other services have a problem. Is this right? Or is the power of the database strong enough for this full-text search? Question 4. After the full-text search I will put the results in the database. Therefore I need also a Perl-example. Please help me. Question 5. If I can not do the full-text search at the MySQL-database I think it would be very helpful to make one directory for all users with all dumps (XML-files). So that every user can use this dumps. At the moment I have the current dump (DE+EN) in my home-directory, but I am sure that other users also have dumps. What did you think about this? Thanks, Stefan (sk) -- Stefan Kühn Email: kuehn-s(a)gmx.net / Web: http://www.webkuehn.de

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l September 2006