Toolserver-l September 2009

toolserver-l@lists.wikimedia.org

35 participants
28 discussions

New hardware ordered
by Daniel Kinzler 28 Jun '11

28 Jun '11

Hi all I'm happy to let you know that new hardware has been ordered by Wikimedia Deutschland and will arrive probably in about two weeks. We will get two new systems: * A more powerful web server, to replace hemlock: Sun Fire X4150, 2x Quad-Core Xeon, 8GB RAM, 2x73GB SAS HDD. The current web server only has two cores. * Another database server, to be used for S1 (english wikipedia), so S1 and S3 no longer have to share a server: Sun Fire X4250, 2x Quad-Core Xeon, 32GB RAM, 16x146GB SAS RAID. This should improve performance and give us some head space for growth. Once the new servers arrive, S3 will be re-imported too, so we will have live data again. Any ideas for names? To stay with the nightshade theme, how about Jurubeba and Erubia? Or perhaps we go the "witches' weed" way, with Datura and Mandrake? Henbane is taken, i think. Amanita sounds nice, too :) A third server has been ordered, which will also be installed in Amsterdam, but will not be part of the toolserver cluster. It's a storage server (X4540, 24TB RAID) that will keep a live backup of all media files. Cheers, Daniel

11 17

Re: [Toolserver-l] Betawiki translations
by Luxo 20 Mar '10

20 Mar '10

>> hi all >> >> many of our tools uses messages from betawiki because they are >> translated in many languages. >> But this messages must be synchronized and I think it's not very >> economically if every user/tool do that self. Because of that I >> propose >> to create one database for all users which will be sync periodically. > >A database with one table per user? Sounds good. > >> What do you think? Are any other users interested for such a db? > >I would be interested. > >> Greetings, >> Luxo > >Pietrodn >powerpdn(a)gmail.com I thought not one table per user, but rather one table for all messages. On betawiki are a lot messages e.g. http://translatewiki.net/wiki/MediaWiki:Abusefilter-revert-title/en. So I would make a table something like + ----------+------------------------+-----------------------------------------------------+ | LANG | MESSAGE | TEXT | + ----------+------------------------+-----------------------------------------------------+ | en | Abusefilter-revert-title | Revert all changes by filter $1 | + ----------+------------------------+-----------------------------------------------------+ | de | Abusefilter-revert-title | Alle Änderungen durch Filter $1 rückgängig machen | + ----------+------------------------+-----------------------------------------------------+ | fr | Abusefilter-revert-title | Révoquer toutes les modifications par le filtre $1 | + ----------+------------------------+-----------------------------------------------------+ the messages which will be synced should be one a list which every ts-user can edit, so that it's easy for every user to add the messages he requires. --Luxo

7 23

a new way to run tools: batch job scheduling
by River Tarnell 10 Oct '09

10 Oct '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 hi, we are testing a new way to run tools on the Toolserver, that will allow tools to easily take advantage of spare resources, including new servers we add in the future, without any change from users. for more information, and documentation on how to use it, please see <https://wiki.toolserver.org/view/Batch_job_scheduling> - river. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (HP-UX) iEYEARECAAYFAkqvwHsACgkQIXd7fCuc5vJX9QCgsiTQqlBwKjMmaTYD3AdkwGNJ UfsAn3Yr2DCqQfWjoM8X2P506BslPF/y =xGgO -----END PGP SIGNATURE-----

5 9

MySQL indices
by Happy-melon 29 Sep '09

29 Sep '09

Is it just me, or have they all gone? mysql> select log_id from logging where log_namespace=0 and log_title='Water_naya'; +----------+ | log_id | +----------+ | 24912432 | | 24914507 | +----------+ 2 rows in set (4 min 38.34 sec) That's surely not right? mysql> show indexes from logging; Empty set (0.00 sec) ?? --HM

2 2

Re: [Toolserver-l] How to get in contact with the toolserver admins?
by John Doe 21 Sep '09

21 Sep '09

https://jira.toolserver.org/browse/TS?report=com.atlassian.jira.plugin.syst… the place to file a bug issue for this 2009/9/21 Delphine Ménard <notafishz(a)gmail.com> > Hello, > > On Mon, Sep 21, 2009 at 18:18, John Doe <phoenixoverride(a)gmail.com> wrote: > > yeah, thats the correct address, what did you need? > > I've lost/messed up my password, and need to either get a new one, or > retrieve my info. > > user: notafish. > > Thanks! > > Delphine > -- > ~notafish > > NB. This gmail address is used for mailing lists. Personal emails will > get lost. > Intercultural musings: Ceci n'est pas une endive - > http://blog.notanendive.org >

4 4

How to get in contact with the toolserver admins?
by Delphine Ménard 21 Sep '09

21 Sep '09

Hi, I've tried a few times to get through to the TS admins, but either I have the wrong address, or they're all on holidays :) is ts-admins(a)toolserver.org the right address? Thank you, Delphine -- ~notafish NB. This gmail address is used for mailing lists. Personal emails will get lost. Intercultural musings: Ceci n'est pas une endive - http://blog.notanendive.org

2 1

Re: [Toolserver-l] Archive of visitor stats
by Mathias Schindler 20 Sep '09

20 Sep '09

2009/9/18 Erik Zachte <erikzachte(a)infodisiac.com>: > I think it is extremely important to keep these files for later analysis by > historians and others. > > Mathias Schindler also keep an archive or at least did till April (Berlin > conference). > He even bought a dedicated external drive for it. Right now, I have a single copy of all the files from December 2007 to April 2009 on a single hard drive. I haven't done any integrity checks beyond some initial tests. The dataset has some missing spots when the service to produce the files was not working. In some cases, it is just an empty .gz file, in some cases there was no file produced at all. In my spare time, I will try to load the files from May to now to this hard drive until it is full. The situation is rather uncomfortable for me since I am in no way able to guarantee the integrity and safety of these files for a longer time frame. While I might continue downloading and "storing" the files, I would be extremely happy to hear that the full and unabridged set of files is available a) to anyone b) for an indefinite time span c) free of charge d) with some backup and data integrity check in place. Speaking of wish lists, a web-accessible service to work with the data would be nice. We know for sure that journalists and hopefully some more demographics like the data, numbers and resulting shiny graphs. Mathias

2 1

Archive of visitor stats
by Lars Aronsson 19 Sep '09

19 Sep '09

Are visitor stats (as produced by Domas) safely archived somewhere, for example on the toolserver, where development projects can easily access them for analysis? I have made my own copies of the files (I guess my plan was to use them, but this hasn't started yet), but now I'm running out of disk and I urgently need to clear some space on that server. I just deleted September 2009 (last 2 weeks) and that freed 9 GB. The oldest I have is pagecounts-20071209-180000.gz -- Lars Aronsson (lars(a)aronsson.se) Aronsson Datateknik - http://aronsson.se

4 4

osm-db
by Nakor 18 Sep '09

18 Sep '09

Hello, I was looking on how to connect to the osm-db and if there is phpMyAdmin access to it? I browsed thru the toolserver and OSM wikis but did not find much. Thanks in advance, N.

4 4

Wikipedia database replication on Google's cluster
by RYU Cheol 17 Sep '09

17 Sep '09

Dear all, I just hit an idea that we could use computing power of google's appengine. AppEngine provides limited free accounts. It provides python runtime environment as well as URL fetch and Bigtable API. I suppose Bots could run on AppEngine with minor ports. And if Google kindly provide database cloning, toolserver could reduce a bunch of overhead. What do you think about this proposal to Google? --Cheol

2 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l September 2009