Toolserver-l

toolserver-l@lists.wikimedia.org

1612 discussions

Start a nNew thread

Emacs requested
by Kelly Martin 19 Sep '06

19 Sep '06

Any chance we could have some version of emacs? Not everyone likes vi, you know. Kelly

3 2

Perl modules needed
by Edward Chernenko 19 Sep '06

19 Sep '06

Hm... there is no Net::IRC perl module on hemlock, please install it. Also, there're many other modules which my scripts need. Currently I've built them in ~edwardspec/build, but it's much more better to install all of these modules globally, using 'cpan' utility. Here is the full list for now: Algorithm::Diff Cache::Cache Config::IniHash CMS::MediaWiki Error Hash::Case Hash::WithDefaults IO::String LWP::UserAgent::WithCache MediaWiki Please setup cron to update last module ('MediaWiki', that's module written by me and not stable enough yet) every day. Thank you. -- Edward Chernenko <edwardspec(a)gmail.com>

2 1

downtime
by River Tarnell 19 Sep '06

19 Sep '06

there will be some downtime of mysql and login-services in the early morning of the 19th (UTC) to reconfigure the disk layout slightly. - river.

1 1

Re: [Toolserver-l] Hemlock - Data base password outside program code.
by Purodha B Blissenbach 18 Sep '06

18 Sep '06

DaB. writes: > ..., you should never insert a password (for mysql or something) in your reposory. At http://hemlock.knams.wikimedia.org/~purodha/sample/dbaccess.php?uselang=en there is a demo php application accessing the data base server without a need to know a passport. Click the "progam source" link, and inspect function dbaccess() It reads your .my.cnf file. Error handling is limited. Greetings. Purodha

1 0

Hemlock
by DaB. 17 Sep '06

17 Sep '06

Hello all, the moving to hemlock is ready. The only problem was softlinks, which I could not copy. Please create it again (was only a small number). The OS is now a Debian Testing and I think that the most of us are more familare with linux then with solaris (which is of corse the better OS ;)). Hemlock is used for run all user-tools. Zedler host "only" the database. So if you run mysql-querys, you run it on zedler from hemlock. For this reason, there is a direct-network-cable between zedler and hemlock. So the new sql-host-name for your tools is "zedler.ts-local". Because the disc of hemlock is a little bit small, there are only 63GB for all users together. Thats calced ~800MB per person at the moment. I think, that should be enought for the most user. After moving all accounts, 68% of the disc is still free. We plan to move some disc-space from zedler to hemlock later. It should be for "archivedata" like dumps. I plan to use the partion on zedler, which is used for the userdatas at the moment The backups will be on zedler too. Hemlock has 8GB-RAM and 2 64-bit Athlons. There are some other changes: The php.cgi-file is not longer needed, the apache use suphp. I have created a .forward-file (r/w by user, r by mail), for these user, which haven't have one. So you can know use "mail *username*" for writing a eMail to another user There are new-stuff too of corse. Hemlock has an subversion-daemon (it's a modern cvs-system) for version-controll. I have created a reposory for each user. It can be find in subversion in your home. To access it, you use svn+ssh://hemlock.knams.wikimedia.org/home/*username*/subversion/ (Please google yourself for a howto in your language, if needed). You have read and write-acess to every reposory on hemlock, but I'm hope, that you ask the reposory-owner first, before you write something in his reposory (and crashed it ;) (reading is nevertheless ok). There is a possibility for anonym-reading for everyone (inclusiv non-toolserver-people) too. The adress is just svn://hemlock.knams.wikimedia.org/*username*/subversion/ (without "ssh"). For this reason, you should never insert a password (for mysql or something) in your reposory. The subversion-system is also browsable on http://hemlock.knams.wikimedia.org/websvn/. A secound newstuff is the bugzilla, which runs on hemlock. The adress is http://hemlock.knams.wikimedia.org/cgi-bin/bugzilla/index.cgi. I plan to create a "product" for every user on the toolserver. The specific tools gets "components". These components can created by the owner of the product. Because every user is the owner of his/her product, you can create the components for all your tools yourself. For creation of your product, send your username and the name of one of your projects to bugzilla(a)hemlock.knams.wikimedia.org. There is also a "product" for the toolserver itself to message the roots about errors and bugs. The address tools.wikimedia.de will change tomorrow to hemlock, but it can take a while until all user use the new IP. I'm realy sure, that I had not installed all needed programms. So if you miss one, write me a private eMail or open a bug in the bugzilla (thats prefered). I personal hope, that you enjoy your new home and that I'm have not made too much mistakes :). Sincerly, DaB.

2 2

Moving of useraccount
by DaB. 14 Sep '06

14 Sep '06

Hello all, I'm quite finish with the installation on hemlock and I plan to move the account tomorrow (Friday). So don't change anything on your account on zedler after 14:00 CEST or it can be lost, because I copy the account-datas only 1 time and you have to move your stuff yourself ;) After the finish, I'm going to send a detailed eMail to this list, what changed. Sincerly, DaB.

1 0

status
by River Tarnell 12 Sep '06

12 Sep '06

following the maintenance yesterday: * hemlock is online, and DaB is preparing it to migrate user accounts to. * the new disk array is online and MySQL data has been migrated to it. hopefully both of these will improve performance, once complete. the additional disk space (1TB in the MySQL InnoDB pool) means we now have enough disk space for some form of text replication, from dumps, the external clusters, or something else. - river.

1 0

reboot, hemlock status
by River Tarnell 11 Sep '06

11 Sep '06

hello, zedler will be rebooted later (probably early morning UTC) for software upgrades. Mark will visit the colo tomorrow to investigate the problem with hemlock and to install the replacement SCSI HBA for zedler, which may result in another reboot. if the HBA works okay, the new array can hopefully be set up. - river.

1 1

Account request
by Florian Maunier 10 Sep '06

10 Sep '06

Hello, I made a request for a toolserver account. I want to advise you. The detail of my request is here : http://meta.wikimedia.org/wiki/Toolserver/New_accounts#w:fr:User:Fmaunier.2… <http://meta.wikimedia.org/wiki/Toolserver/New_accounts#w:fr:User:Fmaunier.2….>Thank you very much Fmaunier

1 0

About long query/queries
by Edward Chernenko 08 Sep '06

08 Sep '06

Hello all, there is a project in Russian Wikipedia to analyze all articles with scrict quality requirements (e.g. at least 500 symbols, or at least 1500 symbols for {{stub}}s, or at least 3 internal links and one external, or at least one section subheader etc.). The result should be: * Total number of "normal articles" * Lists of articles filtered by each requirement To do so, I should either make a long query to iterate through all articles or running small queries like 'SELECT page_title, page_latest FROM page WHERE page_title > ? ORDER BY page_title LIMIT 1' (with substitution of previous page_title fetched). The problem is that the first way is much more efficient but I'm not sure that someone will not kill this query. -- Edward Chernenko <edwardspec(a)gmail.com>

3 7

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l