Toolserver-l May 2012

toolserver-l@lists.wikimedia.org

21 participants
13 discussions

Block mail from dysgo.org?
by Christopher David Howie 18 Feb '13

18 Feb '13

We've been receiving messages from this domain at unblock(a)toolserver.org and they appear to be related to this: <http://www.reddit.com/r/WTF/comments/l44r1/i_just_got_this_email_at_work_i_…>. Viral advertising for some film. In reality, it's a message with a crapload of images attached serving no purpose for us. Can we just block this whole domain from sending mail to toolserver accounts? It's a nuisance, and the messages are quite large. -- Chris Howie http://www.chrishowie.com http://en.wikipedia.org/wiki/User:Crazycomputers If you correspond with me on a regular basis, please read this document: http://www.chrishowie.com/email-preferences/ PGP fingerprint: 2B7A B280 8B12 21CC 260A DF65 6FCE 505A CF83 38F5 ------------------------------------------------------------------------ IMPORTANT INFORMATION/DISCLAIMER This document should be read only by those persons to whom it is addressed. If you have received this message it was obviously addressed to you and therefore you can read it. Additionally, by sending an email to ANY of my addresses or to ANY mailing lists to which I am subscribed, whether intentionally or accidentally, you are agreeing that I am "the intended recipient," and that I may do whatever I wish with the contents of any message received from you, unless a pre-existing agreement prohibits me from so doing. This overrides any disclaimer or statement of confidentiality that may be included on your message.

3 3

Dumps
by John 22 Jul '12

22 Jul '12

I was taking a look at our dumps in user-store and none of them are compressed, and I was socked about that. I know a lot of people use pywikipedia to parse the dumps, and I know it can handle the bz2 files. any reason we dont just make them all bz2? John

4 3

Fairness on the toolserver
by DaB. 12 Jul '12

12 Jul '12

Hello all, the resources on the TS are free, but limited; so we all have to use the resources fair. Some limits (like memory-usage) are set and controlled by the system, but others are not and it is in the responsibility of every single user to make sure to not mis- or overuse resources. So it is for example NOT a good idea to run 200 processes in parallel to get more CPU-resources than you would normally get. And it is not a good idea to use a amount of memory which is just below the slayer-daemon-limit without any purpose. Sincerely, DaB. P.S: It is totally in the rules to disable a user-account because of resource- misusing. -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

7 12

Day of the open linux-server
by DaB. 08 Jun '12

08 Jun '12

Hello all, while the SGE-update will need some more time (see my last mail), I think it is a good idea to finish the installation of linux on yarrow and nightshade soon. Because the roots can not think of everything and your feedback which Debian-packages should be installed was smaller than expected, I hereby announce a Open-Linux-Server-day for Thursday, 10. May between 10:00 and 22:00 UTC. During this time, login for normal users will be possible and it will also be possible to run code/scripts/editors/whatever. After 22 o'clock user-login will be disabled again and the box will get a reboot. On this way I hope that we all will notice the last problems before the linux- boxes will go into the productive state soon after. Sincerely, DaB. -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

2 2

Monthly report 2012-05
by DaB. 30 May '12

30 May '12

Hello all, this is the second monthly report of the toolserver. ==SAN-System== After some more work by Mark at the beginning of the month the SAN-system (that's a disc-system in a network) is fully redundant now. Some more testing by the roots is still needed, but more or less the SAN-extending is done. ==More memory== The WMDE-chapter has bought some memory for some userland-servers and the HA- nodes. Most of these systems are short of memory, so that should help us (in case of the HA-nodes the memory-extending should make the nodes all HA again, because at the moment if one of the node is away, the other crashs soon after because of memory-shortness). The memory will be installed at the next visit of Mark in the datacenter – this will cause some downtime (the roots hope to learn about the visit soon enough so that we can message you all). ==Quota== The roots are working to get the quota-system back in action. At the moment many users do not have any quota (because of a bug in the account-creation- script) and our disc-space for /home is quite full already. If you have a free minute (no matter if you have a quota or not) please look in your home if there are files which you not longer need and delete them (that's also good for the backup-system); a good candidate are log- or tmp-files. Another mail will be send as soon as the roots started to fix the quota-system. ==Interwikibot-ban== Since 15th May the interwiki-bot-ban is finally in place. All long-running bots are now run by the MMP interwikibot, which is organized by Toto Azéro at the moment. I disabled some bots already that were still running. ==Hardware-buying back at the WMDE== After some disagreements between the WMDE and me about the funding and the future of the toolserver (and the buying of new servers), I moved the responsibility of hardware-buying back to the WMDE. So WMDE will decide if and what hardware we will get in future (so complain there when you think the TS is too slow). ==Still waiting for dumps== We are still waiting for dumps of s6 (soon we will reach the 2-month-mark) and s2. ==How to make MMPs more popular== There is a discussion [1] going on the mailinglist about making MMPs more popular; some think that a renaming would be a good idea while others think that making non-MMPs more unpopular would be a better way. *[1] http://lists.wikimedia.org/pipermail/toolserver-l/2012-May/004977.html ==SGE-upgrade/Linux will come back soon== Merlissimo compiled/installed successfully a upgrade of SGE in parallel to the old installation. We will do the switch soon (I will send a announcement-mail before that) and when the switch is done I will enable the login on the linux- boxes (yarrow and nightshade) again. ==User-statistic== The TS has 377 active users at the moment. The next monthly report will be send around 1. July. If you would like to help in the creation-process, please see [1]. *[1] https://wiki.toolserver.org/view/Monthly_report Sincerely, DaB. -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

1 0

Toolserver user phe account expired
by Lars Aronsson 26 May '12

26 May '12

http://toolserver.org/~phe/statistics.php now says "403: User account expired" This madness has to stop. Wikisource depends on this service. I understand the German toolserver is beyond repair, but phe's statistics scripts should be moved to proper WMF servers. Back in April, I copied one set of phe's graphs to Commons, where we can go for a nostalgic look at the once existing statistics graph system that phe built, and that worked fine until the German toolserver gang decided to ruin it, http://commons.wikimedia.org/wiki/Category:ProofreadPage_Statistics -- Lars Aronsson (lars(a)aronsson.se) Aronsson Datateknik - http://aronsson.se

13 25

Out of memory/segfaults?
by Hersfold Wikipedia 16 May '12

16 May '12

I've gotten four error messages from my bot today, several relating to out of memory errors or segfaults. This bot has run without error for months, and never messes directly with memory, using the built-in Java stuff for file handling. Is something wrong with willow? Messages in order: 14:00 UTC: Segmentation Fault - core dumped 16:00 UTC: ld.so.1: sh: fatal: mmap anon failed: Resource temporarily unavailable Followed by: ld.so.1: uname: fatal: /lib/libc.so.1: mmap failed: Resource temporarily unavailable error: JSV stderr: Out of memory! Unable to run job: JSV stderr: Out of memory! JSV stderr is - Out of memory!. Exiting 18:00 UTC apparently ran just fine, no errors reported... 20:00 UTC: /opt/local/bin/cronsub[56]: 8239 Segmentation Fault(coredump) ---- User:Hersfold hersfoldwiki(a)gmail.com Sent from my Windows Phone

4 3

No-interwiki-bot-rule is active now
by DaB. 16 May '12

16 May '12

Hello all, in 3h the 15th of May will be over and with it the time span you (the TS- users) have had to organize and create a MMP for future interwiki-bot-running. No process was done (even after a few users sent mails to the mailinglist) and so it is up to me now to handle the situation: I created the MMP "langlinksbot" now. Only this MMP is allowed to run (non-testing) interwiki- bots on the toolserver. If you run a interwiki-link-bot on the TS, please stop it now because it is against the rules to run it; there will be time until Sunday 24:00 UTC to do it yourself, after Sunday the roots will disable bots when they find them. To let the TS not be completely interwiki-bot-less, I added Toto Azéro as the only member of the MMP. I will not add other users at the moment; organize it first! To summarize again which bots are NOT affected: * Any bot that does not interwiki(/langlink)-links, or * bots that run only for short time, or * bots which are run by other MMPs Sincerely, DaB. -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

2 1

Re: [Toolserver-l] Fairness on the toolserver
by Hersfold Wikipedia 15 May '12

15 May '12

I feel as though this should be a rule - yes, certain tools and programs will need more resources than others, but at the same time the examples you're citing read to me as simply excessive. ---- User:Hersfold hersfoldwiki(a)gmail.com Sent from my Windows Phone From: DaB. Sent: 5/14/2012 17:31 To: toolserver-l(a)lists.wikimedia.org Cc: TS-ML-Announce Subject: [Toolserver-l] Fairness on the toolserver Hello all, the resources on the TS are free, but limited; so we all have to use the resources fair. Some limits (like memory-usage) are set and controlled by the system, but others are not and it is in the responsibility of every single user to make sure to not mis- or overuse resources. So it is for example NOT a good idea to run 200 processes in parallel to get more CPU-resources than you would normally get. And it is not a good idea to use a amount of memory which is just below the slayer-daemon-limit without any purpose. Sincerely, DaB. P.S: It is totally in the rules to disable a user-account because of resource- misusing. -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

1 0

Interwiki bot MMP planning
by Toto Azéro 08 May '12

08 May '12

Hi all ! I'd like to remind everyone of you that *we* have to organize the MMP interwikit-bot *before* 15th May ! It just remains a couple of weeks now, so it's beginning to become an emergency… If nothing's done at that date, DaB said he would "kill and disable every longrunning interwiki-bot that [he] find[s]." (see http://lists.wikimedia.org/pipermail/toolserver-l/2012-April/004913.html) MF-Warburg created https://wiki.toolserver.org/view/Interwiki_bot_MMP_planning nearly two months ago, but only Luckas Blade, Merlissimo and I had completed it… So we are 3 interested persons at the moment, but all from wikipedia-projects (respectively from ptwiki, dewiki and frwiki), whereas DaB wanted one from a non-wikipedia-project… So two questions actually : 1) does the actual group (composed of Luckas Blade, Merlissimo and me) suit to you ? 2) is there anybody else interested in joining it ? Regards, — Toto Azéro

5 8

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l May 2012