Toolserver-l

toolserver-l@lists.wikimedia.org

1612 discussions

Job stuck in error state
by Dr. Trigon 14 Feb '12

14 Feb '12

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all I got some strange info by mail tonight, first: > Unable to run job: error: no suitable queues. Exiting. > then later > Job 1601224 (subster_ar) Set in error state Exit Status = -1 > Signal = unknown signal User = drtrigon Queue > = short(a)ortelius.toolserver.org Host = > ortelius.toolserver.org Start Time = <unknown> End Time > = <unknown> CPU = NA Max vmem = NA failed > assumedly before job because: can't get password entry for user > "drtrigon". Either the user does not exist or NIS error! Use "qmod > -c <jobid>" to clear job error state once the problem is fixed. > (see the attachements) I think they were reactions to 2 of my cronjobs (the other 2 run as usual). Now the strange thing is I have a job in my SGE queue which I am not able to delete by 'qdel' anymore: > job-ID prior name user state submit/start at > queue slots ja-task-ID > ----------------------------------------------------------------------------------------------------------------- > > 1601224 0.00250 subster_ar drtrigon dt 02/12/2012 12:35:55 all.q(a)ortelius.toolserver.org 1 what to do now? Or what am I doing wrong? I just want to delete this job since it crashed obviousely (but because of strange reasons) and then start it again. The cron(ie)tab entries are: > 30 0 * * * cronsub -s subster_frr $HOME/pywikipedia/bot_control.py > -subster -cron -lang:frr 0 1 * * * cronsub -s subster_en > $HOME/pywikipedia/bot_control.py -subster -cron -lang:en 30 1 * * * > cronsub -s subster_ar $HOME/pywikipedia/bot_control.py -subster > -cron -lang:ar (the job at 1:00 had no problems...) So essentially there are 2 questions: 1.) How to remove this job from queue (in order to restart it)? 2.) Why did this happen? As you can see the job was started on 'ortelius'... is this usual behaviour or was another server down? May be someone can give me any hint? Thanks in advance and greetings! DrTrigon -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk83tIEACgkQAXWvBxzBrDDn3wCgoraFGYAYwC91fuzrV/cjdMYo zSYAoKlKYKu9WEVPrL4YbC8a+c0tic+O =saBm -----END PGP SIGNATURE-----

2 2

Wikimania scholarship deadline: Feb 16
by aude 14 Feb '12

14 Feb '12

Reminder that the deadline to apply for a Wikimania 2012 travel scholarship is February 16 (23:59 UTC). We encourage you to apply! We need developers and tech folks at Wikimania, including for the hackathon, the technical track, workshops and more. :) http://wikimania2012.wikimedia.org/wiki/Scholarships Full travel scholarships, funded by the Wikimedia Foundation and chapters (France, UK, Israel, Austria), will cover transportation, hostel accommodations, and conference registration. Partial scholarships are also offered by WMF (and Wikimedia Hungary). Wikimania 2012 will take place July 12-15 at the George Washington University in Washington, DC. Wikimania hackathon is July 10-11. The call for participation is also open now (deadline: March 18), and registration is open. Cheers, Katie

1 0

SLOW_OK
by Lars Aronsson 13 Feb '12

13 Feb '12

Trying to follow the instructions here, https://wiki.toolserver.org/view/Database_access#Slow_queries_and_the_query… I do the following ina shell script, run from cronie: echo "select /* SLOW_OK LIMIT:1800 */ 'pl.wikipedia', count(*), ..." | mysql ... I run such queries for a large number of languages, and most of them run on time, and give good results. The string constant selected as the first column is to facilitate fault searching. Yet, occasionally I receive an email from Query-Killer that says: ----- Hello la2, a MySQL-query of yours was killed because you didn't mark it as SLOW_OK and it have run for 645 seconds which was longer than allowed. You can find the query below. Please have also a look at [1] to find information how you can avoid killings of your queries. Maybe you can optimze the query too? The replication lag at kill-time was 39s. Sincerly, Query-Killer. This eMail was sent automaticaly, please don't reply. select 'pl.wikipedia', count(*), ... ---- As can be seen, the query in the e-mail has a double space after select but no comment. Somebody cut out the comment and my SLOW_OK was not respected. Is it the "mysql" command that does this? Is there a better way? -- Lars Aronsson (lars(a)aronsson.se) Aronsson Datateknik - http://aronsson.se

3 2

Toolserver quota
by Lars Aronsson 13 Feb '12

13 Feb '12

In December I wrote a cron job on the German toolserver, to collect statistics on external links. It works fine, but to be useful I must collect data over time, so I made a cron job to run each Monday morning. While my attention was elsewhere, believing that this was running, it turns out the 256 Mbyte quota (!) made all my files 0 bytes in length for all of January. I have now requested and gotten an increased quota, but 6 weeks of data have been lost. And I must devote time to check my quota every week or two. The /home disk is 600 GB of which 88 GB is free. That's not per user, but for all users together. It should come as a surprise to most people who donate money to the Wikimedia Foundation, that all of its volunteer developers have to share a disk the size of what is found in any laptop. According to an IRC discussion, some new disks that were planned to arrive in mid January have not yet been delivered. I have no idea what amount of disk has been ordered, or whether the quota system will be kept. I get the impression that this doesn't really matter to anybody. This is the development system for the world's 6th most visited website in 2012. It quite doesn't live up to my expectations. It feels more like some hobby project in 2002. I'm a great fan of hobby projects, but with the current budget of WMDE and WMF, I thought we would have reached a higher ambition level by now. -- Lars Aronsson (lars(a)aronsson.se) Aronsson Datateknik - http://aronsson.se

4 3

FYI: login.toolserver not responding or asking for password, HTTP down
by Aaron Halfaker 11 Feb '12

11 Feb '12

I can't seem to ssh to login.toolserver.org (times out or asks for password) and the HTTP server appears to be down. -Aaron (grphack@toolserver)

4 3

External authentication?
by Magnus Manske 11 Feb '12

11 Feb '12

Hi all, on my talk page, [[User:Pathoschild]] raised the idea of allowing OpenID authentication to operate toolserver tools that currently rely on TUSC. While I'd rather go for browserID [1] (not mutually exclusive), it raised the point of which authentication is "good enough" for using some toolserver tools, especially those that edit or upload on Wiki(m|p)edia projects. Would these non-TUSC accounts need to be linked to Wiki(m|p)edia user names? If so, how would this be done? If Wiki(m|p)edia were to provide openID/browserID authentication, it would be a non-issue, but as it stands, this would need to be done on the toolserver in some form, which would most likely be more cumbersome than the current TUSC account creation. Ideas? Magnus [1] https://browserid.org/

4 4

Save the date: Wikimedia & MediaWiki hackathon in Berlin, 1-3 June 2012
by Sumana Harihareswara 10 Feb '12

10 Feb '12

I invite you to the yearly Berlin hackathon. This is the premier event for the MediaWiki and Wikimedia technical community. We'll be hacking, designing, and socialising. Our goals for the event are to bring 100-150 people together, with lots of people who have not attended such events before. User scripts, gadgets, API use, Toolserver, Wikimedia Labs, mobile, structured data, templates -- if you are into any of these things, we want you to come! Some financial assistance will be available -- more details soon. This event will be hosted by Wikimedia Germany (WMDE) and supported by the Wikimedia Foundation. Thank you, WMDE! Dates: June 1-3 2012. Barely-started wiki page, no registration details yet: https://www.mediawiki.org/wiki/Berlin_Hackathon_2012 . Organizers: me and WMDE's Nicole Ebber with assistance from Lydia Pintscher and Daniel Kinzler. Mark your calendars! -- Sumana Harihareswara Volunteer Development Coordinator Wikimedia Foundation

1 0

Regular Maintenance at 8. February
by DaB. 09 Feb '12

09 Feb '12

Hello all, the next maintenance will be at Wednesday, 8 February between 19:00 and 1:00 UTC. The roots will collect what they will do at [1] until Sunday night. If you have something for us to do (like a software-update) please open a bugreport at JIRA and make sure to add the label "maintaince-window" until Sunday noon. Sincerly, DaB. [1] https://wiki.toolserver.org/view/Admin:Next_maintenance -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

2 2

Apply for Wikimania travel funding? Deadline in 8 days
by Sumana Harihareswara 08 Feb '12

08 Feb '12

Just wanted to remind you that you can apply for a Wikimania travel subsidy: https://wikimania2012.wikimedia.org/wiki/Scholarships The deadline is the 16th of February. Thanks! -- Sumana Harihareswara Volunteer Development Coordinator Wikimedia Foundation

1 0

Short outtake arround noon and s4-problems
by DaB. 06 Feb '12

06 Feb '12

Hello all, the toolserver had a short outtake today arround noon because there was a problem with our 2 HA-nodes which control the LDAP, what is necessary for login and file-rights. The problems started arround 13:10 and ended arround 13:40 (UTC). Independently we also discovered that the file-system which carries z-dat-s4-a was corrupted and so z-dat-s4-a can not start anymore and need a re-setup (we have backups of the user-databases there); I will do that at Wednesday in the maintenaice-window. Until then, s4 (commons) is accessable only for reading on the other hosts. Sincerly, DaB. -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l