Toolserver-l March 2012

toolserver-l@lists.wikimedia.org

34 participants
28 discussions

Submit a talk to Open Source Bridge by Mar 16th, get WMF subsidy
by Sumana Harihareswara 18 Mar '12

18 Mar '12

This year I want the Wikimedia technical community to have a strong presence at Open Source Bridge <http://opensourcebridge.org/> in Portland, Oregon, USA, June 26-29. OSB is tech talks & hack sessions with hands-on technologists we want, for Foundation staff recruiting (the Portland tech scene has good people looking for jobs) and for volunteer recruiting and collaboration (tons of Mozilla people went there last year). Good talks, clueful people, great food. :-) If you submit a talk and it gets accepted, tell me, and Wikimedia Foundation will partially subsidize or fully pay for your flight and hotel. If you submit a talk and it doesn't get accepted but you still want to go, talk with me and I'll see what I can do. Call for talks: <http://opensourcebridge.org/blog/2012/01/announcing-the-2012-call-for-propo…> Ideas: the parser rewrite, Wikimedia Labs, how we scale and optimize performance on a shoestring budget, our git/gerrit migration, securing PHP-based webapps, various approaches to making our data more structured/semantic, collaborative design, lessons from our communities, JS hacks, hetdeploy, offline/mobile, geodata... Please forward. -- Sumana Harihareswara Volunteer Development Coordinator Wikimedia Foundation

1 3

How to silence qsub/qcronsub?
by Simon Kågedal Reimer 17 Mar '12

17 Mar '12

Hi! Does anyone have a solution for making qsub/qcronsub not say "Your job ... has been submitted" to standard output? Been getting a lot of e-mails from cronie lately... I *do* of course want it to say something when things are not working as expected, so I don't want all output silenced. Regards, Simon Kågedal Reimer (skagedal)

6 9

Maintenance at Wednesday
by DaB. 16 Mar '12

16 Mar '12

Hello all, at Wednesday, 14th March, between 19:00 and 23:59 UTC we will have a maintenance-window. The most important change is the update of SGE, which will stop all planed and running SGE-jobs during the update. We will also try to use the new SAN-system for the first time and we will move the commons-database on rosemary to the SAN (for that we have to stop rosemary's MySQL). If this is successfull, I will dump the user-databases on thyme (for that I will switch thyme to read-only) and than import them into rosemary – as a preparation of the re-import of sql-s1 on thyme when the wmf provide us with a fresh dump. If we have enough time, we will extend the disc-size of z-dat-s4-a, which will cause a (short) downtime of sql-s4-user (sql-s4-rr will stay online). No other userland-software will be updated during the window, but we may install solaris-patches for the OS and system-services if we find the time. Sincerely, DaB. -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

1 2

Deadline for Wikimania submissions is Sunday
by aude 16 Mar '12

16 Mar '12

Reminder to get your Wikimania program submissions in soon! The deadline for submissions is Sunday, March 18 at 11:59 (San Francisco) Pacific Daylight Time (or 06:59 UTC on 19 March 2012). We seek submissions for presentations, workshops, panels, and other types of sessions. We want the technical track to be the best possible and we need your help! We want submission on various aspects of MediaWiki technology, mobile apps, operations, and more. How do we make Wikipedia scale? visual editor? Wikipedia and wiktionary mobile apps, wikidata, semantic mediawiki, GLAM tech, toolserver projects and tools, MediaWiki extensions, OpenStreetMap and other maps/geo, Wikimedia labs, and everything else that I'm forgetting to mention. :) Among all these topics, we're also interested in highlight accessibility as a topic for presentations and during the hackathon. You can view the call for participation and make submissions here: http://wikimania2012.wikimedia.org/wiki/Submissions Don't forget there will also be a hackathon during the preconference: http://wikimania2012.wikimedia.org/wiki/Hackathon Cheers, Katie -- President, Wikimedia District of Columbia http://wikimediadc.org @wikimediadc / @wikimania2012

1 0

Rewrite of status.toolserver.org is done
by DaB. 16 Mar '12

16 Mar '12

Hello all, as you may know status.toolserver.org was only a static page for some days, because the original site with the dynamic code went down. I promised a rewrite and that is done now, the new dynamic page is in place and working – I switched to it some minutes ago. I tried to keep as much backwards- compatibilty as possible, but it is not 100% the same old page (if you need the same old page for a quick&dirty fix in your tools, you can find it at [1]). I changed many things in the backparts, that will make the live of the roots easier, but I also added some features at the fronside: XML-, JSON- and a plain-output. Please notice that the page runs on a external server of mine, that has not the performance of the toolserver – so please keep the access-rates civil (not more than 1/minute) and provide a useful user-agent (I will block unuseful ones). I plan to setup a cache-instance of it in the toolserver-cluster to allow more accesses; but not at the moment. If you find a problem, please fill in a ticket at JIRA (in the TS-queue). Sincerley, DaB. [1] http://status.toolserver.org/static/old.html -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

1 1

/opt/local/bin/cronsub[4]: /sge62/default/common/settings.sh
by Platonides 15 Mar '12

15 Mar '12

The first cronsub and qcronsub line is to source /sge62/default/common/settings.sh However, that script has disappeared. And qcronsub seems to have been removed right now, too...

2 1

Dumps maintenance part 1. finished
by Danny B. 14 Mar '12

14 Mar '12

Hello, during the weekend I've done cleanup and organization of dumps stored in /mnt/user-store. What's new: All available latest dumps are currently accessible in /mnt/user-store/dumps/<wiki>-latest-<dumptype>.xml However, it is probably not the very final place of their storage. Latest versions of dumps are being (semi)automatically downloaded an unpacked. If you need .bz2, you can get it by bz2file=`readlink --canonicalize-existing /mnt/user-store/dumps/<xmldumpfile>`.bz2 where xmldumpfile is eg. foowiki-latest-pages-articles.xml All available (= latest & historical) dumps are physically stored in /mnt/user-store/dumps/store/<wiki>. If you need to download any dump which is not present in /mnt/user-store/dumps, please use /mnt/user-store/dumps/tmp directory, which is the only with write access. It will be added to the list of downloaded dumps and moved to proper place then. If you had any files stored in /mnt/user-store/dump (emijrp, hippietrail) or had some non-dump files stored in dumps directories (kudu [enwiki], la2 [svwiki], ryuch [kowiki]), you can find it now in /mnt/user-store/dumps/_to_clean - please remove it from there to your personal direcotries, thank you. Members of enwikt MMP (conrad, daveross, hippietrail) - please fix your script to not download enwiktionary dumps to /mnt/user-store, but get them from /mnt/user-store/dumps/enwiktionary-latest-pages-articles.xml or /mnt/user-store/dumps/store/enwiktionary. As said above, it is being periodically checked and downloaded, so you don't have to care about downloading. What is coming next: Fully automatical check'n'download (this will happen after we're back to Debian) Comfortable API to get different types of dumps without having to know where exactly they are stored Some system how to automatize adding of new requested wikis/dumps to autodownload batch (suggestions welcome) Final stable directory structure Anything else? Suggestions welcome... Kind regards Danny B.

1 0

Image import from Europeana
by Andrei Cipu 14 Mar '12

14 Mar '12

Hey guys, I was wondering if there is any tool on the toolserver to automatically import images from Europeana, just like we have for Flickr? Thanks, Andrei

2 1

Fwd: Re: Image import from Europeana
by Sumana Harihareswara 14 Mar '12

14 Mar '12

See Michael Peel's note below. Michael also said: "As ever, I have no objections to my emails being forwarded publicly.... But I'm not sure how useful my email is here to a wider audience - hopefully future emails on this topic will contain more information, or at least will contain links to more information..." Best, Sumana Harihareswara -------- Original Message -------- Date: Tue, 13 Mar 2012 22:24:10 +0000 From: Michael Peel <michael.peel(a)wikimedia.org.uk> Well, there's the mass upload tool that will start to be developed by Europeana in the very near future, in partnership with WMNL, WMUK, WMFR, etc, as was announced at GLAMcamp Amsterdam. I'm not sure what the best weblink for this is right now (a wiki page with associated discussion page would be rather useful here...), hopefully David Daskiya from Europeana (cc'd) can provide more information here about this project (is he subscribed to this mailing list?). That project has a number of long-term implications for importing Europeana content to the Wikimedia projects... Thanks, Mike > > > > -------- Original Message -------- > > Subject: [Toolserver-l] Image import from Europeana > > Date: Tue, 13 Mar 2012 09:59:53 -0700 (PDT) > > From: Andrei Cipu <wiki(a)strainu.ro> > > Reply-To: Andrei Cipu <wiki(a)strainu.ro>, toolserver-l(a)lists.wikimedia.org > > To: toolserver-l(a)lists.wikimedia.org <toolserver-l(a)lists.wikimedia.org> > > > > Hey guys, > > > > I was wondering if there is any tool on the toolserver to automatically > > import images from Europeana, just like we have for Flickr? > > > > Thanks, > > Andrei > > > > > > _______________________________________________ > > Toolserver-l mailing list (Toolserver-l(a)lists.wikimedia.org) > > https://lists.wikimedia.org/mailman/listinfo/toolserver-l > > Posting guidelines for this list: > > https://wiki.toolserver.org/view/Mailing_list_etiquette

1 0

Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93
by Jeremy Baron 13 Mar '12

13 Mar '12

On Mon, Mar 12, 2012 at 10:49, Petr Bena <benapetr(a)gmail.com> wrote: > It's true, most of the tools were overtaken by another user, can you > tell us which tools are still broken? I myself would prefer to move > all these tools to wikimedia labs, as soon as it's possible, which > would allow us to manage them together without separating it tool per > user (eg no ~soxred/files but toolname/files) where all tools would > have own git repository and devs could just update them together and > push to "production". fwiw, the same thing has been possible on the toolserver for quite a while now: Multi-maintainer projects (MMP) maybe they're aren't used enough when making a tool but (I think) you can't blame the roots for that and (I guess/hope) making new MMPs is a relatively cheap/easy process. -Jeremy (Also, this whole thread belongs on toolserver-l I think?)

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l March 2012