Toolserver-l

toolserver-l@lists.wikimedia.org

1612 discussions

Rewrite of status.toolserver.org is done
by DaB. 15 Mar '12

15 Mar '12

Hello all, as you may know status.toolserver.org was only a static page for some days, because the original site with the dynamic code went down. I promised a rewrite and that is done now, the new dynamic page is in place and working – I switched to it some minutes ago. I tried to keep as much backwards- compatibilty as possible, but it is not 100% the same old page (if you need the same old page for a quick&dirty fix in your tools, you can find it at [1]). I changed many things in the backparts, that will make the live of the roots easier, but I also added some features at the fronside: XML-, JSON- and a plain-output. Please notice that the page runs on a external server of mine, that has not the performance of the toolserver – so please keep the access-rates civil (not more than 1/minute) and provide a useful user-agent (I will block unuseful ones). I plan to setup a cache-instance of it in the toolserver-cluster to allow more accesses; but not at the moment. If you find a problem, please fill in a ticket at JIRA (in the TS-queue). Sincerley, DaB. [1] http://status.toolserver.org/static/old.html -- Userpage: [[:w:de:User:DaB.]] — PGP: 2B255885

1 1

/opt/local/bin/cronsub[4]: /sge62/default/common/settings.sh
by Platonides 15 Mar '12

15 Mar '12

The first cronsub and qcronsub line is to source /sge62/default/common/settings.sh However, that script has disappeared. And qcronsub seems to have been removed right now, too...

2 1

Dumps maintenance part 1. finished
by Danny B. 14 Mar '12

14 Mar '12

Hello, during the weekend I've done cleanup and organization of dumps stored in /mnt/user-store. What's new: All available latest dumps are currently accessible in /mnt/user-store/dumps/<wiki>-latest-<dumptype>.xml However, it is probably not the very final place of their storage. Latest versions of dumps are being (semi)automatically downloaded an unpacked. If you need .bz2, you can get it by bz2file=`readlink --canonicalize-existing /mnt/user-store/dumps/<xmldumpfile>`.bz2 where xmldumpfile is eg. foowiki-latest-pages-articles.xml All available (= latest & historical) dumps are physically stored in /mnt/user-store/dumps/store/<wiki>. If you need to download any dump which is not present in /mnt/user-store/dumps, please use /mnt/user-store/dumps/tmp directory, which is the only with write access. It will be added to the list of downloaded dumps and moved to proper place then. If you had any files stored in /mnt/user-store/dump (emijrp, hippietrail) or had some non-dump files stored in dumps directories (kudu [enwiki], la2 [svwiki], ryuch [kowiki]), you can find it now in /mnt/user-store/dumps/_to_clean - please remove it from there to your personal direcotries, thank you. Members of enwikt MMP (conrad, daveross, hippietrail) - please fix your script to not download enwiktionary dumps to /mnt/user-store, but get them from /mnt/user-store/dumps/enwiktionary-latest-pages-articles.xml or /mnt/user-store/dumps/store/enwiktionary. As said above, it is being periodically checked and downloaded, so you don't have to care about downloading. What is coming next: Fully automatical check'n'download (this will happen after we're back to Debian) Comfortable API to get different types of dumps without having to know where exactly they are stored Some system how to automatize adding of new requested wikis/dumps to autodownload batch (suggestions welcome) Final stable directory structure Anything else? Suggestions welcome... Kind regards Danny B.

1 0

Image import from Europeana
by Andrei Cipu 14 Mar '12

14 Mar '12

Hey guys, I was wondering if there is any tool on the toolserver to automatically import images from Europeana, just like we have for Flickr? Thanks, Andrei

2 1

Fwd: Re: Image import from Europeana
by Sumana Harihareswara 14 Mar '12

14 Mar '12

See Michael Peel's note below. Michael also said: "As ever, I have no objections to my emails being forwarded publicly.... But I'm not sure how useful my email is here to a wider audience - hopefully future emails on this topic will contain more information, or at least will contain links to more information..." Best, Sumana Harihareswara -------- Original Message -------- Date: Tue, 13 Mar 2012 22:24:10 +0000 From: Michael Peel <michael.peel(a)wikimedia.org.uk> Well, there's the mass upload tool that will start to be developed by Europeana in the very near future, in partnership with WMNL, WMUK, WMFR, etc, as was announced at GLAMcamp Amsterdam. I'm not sure what the best weblink for this is right now (a wiki page with associated discussion page would be rather useful here...), hopefully David Daskiya from Europeana (cc'd) can provide more information here about this project (is he subscribed to this mailing list?). That project has a number of long-term implications for importing Europeana content to the Wikimedia projects... Thanks, Mike > > > > -------- Original Message -------- > > Subject: [Toolserver-l] Image import from Europeana > > Date: Tue, 13 Mar 2012 09:59:53 -0700 (PDT) > > From: Andrei Cipu <wiki(a)strainu.ro> > > Reply-To: Andrei Cipu <wiki(a)strainu.ro>, toolserver-l(a)lists.wikimedia.org > > To: toolserver-l(a)lists.wikimedia.org <toolserver-l(a)lists.wikimedia.org> > > > > Hey guys, > > > > I was wondering if there is any tool on the toolserver to automatically > > import images from Europeana, just like we have for Flickr? > > > > Thanks, > > Andrei > > > > > > _______________________________________________ > > Toolserver-l mailing list (Toolserver-l(a)lists.wikimedia.org) > > https://lists.wikimedia.org/mailman/listinfo/toolserver-l > > Posting guidelines for this list: > > https://wiki.toolserver.org/view/Mailing_list_etiquette

1 0

Re: [Toolserver-l] [Wikitech-l] 403: User account expired toolserver.org/~soxred93
by Jeremy Baron 12 Mar '12

12 Mar '12

On Mon, Mar 12, 2012 at 10:49, Petr Bena <benapetr(a)gmail.com> wrote: > It's true, most of the tools were overtaken by another user, can you > tell us which tools are still broken? I myself would prefer to move > all these tools to wikimedia labs, as soon as it's possible, which > would allow us to manage them together without separating it tool per > user (eg no ~soxred/files but toolname/files) where all tools would > have own git repository and devs could just update them together and > push to "production". fwiw, the same thing has been possible on the toolserver for quite a while now: Multi-maintainer projects (MMP) maybe they're aren't used enough when making a tool but (I think) you can't blame the roots for that and (I guess/hope) making new MMPs is a relatively cheap/easy process. -Jeremy (Also, this whole thread belongs on toolserver-l I think?)

1 0

Dumps maintenance this weekend
by Danny B. 10 Mar '12

10 Mar '12

Hello, I will be performing dumps maintenance this weekend 10./11. 3. No files are going to be deleted, however, due to moving of files, if you have running scripts, they might be affected. For some transitive period there will be symlinks left behind, but in future, only dedicated directories should be used for dumps, so all symlinks will be deleted. This will be noticed enough ahead so you will have enough time to update your scripts. Also, in round two, there will be automatic dump update service available for requested dumps, so you will not have to take care about their downloading and updating anymore. Once the maintenance is finished, I'll announce the results and possible dependencies. Kind regards Danny B.

1 0

enwiki_p corrupt?
by MZMcBride 09 Mar '12

09 Mar '12

Hi. Can someone verify the integrity of the page table for me, please? --- mzmcbride@willow:~$ sql enwiki_p; mysql> select * from page where page_namespace = 6 and page_title = 'Hubble_Space_Telescope_picture_of_Betelgeuse.jpg'; Empty set (0.00 sec) mysql> select * from page where page_namespace = 0 and page_title = 'Hexen:_Beyond_Heretic'; Empty set (0.00 sec) --- Compare: * http://enwp.org/File:Hubble_Space_Telescope_picture_of_Betelgeuse.jpg * https://en.wikipedia.org/wiki/Hexen:_Beyond_Heretic To me, this indicates that either the master has some very serious problem (unlikely) or that the Toolserver's copy of the database has become corrupt (much more likely). Can anyone verify my findings? MZMcBride

3 4

What happened to user_properties_anonym?
by Krinkle 05 Mar '12

05 Mar '12

Hey all, I used to periodically run some stats on preference usage (mostly skin-preferences and gadget usage), but it appears the custom "user_properties_anonym" table view Toolserver used to have no longer exists ? Testing here: https://toolserver.org/~krinkle/tmp/user_properties_anonym.php -- Krinkle

2 1

About cron
by محمد الجداوي 05 Mar '12

05 Mar '12

Hi there. I made a cron for operating *clean_sandbox.py* every 6 hours, I made a modified copy from *clean_sandbox.py* for me and uploaded it to my account on toolserver (outside the pywikipedia folder). The problem i face is that i can't write the proper code, I made this code: #!/bin/sh #$ -j y #$ -o /dev/null $HOME python clean_sandbox.py -lang:"ar" -family:wikipedia But it didn't work.

3 3

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l