Toolserver-l

toolserver-l@lists.wikimedia.org

1612 discussions

Re: [Toolserver-l] Stable server editcounter
by Huji 22 Nov '07

22 Nov '07

I'll be able to help in both PHP and Python (although I'm more a PHP guy). I think we should really make a more clear plan about caching, features that are going to be included, graphs that are going to be generated (if any) (I really miss the graphs which were previously present in Interiot's tool) etc. Hojjat (aka Huji)

1 0

Stable server editcounter
by E 21 Nov '07

21 Nov '07

As suggested before, we should begin to explore the need of a dedicated editcounter that is run on the new stable server. The simple fact is that it would make life easier for many wikis, by providing a fast and reliable editcounter for users to utilise for any purpose (RfA, RfB, etc.). Is there anyone that has a editcount utility that would be fine with hosting it on the stable server? Thanks in advance, Kind regards, E English Wikipedia e.wikipedia(a)gmail.com

6 7

Stable server editcounter
by E 21 Nov '07

21 Nov '07

1 0

downtime tuesday morning
by River Tarnell 19 Nov '07

19 Nov '07

hello, there will be some downtime Tuesday morning as changes are being made to the knams network. the toolserver IPs will also change during this time. - river.

2 2

Account-Expire-Date is soon
by DaB. 19 Nov '07

19 Nov '07

Hello all, all active accounts will expire at 7th December. If you are still interrested in your account, please send a eMail to ts-not-expire(a)daniel.baur4.info; NOT to this mailinglist! (if you send it to here, you will lost your account instantly ;)). Please name your accountname in this email. If you like, you can send the poll (see below) with it - but that is optional. I will send a list of non-confirmed accounts every monday. So if you have a moment, please fill in this little poll. Of corse your data will only used in anonymous form. Sincerly, DaB. #START *I'm [ ] younger than 18 [ ] between 18 and 25 [ ] between 25 and 35 [ ] older than 34 *I'm [ ] female [ ] male *I live in (please put country-name here) * I use my account for (more then one "x" possible) [ ] running a bot [ ] make statistics [ ] doing research [ ] helping conduct commons [ ] other * I can programm in (more then one "x" possible) [ ] php [ ] perl [ ] python [ ] c (or c++ or c#) [ ] java [ ] bash [ ] html [ ] javascript *I use (for my tools) (more then one "x" possible) [ ] subversion [ ] jira [ ] fisheye [ ] mysql *I work mainly in [ ] wikipedia [ ] wiktionary [ ] wikinews [ ] wikisource [ ] wikiquote [ ] wikiversity [ ] commons #END -- Diese eMail sollte mit dem PGP-Schlüssel 0x2D3EE2D42B255885 digital signiert sein. Bitte beachten Sie, das unsignierte eMails beliebig gefälscht sein können. Achten Sie daher auf Signaturen. -- wp-blog.de

4 3

Re: [Toolserver-l] Toolserver-l Digest, Vol 25, Issue 8
by Tim Alder 18 Nov '07

18 Nov '07

Hello, we need more than external links because we can each template, see: http://de.wikipedia.org/wiki/Wikipedia:WikiProjekt_Vorlagenauswertung/en Grettings Kolossos >What about scanning the externallinks table [1] to find every link to >http://tools.wikimedia.de/~magnus/geo/geohack.php?language=de&... ? If all >the information you need is in the link, this could be an alternative method. > >Jelte a.k.a. WebBoy > >[1] http://www.mediawiki.org/wiki/Externallinks_table > > > >

1 0

Time problem
by Stefan Kühn 17 Nov '07

17 Nov '07

Hello gurus, we (Kolossos and I) work an a new update for Wikipedia-World and Vorlagenauswertung (Templatetiger) http://de.wikipedia.org/wiki/Wikipedia:WikiProjekt_Georeferenzierung/Wikipe… http://de.wikipedia.org/wiki/Wikipedia:WikiProjekt_Vorlagenauswertung/en In the last years we use the dump from Wikimedia Foundation. We download this dump for the main languages and unpack this big files at the toolserver and scan this file with a perl-script for geocoordinates and templates. Problem: This need many time, make many traffic and need many disk space at the toolserver. Also the update is only possible if a new dump is available. Now we want create a new workflow. We use a up-to-date list of articles of a language and the perl-script get the text of a any article from the toolserver. It work very well, but we need at the moment for reading the text of an article 2 seconds. If we get all 677000 German articles with 2 seconds we need 15.6 days. This is too much! With the old workflow I need not more then 30 Minutes to scan the complete DE-Dump. I try different ways to get the text of an article with my perl-script. 1.) http://localhost/~daniel/WikiSense/WikiProxy.php?wiki=de.wikipedia.org&titl… 2.) http://tools.wikimedia.de/~kolossos/rss-test/fopen.php?pro=wikipedia&lang=d… but every time the perl-script need average 2 seconds. With the second PHP-Script I see in a browser the time for getting the text and this time is mostly 0.2 seconds (factor 10 lower !!!) In this time we need only 1.5 days for scanning. This will be ok! Here is the perl-code of my script, which get the article test. I hope one perl guru can help us to reduce the time. Thank´s for every help! Stefan Kühn sub get_article_text_from_web { my $title = $_[0]; my $page_id = 0; my $revision_id = 0; my $revision_time = 0; my $text = ""; print "get\t".$title."\n"; my $test1 = time(); print localtime($test1)."\n"; use URI::Escape; use LWP::UserAgent; # http://localhost/~daniel/WikiSense/WikiProxy.php?wiki=$lang.wikipedia.org&t… my $url = 'http://localhost/~daniel/WikiSense/WikiProxy.php?wiki=de.wikipedia.org&titl…'.$title; #http://www.webkuehn.de uri_escape($url); my $ua = LWP::UserAgent->new; my $response = $ua->get( $url ); $response->is_success or die "$url: ", $response->status_line; my $result = $response->content; if ( $result ) { $text = $result; #print "$result\n"; print "ok\t".$title."\n"; my $test2 = time(); my $test3 = $test2 - $test1; print localtime($test2)."\n"; print "second\t".$test3."\n\n"; } else { print "No result $title\n"; } #print "ok2\n"; return($title, $page_id, $revision_id, $revision_time, $text); }

2 1

Re: [Toolserver-l] Toolserver-l Digest, Vol 25, Issue 5
by Wolfgang Ten-Weges 08 Nov '07

08 Nov '07

> >River Tarnell wrote: > > we have bought the domain toolserver.org with a view to using it for the > > toolserver, e.g. http://toolserver.org/~username/. if anyone has any > > comments (for/against), please say now. > Woohooo ^_^ this looks nice > >From: Martin Peeks <martinp23(a)googlemail.com> > Hemlock is heavily overloaded > Would disabling use of interwiki.py on the TS help reduce the load ? it's known to be a memory whore. (and don't tell me that script can't be run on an user's computer, I've done that for months) --DarkoNeko

2 1

UDFs
by Nikola Smolenski 08 Nov '07

08 Nov '07

Would it be possible to add some user defined functions to MySQL servers? I'm having in mind Levenshtein distance: http://empyrean.lib.ndsu.nodak.edu/~nem/mysql/udf/dludf.cgi?ckey=28

1 1

toolserver.org
by River Tarnell 07 Nov '07

07 Nov '07

hello, we have bought the domain toolserver.org with a view to using it for the toolserver, e.g. http://toolserver.org/~username/. if anyone has any comments (for/against), please say now. - river.

9 12

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Toolserver-l