Hello,
I went through the logs again to see which tools are currently not found. Here is a top list. The second entry comes from people who placed redirects but forgot to write "http://tools.wmflabs.org" and instead put "//tools.wmflabs.org" in instead. I am currently going through the htaccess files with a script and will correct it when I know where exactly it went wrong.
1647 ~platonides/activeusers 1577 /tools.wmflabs.org 901 ~rhaworth/os 520 ~magnus/cgi-bin 509 ~drtrigon/cgi-bin 490 ~zache/incatsince 383 ~enwikt/wotd 366 ~overlordq/cgi-bin 281 ~luxo/contributions 170 ~sk/cgi-bin 147 ~platonides/wlm 143 ~dschwen/iip 139 ~cspurrier/rss 124 ~panther/russia 115 ~h4ck3rm1k3/osmgit 109 ~zach/cgi-bin 101 ~quentinv57/sulinfo 96 ~skagedal/feeds 93 ~superzerocool/es-wn.xml HTTP 77 ~cbm/footer-grad.png HTTP 77 ~cbm/bullet.gif HTTP 71 ~overlordq/scripts 62 ~h4ck3rm1k3/rails 56 ~snottywong/cgi-bin 56 ~dschwen/wma 54 ~interiot/cgi-bin 54 ~apper/sc 49 ~magnus/wiki_js 49 %7Echm/whois 45 ~svick/CLT 41 ~alexxw/Denkmalliste 39 %7Eoverlordq/scripts 32 ~dcoetzee/duplicationdetector 31 ~revolus/afterUpload 31 ~dereckson/translate 29 /toolserver.org 29 ~bawolff/rss.php?title=%E7%BB%B4%E5%9F%BA%E6%96%B0%E9%97%BB&domain=zhwikinews&cat=%E5%B7%B2%E5%8F%91%E5%B8%83&lim=20&ns=0 HTTP 29 %7Eluxo/contributions 28 ~sk/checkwiki 26 ~diberri/cgi-bin 22 ~avatar/feed 20 ~dereckson/cgi-bin 19 ~gmaxwell/jorbis 19 ~cmackenzie/wotd-rss.php HTTP 18 ~wikifeeds/adt
Cheers nosy
On Tue, Jul 1, 2014 at 11:24 AM, Marlen Caemmerer marlen.caemmerer@wikimedia.de wrote:
The second entry comes from people who placed redirects but forgot to write "http://tools.wmflabs.org" and instead put "//tools.wmflabs.org" in instead. I am currently going through the htaccess files with a script and will correct it when I know where exactly it went wrong.
I am pretty sure I did all my redirects protocol-relative like that, and they worked as intended (e.g. for /~dapete/ime/). Did you already make this change? Because now all my redirects lead to the HTTP version.
Cheers, Peter
Hey,
On Tue, 1 Jul 2014, Peter Schlömer wrote:
marlen.caemmerer@wikimedia.de wrote:
The second entry comes from people who placed redirects but forgot to write "http://tools.wmflabs.org" and instead put "//tools.wmflabs.org" in instead. I am currently going through the htaccess files with a script and will correct it when I know where exactly it went wrong.
I am pretty sure I did all my redirects protocol-relative like that, and they worked as intended (e.g. for /~dapete/ime/). Did you already make this change? Because now all my redirects lead to the HTTP version.
D'oh, you are right. But does anyone have an idea why I have in the logs like:
GET //tools.wmflabs.org/bambots/cwb/alpha/Yorkshire.html
nosy
Probably someone set up a RewriteRule to tool labs with [P]
See https://httpd.apache.org/docs/current/mod/mod_rewrite.html#rewriterule
On Tue, 2014-07-01 at 12:57 +0200, Marlen Caemmerer wrote:
Hey,
On Tue, 1 Jul 2014, Peter Schlömer wrote:
marlen.caemmerer@wikimedia.de wrote:
The second entry comes from people who placed redirects but forgot to write "http://tools.wmflabs.org" and instead put "//tools.wmflabs.org" in instead. I am currently going through the htaccess files with a script and will correct it when I know where exactly it went wrong.
I am pretty sure I did all my redirects protocol-relative like that, and they worked as intended (e.g. for /~dapete/ime/). Did you already make this change? Because now all my redirects lead to the HTTP version.
D'oh, you are right. But does anyone have an idea why I have in the logs like:
GET //tools.wmflabs.org/bambots/cwb/alpha/Yorkshire.html
nosy _______________________________________________ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
On Tue, 1 Jul 2014, Marlen Caemmerer wrote:
I am pretty sure I did all my redirects protocol-relative like that, and they worked as intended (e.g. for /~dapete/ime/). Did you already make this change? Because now all my redirects lead to the HTTP version.
Dapete, I guess this a tool of yours - where does it reside on TS?
221.204.196.130 - - [01/Jul/2014:11:03:15 +0000] "GET //tools.wmflabs.org/vcat/catgraphRedirect?cat=El_Santo&d=10&format=png&lang=fr&links =wiki&sub=0&wiki=wikipedia HTTP/1.1" 404 1304 - 1292604356 2
Cheers nosy
On Tue, Jul 1, 2014 at 1:07 PM, Marlen Caemmerer marlen.caemmerer@wikimedia.de wrote:
On Tue, 1 Jul 2014, Marlen Caemmerer wrote:
I am pretty sure I did all my redirects protocol-relative like that, and they worked as intended (e.g. for /~dapete/ime/). Did you already make this change? Because now all my redirects lead to the HTTP version.
Dapete, I guess this a tool of yours - where does it reside on TS?
221.204.196.130 - - [01/Jul/2014:11:03:15 +0000] "GET //tools.wmflabs.org/vcat/catgraphRedirect?cat=El_Santo&d=10&format=png&lang=fr&links =wiki&sub=0&wiki=wikipedia HTTP/1.1" 404 1304 - 1292604356 2
The redirect is for /~dapete/catgraph/graph.php
Peter
Hey,
On Tue, 1 Jul 2014, Peter Schlömer wrote:
On Tue, Jul 1, 2014 at 1:07 PM, Marlen Caemmerer marlen.caemmerer@wikimedia.de wrote:
On Tue, 1 Jul 2014, Marlen Caemmerer wrote:
I am pretty sure I did all my redirects protocol-relative like that, and they worked as intended (e.g. for /~dapete/ime/). Did you already make this change? Because now all my redirects lead to the HTTP version.
Dapete, I guess this a tool of yours - where does it reside on TS?
221.204.196.130 - - [01/Jul/2014:11:03:15 +0000] "GET //tools.wmflabs.org/vcat/catgraphRedirect?cat=El_Santo&d=10&format=png&lang=fr&links =wiki&sub=0&wiki=wikipedia HTTP/1.1" 404 1304 - 1292604356 2
The redirect is for /~dapete/catgraph/graph.php
Really strange. I reverted the changes for you htaccess and the URL redirect still works and gives a strange log entry, dont know why.
Says No webservice btw...
Anyways, seems I will revert all changes to htaccess files I made for now.
Cheers nosy
Any chance we can get shell access back to place redirects? Was it not possible to deactivate tools (i.e. cron jobs, PHP, any HTTP, except redirects, etc.) and leave shell access open?
On Tue, Jul 1, 2014 at 5:21 AM, Marlen Caemmerer marlen.caemmerer@wikimedia.de wrote:
Hey,
On Tue, 1 Jul 2014, Peter Schlömer wrote:
On Tue, Jul 1, 2014 at 1:07 PM, Marlen Caemmerer marlen.caemmerer@wikimedia.de wrote:
On Tue, 1 Jul 2014, Marlen Caemmerer wrote:
I am pretty sure I did all my redirects protocol-relative like that, and they worked as intended (e.g. for /~dapete/ime/). Did you already make this change? Because now all my redirects lead to the HTTP version.
Dapete, I guess this a tool of yours - where does it reside on TS?
221.204.196.130 - - [01/Jul/2014:11:03:15 +0000] "GET
//tools.wmflabs.org/vcat/catgraphRedirect?cat=El_Santo&d=10&format=png&lang=fr&links =wiki&sub=0&wiki=wikipedia HTTP/1.1" 404 1304 - 1292604356 2
The redirect is for /~dapete/catgraph/graph.php
Really strange. I reverted the changes for you htaccess and the URL redirect still works and gives a strange log entry, dont know why.
Says No webservice btw...
Anyways, seems I will revert all changes to htaccess files I made for now.
Cheers nosy _______________________________________________ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Hi Daniel,
On 01.07.2014 16:28, Daniel Schwen wrote:
Any chance we can get shell access back to place redirects? Was it not possible to deactivate tools (i.e. cron jobs, PHP, any HTTP, except redirects, etc.) and leave shell access open?
Sorry, no chance. Please add missing redirects to the list [1] or send them to ts-admins@toolserver.org.
Best, Silke
[1] https://www.mediawiki.org/wiki/Tool_Labs/Collection_of_issues_after_Toolserv...
- -- Silke Meyer Internes IT-Management und Projektmanagement Toolserver
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 260
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.
D'oh, you are right. But does anyone have an idea why I have in the logs
like:
GET //tools.wmflabs.org/bambots/cwb/alpha/Yorkshire.html
nosy
That's going to be me, this is Tool Labs version of ~svick/CleanupListing. It took me few tries to figure out rewrite.script (and that I need that, since toolserver doesn't have mod_rewrite).
If you're still seeing this in the logs, then I may have done something weird in the rewrite.script, but it does seem to work.
Petr Onderka User:Svick
Hey,
On Tue, 1 Jul 2014, Petr Onderka wrote:
D'oh, you are right. But does anyone have an idea why I have in the logs
like:
GET //tools.wmflabs.org/bambots/cwb/alpha/Yorkshire.html
nosy
That's going to be me, this is Tool Labs version of ~svick/CleanupListing. It took me few tries to figure out rewrite.script (and that I need that, since toolserver doesn't have mod_rewrite).
If you're still seeing this in the logs, then I may have done something weird in the rewrite.script, but it does seem to work.
Honestly I see this for a number of URLs and I dont know if it has any impact:
67800 GET //tools.wmflabs.org/para/geo 13093 GET //tools.wmflabs.org/vcat/catgraphRedirect 5234 GET //tools.wmflabs.org/dispenser/cgi-bin 5166 GET //tools.wmflabs.org/kmlexport/ 1022 GET //tools.wmflabs.org/dewikinews-rss/ HTTP 476 GET //tools.wmflabs.org/bambots/cwb 407 GET //tools.wmflabs.org/heritage/api 398 GET //tools.wmflabs.org/geohack/geohack.php 351 GET //tools.wmflabs.org/mzmcbride/cgi-bin 173 GET //tools.wmflabs.org/geocommons/earth.kml 112 GET //tools.wmflabs.org/liangent-toolserver/soxred93 95 GET //tools.wmflabs.org/mzmcbride/watcher 74 GET //tools.wmflabs.org/templatecount/index.php 67 GET //tools.wmflabs.org/geocommons/proximityrama 29 GET //tools.wmflabs.org/geocommons/geocodingtodo 27 GET //tools.wmflabs.org/dewikinews-rss/ 26 GET //tools.wmflabs.org/liangent-toolserver/gadget_usage 18 GET //tools.wmflabs.org/dewikinews-rss/kategorie 16 GET //tools.wmflabs.org/heritage/tools 14 GET //tools.wmflabs.org/para/ripts 14 GET /~dispenser/cgi-bin//tools.wmflabs.org 12 GET //tools.wmflabs.org/dispenser/sources 12 GET /~svick/CleanupListing// 10 GET //tools.wmflabs.org/mzmcbride/redirector
Seems the redirects work so its currently fine for me but still I find it strange.
Cheers nosy
_______________________________________________ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
On 01/07/14 21:35, Marlen Caemmerer wrote:
Honestly I see this for a number of URLs and I dont know if it has any impact:
When putting redirects in place earlier, I noticed in the logs a "360Spider" that interpreted all redirects without a protocol as a local redirect. Probably still going strong?
360Spider looks like some crawler from Qihoo[1], a company creating malwares (read as "disobeying various rules" here). I would personally just ignore those hits.
Relative URLs in Location were incorrect, but they're now acceptable with the new HTTP standard, and most, if not all, current browsers recognize them[2].
It seems that the spider is not aware of the new standard, and/or protocol-relative URLs. In any case, I don't think we need to care spiders, as long as they work fine in browsers.
[1] https://en.wikipedia.org/wiki/Qihoo [2] https://en.wikipedia.org/wiki/HTTP_location
-Liangent
On Wed, Jul 2, 2014 at 4:47 AM, Para wikipara@gmail.com wrote:
On 01/07/14 21:35, Marlen Caemmerer wrote:
Honestly I see this for a number of URLs and I dont know if it has any impact:
When putting redirects in place earlier, I noticed in the logs a "360Spider" that interpreted all redirects without a protocol as a local redirect. Probably still going strong?
Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
toolserver-l@lists.wikimedia.org