Bugs item #2114223, was opened at 2008-09-16 15:46
Message generated for change (Comment added) made by nicdumz
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2114223&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Andr Malafaya Baptista (malafaya)
Assigned to: Nobody/Anonymous (nobody)
Summary: Socket timeout breaks out
Initial Comment:
VERSION.PY
==========
Pywikipedia [svn+ssh] wikimedia/svnroot/pywikipedia/trunk/pywikipedia (r5898, Se
p 16 2008, 11:50:17)
Python 2.5.2 (r252:60911, Feb 21 2008, 13:11:45) [MSC v.1310 32 bit (Intel)]
DESCRIPTION
===========
It's been happening in the past days that a socket timeout interrupts the bot. I believe the stack trace below is self-explanatory.
I used the command line:
interwiki.py -family:wiktionary -autonomous -start:Category:! -lang:io
OUTPUT
======
NOTE: The first unfinished subject is [[io:Kategorio:Albaniana vorti]]
NOTE: Number of pages queued is 59, trying to add 60 more.
Sleeping for 4.1 seconds, 2008-09-16 14:31:06
Dump io (wiktionary) saved
Traceback (most recent call last):
File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1735, in <module>
bot.run()
File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1486, in run
self.queryStep()
File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1460, in queryStep
self.oneQuery()
File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1428, in oneQuery
site = self.selectQuerySite()
File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1402, in selectQuerySite
self.generateMore(globalvar.maxquerysize - mycount)
File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1336, in generateMore
page = self.pageGenerator.next()
File "D:\Work\pywikipediabot-HEAD\pywikipedia\pagegenerators.py", line 688, in
DuplicateFilterPageGenerator
for page in generator:
File "D:\Work\pywikipediabot-HEAD\pywikipedia\pagegenerators.py", line 239, in
AllpagesPageGenerator
for page in site.allpages(start = start, namespace = namespace, includeredir
ects = includeredirects):
File "D:\Work\pywikipediabot-HEAD\pywikipedia\wikipedia.py", line 5166, in allpages
text = self.getUrl(api_url)
File "D:\Work\pywikipediabot-HEAD\pywikipedia\wikipedia.py", line 4485, in getUrl
text = f.read()
File "D:\Program Files\Python\lib\socket.py", line 291, in read
data = self._sock.recv(recv_size)
socket.timeout: timed out
----------------------------------------------------------------------
>Comment By: NicDumZ Nicolas Dumazet (nicdumz)
Date: 2008-09-20 03:41
Message:
the pagegenerator, even with the new api implementation, seems to be
working, I'm currently listing the pages of eo.wikt without any timeout.
Your connection might just be slower than usual ? Or does it timeout when
the WM websites are under heavy load ?
You can tweak the socket timeout in user-config.py, setting socket_timeout
to the number of seconds to wait (default is 120 seconds, quite long...)
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2114223&group_…
Bugs item #2114866, was opened at 2008-09-16 22:50
Message generated for change (Comment added) made by nicdumz
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2114866&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
>Status: Pending
Resolution: None
Priority: 5
Private: No
Submitted By: Luca Landucci (kaspo)
Assigned to: Nobody/Anonymous (nobody)
>Summary: modifying interwiki anchor to wrong one (encoding ?)
Initial Comment:
The script interwiki has replaced in two pages "ofe" with "".
These are the edits:
http://it.wikipedia.org/w/index.php?title=Professor_Elm&diff=18818854&oldid… and http://it.wikipedia.org/w/index.php?title=Professor_Oak&diff=18818865&oldid…
I try again work in these page and the script give me:
[[Professor Elm]]: [[it:Professor Elm]] gives new interwiki [[en:List of characters in the Pokmon anime series#Prssor Elm]]
My versions:
Pywikipedia nightly:pywikipedia (r5858, Aug 28 2008, 11:35:51)
Python 2.5.2 (r252:60911, Jul 31 2008, 17:28:52)
[GCC 4.2.3 (Ubuntu 4.2.3-2ubuntu7)]
----------------------------------------------------------------------
>Comment By: NicDumZ Nicolas Dumazet (nicdumz)
Date: 2008-09-20 03:25
Message:
Erm... for me if I run interwiki.py on these articles, nothing happens,
i.e. the link is not changed ?
Changing title.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2114866&group_…
Bugs item #2119685, was opened at 2008-09-19 20:53
Message generated for change (Comment added) made by carsrac
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2119685&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py does reverts
Initial Comment:
I got this message. As far as I know is this an old feature, that should be solved a long time ago.
At this moment I'm working with revision 5909. But I don't know with which version I did the reverts.
For the description of the feature see the message send by someones else that detected this feature.
Hello Carsrac,
I would like to draw your attention to these edits made by your bot: [http://de.wikipedia.org/w/index.php?title=Auge&diff=48157069&oldid=48020013 article de:Auge] and [http://la.wikipedia.org/w/index.php?title=The_Beatles&diff=562763&oldid=562… article la:The Beatles]. Obviously, the bot didn't edit the version that was at that time the current one, but an older one. That's equivalent to doing a revert. It seems that the bot edited the second last version that had been created by a bot. In these cases that meant a revert of [http://de.wikipedia.org/w/index.php?title=Auge&diff=48157069&oldid=47723213 two versions] of de:Auge and of [http://la.wikipedia.org/w/index.php?title=The_Beatles&diff=562763&oldid=551… 24 versions] of la:The Beatles.
How could that happen? Is there any reason to believe this didn't happen more often? I believe these are questions to be well considered since the bot seems to have done several thousand, if not tens of thousands of edits during that time. And it would be very assuring to know that the possibility that this still can or will happen can be ruled out.
--[[de:user:Lax]] - [[Gebruiker:88.65.169.226|88.65.169.226]] 19 sep 2008 10:15 (CEST)
----------------------------------------------------------------------
Comment By: Carsrac (carsrac)
Date: 2008-09-20 03:16
Message:
It is the same problem as [ 1999895 ] iw bot doesn't detect edit conflict
----------------------------------------------------------------------
Comment By: NicDumZ Nicolas Dumazet (nicdumz)
Date: 2008-09-20 03:07
Message:
rciw.py for example *will* trigger this behavior quite often, sometimes
working on a version more than 10 hours old. I am not however, able to
confirm this on the standard interwiki.py
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2119685&group_…
Bugs item #2110095, was opened at 2008-09-14 11:46
Message generated for change (Comment added) made by nicdumz
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2110095&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: euku (eugo)
Assigned to: Nobody/Anonymous (nobody)
>Summary: [[Special:Export]] not retrieving zh-traditional titles
Initial Comment:
Pywikipedia [http] trunk/pywikipedia (r5894, Sep 13 2008, 17:27:38)
Python 2.4.4 (#2, Apr 15 2008, 23:43:20)
[GCC 4.1.2 20061115 (prerelease) (Debian 4.1.1-21)]
Hello,
my bot checked ru: , - on ru-WP for interwiki links and found an invalid link to zh-WP and removed it. But this link is valid as you can see. Why does this happen?
Best regards,
Euku
-----
python interwiki.py "-start:%D0%94%D0%BE%D0%BC%D0%B0%D1%88%D0%BD%D0%B8%D1%85_%D0%B4%D1%83%D1%85%D0%BE%D0%B2_%D0%BE%D0%B1%D0%BC%D0%B0%D0%BD%D1%83%D0%B2,_%D0%B4%D1%83%D1%88%D0%B0_%D0%A6%D1%8F%D0%BD%D1%8C-%D0%BD%D1%8E%D0%B9_%D1%80%D0%B0%D1%81%D1%81%D1%82%D0%B0%D1%91%D1%82%D1%81%D1%8F_%D1%81_%D1%82%D0%B5%D0%BB%D0%BE%D0%BC" "-number:1" -lang:ru
Checked for running processes. 1 processes currently running, including the current process.
NOTE: Number of pages queued is 0, trying to add 60 more.
Getting 1 pages from wikipedia:ru...
Getting 1 pages from wikipedia:zh...
NOTE: [[zh:????]] does not exist
======Post-processing [[ru:Domashnikh dukhov obmanuv, dusha Cyan'-nyuj rasstatsya s telom]]======
Updating links on page [[ru:Domashnikh dukhov obmanuv, dusha Cyan'-nyuj rasstatsya s telom]].
Changes to be made: udalil: [[zh:????]]
- [[zh:????]]
ERROR: Found incorrect link to zh in [[ru:Domashnikh dukhov obmanuv, dusha Cyan'-nyuj rasstatsya s telom]]
Submit? ([y]es, [n]o, [g]ive up)
----------------------------------------------------------------------
>Comment By: NicDumZ Nicolas Dumazet (nicdumz)
Date: 2008-09-20 03:13
Message:
better title.
----------------------------------------------------------------------
Comment By: euku (eugo)
Date: 2008-09-14 12:17
Message:
Thanks. But there should be a general solution for this. Is it a MediaWiki
bug or should the bot know about all distinctions made on WP-Projects?
----------------------------------------------------------------------
Comment By: Andre Engels (a_engels)
Date: 2008-09-14 12:08
Message:
It has to do with the zh-traditional/zh-simplified distinction. In normal
MediaWiki usage, both the simplified and the traditional orthography of
Chinese work, but the bot uses [[Special:Export]], which only works for
simplified Chinese.
If you change the link from [[zh:]] to [[zh:]],
you still go to the same page, but the link will work for the bot as well.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2110095&group_…
Bugs item #2119685, was opened at 2008-09-19 20:53
Message generated for change (Comment added) made by nicdumz
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2119685&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py does reverts
Initial Comment:
I got this message. As far as I know is this an old feature, that should be solved a long time ago.
At this moment I'm working with revision 5909. But I don't know with which version I did the reverts.
For the description of the feature see the message send by someones else that detected this feature.
Hello Carsrac,
I would like to draw your attention to these edits made by your bot: [http://de.wikipedia.org/w/index.php?title=Auge&diff=48157069&oldid=48020013 article de:Auge] and [http://la.wikipedia.org/w/index.php?title=The_Beatles&diff=562763&oldid=562… article la:The Beatles]. Obviously, the bot didn't edit the version that was at that time the current one, but an older one. That's equivalent to doing a revert. It seems that the bot edited the second last version that had been created by a bot. In these cases that meant a revert of [http://de.wikipedia.org/w/index.php?title=Auge&diff=48157069&oldid=47723213 two versions] of de:Auge and of [http://la.wikipedia.org/w/index.php?title=The_Beatles&diff=562763&oldid=551… 24 versions] of la:The Beatles.
How could that happen? Is there any reason to believe this didn't happen more often? I believe these are questions to be well considered since the bot seems to have done several thousand, if not tens of thousands of edits during that time. And it would be very assuring to know that the possibility that this still can or will happen can be ruled out.
--[[de:user:Lax]] - [[Gebruiker:88.65.169.226|88.65.169.226]] 19 sep 2008 10:15 (CEST)
----------------------------------------------------------------------
>Comment By: NicDumZ Nicolas Dumazet (nicdumz)
Date: 2008-09-20 03:07
Message:
rciw.py for example *will* trigger this behavior quite often, sometimes
working on a version more than 10 hours old. I am not however, able to
confirm this on the standard interwiki.py
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2119685&group_…
Bugs item #2119685, was opened at 2008-09-19 18:53
Message generated for change (Tracker Item Submitted) made by Item Submitter
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2119685&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py does reverts
Initial Comment:
I got this message. As far as I know is this an old feature, that should be solved a long time ago.
At this moment I'm working with revision 5909. But I don't know with which version I did the reverts.
For the description of the feature see the message send by someones else that detected this feature.
Hello Carsrac,
I would like to draw your attention to these edits made by your bot: [http://de.wikipedia.org/w/index.php?title=Auge&diff=48157069&oldid=48020013 article de:Auge] and [http://la.wikipedia.org/w/index.php?title=The_Beatles&diff=562763&oldid=562… article la:The Beatles]. Obviously, the bot didn't edit the version that was at that time the current one, but an older one. That's equivalent to doing a revert. It seems that the bot edited the second last version that had been created by a bot. In these cases that meant a revert of [http://de.wikipedia.org/w/index.php?title=Auge&diff=48157069&oldid=47723213 two versions] of de:Auge and of [http://la.wikipedia.org/w/index.php?title=The_Beatles&diff=562763&oldid=551… 24 versions] of la:The Beatles.
How could that happen? Is there any reason to believe this didn't happen more often? I believe these are questions to be well considered since the bot seems to have done several thousand, if not tens of thousands of edits during that time. And it would be very assuring to know that the possibility that this still can or will happen can be ruled out.
--[[de:user:Lax]] - [[Gebruiker:88.65.169.226|88.65.169.226]] 19 sep 2008 10:15 (CEST)
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2119685&group_…