Bugs item #2765250, was opened at 2009-04-15 11:53
Message generated for change (Tracker Item Submitted) made by nobody
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2765250&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki goes over only one new file
Initial Comment:
Pywikipedia nightly:pywikipedia (r6605, Apr 14 2009, 16:55:58)
Python 2.5.1 (r251:54863, Jun 15 2008, 18:24:56)
[GCC 4.3.0 20080428 (Red Hat 4.3.0-8)]
command:
python interwiki.py -namespace:6 -new
runs only on one new file, not 100.
trying to specify other number (eg. -new:10) will also run on one and not according to the number specified.
doesn't occure on other namespaces.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2765250&group_…
Bugs item #2765231, was opened at 2009-04-15 13:43
Message generated for change (Tracker Item Submitted) made by xqt
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2765231&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: other
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: xqt (xqt)
Assigned to: Nobody/Anonymous (nobody)
Summary: Cosmetic_changes: Empty Selflink Error
Initial Comment:
__version__ = '$Id: cosmetic_changes.py 6285 2009-01-23 14:32:00Z siebrand $'
trunk/pywikipedia (r6602)
Python 2.5.2 r252:60911
Running interwiki.py with cosmetic_changes, wikipedia.Page raises an Error "Can't have an empty self-link". I found this error on the page [http://wuu.wikipedia.org/wiki/%E5%90%84%E5%8F%AA%E8%A8%80%E8%AF%9D%E7%BB%B4…] and I fixed the correspondig link [http://wuu.wikipedia.org/w/index.php?title=%E5%90%84%E5%8F%AA%E8%A8%80%E8%A…]. However it would be better to install an exception error handling for this matter.
File interwiki.py, line 1860 in (module) - bot.run()
File interwiki.py, line 1575 in run - self.queryStep()
File interwiki.py, line 1554 in queryStep - subj.finish(self)
File interwiki.py, line 1147 in finish - if self.replaceLinks(page, new, bot):
File interwiki.py, line 1290 in replaceLinks - status, reason, data = page.put(newtext, comment = wikipedia.translate(page.site().lang, msg)[0] + mods)
File wikipedia.py, line in put - newtext = ccToolkit.change(newtext)
File cosmetic_changes.py, line 106 in change - text = self.cleanUpLinks(text)
File cosmetic_changes.py, line 275 in cleanUpLinks - text = wikipedia.replaceExcept(text, linkR, handleOneLink, ['comment', 'math', 'nowiki', 'pre', 'startspace'])
File wikipedia.py, line in replaceExcept - replacement = new(match)
File cosmetic_changes.py, line 187 in handleOneLink - page = wikioedia.Page(self.sie, titleWithSection)
File wikipedia.py, line 407 in __init__ - raise Error("Can't have an empty self-link")
wikipedia.Error: Can't have an empty self-link
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2765231&group_…
Patches item #2762697, was opened at 2009-04-14 20:14
Message generated for change (Comment added) made by drtrigon
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Dr. Trigon (drtrigon)
Assigned to: Nobody/Anonymous (nobody)
Summary: Stability in wikipedia.py
Initial Comment:
Recently I've had some problems with the stability of 'wikipedia.put(...)' sometimes this method had some issues and that killed my bot.
I was able to track the problem down to 'wikipedia._getEditPage(...)' and following code (in 'wikipedia.py' around line 725):
********************************
while not textareaFound:
text = self.site().getUrl(path, sysop = sysop)
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I have changed it that way, to hold my bot/script running:
********************************
while not textareaFound:
try:
text = self.site().getUrl(path, sysop = sysop)
except:
time.sleep(1)
continue
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I am "pretty" sure that this solved my problem. :)
Probably you are also intressted in this solution?! I would assume that the delay of 1sec is neither critical nor needed.
Greetings
DrTrigon
----------------------------------------------------------------------
Comment By: Dr. Trigon (drtrigon)
Date: 2009-04-15 11:21
Message:
...I could add some code to print the exception the next time, my bot is
down...?!
----------------------------------------------------------------------
Comment By: Dr. Trigon (drtrigon)
Date: 2009-04-15 11:19
Message:
Hello back!
I have to apologize because I don't have the error message anymore (I had
it once...) and the error is a bit hard to reproduce, since it is not
thrown very often... :(
You are right; my solution is a kind of "brute-force"... :) Yesterday,
after my first postings, I had a look into 'getUrl', since I was
remembering that it should catch (and did this in the past accordingly)
such kind of problems. What was strange; the error I had occurred
instantaneously after calling 'getUrl', without any time delay... And it
was (most of the time) on the toolserver, which might have another kind of
internet connection and therefore another failure behaviour (and throw
other exceptions)...?!
----------------------------------------------------------------------
Comment By: NicDumZ — Nicolas Dumazet (nicdumz)
Date: 2009-04-14 20:17
Message:
Hello !
Are you able to elaborate on what error was raised? There is probably a
nicer way to catch the error, at a lower level, instead of bluntly retrying
on error =)
----------------------------------------------------------------------
Comment By: Dr. Trigon (drtrigon)
Date: 2009-04-14 20:15
Message:
Sorry was NOT 'wikipedia.put(...)' was 'wikipedia.get(...)' !
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…
Patches item #2762697, was opened at 2009-04-14 20:14
Message generated for change (Comment added) made by drtrigon
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Dr. Trigon (drtrigon)
Assigned to: Nobody/Anonymous (nobody)
Summary: Stability in wikipedia.py
Initial Comment:
Recently I've had some problems with the stability of 'wikipedia.put(...)' sometimes this method had some issues and that killed my bot.
I was able to track the problem down to 'wikipedia._getEditPage(...)' and following code (in 'wikipedia.py' around line 725):
********************************
while not textareaFound:
text = self.site().getUrl(path, sysop = sysop)
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I have changed it that way, to hold my bot/script running:
********************************
while not textareaFound:
try:
text = self.site().getUrl(path, sysop = sysop)
except:
time.sleep(1)
continue
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I am "pretty" sure that this solved my problem. :)
Probably you are also intressted in this solution?! I would assume that the delay of 1sec is neither critical nor needed.
Greetings
DrTrigon
----------------------------------------------------------------------
Comment By: Dr. Trigon (drtrigon)
Date: 2009-04-15 11:19
Message:
Hello back!
I have to apologize because I don't have the error message anymore (I had
it once...) and the error is a bit hard to reproduce, since it is not
thrown very often... :(
You are right; my solution is a kind of "brute-force"... :) Yesterday,
after my first postings, I had a look into 'getUrl', since I was
remembering that it should catch (and did this in the past accordingly)
such kind of problems. What was strange; the error I had occurred
instantaneously after calling 'getUrl', without any time delay... And it
was (most of the time) on the toolserver, which might have another kind of
internet connection and therefore another failure behaviour (and throw
other exceptions)...?!
----------------------------------------------------------------------
Comment By: NicDumZ — Nicolas Dumazet (nicdumz)
Date: 2009-04-14 20:17
Message:
Hello !
Are you able to elaborate on what error was raised? There is probably a
nicer way to catch the error, at a lower level, instead of bluntly retrying
on error =)
----------------------------------------------------------------------
Comment By: Dr. Trigon (drtrigon)
Date: 2009-04-14 20:15
Message:
Sorry was NOT 'wikipedia.put(...)' was 'wikipedia.get(...)' !
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…
Patches item #2762911, was opened at 2009-04-14 21:35
Message generated for change (Tracker Item Submitted) made by crochet_david
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762911&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Translations
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: David Crochet (crochet_david)
Assigned to: Nobody/Anonymous (nobody)
Summary: add some fr message
Initial Comment:
Some french message adding
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762911&group_…
Bugs item #1908157, was opened at 2008-03-05 18:08
Message generated for change (Comment added) made by cosoleto
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1908157&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Closed
Resolution: Wont Fix
Priority: 7
Private: No
Submitted By: AndreasJS (andreasjs)
Assigned to: Nobody/Anonymous (nobody)
Summary: Cannot edit large page in Python 2.5
Initial Comment:
Cannot edit large page in Python 2.5.
A socket error 35 occurs. It consistently occurs if the page is > about 30 kbyte.
Woks OK in python 2.3.
andreas-schwabs-computer:~/Desktop/pywikipedia andreas$ python basic.py -family:wikipedia -lang:en -page:User:AndreasJS/test
Checked for running processes. 1 processes currently running, including the current process.
Getting 1 pages from wikipedia:en...
>>> User:AndreasJS/test <<<
- Test Test [[image:Wikipedia.png|thumb|This is the [[logo]] of Wikinews]]
+ Test Test Test [[image:Wikipedia.png|thumb|This is the [[logo]] of Wikinews]]
Do you want to accept these changes? ([y]es, [N]o) y
Sleeping for 5.6 seconds, 2008-03-05 11:57:19
Changing page [[en:User:AndreasJS/test]]
Traceback (most recent call last):
File "/Users/andreas/Desktop/pywikipedia/wikipedia.py", line 1287, in _putPage
response, data = self.site().postForm(address, predata, sysop)
File "/Users/andreas/Desktop/pywikipedia/wikipedia.py", line 4014, in postForm
raise ServerError(e)
ServerError: (35, 'Resource temporarily unavailable')
Got a server error when putting [[User:AndreasJS/test]]; will retry in 1 minute.
Changing page [[en:User:AndreasJS/test]]
Traceback (most recent call last):
File "/Users/andreas/Desktop/pywikipedia/wikipedia.py", line 1287, in _putPage
response, data = self.site().postForm(address, predata, sysop)
File "/Users/andreas/Desktop/pywikipedia/wikipedia.py", line 4014, in postForm
raise ServerError(e)
ServerError: (35, 'Resource temporarily unavailable')
Got a server error when putting [[User:AndreasJS/test]]; will retry in 2 minutes.
Changing page [[en:User:AndreasJS/test]]
Traceback (most recent call last):
File "/Users/andreas/Desktop/pywikipedia/wikipedia.py", line 1287, in _putPage
response, data = self.site().postForm(address, predata, sysop)
File "/Users/andreas/Desktop/pywikipedia/wikipedia.py", line 4014, in postForm
raise ServerError(e)
ServerError: (35, 'Resource temporarily unavailable')
Got a server error when putting [[User:AndreasJS/test]]; will retry in 4 minutes.
----------
andreas-schwabs-computer:~/Desktop/pywikipedia andreas$ python
Python 2.5 (r25:51918, Sep 19 2006, 08:49:13)
[GCC 4.0.1 (Apple Computer, Inc. build 5341)] on darwin
System Software Overview:
System Version: Mac OS X 10.4.11 (8S2167)
Kernel Version: Darwin 8.11.1
Boot Volume: Macintosh HD
Computer Name: Andreas Schwab’s Computer
User Name: Andreas Schwab (andreas)
----------------------------------------------------------------------
>Comment By: Francesco Cosoleto (cosoleto)
Date: 2009-04-14 20:36
Message:
You bring good news. It's ok for me too.
----------------------------------------------------------------------
Comment By: NicDumZ — Nicolas Dumazet (nicdumz)
Date: 2009-04-14 19:57
Message:
See https://trac.macports.org/ticket/18376 the issue has been fixed in all
python ports except python25. I wont spend time coding a high-level
workaround for a lower-level issue, knowing that the said low-level bug is
going to be fixed in no more than a couple of weeks.
But again, that's only me :)
http://bugs.python.org/issue5154 is the relevant Python issue
----------------------------------------------------------------------
Comment By: Francesco Cosoleto (cosoleto)
Date: 2009-04-14 18:54
Message:
I really want see this fixed as possible, avoiding problems to users. We
can add a simple workaround based on O.S. type and Python version, for
example (in case, just print a warning of a missing feature). Another
possible solution is to add support for the cURL library and recommend it
in the installation instruction, that is very useful to resolve easily also
others very ugly and high priority problems with the current PyWikipediaBot
network code...
----------------------------------------------------------------------
Comment By: NicDumZ — Nicolas Dumazet (nicdumz)
Date: 2009-04-14 18:25
Message:
1) using socket_timeout = None in your user-config.py should "fix" the
issue on pywikipedia.
") If you want to fix more durably the issue, please follow the
instructions on the last post of http://www.cherrypy.org/ticket/598
(bottom). It involves customizing the Python build under MacOS to avoid
defining the HAVE_POLL constant.
3) The fix applied by cherrypy here (
http://www.cherrypy.org/changeset/1915 ) is not applicable for pywikipedia:
they basically re-implement a complete new socket file descriptors to use
non-blocking socket calls, to avoid calling the broken poll() of MacOS.
Clearly, we're not going to do this here
I'm closing this as Wont Fix because it is a python+MacOS issue, and that
fixing the issue on the Python side is more relevant than implement complex
structures in pywikipedia to overcome that Python issue.
Comments are left open purposely.
----------------------------------------------------------------------
Comment By: Francesco Cosoleto (cosoleto)
Date: 2009-04-10 00:35
Message:
What about latest Python version (2.6.1)?
Doesn't look as reported to Python issue tracker, though.
----------------------------------------------------------------------
Comment By: Pietrodn (pietrodn)
Date: 2008-04-18 17:29
Message:
Logged In: YES
user_id=1887175
Originator: NO
I have the same problem (and use Mac OS X 10.5.2).
----------------------------------------------------------------------
Comment By: AndreasJS (andreasjs)
Date: 2008-03-10 02:15
Message:
Logged In: YES
user_id=1738850
Originator: YES
There is a much easier solution:
Add the following line to user-config.py:
socket_timeout = None
Note: Apparently, the socket timeout is broken in the combination python
2.5 and MacOS 10.4. If socket_timeout is set to any number, error 35 occurs
when putting pages larger than ca. 30 kb.
----------------------------------------------------------------------
Comment By: AndreasJS (andreasjs)
Date: 2008-03-10 00:27
Message:
Logged In: YES
user_id=1738850
Originator: YES
After reading the following thread:
http://www.cherrypy.org/ticket/598
I came up with the following solution:
conn.endheaders()
if hasattr(conn.sock, 'setblocking'): #####
conn.sock.setblocking(1) ######
conn.send(data)
I am not 100% sure if this is safe, but maybe someone socket-savvy can
find out by reading the above thread.
----------------------------------------------------------------------
Comment By: Nobody/Anonymous (nobody)
Date: 2008-03-08 23:19
Message:
Logged In: NO
Sitll doesn't work:
Python 2.5.2 (r252:60911, Feb 22 2008, 07:57:53)
[GCC 4.0.1 (Apple Computer, Inc. build 5363)] on darwin
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2008-03-08 21:53
Message:
Logged In: YES
user_id=687283
Originator: NO
This probably is a bug in an updated version of urllib2 in python2.5+.
Could you try updating your python install and see if the problem remains?
----------------------------------------------------------------------
Comment By: Pietrodn (pietrodn)
Date: 2008-03-05 21:51
Message:
Logged In: YES
user_id=1887175
Originator: NO
I also have Mac OS X 10.4.11 + Python 2.5 and have the same problem.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1908157&group_…
Patches item #2762697, was opened at 2009-04-14 20:14
Message generated for change (Comment added) made by nicdumz
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Dr. Trigon (drtrigon)
Assigned to: Nobody/Anonymous (nobody)
Summary: Stability in wikipedia.py
Initial Comment:
Recently I've had some problems with the stability of 'wikipedia.put(...)' sometimes this method had some issues and that killed my bot.
I was able to track the problem down to 'wikipedia._getEditPage(...)' and following code (in 'wikipedia.py' around line 725):
********************************
while not textareaFound:
text = self.site().getUrl(path, sysop = sysop)
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I have changed it that way, to hold my bot/script running:
********************************
while not textareaFound:
try:
text = self.site().getUrl(path, sysop = sysop)
except:
time.sleep(1)
continue
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I am "pretty" sure that this solved my problem. :)
Probably you are also intressted in this solution?! I would assume that the delay of 1sec is neither critical nor needed.
Greetings
DrTrigon
----------------------------------------------------------------------
>Comment By: NicDumZ — Nicolas Dumazet (nicdumz)
Date: 2009-04-14 20:17
Message:
Hello !
Are you able to elaborate on what error was raised? There is probably a
nicer way to catch the error, at a lower level, instead of bluntly retrying
on error =)
----------------------------------------------------------------------
Comment By: Dr. Trigon (drtrigon)
Date: 2009-04-14 20:15
Message:
Sorry was NOT 'wikipedia.put(...)' was 'wikipedia.get(...)' !
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…
Patches item #2762697, was opened at 2009-04-14 20:14
Message generated for change (Comment added) made by drtrigon
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Dr. Trigon (drtrigon)
Assigned to: Nobody/Anonymous (nobody)
Summary: Stability in wikipedia.py
Initial Comment:
Recently I've had some problems with the stability of 'wikipedia.put(...)' sometimes this method had some issues and that killed my bot.
I was able to track the problem down to 'wikipedia._getEditPage(...)' and following code (in 'wikipedia.py' around line 725):
********************************
while not textareaFound:
text = self.site().getUrl(path, sysop = sysop)
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I have changed it that way, to hold my bot/script running:
********************************
while not textareaFound:
try:
text = self.site().getUrl(path, sysop = sysop)
except:
time.sleep(1)
continue
if text.find("<title>Wiki does not exist</title>") != -1:
raise NoSuchSite(u'Wiki %s does not exist yet' % self.site())
********************************
and I am "pretty" sure that this solved my problem. :)
Probably you are also intressted in this solution?! I would assume that the delay of 1sec is neither critical nor needed.
Greetings
DrTrigon
----------------------------------------------------------------------
>Comment By: Dr. Trigon (drtrigon)
Date: 2009-04-14 20:15
Message:
Sorry was NOT 'wikipedia.put(...)' was 'wikipedia.get(...)' !
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2762697&group_…