pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

[Pywikipedia-l] SVN: [4875] trunk/pywikipedia/wikipedia.py
by rotem＠svn.wikimedia.org 13 Jan '08

13 Jan '08

Revision: 4875 Author: rotem Date: 2008-01-13 18:21:45 +0000 (Sun, 13 Jan 2008) Log Message: ----------- (bug 1869983) Catch ServerError exceptions in Page.put. Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-01-13 18:15:26 UTC (rev 4874) +++ trunk/pywikipedia/wikipedia.py 2008-01-13 18:21:45 UTC (rev 4875) @@ -1270,6 +1270,14 @@ response, data = self.site().postForm(address, predata, sysop) except httplib.BadStatusLine, line: raise PageNotSaved('Bad status line: %s' % line.line) + except ServerError: + output(u''.join(traceback.format_exception(*sys.exc_info()))) + output(u'Got a server error when putting; will retry in %i minutes.' % retry_delay) + time.sleep(60 * retry_delay) + retry_delay *= 2 + if retry_delay > 30: + retry_delay = 30 + continue if data != u'': # Saving unsuccessful. Possible reasons: # server lag, edit conflict or invalid edit token.

2 2

[Pywikipedia-l] SVN: [4878] trunk/pywikipedia/commonsdelinker/delinker.py
by btongminh＠svn.wikimedia.org 13 Jan '08

13 Jan '08

Revision: 4878 Author: btongminh Date: 2008-01-13 20:38:31 +0000 (Sun, 13 Jan 2008) Log Message: ----------- Handle user blocks Modified Paths: -------------- trunk/pywikipedia/commonsdelinker/delinker.py Modified: trunk/pywikipedia/commonsdelinker/delinker.py =================================================================== --- trunk/pywikipedia/commonsdelinker/delinker.py 2008-01-13 20:37:07 UTC (rev 4877) +++ trunk/pywikipedia/commonsdelinker/delinker.py 2008-01-13 20:38:31 UTC (rev 4878) @@ -129,6 +129,8 @@ try: try: result = self.replace_image(image, site, title, summary, replacement) + except wikipedia.UserBlocked, e: + output(u'Warning! Blocked on %s by %s.' % (e[0], e[1])) except wikipedia.CaptchaError, e: output(u'%s Warning! Captcha encountered at %s.' % (self, site)) if (lang, family) not in skipped_images: @@ -153,6 +155,7 @@ if skipped_images: time.sleep(self.CommonsDelinker.config['timeout']) + output(u'Delinking from previously skipped page for %s.' % image) return self.delink_image(image, skipped_images, timestamp, admin, reason, replacement) elif replacement: # Let them know that we are done replacing.

1 0

[Pywikipedia-l] SVN: [4877] trunk/pywikipedia/wikipedia.py
by btongminh＠svn.wikimedia.org 13 Jan '08

13 Jan '08

Revision: 4877 Author: btongminh Date: 2008-01-13 20:37:07 +0000 (Sun, 13 Jan 2008) Log Message: ----------- wpEditToken is explicitly added as last value during urlEncoding. If a premature connection abort occurs while putting, the server will not have received an edit token and thus refuse saving the page. Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-01-13 18:44:01 UTC (rev 4876) +++ trunk/pywikipedia/wikipedia.py 2008-01-13 20:37:07 UTC (rev 4877) @@ -3816,6 +3816,7 @@ else: iterator = iter(query) l = [] + wpEditToken = None for key, value in iterator: if isinstance(key, unicode): key = key.encode('utf-8') @@ -3823,7 +3824,16 @@ value = value.encode('utf-8') key = urllib.quote(key) value = urllib.quote(value) + if key == 'wpEditToken': + wpEditToken = value + continue l.append(key + '=' + value) + + # wpEditToken is explicitly added as last value. + # If a premature connection abort occurs while putting, the server will + # not have received an edit token and thus refuse saving the page + if wpEditToken != None: + l.append('wpEditToken=' + wpEditToken) return '&'.join(l) def postForm(self, address, predata, sysop=False, useCookie=True):

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1870239 ] pagegenerators::_Preloader UniCodeDecodeError & hangs
by SourceForge.net 13 Jan '08

13 Jan '08

Bugs item #1870239, was opened at 2008-01-13 10:02 Message generated for change (Comment added) made by nicdumz You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870239&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nicolas Dumazet (nicdumz) Assigned to: Nobody/Anonymous (nobody) Summary: pagegenerators::_Preloader UniCodeDecodeError & hangs Initial Comment: >From a simple replace.py call : Checked for running processes. 1 processes currently running, including the current process. Exception in thread Preloader-Thread: Traceback (most recent call last): File "threading.py", line 460, in __bootstrap self.run() File "/home/nico/projets/pywikipedia/pagegenerators.py", line 633, in run wikipedia.output(unicode(e)) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 28: ordinal not in range(128) The process then hangs and has to be SIGSTP'ed. Thanks :) Nicolas Dumazet. ---------------------------------------------------------------------- >Comment By: Nicolas Dumazet (nicdumz) Date: 2008-01-13 20:03 Message: Logged In: YES user_id=1963242 Originator: YES very strange. I am running the last revision, python 2.5.1 on an ubuntu system, for what it's worth. I tried this on another system, an unix server running python 2.3.4, and I get the normal behavior : [Errno 2] No such file or directory: 'gdfg' ?!!? ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 19:51 Message: Logged In: YES user_id=1327030 Originator: NO Executing this, I get: Checked for running processes. 1 processes currently running, including the current process. [Errno 2] No such file or directory: u'gdfg' ---------------------------------------------------------------------- Comment By: Nicolas Dumazet (nicdumz) Date: 2008-01-13 19:47 Message: Logged In: YES user_id=1963242 Originator: YES well, I also work on an Unix system. 'python replace.py -file:gdfg "a" "b"' will raise the wanted exception :) ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 19:25 Message: Logged In: YES user_id=1327030 Originator: NO What was the exact command? I get the following exception when executing "python pagegenerators.py -file:gdfg.txt": Checked for running processes. 1 processes currently running, including the current process. Traceback (most recent call last): File "pagegenerators.py", line 827, in <module> for page in gen: File "pagegenerators.py", line 538, in DuplicateFilterPageGenerator for page in generator: File "pagegenerators.py", line 279, in TextfilePageGenerator f = codecs.open(filename, 'r', config.textfile_encoding) File "/usr/lib/python2.5/codecs.py", line 791, in open file = __builtin__.open(filename, mode, buffering) IOError: [Errno 2] No such file or directory: u'gdfg.txt' which is OK. Note that I use Linux, does it work differently on a Windows system? ---------------------------------------------------------------------- Comment By: Nicolas Dumazet (nicdumz) Date: 2008-01-13 10:07 Message: Logged In: YES user_id=1963242 Originator: YES ... I forgot an important point : The call was made with a -file:fileNameWithATypoHenceNotExisting parameter :) Cheers, Nicolas Dumazet. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870239&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1870239 ] pagegenerators::_Preloader UniCodeDecodeError & hangs
by SourceForge.net 13 Jan '08

13 Jan '08

Bugs item #1870239, was opened at 2008-01-13 11:02 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870239&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nicolas Dumazet (nicdumz) Assigned to: Nobody/Anonymous (nobody) Summary: pagegenerators::_Preloader UniCodeDecodeError & hangs Initial Comment: >From a simple replace.py call : Checked for running processes. 1 processes currently running, including the current process. Exception in thread Preloader-Thread: Traceback (most recent call last): File "threading.py", line 460, in __bootstrap self.run() File "/home/nico/projets/pywikipedia/pagegenerators.py", line 633, in run wikipedia.output(unicode(e)) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 28: ordinal not in range(128) The process then hangs and has to be SIGSTP'ed. Thanks :) Nicolas Dumazet. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 20:51 Message: Logged In: YES user_id=1327030 Originator: NO Executing this, I get: Checked for running processes. 1 processes currently running, including the current process. [Errno 2] No such file or directory: u'gdfg' ---------------------------------------------------------------------- Comment By: Nicolas Dumazet (nicdumz) Date: 2008-01-13 20:47 Message: Logged In: YES user_id=1963242 Originator: YES well, I also work on an Unix system. 'python replace.py -file:gdfg "a" "b"' will raise the wanted exception :) ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 20:25 Message: Logged In: YES user_id=1327030 Originator: NO What was the exact command? I get the following exception when executing "python pagegenerators.py -file:gdfg.txt": Checked for running processes. 1 processes currently running, including the current process. Traceback (most recent call last): File "pagegenerators.py", line 827, in <module> for page in gen: File "pagegenerators.py", line 538, in DuplicateFilterPageGenerator for page in generator: File "pagegenerators.py", line 279, in TextfilePageGenerator f = codecs.open(filename, 'r', config.textfile_encoding) File "/usr/lib/python2.5/codecs.py", line 791, in open file = __builtin__.open(filename, mode, buffering) IOError: [Errno 2] No such file or directory: u'gdfg.txt' which is OK. Note that I use Linux, does it work differently on a Windows system? ---------------------------------------------------------------------- Comment By: Nicolas Dumazet (nicdumz) Date: 2008-01-13 11:07 Message: Logged In: YES user_id=1963242 Originator: YES ... I forgot an important point : The call was made with a -file:fileNameWithATypoHenceNotExisting parameter :) Cheers, Nicolas Dumazet. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870239&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1870323 ] interwiki.py remove the category link in zhwiki
by SourceForge.net 13 Jan '08

13 Jan '08

Bugs item #1870323, was opened at 2008-01-13 15:17 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870323&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Alex S.H. Lin (lin4h) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki.py remove the category link in zhwiki Initial Comment: from this revision. http://zh.wikipedia.org/w/index.php?title=Hunter_%C3%97_Hunter&diff=6015464… The console commsnd is : interwiki.py -lang:ja Hunter_%C3%97_Hunter (check interwiki from jawiki,bu I have no idea why it remove the category link automatically ) ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 20:48 Message: Logged In: YES user_id=1327030 Originator: NO I guess you have cosmetic changes enabled and your default language is zh (or you enable cosmetic changes for all languages). If so, this is the same as bug 1863432 and was fixed in r4874. Make sure you check all your bot's previous changes that did cosmetic changes. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870323&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1870239 ] pagegenerators::_Preloader UniCodeDecodeError & hangs
by SourceForge.net 13 Jan '08

13 Jan '08

Bugs item #1870239, was opened at 2008-01-13 10:02 Message generated for change (Comment added) made by nicdumz You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870239&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nicolas Dumazet (nicdumz) Assigned to: Nobody/Anonymous (nobody) Summary: pagegenerators::_Preloader UniCodeDecodeError & hangs Initial Comment: >From a simple replace.py call : Checked for running processes. 1 processes currently running, including the current process. Exception in thread Preloader-Thread: Traceback (most recent call last): File "threading.py", line 460, in __bootstrap self.run() File "/home/nico/projets/pywikipedia/pagegenerators.py", line 633, in run wikipedia.output(unicode(e)) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 28: ordinal not in range(128) The process then hangs and has to be SIGSTP'ed. Thanks :) Nicolas Dumazet. ---------------------------------------------------------------------- >Comment By: Nicolas Dumazet (nicdumz) Date: 2008-01-13 19:47 Message: Logged In: YES user_id=1963242 Originator: YES well, I also work on an Unix system. 'python replace.py -file:gdfg "a" "b"' will raise the wanted exception :) ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 19:25 Message: Logged In: YES user_id=1327030 Originator: NO What was the exact command? I get the following exception when executing "python pagegenerators.py -file:gdfg.txt": Checked for running processes. 1 processes currently running, including the current process. Traceback (most recent call last): File "pagegenerators.py", line 827, in <module> for page in gen: File "pagegenerators.py", line 538, in DuplicateFilterPageGenerator for page in generator: File "pagegenerators.py", line 279, in TextfilePageGenerator f = codecs.open(filename, 'r', config.textfile_encoding) File "/usr/lib/python2.5/codecs.py", line 791, in open file = __builtin__.open(filename, mode, buffering) IOError: [Errno 2] No such file or directory: u'gdfg.txt' which is OK. Note that I use Linux, does it work differently on a Windows system? ---------------------------------------------------------------------- Comment By: Nicolas Dumazet (nicdumz) Date: 2008-01-13 10:07 Message: Logged In: YES user_id=1963242 Originator: YES ... I forgot an important point : The call was made with a -file:fileNameWithATypoHenceNotExisting parameter :) Cheers, Nicolas Dumazet. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870239&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1870285 ] ru-sib: links should be silently removed
by SourceForge.net 13 Jan '08

13 Jan '08

Bugs item #1870285, was opened at 2008-01-13 13:20 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870285&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Marc-Etienne Vargenau (vargenau) Assigned to: Nobody/Anonymous (nobody) Summary: ru-sib: links should be silently removed Initial Comment: Hello, The ru-sib: wiki is now closed and deleted. The bot should automatically delete the ru-sib: links. They are now moved on top because they are not recognized as an interwiki. http://zea.wikipedia.org/w/index.php?title=1005&diff=prev&oldid=7790 Thank you for correcting this. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 20:44 Message: Logged In: YES user_id=1327030 Originator: NO Fixed in r4876. ru-sib: links are now recognized as interwiki links. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1870285&group_…

1 0

[Pywikipedia-l] SVN: [4876] trunk/pywikipedia/wikipedia.py
by rotem＠svn.wikimedia.org 13 Jan '08

13 Jan '08

Revision: 4876 Author: rotem Date: 2008-01-13 18:44:01 +0000 (Sun, 13 Jan 2008) Log Message: ----------- (bug 1870285) The bot should recognize links to obsolete languages that are no longer listed in the valid languages as interwiki links, and match them when removing the language links. Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-01-13 18:21:45 UTC (rev 4875) +++ trunk/pywikipedia/wikipedia.py 2008-01-13 18:44:01 UTC (rev 4876) @@ -3046,7 +3046,9 @@ return text # This regular expression will find every interwiki link, plus trailing # whitespace. - languageR = '|'.join(site.validLanguageLinks()) + validLinks = site.validLanguageLinks() + validLinks.extend(site.family.obsolete.keys()) + languageR = '|'.join(validLinks) interwikiR = re.compile(r'\[\[(%s)\s?:[^\]]*\]\][\s]*' % languageR, re.IGNORECASE) text = replaceExcept(text, interwikiR, '',

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1868451 ] checkimages.py's bugs
by SourceForge.net 13 Jan '08

13 Jan '08

Bugs item #1868451, was opened at 2008-01-10 13:45 Message generated for change (Comment added) made by filnik You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1868451&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed Resolution: None Priority: 5 Private: No Submitted By: Alex S.H. Lin (lin4h) Assigned to: Filnik (filnik) Summary: checkimages.py's bugs Initial Comment: Traceback (most recent call last): File "D:\My Documents\SOURCE\mwbot\pywikipedia\checkimages.py", line 962, in < module> wikipedia.output(u"Waiting for %s seconds, %s" % (time_sleep, time.strftime( "%d %b %Y %H:%M:%S (UTC)", time.localtime()))) UnicodeDecodeError: 'ascii' codec can't decode byte 0xa4 in position 3: ordinal not in range(128) Checking project is jawiki. And I just run this script is zhwiki, when it add a notice to uploader, it add ":" in the section.(http://zh.wikipedia.org/w/index.php?title=User_talk%3AAccler&diff=… ---------------------------------------------------------------------- >Comment By: Filnik (filnik) Date: 2008-01-13 18:28 Message: Logged In: YES user_id=1834469 Originator: NO It was compatible only to python 2.5. I've changed it so you can use it also with 2.4 (and older versions). Bug closed ;-) Bye, Filnik. ---------------------------------------------------------------------- Comment By: Alex S.H. Lin (lin4h) Date: 2008-01-13 15:41 Message: Logged In: YES user_id=1902991 Originator: YES Wait...I update the code to a remote server (use FreeBSD, python 2.4.4), and it returen a Syntax Error. >python checkimages.py File "checkimages.py", line 1009 finally: ^ SyntaxError: invalid syntax But it's not return any error in my Windows OS. ---------------------------------------------------------------------- Comment By: Alex S.H. Lin (lin4h) Date: 2008-01-13 15:28 Message: Logged In: YES user_id=1902991 Originator: YES Checked, It's work!. ---------------------------------------------------------------------- Comment By: Filnik (filnik) Date: 2008-01-13 14:54 Message: Logged In: YES user_id=1834469 Originator: NO Ok, Patch applied. I hope that know it works ;-) (if yes, write here that I close the bug). Filnik ---------------------------------------------------------------------- Comment By: Alex S.H. Lin (lin4h) Date: 2008-01-13 14:38 Message: Logged In: YES user_id=1902991 Originator: YES Orz... Now the new bug is time string after check images. Hsuhaojen.jpg seems ok, 'ascii' codec can't decode byte 0xa4 in position 3: ordinal not in range(128) And... I just copy the code from welcome.py and make a patch before your commit. I think the UnicodeDecodeError is my fault because I use Windows XP Chinese Edition.From line 289 in r4864 , the month name %b will read chinese month name (now is 一月), it is big5.so my OS cannot decode it by utf-8 File Added: checkimages.py.patch ---------------------------------------------------------------------- Comment By: Filnik (filnik) Date: 2008-01-13 14:13 Message: Logged In: YES user_id=1834469 Originator: NO Now it should be fixed. By the way: The first bug is fixed (I've made the Bot print the error but it won't crash) and the second is not my fault (it's the standard function to get the HTML's text and it write the errors but don't crash too). So it should work although it report these errors. Can you please confirm? Filnik. P.S. I've a bit rewritten it so maybe the first bug is totally solved and a few other feature should work a bit better. ---------------------------------------------------------------------- Comment By: Filnik (filnik) Date: 2008-01-13 14:12 Message: Logged In: YES user_id=1834469 Originator: NO Now it should be fixed. By the way: The first bug is fixed (I've made the Bot print the error but it won't crash) and the second is not my fault (it's the standard function to get the HTML's text and it write the errors but don't crash too). So it should work although it report these errors. Can you please confirm? Filnik. P.S. I've a bit rewritten it so maybe the first bug is totally solved and a few other feature should work a bit better. ---------------------------------------------------------------------- Comment By: Alex S.H. Lin (lin4h) Date: 2008-01-13 13:54 Message: Logged In: YES user_id=1902991 Originator: YES It not solve the bug, and I think you forget to write the variable to line 967, it return: 'utf8' codec can't decode byte 0xa4 in position 3: unexpected code byte Waiting for %s seconds And line 796 has the same problem, too.It return error: 'utf8' codec can't decode bytes in position 52871-52873: invalid data ERROR: Invalid characters found on http://zh.wikipedia.org/w/index.php?title=Spe cial:Log&type=upload&user=&page=&limit=80, replaced by \ufffd. ---------------------------------------------------------------------- Comment By: Filnik (filnik) Date: 2008-01-12 12:23 Message: Logged In: YES user_id=1834469 Originator: NO http://botwiki.sno.cc/w/index.php?title=Python%3ACheckimages.py&diff=4652&o… <-- Fixed in this update (the new version is also in the svn system, you it to update ;-)). Not sure for the encoding issue, but it should work (please test it better on your pc. Sometimes there's difference between Linux and Windows..) Filnik ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1868451&group_…

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot