Pywikipedia-l July 2008

pywikipedia-l@lists.wikimedia.org

29 participants
197 discussions

SVN: [5761] branches/rewrite/pywikibot/data/api.py

by nicdumz＠svn.wikimedia.org

Revision: 5761 Author: nicdumz Date: 2008-07-26 08:36:01 +0000 (Sat, 26 Jul 2008) Log Message: ----------- Decode rawdata if not unicode Modified Paths: -------------- branches/rewrite/pywikibot/data/api.py Modified: branches/rewrite/pywikibot/data/api.py =================================================================== --- branches/rewrite/pywikibot/data/api.py 2008-07-25 22:59:42 UTC (rev 5760) +++ branches/rewrite/pywikibot/data/api.py 2008-07-26 08:36:01 UTC (rev 5761) @@ -183,12 +183,13 @@ else: uri = uri + "?" + params rawdata = http.request(self.site, uri) - rawdata = rawdata.decode(self.site.encoding()) except Exception, e: #TODO: what exceptions can occur here? logger.warning(traceback.format_exc()) print uri, params self.wait() continue + if not isinstance(rawdata, unicode): + rawdata = rawdata.decode(self.site.encoding) if rawdata.startswith(u"unknown_action"): raise APIError(rawdata[:14], rawdata[16:]) try:

15 years, 9 months

[ pywikipediabot-Bugs-1641431 ] crash on warnfile.py

by SourceForge.net

Bugs item #1641431, was opened at 2007-01-22 09:54 Message generated for change (Comment added) made by sf-robot You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1641431&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None >Status: Closed Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: crash on warnfile.py Initial Comment: splitwarning.py <all generated ok> warnfile.py -lang:ca Checked for running processes. 1 processes currently running, including the curr ent process. Parsing warnfile... Fixing... 22 pages Getting page [[Categoria:1250]] Traceback (most recent call last): File "warnfile.py", line 121, in ? main() File "warnfile.py", line 117, in main bot.run() File "warnfile.py", line 94, in run mods, removing = interwiki.compareLanguages(old, new, insite = page.site()) ValueError: too many values to unpack ---------------------------------------------------------------------- >Comment By: SourceForge Robot (sf-robot) Date: 2008-07-26 02:20 Message: Logged In: YES user_id=1312539 Originator: NO This Tracker item was closed automatically by the system. It was previously set to a Pending status, and the original submitter did not respond within 14 days (the time period specified by the administrator of this Tracker). ---------------------------------------------------------------------- Comment By: Russell Blau (russblau) Date: 2008-07-11 21:05 Message: Logged In: YES user_id=855050 Originator: NO Does this report still need attention? Please update or the bug will be closed automatically after 30 days. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1641431&group_…

15 years, 9 months

SVN: [5760] branches/rewrite/pywikibot/data/api.py

by nicdumz＠svn.wikimedia.org

Revision: 5760 Author: nicdumz Date: 2008-07-25 22:59:42 +0000 (Fri, 25 Jul 2008) Log Message: ----------- Prevent UnicodeDecodeError :) Modified Paths: -------------- branches/rewrite/pywikibot/data/api.py Modified: branches/rewrite/pywikibot/data/api.py =================================================================== --- branches/rewrite/pywikibot/data/api.py 2008-07-25 18:11:07 UTC (rev 5759) +++ branches/rewrite/pywikibot/data/api.py 2008-07-25 22:59:42 UTC (rev 5760) @@ -183,6 +183,7 @@ else: uri = uri + "?" + params rawdata = http.request(self.site, uri) + rawdata = rawdata.decode(self.site.encoding()) except Exception, e: #TODO: what exceptions can occur here? logger.warning(traceback.format_exc()) print uri, params

15 years, 9 months

SVN: [5759] trunk/pywikipedia/archivebot.py

by misza13＠svn.wikimedia.org

Revision: 5759 Author: misza13 Date: 2008-07-25 18:11:07 +0000 (Fri, 25 Jul 2008) Log Message: ----------- bail out immediately when {{nobots}} prevents from editing Modified Paths: -------------- trunk/pywikipedia/archivebot.py Modified: trunk/pywikipedia/archivebot.py =================================================================== --- trunk/pywikipedia/archivebot.py 2008-07-25 08:43:25 UTC (rev 5758) +++ trunk/pywikipedia/archivebot.py 2008-07-25 18:11:07 UTC (rev 5759) @@ -429,6 +429,8 @@ return set(whys) def run(self): + if not self.Page.Page.botMayEdit(Site.username): + return whys = self.analyzePage() if self.archivedThreads < int(self.get('minthreadstoarchive',2)): return #We might not want to archive a measly few threads (lowers edit frequency)

15 years, 9 months

SVN: [5757] trunk/pywikipedia/families/wikipedia_family.py

by nicdumz＠svn.wikimedia.org

Revision: 5757 Author: nicdumz Date: 2008-07-24 19:52:06 +0000 (Thu, 24 Jul 2008) Log Message: ----------- Adding crossnamespace support to and from en:Help: ( see for example http://en.wikipedia.org/wiki/Help:IPA_for_Italian , equivalent of http://it.wikipedia.org/wiki/Fonologia_dell%27italiano and http://fr.wikipedia.org/wiki/Alphabet_phon%C3%A9tique_international_pour_l%… ) Modified Paths: -------------- trunk/pywikipedia/families/wikipedia_family.py Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2008-07-24 19:48:25 UTC (rev 5756) +++ trunk/pywikipedia/families/wikipedia_family.py 2008-07-24 19:52:06 UTC (rev 5757) @@ -841,24 +841,27 @@ '_default': { 'pt': [102], 'als': [104], + 'en': [12], 'es': [104], 'fr': [104], - 'lt': [104] + 'lt': [104], } } self.crossnamespace[1] = { '_default': { 'pt': [103], 'als': [105], + 'en': [13], 'es': [105], 'fr': [105], - 'lt': [105] + 'lt': [105], } } self.crossnamespace[102] = { 'pt': { '_default': [0], 'als': [0, 104], + 'en': [0, 12], 'es': [0, 104], 'fr': [0, 104], 'lt': [0, 104] @@ -869,6 +872,7 @@ '_default': [1], 'als': [1, 105], 'es': [1, 105], + 'en': [1, 13], 'fr': [1, 105], 'lt': [1, 105] } @@ -878,6 +882,10 @@ '_default': [0], 'pt': [0, 102] }, + 'en': { + '_default': [0], + 'pt': [0, 102] + }, 'es': { '_default': [0], 'pt': [0, 102] @@ -896,6 +904,10 @@ '_default': [1], 'pt': [0, 103] }, + 'en': { + '_default': [1], + 'pt': [0, 103] + }, 'es': { '_default': [1], 'pt': [0, 103]

15 years, 9 months

SVN: [5758] trunk/pywikipedia/families/wikipedia_family.py

by nicdumz＠svn.wikimedia.org

Revision: 5758 Author: nicdumz Date: 2008-07-25 08:43:25 +0000 (Fri, 25 Jul 2008) Log Message: ----------- Crossnamespace fix ; Thanks Stig :) Modified Paths: -------------- trunk/pywikipedia/families/wikipedia_family.py Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2008-07-24 19:52:06 UTC (rev 5757) +++ trunk/pywikipedia/families/wikipedia_family.py 2008-07-25 08:43:25 UTC (rev 5758) @@ -861,7 +861,6 @@ 'pt': { '_default': [0], 'als': [0, 104], - 'en': [0, 12], 'es': [0, 104], 'fr': [0, 104], 'lt': [0, 104] @@ -872,7 +871,6 @@ '_default': [1], 'als': [1, 105], 'es': [1, 105], - 'en': [1, 13], 'fr': [1, 105], 'lt': [1, 105] } @@ -882,10 +880,6 @@ '_default': [0], 'pt': [0, 102] }, - 'en': { - '_default': [0], - 'pt': [0, 102] - }, 'es': { '_default': [0], 'pt': [0, 102] @@ -904,10 +898,6 @@ '_default': [1], 'pt': [0, 103] }, - 'en': { - '_default': [1], - 'pt': [0, 103] - }, 'es': { '_default': [1], 'pt': [0, 103] @@ -921,6 +911,16 @@ 'pt': [0, 103] } } + self.crossnamespace[12] = { + 'en': { + '_default': [0], + } + } + self.crossnamespace[13] = { + 'en': { + '_default': [0], + } + } def get_known_families(self, site): # In Swedish Wikipedia 's:' is part of page title not a family # prefix for 'wikisource'.

15 years, 9 months

SVN: [5756] trunk/pywikipedia/solve_disambiguation.py

by a_engels＠svn.wikimedia.org

Revision: 5756 Author: a_engels Date: 2008-07-24 19:48:25 +0000 (Thu, 24 Jul 2008) Log Message: ----------- ignores for nl: Modified Paths: -------------- trunk/pywikipedia/solve_disambiguation.py Modified: trunk/pywikipedia/solve_disambiguation.py =================================================================== --- trunk/pywikipedia/solve_disambiguation.py 2008-07-24 19:05:50 UTC (rev 5755) +++ trunk/pywikipedia/solve_disambiguation.py 2008-07-24 19:48:25 UTC (rev 5756) @@ -341,7 +341,7 @@ u"Overleg gebruiker:Pven", u"Portaal:.+[aA]rchief.*", u"Wikipedia:Humor en onzin.*", - u"Wikipedia:Links naar doorverwijspagina's.*", + u"Wikipedia:Links naar doorverwijspagina's/Winkeldochters.*", u"Wikipedia:Project aanmelding bij startpagina's", u"Wikipedia:Wikiproject Roemeense gemeenten/Doorverwijspagina's", u'Categorie:Doorverwijspagina', @@ -371,11 +371,12 @@ u'Lijst van Nederlandse namen van pausen', u'Overleg Wikipedia:Discussie spelling 2005', u'Overleg Wikipedia:Doorverwijspagina', - u'Overleg Wikipedia:Logboek*', + u'Overleg Wikipedia:Logboek.*', + u'Wikipedia:Logboek.*', u'Overleg gebruiker:Sybren/test.*', u'Overleg gebruiker:[0-9][0-9]?[0-9]?\.[0-9][0-9]?[0-9]?\.[0-9][0-9]?[0-9]?\.[0-9][0-9]?[0-9]?', u'Overleg:Lage Landen (staatkunde)', - u'Wikipedia:.+rchief.*', + u'Wikipedia:.*[aA]rchief.*', u'Wikipedia:Doorverwijspagina', u'Wikipedia:Lijst van alle tweeletter-combinaties', u'Wikipedia:Onderhoudspagina', @@ -388,6 +389,9 @@ u"Gebruiker:Michiel1972/Lijst plaatsen VS.+", u"Gebruiker:Zanaq/SG1", u'Gebruiker:Erwin.*', + u'Gebruiker:Romaine/Dp.*', + u'Gebruiker:JePe/Artikelen met een ISBN-link', + u'Gebruiker:.+/.*[aA]rchief.*', ], 'pl': [ u'Wikipedysta:.+',

15 years, 9 months

SVN: [5755] trunk/pywikipedia/fixes.py

by alnokta＠svn.wikimedia.org

Revision: 5755 Author: alnokta Date: 2008-07-24 19:05:50 +0000 (Thu, 24 Jul 2008) Log Message: ----------- update arabic fixes Modified Paths: -------------- trunk/pywikipedia/fixes.py Modified: trunk/pywikipedia/fixes.py =================================================================== --- trunk/pywikipedia/fixes.py 2008-07-24 18:06:40 UTC (rev 5754) +++ trunk/pywikipedia/fixes.py 2008-07-24 19:05:50 UTC (rev 5755) @@ -405,14 +405,14 @@ #Corrections for Arabic Wikipedia and any Arabic wiki. - # It isn't fully clear what it's supposed to do, if is safe or correct (included for more - # ancient arabic text). As now it's possible use user-fixes.py and if no objections or - # explanations is given, this part of code might be removed. + # These spelling corrections are very important for the + # Arabic Wikipedia. Please don't remove it. The file is + # shared between all bot operators, so it is in the repository. 'correct-ar': { 'regex': False, 'msg': { - 'ar':u'تدقيق إملائي. 88 كلمة مستهدفة حاليًا.', + 'ar':u'تدقيق إملائي. 128 كلمة مستهدفة حاليًا.', }, 'replacements': [ (u' ,', u' ،'), @@ -504,6 +504,46 @@ (u' انور ', u' أنور '), (u' اصعب ', u' أصعب '), (u' اسهل ', u' أسهل '), + (u' اجمل ', u' أجمل '), + (u' اقبح ', u' أقبح '), + (u' اطول ', u' أطول '), + (u' اقصر ', u' أقصر '), + (u' اسمن ', u' أسمن '), + (u' اذكى ', u' أذكى '), + (u' اماني ', u' أماني '), + (u' احلام ', u' أحلام '), + (u' اسماء ', u' أسماء '), + (u' ابطأ ', u' أبطأ '), + (u' اوربا ', u' أوروبا '), + (u' أوربا ', u' أوروبا '), + (u' امريكي ', u' أمريكي '), + (u' امريكية ', u' أمريكية '), + (u' امريكيان ', u' أمريكيان '), + (u' امريكيتان ', u' أمريكيتان '), + (u' امريكيون ', u' أمريكيون '), + (u' امريكيات ', u' أمريكيات '), + (u' الامريكي ', u' الأمريكي '), + (u' الامريكية ', u' الأمريكية '), + (u' الامريكيان ', u' الأمريكيان '), + (u' الامريكيتان ', u' الأمريكيتان '), + (u' الامريكيون ', u' الأمريكيون '), + (u' الامريكيات ', u' الأمريكيات '), + (u' اوروبي ', u' أوروبي '), + (u' اوروبية ', u' أوروبية '), + (u' اوروبيان ', u' أوروبيان '), + (u' اوروبيتان ', u' أوروبيتان '), + (u' اوروبيون ', u' أوروبيون '), + (u' اوروبيات ', u' أوروبيات '), + (u' الاوروبي ', u' الأوروبي '), + (u' الاوروبية ', u' الأوروبية '), + (u' الاوروبيان ', u' الأوروبيان '), + (u' الاوروبيتان ', u' الأوروبيتان '), + (u' الاوروبيون ', u' الأوروبيون '), + (u' الاوروبيات ', u' الأوروبيات '), + (u' اسرائيلي ', u' إسرائيلي '), + (u' اسرائيلية ', u' إسرائيلية '), + (u' اسرائيليان ', u' إسرائيليان '), + (u' اسرائيليتان ', u' إسرائيليتان '), ] }, }

15 years, 9 months

SVN: [5754] trunk/pywikipedia/wikipedia.py

by nicdumz＠svn.wikimedia.org

Revision: 5754 Author: nicdumz Date: 2008-07-24 18:06:40 +0000 (Thu, 24 Jul 2008) Log Message: ----------- nah, the sleep(1) trick was not working, moving the cache deletions at the end of _flush Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-07-24 17:38:01 UTC (rev 5753) +++ trunk/pywikipedia/wikipedia.py 2008-07-24 18:06:40 UTC (rev 5754) @@ -6393,16 +6393,6 @@ when it has stopped doing so. After a bot has run stopme() it will not slow down other bots any more. """ - if config.use_diskcache: - for site in _sites.itervalues(): - if site._mediawiki_messages: - try: - while(_putthread.isAlive()): - time.sleep(1) - site._mediawiki_messages.delete() - except OSError: - # stopme has been called several times... - pass get_throttle.drop() def _flush(): @@ -6440,6 +6430,13 @@ get_throttle.drop() except NameError: pass + if config.use_diskcache: + for site in _sites.itervalues(): + if site._mediawiki_messages: + try: + site._mediawiki_messages.delete() + except OSError: + pass import atexit atexit.register(_flush)

15 years, 9 months

[ pywikipediabot-Bugs-2026525 ] diskcache fails with an IOError[22] in welcome.py

by SourceForge.net

Bugs item #2026525, was opened at 2008-07-24 10:26 Message generated for change (Comment added) made by nicdumz You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2026525&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: NicDumZ Nicolas Dumazet (nicdumz) Assigned to: Nobody/Anonymous (nobody) Summary: diskcache fails with an IOError[22] in welcome.py Initial Comment: Traceback (most recent call last): File "pywikipedia/welcome.py", line 967, in <module> for number_user in main(settingsBot): File "pywikipedia/welcome.py", line 704, in main contrib = string.capitalize(wsite.mediawiki_message('contribslink')) File "/home/filnik/pywikipedia/wikipedia.py", line 4678, in mediawiki_message value = self._mediawiki_messages[key] File "/home/filnik/pywikipedia/diskcache.py", line 94, in __getitem__ self.cache_file.seek(self.lookup[i]) IOError: [Errno 22] Invalid argument Does that mean that some lookup values are still -1 even after the initialization ? ---------------------------------------------------------------------- >Comment By: NicDumZ Nicolas Dumazet (nicdumz) Date: 2008-07-24 19:40 Message: Logged In: YES user_id=1963242 Originator: YES mmm... Running a custom script in another system, I got a much more user-friendly message than "Invalid argument" : it complained about the cache file not being found. I believe that this is caused by our deferred put thread, which might still be running when stopme() is called. I attempted, in r5753, to address this issue. Waiting a bit more before closing this issue. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2026525&group_…

15 years, 9 months

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l July 2008