pywikibot July 2008

pywikibot@lists.wikimedia.org

29 participants
197 discussions

[Pywikipedia-l] SVN: [5709] trunk/pywikipedia/imageuncat.py

by multichill＠svn.wikimedia.org

Revision: 5709 Author: multichill Date: 2008-07-11 20:34:03 +0000 (Fri, 11 Jul 2008) Log Message: ----------- Removed PD-Statens vegvesen from the ignore list, seems to add a topic category too (Category:Diagrams of road signs of Norway) Modified Paths: -------------- trunk/pywikipedia/imageuncat.py Modified: trunk/pywikipedia/imageuncat.py =================================================================== --- trunk/pywikipedia/imageuncat.py 2008-07-11 08:19:25 UTC (rev 5708) +++ trunk/pywikipedia/imageuncat.py 2008-07-11 20:34:03 UTC (rev 5709) @@ -794,7 +794,6 @@ u'PD-South-Africa', u'PD-Soviet-revised', u'PD-SRBGov', - u'PD-Statens vegvesen', u'PD-STFP', u'PD-StVZVO', u'PD-Sudan',

15 years, 10 months

[Pywikipedia-l] SVN: [5708] trunk/pywikipedia/add_text.py

by multichill＠svn.wikimedia.org

Revision: 5708 Author: multichill Date: 2008-07-11 08:19:25 +0000 (Fri, 11 Jul 2008) Log Message: ----------- nn translation Modified Paths: -------------- trunk/pywikipedia/add_text.py Modified: trunk/pywikipedia/add_text.py =================================================================== --- trunk/pywikipedia/add_text.py 2008-07-10 08:35:27 UTC (rev 5707) +++ trunk/pywikipedia/add_text.py 2008-07-11 08:19:25 UTC (rev 5708) @@ -61,6 +61,7 @@ 'he': u'בוט: מוסיף %s', 'it': u'Bot: Aggiungo %s', 'ja': u'ロボットによる: 追加 %s', + 'nn': u'Robot: La til %s', 'pt': u'Bot: Adicionando %s', 'sv': u'Bot: Lägger till %s', 'zh': u'機器人: 正在新增 %s',

15 years, 10 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2011362 ] featured.py: Add 'Link FA' again for hi and yi

by SourceForge.net

Bugs item #2011362, was opened at 2008-07-05 20:07 Message generated for change (Comment added) made by melancholie You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2011362&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: featured.py: Add 'Link FA' again for hi and yi Initial Comment: Both, hiwiki and yiwiki do use Template:Link_FA, the pages hi:Template:Lien AdQ and yi:Template: are only redirects. By re-adding 'Link FA' to the langs arrays, Template:Link_FA will be used by the bot (otherewise those redirects). ---------------------------------------------------------------------- >Comment By: Melancholie (melancholie) Date: 2008-07-11 07:51 Message: Logged In: YES user_id=2089773 Originator: YES Maybe I was a little bit too imprecise ;-) Here is what I mean: templatelist = template['_default'] try: templatelist += template[tosite.lang] + (u" {{%s|%s}}" % (templatelist[0], fromsite.lang)) templatelist[0] is 'Link FA', but the localized templates used are templatelist[1]. If there is a localized template (with Link_FA being only a redirect) it should be used for edit. So it might be good to change the order (make 'try:' first, add _default with +=) For hi, yi the easiest way might be to just comment out the localized template names, as they are only redirects to Link_FA. ---------------------------------------------------------------------- Comment By: Melancholie (melancholie) Date: 2008-07-10 11:59 Message: Logged In: YES user_id=2089773 Originator: YES So {{Link FA}} is always the first choice? Or does _default actually follow redirects? ---------------------------------------------------------------------- Comment By: NicDumZ Nicolas Dumazet (nicdumz) Date: 2008-07-10 10:41 Message: Logged In: YES user_id=1963242 Originator: NO I'm not sure melancholie :) I added {{Leam VdC}} in r5707, however, since r5669 ( https://fisheye.toolserver.org/browse/pywikipedia/trunk/pywikipedia/feature… ) it uses the '_default' entry (Link FA) AND the locale entry. The list for hi: is for example ['Link Fa', 'Lien AdQ'] ---------------------------------------------------------------------- Comment By: Melancholie (melancholie) Date: 2008-07-10 10:28 Message: Logged In: YES user_id=2089773 Originator: YES Furthermore, add http://fur.wikipedia.org/wiki/Model:Leam_VdC [I wish I were able to do this things myself, but *still* no account yet] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2011362&group_…

15 years, 10 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2014962 ] SyntaxError: mismatched tag: line 6, column 140

by SourceForge.net

Bugs item #2014962, was opened at 2008-07-10 13:53 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2014962&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Multichill (multichill) Assigned to: Nobody/Anonymous (nobody) Summary: SyntaxError: mismatched tag: line 6, column 140 Initial Comment: I'm getting this error in different wiki's when i run commonscat. Pywikipedia [svn+ssh] multichill@trunk/pywikipedia (r5707, Jul 10 2008, 08:35:27 ) Python 2.5.1 (r251:54863, Apr 18 2007, 08:51:08) [MSC v.1310 32 bit (Intel)] Working on Kategorie:Házenkári Sleeping for 3.2 seconds, 2008-07-09 15:55:11 Sleeping for 4.1 seconds, 2008-07-09 15:55:15 Sleeping for 3.8 seconds, 2008-07-09 15:55:20 Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\pagegenerators.py", line 763, in __iter__ yield loaded_page GeneratorExit Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\commonscat.py", line 322, in <module> main() File "D:\Wikipedia\pywikipedia\commonscat.py", line 318, in main (status, always) = addCommonscat(page, summary, always) File "D:\Wikipedia\pywikipedia\commonscat.py", line 237, in addCommonscat if getTemplate(ipage.site().language()) in ipage.templates(): File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1682, in templates return [template for (template, param) in self.templatesWithParams(get_redir ect=get_redirect)] File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1696, in templatesWithParam s thistxt = self.get(get_redirect=get_redirect) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 647, in get self._contents = self._getEditPage(get_redirect = get_redirect, throttle = t hrottle, sysop = sysop) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 705, in _getEditPage if text.find(self.site().mediawiki_message('whitelistedittitle')) != -1: File "D:\Wikipedia\pywikipedia\wikipedia.py", line 4598, in mediawiki_message tree = XML(decode) File "<string>", line 85, in XML SyntaxError: mismatched tag: line 6, column 140 commonscat.py -lang:simple -start:Category:48 Working on Category:47 BC births Sleeping for 3.9 seconds, 2008-07-10 12:26:52 Sleeping for 4.1 seconds, 2008-07-10 12:26:57 Sleeping for 3.9 seconds, 2008-07-10 12:27:02 Sleeping for 3.5 seconds, 2008-07-10 12:27:07 Sleeping for 4.1 seconds, 2008-07-10 12:27:12 Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\pagegenerators.py", line 763, in __iter__ yield loaded_page GeneratorExit Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\commonscat.py", line 322, in <module> main() File "D:\Wikipedia\pywikipedia\commonscat.py", line 318, in main (status, always) = addCommonscat(page, summary, always) File "D:\Wikipedia\pywikipedia\commonscat.py", line 237, in addCommonscat if getTemplate(ipage.site().language()) in ipage.templates(): File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1682, in templates return [template for (template, param) in self.templatesWithParams(get_redir ect=get_redirect)] File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1696, in templatesWithParam s thistxt = self.get(get_redirect=get_redirect) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 647, in get self._contents = self._getEditPage(get_redirect = get_redirect, throttle = t hrottle, sysop = sysop) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 705, in _getEditPage if text.find(self.site().mediawiki_message('whitelistedittitle')) != -1: File "D:\Wikipedia\pywikipedia\wikipedia.py", line 4598, in mediawiki_message tree = XML(decode) File "<string>", line 85, in XML SyntaxError: mismatched tag: line 6, column 140 Working on Category:530 deaths Sleeping for 4.1 seconds, 2008-07-10 13:43:39 Sleeping for 3.7 seconds, 2008-07-10 13:43:45 Sleeping for 4.0 seconds, 2008-07-10 13:43:49 Sleeping for 3.9 seconds, 2008-07-10 13:43:54 Sleeping for 4.0 seconds, 2008-07-10 13:43:59 Sleeping for 4.1 seconds, 2008-07-10 13:44:04 Sleeping for 3.3 seconds, 2008-07-10 13:44:10 Sleeping for 4.1 seconds, 2008-07-10 13:44:14 Sleeping for 4.3 seconds, 2008-07-10 13:44:19 Sleeping for 3.6 seconds, 2008-07-10 13:44:25 Sleeping for 3.8 seconds, 2008-07-10 13:44:29 Sleeping for 3.9 seconds, 2008-07-10 13:44:34 Sleeping for 3.9 seconds, 2008-07-10 13:44:39 Sleeping for 3.2 seconds, 2008-07-10 13:44:45 Sleeping for 3.8 seconds, 2008-07-10 13:44:50 Sleeping for 4.0 seconds, 2008-07-10 13:44:54 Sleeping for 3.1 seconds, 2008-07-10 13:45:00 Sleeping for 3.7 seconds, 2008-07-10 13:45:05 Sleeping for 4.1 seconds, 2008-07-10 13:45:09 Sleeping for 3.7 seconds, 2008-07-10 13:45:15 Sleeping for 3.8 seconds, 2008-07-10 13:45:19 Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\pagegenerators.py", line 763, in __iter__ yield loaded_page GeneratorExit Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\commonscat.py", line 323, in <module> main() File "D:\Wikipedia\pywikipedia\commonscat.py", line 319, in main (status, always) = addCommonscat(page, summary, always) File "D:\Wikipedia\pywikipedia\commonscat.py", line 238, in addCommonscat if getTemplate(ipage.site().language()) in ipage.templates(): File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1682, in templates return [template for (template, param) in self.templatesWithParams(get_redi ect=get_redirect)] File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1696, in templatesWithPara s thistxt = self.get(get_redirect=get_redirect) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 647, in get self._contents = self._getEditPage(get_redirect = get_redirect, throttle = hrottle, sysop = sysop) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 705, in _getEditPage if text.find(self.site().mediawiki_message('whitelistedittitle')) != -1: File "D:\Wikipedia\pywikipedia\wikipedia.py", line 4600, in mediawiki_message tree = XML(decode) File "<string>", line 85, in XML SyntaxError: mismatched tag: line 6, column 140 commonscat.py -lang:cs -start:Category:I Working on Kategorie:Narození 1171 Sleeping for 4.0 seconds, 2008-07-10 13:48:07 Sleeping for 3.8 seconds, 2008-07-10 13:48:12 Sleeping for 4.0 seconds, 2008-07-10 13:48:17 Sleeping for 3.2 seconds, 2008-07-10 13:48:22 Sleeping for 4.0 seconds, 2008-07-10 13:48:27 Sleeping for 3.9 seconds, 2008-07-10 13:48:32 Sleeping for 3.7 seconds, 2008-07-10 13:48:37 Sleeping for 4.0 seconds, 2008-07-10 13:48:42 Sleeping for 3.7 seconds, 2008-07-10 13:48:47 Sleeping for 4.1 seconds, 2008-07-10 13:48:51 Sleeping for 3.3 seconds, 2008-07-10 13:48:57 Sleeping for 4.0 seconds, 2008-07-10 13:49:02 Sleeping for 3.7 seconds, 2008-07-10 13:49:07 Sleeping for 3.7 seconds, 2008-07-10 13:49:12 Checked for running processes. 4 processes currently running, including the curr ent process. Sleeping for 3.0 seconds, 2008-07-10 13:49:37 Sleeping for 3.1 seconds, 2008-07-10 13:49:40 Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\pagegenerators.py", line 763, in __iter__ yield loaded_page GeneratorExit Traceback (most recent call last): File "D:\Wikipedia\pywikipedia\commonscat.py", line 322, in <module> try: File "D:\Wikipedia\pywikipedia\commonscat.py", line 318, in main for page in pregenerator: File "D:\Wikipedia\pywikipedia\commonscat.py", line 237, in addCommonscat #See if commonscat is present File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1682, in templates return [template for (template, param) in self.templatesWithParams(get_redir ect=get_redirect)] File "D:\Wikipedia\pywikipedia\wikipedia.py", line 1696, in templatesWithParam s thistxt = self.get(get_redirect=get_redirect) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 647, in get self._contents = self._getEditPage(get_redirect = get_redirect, throttle = t hrottle, sysop = sysop) File "D:\Wikipedia\pywikipedia\wikipedia.py", line 705, in _getEditPage if text.find(self.site().mediawiki_message('whitelistedittitle')) != -1: File "D:\Wikipedia\pywikipedia\wikipedia.py", line 4598, in mediawiki_message if elementtree: File "<string>", line 85, in XML SyntaxError: mismatched tag: line 6, column 140 ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2014962&group_…

15 years, 10 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2011362 ] featured.py: Add 'Link FA' again for hi and yi

by SourceForge.net

Bugs item #2011362, was opened at 2008-07-05 20:07 Message generated for change (Comment added) made by melancholie You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2011362&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: featured.py: Add 'Link FA' again for hi and yi Initial Comment: Both, hiwiki and yiwiki do use Template:Link_FA, the pages hi:Template:Lien AdQ and yi:Template: are only redirects. By re-adding 'Link FA' to the langs arrays, Template:Link_FA will be used by the bot (otherewise those redirects). ---------------------------------------------------------------------- >Comment By: Melancholie (melancholie) Date: 2008-07-10 11:59 Message: Logged In: YES user_id=2089773 Originator: YES So {{Link FA}} is always the first choice? Or does _default actually follow redirects? ---------------------------------------------------------------------- Comment By: NicDumZ Nicolas Dumazet (nicdumz) Date: 2008-07-10 10:41 Message: Logged In: YES user_id=1963242 Originator: NO I'm not sure melancholie :) I added {{Leam VdC}} in r5707, however, since r5669 ( https://fisheye.toolserver.org/browse/pywikipedia/trunk/pywikipedia/feature… ) it uses the '_default' entry (Link FA) AND the locale entry. The list for hi: is for example ['Link Fa', 'Lien AdQ'] ---------------------------------------------------------------------- Comment By: Melancholie (melancholie) Date: 2008-07-10 10:28 Message: Logged In: YES user_id=2089773 Originator: YES Furthermore, add http://fur.wikipedia.org/wiki/Model:Leam_VdC [I wish I were able to do this things myself, but *still* no account yet] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2011362&group_…

15 years, 10 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2011362 ] featured.py: Add 'Link FA' again for hi and yi

by SourceForge.net

Bugs item #2011362, was opened at 2008-07-05 20:07 Message generated for change (Comment added) made by nicdumz You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2011362&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: featured.py: Add 'Link FA' again for hi and yi Initial Comment: Both, hiwiki and yiwiki do use Template:Link_FA, the pages hi:Template:Lien AdQ and yi:Template: are only redirects. By re-adding 'Link FA' to the langs arrays, Template:Link_FA will be used by the bot (otherewise those redirects). ---------------------------------------------------------------------- >Comment By: NicDumZ Nicolas Dumazet (nicdumz) Date: 2008-07-10 10:41 Message: Logged In: YES user_id=1963242 Originator: NO I'm not sure melancholie :) I added {{Leam VdC}} in r5707, however, since r5669 ( https://fisheye.toolserver.org/browse/pywikipedia/trunk/pywikipedia/feature… ) it uses the '_default' entry (Link FA) AND the locale entry. The list for hi: is for example ['Link Fa', 'Lien AdQ'] ---------------------------------------------------------------------- Comment By: Melancholie (melancholie) Date: 2008-07-10 10:28 Message: Logged In: YES user_id=2089773 Originator: YES Furthermore, add http://fur.wikipedia.org/wiki/Model:Leam_VdC [I wish I were able to do this things myself, but *still* no account yet] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2011362&group_…

15 years, 10 months

[Pywikipedia-l] SVN: [5707] trunk/pywikipedia/featured.py

by nicdumz＠svn.wikimedia.org

Revision: 5707 Author: nicdumz Date: 2008-07-10 08:35:27 +0000 (Thu, 10 Jul 2008) Log Message: ----------- adding fur: template Modified Paths: -------------- trunk/pywikipedia/featured.py Modified: trunk/pywikipedia/featured.py =================================================================== --- trunk/pywikipedia/featured.py 2008-07-10 05:46:47 UTC (rev 5706) +++ trunk/pywikipedia/featured.py 2008-07-10 08:35:27 UTC (rev 5707) @@ -85,7 +85,7 @@ } # ALL wikis use 'Link FA', and sometimes other localized templates. -# We use _default + the localized ones +# We use _default AND the localized ones template = { '_default': ['Link FA'], 'als': ['LinkFA'], @@ -100,6 +100,7 @@ 'es': ['Destacado'], 'eu': ['NA lotura'], 'fr': ['Lien AdQ'], + 'fur': ['Leam VdC'], 'ga': ['Nasc AR'], 'hi': ['Lien AdQ'], 'is': [u'Tengill ÚG'],

15 years, 10 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2011362 ] featured.py: Add 'Link FA' again for hi and yi

by SourceForge.net

15 years, 10 months

[Pywikipedia-l] SVN: [5706] trunk/pywikipedia

by nicdumz＠svn.wikimedia.org

Revision: 5706 Author: nicdumz Date: 2008-07-10 05:46:47 +0000 (Thu, 10 Jul 2008) Log Message: ----------- * Removing multiple stopme() calls, to use a single stopme() exit point per file, when possible * Passing when OSError is raised in stopme Modified Paths: -------------- trunk/pywikipedia/blockpageschecker.py trunk/pywikipedia/capitalize_redirects.py trunk/pywikipedia/casechecker.py trunk/pywikipedia/checkimages.py trunk/pywikipedia/clean_sandbox.py trunk/pywikipedia/copyright.py trunk/pywikipedia/get.py trunk/pywikipedia/lonelypages.py trunk/pywikipedia/pagefromfile.py trunk/pywikipedia/reflinks.py trunk/pywikipedia/replace.py trunk/pywikipedia/standardize_notes.py trunk/pywikipedia/watchlist.py trunk/pywikipedia/wikicomserver.py trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/blockpageschecker.py =================================================================== --- trunk/pywikipedia/blockpageschecker.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/blockpageschecker.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -195,7 +195,7 @@ global categoryToCheck; global comment; global project_inserted if config.mylang not in project_inserted: wikipedia.output(u"Your project is not supported by this script. You have to edit the script and add it!") - wikipedia.stopme() + return # always, define a generator to understand if the user sets one, defining what's genFactory always = False; generator = False; debug = False moveBlockCheck = False; genFactory = pagegenerators.GeneratorFactory() Modified: trunk/pywikipedia/capitalize_redirects.py =================================================================== --- trunk/pywikipedia/capitalize_redirects.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/capitalize_redirects.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -162,9 +162,8 @@ referredPage = wikipedia.Page(wikipedia.getSite(), referredPageName) gen = pagegenerators.ReferringPageGenerator(referredPage) elif source == None or len(commandline_replacements) not in [0, 2]: - wikipedia.stopme() wikipedia.showHelp(u'capitalize_redirects') - sys.exit() + return if namespaces != []: gen = pagegenerators.NamespaceFilterPageGenerator(gen, namespaces) preloadingGen = pagegenerators.PreloadingGenerator(gen, pageNumber = 20) Modified: trunk/pywikipedia/casechecker.py =================================================================== --- trunk/pywikipedia/casechecker.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/casechecker.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -352,7 +352,6 @@ except: if self.apfrom is not None: wikipedia.output(u'Exception at Title = %s, Next = %s' % (title, self.apfrom)) - wikipedia.stopme() raise def WikiLog(self, text): Modified: trunk/pywikipedia/checkimages.py =================================================================== --- trunk/pywikipedia/checkimages.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/checkimages.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -1065,7 +1065,7 @@ # A little block-statement to ensure that the bot will not start with en-parameters if site.lang not in project_inserted: wikipedia.output(u"Your project is not supported by this script. You have to edit the script and add it!") - wikipedia.stopme() + return # Some formatting for delete immediately template di = '\n%s' % di dels = dels % di @@ -1403,10 +1403,6 @@ # Here there is the main loop. I'll take all the (name of the) images and then i'll check them. if __name__ == "__main__": try: - #try: checkbot() - #except wikipedia.BadTitle: - # wikipedia.output(u"Wikidown or server's problem, quit") - # wikipedia.stopme() finally: wikipedia.stopme() Modified: trunk/pywikipedia/clean_sandbox.py =================================================================== --- trunk/pywikipedia/clean_sandbox.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/clean_sandbox.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -119,7 +119,6 @@ wikipedia.output(u'*** Loading again because of edit conflict.\n') if self.no_repeat: wikipedia.output(u'\nDone.') - wikipedia.stopme() return else: wikipedia.output(u'\nSleeping %s hours, now %s' % (self.hours, now)) @@ -134,7 +133,6 @@ no_repeat = False else: wikipedia.showHelp('clean_sandbox') - wikipedia.stopme() return bot = SandboxBot(hours, no_repeat) Modified: trunk/pywikipedia/copyright.py =================================================================== --- trunk/pywikipedia/copyright.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/copyright.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -1170,8 +1170,7 @@ wikipedia.output(output) if not gen: - wikipedia.stopme() - sys.exit() + return if namespaces != []: gen = pagegenerators.NamespaceFilterPageGenerator(gen, namespaces) preloadingGen = pagegenerators.PreloadingGenerator(gen, pageNumber = pageNumber) Modified: trunk/pywikipedia/get.py =================================================================== --- trunk/pywikipedia/get.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/get.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -31,9 +31,6 @@ if __name__ == "__main__": try: main() - except: + finally: wikipedia.stopme() - raise - else: - wikipedia.stopme() Modified: trunk/pywikipedia/lonelypages.py =================================================================== --- trunk/pywikipedia/lonelypages.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/lonelypages.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -170,7 +170,7 @@ # (useful when the bot is run on a server) if getenable != 'enable': wikipedia.output('The bot is disabled') - wikipedia.stopme() + return # DisambigPage part if disambigPage != None: disambigpage = wikipedia.Page(wikiSite, disambigPage) Modified: trunk/pywikipedia/pagefromfile.py =================================================================== --- trunk/pywikipedia/pagefromfile.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/pagefromfile.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -322,8 +322,5 @@ if __name__ == "__main__": try: main() - except: + finally: wikipedia.stopme() - raise - else: - wikipedia.stopme() Modified: trunk/pywikipedia/reflinks.py =================================================================== --- trunk/pywikipedia/reflinks.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/reflinks.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -307,8 +307,7 @@ except wikipedia.NoPage : wikipedia.output(u'The stop page %s does not exist' % self.stopPage.aslink()) - wikipedia.stopme() - sys.exit(1) + raise # Regex to grasp content-type meta HTML tag in HTML source self.META_CONTENT = re.compile(ur'(?i)<meta[^>]*content\-type[^>]*>') @@ -671,8 +670,7 @@ if not generator: # syntax error, show help text from the top of this file wikipedia.showHelp('reflinks') - wikipedia.stopme() - sys.exit() + return generator = pagegenerators.PreloadingGenerator(generator, pageNumber = 50) generator = pagegenerators.RedirectFilterPageGenerator(generator) bot = ReferencesRobot(generator, always, limit, ignorepdf) Modified: trunk/pywikipedia/replace.py =================================================================== --- trunk/pywikipedia/replace.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/replace.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -606,8 +606,7 @@ except KeyError: wikipedia.output(u'Available predefined fixes are: %s' % fixes.fixes.keys()) - wikipedia.stopme() - sys.exit() + return if fix.has_key('regex'): regex = fix['regex'] if fix.has_key('msg'): @@ -675,8 +674,7 @@ if not gen: # syntax error, show help text from the top of this file wikipedia.showHelp('replace') - wikipedia.stopme() - sys.exit() + return if namespaces != []: gen = pagegenerators.NamespaceFilterPageGenerator(gen, namespaces) if xmlFilename: Modified: trunk/pywikipedia/standardize_notes.py =================================================================== --- trunk/pywikipedia/standardize_notes.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/standardize_notes.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -1078,8 +1078,7 @@ if source == None or len(commandline_replacements) not in [0, 2]: # syntax error, show help text from the top of this file wikipedia.output(__doc__, 'utf-8') - wikipedia.stopme() - sys.exit() + return if (len(commandline_replacements) == 2): replacements[commandline_replacements[0]] = commandline_replacements[1] wikipedia.setAction(wikipedia.translate(wikipedia.getSite(), msg ) % ' (-' + commandline_replacements[0] + ' +' + commandline_replacements[1] + ')') @@ -1097,8 +1096,7 @@ fix = fixes['ALTREFS'] except KeyError: wikipedia.output(u'Available predefined fixes are: %s' % fixes.keys()) - wikipedia.stopme() - sys.exit() + return if fix.has_key('regex'): regex = fix['regex'] if fix.has_key('msg'): Modified: trunk/pywikipedia/watchlist.py =================================================================== --- trunk/pywikipedia/watchlist.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/watchlist.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -109,9 +109,6 @@ if __name__ == "__main__": try: main() - except: + finally: wikipedia.stopme() - raise - else: - wikipedia.stopme() Modified: trunk/pywikipedia/wikicomserver.py =================================================================== --- trunk/pywikipedia/wikicomserver.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/wikicomserver.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -78,7 +78,6 @@ return wrap(page) def __del__(self): - wikipedia.stopme() os.chdir(currDir) print "ChDir to original ", currDir @@ -97,5 +96,7 @@ if __name__=='__main__': import win32com.server.register - win32com.server.register.UseCommandLine(Wiki) - wikipedia.stopme() + try: + win32com.server.register.UseCommandLine(Wiki) + finally: + wikipedia.stopme() Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-07-10 05:43:04 UTC (rev 5705) +++ trunk/pywikipedia/wikipedia.py 2008-07-10 05:46:47 UTC (rev 5706) @@ -6341,7 +6341,11 @@ if config.use_diskcache: for site in _sites.itervalues(): if site._mediawiki_messages: - site._mediawiki_messages.delete() + try: + site._mediawiki_messages.delete() + except OSError: + # stopme has been called several times... + pass get_throttle.drop() def _flush():

15 years, 10 months

[Pywikipedia-l] SVN: [5705] trunk/pywikipedia/reflinks.py

by nicdumz＠svn.wikimedia.org

Revision: 5705 Author: nicdumz Date: 2008-07-10 05:43:04 +0000 (Thu, 10 Jul 2008) Log Message: ----------- * Adding experimental feature : Duplicate references check * Minor fixes Modified Paths: -------------- trunk/pywikipedia/reflinks.py Modified: trunk/pywikipedia/reflinks.py =================================================================== --- trunk/pywikipedia/reflinks.py 2008-07-10 05:18:43 UTC (rev 5704) +++ trunk/pywikipedia/reflinks.py 2008-07-10 05:43:04 UTC (rev 5705) @@ -125,14 +125,13 @@ """Xml generator that yiels pages containing bare references""" def __init__(self, xmlFilename, xmlStart, namespaces): - self.xmlFilename = xmlFilename self.xmlStart = xmlStart self.namespaces = namespaces self.skipping = bool(xmlStart) self.site = wikipedia.getSite() import xmlreader - dump = xmlreader.XmlDump(self.xmlFilename) + dump = xmlreader.XmlDump(xmlFilename) self.parser = dump.parse() def __iter__(self): @@ -223,6 +222,63 @@ if float(nb_upper)/(nb_letter+1) > .70: self.title = self.title.title() +class DuplicateReferences: + """ + When some references are duplicated in an article, + name the first, and remove the content of the others + """ + def __init__(self): + # Match references + self.REFS = re.compile(u'(?i)<ref(?P<name>[^>]*)>(?P<content>.*?)</ref>') + self.NAMES = re.compile(u'(?i)\s*name\s*=\s*(?P<quote>"?)\s*(?P<name>.*?)\s*(?P=quote)\s*') + + def process(self, text): + # key are ref contents + # values are [name, [list of full ref matches]] + foundRefs = {} + foundRefNames = [] + + for match in self.REFS.finditer(text): + content = match.group('content') + name = match.group('name') + if foundRefs.has_key(content): + v = foundRefs[content] + v[1].append(match.group()) + else: + v = [None, [match.group()]] + if not v[0]: + n = self.NAMES.match(name) + if n: + n = n.group('name') + v[0] = n + foundRefNames.append(n) + foundRefs[content] = v + + id = 1 + while 'autogenerated%s' % id in foundRefNames: + id += 1 + for (k, v) in foundRefs.iteritems(): + if len(v[1]) == 1: + continue + name = v[0] + if not name: + name = 'autogenerated%s' % id + id += 1 + named = u'<ref name="%s">%s</ref>' % (name, k) + text = text.replace(v[1][0], named, 1) + + # make sure that the first (named ref) is not + # removed later : + pos = text.index(named) + len(named) + header = text[:pos] + end = text[pos:] + + unnamed = u'<ref name="%s" />' % name + for ref in v[1][1:]: + end = end.replace(ref, unnamed) + text = header + end + return text + class ReferencesRobot: def __init__(self, generator, acceptall = False, limit = None, ignorepdf = False ): """ @@ -243,6 +299,8 @@ re.I | re.S | re.X) self.norefbot = noreferences.NoReferencesBot(None) + self.deduplicator = DuplicateReferences() + try : self.stopPageRevId = wikipedia.Page(self.site, self.stopPage).latestRevision() @@ -262,8 +320,7 @@ self.NON_HTML = re.compile(ur'(?is)<script[^>]*>.*?</script>|<style[^>]*>.*?</style>||<!\[CDATA\[.*?\]\]>') # Authorized mime types for HTML pages - str = ur'application/(?:xhtml\+xml|xml)|text/(?:ht|x)ml' - self.MIME = re.compile(str) + self.MIME = re.compile(ur'application/(?:xhtml\+xml|xml)|text/(?:ht|x)ml') def put_page(self, page, new): """ @@ -534,15 +591,18 @@ repl = ref.refTitle() new_text = new_text.replace(match.group(), repl) + # Add <references/> when needed, but ignore templates ! + if page.namespace != 10: + if self.norefbot.lacksReferences(new_text, verbose=False): + new_text = self.norefbot.addReferences(new_text) + + new_text = self.deduplicator.process(new_text) + if new_text == page.get(): wikipedia.output('No changes were necessary in %s' % page.aslink()) continue - # Add <references/> when needed, but ignore templates ! - if page.namespace != 10: - if self.norefbot.lacksReferences(new_text, verbose=False): - new_text = self.norefbot.addReferences(new_text) editedpages += 1 self.put_page(page, new_text)

15 years, 10 months

← Newer
1
...
9
10
11
12
13
14
15
...
20
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot July 2008