pywikibot October 2008

pywikibot@lists.wikimedia.org

25 participants
195 discussions

[Pywikipedia-l] SVN: [5949] trunk/pywikipedia

by russblau＠svn.wikimedia.org

Revision: 5949 Author: russblau Date: 2008-10-10 14:14:04 +0000 (Fri, 10 Oct 2008) Log Message: ----------- Allow normalizeNamespace to work with Turkish dotted capital I. Modified Paths: -------------- trunk/pywikipedia/family.py trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/family.py =================================================================== --- trunk/pywikipedia/family.py 2008-10-10 13:55:06 UTC (rev 5948) +++ trunk/pywikipedia/family.py 2008-10-10 14:14:04 UTC (rev 5949) @@ -2800,8 +2800,11 @@ if value in v: return v[0] else: if value == v: return v - if value == self.namespace('_default', ns): - return self.namespace(code, ns) + try: + if value == self.namespace('_default', ns): + return self.namespace(code, ns) + except KeyError: + pass return value def getNamespaceIndex(self, lang, namespace): Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-10-10 13:55:06 UTC (rev 5948) +++ trunk/pywikipedia/wikipedia.py 2008-10-10 14:14:04 UTC (rev 5949) @@ -5812,8 +5812,10 @@ If no match, return 'value' unmodified. """ - if not self.nocapitalize and value[0].islower(): - value = value[0].upper() + value[1:] + if not self.nocapitalize: + # make sure first letter gets normalized; there is at least + # one case ("İ") in which s.lower().upper() != s + value = value[0].lower().upper() + value[1:] return self.family.normalizeNamespace(self.lang, value) def namespaces(self):

15 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2157483 ] Edit conflit prints html

by SourceForge.net

Bugs item #2157483, was opened at 2008-10-10 15:53 Message generated for change (Settings changed) made by mauro742 You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None Status: Open Resolution: None >Priority: 6 Private: No Submitted By: Mauro (mauro742) Assigned to: Nobody/Anonymous (nobody) Summary: Edit conflit prints html Initial Comment: When I want to save (put) a page and an edit conflit occurs, the framework prints the html code of edit conflit's page. Pywikipedia [http] trunk/pywikipedia (r5945, Oct 10 2008, 11:16:07) Python 2.5.2 (r252:60911, Sep 29 2008, 21:10:35) [GCC 4.3.2] ---------------------------------------------------------------------- Comment By: Mauro (mauro742) Date: 2008-10-10 16:11 Message: This is the output: Changing page [[...page...]] Changing page has failed. Retrying. Getting a token. Sleeping for 5.5 seconds, 2008-10-10 15:36:06 Changing page [[...page...]] ERROR: Unexpected response from wiki server. 200 (OK) then follow the html ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_…

15 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2157483 ] Edit conflit prints html

by SourceForge.net

Bugs item #2157483, was opened at 2008-10-10 15:53 Message generated for change (Comment added) made by mauro742 You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Mauro (mauro742) Assigned to: Nobody/Anonymous (nobody) Summary: Edit conflit prints html Initial Comment: When I want to save (put) a page and an edit conflit occurs, the framework prints the html code of edit conflit's page. Pywikipedia [http] trunk/pywikipedia (r5945, Oct 10 2008, 11:16:07) Python 2.5.2 (r252:60911, Sep 29 2008, 21:10:35) [GCC 4.3.2] ---------------------------------------------------------------------- Comment By: Mauro (mauro742) Date: 2008-10-10 16:11 Message: This is the output: Changing page [[...page...]] Changing page has failed. Retrying. Getting a token. Sleeping for 5.5 seconds, 2008-10-10 15:36:06 Changing page [[...page...]] ERROR: Unexpected response from wiki server. 200 (OK) then follow the html ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_…

15 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2157483 ] Edit conflit prints html

by SourceForge.net

Bugs item #2157483, was opened at 2008-10-10 15:53 Message generated for change (Settings changed) made by mauro742 You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None >Status: Open Resolution: None Priority: 5 Private: No Submitted By: Mauro (mauro742) Assigned to: Nobody/Anonymous (nobody) >Summary: Edit conflit prints html Initial Comment: When I want to save (put) a page and an edit conflit occurs, the framework prints the html code of edit conflit's page. Pywikipedia [http] trunk/pywikipedia (r5945, Oct 10 2008, 11:16:07) Python 2.5.2 (r252:60911, Sep 29 2008, 21:10:35) [GCC 4.3.2] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_…

15 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2157483 ] On edit conflit framework prints html

by SourceForge.net

Bugs item #2157483, was opened at 2008-10-10 15:53 Message generated for change (Settings changed) made by mauro742 You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None >Status: Deleted Resolution: None Priority: 5 Private: No Submitted By: Mauro (mauro742) Assigned to: Nobody/Anonymous (nobody) Summary: On edit conflit framework prints html Initial Comment: When I want to save (put) a page and an edit conflit occurs, the framework prints the html code of edit conflit's page. Pywikipedia [http] trunk/pywikipedia (r5945, Oct 10 2008, 11:16:07) Python 2.5.2 (r252:60911, Sep 29 2008, 21:10:35) [GCC 4.3.2] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_…

15 years, 6 months

[Pywikipedia-l] SVN: [5948] trunk/pywikipedia/checkimages.py

by filnik＠svn.wikimedia.org

Revision: 5948 Author: filnik Date: 2008-10-10 13:55:06 +0000 (Fri, 10 Oct 2008) Log Message: ----------- Bugfix.. complex function to get work correctly Modified Paths: -------------- trunk/pywikipedia/checkimages.py Modified: trunk/pywikipedia/checkimages.py =================================================================== --- trunk/pywikipedia/checkimages.py 2008-10-10 13:42:32 UTC (rev 5947) +++ trunk/pywikipedia/checkimages.py 2008-10-10 13:55:06 UTC (rev 5948) @@ -1024,21 +1024,23 @@ seems_ok = True exit_cicle = True break - else: - try: - template_text = template.get() - except wikipedia.NoPage: - seems_ok = False # Empty template (maybe deleted while the script's running) - exit_cicle = True - break - if second_round == False: - licenses_found = regex_find_licenses.findall(template_text) - second_round = True - break # only exit from the for, not from the while - else: - exit_cicle = True - break - license_found = license_selected + license_found = license_selected # let the last "fake" license normally detected + # previous block was unsuccessful? Try with the next one + for license_selected in licenses_found: + try: + template_text = template.get() + except wikipedia.NoPage: + seems_ok = False # Empty template (maybe deleted while the script's running) + exit_cicle = True + break + if second_round == False: + licenses_found = regex_find_licenses.findall(template_text) + second_round = True + break # only exit from the for, not from the while + else: + exit_cicle = True + license_found = license_selected # A good license? Ok, let's use it instead + break if not seems_ok: rep_text_license_fake = "\n*[[:Image:%s]] seems to have a ''fake license'', license detected: {{tl|%s}}." % (self.image, license_found) regexFakeLicense = r"\* ?\[\[:Image:%s\]\] seems to have a ''fake license'', license detected: \{\{tl\|%s\}\}\.$" % (self.image, license_found)

15 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Bugs-2157483 ] On edit conflit framework prints html

by SourceForge.net

Bugs item #2157483, was opened at 2008-10-10 15:53 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Mauro (mauro742) Assigned to: Nobody/Anonymous (nobody) Summary: On edit conflit framework prints html Initial Comment: When I want to save (put) a page and an edit conflit occurs, the framework prints the html code of edit conflit's page. Pywikipedia [http] trunk/pywikipedia (r5945, Oct 10 2008, 11:16:07) Python 2.5.2 (r252:60911, Sep 29 2008, 21:10:35) [GCC 4.3.2] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2157483&group_…

15 years, 6 months

[Pywikipedia-l] SVN: [5947] trunk/pywikipedia/checkimages.py

by filnik＠svn.wikimedia.org

Revision: 5947 Author: filnik Date: 2008-10-10 13:42:32 +0000 (Fri, 10 Oct 2008) Log Message: ----------- Making the smartdetection smarter (: testing phase on commons begun Modified Paths: -------------- trunk/pywikipedia/checkimages.py Modified: trunk/pywikipedia/checkimages.py =================================================================== --- trunk/pywikipedia/checkimages.py 2008-10-10 12:44:44 UTC (rev 5946) +++ trunk/pywikipedia/checkimages.py 2008-10-10 13:42:32 UTC (rev 5947) @@ -999,27 +999,55 @@ license_found = None regex_find_licenses = re.compile(r'\{\{(?:[Tt]emplate:|)(.*?)(?:[|\n].*?|)\}\}', re.DOTALL) licenses_found = regex_find_licenses.findall(image_text) - if licenses_found != []: - for license_selected in licenses_found: - #print template.exists() - template = wikipedia.Page(self.site, 'Template:%s' % license_selected) - try: - if template.isRedirectPage(): - template = template.getRedirectTarget() - except wikipedia.BadTitle: - seems_ok = False # Template with wrong name - return (seems_ok, license_found) - else: - if template in self.list_licenses: # the list_licenses are loaded in the __init__ (not to load them multimple times) - seems_ok = True - license_found = license_selected + second_round = False + exit_cicle = False # howTo exit from both the for and the while cicle + while 1: + if exit_cicle: # howTo exit from the while + break + if licenses_found != []: + for license_selected in licenses_found: + #print template.exists() + template = wikipedia.Page(self.site, 'Template:%s' % license_selected) + if not template.exists(): + template = wikipedia.Page(self.site, license_selected) + if not template.exists(): + exit_cicle = True + break # break and report + try: + if template.isRedirectPage(): + template = template.getRedirectTarget() + except wikipedia.BadTitle: + # Template with wrong name, no need to report, simply skip + continue + else: + if template in self.list_licenses: # the list_licenses are loaded in the __init__ (not to load them multimple times) + seems_ok = True + exit_cicle = True + break + else: + try: + template_text = template.get() + except wikipedia.NoPage: + seems_ok = False # Empty template (maybe deleted while the script's running) + exit_cicle = True + break + if second_round == False: + licenses_found = regex_find_licenses.findall(template_text) + second_round = True + break # only exit from the for, not from the while + else: + exit_cicle = True + break + license_found = license_selected if not seems_ok: rep_text_license_fake = "\n*[[:Image:%s]] seems to have a ''fake license'', license detected: {{tl|%s}}." % (self.image, license_found) regexFakeLicense = r"\* ?\[\[:Image:%s\]\] seems to have a ''fake license'', license detected: \{\{tl\|%s\}\}\.$" % (self.image, license_found) printWithTimeZone(u"%s seems to have a fake license: %s, reporting..." % (self.image, license_found)) self.report_image(self.image, rep_text = rep_text_license_fake, addings = False, regex = regexFakeLicense) - return (seems_ok, license_found) + else: + printWithTimeZone(u"%s seems ok, license found: %s..." % (self.image, license_found)) + return license_found def load(self, raw): """ Load a list of object from a string using regex. """ @@ -1439,14 +1467,9 @@ seems_ok = False license_found = None if smartdetection: - (seems_ok, license_found) = mainClass.smartDetection(g) + license_found = mainClass.smartDetection(g) else: - seems_ok = True - if seems_ok: - if license_found != None: - printWithTimeZone(u"%s seems ok, license found: %s..." % (imageName, license_found)) - else: - printWithTimeZone(u"%s seems ok..." % imageName) + printWithTimeZone(u"%s seems ok..." % imageName) # It works also without this... but i want only to be sure ^^ parentesi = False continue

15 years, 6 months

[Pywikipedia-l] SVN: [5946] trunk/pywikipedia/category_redirect.py

by russblau＠svn.wikimedia.org

Revision: 5946 Author: russblau Date: 2008-10-10 12:44:44 +0000 (Fri, 10 Oct 2008) Log Message: ----------- Get rid of unused threading cruft, and put all logs on one page instead of littering wiki with daily logs Modified Paths: -------------- trunk/pywikipedia/category_redirect.py Modified: trunk/pywikipedia/category_redirect.py =================================================================== --- trunk/pywikipedia/category_redirect.py 2008-10-10 11:16:07 UTC (rev 5945) +++ trunk/pywikipedia/category_redirect.py 2008-10-10 12:44:44 UTC (rev 5946) @@ -13,7 +13,6 @@ import math import re import sys, traceback -import threading, Queue import time from datetime import datetime, timedelta @@ -29,55 +28,11 @@ return "%(code)s: %(info)s" % self.errors -class ThreadList(list): - """A simple threadpool class to limit the number of simultaneous threads. - - Any threading.Thread object can be added to the pool using the append() - method. If the maximum number of simultaneous threads has not been - reached, the Thread object will be started immediately; if not, the - append() call will block until the thread is able to start. - - >>> pool = ThreadList(limit=10) - >>> def work(): - ... time.sleep(1) - ... - >>> for x in xrange(20): - ... pool.append(threading.Thread(target=work)) - ... - - """ - def __init__(self, limit=sys.maxint, *args): - self.limit = limit - list.__init__(self, *args) - for item in list(self): - if not isinstance(threading.Thread, item): - raise TypeError("Cannot add '%s' to ThreadList" % type(item)) - - def active_count(self): - """Return the number of alive threads, and delete all non-alive ones.""" - count = 0 - for item in list(self): - if item.isAlive(): - count += 1 - else: - self.remove(item) - return count - - def append(self, thd): - if not isinstance(thd, threading.Thread): - raise TypeError("Cannot append '%s' to ThreadList" % type(thd)) - while self.active_count() >= self.limit: - time.sleep(2) - list.append(self, thd) - thd.start() - - class CategoryRedirectBot(object): def __init__(self): self.cooldown = 7 # days self.site = wikipedia.getSite() self.catprefix = self.site.namespace(14)+":" - self.result_queue = Queue.Queue() self.log_text = [] self.edit_requests = [] @@ -270,15 +225,13 @@ if found: wikipedia.output(u"%s: %s found, %s moved" % (oldCat.title(), found, moved)) - self.result_queue.put((oldCatTitle, found, moved)) - return + return (found, moved) except wikipedia.ServerError: wikipedia.output(u"Server error: retrying in 5 seconds...") time.sleep(5) continue except: - self.result_queue.put((oldCatTitle, None, None)) - raise + return (None, None) def readyToEdit(self, cat): """Return True if cat not edited during cooldown period, else False.""" @@ -364,8 +317,7 @@ l = time.localtime() today = "%04d-%02d-%02d" % l[:3] log_page = wikipedia.Page(self.site, - u"User:%(user)s/category redirect logs/%(today)s" - % locals()) + u"User:%(user)s/category redirect log" % locals()) problem_page = wikipedia.Page(self.site, u"User:%(user)s/category redirect problems" % locals()) edit_request_page = wikipedia.Page(self.site, @@ -579,7 +531,7 @@ wikipedia.output(u"Moving pages out of %s redirected categories." % len(cats_to_empty)) # thread_limit = int(math.log(len(cats_to_empty), 8) + 1) - threadpool = ThreadList(limit=1) # disabling multi-threads +# threadpool = ThreadList(limit=1) # disabling multi-threads for cat in cats_to_empty: cat_title = cat.titleWithoutNamespace() @@ -589,33 +541,32 @@ u"* Skipping %s; in cooldown period." % cat.aslink(textlink=True)) continue - threadpool.append( - threading.Thread(target=self.move_contents, - args=(cat_title, catmap[cat]), - kwargs=dict(editSummary=comment))) - while len(counts) < len(cats_to_empty): - title, found, moved = self.result_queue.get() + found, moved = self.move_contents(cat_title, catmap[cat], + editSummary=comment) if found is None: self.log_text.append( - u"* [[:%s%s]]: error in move_contents thread" - % (self.catprefix, title)) - else: - if found: - self.log_text.append( - u"* [[:%s%s]]: %d found, %d moved" - % (self.catprefix, title, found, moved)) - counts[title] = found - record[title][today] = found + u"* [[:%s%s]]: error in move_contents" + % (self.catprefix, cat_title)) + elif found: + record[cat_title][today] = found + self.log_text.append( + u"* [[:%s%s]]: %d found, %d moved" + % (self.catprefix, cat_title, found, moved)) + counts[cat_title] = found cPickle.dump(record, open(datafile, "wb")) wikipedia.setAction(wikipedia.translate(self.site.lang, self.maint_comment)) - log_page.put("\n".join(self.log_text)) + try: + log_text = log_page.get() + except wikipedia.NoPage: + log_text = u"" + log_page.put(log_text + u"\n==~~~~~==\n"+ u"\n".join(self.log_text)) problem_page.put("\n".join(problems)) if self.edit_requests: edit_request_page.put(self.edit_request_text - % "\n".join((self.edit_request_item % item) + % u"\n".join((self.edit_request_item % item) for item in self.edit_requests))

15 years, 6 months

[Pywikipedia-l] SVN: [5945] trunk/pywikipedia/checkimages.py

by filnik＠svn.wikimedia.org

Revision: 5945 Author: filnik Date: 2008-10-10 11:16:07 +0000 (Fri, 10 Oct 2008) Log Message: ----------- Standardizing italian messages. So now also other bots can easily use this bot on it.wiki Modified Paths: -------------- trunk/pywikipedia/checkimages.py Modified: trunk/pywikipedia/checkimages.py =================================================================== --- trunk/pywikipedia/checkimages.py 2008-10-09 23:39:47 UTC (rev 5944) +++ trunk/pywikipedia/checkimages.py 2008-10-10 11:16:07 UTC (rev 5945) @@ -90,6 +90,9 @@ # <------------------------------------------- Change only below! -----------------------------------------------------># ######################################################################################################################### +# NOTE: in the messages used by the Bot if you put __botnick__ in the text, it will automatically replaced +# with the bot's nickname. + # That's what you want that will be added. (i.e. the {{no source}} with the right day/month/year ) n_txt = { 'commons':u'\n{{subst:nld}}', @@ -195,7 +198,7 @@ 'commons':u'The [[:Image:%s]] file seems to have a wrong extension, please check. ~~~~', 'en' :u'The [[:Image:%s]] file seems to have a wrong extension, please check. ~~~~', 'hu' :u'A [[:Kép:%s]] fájlnak rossz a kiterjesztése, kérlek ellenőrízd. ~~~~', - 'it' :u'{{subst:Utente:Filbot/Ext|%s}} --~~~~', + 'it' :u'{{subst:Progetto:Coordinamento/Immagini/Bot/Messaggi/Ext|%s|__botnick__}} --~~~~', 'ko' :u'[[:그림:%s]]의 파일 형식이 잘못되었습니다. 확인 바랍니다.--~~~~', 'ta' :u'[[:படிமம்:%s]] இனங்காணப்படாத கோப்பு நீட்சியை கொண்டுள்ளது தயவு செய்து ஒரு முறை சரி பார்க்கவும் ~~~~', 'zh' :u'您好，你上傳的[[:Image:%s]]無法被識別，請檢查您的檔案，謝謝。--~~~~', @@ -236,7 +239,7 @@ 'de' :u'\n{{subst:Benutzer:ABF/D2|%s}} ~~~~ ', 'en' :u"{{subst:image source|Image:%s}} --~~~~", 'hu' :u"{{subst:adjforrást|Kép:%s}} \n Ezt az üzenetet ~~~ automatikusan helyezte el a vitalapodon, kérdéseddel fordulj a gazdájához, vagy a [[WP:KF|Kocsmafalhoz]]. --~~~~", - 'it' :u"{{subst:Utente:Filbot/Senza licenza|%s}} --~~~~", + 'it' :u"{{subst:Progetto:Coordinamento/Immagini/Bot/Messaggi/Senza licenza|%s|__botnick__}} --~~~~", 'ja' :u"\n{{subst:Image copyright|Image:%s}}--~~~~", 'ko' :u'\n{{subst:사용자:김우진1/BotRFL|%s}} --~~~~', 'ta' :u'\n{{subst:Di-no license-notice|படிமம்:%s}} ~~~~ ', @@ -262,7 +265,7 @@ 'de':None, 'en': None, 'hu':u'\nSzia! Úgy tűnik a [[:Kép:%s]] képpel is hasonló a probléma, mint az előbbivel. Kérlek olvasd el a [[WP:KÉPLIC|feltölthető képek]]ről szóló oldalunk, és segítségért fordulj a [[WP:KF-JO|Jogi kocsmafalhoz]]. Köszönöm --~~~~', - 'it':u':{{subst:Utente:Filbot/Senza licenza2|%s}} --~~~~', + 'it':u':{{subst:Progetto:Coordinamento/Immagini/Bot/Messaggi/Senza licenza2|%s|__botnick__}} --~~~~', 'ja':None, 'ta':None, 'zh':None, @@ -353,7 +356,7 @@ 'commons': u"""\n{{subst:User:Filnik/whitetemplate|Image:%s}}\n\n''This message was '''added automatically by [[User:__botnick__|__botnick__]]''', if you need some help about it, ask its master (~~~) or go to the [[Commons:Help desk]]''. --~~~~""", 'de': None, 'en': None, - 'it': u"{{subst:Utente:Filbot/Template_insufficiente|%s}} --~~~~", + 'it': u"{{subst:Progetto:Coordinamento/Immagini/Bot/Messaggi/Template_insufficiente|%s|__botnick__}} --~~~~", 'ko': u"\n{{subst:User:김우진1/BotRFL|%s}} --~~~~", 'ta': None, } @@ -372,7 +375,7 @@ duplicates_user_talk_text = { 'commons':u'{{subst:User:Filnik/duplicates|Image:%s|Image:%s}}', 'en':None, - 'it':u"{{subst:Utente:Filbot/duplicati|%s|%s}} --~~~~", + 'it':u"{{subst:Progetto:Coordinamento/Immagini/Bot/Messaggi/Duplicati|%s|%s|__botnick__}} --~~~~", } duplicates_comment_talk = {

15 years, 6 months

← Newer
1
...
13
14
15
16
17
18
19
20
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot October 2008