Pywikipedia-l December 2007

pywikipedia-l@lists.wikimedia.org

26 participants
320 discussions

SVN: [4667] trunk/pywikipedia/blockpageschecker.py
by filnik＠svn.wikimedia.org 09 Dec '07

09 Dec '07

Revision: 4667 Author: filnik Date: 2007-12-09 15:15:18 +0000 (Sun, 09 Dec 2007) Log Message: ----------- I've found that someone add the template using <noinclude> inside, delete also them (ref: http://it.wikipedia.org/w/index.php?title=Wikipedia%3AWikipediano%2FBozza%2… ) Modified Paths: -------------- trunk/pywikipedia/blockpageschecker.py Modified: trunk/pywikipedia/blockpageschecker.py =================================================================== --- trunk/pywikipedia/blockpageschecker.py 2007-12-09 15:07:10 UTC (rev 4666) +++ trunk/pywikipedia/blockpageschecker.py 2007-12-09 15:15:18 UTC (rev 4667) @@ -1,9 +1,10 @@ # -*- coding: utf-8 -*- """ -This is a script originally written by Wikihermit and then rewritten by Filnik, to delete the templates used to warn in the -pages that a page is blocked, when the page isn't blocked at all. Indeed, very often sysops block the pages for a setted -time but then the forget to delete the warning! This script is useful if you want to delete those useless warning left in these -pages. +This is a script originally written by Wikihermit and then rewritten by Filnik, +to delete the templates used to warn in the pages that a page is blocked, +when the page isn't blocked at all. Indeed, very often sysops block the pages +for a setted time but then the forget to delete the warning! This script is useful +if you want to delete those useless warning left in these pages. Parameters: @@ -13,9 +14,11 @@ Note: This script uses also genfactory, you can use those generator as default. --- Warning! --- -You have to edit this script in order to add your preferences otherwise the script won't work! +You have to edit this script in order to add your preferences +otherwise the script won't work! -If you have problems, ask on botwiki ( http://botwiki.sno.cc ) or on IRC (#pywikipediabot) +If you have problems, ask on botwiki ( http://botwiki.sno.cc ) +or on IRC (#pywikipediabot) --- Example of how to use the script --- @@ -59,7 +62,7 @@ # Comment used when the Bot edits comment = { 'en':u'Bot: Deleting out-dated template', - 'fr':u'Robot : Retrait du bandeau protection/semi-protection d\'une page qui ne l\'es plus', + 'fr':u'Robot: Retrait du bandeau protection/semi-protection d\'une page qui ne l\'es plus', 'it':u'Bot: Tolgo template di avviso blocco scaduto', } # Check list to block the users that haven't set their preferences @@ -129,7 +132,7 @@ oldtext = text # Deleting the template because the page doesn't need it. for replaceToPerform in TTR: - text = re.sub(replaceToPerform, '', text) + text = re.sub('(?:<noinclude>|)%s(?:</noinclude>|)' % replaceToPerform, '', text) if oldtext != text: # Ok, asking if the change has to be performed and do it. wikipedia.output(u"\n\n>>> \03{lightpurple}%s\03{default} <<<" % page.title())

1 0

SVN: [4666] trunk/pywikipedia/welcome.py
by filnik＠svn.wikimedia.org 09 Dec '07

09 Dec '07

Revision: 4666 Author: filnik Date: 2007-12-09 15:07:10 +0000 (Sun, 09 Dec 2007) Log Message: ----------- No more for python 2.5, now also for 2.4 Modified Paths: -------------- trunk/pywikipedia/welcome.py Modified: trunk/pywikipedia/welcome.py =================================================================== --- trunk/pywikipedia/welcome.py 2007-12-09 15:01:53 UTC (rev 4665) +++ trunk/pywikipedia/welcome.py 2007-12-09 15:07:10 UTC (rev 4666) @@ -1,9 +1,6 @@ #!/usr/bin/python # -*- coding: utf-8 -*- """ - -ATTENTION! THIS SCRIPT *REQUIRES* PYTHON 2.5 - Script to welcome new users. This script works out of the box for Wikis that have been defined in the script. It is currently used on the Dutch, Norwegian, Arabian, Albanian, Italian Wikipedia, Wikimedia Commons and English Wikiquote.

1 0

SVN: [4665] trunk/pywikipedia/add_text.py
by filnik＠svn.wikimedia.org 09 Dec '07

09 Dec '07

Revision: 4665 Author: filnik Date: 2007-12-09 15:01:53 +0000 (Sun, 09 Dec 2007) Log Message: ----------- Adding comments, adding an example, adding link to botwiki if you need help Modified Paths: -------------- trunk/pywikipedia/add_text.py Modified: trunk/pywikipedia/add_text.py =================================================================== --- trunk/pywikipedia/add_text.py 2007-12-09 14:46:49 UTC (rev 4664) +++ trunk/pywikipedia/add_text.py 2007-12-09 15:01:53 UTC (rev 4665) @@ -32,6 +32,17 @@ -untagged Add text in the images that doesn't have any license template -always If used, the bot won't asked if it should add the text specified -up If used, put the text above and not below + +--- Example --- + +python add_text.py -start:! -summary:"Bot: Adding a template" -text:"{{Something}}" -except:"\{\{(?:[Tt]emplate:|)[Ss]omething" -up + +--- Credits and Help --- +This script has been written by Botwiki's stuff, if you want to help us +or you need some help regarding this script, you can find us here: + +* http://botwiki.sno.cc + """ # @@ -51,88 +62,63 @@ class NothingFound(wikipedia.Error): """ An exception indicating that a regex has return [] instead of results.""" +# Useful for the untagged function def pageText(url): - try: - request = urllib2.Request(url) - user_agent = 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7' - request.add_header("User-Agent", user_agent) - response = urllib2.urlopen(request) - text = response.read() - response.close() - # When you load to many users, urllib2 can give this error. - except urllib2.HTTPError: - wikipedia.output(u"Server error. Pausing for 10 seconds... " + time.strftime("%d %b %Y %H:%M:%S (UTC)", time.gmtime()) ) - time.sleep(10) - request = urllib2.Request(url) - user_agent = 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7' - request.add_header("User-Agent", user_agent) - response = urllib2.urlopen(request) - text = response.read() - response.close() - return text + """ Function to load HTML text of a URL """ + try: + request = urllib2.Request(url) + user_agent = 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7' + request.add_header("User-Agent", user_agent) + response = urllib2.urlopen(request) + text = response.read() + response.close() + # When you load to many users, urllib2 can give this error. + except urllib2.HTTPError: + wikipedia.output(u"Server error. Pausing for 10 seconds... " + time.strftime("%d %b %Y %H:%M:%S (UTC)", time.gmtime()) ) + time.sleep(10) + request = urllib2.Request(url) + user_agent = 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7' + request.add_header("User-Agent", user_agent) + response = urllib2.urlopen(request) + text = response.read() + response.close() + return text def untaggedGenerator(untaggedProject, limit = 500): - lang = untaggedProject.split('.', 1)[0] - project = '.' + untaggedProject.split('.', 1)[1] - if lang == 'commons': - link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikifam=comm…' - else: - link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikilang=' + lang + '&wikifam=' + project + '&order=img_timestamp&max=' + str(limit) + '&ofs=0&max=' + str(limit) - text = pageText(link) - #print text - regexp = r"""<td valign='top' title='Name'><a href='http://.*?\..*?\.org/w/index\.php\?title=(.*?)'>.*?</a></td>""" - results = re.findall(regexp, text) - if results == []: - print link - raise NothingFound('Nothing found! Try to use the tool by yourself to be sure that it works!') - else: - for result in results: - yield wikipedia.Page(self.site, result) + """ Function to get the pages returned by this tool: http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php """ + lang = untaggedProject.split('.', 1)[0] + project = '.' + untaggedProject.split('.', 1)[1] + if lang == 'commons': + link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikifam=comm…' + else: + link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikilang=' + lang + '&wikifam=' + project + '&order=img_timestamp&max=' + str(limit) + '&ofs=0&max=' + str(limit) + text = pageText(link) + #print text + regexp = r"""<td valign='top' title='Name'><a href='http://.*?\.org/w/index\.php\?title=(.*?)'>.*?</a></td>""" + results = re.findall(regexp, text) + if results == []: + print link + raise NothingFound('Nothing found! Try to use the tool by yourself to be sure that it works!') + else: + for result in results: + yield wikipedia.Page(self.site, result) -def newImages(limit): - # Search regular expression to find links like this (and the class attribute is optional too) - # class="new" title="Immagine:Soldatino2.jpg">Immagine:Soldatino2.jpg</a>" ‎ <span class="comment"> - url = "/w/index.php?title=Special:Log&type=upload&user=&page=&pattern=&limit=%d&offset=0" % int(limit) - site = wikipedia.getSite() - textrun = site.getUrl(url) - image_namespace = site.image_namespace() + ":" - regexp = r'(class=\"new\" |)title=\"' + image_namespace + '(.*?)\.(\w\w\w|jpeg)\">.*?</a>\".*?<span class=\"comment\">' - pos = 0 - done = list() - ext_list = list() - r = re.compile(regexp, re.UNICODE) - while 1: - m = r.search(textrun, pos) - if m == None: - wikipedia.output(u"\t\t>> All images checked. <<") - break - pos = m.end() - new = m.group(1) - im = m.group(2) - ext = m.group(3) - # This prevent pages with strange characters. They will be loaded without problem. - image = im + "." + ext - if new != '': - wikipedia.output(u"Skipping %s because it has been deleted." % image) - done.append(image) - if image not in done: - done.append(image) - yield wikipedia.Page(site, 'Image:%s' % image) - def main(): + # When a page is tagged as "really well written" it has a star in the interwiki links. + # This is a list of all the templates used (in regex format) to make the stars appear. starsList = ['link[ _]fa', 'link[ _]adq', 'enllaç[ _]ad', 'link[ _]ua', 'legătură[ _]af', 'destacado', 'ua', 'liên k[ _]t[ _]chọn[ _]lọc'] - summary = None - addText = None - regexSkip = None - generator = None - always = False - exceptUrl = False + # If none, the var is setted only for check purpose. + summary = None; addText = None; regexSkip = None + generator = None; always = False; exceptUrl = False + # Load a lot of default generators genFactory = pagegenerators.GeneratorFactory() errorCount = 0 + # Put the text above or below the text? up = False - + + # Loading the arguments for arg in wikipedia.handleArgs(): if arg.startswith('-text'): if len(arg) == 5: @@ -173,20 +159,23 @@ limit = wikipedia.input(u'How many images do you want to check?') else: limit = arg[11:] - generator = newImages(limit) + generator = pagegenerators.newImages(limit, wikipedia.getSite()) elif arg == '-always': always = True else: generator = genFactory.handleArg(arg) site = wikipedia.getSite() + # /wiki/ is not always the right path in non-wiki projects pathWiki = site.family.nicepath(site.lang) + # Check if there are the minimal settings if not generator: raise NoEnoughData('You have to specify the generator you want to use for the script!') if not addText: raise NoEnoughData('You have to specify what text you want to add!') if not summary: summary = 'Bot: Adding %s' % addText + # Main Loop for page in generator: wikipedia.output(u'Loading %s...' % page.title()) try: @@ -197,6 +186,7 @@ except wikipedia.IsRedirectPage: wikipedia.output(u"%s is a redirect, skip!" % page.title()) continue + # Understand if the bot has to skip the page or not if regexSkip and exceptUrl: url = '%s%s' % (pathWiki, page.urlname()) result = re.findall(regexSkip, site.getUrl(url)) @@ -205,23 +195,30 @@ else: result = [] if result != []: - wikipedia.output(u'Exception! regex (or word) use with -except, is in the page. Skip!') + wikipedia.output(u'Exception! regex (or word) use with -except is in the page. Skip!') continue + # If not up, text put below if not up: newtext = text categoryNamespace = site.namespace(14) + # Getting the categories regexpCat = re.compile(r'\[\[((?:category|%s):.*?)\]\]' % categoryNamespace.lower(), re.I) categorieInside = regexpCat.findall(text) + # Deleting the categories newtext = wikipedia.removeCategoryLinks(newtext, site) + # Getting the interwiki interwikiInside = page.interwiki() interwikiList = list() for paginetta in interwikiInside: nome = str(paginetta).split('[[')[1].split(']]')[0] interwikiList.append(nome) lang = nome.split(':')[0] + # Removing the interwiki newtext = wikipedia.removeLanguageLinks(newtext, site) + # Sorting the interwiki interwikiList.sort() newtext += "\n%s" % addText + # Reputting the categories for paginetta in categorieInside: try: newtext += '\n[[%s]]' % paginetta.decode('utf-8') @@ -231,6 +228,7 @@ except UnicodeEncodeError: newtext += '\n[[%s]]' % paginetta newtext += '\n' + # Dealing the stars' issue starsListInPage = list() for star in starsList: regex = re.compile('(\{\{(?:template:|)%s\|.*?\}\}\n)' % star, re.I) @@ -239,6 +237,7 @@ newtext = regex.sub('', newtext) for element in risultato: newtext += '\n%s' % element + # Adding the interwiki for paginetta in interwikiList: try: newtext += '\n[[%s]]' % paginetta.decode('utf-8') @@ -247,11 +246,13 @@ newtext += '\n[[%s]]' % paginetta.decode('Latin-1') except UnicodeEncodeError: newtext += '\n[[%s]]' % paginetta + # If instead the text must be added above... else: newtext = addText + '\n' + text wikipedia.output(u"\n\n>>> \03{lightpurple}%s\03{default} <<<" % page.title()) wikipedia.showDiff(text, newtext) choice = '' + # Let's put the changes. while 1: if not always: choice = wikipedia.inputChoice(u'Do you want to accept these changes?', ['Yes', 'No', 'All'], ['y', 'N', 'a'], 'N')

1 0

SVN: [4664] trunk/pywikipedia/blockpageschecker.py
by filnik＠svn.wikimedia.org 09 Dec '07

09 Dec '07

Revision: 4664 Author: filnik Date: 2007-12-09 14:46:49 +0000 (Sun, 09 Dec 2007) Log Message: ----------- Bugfix, check all the categories not only the last one Modified Paths: -------------- trunk/pywikipedia/blockpageschecker.py Modified: trunk/pywikipedia/blockpageschecker.py =================================================================== --- trunk/pywikipedia/blockpageschecker.py 2007-12-09 14:38:50 UTC (rev 4663) +++ trunk/pywikipedia/blockpageschecker.py 2007-12-09 14:46:49 UTC (rev 4664) @@ -97,11 +97,14 @@ category = wikipedia.translate(site, categoryToCheck) commentUsed = wikipedia.translate(site, comment) if not generator: + generator = list() # Define the category if no other generator has been setted for CAT in category: cat = catlib.Category(site, CAT) # Define the generator - generator = pagegenerators.CategorizedPageGenerator(cat) + gen = pagegenerators.CategorizedPageGenerator(cat) + for pageCat in gen: + generator.append(pageCat) # Main Loop for page in generator: pagename = page.title()

1 0

[ pywikipediabot-Patches-1844704 ] disambiguation templates for sh:
by SourceForge.net 09 Dec '07

09 Dec '07

Patches item #1844704, was opened at 2007-12-05 10:30 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603140&aid=1844704&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Andre Engels (a_engels) Assigned to: Nobody/Anonymous (nobody) Summary: disambiguation templates for sh: Initial Comment: I am unable to get onto SVN at the moment (my pgp private key is on a computer that had a hard disk crash), so I'm doing it this way. To add in self.disambiguationTemplates in wikipedia_family.py: 'sh': [u'Višeznačna odrednica', u'Disambig', u'Razdvojba', u'Razvrstavanje', u'VZO', u'Višeznačnost', u'Homograf', u'Radzvojba', u'Čvor'], ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2007-12-09 16:39 Message: Logged In: YES user_id=1327030 Originator: NO Added in r4663. ---------------------------------------------------------------------- Comment By: Andre Engels (a_engels) Date: 2007-12-06 10:22 Message: Logged In: YES user_id=843018 Originator: YES Here the list for az.wikipedia.org: 'az': [u'Dəqiqləşdirmə', u'Anlam ayrım', u'Disambiguation'], ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603140&aid=1844704&group_…

1 0

SVN: [4663] trunk/pywikipedia/families/wikipedia_family.py
by rotem＠svn.wikimedia.org 09 Dec '07

09 Dec '07

Revision: 4663 Author: rotem Date: 2007-12-09 14:38:50 +0000 (Sun, 09 Dec 2007) Log Message: ----------- (patch 1844704) Add sh: disambig templates. Modified Paths: -------------- trunk/pywikipedia/families/wikipedia_family.py Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2007-12-09 14:23:00 UTC (rev 4662) +++ trunk/pywikipedia/families/wikipedia_family.py 2007-12-09 14:38:50 UTC (rev 4663) @@ -463,6 +463,10 @@ 'ru': [u'Disambig', u'Неоднозначность', u'неоднозначность'], 'scn': [u'Disambigua', u'Disambig', u'Sigla2', u'Sigla3'], 'simple': [u'Disambig', u'Disambiguation', u'3CC',u'2CC'], + 'sh': [u'Višeznačna odrednica', u'Disambig', u'Razdvojba', + u'Razvrstavanje', u'VZO', u'Višeznačnost', + u'Homograf', + u'Radzvojba', u'Čvor'], 'sk': [u'Disambig', u'Rozlišovacia stránka', u'Disambiguation'], 'sl': [u'Disambig', u'Razločitev', u'Disambig-ship'], 'sq': [u'Kthjellim', u'Disambig'],

1 0

[ pywikipediabot-Bugs-1844339 ] putPage AttributeError by using authenticate
by SourceForge.net 09 Dec '07

09 Dec '07

Bugs item #1844339, was opened at 2007-12-04 21:07 Message generated for change (Comment added) made by cosoleto You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1844339&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None >Status: Closed >Resolution: Fixed Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: putPage AttributeError by using authenticate Initial Comment: AttributeError: 'dict' object has no attribute 'append' This Error occurs in Function putPage of class Page in wikipedia.py. Near: if self.site().hostname() in config.authenticate.keys(): Adding values to "predata" fails with append() because it's a dictionary. predata.append(("Content-type","application/x-www-form-urlencoded")) predata.append(("User-agent", useragent)) using: predata["Content-type"] = "application/x-www-form-urlencoded" predata["User-agent"] = useragent instead works fine. ---------------------------------------------------------------------- >Comment By: Francesco Cosoleto (cosoleto) Date: 2007-12-09 15:30 Message: Logged In: YES user_id=181280 Originator: NO Can anyone provide URL to test this feature? ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2007-12-09 14:59 Message: Logged In: YES user_id=1327030 Originator: NO Fixed in r4659. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1844339&group_…

1 0

SVN: [4662] trunk/pywikipedia/checkimages.py
by filnik＠svn.wikimedia.org 09 Dec '07

09 Dec '07

Revision: 4662 Author: filnik Date: 2007-12-09 14:23:00 +0000 (Sun, 09 Dec 2007) Log Message: ----------- Updated. Now it uses pagegenerator. Rewrite of some parts Modified Paths: -------------- trunk/pywikipedia/checkimages.py Modified: trunk/pywikipedia/checkimages.py =================================================================== --- trunk/pywikipedia/checkimages.py 2007-12-09 14:01:24 UTC (rev 4661) +++ trunk/pywikipedia/checkimages.py 2007-12-09 14:23:00 UTC (rev 4662) @@ -127,27 +127,27 @@ # if the file has an unknown extension it will be tagged with this template. # In reality, there aren't unknown extension, they are only not allewed... ^__^ delete_immediately = { - 'commons':"{{db-meta|The file has .%s as extension.}}", - 'en' :"{{db-meta|The file has .%s as extension.}}", - 'it' :'{{cancella subito|motivo=Il file ha come estensione ".%s"}}', - 'hu' :u'{{azonnali|A fájlnak .%s a kiterjesztése}}', - } + 'commons':"{{db-meta|The file has .%s as extension.}}", + 'en' :"{{db-meta|The file has .%s as extension.}}", + 'it' :'{{cancella subito|motivo=Il file ha come estensione ".%s"}}', + 'hu' :u'{{azonnali|A fájlnak .%s a kiterjesztése}}', + } # The header of the Unknown extension's message. delete_immediately_head = { - 'commons':"\n== Unknown extension! ==\n", - 'en' :"\n== Unknown extension! ==\n", - 'it' :'\n== File non specificato ==\n', - 'hu' :u'\n== Ismeretlen kiterjesztésű fájl ==\n', - } + 'commons':"\n== Unknown extension! ==\n", + 'en' :"\n== Unknown extension! ==\n", + 'it' :'\n== File non specificato ==\n', + 'hu' :u'\n== Ismeretlen kiterjesztésű fájl ==\n', + } # Text that will be add if the bot find a unknown extension. delete_immediately_notification = { - 'commons':'The [[:Image:%s]] file has a wrong extension, please check. ~~~~', - 'en' :'The [[:Image:%s]] file has a wrong extension, please check. ~~~~', - 'it' :'{{subst:Utente:Filbot/Ext|%s}}', - 'hu' :u'A [[:Kép:%s]] fájlnak rossz a kiterjesztése, kérlek ellenőrízd. ~~~~', - } + 'commons':'The [[:Image:%s]] file has a wrong extension, please check. ~~~~', + 'en' :'The [[:Image:%s]] file has a wrong extension, please check. ~~~~', + 'it' :'{{subst:Utente:Filbot/Ext|%s}}', + 'hu' :u'A [[:Kép:%s]] fájlnak rossz a kiterjesztése, kérlek ellenőrízd. ~~~~', + } # Summary of the delate immediately. (f.e: Adding {{db-meta|The file has .%s as extension.}}) del_comm = { 'commons':'Bot: Adding %s', @@ -242,6 +242,7 @@ class NothingFound(wikipedia.Error): """ An exception indicating that a regex has return [] instead of results.""" +# When the page is not a wiki-page (as for untagged generator) you need that function def pageText(url): try: request = urllib2.Request(url) @@ -252,7 +253,7 @@ response.close() # When you load to many users, urllib2 can give this error. except urllib2.HTTPError: - wikipedia.output(u"Server error. Pausing for 10 seconds... " + time.strftime("%d %b %Y %H:%M:%S (UTC)", time.gmtime()) ) + wikipedia.output(u"Server error. Pausing for 10 seconds... %s" % time.strftime("%d %b %Y %H:%M:%S (UTC)", time.gmtime()) ) time.sleep(10) request = urllib2.Request(url) user_agent = 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7' @@ -264,9 +265,9 @@ # Here there is the main class. class main: - def __init__(self, site): + def __init__(self, site, logFulNumber = 25000): self.site = site - self.logFulNumber = 25000 + self.logFulNumber = logFulNumber def general(self, newtext, image, notification, head, botolist): """ This class can be called for two reason. So I need two different __init__, one with common data and another with the data that I required... maybe it can be added on the other function, but in this way @@ -307,7 +308,7 @@ self.report_image(rep_page, self.image, com, repme) return False luser = wikipedia.url2link(nick, self.site, self.site) - pagina_discussione = self.site.namespace(3) + ':' + luser + pagina_discussione = "%s:%s" % (self.site.namespace(3), luser) # Defing the talk page (pagina_discussione = talk_page ^__^ ) talk_page = wikipedia.Page(self.site, pagina_discussione) self.talk_page = talk_page @@ -332,7 +333,7 @@ history = talk_page.getVersionHistory(False, False, False) latest_edit = history[0] latest_user = latest_edit[2] - wikipedia.output(u'The latest user that has written something is: ' + latest_user) + wikipedia.output(u'The latest user that has written something is: %s' % latest_user) else: wikipedia.output(u'The user page is blank') @@ -360,53 +361,28 @@ else: commentox = commx if second_text == True: - talk_page.put(testoattuale + "\n\n:" + notification2, comment = commentox, minorEdit = False) + talk_page.put("%s\n\n:%s" % (testoattuale, notification2), comment = commentox, minorEdit = False) elif second_text == False: talk_page.put(testoattuale + head + notification, comment = commentox, minorEdit = False) - def run_bot(self, textrun, rep_page, com): - # Search regular expression to find links like this (and the class attribute is optional too) - # class="new" title="Immagine:Soldatino2.jpg">Immagine:Soldatino2.jpg</a>" ‎ <span class="comment"> - regexp = r'(class=\"new\" |)title=\"' + image_namespace + '(.*?)\.(\w\w\w|jpeg)\">.*?</a>\".*?<span class=\"comment\">' - pos = 0 - done = list() - ext_list = list() - r = re.compile(regexp, re.UNICODE) - while 1: - m = r.search(textrun, pos) - if m == None: - wikipedia.output(u"\t\t>> All images checked. <<") - break - pos = m.end() - new = m.group(1) - im = m.group(2) - ext = m.group(3) - # This prevent pages with strange characters. They will be loaded without problem. - image = im + "." + ext - if new != '': - wikipedia.output(u"Skipping %s because it has been deleted." % image) - done.append(image) - if image not in done: - done.append(image) - yield image - #continue - + def untaggedGenerator(self, untaggedProject, rep_page, com): lang = untaggedProject.split('.', 1)[0] - project = '.' + untaggedProject.split('.', 1)[1] + project = '.%s' % untaggedProject.split('.', 1)[1] if lang == 'commons': link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikifam=comm…' else: - link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikilang=' + lang + '&wikifam=' + project + '&order=img_timestamp&max=' + str(limit) + '&ofs=0&max=' + str(limit) + link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikilang=%s&…' % (lang, project, limit, limit) text = pageText(link) #print text - regexp = r"""<td valign='top' title='Name'><a href='http://.*?\..*?\.org/w/index\.php\?title=(.*?)'>.*?</a></td>""" + regexp = r"""<td valign='top' title='Name'><a href='http://.*?\.org/w/index\.php\?title=(.*?)'>.*?</a></td>""" results = re.findall(regexp, text) if results == []: print link raise NothingFound('Nothing found! Try to use the tool by yourself to be sure that it works!') else: for result in results: - yield wikipedia.Page(self.site, result) + wikiPage = wikipedia.Page(self.site, result) + yield wikiPage def regexGenerator(self, regexp, textrun): pos = 0 @@ -430,9 +406,9 @@ # title="Immagine:Nvidia.jpg" wikipedia.output(u'Checking if %s is on commons...' % image) commons = wikipedia.getSite('commons', 'commons') - if wikipedia.Page(commons, u'Image:' + image).exists(): + if wikipedia.Page(commons, u'Image:%s' % image).exists(): wikipedia.output(u'%s is on commons!' % image) - imagePage = wikipedia.ImagePage(self.site, 'Image:' + image) + imagePage = wikipedia.ImagePage(self.site, 'Image:%s' % image) on_commons_text = imagePage.getImagePageHtml() if "<div class='sharedUploadNotice'>" in on_commons_text: wikipedia.output(u"But, the image doesn't exist on your project! Skip...") @@ -459,7 +435,7 @@ else: text_get = str() if len(text_get) >= self.logFulNumber: - raise LogIsFull("The log page (%s) is full! Please delete the old images reported." % another_page.title()) + raise LogIsFull("The log page (%s) is full! Please delete the old images reported." % another_page.title()) pos = 0 # The talk page includes "_" between the two names, in this way i replace them to " " regex = image @@ -622,7 +598,7 @@ firstPageTitle = str(wikipedia.input(u'From witch page do you want to start?')) elif len(arg) > 6: firstPageTitle = str(arg[7:]) - generator = wikipedia.getSite().allpages(start='Image:'+firstPageTitle) + generator = wikipedia.getSite().allpages(start='Image:%s' % firstPageTitle) repeat = False elif arg.startswith('-page:'): if len(arg) == 6: @@ -651,7 +627,7 @@ catName = str(wikipedia.input(u'In which category do I work?')) elif len(arg) > 4: catName = str(arg[5:]) - catSelected = catlib.Category(wikipedia.getSite(), 'Category:'+catName) + catSelected = catlib.Category(wikipedia.getSite(), 'Category:%s' % catName) generator = pagegenerators.CategorizedPageGenerator(catSelected) repeat = False elif arg.startswith('-untagged'): @@ -666,10 +642,7 @@ generator except NameError: normal = True - - # URL of the log of newimages. (http:/en.wikipedia.org/ will generated according to the project... you won't see it in the url) - url = "/w/index.php?title=Special:Log&type=upload&user=&page=&pattern=&limit=%d&offset=0" % limit - + # Define the site. site = wikipedia.getSite() @@ -679,7 +652,7 @@ # Block of text to translate the parameters set above. image_n = site.image_namespace() - image_namespace = image_n + ":" + image_namespace = "%s:" % image_n unvertext = wikipedia.translate(site, n_txt) commento = wikipedia.translate(site, comm) commento2 = wikipedia.translate(site, comm2) @@ -715,7 +688,7 @@ wikipedia.output(u"Your project is not supported by this script. You have to edit the script and add it!") wikipedia.stopme() - di = '\n' + di + di = '\n%s' % di dels = dels % di # Reading the log of the new images @@ -725,18 +698,13 @@ else: wikipedia.output(u"Retrieving the lastest %d files for checking..." % limit) - while 1: - # If I use the standard way, I have to download the page to parse it. - if normal == True: - textrun = site.getUrl(url) - + while 1: mainClass = main(site) if untagged == True: generator = mainClass.untaggedGenerator(projectUntagged, rep_page, com) normal = False if normal == True: - generator = mainClass.run_bot(textrun, rep_page, com) - + generator = pagegenerators.newImages(limit, site) if urlUsed == True and regexGen == True: textRegex = pagetext(regexPageUrl) elif regexGen == True: @@ -764,28 +732,27 @@ wikipedia.output(u"No additional settings found!") if skip == True: skip_list = list() - wikipedia.output(u'Skipping the first ' + str(skip_number) + u' images:\n') + wikipedia.output(u'Skipping the first %s images:\n' % skip_number) else: wikipedia.output(u'\t\t>> No images to skip...<<') skipok = False for image in generator: if normal == False and regexGen == False: - if image_namespace not in image.title(): + if image_namespace.lower() not in image.title().lower() and \ + 'image:' not in image.title().lower(): continue - image = image.title().split(image_namespace)[1] - elif regexGen == True: - image = image.split(image_namespace)[1] + imageName = image.title().split(image_namespace)[1] if skip == True: if len(skip_list) < skip_number: - wikipedia.output(u'Skipping %s...' % image) - skip_list.append(image) + wikipedia.output(u'Skipping %s...' % imageName) + skip_list.append(imageName) continue else: if skipok == False: wikipedia.output('') skipok = True if commonsActive == True: - response = mainClass.checkImage(image) + response = mainClass.checkImage(imageName) if response == False: continue if tupla_written != None: @@ -794,17 +761,17 @@ parentesi = False delete = False tagged = False - extension = image.split('.')[-1] - page = image_namespace + image - p = wikipedia.ImagePage(site, page) + extension = imageName.split('.')[-1] + # Page => ImagePage + p = wikipedia.ImagePage(site, image.title()) # Skip deleted images try: g = p.get() except wikipedia.NoPage: - wikipedia.output(u"Skipping %s because it has been deleted." % image) + wikipedia.output(u"Skipping %s because it has been deleted." % imageName) continue except wikipedia.IsRedirectPage: - wikipedia.output(u"The file description for %s is a redirect?!" % image ) + wikipedia.output(u"The file description for %s is a redirect?!" % imageName ) continue for l in hiddentemplate: if l.lower() in g.lower(): @@ -841,7 +808,7 @@ summary = tupla[5] head_2 = tupla[6] text = tupla[7] - text = text % image + text = text % imageName mexCatched = tupla[8] wikipedia.setAction(summary) del tupla[0:8] @@ -867,9 +834,9 @@ mex_used = mexCatched continue if p.exists(): - # Here there is the checkin ^^ + # Here begins the check block. if tagged == True: - wikipedia.output(image + u' is already tagged... ' + time.strftime("%H:%M:%S", time.localtime())) + wikipedia.output(u'%s is already tagged... %s' % (imageName, time.strftime("%H:%M:%S", time.localtime()))) continue if some_problem == True: if mex_used in g: @@ -884,13 +851,13 @@ reported = True if reported == True: #if imagestatus_used == True: - report(mex_used, image, text_used, "\n" + head_used + "\n", None, imagestatus_used, summary_used) + report(mex_used, imageName, text_used, "\n%s\n" % head_used, None, imagestatus_used, summary_used) else: wikipedia.output(u"Skipping the image...") some_problem = False continue elif parentesi == True: - wikipedia.output(image + u" seems ok, " + time.strftime("%H:%M:%S", time.localtime())) + wikipedia.output(u"%s seems ok, %s" % (imageName, time.strftime("%H:%M:%S", time.localtime()))) # It works also without this... but i want only to be sure ^^ parentesi = False continue @@ -901,7 +868,7 @@ canctext = di % extension notification = din % image head = dih - report(canctext, image, notification, head) + report(canctext, imageName, notification, head) delete = False continue elif g in nothing: @@ -914,7 +881,7 @@ notification = nn else: notification = nn % image - report(unvertext, image, notification, head, smwl) + report(unvertext, imageName, notification, head, smwl) continue else: wikipedia.output(u"%s has only text and not the specific license..." % image) @@ -926,11 +893,11 @@ notification = nn else: notification = nn % image - report(unvertext, image, notification, head, smwl) + report(unvertext, imageName, notification, head, smwl) continue # A little block to perform the repeat or to break. if repeat == True: - wikipedia.output(u"Waiting for " + str(time_sleep) + u" seconds, " + time.strftime("%d %b %Y %H:%M:%S (UTC)", time.localtime()) ) + wikipedia.output(u"Waiting for %s seconds, %s" % (time_sleep, time.strftime("%d %b %Y %H:%M:%S (UTC)", time.localtime()))) time.sleep(time_sleep) elif repeat == False: wikipedia.output(u"\t\t\t>> STOP! <<")

1 0

[ pywikipediabot-Bugs-1843759 ] [patch] image.py doesn't work
by SourceForge.net 09 Dec '07

09 Dec '07

Bugs item #1843759, was opened at 2007-12-04 01:38 Message generated for change (Settings changed) made by cosoleto You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1843759&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: other Group: None >Status: Closed >Resolution: Fixed Priority: 5 Private: No Submitted By: Pietro Battiston (toobaz) Assigned to: Nobody/Anonymous (nobody) Summary: [patch] image.py doesn't work Initial Comment: The following command: python image.py pippo.png gives the following output: Checked for running processes. 1 processes currently running, including the current process. 'Page' object has no attribute 'usingPages' The problem is that oldImagePage is an instance of wikipedia.Page instead of wikipedia.ImagePage. I attach a very simple patch that fixes it. Then, everything works. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2007-12-09 12:52 Message: Logged In: YES user_id=1327030 Originator: NO Fixed in r4649. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1843759&group_…

1 0

[ pywikipediabot-Bugs-1845158 ] Update namespaces for 'qu' Wikipedia
by SourceForge.net 09 Dec '07

09 Dec '07

Bugs item #1845158, was opened at 2007-12-06 00:12 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1845158&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: Update namespaces for 'qu' Wikipedia Initial Comment: Please update namespaces for Wikipedia language 'qu'. I'm getting many namespace mismatch matches when processing categories. Thanks! ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2007-12-09 16:08 Message: Logged In: YES user_id=1327030 Originator: NO Testing the language, I can't see any message about it. Is it still a problem? If so, please copy the messages to here. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1845158&group_…

1 0

← Newer
1
...
21
22
23
24
25
26
27
...
32
Older →

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l December 2007