pywikibot September 2007

pywikibot@lists.wikimedia.org

24 participants
397 discussions

[Pywikipedia-l] SVN: [4379] trunk/pywikipedia/image_replacer.py

by btongminh＠svn.wikimedia.org

Revision: 4379 Author: btongminh Date: 2007-09-29 10:33:52 +0000 (Sat, 29 Sep 2007) Log Message: ----------- Reworked the history fetching method Modified Paths: -------------- trunk/pywikipedia/image_replacer.py Modified: trunk/pywikipedia/image_replacer.py =================================================================== --- trunk/pywikipedia/image_replacer.py 2007-09-29 09:41:08 UTC (rev 4378) +++ trunk/pywikipedia/image_replacer.py 2007-09-29 10:33:52 UTC (rev 4379) @@ -10,7 +10,7 @@ # Distributed under the terms of the MIT license. # __version__ = '$Id$' -import config, wikipedia +import config, wikipedia, simplejson import re, time import threadpool import sys, os, signal, traceback @@ -74,8 +74,13 @@ else: since = None + if self.config.get('clean_list', False): + username = config.sysopnames[self.site.family.name][self.site.lang] + else: + username = None + try: - revisions = page.fullVersionHistory(max = 500, since = since) + revisions = self.get_history(page.title(), since, username) # Fetch the page any way, to prevent editconflicts old_text = text = page.get() except StandardError, e: @@ -84,18 +89,13 @@ output('%s: %s' % (e.__class__.__name__, str(e)), False) return time.sleep(self.config['timeout']) - if text.lower().find('{{stop}}') != -1: + if '{{stop}}' in text.lower(): output(u'Found {{stop}} on command page. Not replacing anything.') return time.sleep(self.config['timeout']) - revisions.sort(key = lambda rev: rev[0]) + revisions.sort(key = lambda rev: rev['timestamp']) replacements = self.template.finditer(text) - if self.config.get('clean_list', False): - username = config.sysopnames[self.site.family.name][self.site.lang] - else: - username = None - remove_from_list = [] for replacement in replacements: res = self.examine_revision_history( @@ -116,23 +116,38 @@ return except wikipedia.EditConflict: text = page.get() + + def get_history(self, title, since, username): + address = self.site.api_address() + predata = [ + ('action', 'query'), + ('prop', 'revisions'), + ('titles', title.encode('utf-8')), + ('rvprop', 'timestamp|user|comment|content'), + ('rvlimit', '50'), + ('format', 'json'), + ('rvend', since), + ('rvexcludeuser', username.encode('utf-8')) + ] + response, data = self.site.postForm(address, predata) + data = simplejson.loads(data) + if 'error' in data: + raise RuntimeError(data['error']) + + page = data['query']['pages'].values()[0] + if 'missing' in page: + raise Exception('Missing page!') + return page.get('revisions', ()) - def examine_revision_history(self, revisions, replacement, username): - #if replacement.group(0) in revisions[0][2]: - # return (db_timestamp(revisions[0][0]), - # strip_image(replacement.group(1)), - # strip_image(replacement.group(2)), - # '<Unknown>', replacement.group(3)) - - for timestamp, user, text in revisions: - if replacement.group(0) in text and user != username: + for revision in revisions: + if replacement.group(0) in revision['content']: db_time = db_timestamp(timestamp) if db_time < self.first_revision or not self.first_revision: self.first_revision = int(db_time) return (db_time, strip_image(replacement.group(1)), strip_image(replacement.group(2)), - user, replacement.group(3)) + revision['user'], replacement.group(3)) output('Warning! Could not find out who did %s' % \ repr(replacement.group(0)), False)

16 years, 6 months

[Pywikipedia-l] SVN: [4378] trunk/pywikipedia/splitwarning.py

by valhallasw＠svn.wikimedia.org

Revision: 4378 Author: valhallasw Date: 2007-09-29 09:41:08 +0000 (Sat, 29 Sep 2007) Log Message: ----------- Russblau, please confirm the code is working before committing ;) Modified Paths: -------------- trunk/pywikipedia/splitwarning.py Modified: trunk/pywikipedia/splitwarning.py =================================================================== --- trunk/pywikipedia/splitwarning.py 2007-09-29 07:32:34 UTC (rev 4377) +++ trunk/pywikipedia/splitwarning.py 2007-09-29 09:41:08 UTC (rev 4378) @@ -1,4 +1,4 @@ -# -*- coding: utf-8 -*- +# -*- coding: utf-8 -*- """Splits a interwiki.log file into chunks of warnings separated by language""" # # (C) Rob W.W. Hooft, 2003 @@ -29,7 +29,7 @@ if not files.has_key(code): files[code] = codecs.open( wikipedia.datafilepath('logs', - '/warning-%s-%s.log' % (family, code), + 'warning-%s-%s.log' % (family, code)), 'w', 'utf-8') count[code] = 0 files[code].write(line)

16 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Feature Requests-1777751 ] interwiki.py in categories

by SourceForge.net

Feature Requests item #1777751, was opened at 2007-08-20 09:17 Message generated for change (Comment added) made by nobody You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1777751&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki.py in categories Initial Comment: It would be helpful to add functionality to interwiki.py to work with categories and subcategories, not just with articles contained within, i.e. to treat category pages as they were normal articles. Additional key to existing -cat option or whatever, please. ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2007-09-29 02:03 Message: Logged In: NO Hum, I think that the 2 comments information under need to be add to the -help of interwiki.py ---------------------------------------------------------------------- Comment By: Marc-Etienne Vargenau (vargenau) Date: 2007-08-21 01:49 Message: Logged In: YES user_id=1118700 Originator: NO Hello, I do not know if this was the original question, but there is still something I cannot do with subcategories. Consider: http://en.wikipedia.org/wiki/Category:France The Category:France has 21 subcategories and 2 pages in it. python interwiki.py Category:France will work on the category itself. python interwiki.py -cat:France will work on the two pages France and Portal:France How do I work on the 21 subcategories (i.e. category:Communications in France, etc.)? Regards, Marc-Etienne ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2007-08-20 14:33 Message: Logged In: NO You can already work on categories interwiki. For example : python interwiki.py -start:Category:Spain ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1777751&group_…

16 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Bugs-1804648 ] interwiki block with protected pages

by SourceForge.net

Bugs item #1804648, was opened at 2007-09-29 01:54 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1804648&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki block with protected pages Initial Comment: Hello I would like to add a new fonction when interwiki want to edit a protected page. When interwiki want to edit an protected page, it want to use the sysop account if it exist. If interwiki can't use the sysop account, he stop this edition and go to the next on the todo list. I propose that interwiki add to the talk page this : " ==Interwiki checking by [[user:name_of_the_bot_]]== I would to change the interwiki links in this page, but the protection make that I can't. So, somebody would to make this : * Adding [[en:The_link_to_add] * Replace [[fr:The_link_to_replace]] * Erase [[es:The_link_to_erase]] Thanks. ~~~~ " ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1804648&group_…

16 years, 6 months

[Pywikipedia-l] SVN: [4377] trunk/pywikipedia/commons_link.py

by siebrand＠svn.wikimedia.org

Revision: 4377 Author: siebrand Date: 2007-09-29 07:32:34 +0000 (Sat, 29 Sep 2007) Log Message: ----------- Whitespace fixes Modified Paths: -------------- trunk/pywikipedia/commons_link.py Modified: trunk/pywikipedia/commons_link.py =================================================================== --- trunk/pywikipedia/commons_link.py 2007-09-29 07:27:45 UTC (rev 4376) +++ trunk/pywikipedia/commons_link.py 2007-09-29 07:32:34 UTC (rev 4377) @@ -47,7 +47,7 @@ def __init__(self, generator, acceptall = False): self.generator = generator self.acceptall = acceptall - + def pages(self): for page in self.generator: try: @@ -81,17 +81,17 @@ page.put(text, msg) except wikipedia.EditConflict: wikipedia.output(u'Skipping %s because of edit conflict' % (page.title())) - + except wikipedia.NoPage: wikipedia.output(u'Page does not exist in Commons!') - + except wikipedia.NoPage: wikipedia.output(u'Page %s does not exist?!' % page.title()) except wikipedia.IsRedirectPage: wikipedia.output(u'Page %s is a redirect; skipping.' % page.title()) except wikipedia.LockedPage: wikipedia.output(u'Page %s is locked?!' % page.title()) - + def categories(self): for page in self.generator: try: @@ -112,7 +112,7 @@ if s: wikipedia.output(u'** Already done.') else: - text = wikipedia.replaceCategoryLinks(text+u'{{commonscat|%s}}'%categoryname, page.categories()) + text = wikipedia.replaceCategoryLinks(text+u'{{commonscat|%s}}'%categoryname, page.categories()) if oldText != text: wikipedia.showDiff(oldText, text) if not self.acceptall: @@ -125,10 +125,10 @@ page.put(text, msg) except wikipedia.EditConflict: wikipedia.output(u'Skipping %s because of edit conflict' % (page.title())) - + except wikipedia.NoPage: wikipedia.output(u'Category does not exist in Commons!') - + except wikipedia.NoPage: wikipedia.output(u'Page %s does not exist?!' % page.title()) except wikipedia.IsRedirectPage: @@ -175,6 +175,6 @@ bot.categories() else: wikipedia.showHelp(u'commons_link') - + finally: wikipedia.stopme()

16 years, 6 months

[Pywikipedia-l] SVN: [4376] trunk/pywikipedia/commons_link.py

by siebrand＠svn.wikimedia.org

Revision: 4376 Author: siebrand Date: 2007-09-29 07:27:45 +0000 (Sat, 29 Sep 2007) Log Message: ----------- Fix 'SyntaxError: EOL while scanning single-quoted string' Modified Paths: -------------- trunk/pywikipedia/commons_link.py Modified: trunk/pywikipedia/commons_link.py =================================================================== --- trunk/pywikipedia/commons_link.py 2007-09-28 20:20:59 UTC (rev 4375) +++ trunk/pywikipedia/commons_link.py 2007-09-29 07:27:45 UTC (rev 4376) @@ -68,7 +68,7 @@ if s or s2: wikipedia.output(u'** Already done.') else: - text = wikipedia.replaceCategoryLinks(text+u'{{commons||%s}}'%commonspage.title()', page.categories()) + text = wikipedia.replaceCategoryLinks(text+u'{{commons||%s}}'%commonspage.title(), page.categories()) if oldText != text: wikipedia.showDiff(oldText, text) if not self.acceptall:

16 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Feature Requests-1804482 ] Query API CLI

by SourceForge.net

Feature Requests item #1804482, was opened at 2007-09-29 05:23 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1804482&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Priority: 5 Private: No Submitted By: John Vandenberg (zeroj) Assigned to: Nobody/Anonymous (nobody) Summary: Query API CLI Initial Comment: query.py provides access to the Query.php API, but there is no command line interface for it. The attached patch provides one. This patch on this bug needs to be fixed first: https://sourceforge.net/tracker/index.php?func=detail&aid=1804103&group_id=… ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1804482&group_…

16 years, 6 months

[Pywikipedia-l] SVN: [4374] branches/pywikipedia/messages

by huji＠svn.wikimedia.org

Revision: 4374 Author: huji Date: 2007-09-28 18:51:41 +0000 (Fri, 28 Sep 2007) Log Message: ----------- *Updating the translate() function, to work with a nested dictionary of messages. *Updating basic.py file accordingly. *This version is NOT a working version. *The rest of modules should also be updated according to the changes in wikipedia.py Modified Paths: -------------- branches/pywikipedia/messages/basic.py branches/pywikipedia/messages/wikipedia.py Modified: branches/pywikipedia/messages/basic.py =================================================================== --- branches/pywikipedia/messages/basic.py 2007-09-28 11:38:13 UTC (rev 4373) +++ branches/pywikipedia/messages/basic.py 2007-09-28 18:51:41 UTC (rev 4374) @@ -29,10 +29,6 @@ class BasicBot: # Edit summary message that should be used. # NOTE: Put a good description here, and add translations, if possible! - msg = { - 'de': u'Bot: Ändere ...', - 'en': u'Robot: changing ...', - } def __init__(self, generator, debug): """ @@ -47,7 +43,7 @@ def run(self): # Set the edit summary message - wikipedia.setAction(wikipedia.translate(wikipedia.getSite(), self.msg)) + wikipedia.setAction(wikipedia.translate(wikipedia.getSite(), 'test')) for page in self.generator: self.treat(page) Modified: branches/pywikipedia/messages/wikipedia.py =================================================================== --- branches/pywikipedia/messages/wikipedia.py 2007-09-28 11:38:13 UTC (rev 4373) +++ branches/pywikipedia/messages/wikipedia.py 2007-09-28 18:51:41 UTC (rev 4374) @@ -4635,12 +4635,12 @@ return [] -def translate(code, dict): +def translate(code, msg): """ - Given a language code and a dictionary, returns the dictionary's value for - key 'code' if this key exists; otherwise tries to return a value for an - alternative language that is most applicable to use on the Wikipedia in - language 'code'. + Given a language code and a message name, it returns the value appropriate + edit comment, according to message dictionary in message.py, if this key + exists; otherwise tries to return a value for an alternative language that + is most applicable to use on the Wikipedia in language 'code'. The language itself is always checked first, then languages that have been defined to be alternatives, and finally English. If none of the options gives result, we just take the first language in the @@ -4650,15 +4650,26 @@ if hasattr(code,'lang'): code = code.lang - if dict.has_key(code): - return dict[code] + #TEMP: Defined messages temporarily here + messages = {'en' : {'test' : u'Test message'}, 'test' : {'test' : u'Maesagi testi'}} + + if messages.has_key(code): + dict = messages[code] + if dict.has_key(msg): + return dict[msg] for alt in altlang(code): - if dict.has_key(alt): - return dict[alt] - if dict.has_key('en'): - return dict['en'] + if messages.has_key(alt): + dict = messages[alt] + if dict.has_key(msg): + return dict[msg] + if messages.has_key('en'): + dict = messages['en'] + if dict.has_key(msg): + return dict[msg] + dict = messages.values()[0] return dict.values()[0] + def showDiff(oldtext, newtext): """ Prints a string showing the differences between oldtext and newtext.

16 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Support Requests-1804183 ] Can't get valid graph file

by SourceForge.net

Support Requests item #1804183, was opened at 2007-09-28 14:31 Message generated for change (Comment added) made by malafaya You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1804183&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Deleted Priority: 5 Private: No Submitted By: André Malafaya Baptista (malafaya) Assigned to: Nobody/Anonymous (nobody) Summary: Can't get valid graph file Initial Comment: I tried generating a graph file for conflicting articles. I set interwiki_graph = True in user_config.py. I installed: pydot v0.9.10 pyparsing v1.4.7 GraphViz v2.1.4.1 I tried with format PNG, SVG and DOT and the result is always an empty file, i.e., wikipedia-pt-****.png is always zero bytes in length. What could be wrong? Thanks. ---------------------------------------------------------------------- >Comment By: André Malafaya Baptista (malafaya) Date: 2007-09-28 14:39 Message: Logged In: YES user_id=1037345 Originator: YES I had to restart the DOS prompt after installing GraphViz cause it looks for the executables in the PATH environment variable which was not updated in the old DOS prompt. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1804183&group_…

16 years, 6 months

[Pywikipedia-l] [ pywikipediabot-Support Requests-1804183 ] Can't get valid graph file

by SourceForge.net

Support Requests item #1804183, was opened at 2007-09-28 14:31 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1804183&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Priority: 5 Private: No Submitted By: André Malafaya Baptista (malafaya) Assigned to: Nobody/Anonymous (nobody) Summary: Can't get valid graph file Initial Comment: I tried generating a graph file for conflicting articles. I set interwiki_graph = True in user_config.py. I installed: pydot v0.9.10 pyparsing v1.4.7 GraphViz v2.1.4.1 I tried with format PNG, SVG and DOT and the result is always an empty file, i.e., wikipedia-pt-****.png is always zero bytes in length. What could be wrong? Thanks. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1804183&group_…

16 years, 6 months

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot September 2007