Pywikipedia-l June 2008

pywikipedia-l@lists.wikimedia.org

32 participants
449 discussions

replace.py - how to narrow down the results?
by Chris Watkins 02 Jul '08

02 Jul '08

I am running replace.py and have several questions. Any help on any of the questions would be appreciated. * Can I replace only the first result per page? * Can I exclude hits within a wikilink, url or header? E.g. can I look for appropriate technology but ensure it's not inside a wikilink, e.g. * [[Peter's appropriate technology lamp]] or * [[Wikipedia:Appropriate technology|appropriate technology stuff at Wikipedia]]) or * http://forum.permaculture.org (if I'm looking for "permaculture"). * == Permaculture program == Thanks - and thanks also to Merlijn van Deen for answering my last question. -- Chris Watkins (a.k.a. Chriswaterguy) Appropedia.org - Sharing knowledge to build rich, sustainable lives. Blog: chriswaterguy.livejournal.com/ Buying at Amazon, eBay etc? Start at http://appropedia.maatiam.com and a percentage of your purchase supports Appropedia - at no extra cost. Where men are the most sure and arrogant, they are commonly the most mistaken, and have there given reins to passion, without that proper deliberation and suspense, which can alone secure them from the grossest absurdities. -- David Hume

2 3

KeyboardInterrupt loses all changes
by Chris Watkins 01 Jul '08

01 Jul '08

When using replace.py without the -always parameter, I've found a serious problem: If I accidentally interrupt the operation,* I get a message like the following, "Waiting for xx pages to be put. Estimated time remaining: xxxxx" - however, it fails to make the changes, even when I leave it a long time. If I've made a lot of changes, this is a very big problem. The full output is shown below. *I wanted to copy a page name to edit manually, and reflexively used ctrl+C to copy, but of course this is a KeyboardInterrupt. It's very ingrained habit, and realistically I'm likely to make the same mistake in future. -- Do you want to accept these changes? ([y]es, [N]o, [e]dit, open in [b]rowser, [a]ll, [q]uit) Traceback (most recent call last): File "/home/cwg/pwb/pagegenerators.py", line 763, in __iter__ yield loaded_page GeneratorExit Traceback (most recent call last): File "replace.py", line 694, in <module> main() File "replace.py", line 690, in main bot.run() File "replace.py", line 387, in run ['y', 'N', 'e', 'b', 'a', 'q'], 'N') File "/home/cwg/pwb/wikipedia.py", line 6228, in inputChoice data = ui.inputChoice(question, answers, hotkeys, default).lower() File "/home/cwg/pwb/userinterfaces/terminal_interface.py", line 261, in inputChoice answer = self.input(prompt) File "/home/cwg/pwb/userinterfaces/terminal_interface.py", line 238, in input text = raw_input() KeyboardInterrupt Waiting for 67 pages to be put. Estimated time remaining: 0:11:10 -- Chris Watkins (a.k.a. Chriswaterguy) Appropedia.org - Sharing knowledge to build rich, sustainable lives. Blog: chriswaterguy.livejournal.com/ Buying at Amazon, eBay etc? Start at http://appropedia.maatiam.com and a percentage of your purchase supports Appropedia - at no extra cost. Where men are the most sure and arrogant, they are commonly the most mistaken, and have there given reins to passion, without that proper deliberation and suspense, which can alone secure them from the grossest absurdities. -- David Hume

2 6

[ pywikipediabot-Bugs-2007115 ] SyntaxError: invalid syntax
by SourceForge.net 30 Jun '08

30 Jun '08

Bugs item #2007115, was opened at 2008-06-30 23:03 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2007115&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: other Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: H92-nowiki (h92-nowiki) Assigned to: Nobody/Anonymous (nobody) Summary: SyntaxError: invalid syntax Initial Comment: python version.py output: Pywikipedia [http] trunk/pywikipedia (r5660, Jun 30 2008, 13:04:44) Python 2.5.1 (r251:54869, Apr 18 2007, 22:08:04) [GCC 4.0.1 (Apple Computer, Inc. build 5367)] OK: Recently, clean_sandbox.py, replace.py, template.py and more have failed, producing the same message: File "/[blablabla]/clean_sandbox.py", line 55 <<<<<<< .mine ^ SyntaxError: invalid syntax The other scripts I mentioned also produce this (but with another line number), replace.py produces line 156 for instance. What is this, how can it be fixed? Oh, and I apologize for any mistakes in this report, it's my first time. :) Best regards, w:no:User:H92 ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2007115&group_…

1 0

SVN: [5662] trunk/pywikipedia/category_redirect.py
by multichill＠svn.wikimedia.org 30 Jun '08

30 Jun '08

Revision: 5662 Author: multichill Date: 2008-06-30 19:48:07 +0000 (Mon, 30 Jun 2008) Log Message: ----------- Tool to clean up http://commons.wikimedia.org/wiki/Category:Non-empty_category_redirects Added Paths: ----------- trunk/pywikipedia/category_redirect.py Added: trunk/pywikipedia/category_redirect.py =================================================================== --- trunk/pywikipedia/category_redirect.py (rev 0) +++ trunk/pywikipedia/category_redirect.py 2008-06-30 19:48:07 UTC (rev 5662) @@ -0,0 +1,71 @@ +#!/usr/bin/python +# -*- coding: utf-8 -*- +""" +Script to clean up http://commons.wikimedia.org/wiki/Category:Non-empty_category_redirects + +Moves all images, pages and categories in redirect categories to the target category. + +""" + +# +# (C) Multichill, 2008 +# +# Distributed under the terms of the MIT license. +# + +import wikipedia, config, catlib +from category import * + +redirect_templates = [u'Category redirect', u'Categoryredirect', u'See cat', u'Seecat', u'Catredirect', u'Cat redirect', u'CatRed', u'Catredir'] +move_message = u'Moving from [[%s|%s]] to [[%s|%s]] (following [[Template:Category redirect|category redirect]])' + +def get_redirect_cat(category=None): + ''' + Return the target category + ''' + destination = None + site = wikipedia.getSite(u'commons', u'commons') + for template in category.templatesWithParams(): + if ((template[0] in redirect_templates) and (len(template[1]) > 0)): + #destination = template[1][0]; + destination =catlib.Category(site, template[1][0]) + if not destination.exists(): + return None + return destination + + +def main(): + ''' + Main loop. Loop over all categories of Category:Non-empty_category_redirects and move all content. + ''' + + site = wikipedia.getSite(u'commons', u'commons') + dirtycat = catlib.Category(site, u'Category:Non-empty category redirects') + destination = None + catbot = None + + for old_category in dirtycat.subcategories(): + destination = get_redirect_cat(old_category) + if destination: + wikipedia.output(destination.title()) + for page in old_category.articles(): + try: + catlib.change_category(page, old_category, destination, move_message % (old_category.title(), old_category.titleWithoutNamespace(), destination.title(), destination.titleWithoutNamespace())) + except wikipedia.IsRedirectPage: + wikipedia.output(page.title() + u' is a redirect!') + for cat in old_category.subcategories(): + try: + catlib.change_category(cat, old_category, destination, move_message % (old_category.title(), old_category.titleWithoutNamespace(), destination.title(), destination.titleWithoutNamespace())) + except wikipedia.IsRedirectPage: + wikipedia.output(page.title() + u' is a redirect!') + #Dummy edit to refresh the page, shouldnt show up in any logs. + try: + old_category.put(old_category.get()) + except: + wikipedia.output(u'Dummy edit at ' + old_category.title() + u' failed') + +if __name__ == "__main__": + try: + main() + finally: + wikipedia.stopme()

1 0

SVN: [5661] trunk/pywikipedia/movepages.py
by leogregianin＠svn.wikimedia.org 30 Jun '08

30 Jun '08

Revision: 5661 Author: leogregianin Date: 2008-06-30 19:42:02 +0000 (Mon, 30 Jun 2008) Log Message: ----------- fixed generator movepages bot Modified Paths: -------------- trunk/pywikipedia/movepages.py Modified: trunk/pywikipedia/movepages.py =================================================================== --- trunk/pywikipedia/movepages.py 2008-06-30 13:04:44 UTC (rev 5660) +++ trunk/pywikipedia/movepages.py 2008-06-30 19:42:02 UTC (rev 5661) @@ -279,7 +279,7 @@ bot.moveOne(page, pair[1]) if gen: preloadingGen = pagegenerators.PreloadingGenerator(gen) - bot = MovePagesBot(preloadingGen, prefix, delete, always, skipredirects) + bot = MovePagesBot(preloadingGen, prefix, delete, always, skipredirects, summary) bot.run() elif not fromToPairs: wikipedia.showHelp('movepages')

1 0

SVN: [5660] trunk/pywikipedia/wikipedia.py
by wikipedian＠svn.wikimedia.org 30 Jun '08

30 Jun '08

Revision: 5660 Author: wikipedian Date: 2008-06-30 13:04:44 +0000 (Mon, 30 Jun 2008) Log Message: ----------- replaceExcept(): added a regular expression for section headers (it was requested on the mailing list). Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-06-29 12:54:25 UTC (rev 5659) +++ trunk/pywikipedia/wikipedia.py 2008-06-30 13:04:44 UTC (rev 5660) @@ -3121,6 +3121,8 @@ exceptionRegexes = { 'comment': re.compile(r'(?s)'), + # section headers + 'header': re.compile(r'\r\n=+.+=+ *\r\n'), 'includeonly': re.compile(r'(?is)<includeonly>.*?</includeonly>'), 'math': re.compile(r'(?is)<math>.*?</math>'), 'noinclude': re.compile(r'(?is)<noinclude>.*?</noinclude>'),

1 0

[ pywikipediabot-Bugs-2006208 ] Undo decodeEsperantoX removal (r5563)
by SourceForge.net 29 Jun '08

29 Jun '08

Bugs item #2006208, was opened at 2008-06-29 23:58 Message generated for change (Comment added) made by melancholie You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2006208&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 9 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: Undo decodeEsperantoX removal (r5563) Initial Comment: I do not know why siebrand had problems with decodeEsperantoX(), see http://eo.wikipedia.org/w/index.php?title=Sunfloro&diff=1775705&oldid=15592… - but now I do have that problem (not with interwiki.py, but with featured.py and replace.py)! See http://eo.wikipedia.org/w/index.php?title=Vitamino_C&diff=prev&oldid=1819462 Characters are replaced to gxx, sxx etc., making templates unusable etc... As decodeEsperantoX() had been used for a very long time, please undo that change: http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/wikipedia.py?… ---------------------------------------------------------------------- >Comment By: Melancholie (melancholie) Date: 2008-06-30 00:19 Message: Logged In: YES user_id=2089773 Originator: YES See also: * http://eo.wikipedia.org/wiki/Vikipedio:Diskutejo#.22Laboro.22_de_robotistoj * http://eo.wikipedia.org/w/index.php?title=Historio_de_Unui%C4%9Dinta_Re%C4%… ---------------------------------------------------------------------- Comment By: Melancholie (melancholie) Date: 2008-06-30 00:00 Message: Logged In: YES user_id=2089773 Originator: YES http://eo.wikipedia.org/wiki/Speciala:Contributions/Melancholie (r5558 works; r5639 is broken)! ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2006208&group_…

1 0

[ pywikipediabot-Bugs-2006208 ] Undo decodeEsperantoX removal (r5563)
by SourceForge.net 29 Jun '08

29 Jun '08

Bugs item #2006208, was opened at 2008-06-29 23:58 Message generated for change (Comment added) made by melancholie You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2006208&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None >Priority: 9 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: Undo decodeEsperantoX removal (r5563) Initial Comment: I do not know why siebrand had problems with decodeEsperantoX(), see http://eo.wikipedia.org/w/index.php?title=Sunfloro&diff=1775705&oldid=15592… - but now I do have that problem (not with interwiki.py, but with featured.py and replace.py)! See http://eo.wikipedia.org/w/index.php?title=Vitamino_C&diff=prev&oldid=1819462 Characters are replaced to gxx, sxx etc., making templates unusable etc... As decodeEsperantoX() had been used for a very long time, please undo that change: http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/wikipedia.py?… ---------------------------------------------------------------------- >Comment By: Melancholie (melancholie) Date: 2008-06-30 00:00 Message: Logged In: YES user_id=2089773 Originator: YES http://eo.wikipedia.org/wiki/Speciala:Contributions/Melancholie (r5558 works; r5639 is broken)! ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2006208&group_…

1 0

[ pywikipediabot-Bugs-2006208 ] Undo decodeEsperantoX removal (r5563)
by SourceForge.net 29 Jun '08

29 Jun '08

Bugs item #2006208, was opened at 2008-06-29 23:58 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2006208&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: Undo decodeEsperantoX removal (r5563) Initial Comment: I do not know why siebrand had problems with decodeEsperantoX(), see http://eo.wikipedia.org/w/index.php?title=Sunfloro&diff=1775705&oldid=15592… - but now I do have that problem (not with interwiki.py, but with featured.py and replace.py)! See http://eo.wikipedia.org/w/index.php?title=Vitamino_C&diff=prev&oldid=1819462 Characters are replaced to gxx, sxx etc., making templates unusable etc... As decodeEsperantoX() had been used for a very long time, please undo that change: http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/wikipedia.py?… ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2006208&group_…

1 0

[ pywikipediabot-Patches-2005964 ] Update/optimization of featured.py
by SourceForge.net 29 Jun '08

29 Jun '08

Patches item #2005964, was opened at 2008-06-29 17:23 Message generated for change (Comment added) made by melancholie You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2005964&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None >Priority: 6 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: Update/optimization of featured.py Initial Comment: 1. added dsb summary 2. removed all namespace prefixes (else they just get obsolete with the time); using English standards in that patch (how to use module dicts?)... Diff patch is attached ;-) See also coloured diff: http://als.wikipedia.org/w/index.php?title=Benutzer%3AMelancholieBot%2Ffeat… ---------------------------------------------------------------------- >Comment By: Melancholie (melancholie) Date: 2008-06-29 17:26 Message: Logged In: YES user_id=2089773 Originator: YES Note: The uz template namespace has been changed for example... ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603140&aid=2005964&group_…

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l June 2008