pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

[Pywikipedia-l] [JIRA] Created: (PYWP-5) Support for protecting non-existent pages
by Pietrodn (JIRA) 05 Jan '08

05 Jan '08

Support for protecting non-existent pages ----------------------------------------- Key: PYWP-5 URL: https://jira.ts.wikimedia.org/browse/PYWP-5 Project: pywikipedia Issue Type: New Feature Components: Framework Reporter: Pietrodn Attachments: svn.diff The developer have recently added to MediaWiki a new feature: a sysop can protect a non-existent page. http://bugzilla.wikimedia.org/show_bug.cgi?id=2919 I implemented this in pywikipedia, changing the Page.protect() function to support the "create" protection. The default is "sysop". There is a patch. Regards. Pietrodn -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.ts.wikimedia.org/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira

2 3

[Pywikipedia-l] SVN: [4817] trunk/pywikipedia/wikipedia.py
by rotem＠svn.wikimedia.org 05 Jan '08

05 Jan '08

Revision: 4817 Author: rotem Date: 2008-01-05 17:50:45 +0000 (Sat, 05 Jan 2008) Log Message: ----------- Making it possible to protect pages from creation, and fixing messages, per https://jira.ts.wikimedia.org/browse/PYWP-5 . Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-01-05 17:21:36 UTC (rev 4816) +++ trunk/pywikipedia/wikipedia.py 2008-01-05 17:50:45 UTC (rev 4817) @@ -2101,7 +2101,7 @@ #TODO: Check for errors below (have we succeeded? etc): return self.site().postForm(address,formdata,sysop=True) - def protect(self, edit='sysop', move='sysop', unprotect=False, + def protect(self, edit='sysop', move='sysop', create='sysop', unprotect=False, reason=None, prompt=True, throttle=True): """(Un)protect a wiki page. Requires administrator status. @@ -2134,10 +2134,12 @@ #Translate 'none' to '' if edit == 'none': edit = '' if move == 'none': move = '' + if create == 'none': create = '' predata = { 'mwProtect-level-edit': edit, 'mwProtect-level-move': move, + 'mwProtect-level-create': create, 'mwProtect-reason': reason } if token: @@ -2152,11 +2154,11 @@ data, response = self.site().postForm(address, predata, sysop = True) if not response: - output(u'(Un)protection successful.') + output(u'Changed protection level of page %s.' % self) return True else: #Normally, we expect a 302 with no data, so this means an error - output(u'Protection failed:') + output(u'Failed to change protection level of page %s:' % self) output(data) return False

1 0

[Pywikipedia-l] [ pywikipediabot-Feature Requests-1864162 ] Error interwiki.py and sysop account
by SourceForge.net 05 Jan '08

05 Jan '08

Feature Requests item #1864162, was opened at 2008-01-04 12:11 Message generated for change (Comment added) made by nobody You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1864162&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: Error interwiki.py and sysop account Initial Comment: I'm using a sysop bot to make some interwikies in protected pages in pt.wikinews. The bot finds a new interwikies, but the bot doesn't save. This bot have sysop at pt.wikinews and es.wikinews, because both wikies are protecting pages to prevent spam bot and another things. Here is a example: ======Post-processing [[pt:Milhares de pessoas fogem do furac├úo Katrina em Nova Orle├úes, nos EUA]]====== Updating links on page [[es:Numerosas personas huyen del hurac├ín Katrina en Nue va Orleans]]. No changes needed Updating links on page [[pt:Milhares de pessoas fogem do furac├úo Katrina em Nov a Orle├úes, nos EUA]]. Changes to be made: Modificando: [[en:Mandatory evacuation declared in New Orle ans, US]] + [[de:Angst vor dem Hurrikan: New Orleans wird evakuiert]] + [[en:Mandatory evacuation declared in New Orleans, US]] - [[en:Mandatory Evacuation declared in New Orleans]] - [[de:Angst vor dem Hurrikan: New Orleans wird evakuiert]] NOTE: Updating live wiki... Page is locked, using sysop account. Sleeping for 3.0 seconds, 2008-01-04 17:05:23 Changing page [[pt:Milhares de pessoas fogem do furac├úo Katrina em Nova Orle├úe s, nos EUA]] 200 OK WARNING: wikinews: [[pt:Milhares de pessoas fogem do furac├úo Katrina em Nova Or le├úes, nos EUA]] does not link to [[en:Mandatory evacuation declared in New Orl eans, US]] but to [[en:Mandatory Evacuation declared in New Orleans]] WARNING: wikinews: [[en:Mandatory evacuation declared in New Orleans, US]] links to incorrect [[nl:New-Orleans houdt hart vast voor komst Katrina]] ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2008-01-05 09:24 Message: Logged In: NO I view the html code and a user in pt.wn don't say me the truth about sysop bot. You can close the ticket :$ ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-05 00:57 Message: Logged In: YES user_id=1327030 Originator: NO It seems like an error Page.put didn't detect. Please replace line 1114 in your copy of interwiki.py: wikipedia.output(u'%s %s' % (status, reason)) (if this is not the line, update the file first) to: wikipedia.output("Data: %s" % data) (make sure to keep the spaces before the line!) and copy the results to here. This will output the whole HTML data from the server in case of error (note that it will contain many lines). Make sure to change the line to the previous text before using interwiki.py again. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1864162&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1864547 ] add_text damages interwiki encoding
by SourceForge.net 05 Jan '08

05 Jan '08

Bugs item #1864547, was opened at 2008-01-05 18:12 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1864547&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: add_text damages interwiki encoding Initial Comment: When running add_text.py on pl.wikipedia with: add_text.py -cat:"III wiek" -text:"{{Commonscat}}" -except:"\{\{(?:[Ss]zablon:|)[Cc]ommonscat}}" text is added correctly but the interwiki links encoding is destroyed ie. not UTF-8 anymore. example of live change: http://pl.wikipedia.org/w/index.php?title=201&diff=10859565&oldid=10786774 ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-05 19:23 Message: Logged In: YES user_id=1327030 Originator: NO Should be fixed in r4816. ---------------------------------------------------------------------- Comment By: Filnik (filnik) Date: 2008-01-05 18:29 Message: Logged In: YES user_id=1834469 Originator: NO Uhm, unfortunately that's a really big problem. I've tried almost everything, so I would be glad if anyone can help fixing the problem (search .decode(' in the code, you can't lose it). Maybe the old version works better (but I think not). Try http://botwiki.sno.cc/w/index.php?title=Python:Add_text.py&action=history until I can work on it. Filnik ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1864547&group_…

1 0

[Pywikipedia-l] SVN: [4816] trunk/pywikipedia/add_text.py
by rotem＠svn.wikimedia.org 05 Jan '08

05 Jan '08

Revision: 4816 Author: rotem Date: 2008-01-05 17:21:36 +0000 (Sat, 05 Jan 2008) Log Message: ----------- Using the predefined functions for categories and interwikies, should fix bug 1864547; fixing whitespace. Modified Paths: -------------- trunk/pywikipedia/add_text.py Modified: trunk/pywikipedia/add_text.py =================================================================== --- trunk/pywikipedia/add_text.py 2008-01-05 16:57:01 UTC (rev 4815) +++ trunk/pywikipedia/add_text.py 2008-01-05 17:21:36 UTC (rev 4816) @@ -102,7 +102,7 @@ if lang == 'commons': link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikifam=comm…' else: - link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikilang=' + lang + '&wikifam=' + project + '&order=img_timestamp&max=' + str(limit) + '&ofs=0&max=' + str(limit) + link = 'http://tools.wikimedia.de/~daniel/WikiSense/UntaggedImages.php?wikilang=' + lang + '&wikifam=' + project + '&order=img_timestamp&max=' + str(limit) + '&ofs=0&max=' + str(limit) text = pageText(link) #print text regexp = r"""<td valign='top' title='Name'><a href='http://.*?\.org/w/index\.php\?title=(.*?)'>.*?</a></td>""" @@ -147,12 +147,12 @@ text = oldTextGiven # Understand if the bot has to skip the page or not # In this way you can use both -except and -excepturl - if regexSkipUrl != None: + if regexSkipUrl != None: url = '%s%s' % (pathWiki, page.urlname()) result = re.findall(regexSkipUrl, site.getUrl(url)) if result != []: wikipedia.output(u'Exception! regex (or word) used with -exceptUrl is in the page. Skip!') - return (False, always) # continue + return (False, always) # continue if regexSkip != None: result = re.findall(regexSkip, text) if result != []: @@ -161,39 +161,18 @@ # If not up, text put below if not up: newtext = text - categoryNamespace = site.namespace(14) # Getting the categories - regexpCat = re.compile(r'\[\[((?:category|%s):.*?)\]\]' % categoryNamespace.lower(), re.I) - categorieInside = regexpCat.findall(text) + categoriesInside = wikipedia.getCategoryLinks(newtext, site) # Deleting the categories newtext = wikipedia.removeCategoryLinks(newtext, site) # Getting the interwiki - interwikiInside = page.interwiki() - interwikiList = list() - for paginetta in interwikiInside: - nome = str(paginetta).split('[[')[1].split(']]')[0] - interwikiList.append(nome) - lang = nome.split(':')[0] + interwikiInside = wikipedia.getLanguageLinks(newtext, site) # Removing the interwiki newtext = wikipedia.removeLanguageLinks(newtext, site) - # Sorting the interwiki - interwikiList.sort() - newtext += "\n%s" % addText + # Adding the text + newtext += u"\n%s" % addText # Reputting the categories - for paginetta in categorieInside: - try: - newtext += '\n[[%s]]' % paginetta.decode('utf-8') - except UnicodeDecodeError: - try: - newtext += '\n[[%s]]' % paginetta.decode('Latin-1') - except UnicodeDecodeError: - newtext += '\n[[%s]]' % paginetta.encode(site.encoding()) - except UnicodeEncodeError: - try: - newtext += '\n[[%s]]' % paginetta.encode('utf-8') - except UnicodeEncodeError: - newtext += '\n[[%s]]' % paginetta.encode(site.encoding()) - newtext += '\n' + newtext = wikipedia.replaceCategoryLinks(newtext, categoriesInside, site) # Dealing the stars' issue starsListInPage = list() for star in starsList: @@ -204,19 +183,7 @@ for element in risultato: newtext += '\n%s' % element # Adding the interwiki - for paginetta in interwikiList: - try: - newtext += '\n[[%s]]' % paginetta.decode('utf-8') - except UnicodeDecodeError: - try: - newtext += '\n[[%s]]' % paginetta.decode('Latin-1') - except UnicodeDecodeError: - newtext += '\n[[%s]]' % paginetta.encode(site.encoding()) - except UnicodeEncodeError: - try: - newtext += '\n[[%s]]' % paginetta.encode('utf-8') - except UnicodeEncodeError: - newtext += '\n[[%s]]' % paginetta.encode(site.encoding()) + newtext = wikipedia.replaceLanguageLinks(newtext, interwikiInside, site) # If instead the text must be added above... else: newtext = addText + '\n' + text @@ -233,13 +200,13 @@ if choice.lower() in ['a', 'all']: always = True if choice.lower() in ['n', 'no']: - return (False, always) + return (False, always) if choice.lower() in ['y', 'yes'] or always: try: page.put(newtext, summary) except wikipedia.EditConflict: wikipedia.output(u'Edit conflict! skip!') - return (False, always) + return (False, always) except wikipedia.ServerError: errorCount += 1 if errorCount < 5: @@ -250,20 +217,20 @@ raise wikipedia.ServerError(u'Fifth Server Error!') except wikipedia.SpamfilterError, e: wikipedia.output(u'Cannot change %s because of blacklist entry %s' % (page.title(), e.url)) - return (False, always) + return (False, always) except wikipedia.PageNotSaved, error: wikipedia.output(u'Error putting page: %s' % error.args) - return (False, always) + return (False, always) except wikipedia.LockedPage: wikipedia.output(u'Skipping %s (locked page)' % page.title()) - return (False, always) + return (False, always) else: # Break only if the errors are one after the other... errorCount = 0 - return (True, always) + return (True, always) else: return (text, newtext, always) - + def main(): # If none, the var is setted only for check purpose. summary = None; addText = None; regexSkip = None; regexSkipUrl = None; @@ -315,7 +282,7 @@ if not generator: raise NoEnoughData('You have to specify the generator you want to use for the script!') # Main Loop - for page in generator: + for page in generator: (status, always) = add_text(page, addText, summary, regexSkip, regexSkipUrl, always, up, True) if __name__ == "__main__":

1 0

[Pywikipedia-l] SVN: [4815] trunk/pywikipedia
by rotem＠svn.wikimedia.org 05 Jan '08

05 Jan '08

Revision: 4815 Author: rotem Date: 2008-01-05 16:57:01 +0000 (Sat, 05 Jan 2008) Log Message: ----------- Adding Hebrew translation, fix. Modified Paths: -------------- trunk/pywikipedia/add_text.py trunk/pywikipedia/standardize_interwiki.py Modified: trunk/pywikipedia/add_text.py =================================================================== --- trunk/pywikipedia/add_text.py 2008-01-05 16:44:54 UTC (rev 4814) +++ trunk/pywikipedia/add_text.py 2008-01-05 16:57:01 UTC (rev 4815) @@ -62,6 +62,7 @@ msg = { 'en': u'Bot: Adding %s', + 'he': u'בוט: מוסיף %s', 'it': u'Bot: Aggiungo %s', 'pt': u'Bot: Adicionando %s', } Modified: trunk/pywikipedia/standardize_interwiki.py =================================================================== --- trunk/pywikipedia/standardize_interwiki.py 2008-01-05 16:44:54 UTC (rev 4814) +++ trunk/pywikipedia/standardize_interwiki.py 2008-01-05 16:57:01 UTC (rev 4815) @@ -46,9 +46,9 @@ for arg in wikipedia.handleArgs(): if arg.startswith('-start'): if len(arg) == 6: - start = str(wikipedia.input(u'From what page do you want to start?')) + start = unicode(wikipedia.input(u'From what page do you want to start?')) else: - start = str(arg[7:]) + start = unicode(arg[7:]) # What follows is the main part of the code. try:

1 0

[Pywikipedia-l] SVN: [4814] trunk/pywikipedia/clean_sandbox.py
by leogregianin＠svn.wikimedia.org 05 Jan '08

05 Jan '08

Revision: 4814 Author: leogregianin Date: 2008-01-05 16:44:54 +0000 (Sat, 05 Jan 2008) Log Message: ----------- commons msg Modified Paths: -------------- trunk/pywikipedia/clean_sandbox.py Modified: trunk/pywikipedia/clean_sandbox.py =================================================================== --- trunk/pywikipedia/clean_sandbox.py 2008-01-05 16:38:37 UTC (rev 4813) +++ trunk/pywikipedia/clean_sandbox.py 2008-01-05 16:44:54 UTC (rev 4814) @@ -55,6 +55,7 @@ 'no': u'bot: Rydder sandkassa.', 'pl': u'Robot czyści brudnopis', 'pt': u'Bot: Limpeza da página de testes', + 'commons': u'Bot: This page will automatically be cleaned.', 'sv': u'Robot krattar sandlådan.', 'th': u'โรบอต: กำลังจะเก็บกวาดหน้านี้โดยอัตโนมัติ', 'zh': u'Bot: 本页被自动清理',

1 0

[Pywikipedia-l] SVN: [4813] trunk/pywikipedia/nowcommons.py
by leogregianin＠svn.wikimedia.org 05 Jan '08

05 Jan '08

Revision: 4813 Author: leogregianin Date: 2008-01-05 16:38:37 +0000 (Sat, 05 Jan 2008) Log Message: ----------- add {{ncd}} and {{nowcommons}} for en.wiki Modified Paths: -------------- trunk/pywikipedia/nowcommons.py Modified: trunk/pywikipedia/nowcommons.py =================================================================== --- trunk/pywikipedia/nowcommons.py 2008-01-05 16:24:11 UTC (rev 4812) +++ trunk/pywikipedia/nowcommons.py 2008-01-05 16:38:37 UTC (rev 4813) @@ -50,6 +50,10 @@ u'NCT', u'Nowcommons', ], + 'en': [ + u'NowCommons', + u'Ncd', + ], 'fr': [ u'Désormais sur Commons' ],

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1864547 ] add_text damages interwiki encoding
by SourceForge.net 05 Jan '08

05 Jan '08

Bugs item #1864547, was opened at 2008-01-05 16:12 Message generated for change (Comment added) made by filnik You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1864547&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: add_text damages interwiki encoding Initial Comment: When running add_text.py on pl.wikipedia with: add_text.py -cat:"III wiek" -text:"{{Commonscat}}" -except:"\{\{(?:[Ss]zablon:|)[Cc]ommonscat}}" text is added correctly but the interwiki links encoding is destroyed ie. not UTF-8 anymore. example of live change: http://pl.wikipedia.org/w/index.php?title=201&diff=10859565&oldid=10786774 ---------------------------------------------------------------------- Comment By: Filnik (filnik) Date: 2008-01-05 16:29 Message: Logged In: YES user_id=1834469 Originator: NO Uhm, unfortunately that's a really big problem. I've tried almost everything, so I would be glad if anyone can help fixing the problem (search .decode(' in the code, you can't lose it). Maybe the old version works better (but I think not). Try http://botwiki.sno.cc/w/index.php?title=Python:Add_text.py&action=history until I can work on it. Filnik ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1864547&group_…

1 0

[Pywikipedia-l] SVN: [4812] trunk/pywikipedia/fixing_redirects.py
by leogregianin＠svn.wikimedia.org 05 Jan '08

05 Jan '08

Revision: 4812 Author: leogregianin Date: 2008-01-05 16:24:11 +0000 (Sat, 05 Jan 2008) Log Message: ----------- typos Modified Paths: -------------- trunk/pywikipedia/fixing_redirects.py Modified: trunk/pywikipedia/fixing_redirects.py =================================================================== --- trunk/pywikipedia/fixing_redirects.py 2008-01-05 16:22:45 UTC (rev 4811) +++ trunk/pywikipedia/fixing_redirects.py 2008-01-05 16:24:11 UTC (rev 4812) @@ -166,7 +166,7 @@ namespace2 = int(wikipedia.input(u'Which namespace should be processed?')) else: namespace2 =int( arg[11:]) - for page in pagegenerators.AllpagesPageGenerator(start =start, namespace = namespace2, includeredirects = False): + for page in pagegenerators.AllpagesPageGenerator(start=start, namespace=namespace2, includeredirects=False): workon(page)

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot