pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

Re: [Pywikipedia-l] Noisy interwiki.py
by info＠gno.de 28 Dec '11

28 Dec '11

I am wondering. ring_bell is set to False in the config.py since pyrev: 4469. http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/config.py?r1=… Greetings xqt

1 0

[Pywikipedia-l] aslink deprecated
by Bináris 27 Dec '11

27 Dec '11

Once pywiki claims at every processed item that aslink is deprecated, and title should be used instead, the description of Page object in wikipedia.py should be updated, too. aslink: currently in line 201, http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/wikipedia.py?… -- Bináris

2 1

[Pywikipedia-l] -exceptinsidetag:header - no longer working
by Chris Watkins 24 Dec '11

24 Dec '11

I have been using " -exceptinsidetag:header" with replace.py. This was added by Daniel Herding in response to a request by me: On Mon, Jun 30, 2008 at 23:11, Daniel Herding <DHerding(a)gmx.de> wrote: > > > This will exclude wikilinks and URLs. There are some more things that can > be > excluded, see the source code of the method replaceExcept() in wikipedia.py > (look at the exceptionRegexes dictionary). I have just added a regular > expression for section headers for you, so if you're running the SVN > version, > you can use this parameter: > > -exceptinsidetag:header > I seem to recall this working in a nightly version a couple of years ago, but it's not working now - I'm not sure when it stopped. Is it possible to put it back in? Thanks! -- Chris Watkins Appropedia.org - Sharing knowledge to build rich, sustainable lives.

2 3

[Pywikipedia-l] rewrite branch
by John Vandenberg 22 Dec '11

22 Dec '11

On Mon, Apr 25, 2011 at 7:49 AM, Merlijn van Deen <valhallasw(a)arctus.nl> wrote: > Whoo! Great work :-) Tests always are good contributions :-) Thanks ;-) I agree. > On a sidenote - is there a reason you're implementing these in 'trunk' and > not in 'rewrite'? Of course, these contributions are very welcome in the > trunk, but I still think it would be good to push the rewrite branch. I'm working off trunk because it is trunk. I'd assumed that the rewrite branch was a single-purpose branch to rewrite something, and that it would be merged back when it is stable. Is it stable? Is there any documentation on what the plans are for the rewrite branch? Is there a roadmap to finish it? Is see now that the rewrite branch has more unit tests, but more are needed. Is there a need to create a backwards compatibility layer? Or, is everyone except me using the rewrite branch? ;-) -- John Vandenberg

3 2

[Pywikipedia-l] Command line parameter autocompletion
by Tisza Gergo 17 Dec '11

17 Dec '11

Hi bot people, did anyone try creating command line autocompletion [1] for bot scripts? We are setting up a sort of toolserver for the bot owners on Hungarian Wikipedia, and trying to make it a comfortable environment, and parameter autocompletion would be a big step towards that. I'm interested both in quick and dirty hacks (my current plan is to grep out the arg.startswith parameters from the bot code and use them as a more or less correct argument list) and a long-term solution for making pywikipediabot parameter handling and help generation easy both for the bot programmer and the bot user. I'm thinking along the lines of defining a list of options, with a couple field for each options: short name, long name(s), help text, whether it takes an option (a bit like getopts in Linux, just with cleaner syntax). Some helper function would then process the command line based on that, and the bot programmer would just have to iterate trough the results, without all the ugly string manipulation that is currently required. This would have several advantages: - easier parameter handling and help text autogeneration - automatic generation of bash completion files - it could pave the way for moving towards a more linux-like command syntax with double dashes before long arguments and the other usual features - it would make it possible to create GUI controls for the bots, with auto-generated option fields What do you think about it? Am I overcomplicating, or reinventing the wheel, or is this worth doing? [1] https://www.gnu.org/software/bash/manual/bashref.html#Programmable-Completi…

2 1

[Pywikipedia-l] ThreadedGenerator
by Dr. Trigon 10 Dec '11

10 Dec '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all! I am updating (re-merging) DrTrigon framework with pywikipedia framework. During this process I recognized 'ThreadedGenerator' is not in pagegenerators.py anymore... Has it gone completely? Is there any replacement? Thanks and greetings Dr. Trigon -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk7aKwkACgkQAXWvBxzBrDDw6QCdHNAM8kC0rJQR1gTMVMQSd8IF 5j8An32M6LgCBIAdEs3A9myic1t9C6UF =1pbQ -----END PGP SIGNATURE-----

1 2

Re: [Pywikipedia-l] ThreadedGenerator
by info＠gno.de 03 Dec '11

03 Dec '11

See r9244: move ThreadedGenerator from pagegenerators to pywikibot/tools from rewrite r9067 Xqt

2 1

[Pywikipedia-l] How can we block IPs via PWB?
by Pedro Sanchez 12 Nov '11

12 Nov '11

Sorry for starting a new thread, I just suscribed. I ran into the same problem today and I think I know how to fix it. On userlib.py there are several checks before attempting to raise a block def block(self, expiry=None, reason=None, anon=True, noCreate=False, onAutoblock=False, banMail=False, watchUser=False, allowUsertalk=True, reBlock=False, hidename=False): if self._isAutoblock: #This user is probably being queried for purpose of lifting #an autoblock, so can't be blocked. raise AutoblockUser if self.isBlocked() and not reBlock: raise AlreadyBlocked() if not self.site().isAllowed('block', sysop=True): raise UserActionRefuse('You don\'t have permission to block') if not expiry: expiry = pywikibot.input(u'Please enter the expiry time for the block:') if not reason: reason = pywikibot.input(u'Please enter a reason for the block:') if (not self.site().has_api()) or self.site().versionnumber() < 12: return self._blockOld(expiry, reason, anon, noCreate, onAutoblock, banMail, watchUser, allowUsertalk, reBlock) params = { 'action': 'block', 'user': self.name(), 'token': self.site().getToken(self, sysop = True), 'reason': reason, } Notice last check: If the site doesn't have an API or version number is too old, then use a deprecated function to raise the block. We could add a check there as in if self.isAnonymous() or (not self.site().has_api()) or self.site().versionnumber() < 12: so if user is an IP, goes to the old method. However the error would persist. This because the checks above also need a user (user.isBlocked() fails for IP). quick hack would be moving this check at the top: def block(self, expiry=None, reason=None, anon=True, noCreate=False, onAutoblock=False, banMail=False, watchUser=False, allowUsertalk=True, reBlock=False, hidename=False): if self.isAnonymous() or (not self.site().has_api()) or self.site().versionnumber() < 12: return self._blockOld(expiry, reason, anon, noCreate, onAutoblock, banMail, watchUser, allowUsertalk, reBlock) if self._isAutoblock: #This user is probably being queried for purpose of lifting #an autoblock, so can't be blocked. raise AutoblockUser if self.isBlocked() and not reBlock: raise AlreadyBlocked() This way, if user = IP, goes directly into the depprecated ol method and doesn't execute the API-useronly functions. Now running gives :!python bloqueador.py Bloqueando 128.163.142.21 Traceback (most recent call last): File "bloqueador.py", line 86, in <module> main() File "bloqueador.py", line 79, in main bot.run() File "bloqueador.py", line 48, in run self.treat(user) File "bloqueador.py", line 62, in treat user.block(expiry="1 year", reason="Proxy", anon=True) File "/home/drini/pywiki/userlib.py", line 381, in block allowUsertalk, reBlock) TypeError: _blockOld() takes exactly 9 arguments (10 given) It seems code had another bug: _Blockold() doesn't accept a "reBlock" parameter: def _blockOld(self, expiry, reason, anonOnly, noSignup, enableAutoblock, emailBan, watchUser, allowUsertalk): So we fix again the call as if self.isAnonymous() or (not self.site().has_api()) or self.site().versionnumber() < 12: return self._blockOld(expiry, reason, anon, noCreate, onAutoblock, banMail, watchUser, allowUsertalk) It SHOULD work now... except I get a cryptic error: :!python bloqueador.py Bloqueando 128.163.142.21 Getting a token. Note: Your sysop account on wikipedia:es does not have a bot flag. Its edits will be visible in the recent changes. Blocking [[User:128.163.142.21]]... Traceback (most recent call last): File "bloqueador.py", line 86, in <module> main() File "bloqueador.py", line 79, in main bot.run() File "bloqueador.py", line 48, in run self.treat(user) File "bloqueador.py", line 62, in treat user.block(expiry="1 year", reason="Proxy", anon=True) File "/home/drini/pywiki/userlib.py", line 381, in block allowUsertalk) File "/home/drini/pywiki/userlib.py", line 471, in _blockOld raise BlockError userlib.BlockError shell returned 1 Hope it helps Amir, and if you find a solution, please tell since I'm stuck with the same problem Pedro Sánchez http://drini.mx @combinatorica

1 0

[Pywikipedia-l] Please approve me for commit access
by MJB 30 Oct '11

30 Oct '11

Hello , Tim Starling told me that i can ask here to approve me for commit access, i am working always with python and as i am working in Persian community, my codes is about working on Persian Wikis you can see a summary here <http://fa.wikinews.org/wiki/%DA%A9%D8%A7%D8%B1%D8%A8%D8%B1:Mjbmrbot#Robot_T…> and i would like to work on localization and some minor edits that would be helpful, here is example of my codes : # -*- coding: utf-8 -*- import wikipedia, urllib, re, os, datetime, calendar from xml.dom import minidom from time import strftime Lang="fa" Family="wikinews" RR = (u'??????', u'?????', u'????', u'?????', u'??', u'????', u'?????', u'???', u'???????', u'?????', u'??????', u'??????') RR2 = (u'January', u'February', u'March', u'April', u'May', u'June', u'July', u'August', u'September', u'October', u'November', u'December') RRfr = (u'janvier', u'février', u'mars', u'avril', u'mai', u'juin', u'juillet', u'août', u'septembre', u'octobre', u'novembre', u'décembre') RRfr2 = (u'Janvier', u'Février', u'Mars', u'Avril', u'Mai', u'Juin', u'Juillet', u'Août', u'Septembre', u'Octobre', u'Novembre', u'Décembre') RR3 = (31, 28, 31, 30, 31, 30, 31, 31, 30, 31, 30, 31) MMM = int(strftime("%m")) YYY = strftime("%Y") YYY2 = strftime("%Y") YYY = YYY.replace(u'1', u'1') YYY = YYY.replace(u'2', u'2') YYY = YYY.replace(u'3', u'3') YYY = YYY.replace(u'4', u'4') YYY = YYY.replace(u'5', u'5') YYY = YYY.replace(u'6', u'6') YYY = YYY.replace(u'7', u'7') YYY = YYY.replace(u'8', u'8') YYY = YYY.replace(u'9', u'9') YYY = YYY.replace(u'0', u'0') site = wikipedia.getSite(Lang, Family) FF = "" for i in range(1, RR3[MMM-1] + 1): site = wikipedia.getSite(Lang, Family) DD = str(i) DD2 = str(i) DDfr = str(i) if (DDfr==u'1'): DDfr = u"1er" DDfr2 = str(i) if (len(DDfr2)==1): DDfr2 = u'0' + DDfr2 DD = DD.replace(u'1', u'1') DD = DD.replace(u'2', u'2') DD = DD.replace(u'3', u'3') DD = DD.replace(u'4', u'4') DD = DD.replace(u'5', u'5') DD = DD.replace(u'6', u'6') DD = DD.replace(u'7', u'7') DD = DD.replace(u'8', u'8') DD = DD.replace(u'9', u'9') DD = DD.replace(u'0', u'0') FF = FF + u"== [[/" + DD + u'|' + DD + u' ' + RR[MMM-1] + u"]] ==\n{{/" + DD + u'}}\n\n' pagename = (u'???:' + DD + u' ' + RR[MMM-1] + u' ' + YYY) page = wikipedia.Page(site, pagename) AA = (u'[[???:' + RR[MMM-1] + u' ' + YYY + u']]\n[[???:' + DD + u' ' + RR[MMM-1] + u']]\n\n[[en:Category:' + RR2[MMM-1] + u' ' + DD2 + u', ' + YYY2 + u']]\n[[fr:Catégorie:' + DDfr + u' ' + RRfr[MMM-1] + u' ' + YYY2 + u']]') CCC = (u'????: ????? ???????? ??? ' + RR[MMM-1] + u' ' + YYY) wikipedia.output(u"Loading %s..." % pagename) try: text = page.get() except wikipedia.NoPage: print "Page doesn't exist, creating it ..." page.put(AA, comment=CCC, watchArticle = None, minorEdit = False) pagename = (u'???:' + DD + u' ' + RR[MMM-1]) page = wikipedia.Page(site, pagename) AA = (u'{{' + RR[MMM-1] + u'}}\n{{?????????|{{????????}}}}\n{{??????????-???|' + DD2 + u' ' + RR2[MMM-1] + u'}}\n\n[[en:Category:' + RR2[MMM-1] + u' ' + DD2 + u']]\n[[fr:Catégorie:' + DDfr + u' ' + RRfr[MMM-1] + u']]') CCC = (u'????: ????? ??????? ??? ' + RR[MMM-1]) wikipedia.output(u"Loading %s..." % pagename) try: text = page.get() except wikipedia.NoPage: print "Page doesn't exist, creating it ..." page.put(AA, comment=CCC, watchArticle = None, minorEdit = False) pagename = (u'????????:' + YYY + u'/' + RR[MMM-1] + u'/' + DD) page = wikipedia.Page(site, pagename) AA = (u'<onlyinclude>\n<DynamicPageList>\ncategory=????????\ncategory=' + DD + u' ' + RR[MMM-1] + u' ' + YYY + u'\nsuppresserrors=true\nstablepages=only\n</DynamicPageList>\n</onlyinclude>\n\n[[en:Wikinews:' + YYY2 + u'/' + RR2[MMM-1] + u'/' + DD2 + u']]\n[[fr:Wikinews:' + YYY2 + u'/' + RRfr[MMM-1] + u'/' + DDfr2 + u']]') CCC = (u'????: ????? ???????? ??? ' + RR[MMM-1] + u' ' + YYY) wikipedia.output(u"Loading %s..." % pagename) try: text = page.get() except wikipedia.NoPage: print "Page doesn't exist, creating it ..." page.put(AA, comment=CCC, watchArticle = None, minorEdit = False) pagename = (u'????????:' + YYY + u'/' + RR[MMM-1]) page = wikipedia.Page(site, pagename) FF = FF + u'[[???:' + RR[MMM-1] + u' ' + YYY + ']]\n\n[[en:Wikinews:' + YYY2 + u'/' + RR2[MMM-1] + u']]\n[[fr:Wikinews:' + YYY2 + u'/' + RRfr[MMM-1] + ']]' CCC = (u'????: ????? ????? ????? ?? ??? ' + RR[MMM-1] + u' ' + YYY) wikipedia.output(u"Loading %s..." % pagename) try: text = page.get() except wikipedia.NoPage: print "Page doesn't exist, creating it ..." page.put(FF, comment=CCC, watchArticle = None, minorEdit = False) pagename = (u'???:' + RR[MMM-1] + u' ' + YYY) page = wikipedia.Page(site, pagename) AA = (u'[[???:' + RR[MMM-1] + u']]\n[[???:'+ YYY + u']]\n\n[[en:Category:' + RR2[MMM-1] + u' ' + YYY2 + u']]\n[[fr:Catégorie:' + RRfr2[MMM-1] + u' ' + YYY2 + u']]') CCC = (u'????: ????? ???? ??? ' + RR[MMM-1] + u' ' + YYY) try: text = page.get() except wikipedia.NoPage: print "Page doesn't exist, creating it ..." page.put(AA, comment=CCC, watchArticle = None, minorEdit = False) pagename = (u'???:' + YYY) page = wikipedia.Page(site, pagename) AA = (u'{{???????????|' + YYY2 + u'}}\n\n[[???:????? ?? ???? ?????]]\n\n[[en:Category:' + YYY2 + u']]\n[[fr:Catégorie:' + YYY2 + u']]') CCC = (u'????: ????? ???? ??? ' + YYY) try: text = page.get() except wikipedia.NoPage: print "Page doesn't exist, creating it ..." page.put(AA, comment=CCC, watchArticle = None, minorEdit = False) This is a simple code that create date category pages and templates, my user name in wmf projects is Mjbmr and i have a bot with Mjbmrbot username that it have a global flag, I hope you accept my request, Regards -- Mjbmr

7 9

[Pywikipedia-l] Instantiating pages with ":" in title
by Morten Wang 24 Oct '11

24 Oct '11

Hi, I'm running into a problem with article titles that include ":", e.g. "Nomad: From Islam to America" (which exists on English Wikipedia: http://en.wikipedia.org/wiki/Nomad:_From_Islam_to_America ). I haven't been able to figure out if there's a way to instantiate pages like this one, neither through Google nor reading source code and trial & error. All I end up with is slamming into an exception because there's no "Nomad" family. Is there a simple and straightforward way to do this? Regards, Morten

4 5

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot