pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

[Pywikipedia-l] skip to next occurrence in a page?
by Chris Watkins 20 Nov '10

20 Nov '10

I'm using replace.py to create wikilinks. Usually I want to select only the first occurrence of the search string, and my command works fine for this. But sometimes, the first hit is not suitable (e.g. it's part of a book or course title, so I don't want to add the wikilink). If I choose n for no, the bot goes to the next page. Is there a way I can skip to the next occurrence in the same page? I'm guessing it will need a modified version of replace.py, so that it gives an extra option besides ([y]es, [N]o, [e]dit, open in [b]rowser, [a]ll, [q]uit) The actual command I'm using is: python replace.py -regex "(?si)\b((?:FOO1|FOO2))\b(.*$) " "[[\\1]]\\2" -exceptinsidetag:link -exceptinsidetag:hyperlink -exceptinsidetag:header -exceptinsidetag:nowiki -exceptinsidetag:ref -excepttext:"(?si)\[\[((?:FOO1|FOO2)[\|\]])" -namespace:0 -namespace:102 -namespace:4 -summary:"[[Appropedia:Wikilink bot]] adding double square brackets to: FOO1|FOO2." -log -xml:currentdump.xml Many thanks! -- Chris Watkins Appropedia.org - Sharing knowledge to build rich, sustainable lives. blogs.appropedia.org identi.ca/appropedia twitter.com/appropedia

4 7

[Pywikipedia-l] Minor comment changes
by Dr. Trigon 13 Nov '10

13 Nov '10

Hello all Just looked at the last svn chnages and thought this patch could be good to apply, in fact it just chnages some comments, but I think it's needed, may be you too. ;) I did not open a ticket since I do no think it is THAT relevant, beacuse it's not a bug. Greetings

2 2

[Pywikipedia-l] userlib.py: fix for KeyError bug #3097185
by Dr. Trigon 13 Nov '10

13 Nov '10

Hello xqt and valhallasw! Just wanted to give a final comment to this topic. ;) ---------------------------------------------------------------------- > >Comment By: xqt (xqt) Date: 2010-11-06 04:17 Message: KeyError fixed in r8701 as recommended Maybe there are follow-ups of this bug in other scripts depending of the comment is None ---------------------------------------------------------------------- THANKS A LOT FOR IMPLEMENTING THIS! ---------------------------------------------------------------------- Comment By: Merlijn S. van Deen (valhallasw) Date: 2010-11-04 14:44 Message: I disagree with the statement "an unicode string is expected and thus a None (..) is not a good idea". The comment is hidden, which is different from an empty comment. Using None is much more sensible. In addition, the code can be simplified by using contrib.get('comment', None) instead of the current if/the. ---------------------------------------------------------------------- YEA, I WAS NOT SURE WHICH ONE TO CHOOSE. 'None' SEAMS MORE SENSIBLE SOLUTION, BUT SINCE I WANTED NOT TO BREAK OTHER CODE... ;) INDEED, THE SIMPLIFIED CODE IS A LOT BETTER - I WAS FOCUSSED ON TRIGGERING TO 'commenthidden' WHICH IS NOT REALLY NEEDED. AFTER ALL WHEN I WAS LOOKING AT THE CODE THE 'None' GETS FED INTO A PAGE OBJECTS, SO THIS IS THE ONLY PART THAT COULD BREAK, AND SHOULD NOT AFFECT ANY OTHER CODE... SEAMS THE PERFECT SOLUTION. Greetings and thanks Dr. Trigon

1 0

[Pywikipedia-l] Yet another idea for replace.py -- please comment
by Bináris 09 Nov '10

09 Nov '10

Hi, I have an enhacement that I wrote for myself. Now, with replace.py r8700, using -xml and -save, we can collect the articles to work on in automatic mode. But sometimes it takes a lot of time, and we would like to know, whether it will end in the near future or needs more time. For example, I have to leave home, and I want to know if the task will end in 15 minutes or I have to quit it. The xml dump contains articles mainly in the order of their creation, so knowing the date of the first edit if the article on the screen is useful. It may cause a very few decreasing of speed. My replace.py writes this date on the screen after every 20th title if in automatic mode (but perhaps it could also be each title). The question is: is it worth to build into the framework for public use, or is it only in my interest? Shall I put it on SF or forget? -- Bináris

1 0

[Pywikipedia-l] match and list, but not replace
by Chris Watkins 07 Nov '10

07 Nov '10

I want to generate a list of matches for a search, but not do anything to the page. E.g. I want to list all pages that contain "redirect[[:Category", but I don't want to modify the pages. I guess that it's possible to modify redirect.py (I don't speak python, but it shouldn't be hard) and run it with -log. But maybe there's a simpler way? Thanks in advance. -- Chris Watkins Appropedia.org - Sharing knowledge to build rich, sustainable lives. blogs.appropedia.org community.livejournal.com/appropedia identi.ca/appropedia twitter.com/appropedia

5 11

[Pywikipedia-l] XMLreader.py
by emijrp 07 Nov '10

07 Nov '10

Hi all; I think that there is an error in xmlreader.py. When parsing a full revision XML (in this case[1]), using this code[2] (look at the try-catch, it writes when fails) I get correctly username, timestamp and revisionid, but sometimes, the page title and the page id are None or empty string. The first error is: ['', None, 'QuartierLatin1968', '2004-10-10T04:24:14Z', '4267'] But if we do: 7za e -bd -so kwwiki-20100926-pages-meta-history.xml.7z 2>/dev/null | egrep -i '2004-10-10T04::14Z' -C20 We get this[3], which is OK, the page title and the page id are available in the XML, but not correctly parsed. And this is not the only page title and page it that fails. Perhaps I have missed something, because I'm learning to parsing XML. Sorry in that case. Regards, emijrp [1] http://download.wikimedia.org/kwwiki/20100926/kwwiki-20100926-pages-meta-hi… [2] http://pastebin.ca/1951930 [3] http://pastebin.ca/1951937

4 16

[Pywikipedia-l] pagefromfile.py error
by kettner 04 Nov '10

04 Nov '10

Hi All, I had set up system such that every day the pymediawiki would insert a page into my local wiki (csdms.colorado.edu). This worked fine for a year till I updated to mediawiki 1.16.0 (from 1.15.4). Since than the pagefromfile.py isn't working anymore for me. I updated all the pywikipedia code, still no luck, the following error message is created (See below). I did a check to see if the family / user-config.py & password file is set up correctly, with "python login.py" and that works fine, the bot is able to log into the wiki. Also, "$wgEnableWriteAPI" is added to the LocalSettings.php file. Any idea what might go wrong? Thanks Albert. Error message after command: python ~/web/pywikipedia/pagefromfile.py -v -file:<some wikicoded.txt> -start:startpage -end:endpage -force ********ERROR*********** Requesting API query from csdms:en error occured, code:writeapidenied info:You're not allowed to edit this wiki through the API status:200 response:OK File "/home/faculty/kettner/web/pywikipedia/pagefromfile.py", line 348, in ? main() File "/home/faculty/kettner/web/pywikipedia/pagefromfile.py", line 344, in main bot.run() File "/home/faculty/kettner/web/pywikipedia/pagefromfile.py", line 154, in run self.put(title, contents) File "/home/faculty/kettner/web/pywikipedia/pagefromfile.py", line 211, in put page.put(contents, comment = comment, minorEdit = self.minor) File "/data/home/faculty/kettner/web/pywikipedia/wikipedia.py", line 1710, in put newPage, self.site().getToken(sysop = sysop), sysop = sysop, botflag=botflag, maxTries=maxTries) File "/data/home/faculty/kettner/web/pywikipedia/wikipedia.py", line 1861, in _putPage output("OriginalData:%s" % faked) File "/data/home/faculty/kettner/web/pywikipedia/wikipedia.py", line 7576, in output print traceback.print_stack() OriginalData:{'maxlag': '5', 'title': u'Model download Page', 'starttimestamp': '0', 'format': u'json', 'basetimestamp': u'20101103200220', 'summary': 'Automated import of articles *** existing text overwritten ***', 'token': u'864496fb7619522ce8cb49451cd856af+\\', 'bot': u'1', 'notminor': u'1', 'action': 'edit', 'nocreate': u'1'} Unknown Error. API Error code:writeapidenied Information:You're not allowed to edit this wiki through the API End of file. ********************** -- ******************************************************* Albert J. Kettner Research Scientist CSDMS, INSTAAR, Univ. of Colorado P.O.Box 545 Boulder, CO, 80309, USA http://csdms.colorado.edu/~kettner http://csdms.colorado.edu *****************************************************

1 0

[Pywikipedia-l] Internationalization
by Maarten Dammers 29 Oct '10

29 Oct '10

Hi everyone, Currently translation of messages outputted to the wiki's is done in source. This is quite tedious to maintain. A good step would be to move translations to http://www.translatewiki.org so it is much easier to get things translated. But how? We have several options. 1. Gettext: http://en.wikipedia.org/wiki/GNU_gettext Supported by translatewiki, build in support in python (http://docs.python.org/library/gettext.html), but it doesn't seem to be really targeted on working on multiple languages the same time like we do in for example interwiki.py. 2. Big python dictionary: Easy to implement in pywikipedia but isn't really a standard so translatewiki needs to be modified. You can see a test in r8684 3. Properties files: http://en.wikipedia.org/wiki/.properties These files are used in Java programs to store translations. Supported at translatewiki. We could probably parse these with something like http://docs.python.org/library/configparser.html . Downside is that these files are not utf-8 encoded. 4. YAML : http://en.wikipedia.org/wiki/YAML . Supported by translatewiki, need a lib to use it in pywikipedia. So what do you guys think? What should we do? Anyone willing to help implement this? We've talked about this several times. I hope we manage to implement something this time :-) Maarten

3 2

Re: [Pywikipedia-l] Tears on my pillow...
by Bináris 23 Oct '10

23 Oct '10

Now the script works, but I still don't understand! I was advised to get the site and a page ad its _getActionUser('block') method. The but ran as BinBott and at _this point_ it asked for my sysop password. I wrote it. After this I ran my blocking script again, and it worked fine!!! But it didn't ask me for the password itself. I try to copy the relevant lines of my script here: tag=u'Teszteszter' user=userlib.User(site,tag) if user.block(expiry='infinite', reason=blockmessage): pywikibot.output(u'%s blokkolva van.' % user.name()) else: pywikibot.output(u'%s blokkolása nem sikerült.' % user.name()) 2010/10/23 <klaus.seiler(a)arcor.de> > If you are logged in as BinBot it wouldn't asked for the sysop password. > Either log in as sysop or create a new directory and use one for the bot and > one for sysop operations. > > Greetings > xqt > ---------- > But my config has: > usernames['wikipedia']['hu'] = u'BinBott' > sysopnames['wikipedia']['hu'] = u'Bináris' > Once it is not logged in, it should ask for a password, shouldn't it? > -- Bináris

1 0

Re: [Pywikipedia-l] Tears on my pillow...
by Bináris 23 Oct '10

23 Oct '10

Sorry, I don't understand this. :-( The bot HAD worked previously with the same config, and something has gone wrong in the past few weeks. This is just for what sysopnames is created, isn't it? 2010/10/23 <klaus.seiler(a)arcor.de> > If you are logged in as BinBot it wouldn't asked for the sysop password. > Either log in as sysop or create a new directory and use one for the bot and > one for sysop operations. > > Greetings > xqt > ---------- > But my config has: > usernames['wikipedia']['hu'] = u'BinBott' > sysopnames['wikipedia']['hu'] = u'Bináris' > Once it is not logged in, it should ask for a password, shouldn't it? > > 2010/10/21 <info(a)gno.de> > > > ...seems to me the bot is not logged in as sysop > > > > > -- > Bináris > _______________________________________________ > Pywikipedia-l mailing list > Pywikipedia-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l > -- Bináris

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot