Pywikipedia-l November 2011

pywikipedia-l@lists.wikimedia.org

6 participants
10 discussions

Urlencoded section titles
by Bináris 12 Jun '12

12 Jun '12

Happy Monday, There are strange people who make such links (kindof urlencoded?): [[Második világháború#Partrasz.C3.A1ll.C3.A1s Szic.C3.ADli.C3.A1ban .28Huskey hadm.C5.B1velet.29|Huskey hadműveletben]] So the section title must have been copied from the URL. Do we have a ready tool to fix these? -- Bináris

3 10

Replace.py should save -- please comment
by Bináris 26 Feb '12

26 Feb '12

Hi! My old problem is that repalce.py can't write the pages to work on into a file on my disk. I have used a modificated version for years that does no changes but writes the title of the involved pages to a subpage on Wikipedia in automated mode, and then I can make the replacements from that page much more quickly than directly from dump or living Wikipedia. This is slow and generates a plenty of dummy edits. In other words, replace.py has a tool to get the titles from a file (-file) or from a wikipage (-links), but has no tool to generate this file. Now I am ready to rewrite it. This way we can start it and the bot will find all the possible articles to work on and save the titles without editing Wikipedia (and without artificial delay), meanwhile we can have the lunch or run a marathon or sleep. Then we make the replacements from this with -file. My idea is that replace.py should have two new parameters: -save writes the results into a new file instead of editing articles. It overwrites existing file without notice. -saveappend writes into a file or appends to the existing one. OR: -save writes and appends (primary mode) -savenew writes and overwrites The help is here: http://docs.python.org/howto/unicode.html#reading-and-writing-unicode-data So we have to import codecs. My script is: articles=codecs.open('cikkek.txt','a',encoding='utf-8') ... tutuzuzu=u'# %s\n' %page.aslink() <-- needs rewrite to the new syntax articles.write(unicode(tutuzuzu)) <-- needs further testing, if nicode() is really needed articles.flush() It works fine except '\n' is a unix-styled newline that has to be converted by lfcr.py in order to make it readable with notepad.exe. This is with constant filename, that should be developed to get from command line. Your opinions before I begin? -- Bináris

5 12

SourceForge passwords
by Bináris 20 Feb '12

20 Feb '12

Have you also got an e-mail with subject "SourceForge.net passwords reset"? Is that authentic? -- Bináris

10 28

How to read special pages?
by Bináris 17 Feb '12

17 Feb '12

I want to read a special page with Page.get(). The message is: File "C:\Program Files\Pywikipedia\wikipedia.py", line 601, in get raise NoPage('%s is in the Special namespace!' % self.aslink()) pywikibot.exceptions.NoPage What is the solution? -- Bináris

7 21

SVN access request
by Bináris 07 Feb '12

07 Feb '12

Hi, I would like to get an SVN access and some help to start. I need it mainly for inserting and maintaining TOCbot that is under preparation (it has worked in huwiki for several months and is now being internationalized). Information about TOCbot: http://hu.wikipedia.org/wiki/Szerkeszt%C5%91:Bin%C3%A1ris/TOCbot Description, user guide and bot owners' guide and a collection of examples is ready as well as an auxilary script, while the main script is not yet public. It will soon be published for test and may need much care in the first time. I would also like to take part in maintenance of replace.py for what I worked a lot already. At the moment I am interested only in trunk version. My SF page: http://sourceforge.net/users/binbot/ -- I don't know how to list all my contributions, here appears a part of them since May 22, but there are much more. I have also been active on mailing list in the past years. Please support and give me technical help to use the system. -- Bináris

3 8

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [9196] trunk/pywikipedia
by Merlijn van Deen 19 Jan '12

19 Jan '12

Whoo! Great work :-) Tests always are good contributions :-) On a sidenote - is there a reason you're implementing these in 'trunk' and not in 'rewrite'? Of course, these contributions are very welcome in the trunk, but I still think it would be good to push the rewrite branch. Best regards, Merlijn On 24 April 2011 07:41, <jayvdb(a)svn.wikimedia.org> wrote: > http://www.mediawiki.org/wiki/Special:Code/pywikipedia/9196 > > Revision: 9196 > Author: jayvdb > Date: 2011-04-24 05:40:59 +0000 (Sun, 24 Apr 2011) > Log Message: > ----------- > Allow lists of Page and User objects to be interogated > > Modified Paths: > -------------- > trunk/pywikipedia/query.py > trunk/pywikipedia/tests/test_query.py > > Modified: trunk/pywikipedia/query.py > =================================================================== > --- trunk/pywikipedia/query.py 2011-04-24 04:23:12 UTC (rev 9195) > +++ trunk/pywikipedia/query.py 2011-04-24 05:40:59 UTC (rev 9196) > @@ -263,10 +263,21 @@ > > encList = '' > # items may not have one symbol - '|' > - for l in list: > - if type(l) == str and u'|' in l: > - raise wikipedia.Error("item '%s' contains '|' symbol" % l ) > - encList += ToUtf8(l) + u'|' > + for item in list: > + if isinstance(item,basestring): > + if u'|' in item: > + raise wikipedia.Error(u"item '%s' contains '|' symbol" % > item ) > + encList += ToUtf8(item) + u'|' > + elif isinstance(item,wikipedia.Page): > + encList += ToUtf8(item.title()) + u'|' > + elif item.__class__.__name__ == 'User': > + # delay loading this until it is needed > + import userlib > + encList += ToUtf8(item.name()) + u'|' > + else: > + raise wikipedia.Error(u'unknown item class %s' % > item.__class__.__name__) > + > + # strip trailing '|' before returning > return encList[:-1] > > def ToUtf8(s): > > Modified: trunk/pywikipedia/tests/test_query.py > =================================================================== > --- trunk/pywikipedia/tests/test_query.py 2011-04-24 04:23:12 UTC > (rev 9195) > +++ trunk/pywikipedia/tests/test_query.py 2011-04-24 05:40:59 UTC > (rev 9196) > @@ -7,6 +7,8 @@ > import unittest > import tests.test_pywiki > > +import wikipedia as pywikibot > +import catlib, userlib > import query > > > @@ -74,5 +76,72 @@ > ]} > self.assertEqualQueryResult(params, expectedresult) > > + def test_titles_Page(self): > + params = { > + 'action': 'query', > + 'list': 'users', > + 'usprop': ['registration'], > + 'ususers': [pywikibot.Page(self.site, u'Example'), > + pywikibot.Page(self.site, u'Example2')], > + } > + expectedresult = {u'users': [ > + { > + u'userid': 215131, > + u'name': u'Example', > + u'registration': u'2005-03-19T00:17:19Z' > + }, > + { > + u'userid': 5176706, > + u'name': u'Example2', > + u'registration': u'2007-08-26T02:13:33Z' > + }, > + ]} > + self.assertEqualQueryResult(params, expectedresult) > + > + def test_titles_User(self): > + params = { > + 'action': 'query', > + 'list': 'users', > + 'usprop': ['registration'], > + 'ususers': [userlib.User(self.site, u'Example'), > + userlib.User(self.site, u'Example2')], > + } > + expectedresult = {u'users': [ > + { > + u'userid': 215131, > + u'name': u'Example', > + u'registration': u'2005-03-19T00:17:19Z' > + }, > + { > + u'userid': 5176706, > + u'name': u'Example2', > + u'registration': u'2007-08-26T02:13:33Z' > + }, > + ]} > + self.assertEqualQueryResult(params, expectedresult) > + > + def test_titles_Category(self): > + params = { > + 'action': 'query', > + 'prop': 'revisions', > + 'rvprop': ['ids', 'timestamp', 'user'], > + 'rvdir': 'newer', > + 'rvlimit': 1, > + 'titles': [catlib.Category(self.site, > u'Category:Categories')], > + } > + expectedresult = {u'pages': {u'794823': > + { > + u'ns': 14, > + u'pageid': 794823, > + u'revisions': [{ > + u'revid': 4494485, > + u'user': u'SEWilco', > + u'timestamp': u'2004-07-07T18:45:50Z', > + }], > + u'title': u'Category:Categories', > + }, > + }} > + self.assertEqualQueryResult(params, expectedresult) > + > if __name__ == "__main__": > unittest.main() > > > _______________________________________________ > Pywikipedia-svn mailing list > Pywikipedia-svn(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-svn >

8 13

How can we block IPs via PWB?
by Amir Ladsgroup 15 Jan '12

15 Jan '12

Hello As I know (and I tested) userlib.py doesn't let block IPs. Why did you that? and How can I block almost thirty thousand IP via PWB? -- Amir

2 6

upload.py under Windows 7: "No input filename given"
by Raimond Spekking 03 Jan '12

03 Jan '12

Hi, I try to run upload.py under Windows 7. Installed: Python 2.7 Pywikipediabot: Latest from SVN Executing this line from Windows PowerShell: c:\python27\python.exe D:\F_Programmierung\pywikipedia\upload.py -keep -log:upload.log -filename:"Kulturpreis der Sparkassen-Kulturstiftung Rheinland 2011-5606.jpg" -noverify "D:\Eigene Bilder\WP Bilder\Kulturpreis der Sparkassen-Kulturstiftung Rheinland 2011-5606.jpg" "== {{int:filedesc}} ==......." results into "No input filename given". Same error if I simplify the line to c:\python27\python.exe D:\F_Programmierung\pywikipedia\upload.py -filename:xxx.jph .\xxx.jpg "...." Yes, the pathes are correct. Any ideas? Thanks. Raimond.

4 7

rewrite branch
by John Vandenberg 22 Dec '11

22 Dec '11

On Mon, Apr 25, 2011 at 7:49 AM, Merlijn van Deen <valhallasw(a)arctus.nl> wrote: > Whoo! Great work :-) Tests always are good contributions :-) Thanks ;-) I agree. > On a sidenote - is there a reason you're implementing these in 'trunk' and > not in 'rewrite'? Of course, these contributions are very welcome in the > trunk, but I still think it would be good to push the rewrite branch. I'm working off trunk because it is trunk. I'd assumed that the rewrite branch was a single-purpose branch to rewrite something, and that it would be merged back when it is stable. Is it stable? Is there any documentation on what the plans are for the rewrite branch? Is there a roadmap to finish it? Is see now that the rewrite branch has more unit tests, but more are needed. Is there a need to create a backwards compatibility layer? Or, is everyone except me using the rewrite branch? ;-) -- John Vandenberg

3 2

How can we block IPs via PWB?
by Pedro Sanchez 12 Nov '11

12 Nov '11

Sorry for starting a new thread, I just suscribed. I ran into the same problem today and I think I know how to fix it. On userlib.py there are several checks before attempting to raise a block def block(self, expiry=None, reason=None, anon=True, noCreate=False, onAutoblock=False, banMail=False, watchUser=False, allowUsertalk=True, reBlock=False, hidename=False): if self._isAutoblock: #This user is probably being queried for purpose of lifting #an autoblock, so can't be blocked. raise AutoblockUser if self.isBlocked() and not reBlock: raise AlreadyBlocked() if not self.site().isAllowed('block', sysop=True): raise UserActionRefuse('You don\'t have permission to block') if not expiry: expiry = pywikibot.input(u'Please enter the expiry time for the block:') if not reason: reason = pywikibot.input(u'Please enter a reason for the block:') if (not self.site().has_api()) or self.site().versionnumber() < 12: return self._blockOld(expiry, reason, anon, noCreate, onAutoblock, banMail, watchUser, allowUsertalk, reBlock) params = { 'action': 'block', 'user': self.name(), 'token': self.site().getToken(self, sysop = True), 'reason': reason, } Notice last check: If the site doesn't have an API or version number is too old, then use a deprecated function to raise the block. We could add a check there as in if self.isAnonymous() or (not self.site().has_api()) or self.site().versionnumber() < 12: so if user is an IP, goes to the old method. However the error would persist. This because the checks above also need a user (user.isBlocked() fails for IP). quick hack would be moving this check at the top: def block(self, expiry=None, reason=None, anon=True, noCreate=False, onAutoblock=False, banMail=False, watchUser=False, allowUsertalk=True, reBlock=False, hidename=False): if self.isAnonymous() or (not self.site().has_api()) or self.site().versionnumber() < 12: return self._blockOld(expiry, reason, anon, noCreate, onAutoblock, banMail, watchUser, allowUsertalk, reBlock) if self._isAutoblock: #This user is probably being queried for purpose of lifting #an autoblock, so can't be blocked. raise AutoblockUser if self.isBlocked() and not reBlock: raise AlreadyBlocked() This way, if user = IP, goes directly into the depprecated ol method and doesn't execute the API-useronly functions. Now running gives :!python bloqueador.py Bloqueando 128.163.142.21 Traceback (most recent call last): File "bloqueador.py", line 86, in <module> main() File "bloqueador.py", line 79, in main bot.run() File "bloqueador.py", line 48, in run self.treat(user) File "bloqueador.py", line 62, in treat user.block(expiry="1 year", reason="Proxy", anon=True) File "/home/drini/pywiki/userlib.py", line 381, in block allowUsertalk, reBlock) TypeError: _blockOld() takes exactly 9 arguments (10 given) It seems code had another bug: _Blockold() doesn't accept a "reBlock" parameter: def _blockOld(self, expiry, reason, anonOnly, noSignup, enableAutoblock, emailBan, watchUser, allowUsertalk): So we fix again the call as if self.isAnonymous() or (not self.site().has_api()) or self.site().versionnumber() < 12: return self._blockOld(expiry, reason, anon, noCreate, onAutoblock, banMail, watchUser, allowUsertalk) It SHOULD work now... except I get a cryptic error: :!python bloqueador.py Bloqueando 128.163.142.21 Getting a token. Note: Your sysop account on wikipedia:es does not have a bot flag. Its edits will be visible in the recent changes. Blocking [[User:128.163.142.21]]... Traceback (most recent call last): File "bloqueador.py", line 86, in <module> main() File "bloqueador.py", line 79, in main bot.run() File "bloqueador.py", line 48, in run self.treat(user) File "bloqueador.py", line 62, in treat user.block(expiry="1 year", reason="Proxy", anon=True) File "/home/drini/pywiki/userlib.py", line 381, in block allowUsertalk) File "/home/drini/pywiki/userlib.py", line 471, in _blockOld raise BlockError userlib.BlockError shell returned 1 Hope it helps Amir, and if you find a solution, please tell since I'm stuck with the same problem Pedro Sánchez http://drini.mx @combinatorica

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l November 2011