Pywikipedia-l January 2012

pywikipedia-l@lists.wikimedia.org

17 participants
30 discussions

by Bináris

Happy Monday, There are strange people who make such links (kindof urlencoded?): [[Második világháború#Partrasz.C3.A1ll.C3.A1s Szic.C3.ADli.C3.A1ban .28Huskey hadm.C5.B1velet.29|Huskey hadműveletben]] So the section title must have been copied from the URL. Do we have a ready tool to fix these? -- Bináris

11 years, 10 months

Noisy interwiki.py

by Tuszynski, Jaroslaw W.

Running interwiki.py in the background produces infrequent but steady stream of beeps, which I can't figure out how to turn off. It seems like occasionally when program tries to display am non English character it beeps. The beep does not respond to computer's volume or mute control. I was looking for an option for less verbose output, but could not find one. Is there any other way to control it other than disabling motherboard speaker? I run interwiki.py from DOS command line in Windows XP. Jarosław Tuszyński, PhD. Science Applications International Corporation (SAIC) 703-516-7406 (Office) 571-245-5824 (BlackBerry)

12 years

Replace.py should save -- please comment

by Bináris

Hi! My old problem is that repalce.py can't write the pages to work on into a file on my disk. I have used a modificated version for years that does no changes but writes the title of the involved pages to a subpage on Wikipedia in automated mode, and then I can make the replacements from that page much more quickly than directly from dump or living Wikipedia. This is slow and generates a plenty of dummy edits. In other words, replace.py has a tool to get the titles from a file (-file) or from a wikipage (-links), but has no tool to generate this file. Now I am ready to rewrite it. This way we can start it and the bot will find all the possible articles to work on and save the titles without editing Wikipedia (and without artificial delay), meanwhile we can have the lunch or run a marathon or sleep. Then we make the replacements from this with -file. My idea is that replace.py should have two new parameters: -save writes the results into a new file instead of editing articles. It overwrites existing file without notice. -saveappend writes into a file or appends to the existing one. OR: -save writes and appends (primary mode) -savenew writes and overwrites The help is here: http://docs.python.org/howto/unicode.html#reading-and-writing-unicode-data So we have to import codecs. My script is: articles=codecs.open('cikkek.txt','a',encoding='utf-8') ... tutuzuzu=u'# %s\n' %page.aslink() <-- needs rewrite to the new syntax articles.write(unicode(tutuzuzu)) <-- needs further testing, if nicode() is really needed articles.flush() It works fine except '\n' is a unix-styled newline that has to be converted by lfcr.py in order to make it readable with notepad.exe. This is with constant filename, that should be developed to get from command line. Your opinions before I begin? -- Bináris

12 years, 1 month

Logout when using 'getUrl' with foreign wiki

by Dr. Trigon

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all! I have a quite confusing situation happening to my bot when trying to access any URL that points to foreign (but mediawiki software) wiki, like this: >>> pywikibot.getSite().getUrl(foreign_wiki_url, no_hostname = >>> True) This should be more or less similar to a simple: >>> urllib.urlopen(foreign_wiki_url).read() I mean I am not trying to edit or access that other wiki in a usual way (I have not login there, no family file, ...) I just want to fetch the HTML text from that page - which actually works. But while doing this the bot seems to log-out since afterwards it is not able to edit any page anymore the "traceback" from the logs is: * Password for user DrTrigonBot on wikipedia:de: * /opt/ts/python/2.7/lib/python2.7/getpass.py:83: GetPassWarning: Can not control echo on the terminal. * passwd = fallback_getpass(prompt, stream) * Warning: Password input may be echoed. * * Unhandled exception in thread started by * * Traceback (most recent call last): * File "/home/drtrigon/pywikipedia/bot_control.py", line 317, in write * string = self._REGEX_boc.sub('', string) # make more readable * File "/home/drtrigon/pywikipedia/subster_irc.py", line 156, in main_subster * bot.run() * File "/home/drtrigon/pywikipedia/subster.py", line 220, in run * self.save(page, substed_content, head + mod % (", ".join(substed_tags)), **flags) * File "/home/drtrigon/pywikipedia/dtbext/dtbext_basic.py", line 240, in save * page.put(text, comment=comment, minorEdit=minorEdit, botflag=botflag) * File "/home/drtrigon/pywikipedia/wikipedia.py", line 1708, in put * sysop = self._getActionUser(action = 'edit', restriction = self.editRestriction, sysop = sysop) * File "/home/drtrigon/pywikipedia/wikipedia.py", line 1581, in _getActionUser * self.site().forceLogin(sysop = sysop) * File "/home/drtrigon/pywikipedia/wikipedia.py", line 5008, in forceLogin * if loginMan.login(retry = True): * File "/home/drtrigon/pywikipedia/login.py", line 307, in login * password = True) * File "/home/drtrigon/pywikipedia/wikipedia.py", line 8018, in input * data = ui.input(question, password) * File "/home/drtrigon/pywikipedia/userinterfaces/terminal_interface.py", line 238, in input * text = getpass.getpass('') * File "/opt/ts/python/2.7/lib/python2.7/getpass.py", line 83, in unix_getpass * passwd = fallback_getpass(prompt, stream) * File "/opt/ts/python/2.7/lib/python2.7/getpass.py", line 118, in fallback_getpass * return _raw_input(prompt, stream) * File "/opt/ts/python/2.7/lib/python2.7/getpass.py", line 135, in _raw_input * raise EOFError * EOFError ...any idea whats happening here?? Thanks a lot! Greetings DrTrigon -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk8i0WgACgkQAXWvBxzBrDAtpwCfdge6G2fKmh+hYZIX2YQOi7lY wyIAoKN7j6QeQymclaCOqhSWdHhG1XUy =bLby -----END PGP SIGNATURE-----

12 years, 1 month

Making pagenerators shut up

by Bináris

Hi, I run an own script on a remote Linux toolserver in the background. I suppressed my own screen outputs for that purpose. However, the program uses pagenerators.py, and my screen is infinitely full of lines lik these: Getting 60 pages from wikipedia:hu... Sleeping for 4.5 seconds, 2011-12-22 14:19:06 Getting 60 pages from wikipedia:hu... Sleeping for 4.6 seconds, 2011-12-22 14:19:12 Getting 60 pages from wikipedia:hu... Sleeping for 4.2 seconds, 2011-12-22 14:19:19 Getting 60 pages from wikipedia:hu... Sleeping for 4.1 seconds, 2011-12-22 14:19:25 Getting 60 pages from wikipedia:hu... Sleeping for 4.3 seconds, 2011-12-22 14:19:30 Getting 60 pages from wikipedia:hu... Sleeping for 4.2 seconds, 2011-12-22 14:19:36 Sleeping for 4.1 seconds, 2011-12-22 14:19:42 Getting 60 pages from wikipedia:hu... Getting 60 pages from wikipedia:hu... This is not only ugly but prevents me of using the console. Is there any way to suppress these messages and run pagegenerators in silent mode? -- Bináris

12 years, 1 month

SourceForge passwords

by Bináris

Have you also got an e-mail with subject "SourceForge.net passwords reset"? Is that authentic? -- Bináris

12 years, 2 months

Automated nightly testing

by Merlijn van Deen

Hello all, In some spare time, I hacked together an automated test runner that runs all pywikipedia's tests after the last nightly release has been generated, and posts the results online. Currently, most tests seem to be malfunctioning in one way or another, so it needs some work. The results are available at: http://toolserver.org/~pywikipedia/nightly/testing/test_pywikipedia.txt (and in xunit format, if anyone prefers that). Best, Merlijn

12 years, 2 months

How to read special pages?

by Bináris

I want to read a special page with Page.get(). The message is: File "C:\Program Files\Pywikipedia\wikipedia.py", line 601, in get raise NoPage('%s is in the Special namespace!' % self.aslink()) pywikibot.exceptions.NoPage What is the solution? -- Bináris

12 years, 2 months

SVN access request

by Bináris

Hi, I would like to get an SVN access and some help to start. I need it mainly for inserting and maintaining TOCbot that is under preparation (it has worked in huwiki for several months and is now being internationalized). Information about TOCbot: http://hu.wikipedia.org/wiki/Szerkeszt%C5%91:Bin%C3%A1ris/TOCbot Description, user guide and bot owners' guide and a collection of examples is ready as well as an auxilary script, while the main script is not yet public. It will soon be published for test and may need much care in the first time. I would also like to take part in maintenance of replace.py for what I worked a lot already. At the moment I am interested only in trunk version. My SF page: http://sourceforge.net/users/binbot/ -- I don't know how to list all my contributions, here appears a part of them since May 22, but there are much more. I have also been active on mailing list in the past years. Please support and give me technical help to use the system. -- Bináris

12 years, 2 months

Template parsing code

by Hannes Röst

Hello all >From one of my assignments as a bot operator I have some code which does template parsing and general text parsing (e.g. Image/File tags). It is not using regex and thus able to correctly parse nested templates and other such nasty things. I have written those as library classes and written tests for them which cover almost all of the code. I would now really like to contribute that code back to the community. Would you be interested in adding this code to the pywikibot framework? If yes, can I send the code to someone for code review or how do you usually operate? Greetings Hannes PS: wiki userpage is http://en.wikipedia.org/wiki/User:Hannes_R%C3%B6st

12 years, 2 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l January 2012