pywikibot June 2012

pywikibot@lists.wikimedia.org

11 participants
15 discussions

[Pywikipedia-l] Urlencoded section titles
by Bináris 13 Sep '18

13 Sep '18

Happy Monday, There are strange people who make such links (kindof urlencoded?): [[Második világháború#Partrasz.C3.A1ll.C3.A1s Szic.C3.ADli.C3.A1ban .28Huskey hadm.C5.B1velet.29|Huskey hadműveletben]] So the section title must have been copied from the URL. Do we have a ready tool to fix these? -- Bináris

3 11

[Pywikipedia-l] Template parsing code
by Hannes Röst 02 Sep '16

02 Sep '16

Hello all >From one of my assignments as a bot operator I have some code which does template parsing and general text parsing (e.g. Image/File tags). It is not using regex and thus able to correctly parse nested templates and other such nasty things. I have written those as library classes and written tests for them which cover almost all of the code. I would now really like to contribute that code back to the community. Would you be interested in adding this code to the pywikibot framework? If yes, can I send the code to someone for code review or how do you usually operate? Greetings Hannes PS: wiki userpage is http://en.wikipedia.org/wiki/User:Hannes_R%C3%B6st

5 13

[Pywikipedia-l] Pywikibot code contribution
by Hannes Röst 04 Jan '13

04 Jan '13

Dear all I have posted to this mailing list in January with a library that I wanted to contribute to the codebase. This is part of an effort on my side to refactor code that accumulated over various bot-operator tasks and make it available to the community. The main part of the code deals with spellchecking using hunspell (http://hunspell.sourceforge.net/) instead of the list-based approach currently used in spellcheck.py. The second part is an interactive robot to do revision control (Sichten) in the german wikipedia. There are some api functions that use the "undo" functions of the action=edit command and an api function that uses the action=review command. So I wanted to ask whether somebody had time to have a look at the code I submitted here http://sourceforge.net/tracker/?func=detail&aid=3479070&group_id=93107&atid… (I uploaded a new file "(moved testSamples)" please us this to test, the other one seems corrupt and cannot be deleted any more as well). Thus, is there a code-review process that I can undergo or what do you suggest is the best way to get the code into trunk (if at all?). Would it be easier if I talked directly to one of you? What are the criteria to get SVN commit access -- I was just wondering what the general rules are. Greetings Hannes

4 3

[Pywikipedia-l] Request to join in Pywikipediabot project
by Jenith 25 Nov '12

25 Nov '12

Hi, I would like to join in Python Wikipedia Robot Framework project in Sourceforge. Some of my contribution: https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3509841&group_… . Currently I have been doing Picasa batch upload automated script. I kindly request to add me in this project Regards, Jenith

2 6

[Pywikipedia-l] Fw: Improving the extraction of Wikipedia data
by koltzenburg＠w4w.net 27 Jun '12

27 Jun '12

fyi, ck http://libresoft.es/node/564 Improving the extraction of Wikipedia data Published by jfelipe on Sun, 2012-06-03 18:37 my source: “Wikipedia Academy” preview, by Daniel Mietchen https://blog.wikimedia.org/2012/06/26/wikimedia-research-newsletter-june- 2012/#.22Wikipedia_Academy.22_preview

1 0

[Pywikipedia-l] UnicodeDecodeError in 'pywikibot/comms/http.py'
by Dr. Trigon 25 Jun '12

25 Jun '12

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all! I got this error (from trunk): Traceback (most recent call last): File "../pywikipedia/subster.py", line 251, in subContent (substed_content, tags) = self.subTemplate(substed_content, item) File "../pywikipedia/subster.py", line 345, in subTemplate external_buffer = http.request(self.site, param['url'], no_hostname = True) File "../pywikipedia/pywikibot/comms/http.py", line 125, in request pywikibot.output(u'%s' %e) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 42: ordinal not in range(128) and was able to trace the code line 125 (http.py): pywikibot.output(u'%s' %e) back to "revision 7591 by alexsh, Wed Nov 4 13:22:17 2009 UTC" line 5508, please confer [1]. Now this code snipplet is quite old and I doubt someone is able to remember any details... ;) [1] http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/wikipedia.py?… ...BUT what about the error I got? Does anybody experience the same? I think it is related to network timeouts (e.g. servers not reachable) and thus hard to reproduce... I was using Python 2.7.3: Python 2.7.3 (default, May 29 2012, 14:54:22) [GCC 4.6.3 20120306 (Red Hat 4.6.3-2)] on linux2 Greetings and thanks for any hints! DrTrigon -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk/ki5cACgkQAXWvBxzBrDBkBgCfWS/QJVd4xSzNiEqgGFzigUTa kOkAoNdjOV0Zmhnw9dyOAPOLl1xYbZt1 =O9hG -----END PGP SIGNATURE-----

3 4

[Pywikipedia-l] Manual of fixes.py
by Bináris 24 Jun '12

24 Jun '12

As a preparation to my upcoming presentaion at Wikimania ( http://wikimania2012.wikimedia.org/wiki/Submissions/Efficient_and_flexible_…) I wrote the missing manpage of fixes.py. Please review and complete if necessary. http://www.mediawiki.org/wiki/Manual:Pywikipediabot/fixes.py -- Bináris

2 2

Re: [Pywikipedia-l] Request for feedback on rewrite branch
by info＠gno.de 23 Jun '12

23 Jun '12

I was working on the rewrite branch last week (implementing xmlreader, additional retrieving of special pages, hooking cosmetic_changes with new functionality and some other stuff) At least I am a bit frustrated: I guess nobody uses it as I found some blocker in the code and mainly it runs very very slow. The time consumption is more than 10 times of the trunk release. Maybe the cacherequest is still unfinished but I cannot follow the site request since -verbose gives no additional output about that. Is there another switch? As I am not able to keep both releases on the same level an merge it vice versa, I would like to ask the next steps and how to proceed in that manner. btw I created a matrix for python version / pwb release at http://www.mediawiki.org/wiki/Manual:Pywikipediabot/Overview. Because of the unicode bug (which is triggered by py 2.5/2.6/2.71) it is strictly recommended to use python 2.7.2 or 2.7.2 for the trunk. I guess that bug does not affect the rewrite. But we need 2.6 for some method decorators. And at last: thanks Merlijn for the pwb.py shortener. Regards xqt

2 3

[Pywikipedia-l] how search for non-bot interlanguage link edits
by koltzenburg＠w4w.net 18 Jun '12

18 Jun '12

hi all, I'm seek interlanguage link edits that were undertaken by users who are no bots, these users for interlanguage link edits would usually be active before bots come in to do their work maybe it is a good path to look at the summaries of the first interwiki bot edits per entry and take what happened before that point in time? if yes, it should be great if anyone on this list could run such a search for me, am ready to provide details about what is needed, thanks & cheers, Claudia koltzenburg(a)w4w.net

6 12

[Pywikipedia-l] toolserver wiki
by John 16 Jun '12

16 Jun '12

I generated a toolserver family using generate_family_files.py and then set the protocol to https (http doesnt work) yet it is not possible to log in. can someone else talk a look and figure out what Im doing wrong? John

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot June 2012