pywikibot May 2012

pywikibot@lists.wikimedia.org

10 participants
10 discussions

[Pywikipedia-l] Urlencoded section titles
by Bináris 13 Sep '18

13 Sep '18

Happy Monday, There are strange people who make such links (kindof urlencoded?): [[Második világháború#Partrasz.C3.A1ll.C3.A1s Szic.C3.ADli.C3.A1ban .28Huskey hadm.C5.B1velet.29|Huskey hadműveletben]] So the section title must have been copied from the URL. Do we have a ready tool to fix these? -- Bináris

3 11

[Pywikipedia-l] Template parsing code
by Hannes Röst 02 Sep '16

02 Sep '16

Hello all >From one of my assignments as a bot operator I have some code which does template parsing and general text parsing (e.g. Image/File tags). It is not using regex and thus able to correctly parse nested templates and other such nasty things. I have written those as library classes and written tests for them which cover almost all of the code. I would now really like to contribute that code back to the community. Would you be interested in adding this code to the pywikibot framework? If yes, can I send the code to someone for code review or how do you usually operate? Greetings Hannes PS: wiki userpage is http://en.wikipedia.org/wiki/User:Hannes_R%C3%B6st

5 13

[Pywikipedia-l] Pywikibot code contribution
by Hannes Röst 04 Jan '13

04 Jan '13

Dear all I have posted to this mailing list in January with a library that I wanted to contribute to the codebase. This is part of an effort on my side to refactor code that accumulated over various bot-operator tasks and make it available to the community. The main part of the code deals with spellchecking using hunspell (http://hunspell.sourceforge.net/) instead of the list-based approach currently used in spellcheck.py. The second part is an interactive robot to do revision control (Sichten) in the german wikipedia. There are some api functions that use the "undo" functions of the action=edit command and an api function that uses the action=review command. So I wanted to ask whether somebody had time to have a look at the code I submitted here http://sourceforge.net/tracker/?func=detail&aid=3479070&group_id=93107&atid… (I uploaded a new file "(moved testSamples)" please us this to test, the other one seems corrupt and cannot be deleted any more as well). Thus, is there a code-review process that I can undergo or what do you suggest is the best way to get the code into trunk (if at all?). Would it be easier if I talked directly to one of you? What are the criteria to get SVN commit access -- I was just wondering what the general rules are. Greetings Hannes

4 3

[Pywikipedia-l] Request to join in Pywikipediabot project
by Jenith 24 Nov '12

24 Nov '12

Hi, I would like to join in Python Wikipedia Robot Framework project in Sourceforge. Some of my contribution: https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3509841&group_… . Currently I have been doing Picasa batch upload automated script. I kindly request to add me in this project Regards, Jenith

2 6

[Pywikipedia-l] how search for non-bot interlanguage link edits
by koltzenburg＠w4w.net 18 Jun '12

18 Jun '12

hi all, I'm seek interlanguage link edits that were undertaken by users who are no bots, these users for interlanguage link edits would usually be active before bots come in to do their work maybe it is a good path to look at the summaries of the first interwiki bot edits per entry and take what happened before that point in time? if yes, it should be great if anyone on this list could run such a search for me, am ready to provide details about what is needed, thanks & cheers, Claudia koltzenburg(a)w4w.net

6 12

[Pywikipedia-l] -simulate
by Bináris 13 Jun '12

13 Jun '12

2012/2/18 <drtrigon(a)svn.wikimedia.org> > http://www.mediawiki.org/wiki/Special:Code/pywikipedia/9909 > > Revision: 9909 > Author: drtrigon > Date: 2012-02-17 23:09:15 +0000 (Fri, 17 Feb 2012) > Log Message: > ----------- > follow-up to r9905 '-debug' replaced with new '-simulate' that allows > switching off write access > Trigon, this is great, thank you! I have just tried it and works fine and helps in testing a lot. Several scripts use their own mechanism for that with "-dry" or "-test" or something; we should revise these if they are still neccessary or may be removed. (As far as I understand -simulate works with API query. What happens if somebody uses the bot without API?) -- Bináris

3 3

Re: [Pywikipedia-l] Pywikipedia at the Berlin_Hackathon_2012
by info＠gno.de 31 May '12

31 May '12

Hi folks, thanks Merlijn for your proposals. It sound good and I guess we haven't enough time for all items. Anyway I have some more topics. Shouldn't we create a to-do-list anywhere? * What is the future of interwiki.py and when is wikidata released for wikimedia sites. What about toolserver MMP. Interwiki.py has a big memory leak and uses exhausting memory space; I've seen more than 1 GB for one instance. * Should we merge featured.py with interwiki.py? When interwikilinks are fixed there could be remaining Link_FA templates without interwiki links or leading to the wrong place. And featured.py loads each FA for each mw site for each processed site which could be abbreviated. * Disable {{nobots}}/{{bots|deny=xx]] for specific bot scripts not for bot accounts (only) (Just implemented on my working copy) * move some methods to a library (e.g. add_text, cosmetic_changes) to remove code duplications * move libraries to the pywikbot subdirectory * we should have a look to gerrit/git (and keep svn ;) * The documentation has been partially neglected. * Are there news about www.pywikipedia.org domain * new branch 3.0 for python 3.0? Ok lets merge 2.0 first. * (full) access to config variables through command line. * reading default options from a config file * There is a mess with timestamp formats. This must be solved. * solving redirect loops via redirect.py . I could should show my ideas and my current implementation using string comparison. How is __STATICREDIRECT__ working with redirect and interwiki. Or in a more general manner: idea pool / presentation of exisiting scripts or local adaptions. Maybe some of our local scripts are also fascinating other projects. * use a basic(.py) bot as an class object for other bots. Implementing a setOptions method and general methods for reading and saving pages * botwiki - any comments to that (semi-)official pywikipedia wiki? * Survey 2012 . any suggestions to the current responses * Cleanup old stuff: ** version warning - sorry if the bot knows the right version, why does it complain? ** downloading watchlist - for what is that good for ** remove pre-2.4 code, __future__ imports, set implementations and other hack * others see below Regards xqt ----- Original Nachricht ---- Von: Merlijn van Deen <valhallasw(a)arctus.nl> An: Pywikipedia discussion list <pywikipedia-l(a)lists.wikimedia.org> Datum: 27.05.2012 22:15 Betreff: Re: [Pywikipedia-l] Pywikipedia at the Berlin_Hackathon_2012 > Hello all, > > The hackathon is already next week! So this would be a good time to > start thinking about the projects we would like to work on. I have > some proposals: > > * How to merge trunk and rewrite? They have co-existed for years now, > and we should really merge them. Can we find a path to either merge > them or to quickly move the missing components from trunk to rewrite? > Given that there are quite a lot of pwb developers coming, I think we > should be able to at least sketch a roadmap for this. I guess this should be the main point for us. In past I tried to keep both forks on a same level. But I do not always succed. Some scripts are nearby identical except the import since I fixed the site property. Some others are very different and have different behaviours. The rewrite branch uses apisite object based on basesite. This could be an idea to include the old stuff as e.g. oldsite class to merge them. And I prefer a version which does not has to be installed as package to enable more than one branch running without having problems with directory access I found in past. Maybe I am to stupid for that. > > * Interface localisation. This has been a running request for a few > years, and xqt has started some initial work on it. I expect there > will be quite a lot of localisation know-how around. There are some remaining questions: What is the default lang for the logfiles and how to translate error tracebacks and error/warning/info/debug messages. Do we need message numbers for debug purposes (I remember there is a feature request with some proposals) > > * Wiki-based configuration. Currently, we have a lot of hacks > throughout the code to change the behaviour for a specific wiki. We > should try and see if we can move to a wiki-based configuration > system, where the behaviour of the bot is controlled by flags on the > wiki itself. This also includes stuff like the text & summaries to > display. The MediaWiki people could be very helpful for this. There as some local config page like MediaWiki:Disambiguationspage and the new MediaWiki:Interwiki_config-sorting_order (see http://meta.wikimedia.org/wiki/Interwiki_sorting_order). This is a good idea for L10n and we should delegate more config stuff to local sites. Unfortunately the local config doesn't work well in opposite to twn. So we need some members with global rights to change the mw messages if needed. Therefore I guess i18n should keep at twn since it works. > > * Patch review spree! There is still a backlog, and we can fix that > (and it's much more fun to do together). The same is valid too for bug and feature request > >

3 6

[Pywikipedia-l] Pywikipedia at the Berlin_Hackathon_2012
by Maarten Dammers 27 May '12

27 May '12

Hi everyone, Insix weeks (1-3 June 2012) it's time again for the annual Berlin Hackathon [1]. It would be nice to also work on Pywikipedia there. The following people who are active in Pywikipedia are attending the Hackathon: * Merlijn van Deen (valhallasw) * Siebrand Mazeland (siebrand) * Maarten Dammers (multichill) * Bináris ? * xqt ? * You? It would be nice if more Pywikipedia developers or people who want to become Pywikipedia developers would come to the hackathon. There are only 10 or so places left, so if you'd like to come, please register soon. Some financial subsidy is available- If you need to request financial assistance or help with visa or hotel, then please register by May 1st and mention it in the registration form. Registration form: https://wmberlin.eventbrite.com/ Maarten en Merlijn (your friendly list admins) [1] https://www.mediawiki.org/wiki/Berlin_Hackathon_2012

6 6

[Pywikipedia-l] handleArgs
by Gnumarcoo 21 May '12

21 May '12

According with you, why this /for /doesn't work: for arg in pywikibot.handleArgs(): genFactory.handleArg(arg) in my python script? Error message is: "name 'genFactory' is not defined" I've: import wikipedia as pywikibot surely it's a small detail that escapes me... but I cannot find it. :( Tnx, Marco

2 1

Re: [Pywikipedia-l] [Commons-l] Help test chunked uploading
by Maarten Dammers 05 May '12

05 May '12

Hi Raimond, Op 5-5-2012 10:46, Raimond Spekking schreef: > Am 04.05.2012 05:16, schrieb Erik Moeller: >> http://commons.wikimedia.org/wiki/Special:Preferences#mw-prefsection-uploads >> >> There's a new user preference "chunked uploads for files over 1 MB" >> for Upload Wizard. >> >> The intent of this feature is to reliably transfer large files, >> mitigating connection reliability issues. This will enable us to raise >> the file size limit for all users. >> >> Please help test this feature and report issues (performance, file >> corruption, errors, etc.). The carrot is that with this preference >> enabled, you can upload files<500 MB today (as opposed to<100 MB) >> :-) >> >> The feature currently only works with Upload Wizard. >> >> More information: >> http://commons.wikimedia.org/wiki/Commons:Chunked_uploads >> >> Please report bugs on the talk page or against UploadWizard in Bugzilla: >> https://bugzilla.wikimedia.org/enter_bug.cgi?product=MediaWiki%20extensions… >> > Thanks for the info, Erik. > > Does anyone know, if the pywikipediabot framework supports chunked > uploading now or in the near future? I was about to forward this email to the pywikipedia-l list to suggest someone to implement this. Based on http://www.mediawiki.org/wiki/API:Upload#Chunked_uploading this shouldn't be too hard. Maarten

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot May 2012