pywikibot April 2013

pywikibot@lists.wikimedia.org

13 participants
23 discussions

[Pywikipedia-l] Urlencoded section titles
by Bináris 13 Sep '18

13 Sep '18

Happy Monday, There are strange people who make such links (kindof urlencoded?): [[Második világháború#Partrasz.C3.A1ll.C3.A1s Szic.C3.ADli.C3.A1ban .28Huskey hadm.C5.B1velet.29|Huskey hadműveletben]] So the section title must have been copied from the URL. Do we have a ready tool to fix these? -- Bináris

3 11

[Pywikipedia-l] Template parsing code
by Hannes Röst 02 Sep '16

02 Sep '16

Hello all >From one of my assignments as a bot operator I have some code which does template parsing and general text parsing (e.g. Image/File tags). It is not using regex and thus able to correctly parse nested templates and other such nasty things. I have written those as library classes and written tests for them which cover almost all of the code. I would now really like to contribute that code back to the community. Would you be interested in adding this code to the pywikibot framework? If yes, can I send the code to someone for code review or how do you usually operate? Greetings Hannes PS: wiki userpage is http://en.wikipedia.org/wiki/User:Hannes_R%C3%B6st

5 13

[Pywikipedia-l] Using a true MediaWiki parser (mwparserfromhell) instead of textlib methods
by legoktm 14 Jul '13

14 Jul '13

Hi all, I had mentioned this in the rewrite roadmap, and noticed it came up on IRC as well, so I'd like to run this by the mailing list: User:The Earwig has written a pure-python (with optional C-speedups) MediaWiki text parser named mwparserfromhell[1]. Currently we have the textlib library and some various regexes that implement this in a non-perfect way. From my experience using mwparser (over 400k successful edits with no issues) I believe it is ready to be bundled with the framework. I think it would still be a good idea to keep textlib in as a fallback or for users who are currently using it and don't need to migrate. As for actually adding it, in the rewrite branch we can just add it as a dependency in setup.py, and then convert various methods over. In trunk, I'm guessing we would need to add it as an external. (I'm not sure how that's actually done.) [1] https://github.com/earwig/mwparserfromhell -- Legoktm

5 9

[Pywikipedia-l] [rewrite] Using pywikibot.Timestamp instead of raw MediaWiki ones
by legoktm 29 Apr '13

29 Apr '13

In #pywikipediabot today, Pyfisch pointed out that User.contributions and Page.getVersionHistory are returning the MediaWiki timestamp format (example: 20130427104527). I've gone ahead and modified both methods to return pywikibot.Timestamp formats, which are much easier to use. I've noted this in the README-conversion.txt file, since this is a breaking change from trunk. I doubt these two are the only methods that needed changing, so I will try and convert everything else over soon. -- Legoktm

2 1

[Pywikipedia-l] Table of contents for scripts and fixes
by Bináris 28 Apr '13

28 Apr '13

Hi gurus, I have suffered for a long time because I have quite a lot of fixes and I can hardly find my way in this jungle and keep a logical order and find old ones. So I decided to write a script that creates a table of contents int fixes.py/user-fixes.py. Then I thought it should also list main-level variables and functions (Python is very good at dissolving main-level things from others :-)). As I already wrote earlier, I use several own functions for my fixes ([1]). And also header lines of some predefined format. All this script needs a place to insert the TOC which should be a predefined constant line, e.g. # *** CONTENTS *** # (If the script finds the corresponding END CONTENTS line, it clears the previous TOC from between these two.) But then I realized that enhanced with classes this would be useful for any kind of scripts without extra work. For example in wikipedia.py which is now long, long, and hard to overview. Of course, there would be a possibility to leave some kind of data (e.g. "no variables please, only functiions and classes"), and two approaches for ordering (everything in original order, or fisrt the variables, then functions, then fixes...). Unfortunately, in some rare cases the length of a line may excced the 80 characters, which may cause PEP8 and/or Xqt beiing sad. :-) How does this concept sound? I will anyhow write it for my own purposes. It is just about community use for complicated scripts such as fixes.py or wikipedia.py. [1] http://hu.wikipedia.org/wiki/Szerkeszt%C5%91:Bin%C3%A1ris/Fixes_and_functio… -- Bináris

2 2

Re: [Pywikipedia-l] [Wikidata-l] New exception needed: score
by info＠gno.de 24 Apr '13

24 Apr '13

I saw the request below only ;-) Xqt ----- Ursprüngliche Nachricht ----- Von: Bináris Gesendet: 24.04.2013 16:57 An: Pywikipedia discussion list Betreff: Re: [Pywikipedia-l] [Wikidata-l] New exception needed: score No, this is similar to syntaxhighlight because of <score foo bar> ... </score> syntax. 2013/4/24 <info(a)gno.de> This sort of html like tags are already implemented.Just use 'score' in the exception list. greeting xqt Von: legoktm Gesendet: 24.04.2013 12:54 An: WikiMedia Mailing Lists Betreff: Re: [Pywikipedia-l] [Wikidata-l] New exception needed: score I'm guessing this was intended for the Pywikipedia-l list? :) -- Legoktm On Wed, Apr 24, 2013 at 1:38 AM, Bináris <wikiposta(a)gmail.com> wrote: Hi, <score> blahblah </score> or <score foo bar> ... </score> is introduces for music notes as written below. See also http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Grin/lilypond&act… for live use. Anyone to add a new exceptcion to textlib? Not a big deal, I am just far from my own computer now where I could solve it. It should be handled in the way as syntaxhighlight in line 121 here: http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/pywikibot/tex… ---------- Forwarded message ---------- From: MZMcBride <z(a)mzmcbride.com> Date: 2013/4/23 Subject: [Wikitech-l] Bug 189: "Add a music wikimodule" resolved/fixed To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> Hi. https://bugzilla.wikimedia.org/show_bug.cgi?id=189 Congrats to all involved in getting bug 189 resolved! :-) Bug 189 was one of the oldest unresolved and one of the better known bugs in Bugzilla involving a request to add a music module to Wikimedia wikis. Quick stats about the bug: * Opened: 2004-08-22 * Votes: 48 * Comments: 123 The bug filer is still around and left a nice note on the bug (<https://bugzilla.wikimedia.org/show_bug.cgi?id=189#c123>): --- Congratulations to all ! It makes my dream comes true today ! Thanks million times! --- <https://en.wikipedia.org/wiki/Note> seemed like an easy target for demoing the newly deployed Score extension (<https://www.mediawiki.org/wiki/Extension:Score>) on a production site, if anyone's interested. I tried looking around for a point and click lilypond or ABC code generation tool (preferably Web-based), but a lot of these tools quickly went over my head. MZMcBride _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Bináris -- Bináris _______________________________________________ Wikidata-l mailing list Wikidata-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-l _______________________________________________ Pywikipedia-l mailing list Pywikipedia-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l -- Bináris

1 0

Re: [Pywikipedia-l] [Wikidata-l] New exception needed: score
by info＠gno.de 24 Apr '13

24 Apr '13

This sort of html like tags are already implemented.Just use 'score' in the exception list. greeting xqt ----- Ursprüngliche Nachricht ----- Von: legoktm Gesendet: 24.04.2013 12:54 An: WikiMedia Mailing Lists Betreff: Re: [Pywikipedia-l] [Wikidata-l] New exception needed: score I'm guessing this was intended for the Pywikipedia-l list? :) -- Legoktm On Wed, Apr 24, 2013 at 1:38 AM, Bináris <wikiposta(a)gmail.com> wrote: Hi, <score> blahblah </score> or <score foo bar> ... </score> is introduces for music notes as written below. See also http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Grin/lilypond&act… for live use. Anyone to add a new exceptcion to textlib? Not a big deal, I am just far from my own computer now where I could solve it. It should be handled in the way as syntaxhighlight in line 121 here: http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/pywikibot/tex… ---------- Forwarded message ---------- From: MZMcBride <z(a)mzmcbride.com> Date: 2013/4/23 Subject: [Wikitech-l] Bug 189: "Add a music wikimodule" resolved/fixed To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> Hi. https://bugzilla.wikimedia.org/show_bug.cgi?id=189 Congrats to all involved in getting bug 189 resolved! :-) Bug 189 was one of the oldest unresolved and one of the better known bugs in Bugzilla involving a request to add a music module to Wikimedia wikis. Quick stats about the bug: * Opened: 2004-08-22 * Votes: 48 * Comments: 123 The bug filer is still around and left a nice note on the bug (<https://bugzilla.wikimedia.org/show_bug.cgi?id=189#c123>): --- Congratulations to all ! It makes my dream comes true today ! Thanks million times! --- <https://en.wikipedia.org/wiki/Note> seemed like an easy target for demoing the newly deployed Score extension (<https://www.mediawiki.org/wiki/Extension:Score>) on a production site, if anyone's interested. I tried looking around for a point and click lilypond or ABC code generation tool (preferably Web-based), but a lot of these tools quickly went over my head. MZMcBride _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Bináris -- Bináris _______________________________________________ Wikidata-l mailing list Wikidata-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-l

2 1

Re: [Pywikipedia-l] [Wikidata-l] New exception needed: score
by legoktm 24 Apr '13

24 Apr '13

I'm guessing this was intended for the Pywikipedia-l list? :) -- Legoktm On Wed, Apr 24, 2013 at 1:38 AM, Bináris <wikiposta(a)gmail.com> wrote: > Hi, > > <score> blahblah </score> or <score foo bar> ... </score> is introduces > for music notes as written below. See also > http://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91:Grin/lilypond&act… live use. Anyone to add a new exceptcion to textlib? > Not a big deal, I am just far from my own computer now where I could solve > it. It should be handled in the way as syntaxhighlight in line 121 here: > http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/pywikibot/tex… > > ---------- Forwarded message ---------- > From: MZMcBride <z(a)mzmcbride.com> > Date: 2013/4/23 > Subject: [Wikitech-l] Bug 189: "Add a music wikimodule" resolved/fixed > To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> > > > Hi. > > https://bugzilla.wikimedia.org/show_bug.cgi?id=189 > > Congrats to all involved in getting bug 189 resolved! :-) > > Bug 189 was one of the oldest unresolved and one of the better known bugs > in Bugzilla involving a request to add a music module to Wikimedia wikis. > Quick stats about the bug: > > * Opened: 2004-08-22 > * Votes: 48 > * Comments: 123 > > The bug filer is still around and left a nice note on the bug > (<https://bugzilla.wikimedia.org/show_bug.cgi?id=189#c123>): > > --- > Congratulations to all ! > > It makes my dream comes true today ! > > Thanks million times! > --- > > <https://en.wikipedia.org/wiki/Note> seemed like an easy target for > demoing the newly deployed Score extension > (<https://www.mediawiki.org/wiki/Extension:Score>) on a production site, > if anyone's interested. I tried looking around for a point and click > lilypond or ABC code generation tool (preferably Web-based), but a lot of > these tools quickly went over my head. > > MZMcBride > > > > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > > > > -- > Bináris > > > > -- > Bináris > _______________________________________________ > Wikidata-l mailing list > Wikidata-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikidata-l > >

2 1

[Pywikipedia-l] Interwiki.py?
by Jan Dudík 24 Apr '13

24 Apr '13

How to use interwiki.py now for wikipedia? I use http://www.wikidata.org/wiki/User:Reza1615/BOT/new_interwiki.py but i want to use classical interwiki.py too, because of posibilities like -hint:20, -neverlink:foo, -ignore:en:bar etc It should mininimally remove incorrect links from wikipedia and add pages to wikidata When I run interwiki.py dinotopie -neverlink:hu Getting 1 page from wikipedia:cs... ... WARNING: wikipedia: [[cs:Dinotopie]] links to incorrect [[hu:Dinotópia (film, 2002)]] WARNING: wikipedia: [[el:Deinotopía]] links to incorrect [[hu:Dinotópia (film, 2002)]] WARNING: wikipedia: [[de:Dinotopia]] links to incorrect [[hu:Dinotópia (film, 2002)]] But no page is changed When I run interwiki.py dinotopie -repository Getting 1 page from wikipedia:cs... [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[de:Dinotopia]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[el:Deinotopía]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[en:Dinotopia]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[es:Dinotopia]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[fr:Dinotopia]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[hu:Dinotópia (film, 2002)]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[it:Dinotopia]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[nl:Dinotopia]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[pl:Dinotopia]] [[cs:Dinotopie]]: [[cs:Dinotopie]] gives new interwiki [[pt:Dinotopia]] Getting 1 page from wikidata:wikidata... Traceback (most recent call last): File "D:\Py\pagegenerators.py", line 1234, in __iter__ for loaded_page in self.preload(somePages): File "D:\Py\pagegenerators.py", line 1253, in preload pywikibot.getall(site, pagesThisSite) File "D:\Py\wikipedia.py", line 5464, in getall _GetAll(site, pages, throttle, force).run() File "D:\Py\wikipedia.py", line 5081, in run data = self.getData() File "D:\Py\wikipedia.py", line 5251, in getData pagenames = u'\r\n'.join(pagenames) TypeError: sequence item 0: expected string or Unicode, NoneType found sequence item 0: expected string or Unicode, NoneType found Dump cs (wikipedia) appended. Traceback (most recent call last): File "D:\Py\interwiki.py", line 2678, in <module> main() File "D:\Py\interwiki.py", line 2652, in main bot.run() File "D:\Py\interwiki.py", line 2370, in run self.queryStep() File "D:\Py\interwiki.py", line 2343, in queryStep self.oneQuery() File "D:\Py\interwiki.py", line 2339, in oneQuery subject.batchLoaded(self) File "D:\Py\interwiki.py", line 1391, in batchLoaded (skip, alternativePage) = self.disambigMismatch(page, counter) File "D:\Py\interwiki.py", line 1158, in disambigMismatch elif not self.originPage.isDisambig() and page.isDisambig(): File "D:\Py\wikipedia.py", line 1570, in isDisambig self.templates()) File "D:\Py\wikipedia.py", line 2830, in templates get_redirect=get_redirect)])) File "D:\Py\wikipedia.py", line 2853, in templatesWithParams extract_templates_and_params(thistxt, asList=True)] File "D:\Py\pywikibot\textlib.py", line 899, in extract_templates_and_params thistxt = removeDisabledParts(text) File "D:\Py\pywikibot\textlib.py", line 272, in removeDisabledParts return toRemoveR.sub('', text) TypeError: expected string or buffer -- JAnD

1 0

[Pywikipedia-l] Stop supporting non-API wikis
by Amir Ladsgroup 23 Apr '13

23 Apr '13

Hello all, API is one of the most important features of MW and it has been used on WMF wikis since 2009 If I recall correctly I want to use API on everything remained (in PWB codes) in order to reduce pressure on servers but this idea of supporting non-API wikis is really annoying and unreasonable in my opinion I think we must end supporting non-API wikis, If you're not agree with me, tell me why not Best -- Amir

5 6

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot April 2013