pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

[Pywikipedia-l] Resolved: Re: add_text.py feature that is sometimes a bug with stub templates
by Max Klein 08 Oct '12

08 Oct '12

> > > From: masti <mastigm(a)gmail.com> > To: pywikipedia-l(a)lists.wikimedia.org > Cc: > Date: Sat, 06 Oct 2012 23:25:11 +0200 > Subject: Re: [Pywikipedia-l] add_text.py feature that is sometimes a bug > with stub templates > On 10/04/2012 09:12 PM, Max Klein wrote: > >> Hello I see that Filnik has written add_text.py for pywikipedia bot. My >> bot [[en:user:VIAFbot]] calls this. It's an extremely useful function, >> but there is a problem. add_text.py puts all the templates that are >> below the categories above the categories when I call it [see >> http://en.wikipedia.org/w/**index.php?title=David_K._** >> Shipler&diff=next&oldid=**455476445<http://en.wikipedia.org/w/index.php?title=David_K._Shipler&diff=next&oldid=…> >> <http://en.wikipedia.org/w/**index.php?title=David_K._** >> Shipler&diff=next&oldid=**455476445<http://en.wikipedia.org/w/index.php?title=David_K._Shipler&diff=next&oldid=…> >> >]. >> On English Wikipedia that's a problem because the >> [[en:Wikipedia:Manual_of_**Style/Layout#Order_of_**sections|English >> manual >> of style]] says that stub templates go below categories. >> Can you think of a way to patch this? >> Thanks, >> Max >> > > there is -noreorder parameter to prevent this. > Have you tried it? > > masti > > Hi Masti, I did see that you can use -noreorder. The problem with no reorder is that then you are just inserting at the very last line of the page. But I finally understood what add_text does The thing that is misleading is that it doesn't "insert above category and language links but below the rest of the text" like it says. It's true that add_text has that effect when pages follow the order of 1. content 2. templates 3. categories 4. language links but in English Wikipedia there are sometimes things stored inbetween categories and language links ( I agree that the practice of doing that is bad). In fact what add_text does is remove the categories and language links, insert text at the end, and then paste back on categories and language links. That means that if there are other things inbetween categories and language links then they will jump up in order. I refactored my code to stop using add_text and am running using a modified version of replaceExcept to insert text via big switch statement searching for the first category, or first {{persondata}}. Thanks, Max

1 0

[Pywikipedia-l] add_text.py feature that is sometimes a bug with stub templates
by Max Klein 06 Oct '12

06 Oct '12

Hello I see that Filnik has written add_text.py for pywikipedia bot. My bot [[en:user:VIAFbot]] calls this. It's an extremely useful function, but there is a problem. add_text.py puts all the templates that are below the categories above the categories when I call it [see http://en.wikipedia.org/w/index.php?title=David_K._Shipler&diff=next&oldid=…]. On English Wikipedia that's a problem because the [[en:Wikipedia:Manual_of_Style/Layout#Order_of_sections|English manual of style]] says that stub templates go below categories. Can you think of a way to patch this? Thanks, Max

2 1

[Pywikipedia-l] Wikimedia Nederland Hackathon 2012
by Maarten Dammers 06 Oct '12

06 Oct '12

(Dutch below) After the successful hackathon in 2012 it's time for the Wikimedia Nederland Hackathon 2012. The Hackathon will take place on Saturday 10 November, the day after our annual Wikimedia Nederland Conference. The approach is the same as last year: We'll arrange a location, food and drinks. You all come with your laptops and good ideas. Some possible topics: * TS-reports * Good old Mediawiki * Pywikipedia * Wikidata * GLAMwiki toolset project * Open Cultuur Data * ... This hackathon doesn't aim, like the Berlin Hackathon, to be a global Hackathon. It aims to be more of a regional hackathon. We have a very limited budget for travel and accommodation More information and registration at https://nl.wikimedia.org/wiki/Hackathon_2012/en ------------ Na de succesvolle hackathon in 2011 is het op zaterdag 10 november tijd voor de Wikimedia Nederland Hackathon 2012. Dit is de dag na de Wikimedia Conferentie Nederland. De opzet zal hetzelfde zijn als vorig jaar: Wij zorgen voor een locatie, hapjes en drankjes. Jullie komen met de laptops en de goede ideeën. Een aantal mogelijke onderwerpen: * TS-reports * Good old Mediawiki * Pywikipedia * Wikidata * GLAMwiki toolset project * Open Cultuur Data * ... Deze Hackathon richt zich niet, zoals de Hackathon in Berlijn, op alle ontwikkelaars wereldwijd, maar heeft een meer regionaal karakter. We hebben dan ook een zeer beperkt budget voor reizen en accommodatie. Meer informatie en inschrijven op https://nl.wikimedia.org/wiki/Hackathon_2012 Maarten Dammers Wikimedia Nederland

1 0

[Pywikipedia-l] Fwd: Fwd: Learning Git/Gerrit? Answer poll to choose tutorial date
by Lewis Cawte 24 Sep '12

24 Sep '12

-------- Original Message -------- Subject: Fwd: Learning Git/Gerrit? Answer poll to choose tutorial date Date: Mon, 24 Sep 2012 15:42:07 -0400 From: Sumana Harihareswara <sumanah(a)wikimedia.org> Organisation: Wikimedia Foundation To: Lewis Cawte <lewiscawte(a)googlemail.com>, Jon Robson <jrobson(a)wikimedia.org>, Maarten Dammers <maarten.dammers(a)wikimedianederland.nl>, Butch Bustria <butch(a)wikimedia.org.ph>, Yuvi Panda <yuvipanda(a)gmail.com> Would you mind helping me out by forwarding/reposting this to relevant Wikimedia communities? Tool/bot makers, people who want to learn to hack MediaWiki, mobile developers, etc. Thanks! -Sumana -------- Original Message -------- Subject: Learning Git/Gerrit? Answer poll to choose tutorial date Date: Mon, 24 Sep 2012 15:39:25 -0400 From: Sumana Harihareswara <sumanah(a)wikimedia.org> Organization: Wikimedia Foundation To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> Git, Gerrit, and You! A Tutorial Where: IRC/SIP/SSH We want all our developers to feel comfortable with Git, git-review, and Gerrit. So saper is leading a hands-on online training: https://www.mediawiki.org/wiki/Project:WikiProject_Extensions/MediaWiki_Wor… . Check [[Git/Workshop]] for testing access to the conference & lab setup. Saper will be available for 3 hours, and there'll be a break in the middle. Absolute beginners with Git might want to stay for the whole three hours; people with some experience won't need as long. Answer this poll to help saper choose a date: 17:30 UTC on 26 September, 27 September, 2 October, or 3 October. http://www.doodle.com/pbdbrcrh5gdpvrfu If you want to attend, please also answer this question: how much do you already know? http://www.doodle.com/zhn7buksgrg8e8rx Thanks for doing this, saper. -- Sumana Harihareswara Engineering Community Manager Wikimedia Foundation

1 0

[Pywikipedia-l] Support for SSL server
by Marco Aurelio 16 Sep '12

16 Sep '12

Hello, This is my first post to this list. Apologies if this issue has been already discussed & also for my bad English. I wonder if it is possible to make the bot edit through the https server instead of the normal one and how that can be done. Thanks in advance for your help. Best regards, M. -- - Marco Aurelio

2 1

[Pywikipedia-l] Fix for wikipedia.py getVersionHistory
by Johnuniq 16 Aug '12

16 Aug '12

Pywikipedia (r10475 (wikipedia.py), 2012/08/09, 16:51:37) wikipedia.py seems to have the same bug in two places. At lines 2976 and 3145: if 'query-continue' in result and getAll: params['rvstartid'] = ... where ... is: result['query-continue']['revisions']['rvstartid'] Fix is to change "rvstartid" to "rvcontinue": result['query-continue']['revisions']['rvcontinue'] # Demonstrate problem by running following. # Get a long history list from en.wikipedia.org. import wikipedia site = wikipedia.getSite(fam='wikipedia') page = wikipedia.Page(site, 'Ahalya') hist = page.getVersionHistory(getAll=True) print 'len(getVersionHistory()) = %d' % len(hist) Calling getVersionHistory() raises an exception at line 2977: KeyError: 'rvstartid' That is fixed by making the change shown above; output: len(getVersionHistory()) = 1256 John

2 1

[Pywikipedia-l] Solution to Automatic generation of templates descriptions
by Max Klein 06 Aug '12

06 Aug '12

> > > From: Yury Katkov <katkov.juriy(a)gmail.com> > To: MediaWiki announcements and site admin list < > mediawiki-l(a)lists.wikimedia.org>, pywikipedia-l(a)lists.wikimedia.org > Cc: > Date: Mon, 6 Aug 2012 16:05:03 +0400 > Subject: [Pywikipedia-l] Automatic generation of templates descriptions > Hello! Is there a bot or extension that can generate stubs of template > descriptions by template wikitext? It should be pretty simple: the bot will > just grab all template parameters {{{PARAMETER}}} and lists those > parameters. > > If no such extensions exists could anybody tell how to programaticaly get > the parameters of a given template? > Hi Yury, I actually just solved this problem myself. There is indeed a method of pywikipediabot that does this - it's called templatesWithParams() Here is a code example where I am looking to get see what the "VIAF" parameter is of the {{Authority Control}} template: def determineAuthorityControlTemplate(nameOfPage): """returns 'noACtemplate' if no Authority Control Template, 'templateNoVIAF' if AC template but no VIAF number, and returns the viaf number if it exists""" namepage = Page(enwp,nameOfPage) templates = namepage.templatesWithParams() #here we load the templates into a list for template in templates: # go through the templates if template[0] == 'Authority control': # are we looking at the right template? for param in template[1]: #go through the paramaters of the template if param[:4] == 'VIAF': #are we looking at the right parameter? return param[5:] return 'templateNoVIAF' return 'noACtemplate' Best, Max > > > Sincerely yours, > ----- > Yury Katkov > > > > _______________________________________________ > Pywikipedia-l mailing list > Pywikipedia-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l > >

2 1

[Pywikipedia-l] Request for commit access
by Z Z 16 Jul '12

16 Jul '12

Hi, I'm interested in working on pywikipedia and want to have the access. I've already developed many codes for bots on my home Wikipedia and with this access I can "merge" these features with the standard pywikipedia package. Regards, Z

1 0

[Pywikipedia-l] Fw: Improving the extraction of Wikipedia data
by koltzenburg＠w4w.net 27 Jun '12

27 Jun '12

fyi, ck http://libresoft.es/node/564 Improving the extraction of Wikipedia data Published by jfelipe on Sun, 2012-06-03 18:37 my source: “Wikipedia Academy” preview, by Daniel Mietchen https://blog.wikimedia.org/2012/06/26/wikimedia-research-newsletter-june- 2012/#.22Wikipedia_Academy.22_preview

1 0

[Pywikipedia-l] UnicodeDecodeError in 'pywikibot/comms/http.py'
by Dr. Trigon 25 Jun '12

25 Jun '12

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all! I got this error (from trunk): Traceback (most recent call last): File "../pywikipedia/subster.py", line 251, in subContent (substed_content, tags) = self.subTemplate(substed_content, item) File "../pywikipedia/subster.py", line 345, in subTemplate external_buffer = http.request(self.site, param['url'], no_hostname = True) File "../pywikipedia/pywikibot/comms/http.py", line 125, in request pywikibot.output(u'%s' %e) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 42: ordinal not in range(128) and was able to trace the code line 125 (http.py): pywikibot.output(u'%s' %e) back to "revision 7591 by alexsh, Wed Nov 4 13:22:17 2009 UTC" line 5508, please confer [1]. Now this code snipplet is quite old and I doubt someone is able to remember any details... ;) [1] http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/wikipedia.py?… ...BUT what about the error I got? Does anybody experience the same? I think it is related to network timeouts (e.g. servers not reachable) and thus hard to reproduce... I was using Python 2.7.3: Python 2.7.3 (default, May 29 2012, 14:54:22) [GCC 4.6.3 20120306 (Red Hat 4.6.3-2)] on linux2 Greetings and thanks for any hints! DrTrigon -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk/ki5cACgkQAXWvBxzBrDBkBgCfWS/QJVd4xSzNiEqgGFzigUTa kOkAoNdjOV0Zmhnw9dyOAPOLl1xYbZt1 =O9hG -----END PGP SIGNATURE-----

3 4

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot