Pywikipedia-l July 2009

pywikipedia-l@lists.wikimedia.org

12 participants
9 discussions

search output
by Chris Watkins 02 Aug '09

02 Aug '09

Hi, I want to list all pages in our wiki that use tables. This seems like it should be simple, but I'm not sure how to do it. Any ideas? I know that "{|" (the beginning of a table) works as a search term, as I tried it with replace.py. However, I don't want to replace anything, and I don't want to sit there pressing "n" for each result. Ideally I could capture just the names of the pages, without extended details (such as a proposed diff given by replace.py). Any help much appreciated. Cheers -- Chris Watkins Appropedia.org - Sharing knowledge to build rich, sustainable lives. identi.ca/appropedia / twitter.com/appropedia blogs.appropedia.org I like this: five.sentenc.es

6 11

rewrite brach "replace.py" error with user-fixes.py
by Matias 30 Jul '09

30 Jul '09

Hi, I have a problem with my user-fixes.py file. When I run replace.py using a "fix" defined if my user-fixes.py, an error raises like if there isn't a valid entry for the argument. Same user-fixes.py file works fine with trunk. I'm using latest rewrite from SVN. User-fixes.py is inside "/scripts" with the fixes.py file. Any Idea? Matias A.

2 2

interwiki crash
by masti 26 Jul '09

26 Jul '09

python pywikipedia/interwiki.py -start:"Eisenbunnsstreck" Traceback (most recent call last): File "pywikipedia/interwiki.py", line 311, in <module> import wikipedia, config, pagegenerators, catlib File "/home/mst/pw/pywikipedia/wikipedia.py", line 148, in <module> import config, login, query, version File "/home/mst/pw/pywikipedia/config.py", line 88, in <module> for _filename in os.listdir(os.path.join(_base_dir, 'families')): OSError: [Errno 2] Nie ma takiego pliku ani katalogu: '/home/mst/pw/families' [mst@pl37007 pw]$ python pywikipedia/interwiki.py -start:"Eisenbunnsstreck" -autonomous Traceback (most recent call last): File "pywikipedia/interwiki.py", line 311, in <module> import wikipedia, config, pagegenerators, catlib File "/home/mst/pw/pywikipedia/wikipedia.py", line 148, in <module> import config, login, query, version File "/home/mst/pw/pywikipedia/config.py", line 88, in <module> for _filename in os.listdir(os.path.join(_base_dir, 'families')): OSError: [Errno 2] Nie ma takiego pliku ani katalogu: '/home/mst/pw/families' [mst@pl37007 pw]$ python pywikipedia/version.py Traceback (most recent call last): File "pywikipedia/version.py", line 74, in <module> print 'Pywikipedia %s' % getversion() File "pywikipedia/version.py", line 20, in getversion return '%(tag)s (r%(rev)s, %(date)s)' % getversiondict() File "pywikipedia/version.py", line 32, in getversiondict import wikipedia File "/home/mst/pw/pywikipedia/wikipedia.py", line 148, in <module> import config, login, query, version File "/home/mst/pw/pywikipedia/config.py", line 88, in <module> for _filename in os.listdir(os.path.join(_base_dir, 'families')): OSError: [Errno 2] Nie ma takiego pliku ani katalogu: '/home/mst/pw/families'

2 1

Double az: interwiki
by Jan Dudík 23 Jul '09

23 Jul '09

Hello, I found problem with az.wiki: there are some articles in two versions: latin and arabic, e.g. http://az.wikipedia.org/wiki/Erm%C9%99nistan http://az.wikipedia.org/wiki/%D8%A7%D8%A6%D8%B1%D9%85%D9%86%DB%8C%D8%B3%D8%… Both is about Armenia Bot cannot handle with it, and there is autonomous error when both interwiki is present in article. Have any Idea how to solve it? The best solution might be double language wiki like sr or second wiki like be and be-x-old, but this depend on developers [[:cs:User:JAn Dudík]] -- -- Ing. Jan Dudík

2 1

Re: [Pywikipedia-l] interwiki.py crashes on disambigs
by alexsh 20 Jul '09

20 Jul '09

Fixed in r7082. Thank you. --Alex Shih-Han Lin ※ 引述《"masti" <mastigm(a)gmail.com>》之郵件內容： >Hi, >since some time interwiki.py crashes when it encounters disambig page. >example from pl.wiki: > >$python pywikipedia/interwiki.py -start:"Gaines (ujednoznacznienie)" >NOTE: Number of pages queued is 0, trying to add 60 more. >Dump pl (wikipedia) saved >Traceback (most recent call last): > File "pywikipedia/interwiki.py", line 2156, in <module> > bot.run() > File "pywikipedia/interwiki.py", line 1865, in run > self.queryStep() > File "pywikipedia/interwiki.py", line 1838, in queryStep > self.oneQuery() > File "pywikipedia/interwiki.py", line 1806, in oneQuery > site = self.selectQuerySite() > File "pywikipedia/interwiki.py", line 1780, in selectQuerySite > self.generateMore(globalvar.maxquerysize - mycount) > File "pywikipedia/interwiki.py", line 1711, in generateMore > page = self.pageGenerator.next() > File "/home/mst/pw/pywikipedia/pagegenerators.py", line 729, in >DuplicateFilterPageGenerator > for page in generator: > File "/home/mst/pw/pywikipedia/pagegenerators.py", line 254, in >AllpagesPageGenerator > for page in site.allpages(start = start, namespace = namespace, >includeredirects = includeredirects): > File "/home/mst/pw/pywikipedia/wikipedia.py", line 5647, in allpages > for p in data['query']['allpages']: >KeyError: 'query' > >$python pywikipedia/version.py >Pywikipedia (r7080 (wikipedia.py), 2009/07/19, 12:40:06) >Python 2.6 (r26:66714, Jun 8 2009, 16:07:26) >[GCC 4.4.0 20090506 (Red Hat 4.4.0-4)] > > >masti > >_______________________________________________ >Pywikipedia-l mailing list >Pywikipedia-l(a)lists.wikimedia.org >https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l >

1 0

interwiki.py crashes on disambigs
by masti 20 Jul '09

20 Jul '09

Hi, since some time interwiki.py crashes when it encounters disambig page. example from pl.wiki: $python pywikipedia/interwiki.py -start:"Gaines (ujednoznacznienie)" NOTE: Number of pages queued is 0, trying to add 60 more. Dump pl (wikipedia) saved Traceback (most recent call last): File "pywikipedia/interwiki.py", line 2156, in <module> bot.run() File "pywikipedia/interwiki.py", line 1865, in run self.queryStep() File "pywikipedia/interwiki.py", line 1838, in queryStep self.oneQuery() File "pywikipedia/interwiki.py", line 1806, in oneQuery site = self.selectQuerySite() File "pywikipedia/interwiki.py", line 1780, in selectQuerySite self.generateMore(globalvar.maxquerysize - mycount) File "pywikipedia/interwiki.py", line 1711, in generateMore page = self.pageGenerator.next() File "/home/mst/pw/pywikipedia/pagegenerators.py", line 729, in DuplicateFilterPageGenerator for page in generator: File "/home/mst/pw/pywikipedia/pagegenerators.py", line 254, in AllpagesPageGenerator for page in site.allpages(start = start, namespace = namespace, includeredirects = includeredirects): File "/home/mst/pw/pywikipedia/wikipedia.py", line 5647, in allpages for p in data['query']['allpages']: KeyError: 'query' $python pywikipedia/version.py Pywikipedia (r7080 (wikipedia.py), 2009/07/19, 12:40:06) Python 2.6 (r26:66714, Jun 8 2009, 16:07:26) [GCC 4.4.0 20090506 (Red Hat 4.4.0-4)] masti

1 0

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [7062] trunk/pywikipedia/wikipedia.py
by Russell Blau 14 Jul '09

14 Jul '09

Alex - Are you aware of the rewrite branch of pywikipedia? The rewrite branch is written to use the API consistently, and much of what you are doing in the trunk is already implemented in the rewrite branch. You might want to take a look at the rewrite branch and see if you can contribute to it. Russ ----- Original Message ----- From: <alexsh(a)svn.wikimedia.org> To: <pywikipedia-svn(a)lists.wikimedia.org> Sent: Tuesday, July 14, 2009 12:59 PM Subject: [Pywikipedia-svn] SVN: [7062] trunk/pywikipedia/wikipedia.py > Revision: 7062 > Author: alexsh > Date: 2009-07-14 16:59:57 +0000 (Tue, 14 Jul 2009) > > Log Message: > ----------- > Change page.getRestrictions() API data from XML to JSON(had comments about > get multiple pages data), function tested in blockpageschecker.py > > Modified Paths: > -------------- > trunk/pywikipedia/wikipedia.py > > Modified: trunk/pywikipedia/wikipedia.py > =================================================================== > --- trunk/pywikipedia/wikipedia.py 2009-07-14 12:13:56 UTC (rev 7061) > +++ trunk/pywikipedia/wikipedia.py 2009-07-14 16:59:57 UTC (rev 7062) > @@ -1308,28 +1308,44 @@ > ('autoconfirmed' or 'sysop') > * expiry is the expiration time of the restriction > """ > + #, titles = None > + #if titles: > + # restrictions = {} > + #else: > restrictions = { 'edit': None, 'move': None } > try: > api_url = self.site().api_address() > except NotImplementedError: > return restrictions > - api_url += > 'action=query&prop=info&inprop=protection&format=xml&titles=%s' % > self.urlname() > - text = self.site().getUrl(api_url) > - if 'missing=""' in text: > - self._getexception = NoPage > - raise NoPage('Page %s does not exist' % self.aslink()) > - elif not 'pageid="' in text: > - # I don't know what may happen here. > - # We may want to have better error handling > - raise Error("BUG> API problem.") > - match = re.findall(r'<protection>(.*?)</protection>', text) > + > + predata = { > + 'action': 'query', > + 'prop': 'info', > + 'inprop': 'protection', > + 'titles': self.title(), > + } > + #if titles: > + # predata['titles'] = query.ListToParam(titles) > + > + text = query.GetData(predata, useAPI = True)['query']['pages'] > + > + for pageid in text: > + if text[pageid].has_key('missing'): > + self._getexception = NoPage > + raise NoPage('Page %s does not exist' % self.aslink()) > + elif not text[pageid].has_key('pageid'): > + # Don't know what may happen here. > + # We may want to have better error handling > + raise Error("BUG> API problem.") > + if text[pageid]['protection'] != []: > + #if titles: > + # restrictions[ pageid ] = { 'edit': None, 'move': > None } > + # for detail in text[pageid]['protection']: > + # restrictions[ pageid ][ detail[ 'type' ] ] = [ > detail[ 'level' ], detail[ 'expiry'] ] > + #else: > + for detail in text[pageid]['protection']: > + restrictions[ detail[ 'type' ] ] = [ detail[ > 'level' ], detail['expiry'] ] > > - if match: > - text = match[0] # If there's the block "protection" take the > settings inside it. > - api_found = re.compile(r'<pr type="(.*?)" level="(.*?)" > expiry="(.*?)" />') > - for entry in api_found.findall(text): > - restrictions[ entry[0] ] = [ entry[1], entry[2] ] > - > return restrictions > > def put_async(self, newtext, > > > > _______________________________________________ > Pywikipedia-svn mailing list > Pywikipedia-svn(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-svn >

1 0

Re: [Pywikipedia-l] Getting started
by Merlijn van Deen 13 Jul '09

13 Jul '09

Hello Mary, the self.langs should contain the hostname 'localhost'. The path for the wiki should be given in scriptpath. In your case, try something like self.langs = {'en': 'localhost'} def scriptpath(self, code): return '/default' Hopefully that should work! Best reagards, Merlijn On Fri, June 19, 2009 9:56 pm, Beebe, Mary J wrote: > I am not trying a simpler family setup file. I am putting None in for > en:'None'. Then adding: > def hostname(self,code): > return '/default' > > Mary Beebe > > ________________________________ > From: pywikipedia-l-bounces(a)lists.wikimedia.org > [mailto:pywikipedia-l-bounces@lists.wikimedia.org] On Behalf Of Beebe, > Mary J > Sent: Friday, June 19, 2009 3:22 PM > To: pywikipedia-l(a)lists.wikimedia.org > Subject: [Pywikipedia-l] Getting started > > I am trying to setup pywikipedia to work on my local wiki. I have tried > to follow online steps plus steps within README-family.txt. > > My test wiki is: http://localhost/default (it is not live anywhere). > > It seems like I am having trouble with this line within default_family.py > (my family file). > > self.langs = { # REQUIRED > 'en': 'localhost/default', # Include one line for each wiki > in family > # in the format 'code': 'hostname', > } > > I have tried many different possibilities but have been unsuccessful. > Here is the message I receive with login.py: > > login.py > Password for user PyWikipedialBot on default:en: > Logging in to default:en as PyWikipedialBot > Traceback (most recent call last): > File "C:\Documents and Settings\beebem\Desktop\pywikipedia\login.py", > line 316, in <module> > main() > File "C:\Documents and Settings\beebem\Desktop\pywikipedia\login.py", > line 312, in main > loginMan.login() > File "C:\Documents and Settings\beebem\Desktop\pywikipedia\login.py", > line 248, in login > cookiedata = self.getCookie() > File "C:\Documents and Settings\beebem\Desktop\pywikipedia\login.py", > line 166, in getCookie > response, data = self.site.postData(address, > self.site.urlEncode(predata)) > File "C:\Documents and > Settings\beebem\Desktop\pywikipedia\wikipedia.py", line 4655, in > postData > conn.endheaders() > File "C:\Python26\lib\httplib.py", line 868, in endheaders > self._send_output() > File "C:\Python26\lib\httplib.py", line 740, in _send_output > self.send(msg) > File "C:\Python26\lib\httplib.py", line 699, in send > self.connect() > File "C:\Python26\lib\httplib.py", line 683, in connect > self.timeout) > File "C:\Python26\lib\socket.py", line 498, in create_connection > for res in getaddrinfo(host, port, 0, SOCK_STREAM): > socket.gaierror: [Errno 11001] getaddrinfo failed > > Thank you, > > Mary Beebe > > > _______________________________________________ > Pywikipedia-l mailing list > Pywikipedia-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l >

2 1

generate_user_files.py: "No such file or directory: 'families'"
by Chris 05 Jul '09

05 Jul '09

Hi all, While following the Wikimedia "Pywikipedia bot on non-Wikimedia projects" instructions, I received the following error. Guessing that PYTHONPATH was required, I supplied it in .bashrc and the current terminal (so I don't have to run .bashrc before using pywikipedia). But the error still occurs and I'm out of my one idea (and Google's zero) about the cause. $ echo $PYTHONPATH /home/coder/pywikipedia $ python /home/coder/pywikipedia/generate_user_files.py 1: Create user_config.py file 2: Create user_fixes.py file 3: The two files What do you do? 3 Traceback (most recent call last): File "/home/coder/pywikipedia/generate_user_files.py", line 125, in <module> create_user_config() File "/home/coder/pywikipedia/generate_user_files.py", line 47, in create_user_config know_families = re.findall(r'(.+)_family.py\b', '\n'.join(os.listdir(os.path.join(base_dir, "families")))) OSError: [Errno 2] No such file or directory: 'families' Any guidance would be greatly appreciated, Chris

2 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l July 2009