Pywikipedia-l September 2010

pywikipedia-l@lists.wikimedia.org

17 participants
35 discussions

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [8588] trunk/pywikipedia/userlib.py
by Dr. Trigon 22 Sep '10

22 Sep '10

Works for me too! Thanks a lot for investigating this! Am 22.09.2010 06:53, schrieb xqt(a)svn.wikimedia.org: > Revision: 8588 > Author: xqt > Date: 2010-09-22 04:53:21 +0000 (Wed, 22 Sep 2010) > > Log Message: > ----------- > Fix for ascii encoding error for User.__str__() reported by DrTrigon > > Modified Paths: > -------------- > trunk/pywikipedia/userlib.py > > Modified: trunk/pywikipedia/userlib.py > =================================================================== > --- trunk/pywikipedia/userlib.py 2010-09-21 16:47:03 UTC (rev 8587) > +++ trunk/pywikipedia/userlib.py 2010-09-22 04:53:21 UTC (rev 8588) > @@ -11,7 +11,7 @@ > > import re > import wikipedia as pywikibot > -import query > +import query, config > > class AutoblockUser(pywikibot.Error): > """ > @@ -85,7 +85,9 @@ > return ip_regexp.match(self.username) is not None > > def __str__(self): > - return u'%s:%s' % (self.site() , self.name()) > + return (u'%s:%s' > + % (self.site(), self.name())).encode(config.console_encoding, > + 'replace') > > def __repr__(self): > return self.__str__() > > > > _______________________________________________ > Pywikipedia-svn mailing list > Pywikipedia-svn(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-svn >

1 0

Bug fix for userlib.User.__str__
by Dr. Trigon 21 Sep '10

21 Sep '10

Hello all I recognized an issue, when executing the following code: print userlib.User(pywikibot.getSite(), u'º_the_Bench_º') results in Traceback (most recent call last): File "tests/dtbext_tester.py", line 279, in <module> print userlib.User(pywikibot.getSite(), u'º_the_Bench_º') UnicodeEncodeError: 'ascii' codec can't encode character u'\xba' in position 13: ordinal not in range(128) The u'\xba' is assigned to u'º' which raises an UnicodeEncodeError. By using the patch attached, which simply adds an '.encode(self.site().encoding())' to the string produced the issues is solved for me. And produces: wikipedia:de:º_the_Bench_º May be the 'self.site().encoding()' should or has to be replaced by another var or const. But the encoding to something like 'utf8' is essential as statet in [1]. Thanks a lot and greetings DrTrigon [1] http://wiki.python.org/moin/UnicodeEncodeError

2 2

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [8571] trunk/pywikipedia/wikipedia.py
by Dr. Trigon 19 Sep '10

19 Sep '10

Works like a charm! Thanks a lot!! Greetings Am 17.09.2010 11:20, schrieb xqt(a)svn.wikimedia.org: > Revision: 8571 > Author: xqt > Date: 2010-09-17 09:20:40 +0000 (Fri, 17 Sep 2010) > > Log Message: > ----------- > NoPage and BadTitle exceptions for _getVersionHistory, requested by DrTrigon > > Modified Paths: > -------------- > trunk/pywikipedia/wikipedia.py > > Modified: trunk/pywikipedia/wikipedia.py > =================================================================== > --- trunk/pywikipedia/wikipedia.py 2010-09-17 05:41:56 UTC (rev 8570) > +++ trunk/pywikipedia/wikipedia.py 2010-09-17 09:20:40 UTC (rev 8571) > @@ -2615,6 +2615,13 @@ > result = query.GetData(params, self.site()) > if 'error' in result: > raise RuntimeError("%s" % result['error']) > + pageInfo = result['query']['pages'].values()[0] > + if result['query']['pages'].keys()[0] == "-1": > + if 'missing' in pageInfo: > + raise NoPage(self.site(), self.aslink(forceInterwiki=True), > + "Page does not exist.") > + elif 'invalid' in pageInfo: > + raise BadTitle('BadTitle: %s' % self) > > if 'query-continue' in result and getAll: > params['rvstartid'] = result['query-continue']['revisions']['rvstartid'] > @@ -2624,7 +2631,7 @@ > if skipFirst: > skipFirst = False > else: > - for r in result['query']['pages'].values()[0]['revisions']: > + for r in pageInfo['revisions']: > c = '' > if 'comment' in r: > c = r['comment'] > > > > _______________________________________________ > Pywikipedia-svn mailing list > Pywikipedia-svn(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-svn >

1 0

Working on more wikis
by Bináris 18 Sep '10

18 Sep '10

Hi, I started a new wiki on wikia.com. I created a family file for it (luckily, I found wowwiki_family, which colud be copied and modified), and made a successful edit while commented out my Wikipedia usernames in user-config.py. Now, the question is, how can I use these two together? One day I would like to edit Wikipedia, and on the other day my wikia wiki. So, how can I tell the bot, which wiki to work on? (lang is 'hu' on both, the family is different) -- Bináris

3 6

Question about getVersionHistory
by Dr. Trigon 17 Sep '10

17 Sep '10

Hello all Is it ok, that page.getVersionHistory without a previous page.get is not able to correctly resolve NoPage (and may be other). Example is the page 'Wikipedia Diskussion:WikiProjekt Portale/Baustelle/Portal:Biochemie' which throws the python error: Traceback (most recent call last): File "tests/dtbext_tester.py", line 240, in <module> TEST_get() File "tests/dtbext_tester.py", line 226, in TEST_get page.getVersionHistory() File "./wikipedia.py", line 2576, in getVersionHistory dataQuery.extend(self._getVersionHistory(getAll, skip, reverseOrder, revCount)) File "./wikipedia.py", line 2627, in _getVersionHistory for r in result['query']['pages'].values()[0]['revisions']: KeyError: 'revisions' So it seams that getVersionHistory and _getVersionHistory do not resolve and throw the needed exceptions. Greetings DrTrigon

2 1

Question about missing family
by Dr. Trigon 15 Sep '10

15 Sep '10

Hello all! The family 'wiki' is listed as known and gets returned by 'get_known_families', but yield a ValueError... Also the file in families/ is missing. What does happen here? Bug? Greetings DrTrigon

1 0

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [8562] trunk/pywikipedia/wikipedia.py
by Dr. Trigon 15 Sep '10

15 Sep '10

And again: Thanks a lot!!! Greetings Am 15.09.2010 14:54, schrieb xqt(a)svn.wikimedia.org: > Revision: 8562 > Author: xqt > Date: 2010-09-15 12:54:46 +0000 (Wed, 15 Sep 2010) > > Log Message: > ----------- > pre"loading" version history, submitted by DrTrigon. > Fix for old bug: VH was never reloaded if len(VH)< revCount. > > Modified Paths: > -------------- > trunk/pywikipedia/wikipedia.py > > Modified: trunk/pywikipedia/wikipedia.py > =================================================================== > --- trunk/pywikipedia/wikipedia.py 2010-09-15 11:32:15 UTC (rev 8561) > +++ trunk/pywikipedia/wikipedia.py 2010-09-15 12:54:46 UTC (rev 8562) > @@ -2559,8 +2559,11 @@ > dataQuery = self._versionhistoryearliest > else: > thisHistoryDone = True > - elif not hasattr(self, '_versionhistory') or forceReload: > + elif not hasattr(self, '_versionhistory') or forceReload or \ > + len(self._versionhistory)< revCount: > self._versionhistory = [] > + # ?? does not load if len(self._versionhistory)> revCount > + # shouldn't it > elif getAll and len(self._versionhistory) == revCount: > # Cause a reload, or at least make the loop run > thisHistoryDone = False > @@ -3907,7 +3910,7 @@ > successful = False > for page2 in self.pages: > if page2.sectionFreeTitle() == page.sectionFreeTitle(): > - if not (hasattr(page2,'_contents') or hasattr(page2,'_getexception')) or self.force: > + if not (hasattr(page2,'_contents') or hasattr(page2, '_getexception')) or self.force: > page2.editRestriction = entry.editRestriction > page2.moveRestriction = entry.moveRestriction > if editRestriction == 'autoconfirmed': > @@ -3917,6 +3920,7 @@ > page2._ipedit = ipedit > page2._revisionId = revisionId > page2._editTime = timestamp > + page2._versionhistory = [(revisionId, str(Timestamp.fromtimestampformat(timestamp)), username, entry.comment)] > section = page2.section() > # Store the content > page2._contents = text > > > > _______________________________________________ > Pywikipedia-svn mailing list > Pywikipedia-svn(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-svn

1 0

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [8561] trunk/pywikipedia/wikipedia.py
by Dr. Trigon 15 Sep '10

15 Sep '10

Thanks a lot! Am 15.09.2010 13:32, schrieb xqt(a)svn.wikimedia.org: > Revision: 8561 > Author: xqt > Date: 2010-09-15 11:32:15 +0000 (Wed, 15 Sep 2010) > > Log Message: > ----------- > expandtemplates parameter for Page.get() - Fully resolve templates within page content submitted by DrTrogom. Thanks. > > Modified Paths: > -------------- > trunk/pywikipedia/wikipedia.py > > Modified: trunk/pywikipedia/wikipedia.py > =================================================================== > --- trunk/pywikipedia/wikipedia.py 2010-09-15 10:11:05 UTC (rev 8560) > +++ trunk/pywikipedia/wikipedia.py 2010-09-15 11:32:15 UTC (rev 8561) > @@ -585,7 +585,7 @@ > return self.autoFormat()[0] is not None > > def get(self, force=False, get_redirect=False, throttle=True, > - sysop=False, change_edit_time=True): > + sysop=False, change_edit_time=True, expandtemplates=False): > """Return the wiki-text of the page. > > This will retrieve the page from the server if it has not been > @@ -604,6 +604,8 @@ > If change_edit_time is False, do not check this version for changes > before saving. This should be used only if the page has been loaded > previously. > + If expandtemplates is True, all templates in the page content are > + fully resolved too (if API is used). > > """ > # NOTE: The following few NoPage exceptions could already be thrown at > @@ -622,7 +624,7 @@ > if self.site().isInterwikiLink(self.title()): > raise NoPage('%s is not a local page on %s!' > % (self.aslink(), self.site())) > - if force: > + if force or expandtemplates: > # When forcing, we retry the page no matter what. Old exceptions > # and contents do not apply any more. > for attr in ['_redirarg', '_getexception', '_contents']: > @@ -640,7 +642,8 @@ > # Make sure we did try to get the contents once > if not hasattr(self, '_contents'): > try: > - self._contents = self._getEditPage(get_redirect = get_redirect, throttle = throttle, sysop = sysop) > + self._contents = self._getEditPage(get_redirect=get_redirect, throttle=throttle, sysop=sysop, > + expandtemplates = expandtemplates) > hn = self.section() > if hn: > m = re.search("=+ *%s *=+" % hn, self._contents) > @@ -669,7 +672,7 @@ > return self._contents > > def _getEditPage(self, get_redirect=False, throttle=True, sysop=False, > - oldid=None, change_edit_time=True): > + oldid=None, change_edit_time=True, expandtemplates=False): > """Get the contents of the Page via API query > > Do not use this directly, use get() instead. > @@ -677,6 +680,8 @@ > Arguments: > oldid - Retrieve an old revision (by id), not the current one > get_redirect - Get the contents, even if it is a redirect page > + expandtemplates - Fully resolve templates within page content > + (if API is used) > > This method returns the raw wiki text as a unicode string. > """ > @@ -694,6 +699,8 @@ > } > if oldid: > params['rvstartid'] = oldid > + if expandtemplates: > + params[u'rvexpandtemplates'] = u'' > > if throttle: > get_throttle() > > > > _______________________________________________ > Pywikipedia-svn mailing list > Pywikipedia-svn(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/pywikipedia-svn

1 0

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [8556] trunk/pywikipedia/wikipedia.py
by Bináris 15 Sep '10

15 Sep '10

Great! Thank you very much! -- Bináris

1 0

Console Message for user.contributions() ?
by Dr. Trigon 14 Sep '10

14 Sep '10

Hello all! I wondered why is in userlib.user.contributions() no message output when accessing the wiki? This way such accesses are completely silent... Greetings

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l September 2010