Pywikipedia-l May 2008

pywikipedia-l@lists.wikimedia.org

32 participants
376 discussions

SVN: [5330] trunk/pywikipedia/wikipedia.py
by wikipedian＠svn.wikimedia.org 08 May '08

08 May '08

Revision: 5330 Author: wikipedian Date: 2008-05-08 00:07:39 +0000 (Thu, 08 May 2008) Log Message: ----------- IMPORTANT update: read and send the revisionId, which is required for the Flagged Revisions extension that is now activated on the German Wikipedia. If you run a bot that edits pages on de: (e. g. an interwiki bot), this update is mandatory. Please update immediately, otherwise your bot might be in danger of getting blocked. Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-05-07 23:56:38 UTC (rev 5329) +++ trunk/pywikipedia/wikipedia.py 2008-05-08 00:07:39 UTC (rev 5330) @@ -442,6 +442,8 @@ self._userName = None self._ipedit = None self._editTime = None + # For the Flagged Revisions MediaWiki extension + self._revisionId = None self._deletedRevs = None except NoSuchSite: raise @@ -746,6 +748,9 @@ self.moveRestriction = m.group(1); else: self.moveRestriction = '' + m = re.search('name=["\']baseRevId["\'] type=["\']hidden["\'] value="(\d+)"', text) + if m: + self._revisionId = m.group(1) if change_edit_time: # Get timestamps m = re.search('value="(\d+)" name=["\']wpEdittime["\']', text) @@ -1280,6 +1285,8 @@ else: predata['wpEdittime'] = self._editTime predata['wpStarttime'] = self._startTime + if self._revisionId: + predata['baseRevId'] = self._revisionId # Pass the minorEdit and watchArticle arguments to the Wiki. if minorEdit: predata['wpMinoredit'] = '1' @@ -2653,6 +2660,8 @@ text = entry.text editRestriction = entry.editRestriction moveRestriction = entry.moveRestriction + revisionId = entry.revisionid + page = Page(self.site, title) successful = False for page2 in self.pages: @@ -2665,6 +2674,7 @@ page2._permalink = entry.revisionid page2._userName = username page2._ipedit = ipedit + page2._revisionId = revisionId page2._editTime = timestamp section = page2.section() m = self.site.redirectRegex().match(text)

1 0

SVN: [5329] trunk/pywikipedia/noreferences.py
by wikipedian＠svn.wikimedia.org 08 May '08

08 May '08

Revision: 5329 Author: wikipedian Date: 2008-05-07 23:56:38 +0000 (Wed, 07 May 2008) Log Message: ----------- preloading 500 pages at once is a REALLY bad idea. Modified Paths: -------------- trunk/pywikipedia/noreferences.py Modified: trunk/pywikipedia/noreferences.py =================================================================== --- trunk/pywikipedia/noreferences.py 2008-05-07 23:23:11 UTC (rev 5328) +++ trunk/pywikipedia/noreferences.py 2008-05-07 23:56:38 UTC (rev 5329) @@ -432,7 +432,7 @@ else: if namespaces != []: gen = pagegenerators.NamespaceFilterPageGenerator(gen, namespaces) - preloadingGen = pagegenerators.PreloadingGenerator(gen,pageNumber=500) + preloadingGen = pagegenerators.PreloadingGenerator(gen) bot = NoReferencesBot(preloadingGen, always, ignoreMsg) bot.run()

1 0

SVN: [5328] branches/rewrite/pywikibot/site.py
by nicdumz＠svn.wikimedia.org 08 May '08

08 May '08

Revision: 5328 Author: nicdumz Date: 2008-05-07 23:23:11 +0000 (Wed, 07 May 2008) Log Message: ----------- Adding Site.getcurrenttimestamp() , useful for Special:Log which is now relying on timestamps Modified Paths: -------------- branches/rewrite/pywikibot/site.py Modified: branches/rewrite/pywikibot/site.py =================================================================== --- branches/rewrite/pywikibot/site.py 2008-05-07 22:58:16 UTC (rev 5327) +++ branches/rewrite/pywikibot/site.py 2008-05-07 23:23:11 UTC (rev 5328) @@ -20,6 +20,7 @@ import os import sys import threading +import re class PageInUse(pywikibot.Error): @@ -428,6 +429,16 @@ self._userinfo = uidata['query']['userinfo'] return self._userinfo + def getcurrenttimestamp(self): + """Returns a (Mediawiki) timestamp, {{CURRENTTIMESTAMP}}, + the server time. + Format is yyyymmddhhmmss""" + r = api.Request(site=self, + action="parse", + text="{{CURRENTTIMESTAMP}}") + result = r.submit() + return re.search('\d+', result['parse']['text']['*']).group() + def getsiteinfo(self): """Retrieve siteinfo from site and store in _siteinfo attribute.""" if not hasattr(self, "_siteinfo"):

1 0

SVN: [5327] trunk/pywikipedia/welcome.py
by nicdumz＠svn.wikimedia.org 08 May '08

08 May '08

Revision: 5327 Author: nicdumz Date: 2008-05-07 22:58:16 +0000 (Wed, 07 May 2008) Log Message: ----------- Using "time" as a variable name had unwanted consequences : calls to time module methods were screwed up. Fixing that. Modified Paths: -------------- trunk/pywikipedia/welcome.py Modified: trunk/pywikipedia/welcome.py =================================================================== --- trunk/pywikipedia/welcome.py 2008-05-07 22:32:35 UTC (rev 5326) +++ trunk/pywikipedia/welcome.py 2008-05-07 22:58:16 UTC (rev 5327) @@ -778,8 +778,8 @@ # think about non-wikimedia wikis. Use Site functions. URL = wsite.log_address(limit, 'newusers') if timeoffset_variable != 0: - time = wsite.server_time() - timedelta(minutes=timeoffset_variable) - offset_variable = int(time.strftime("%Y%m%d%H%M%S")) + now = wsite.server_time() - timedelta(minutes=timeoffset_variable) + offset_variable = int(now.strftime("%Y%m%d%H%M%S")) if offset_variable != 0: URL += "&offset=%d" % offset_variable log = wsite.getUrl(URL)

1 0

SVN: [5326] trunk/pywikipedia
by nicdumz＠svn.wikimedia.org 08 May '08

08 May '08

Revision: 5326 Author: nicdumz Date: 2008-05-07 22:32:35 +0000 (Wed, 07 May 2008) Log Message: ----------- Let's use Site.path() and Site.apipath() instead of all these hardcoded paths :) Modified Paths: -------------- trunk/pywikipedia/checkimages.py trunk/pywikipedia/pageimport.py trunk/pywikipedia/rcsort.py trunk/pywikipedia/redirect.py trunk/pywikipedia/welcome.py Modified: trunk/pywikipedia/checkimages.py =================================================================== --- trunk/pywikipedia/checkimages.py 2008-05-07 21:51:23 UTC (rev 5325) +++ trunk/pywikipedia/checkimages.py 2008-05-07 22:32:35 UTC (rev 5326) @@ -588,7 +588,7 @@ duplicateRegex = r'\n\*(?:\[\[:Image:%s\]\] has the following duplicates:|\*\[\[:Image:%s\]\])$' % (self.convert_to_url(self.image), self.convert_to_url(self.image)) imagePage = wikipedia.ImagePage(self.site, 'Image:%s' % self.image) wikipedia.output(u'Checking if %s has duplicates...' % image) - get_hash = self.site.getUrl('/w/api.php?action=query&format=xml&titles=Image:%s&prop=imageinfo&iiprop=sha1' % self.convert_to_url(self.image)) + get_hash = self.site.getUrl(self.site.apipath() + '?action=query&format=xml&titles=Image:%s&prop=imageinfo&iiprop=sha1' % self.convert_to_url(self.image)) hash_found_list = re.findall(r'<ii sha1="(.*?)" />', get_hash) if hash_found_list != []: hash_found = hash_found_list[0] @@ -598,7 +598,7 @@ else: wikipedia.output(u'Image deleted before getting the Hash. Skipping...') return False # Error, we need to skip the page. - get_duplicates = self.site.getUrl('/w/api.php?action=query&format=xml&list=allimages&aisha1=%s' % hash_found) + get_duplicates = self.site.getUrl(self.site.apipath() + '?action=query&format=xml&list=allimages&aisha1=%s' % hash_found) duplicates = re.findall(r'<img name="(.*?)".*?/>', get_duplicates) if len(duplicates) > 1: if len(duplicates) == 2: Modified: trunk/pywikipedia/pageimport.py =================================================================== --- trunk/pywikipedia/pageimport.py 2008-05-07 21:51:23 UTC (rev 5325) +++ trunk/pywikipedia/pageimport.py 2008-05-07 22:32:35 UTC (rev 5326) @@ -67,7 +67,7 @@ answer = wikipedia.inputChoice(u'Do you want to import %s?' % target, ['Yes', 'No'], ['y', 'N'], 'N') if answer in ['y', 'Y']: host = self.site().hostname() - address = '/w/index.php?title=%s&action=submit' % self.urlname() + address = self.site().path() + '?title=%s&action=submit' % self.urlname() # You need to be a sysop for the import. self.site().forceLogin(sysop = True) # Getting the token. Modified: trunk/pywikipedia/rcsort.py =================================================================== --- trunk/pywikipedia/rcsort.py 2008-05-07 21:51:23 UTC (rev 5325) +++ trunk/pywikipedia/rcsort.py 2008-05-07 22:32:35 UTC (rev 5326) @@ -41,7 +41,7 @@ if not 'limit' in form: post += '&limit=1000' -text = mysite.getUrl('/w/index.php?%s'%post) +text = mysite.getUrl(mysite.path() + '?%s'%post) text = text.split('\n') rcoptions = False @@ -62,10 +62,10 @@ count += 1 lines.append((user,count,line)) elif line.find('rcoptions') > -1: - print line.replace("/w/index.php?title=Speciaal:RecenteWijzigingen&","rcsort.py?") + print line.replace(mysite.path() + "?title=Speciaal:RecenteWijzigingen&","rcsort.py?") rcoptions = True elif newbies and line.find('Nieuwste') > -1: - line = line.replace("/w/index.php?title=Speciaal:Bijdragen&","rcsort.py?").replace("target=newbies","newbies=true") + line = line.replace(mysite.path() + "?title=Speciaal:Bijdragen&","rcsort.py?").replace("target=newbies","newbies=true") if line.find('</fieldset>') > -1: line = line[line.find('</fieldset>')+11:] print line Modified: trunk/pywikipedia/redirect.py =================================================================== --- trunk/pywikipedia/redirect.py 2008-05-07 21:51:23 UTC (rev 5325) +++ trunk/pywikipedia/redirect.py 2008-05-07 22:32:35 UTC (rev 5326) @@ -250,12 +250,16 @@ wikipedia.output(u'\nChecking redirect %i of %i...' % (num + 1, len(redict))) + # /wiki/ + wiki = re.escape(wikipedia.getSite().nice_get_address('')) + # /w/index.php + index = re.escape(wikipedia.getSite().path()) move_regex = re.compile( - r'<li>.*?<a href="/wiki/User:.*?>.*?</a> ' - r'$<a href="/wiki/User_talk:.*?>Talk</a> \| ' - r'<a href="/wiki/Special:Contributions/.*?>contribs</a>$ ' - r'moved <a href="/w/index\.php\?title=.*?>(.*?)</a> to ' - r'<a href="/wiki/.*?>.*?</a>.*?</li>' ) + r'<li>.*?<a href="' + wiki + r'User:.*?>.*?</a> ' + r'$<a href="' + wiki + r'User_talk:.*?>Talk</a> \| ' + r'<a href="' + wiki + r'Special:Contributions/.*?>contribs</a>$ ' + r'moved <a href="' + index + r'?title=.*?>(.*?)</a> to ' + r'<a href="' + index + r'.*?>.*?</a>.*?</li>' ) def get_moved_pages_redirects(self): '''generate redirects to recently-moved pages''' @@ -263,7 +267,7 @@ site = wikipedia.getSite() while offset <= 10000: # MW won't accept offset value > 10000 move_url = \ - "/w/index.php?title=Special:Log&limit=500&offset=%i&type=move"\ + site.path() + "?title=Special:Log&limit=500&offset=%i&type=move"\ % offset try: move_list = site.getUrl(move_url) Modified: trunk/pywikipedia/welcome.py =================================================================== --- trunk/pywikipedia/welcome.py 2008-05-07 21:51:23 UTC (rev 5325) +++ trunk/pywikipedia/welcome.py 2008-05-07 22:32:35 UTC (rev 5326) @@ -398,7 +398,8 @@ # and i put them in a list (i find it more easy and secure). while 1: # FIXME: That's the regex, if there are problems, take a look here. - reg = r'\(<a href=\"/w/index\.php\?title=%s(?P<user>.*?)&(?:amp;|)action=(?:edit|editredlink|edit&redlink=1)\"' % talk + + reg = r'\(<a href=\"' + re.escape(wsite.path()) + r'\?title=%s(?P<user>.*?)&(?:amp;|)action=(?:edit|editredlink|edit&redlink=1)\"' % talk p = re.compile(reg, re.UNICODE) x = p.search(raw, pos) if x == None: @@ -461,7 +462,7 @@ pathWiki = wsite.family.nicepath(wsite.lang) #A little function to check if the user has already been blocked (to skip him). reg = r"""<li>\d\d:\d\d, \d(\d)? (.*?) \d\d\d\d <a href=\"""" + pathWiki + r"""(.*?)\" title=\"(.*?)\">(.*?)</a> \(<a href=\"""" + pathWiki + r"""(.*?)\" title=\"(.*?)\">(.*?)</a>""" - block_text = wsite.getUrl('/w/index.php?title=Special:Log/block&page=User:' + username) + block_text = wsite.getUrl(wsite.path() + '?title=Special:Log/block&page=User:' + username) numblock = re.findall(reg, block_text) # If the bot doesn't find block-line (that means the user isn't blocked), it will return False otherwise True. if len(numblock) == 0:

1 0

SVN: [5324] trunk/pywikipedia/wikipedia.py
by nicdumz＠svn.wikimedia.org 08 May '08

08 May '08

Revision: 5324 Author: nicdumz Date: 2008-05-07 21:41:35 +0000 (Wed, 07 May 2008) Log Message: ----------- Oops. "Don't make any (even minor) changes just before committing, pretending not to test them because they are <trivial>" Hm. I say from now on everyone breaking the svn build owes other devs a beer, available at Wikimania 2008. NicDumZ 1 - rest of the world 0. Who's in ? :) Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-05-07 21:13:48 UTC (rev 5323) +++ trunk/pywikipedia/wikipedia.py 2008-05-07 21:41:35 UTC (rev 5324) @@ -3979,7 +3979,7 @@ def server_time(self): """returns a datetime object representing server time""" # It is currently user-clock depending - return self.family.get_server_time() + return self.family.server_time() def messages(self, sysop = False): """Returns true if the user has new messages, and false otherwise."""

2 1

SVN: [5325] trunk/pywikipedia/welcome.py
by nicdumz＠svn.wikimedia.org 07 May '08

07 May '08

Revision: 5325 Author: nicdumz Date: 2008-05-07 21:51:23 +0000 (Wed, 07 May 2008) Log Message: ----------- Localizing welcome.py for fr: Thanks DarkoNeko for the patch :) Modified Paths: -------------- trunk/pywikipedia/welcome.py Modified: trunk/pywikipedia/welcome.py =================================================================== --- trunk/pywikipedia/welcome.py 2008-05-07 21:41:35 UTC (rev 5324) +++ trunk/pywikipedia/welcome.py 2008-05-07 21:51:23 UTC (rev 5325) @@ -200,6 +200,7 @@ 'de': None, # no welcome log on de.wiki 'en': u'Project:Welcome log', 'fa': u'Project:سیاهه خوشامد', + 'fr': u'Wikipedia:Prise de décision/Accueil automatique des nouveaux par un robot/log', 'he': None, # no welcome log on he.wiki 'id': None, # no welcome log on id.wiki 'it': u'Project:Benvenuto Bot/Log', @@ -217,6 +218,7 @@ 'de':u'Herzlich willkommen!', 'en':u'Welcome!', 'fa':u'خوش آمدید!', + 'fr':u'Bienvenue sur Wikipedia !', 'he':u'ברוך הבא!', 'id':u'Selamat datang', 'it':u'Benvenuto!', @@ -236,6 +238,7 @@ 'de':u'{{subst:Hallo}} %s', 'en':u'{{subst:welcome}} %s', 'fa':u'{{جا:خوشامد}} %s', + 'fr':u'{{subst:Discussion Projet:Aide/Bienvenue}} %s', 'he':u'{{ס:ברוך הבא}} %s', 'id':u'{{sdbot|%s}}', 'it':u'\n{{subst:Benvebot}} %s', @@ -253,6 +256,7 @@ 'de':u'Aktualisiere Logdatei', 'en':u'Updating log', 'fa':u'به روز رسانی سیاهه', + 'fr':u'Mise a jour du log', 'it':u'Aggiorno il log', 'ja':u'更新記録', 'nl':u'Logboek bijwerken', @@ -310,6 +314,7 @@ 'de':u'\n*[[Benutzer Diskussion:%s]] ' + timeselected, 'en':u'\n*{{Userlinks|%s}} ' + timeselected, 'fa':u'\n*{{کاربر|%s}}' + timeselected, + 'fr':u'\n*{{u|%s}} ' + timeselected, 'it':u"\n{{Reported|%s|", 'ja':u"\n*{{User2|%s}}" + timeselected, 'nl':u'\n*{{linkgebruiker%s}} ' + timeselected, @@ -323,6 +328,7 @@ 'ar': u'Project:سجل الترحيب/توقيعات', 'fa': u'Project:سیاهه خوشامد/امضاها', 'en': u'User:Filnik/Sign', + 'fr': u'Projet:Service de Parrainage Actif/Signatures', 'it': u'Project:Benvenuto_Bot/Firme', 'ja':u'利用者:Alexbot/Welcomebotログ/List', 'zh': u'user:Welcomebot/欢迎日志/用户',

1 0

SVN: [5323] branches/rewrite/pywikibot
by russblau＠svn.wikimedia.org 07 May '08

07 May '08

Revision: 5323 Author: russblau Date: 2008-05-07 21:13:48 +0000 (Wed, 07 May 2008) Log Message: ----------- site methods allpages, alllinks, allcategories added Modified Paths: -------------- branches/rewrite/pywikibot/data/api.py branches/rewrite/pywikibot/page.py branches/rewrite/pywikibot/site.py Modified: branches/rewrite/pywikibot/data/api.py =================================================================== --- branches/rewrite/pywikibot/data/api.py 2008-05-07 19:13:52 UTC (rev 5322) +++ branches/rewrite/pywikibot/data/api.py 2008-05-07 21:13:48 UTC (rev 5323) @@ -231,6 +231,7 @@ # double the next wait, but do not exceed 120 seconds self.retry_wait = min(120, self.retry_wait * 2) +#TODO - refactor all these generator classes into a parent/subclass hierarchy class PageGenerator(object): """Iterator for response to a request of type action=query&generator=foo.""" @@ -247,8 +248,11 @@ raise ValueError("Unrecognized generator '%s'" % generator) self.request = Request(action="query", generator=generator, **kwargs) # set limit to max, if applicable + # FIXME: need to distinguish between the "limit" per API request and an + # overall limit on the number of pages to be iterated if self.limits[generator]: - self.request['g'+self.limits[generator]] = "max" + limitkey = 'g' + self.limits[generator] + self.request.setdefault(limitkey, "max") if 'prop' in self.request: self.request['prop'] += "|info|imageinfo" else: @@ -330,6 +334,7 @@ class CategoryPageGenerator(PageGenerator): """Generator that yields Category objects instead of Pages.""" + def result(self, pagedata): p = PageGenerator.result(self, pagedata) return pywikibot.Category(p) @@ -337,6 +342,7 @@ class ImagePageGenerator(PageGenerator): """Generator that yields ImagePage objects instead of Pages.""" + def result(self, pagedata): p = PageGenerator.result(self, pagedata) image = pywikibot.ImagePage(p) @@ -350,8 +356,9 @@ Note that this generator yields one or more dict object(s) corresponding to each "page" item(s) from the API response; the calling module has to - decide what to do with the contents of the dict.""" + decide what to do with the contents of the dict. + """ def __init__(self, prop, **kwargs): """ Required and optional parameters are as for C{Request}, except that @@ -409,6 +416,76 @@ self.request.update(self.data["query-continue"][self.resultkey]) +class ListGenerator(object): + """Iterator for queries with action=query&list=... parameters""" + + def __init__(self, listaction, **kwargs): + """ + Required and optional parameters are as for C{Request}, except that + action=query is assumed and listaction is required. + + @param listaction: the "list=" type from api.php + @type listaction: str + + """ + if listaction not in self.limits: + raise ValueError("Unrecognized list type '%s'" % listaction) + self.request = Request(action="query", list=listaction, **kwargs) + # set limit to max, if applicable + # FIXME: need to distinguish between the "limit" per API request and an + # overall limit on the number of pages to be iterated + if self.limits[listaction]: + limitkey = self.limits[listaction] + self.request.setdefault(limitkey, "max") + self.resultkey = listaction + self.site = self.request.site + + # dict mapping generator types to their limit parameter names + + limits = {'allpages': 'aplimit', + 'alllinks': 'allimit', + 'allcategories': 'aclimit', + 'allusers': 'aulimit', + 'allimages': 'ailimit', + 'backlinks': 'bllimit', + 'blocks': 'bklimit', + 'categorymembers': 'cmlimit', + 'embeddedin': 'eilimit', + 'exturlusage': 'eulimit', + 'imageusage': 'iulimit', + 'logevents': 'lelimit', + 'recentchanges': 'rclimit', + 'search': 'srlimit', + 'usercontribs': 'uclimit', + 'watchlist': 'wllimit', + 'deletedrevs': 'drlimit', + 'users': None, + 'random': 'rnlimit', + } + + def __iter__(self): + """Iterate objects for elements found in response.""" + # this looks for the resultkey in the 'query' element + while True: + self.data = self.request.submit() + if not self.data or not isinstance(self.data, dict): + raise StopIteration + if not ("query" in self.data + and self.resultkey in self.data["query"]): + raise StopIteration + resultdata = self.data["query"][self.resultkey] + assert isinstance(resultdata, list) + for item in resultdata: + yield item + if not "query-continue" in self.data: + return + if not self.resultkey in self.data["query-continue"]: + raise APIError("Unknown", + "Missing '%s' key in ['query-continue'] value.", + data=self.data["query-continue"]) + self.request.update(self.data["query-continue"][self.resultkey]) + + class LoginManager(login.LoginManager): """Supplies getCookie() method to use API interface.""" def getCookie(self, remember=True, captchaId=None, captchaAnswer=None): Modified: branches/rewrite/pywikibot/page.py =================================================================== --- branches/rewrite/pywikibot/page.py 2008-05-07 19:13:52 UTC (rev 5322) +++ branches/rewrite/pywikibot/page.py 2008-05-07 21:13:48 UTC (rev 5323) @@ -284,7 +284,7 @@ raise self._getexception if force or not hasattr(self, "_revid") \ or not self._revid in self._revisions: - self.site().getrevisions(self, getText=True, sysop=sysop) + self.site().loadrevisions(self, getText=True, sysop=sysop) # TODO: Exception handling for no-page, redirects, etc. return self._revisions[self._revid].text @@ -307,7 +307,7 @@ logging.debug( "Page.getOldVersion(change_edit_time) option is deprecated.") if force or not oldid in self._revisions: - self.site().getrevisions(self, getText=True, ids=oldid, + self.site().loadrevisions(self, getText=True, ids=oldid, sysop=sysop) # TODO: what about redirects, errors? return self._revisions[oldid].text @@ -324,7 +324,7 @@ def latestRevision(self): """Return the current revision id for this page.""" if not hasattr(self, '_revid'): - self.site().getrevisions(self) + self.site().loadrevisions(self) return self._revid def userName(self): @@ -664,7 +664,7 @@ if not self.isRedirectPage(): raise pywikibot.IsNotRedirectPage if not isinstance(self._redir, Page): - self.site().pageredirtarget(self) + self.site().getredirtarget(self) return self._redir def getVersionHistory(self, forceReload=False, reverseOrder=False, @@ -682,7 +682,7 @@ limit = None else: limit = revCount - return self.site().getrevisions(self, getText=False, + return self.site().loadrevisions(self, getText=False, rvdir=not reverseOrder, limit=limit) def getVersionHistoryTable(self, forceReload=False, reverseOrder=False, @@ -706,7 +706,7 @@ @return: A generator that yields tuples consisting of revision ID, edit date/time, user name and content """ - return self.site().getrevisions(self, withText=True) + return self.site().loadrevisions(self, withText=True) def contributingUsers(self): """Return a set of usernames (or IPs) of users who edited this page.""" @@ -1100,7 +1100,7 @@ recurse = recurse - 1 if not hasattr(self, "_subcats"): self._subcats = [] - for member in self.site().pagecategorymembers(self, namespaces=[14]): + for member in self.site().categorymembers(self, namespaces=[14]): subcat = Category(self.site(), member.title()) self._subcats.append(subcat) yield subcat @@ -1127,7 +1127,7 @@ """ namespaces = [x for x in self.site().namespaces().keys() if x>=0 and x!=14] - for member in self.site().pagecategorymembers(self, + for member in self.site().categorymembers(self, namespaces=namespaces): yield member if recurse: Modified: branches/rewrite/pywikibot/site.py =================================================================== --- branches/rewrite/pywikibot/site.py 2008-05-07 19:13:52 UTC (rev 5322) +++ branches/rewrite/pywikibot/site.py 2008-05-07 21:13:48 UTC (rev 5323) @@ -494,7 +494,7 @@ return self.namespaces()[num] return self.namespaces()[num][0] - def getpageinfo(self, page): + def loadpageinfo(self, page): """Load page info from api and save in page attributes""" title = page.title(withSection=False) query = api.PropertyGenerator("info", @@ -502,21 +502,21 @@ for pageitem in query: if pageitem['title'] != title: raise Error( - u"getpageinfo: Query on %s returned data on '%s'" + u"loadpageinfo: Query on %s returned data on '%s'" % (page, pageitem['title'])) api.update_page(page, pageitem) def page_exists(self, page): """Return True if and only if page is an existing page on site.""" if not hasattr(page, "_pageid"): - self.getpageinfo(page) + self.loadpageinfo(page) return page._pageid > 0 def page_restrictions(self, page): """Returns a dictionary reflecting page protections""" if not self.page_exists(page): raise NoPage(u'No page %s.' % page) - # page_exists called getpageinfo which set protection levels + # page_exists called loadpageinfo which set protection levels return page._protection def page_can_be_edited(self, page): @@ -537,13 +537,13 @@ def page_isredirect(self, page): """Return True if and only if page is a redirect.""" if not hasattr(page, "_redir"): - self.getpageinfo(page) + self.loadpageinfo(page) return bool(page._redir) - def pageredirtarget(self, page): + def getredirtarget(self, page): """Return Page object for the redirect target of page.""" if not hasattr(page, "_redir"): - self.getpageinfo(page) + self.loadpageinfo(page) if not page._redir: raise pywikibot.IsNotRedirectPage title = page.title(withSection=False) @@ -554,13 +554,13 @@ result = query.submit() if "query" not in result or "redirects" not in result["query"]: raise RuntimeError( - "pageredirtarget: No 'redirects' found for page %s." + "getredirtarget: No 'redirects' found for page %s." % title) redirmap = dict((item['from'], item['to']) for item in result['query']['redirects']) if title not in redirmap: raise RuntimeError( - "pageredirtarget: 'redirects' contains no key for page %s." + "getredirtarget: 'redirects' contains no key for page %s." % title) if "pages" not in result['query']: # no "pages" element indicates a circular redirect @@ -569,7 +569,7 @@ # there should be only one value in 'pages', and it is the target if pagedata['title'] not in redirmap.values(): raise RuntimeError( - "pageredirtarget: target page '%s' not found in 'redirects'" + "getredirtarget: target page '%s' not found in 'redirects'" % pagedata['title']) target = pywikibot.Page(self, pagedata['title'], pagedata['ns']) api.update_page(target, pagedata) @@ -733,7 +733,7 @@ for ns in namespaces) return tlgen - def pagecategorymembers(self, category, namespaces=None): + def categorymembers(self, category, namespaces=None): """Iterate members of specified category. @param category: The Category to iterate. @@ -757,7 +757,7 @@ for ns in namespaces) return cmgen - def getrevisions(self, page=None, getText=False, revids=None, + def loadrevisions(self, page=None, getText=False, revids=None, limit=None, startid=None, endid=None, starttime=None, endtime=None, rvdir=None, user=None, excludeuser=None, section=None, sysop=False): @@ -811,25 +811,25 @@ # check for invalid argument combinations if page is None and revids is None: raise ValueError( - "getrevisions: either page or revids argument required") + "loadrevisions: either page or revids argument required") if (startid is not None or endid is not None) and \ (starttime is not None or endtime is not None): raise ValueError( - "getrevisions: startid/endid combined with starttime/endtime") + "loadrevisions: startid/endid combined with starttime/endtime") if starttime is not None and endtime is not None: if rvdir and starttime >= endtime: raise ValueError( - "getrevisions: starttime > endtime with rvdir=True") + "loadrevisions: starttime > endtime with rvdir=True") if (not rvdir) and endtime >= starttime: raise ValueError( - "getrevisions: endtime > starttime with rvdir=False") + "loadrevisions: endtime > starttime with rvdir=False") if startid is not None and endid is not None: if rvdir and startid >= endid: raise ValueError( - "getrevisions: startid > endid with rvdir=True") + "loadrevisions: startid > endid with rvdir=True") if (not rvdir) and endid >= startid: raise ValueError( - "getrevisions: endid > startid with rvdir=False") + "loadrevisions: endid > startid with rvdir=False") # assemble API request if revids is None: @@ -866,7 +866,7 @@ if page is not None: if pagedata['title'] != page.title(withSection=False): raise Error( - u"getrevisions: Query on %s returned data on '%s'" + u"loadrevisions: Query on %s returned data on '%s'" % (page, pagedata['title'])) else: page = Page(self, pagedata['title']) @@ -924,8 +924,148 @@ for linkdata in pageitem['extlinks']: yield linkdata['*'] + def allpages(self, start="!", prefix="", namespace=0, + filterredir=None, filterlanglinks=None, + minsize=None, maxsize=None, + protect_type=None, protect_level=None, + limit=None, reverse=False, includeRedirects=None, + throttle=None): + """Iterate pages in a single namespace. + Note: parameters includeRedirects and throttle are deprecated and + included only for backwards compatibility. + + @param start: Start at this title (page need not exist). + @param prefix: Only yield pages starting with this string. + @param namespace: Iterate pages from this (single) namespace + (default: 0) + @param filterredir: if True, only yield redirects; if False (and not + None), only yield non-redirects (default: yield both) + @param filterlanglinks: if True, only yield pages with language links; + if False (and not None), only yield pages without language links + (default: yield both) + @param minsize: if present, only yield pages at least this many + bytes in size + @param maxsize: if present, only yield pages at most this many bytes + in size + @param protect_type: only yield pages that have a protection of the + specified type + @type protect_type: str + @param protect_level: only yield pages that have protection at this + level; can only be used if protect_type is specified + @param limit: maximum number of pages to iterate (default: iterate + all pages in namespace) + @param reverse: if True, iterate in reverse Unicode lexigraphic + order (default: iterate in forward order) + """ + if not isinstance(namespace, int): + raise Error("allpages: only one namespace permitted.") + if throttle is not None: + logging.debug("allpages: the 'throttle' parameter is deprecated.") + if includeRedirects is not None: + logging.debug( + "allpages: the 'includeRedirect' parameter is deprecated.") + if includeRedirects: + if includeRedirects == "only": + filterredirs = True + else: + filterredirs = None + else: + filterredirs = False + + apgen = api.PageGenerator("allpages", gapnamespace=str(namespace), + gapfrom=start) + if prefix: + apgen.request["gapprefix"] = prefix + if filterredir is not None: + apgen.request["gapfilterredir"] = (filterredir + and "redirects" + or "nonredirects") + if filterlanglinks is not None: + apgen.request["gapfilterlanglinks"] = (filterlanglinks + and "withlanglinks" + or "withoutlanglinks") + if isinstance(minsize, int): + apgen.request["gapminsize"] = str(minsize) + if isinstance(maxsize, int): + apgen.request["gapmaxsize"] = str(maxsize) + if isinstance(protect_type, basestring): + apgen.request["gapprtype"] = protect_type + if isinstance(protect_level, basestring): + apgen.request["gapprlevel"] = protect_level + if isinstance(limit, int): + apgen.request["gaplimit"] = str(limit) + if reverse: + apgen.request["gapdir"] = "descending" + return apgen + + def alllinks(self, start="!", prefix="", namespace=0, unique=False, + limit=None, fromids=False): + """Iterate all links to pages (which need not exist) in one namespace. + + Note that, in practice, links that were found on pages that have + been deleted may not have been removed from the links table, so this + method can return false positives. + + @param start: Start at this title (page need not exist). + @param prefix: Only yield pages starting with this string. + @param namespace: Iterate pages from this (single) namespace + (default: 0) + @param unique: If True, only iterate each link title once (default: + iterate once for each linking page) + @param limit: maximum number of pages to iterate (default: iterate + all pages in namespace) + @param fromids: if True, include the pageid of the page containing + each link (default: False) as the 'fromid' attribute of the Page; + cannot be combined with unique + + """ + if unique and fromids: + raise Error("alllinks: unique and fromids cannot both be True.") + if not isinstance(namespace, int): + raise Error("alllinks: only one namespace permitted.") + algen = api.ListGenerator("alllinks", alnamespace=str(namespace), + alfrom=start) + if prefix: + algen.request["alprefix"] = prefix + if isinstance(limit, int): + algen.request["allimit"] = str(limit) + if unique: + algen.request["alunique"] = "" + if fromids: + algen.request["alprop"] = "title|ids" + for link in algen: + p = pywikibot.Page(self, link['title'], link['ns']) + if fromids: + p.fromid = link['fromid'] + yield p + + + def allcategories(self, start="!", prefix="", limit=None, + reverse=False): + """Iterate categories used (which need not have a Category page). + + Iterator yields Category objects. + + @param start: Start at this category title (category need not exist). + @param prefix: Only yield categories starting with this string. + @param limit: maximum number of categories to iterate (default: + iterate all) + @param reverse: if True, iterate in reverse Unicode lexigraphic + order (default: iterate in forward order) + + """ + acgen = api.CategoryGenerator("allcategories", gapfrom=start) + if prefix: + acgen.request["gacprefix"] = prefix + if isinstance(limit, int): + acgen.request["gaclimit"] = str(limit) + if reverse: + acgen.request["gacdir"] = "descending" + return acgen + + #### METHODS NOT IMPLEMENTED YET (but may be delegated to Family object) #### class NotImplementedYet: @@ -1806,92 +1946,6 @@ if not repeat: break - def allpages(self, start='!', namespace=0, includeredirects=True, - throttle=True): - """Yield all Pages from Special:Allpages. - - Parameters: - start Start at this page. By default, it starts at '!', and yields - all pages. - namespace Yield all pages in this namespace; defaults to 0. - MediaWiki software will only return pages in one namespace - at a time. - - If includeredirects is False, redirects will not be found. - If includeredirects equals the string 'only', only redirects - will be found. Note that this has not been tested on older - versions of the MediaWiki code. - - It is advised not to use this directly, but to use the - AllpagesPageGenerator from pagegenerators.py instead. - - """ - while True: - # encode Non-ASCII characters in hexadecimal format (e.g. %F6) - start = start.encode(self.encoding()) - start = urllib.quote(start) - # load a list which contains a series of article names (always 480) - path = self.allpages_address(start, namespace) - output(u'Retrieving Allpages special page for %s from %s, namespace %i' % (repr(self), start, namespace)) - returned_html = self.getUrl(path) - # Try to find begin and end markers - try: - # In 1.4, another table was added above the navigational links - if self.versionnumber() >= 4: - begin_s = '</table><hr /><table' - end_s = '</table' - else: - begin_s = '<table' - end_s = '</table' - ibegin = returned_html.index(begin_s) - iend = returned_html.index(end_s,ibegin + 3) - except ValueError: - raise ServerError( -"Couldn't extract allpages special page. Make sure you're using MonoBook skin.") - # remove the irrelevant sections - returned_html = returned_html[ibegin:iend] - if self.versionnumber()==2: - R = re.compile('/wiki/(.*?)\" *class=[\'\"]printable') - elif self.versionnumber()<5: - # Apparently the special code for redirects was added in 1.5 - R = re.compile('title ?=\"(.*?)\"') - elif not includeredirects: - R = re.compile('\<td(?: width="33%")?\>\<a href=\"\S*\" +title ?="(.*?)"') - elif includeredirects == 'only': - R = re.compile('\<td(?: width="33%")?>\<[^\<\>]*allpagesredirect\"\>\<a href=\"\S*\" +title ?="(.*?)"') - else: - R = re.compile('title ?=\"(.*?)\"') - # Count the number of useful links on this page - n = 0 - for hit in R.findall(returned_html): - # count how many articles we found on the current page - n = n + 1 - if self.versionnumber()==2: - yield Page(self, url2link(hit, site = self, insite = self)) - else: - yield Page(self, hit) - # save the last hit, so that we know where to continue when we - # finished all articles on the current page. Append a '!' so that - # we don't yield a page twice. - start = Page(self,hit).titleWithoutNamespace() + '!' - # A small shortcut: if there are less than 100 pages listed on this - # page, there is certainly no next. Probably 480 would do as well, - # but better be safe than sorry. - if n < 100: - if (not includeredirects) or includeredirects == 'only': - # Maybe there were only so few because the rest is or is not a redirect - R = re.compile('title ?=\"(.*?)\"') - allLinks = R.findall(returned_html) - if len(allLinks) < 100: - break - elif n == 0: - # In this special case, no pages of the requested type - # were found, and "start" will remain and be double-encoded. - # Use the last page as the start of the next page. - start = Page(self, allLinks[-1]).titleWithoutNamespace() + '!' - else: - break - def prefixindex(self, prefix, namespace=0, includeredirects=True): """Yield all pages with a given prefix.

1 0

SVN: [5322] trunk/pywikipedia
by borgo＠svn.wikimedia.org 07 May '08

07 May '08

Revision: 5322 Author: borgo Date: 2008-05-07 19:13:52 +0000 (Wed, 07 May 2008) Log Message: ----------- Added namespace translation for map-bms, kl, oc. Modified Paths: -------------- trunk/pywikipedia/families/wikipedia_family.py trunk/pywikipedia/family.py Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2008-05-07 14:45:04 UTC (rev 5321) +++ trunk/pywikipedia/families/wikipedia_family.py 2008-05-07 19:13:52 UTC (rev 5322) @@ -201,6 +201,7 @@ 'ka': u'ვიკიპედია განხილვა', 'kab': u'Amyannan n Wikipedia', 'kk': u'Уикипедия талқылауы', + 'kl': u'Wikipedia-diskussion', 'km': u'ការពិភាក្សាអំពីWikipedia', 'kn': u'ವಿಕಿಪೀಡಿಯ ಚರ್ಚೆ', 'ko': u'위키백과토론', @@ -218,6 +219,7 @@ 'lo': u'ສົນທະນາກ່ຽວກັບວິກິພີເດຍ', 'lt': u'Wikipedia aptarimas', 'lv': u'Vikipēdijas diskusija', + 'map-bms': u'Dhiskusi Wikipedia', 'mg': u'Discussion Wikipedia', 'mk': u'Разговор за Википедија', 'ml': u'വിക്കിപീഡിയ സംവാദം', Modified: trunk/pywikipedia/family.py =================================================================== --- trunk/pywikipedia/family.py 2008-05-07 14:45:04 UTC (rev 5321) +++ trunk/pywikipedia/family.py 2008-05-07 19:13:52 UTC (rev 5322) @@ -101,6 +101,7 @@ 'new': u'माध्यम', 'nn': u'Filpeikar', 'no': u'Medium', + 'oc': u'Mèdia', 'pa': u'ਮੀਡੀਆ', 'ps': u'رسنۍ', 'qu': u'Midya', @@ -191,6 +192,7 @@ 'ka': u'სპეციალური', 'kab': u'Uslig', 'kk': u'Арнайы', + 'kl': u'Speciel', 'km': u'ពិសេស', 'kn': u'ವಿಶೇಷ', 'ko': u'특수기능', @@ -206,6 +208,7 @@ 'lmo': u'Speciale', 'lo': u'ພິເສດ', 'lt': u'Specialus', + 'map-bms': u'Astamiwa', 'mk': u'Специјални', 'ml': u'പ്രത്യേകം', 'mr': u'विशेष', @@ -333,6 +336,7 @@ 'ka': u'განხილვა', 'kab': u'Mmeslay', 'kk': u'Талқылау', + 'kl': u'Diskussion', 'km': u'ពិភាក្សា', 'kn': u'ಚರ್ಚೆಪುಟ', 'ko': u'토론', @@ -350,6 +354,7 @@ 'lo': u'ສົນທະນາ', 'lt': u'Aptarimas', 'lv': u'Diskusija', + 'map-bms': u'Dhiskusi', 'mg': u'Discuter', 'mk': u'Разговор', 'ml': u'സംവാദം', @@ -481,6 +486,7 @@ 'ka': u'მომხმარებელი', 'kab': u'Amseqdac', 'kk': u'Қатысушы', + 'kl': u'Bruger', 'km': u'អ្នកប្រើប្រាស់', 'kn': u'ಸದಸ್ಯ', 'ko': u'사용자', @@ -498,6 +504,7 @@ 'lo': u'ຜູ້ໃຊ້', 'lt': u'Naudotojas', 'lv': u'Lietotājs', + 'map-bms': u'Panganggo', 'mg': u'Utilisateur', 'mk': u'Корисник', 'ml': u'ഉപയോക്താവ്', @@ -630,6 +637,7 @@ 'ka': u'მომხმარებელი განხილვა', 'kab': u'Amyannan umsqedac', 'kk': u'Қатысушы талқылауы', + 'kl': u'Brugerdiskussion', 'km': u'អ្នកប្រើប្រាស់-ពិភាក្សា', 'kn': u'ಸದಸ್ಯರ ಚರ್ಚೆಪುಟ', 'ko': u'사용자토론', @@ -647,6 +655,7 @@ 'lo': u'ສົນທະນາຂອງຜູ້ໃຊ້', 'lt': u'Naudotojo aptarimas', 'lv': u'Lietotāja diskusija', + 'map-bms': u'Dhiskusi Panganggo', 'mg': u'Discussion Utilisateur', 'mk': u'Разговор со корисник', 'ml': u'ഉപയോക്താവിന്റെ സംവാദം', @@ -783,6 +792,7 @@ 'ka': u'სურათი', 'kab': u'Tugna', 'kk': u'Сурет', + 'kl': u'Billede', 'km': u'រូបភាព', 'kn': u'ಚಿತ್ರ', 'ko': u'그림', @@ -799,6 +809,7 @@ 'lo': u'ຮູບ', 'lt': u'Vaizdas', 'lv': u'Attēls', + 'map-bms': u'Gambar', 'mk': u'Слика', 'ml': u'ചിത്രം', 'mr': u'चित्र', @@ -928,6 +939,7 @@ 'ka': u'სურათი განხილვა', 'kab': u'Amyannan n tugna', 'kk': u'Сурет талқылауы', + 'kl': u'Billeddiskussion', 'km': u'រូបភាព-ពិភាក្សា', 'kn': u'ಚಿತ್ರ ಚರ್ಚೆಪುಟ', 'ko': u'그림토론', @@ -945,6 +957,7 @@ 'lo': u'ສົນທະນາກ່ຽວກັບຮູບ', 'lt': u'Vaizdo aptarimas', 'lv': u'Attēla diskusija', + 'map-bms': u'Dhiskusi Gambar', 'mg': u'Discussion Image', 'mk': u'Разговор за слика', 'ml': u'ചിത്രത്തിന്റെ സംവാദം', @@ -1117,6 +1130,7 @@ 'ka': u'მედიავიკი განხილვა', 'kab': u'Amyannan n MediaWiki', 'kk': u'МедиаУики талқылауы', + 'kl': u'MediaWiki-diskussion', 'km': u'មីឌាវិគី-ពិភាក្សា', 'kn': u'ಮೀಡೀಯವಿಕಿ ಚರ್ಚೆ', 'ko': u'MediaWiki토론', @@ -1134,6 +1148,7 @@ 'lo': u'ສົນທະນາກ່ຽວກັບມີເດຍວິກິ', 'lt': u'MediaWiki aptarimas', 'lv': u'MediaWiki diskusija', + 'map-bms': u'Dhiskusi MediaWiki', 'mg': u'Discussion MediaWiki', 'mk': u'Разговор за МедијаВики', 'ml': u'മീഡിയവിക്കി സംവാദം', @@ -1261,6 +1276,7 @@ 'ka': u'თარგი', 'kab': u'Talɣa', 'kk': u'Үлгі', + 'kl': u'Skabelon', 'km': u'ទំព័រគំរូ', 'kn': u'ಟೆಂಪ್ಲೇಟು', 'ko': u'틀', @@ -1276,6 +1292,7 @@ 'lo': u'ແມ່ແບບ', 'lt': u'Šablonas', 'lv': u'Veidne', + 'map-bms': u'Cithakan', 'mg': u'Modèle', 'mk': u'Шаблон', 'ml': u'ഫലകം', @@ -1399,6 +1416,7 @@ 'ka': u'თარგი განხილვა', 'kab': u'Amyannan n talɣa', 'kk': u'Үлгі талқылауы', + 'kl': u'Skabelondiskussion', 'km': u'ទំព័រគំរូ-ពិភាក្សា', 'kn': u'ಟೆಂಪ್ಲೇಟು ಚರ್ಚೆ', 'ko': u'틀토론', @@ -1416,6 +1434,7 @@ 'lo': u'ສົນທະນາກ່ຽວກັບແມ່ແບບ', 'lt': u'Šablono aptarimas', 'lv': u'Veidnes diskusija', + 'map-bms': u'Dhiskusi Cithakan', 'mg': u'Discussion Modèle', 'mk': u'Разговор за шаблон', 'ml': u'ഫലകത്തിന്റെ സംവാദം', @@ -1542,6 +1561,7 @@ 'ka': u'დახმარება', 'kab': u'Tallat', 'kk': u'Анықтама', + 'kl': u'Hjælp', 'km': u'ជំនួយ', 'kn': u'ಸಹಾಯ', 'ko': u'도움말', @@ -1558,6 +1578,7 @@ 'lo': u'ຊ່ວຍເຫຼືອ', 'lt': u'Pagalba', 'lv': u'Palīdzība', + 'map-bms': u'Pitulung', 'mg': u'Aide', 'mk': u'Помош', 'ml': u'സഹായം', @@ -1687,6 +1708,7 @@ 'ka': u'დახმარება განხილვა', 'kab': u'Amyannan n tallat', 'kk': u'Анықтама талқылауы', + 'kl': u'Hjælp-diskussion', 'km': u'ជំនួយ-ពិភាក្សា', 'kn': u'ಸಹಾಯ ಚರ್ಚೆ', 'ko': u'도움말토론', @@ -1704,6 +1726,7 @@ 'lo': u'ສົນທະນາກ່ຽວກັບຊ່ວຍເຫຼືອ', 'lt': u'Pagalbos aptarimas', 'lv': u'Palīdzības diskusija', + 'map-bms': u'Dhiskusi Pitulung', 'mg': u'Discussion Aide', 'mk': u'Разговор за помош', 'ml': u'സഹായത്തിന്റെ സംവാദം', @@ -1833,6 +1856,7 @@ 'ka': u'კატეგორია', 'kab': u'Taggayt', 'kk': u'Санат', + 'kl': u'Kategori', 'km': u'ចំណាត់ក្រុម', 'kn': u'ವರ್ಗ', 'ko': u'분류', @@ -1850,6 +1874,7 @@ 'lo': u'ໝວດ', 'lt': u'Kategorija', 'lv': u'Kategorija', + 'map-bms': u'Kategori', 'mg': u'Catégorie', 'mk': u'Категорија', 'ml': u'വിഭാഗം', @@ -1979,6 +2004,7 @@ 'ka': u'კატეგორია განხილვა', 'kab': u'Amyannan n taggayt', 'kk': u'Санат талқылауы', + 'kl': u'Kategoridiskussion', 'km': u'ចំណាត់ក្រុម-ពិភាក្សា', 'kn': u'ವರ್ಗ ಚರ್ಚೆ', 'ko': u'분류토론', @@ -1996,6 +2022,7 @@ 'lo': u'ສົນທະນາກ່ຽວກັບໝວດ', 'lt': u'Kategorijos aptarimas', 'lv': u'Kategorijas diskusija', + 'map-bms': u'Dhiskusi Kategori', 'mg': u'Discussion Catégorie', 'mk': u'Разговор за категорија', 'ml': u'വിഭാഗത്തിന്റെ സംവാദം',

1 0

[ pywikipediabot-Bugs-1959384 ] welcome.py seems to ignore offset
by SourceForge.net 07 May '08

07 May '08

Bugs item #1959384, was opened at 2008-05-07 11:56 Message generated for change (Comment added) made by nicdumz You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1959384&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: DarkoNeko (darkoneko) Assigned to: Nobody/Anonymous (nobody) Summary: welcome.py seems to ignore offset Initial Comment: Version used: 5318 (latest available, since I did an update just before re-testing the bug) Command used : /usr/bin/python ~/pywikipedia/welcome.py -nlog -limit:300 -offset:40 -random -time:300 Problem : the script ignores offset and welcomes users since the first one (verified using http://fr.wikipedia.org/wiki/Special:log/newusers ) I thought the problem was "it ignores the 40 first lines, regardless of what action it is" but it's not the case : the welcomed user (Yusukay) was 6th in user creation list, and 27th in the overall log. ---------------------------------------------------------------------- Comment By: NicDumZ — Nicolas Dumazet (nicdumz) Date: 2008-05-07 16:48 Message: Logged In: YES user_id=1963242 Originator: NO Actually Mediawiki Special:Log has changed lately. It's not using anymore a number offset, but a timestamp offset instead. I fixed this on r5320, now you have to use a yyyymmddhhmmss timestamp as an -offset argument : it will only welcome users OLDER than that time. (Actually this time is server-dependant, it's GMT time for wikimedia projects). After thinking more about this issue, I also added a timeoffset:# parameter : it will only welcome users older than # minutes. (These argument names are confusing, offset, timeoffset, and time, but I could not really find better names. If a developer has better names, just go ahead, and *please add a deprecated warning for the old names* ) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1959384&group_…

1 0

← Newer
1
...
30
31
32
33
34
35
36
37
38
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l May 2008