Pywikipedia-svn November 2009

pywikipedia-svn@lists.wikimedia.org

9 participants
146 discussions

SVN: [7702] trunk/pywikipedia/commonscat.py
by multichill＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7702 Author: multichill Date: 2009-11-26 14:09:14 +0000 (Thu, 26 Nov 2009) Log Message: ----------- Where did that , go? Modified Paths: -------------- trunk/pywikipedia/commonscat.py Modified: trunk/pywikipedia/commonscat.py =================================================================== --- trunk/pywikipedia/commonscat.py 2009-11-26 14:04:51 UTC (rev 7701) +++ trunk/pywikipedia/commonscat.py 2009-11-26 14:09:14 UTC (rev 7702) @@ -161,7 +161,7 @@ 'ar' : [u'تحويلة تصنيف', u'كومنز', u'كومونز', u'Commons'], 'cs' : [u'Commons', u'Sestřičky', u'Sisterlinks'], 'da' : [u'Commons', u'Commons left', u'Commons2', u'Commonsbilleder', u'Commonscat left', u'Commonscat2', u'GalleriCommons', u'Søsterlinks'], - 'de' : [u'Commons'] + 'de' : [u'Commons'], 'en' : [u'Category redirect', u'Commons', u'Commonscat1A', u'Commoncats', u'Commonscat4Ra', u'Sisterlinks', u'Sisterlinkswp', u'Tracking category', u'Template category', u'Wikipedia category'], 'eo' : [u'Commons', (u'Projekto/box', 'commons='), (u'Projekto', 'commons='), (u'Projektoj', 'commons='), (u'Projektoj', 'commonscat=')], 'es' : [u'Commons', u'IprCommonscat'],

1 0

SVN: [7701] trunk/pywikipedia/commonscat.py
by multichill＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7701 Author: multichill Date: 2009-11-26 14:04:51 +0000 (Thu, 26 Nov 2009) Log Message: ----------- Exception for dewp Modified Paths: -------------- trunk/pywikipedia/commonscat.py Modified: trunk/pywikipedia/commonscat.py =================================================================== --- trunk/pywikipedia/commonscat.py 2009-11-26 13:43:56 UTC (rev 7700) +++ trunk/pywikipedia/commonscat.py 2009-11-26 14:04:51 UTC (rev 7701) @@ -161,6 +161,7 @@ 'ar' : [u'تحويلة تصنيف', u'كومنز', u'كومونز', u'Commons'], 'cs' : [u'Commons', u'Sestřičky', u'Sisterlinks'], 'da' : [u'Commons', u'Commons left', u'Commons2', u'Commonsbilleder', u'Commonscat left', u'Commonscat2', u'GalleriCommons', u'Søsterlinks'], + 'de' : [u'Commons'] 'en' : [u'Category redirect', u'Commons', u'Commonscat1A', u'Commoncats', u'Commonscat4Ra', u'Sisterlinks', u'Sisterlinkswp', u'Tracking category', u'Template category', u'Wikipedia category'], 'eo' : [u'Commons', (u'Projekto/box', 'commons='), (u'Projekto', 'commons='), (u'Projektoj', 'commons='), (u'Projektoj', 'commonscat=')], 'es' : [u'Commons', u'IprCommonscat'],

1 0

SVN: [7700] trunk/pywikipedia/wikipedia.py
by alexsh＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7700 Author: alexsh Date: 2009-11-26 13:43:56 +0000 (Thu, 26 Nov 2009) Log Message: ----------- Fix: Page().linkedPages() object duplicate. Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2009-11-26 09:37:32 UTC (rev 7699) +++ trunk/pywikipedia/wikipedia.py 2009-11-26 13:43:56 UTC (rev 7700) @@ -2213,7 +2213,7 @@ continue if not withImageLinks and page.isImage(): continue - if page.sectionFreeTitle(): + if page.sectionFreeTitle() and page not in result: result.append(page) return result

1 0

SVN: [7699] trunk/pywikipedia/login.py
by alexsh＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7699 Author: alexsh Date: 2009-11-26 09:37:32 +0000 (Thu, 26 Nov 2009) Log Message: ----------- identify login between API and ordinary Modified Paths: -------------- trunk/pywikipedia/login.py Modified: trunk/pywikipedia/login.py =================================================================== --- trunk/pywikipedia/login.py 2009-11-26 09:36:47 UTC (rev 7698) +++ trunk/pywikipedia/login.py 2009-11-26 09:37:32 UTC (rev 7699) @@ -273,7 +273,11 @@ self.password = self.password.encode(self.site.encoding()) - wikipedia.output(u"Logging in to %s as %s" % (self.site, self.username)) + if api: + wikipedia.output(u"Logging in to %s as %s via API." % (self.site, self.username)) + else: + wikipedia.output(u"Logging in to %s as %s" % (self.site, self.username)) + try: cookiedata = self.getCookie(api) except NotImplementedError:

1 0

SVN: [7698] trunk/pywikipedia/template.py
by alexsh＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7698 Author: alexsh Date: 2009-11-26 09:36:47 +0000 (Thu, 26 Nov 2009) Log Message: ----------- change get Page() by namespace, and use Page().titleWithoutNamespace() to fix input quoted template name. Modified Paths: -------------- trunk/pywikipedia/template.py Modified: trunk/pywikipedia/template.py =================================================================== --- trunk/pywikipedia/template.py 2009-11-26 09:33:45 UTC (rev 7697) +++ trunk/pywikipedia/template.py 2009-11-26 09:36:47 UTC (rev 7698) @@ -387,7 +387,7 @@ acceptAll = True else: if not genFactory.handleArg(arg): - templateNames.append(arg) + templateNames.append(pywikibot.Page(pywikibot.getSite(), arg, defaultNamespace=10).titleWithoutNamespace()) if subst or remove: for templateName in templateNames: @@ -403,7 +403,7 @@ oldTemplates = [] ns = pywikibot.getSite().template_namespace() for templateName in templates.keys(): - oldTemplate = pywikibot.Page(pywikibot.getSite(), ns + ':' + templateName) + oldTemplate = pywikibot.Page(pywikibot.getSite(), templateName, defaultNamespace=10) oldTemplates.append(oldTemplate) if xmlfilename:

1 0

SVN: [7697] trunk/pywikipedia/wikipedia.py
by alexsh＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7697 Author: alexsh Date: 2009-11-26 09:33:45 +0000 (Thu, 26 Nov 2009) Log Message: ----------- separate getall for huge-retrieve (only work in getAll pageCount > config.special_page_limit Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2009-11-26 09:29:40 UTC (rev 7696) +++ trunk/pywikipedia/wikipedia.py 2009-11-26 09:33:45 UTC (rev 7697) @@ -3848,7 +3848,25 @@ # TODO: why isn't this a Site method? pages = list(pages) # if pages is an iterator, we need to make it a list output(u'Getting %d pages from %s...' % (len(pages), site)) - _GetAll(site, pages, throttle, force).run() + limit = config.special_page_limit / 4 # default is 500/4, but It might have good point for server. + + if len(pages) > limit: + # separate export pages for bulk-retrieve + + for pagg in range(0, len(pages), limit): + if pagg == range(0, len(pages), limit)[-1]: #latest retrieve + k = pages[pagg:] + output(u'Getting pages %d - %d of %d...' % (pagg + 1, len(pages), len(pages))) + _GetAll(site, k, throttle, force).run() + pages[pagg:] = k + else: + k = pages[pagg:pagg + limit] + output(u'Getting pages %d - %d of %d...' % (pagg + 1, pagg + limit, len(pages))) + _GetAll(site, k, throttle, force).run() + pages[pagg:pagg + limit] = k + get_throttle(requestsize = len(pages) / 10) # one time to retrieve is 7.7 sec. + else: + _GetAll(site, pages, throttle, force).run() # Library functions

1 0

SVN: [7696] trunk/pywikipedia/speedy_delete.py
by alexsh＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7696 Author: alexsh Date: 2009-11-26 09:29:40 +0000 (Thu, 26 Nov 2009) Log Message: ----------- add zh option Modified Paths: -------------- trunk/pywikipedia/speedy_delete.py Modified: trunk/pywikipedia/speedy_delete.py =================================================================== --- trunk/pywikipedia/speedy_delete.py 2009-11-26 09:28:38 UTC (rev 7695) +++ trunk/pywikipedia/speedy_delete.py 2009-11-26 09:29:40 UTC (rev 7696) @@ -398,6 +398,7 @@ 'test':u'[[WP:CSD#G2]]: 測試頁', 'vand':u'[[WP:CSD#G3]]: 純粹破壞', 'rep':u'[[WP:CSD#G5]]: 經討論被刪除後又重新創建的內容', + 'repa':u'[[WP:CSD#G5]]: 重複的文章', 'oprj':u'[[WP:CSD#G7]]: 內容來自其他中文計劃', 'move':u'[[WP:CSD#G8]]: 依[[Wikipedia:移動請求]]暫時刪除以進行移動或合併頁面之工作', 'auth':u'[[WP:CSD#G10]]: 原作者請求',

1 0

SVN: [7695] trunk/pywikipedia
by alexsh＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7695 Author: alexsh Date: 2009-11-26 09:28:38 +0000 (Thu, 26 Nov 2009) Log Message: ----------- bugfix, variable typo Modified Paths: -------------- trunk/pywikipedia/interwiki.py trunk/pywikipedia/replace.py trunk/pywikipedia/userlib.py Modified: trunk/pywikipedia/interwiki.py =================================================================== --- trunk/pywikipedia/interwiki.py 2009-11-26 01:24:40 UTC (rev 7694) +++ trunk/pywikipedia/interwiki.py 2009-11-26 09:28:38 UTC (rev 7695) @@ -1647,7 +1647,7 @@ timeout *= 2 time.sleep(timeout) except pywikibot.ServerError: - if timeout>3600: + if timeout > 3600: raise pywikibot.output(u'ERROR putting page: ServerError.') pywikibot.output(u'Sleeping %i seconds before trying again.' % (timeout,)) Modified: trunk/pywikipedia/replace.py =================================================================== --- trunk/pywikipedia/replace.py 2009-11-26 01:24:40 UTC (rev 7694) +++ trunk/pywikipedia/replace.py 2009-11-26 09:28:38 UTC (rev 7695) @@ -305,7 +305,7 @@ self.recursive = recursive if addedCat: site = pywikibot.getSite() - self.addedCat = pywikibot.Page(site, addCat, defaultNamespace=14) + self.addedCat = pywikibot.Page(site, addedCat, defaultNamespace=14) self.sleep = sleep # Some function to set default editSummary should probably be added self.editSummary = editSummary Modified: trunk/pywikipedia/userlib.py =================================================================== --- trunk/pywikipedia/userlib.py 2009-11-26 01:24:40 UTC (rev 7694) +++ trunk/pywikipedia/userlib.py 2009-11-26 09:28:38 UTC (rev 7695) @@ -73,7 +73,7 @@ return self.__str__() def _load(self): - getall(self.site(), [self]) + getall(self.site(), [self], force=True) return def registrationTime(self, force = False):

1 0

SVN: [7694] trunk/pywikipedia/families/wikipedia_family.py
by xqt＠svn.wikimedia.org 26 Nov '09

26 Nov '09

Revision: 7694 Author: xqt Date: 2009-11-26 01:24:40 +0000 (Thu, 26 Nov 2009) Log Message: ----------- Crossnamespace Project:/Help: for de-wiki Modified Paths: -------------- trunk/pywikipedia/families/wikipedia_family.py Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2009-11-25 22:14:36 UTC (rev 7693) +++ trunk/pywikipedia/families/wikipedia_family.py 2009-11-26 01:24:40 UTC (rev 7694) @@ -1130,6 +1130,8 @@ }, } self.crossnamespace[12] = { + 'de': {'_default': [4], + }, 'en': { '_default': [0], },

1 0

SVN: [7693] trunk/pywikipedia/wikipedia.py
by xqt＠svn.wikimedia.org 25 Nov '09

25 Nov '09

Revision: 7693 Author: xqt Date: 2009-11-25 22:14:36 +0000 (Wed, 25 Nov 2009) Log Message: ----------- handle exceptionRegex <source /> alias <syntaxhighlight /> Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2009-11-25 13:47:03 UTC (rev 7692) +++ trunk/pywikipedia/wikipedia.py 2009-11-25 22:14:36 UTC (rev 7693) @@ -4137,6 +4137,9 @@ if exc not in exceptionRegexes: raise ValueError("Unknown tag type: " + exc) dontTouchRegexes.append(exceptionRegexes[exc]) + # handle alias + if exc == 'source': + dontTouchRegexes.append(re.compile(r'(?is)<syntaxhighlight .*?</syntaxhighlight>')) else: # assume it's a regular expression dontTouchRegexes.append(exc)

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Pywikipedia-svn November 2009