Pywikipedia-l February 2009

pywikipedia-l@lists.wikimedia.org

22 participants
230 discussions

a bug of wikipedia.Page.getVersionHistory().
by mizusumashi 16 Feb '09

16 Feb '09

I think that wikipedia.Page.getVersionHistory has a bug. The function getVersionHistory return without edit summary at least in Japanese Wikipedia. The local variable editR is wrong. The following version may work: > editR = re.compile(r'<li>\([^\)]*\) \([^\)]*\) <[^>]*><[^>]*> <a href="[^\'"]*oldid=(\d*)"[^>]*>([^<]*)</a> <span class=[\'"]history-user[\'"]><a [^>]*>([^<]*)</a>(?:[^<]|<(?!span class="comment">)(?!/li>))*(?:<span class="comment">\((.*)\)</span>)?.*</li>', re.UNICODE) I've tested this code rough. Sorry for my poor English. Thank you. ---- [[w:ja:user:mizusumashi]]

1 0

SVN: [6354] branches/rewrite/pywikibot/data/api.py
by russblau＠svn.wikimedia.org 16 Feb '09

16 Feb '09

Revision: 6354 Author: russblau Date: 2009-02-16 22:16:53 +0000 (Mon, 16 Feb 2009) Log Message: ----------- restore component-specific debugging Modified Paths: -------------- branches/rewrite/pywikibot/data/api.py Modified: branches/rewrite/pywikibot/data/api.py =================================================================== --- branches/rewrite/pywikibot/data/api.py 2009-02-14 14:36:27 UTC (rev 6353) +++ branches/rewrite/pywikibot/data/api.py 2009-02-16 22:16:53 UTC (rev 6354) @@ -200,8 +200,7 @@ level=pywikibot.VERBOSE) self.wait() continue - pywikibot.output("API response received:\n%s" % rawdata, - level=pywikibot.DEBUG) + logger.debug(u"API response received:\n%s" % rawdata) if not isinstance(rawdata, unicode): rawdata = rawdata.decode(self.site.encoding()) if rawdata.startswith(u"unknown_action"): @@ -214,7 +213,7 @@ pywikibot.output( "Non-JSON response received from server %s; the server may be down." % self.site, level=pywikibot.WARNING) - pywikibot.output(rawdata, level=pywikibot.DEBUG) + logger.debug(rawdata) self.wait() continue if not result: @@ -360,10 +359,9 @@ else: self.query_limit = int(param["max"]) self.prefix = _modules[mod]["prefix"] - pywikibot.output(u"%s: Set query_limit to %i." - % (self.__class__.__name__, - self.query_limit), - level=pywikibot.DEBUG) + logger.debug(u"%s: Set query_limit to %i." + % (self.__class__.__name__, + self.query_limit)) return def __iter__(self): @@ -385,31 +383,26 @@ self.request[self.prefix+"limit"] = str(new_limit) self.data = self.request.submit() if not self.data or not isinstance(self.data, dict): - pywikibot.output( + logger.debug( u"%s: stopped iteration because no dict retrieved from api." - % self.__class__.__name__, - level=pywikibot.DEBUG) + % self.__class__.__name__) return if not ("query" in self.data and self.resultkey in self.data["query"]): - pywikibot.output( + logger.debug( u"%s: stopped iteration because 'query' and '%s' not found in api response." - % (self.__class__.__name__, self.resultkey), - level=pywikibot.DEBUG) - pywikibot.output(unicode(self.data), level=pywikibot.DEBUG) + % (self.__class__.__name__, self.resultkey)) + logger.debug(unicode(self.data)) return pagedata = self.data["query"][self.resultkey] if isinstance(pagedata, dict): - pywikibot.output(u"%s received %s; limit=%s" - % (self.__class__.__name__, pagedata.keys(), - self.limit), - level=pywikibot.DEBUG) + logger.debug(u"%s received %s; limit=%s" + % (self.__class__.__name__, pagedata.keys(), + self.limit)) pagedata = pagedata.values() else: - pywikibot.output(u"%s received %s; limit=%s" - % (self.__class__.__name__, pagedata, - self.limit), - level=pywikibot.DEBUG) + logger.debug(u"%s received %s; limit=%s" + % (self.__class__.__name__, pagedata, self.limit)) for item in pagedata: yield self.result(item) count += 1

1 0

really basic shell script questions (or is it Bourne script? Bash?)
by Chris Watkins 16 Feb '09

16 Feb '09

I've never written a script before, and know very little about them. (I've googled, and just got confused.) If I want to run a heap of movepages.py commands, it seems like I should use something like: #!/bin/sh python movepages.py -from:"abc (from Wikipedia)" -to:"abc" -log:movelog python movepages.py -from:"xyz (from Wikipedia)" -to:"xyz" -log:movelog etc My questions: - If I place the script in my pywikipedia directory, do I still need to add a *cd pywikipedia/* or equivalent after the first line? - I've seen *rundate=`date +"%FT%T%z"` *used after the cd command, but I can't figure out what this does. Is it needed? -- Chris Watkins (a.k.a. Chriswaterguy) Appropedia.org - Sharing knowledge to build rich, sustainable lives. identi.ca/appropedia / twitter.com/appropedia blogs.appropedia.org I like this: five.sentenc.es

2 1

[ pywikipediabot-Bugs-2605385 ] wiktionary sort order for ms and da
by SourceForge.net 16 Feb '09

16 Feb '09

Bugs item #2605385, was opened at 2009-02-16 15:28 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2605385&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Robert Ullmann (robertullmann) Assigned to: Nobody/Anonymous (nobody) Summary: wiktionary sort order for ms and da Initial Comment: It was pointed out to me that the order used for ms.wikt (default code-alpha) is incorrect, they use the order used by ms.wp: "alphabetic_revised" Also: da.wikt wants the order to be "alphabetic" Does anyone look at "feature requests"? Took me a while to realize they were separate from "bugs". Pywikipedia [http] trunk/pywikipedia (r6353, Feb 14 2009, 14:36:27) Python 2.6.1 (r261:67517, Dec 4 2008, 16:51:00) [MSC v.1500 32 bit (Intel)] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2605385&group_…

1 0

movepages - removing a suffix from each pagename?
by Chris Watkins 16 Feb '09

16 Feb '09

I need to move a bunch of pages, removing the last part of the title. (Detail: I've edited the XML file of imported pages, to add "(from Wikipedia)" on the end of each article's name. This helps avoid clashes between articles of the same name in the imported pages and the existing wiki pages. By leaving the redirects in place, it helps avoid importing each article more than once, when I import more groups of pages in future.) Now, I can use a spreadsheet to make up a list of commands, one line for each page, of the form: *python movepages.py -from:"foo (from Wikipedia)" -to:"foo"* * "file:pagelist.txt"* * *and that will work...but is there a more efficient way of renaming these pages? Thanks! -- Chris Watkins (a.k.a. Chriswaterguy) Appropedia.org - Sharing knowledge to build rich, sustainable lives. identi.ca/appropedia / twitter.com/appropedia blogs.appropedia.org I like this: five.sentenc.es

1 0

[ pywikipediabot-Bugs-2602058 ] Interwiki link sorting for Swedish Wikipedia
by SourceForge.net 15 Feb '09

15 Feb '09

Bugs item #2602058, was opened at 2009-02-15 08:48 Message generated for change (Comment added) made by multichill You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2602058&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Lars Aronsson (aronsson) Assigned to: Nobody/Anonymous (nobody) Summary: Interwiki link sorting for Swedish Wikipedia Initial Comment: Please modify families/wikipedia_family.py (near line 910) so that interwiki links on the Swedish Wikipedia (sv.wikipedia.org) are sorted by language name (self.interwiki_putfirst = {... 'sv': self.alphabetic, ...}, as for en.wikipedia.org and no.wikipedia.org) rather than by language code (which is the default). ---------------------------------------------------------------------- >Comment By: Multichill (multichill) Date: 2009-02-15 12:17 Message: Do you have community consensus on this? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2602058&group_…

1 0

[ pywikipediabot-Bugs-2602058 ] Interwiki link sorting for Swedish Wikipedia
by SourceForge.net 15 Feb '09

15 Feb '09

Bugs item #2602058, was opened at 2009-02-15 08:48 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2602058&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Lars Aronsson (aronsson) Assigned to: Nobody/Anonymous (nobody) Summary: Interwiki link sorting for Swedish Wikipedia Initial Comment: Please modify families/wikipedia_family.py (near line 910) so that interwiki links on the Swedish Wikipedia (sv.wikipedia.org) are sorted by language name (self.interwiki_putfirst = {... 'sv': self.alphabetic, ...}, as for en.wikipedia.org and no.wikipedia.org) rather than by language code (which is the default). ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2602058&group_…

1 0

SVN: [5914] trunk/pywikipedia
by wikipedian＠svn.wikimedia.org 14 Feb '09

14 Feb '09

Revision: 5914 Author: wikipedian Date: 2008-09-22 16:15:37 +0000 (Mon, 22 Sep 2008) Log Message: ----------- Fixed the Esperanto X-convention bug [ 2006208 ] by rolling back many changes that concerned Esperanto X-conv. I fixed this on 2008-08-21 already, but somehow my commit seems to have failed (sorry), so now I retry to commit it. Modified Paths: -------------- trunk/pywikipedia/families/wikipedia_family.py trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2008-09-22 09:58:41 UTC (rev 5913) +++ trunk/pywikipedia/families/wikipedia_family.py 2008-09-22 16:15:37 UTC (rev 5914) @@ -966,16 +966,4 @@ return self.code2encoding(code), def shared_image_repository(self, code): - return ('commons', 'commons') - - def post_get_convert(self, site, getText): - if site.lang == 'eo': - return wikipedia.decodeEsperantoX(getText) - else: - return getText - - def pre_put_convert(self, site, getText): - if site.lang == 'eo': - return wikipedia.encodeEsperantoX(getText) - else: - return getText + return ('commons', 'commons') \ No newline at end of file Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-09-22 09:58:41 UTC (rev 5913) +++ trunk/pywikipedia/wikipedia.py 2008-09-22 16:15:37 UTC (rev 5914) @@ -799,12 +799,12 @@ else: self._isWatched = False # Now process the contents of the textarea - # Unescape HTML characters, strip whitespace and postconvert - pagetext = text[i1:i2] - pagetext = unescape(pagetext) - pagetext = pagetext.rstrip() - pagetext = self.site().post_get_convert(pagetext) - + # Unescape HTML characters, strip whitespace + pagetext = text[i1:i2] + pagetext = unescape(pagetext) + pagetext = pagetext.rstrip() + if self.site().lang == 'eo': + pagetext = decodeEsperantoX(pagetext) m = self.site().redirectRegex().match(pagetext) if m: # page text matches the redirect pattern @@ -1295,7 +1295,12 @@ import watchlist watchArticle = watchlist.isWatched(self.title(), site = self.site()) newPage = not self.exists() - newtext = self.site().pre_put_convert(newtext) + # if posting to an Esperanto wiki, we must e.g. write Bordeauxx instead + # of Bordeaux + if self.site().lang == 'eo': + newtext = encodeEsperantoX(newtext) + comment = encodeEsperantoX(comment) + return self._putPage(newtext, comment, watchArticle, minorEdit, newPage, self.site().getToken(sysop = sysop), sysop = sysop) @@ -2237,7 +2242,7 @@ reason = input(u'Please enter a reason for the deletion:') answer = 'y' if prompt and not hasattr(self.site(), '_noDeletePrompt'): - answer = inputChoice(u'Do you want to delete %s?' % self.aslink(forceInterwiki = True), ['Yes', 'No', 'All'], ['Y', 'N', 'A'], 'N') + answer = inputChoice(u'Do you want to delete %s?' % self.aslink(forceInterwiki = True), ['yes', 'no', 'all'], ['y', 'N', 'a'], 'N') if answer == 'a': answer = 'y' self.site()._noDeletePrompt = True @@ -2939,6 +2944,9 @@ def getData(self): address = self.site.export_address() pagenames = [page.sectionFreeTitle() for page in self.pages] + # We need to use X convention for requested page titles. + if self.site.lang == 'eo': + pagenames = [encodeEsperantoX(pagetitle) for pagetitle in pagenames] pagenames = u'\r\n'.join(pagenames) if type(pagenames) is not unicode: output(u'Warning: xmlreader.WikipediaXMLHandler.getData() got non-unicode page names. Please report this.') @@ -3995,11 +4003,6 @@ linktrail: Return regex for trailing chars displayed as part of a link. disambcategory: Category in which disambiguation pages are listed. - post_get_convert: Converts text data from the site immediatly after get - i.e. EsperantoX -> unicode - pre_put_convert: Converts text data from the site immediatly before put - i.e. unicode -> EsperantoX - Methods that yield Page objects derived from a wiki's Special: pages (note, some methods yield other information in a tuple along with the Pages; see method docs for details) -- @@ -5840,12 +5843,6 @@ """Return regex for trailing chars displayed as part of a link.""" return self.family.linktrail(self.lang) - def post_get_convert(self, getText): - return self.family.post_get_convert(self, getText) - - def pre_put_convert(self, putText): - return self.family.pre_put_convert(self, putText) - def language(self): """Return Site's language code.""" return self.lang

2 1

SVN: [6353] trunk/pywikipedia
by malafaya＠svn.wikimedia.org 14 Feb '09

14 Feb '09

Revision: 6353 Author: malafaya Date: 2009-02-14 14:36:27 +0000 (Sat, 14 Feb 2009) Log Message: ----------- updated some namespaces names in sa, mt Modified Paths: -------------- trunk/pywikipedia/families/wikipedia_family.py trunk/pywikipedia/families/wiktionary_family.py trunk/pywikipedia/family.py Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2009-02-14 12:45:41 UTC (rev 6352) +++ trunk/pywikipedia/families/wikipedia_family.py 2009-02-14 14:36:27 UTC (rev 6353) @@ -119,6 +119,7 @@ 'pa': u'ਵਿਕਿਪੀਡਿਆ', 'rmy': u'Vikipidiya', 'ru': u'Википедия', + 'sa': u'विकिपीडिया', 'sah': u'Бикипиидийэ', 'sk': u'Wikipédia', 'sl': u'Wikipedija', @@ -271,7 +272,7 @@ 'rmy': u'Vikipidiyake vakyarimata', 'ro': u'Discuţie Wikipedia', 'ru': u'Обсуждение Википедии', - 'sa': u'Wikipediaसंभाषणं', + 'sa': u'विकिपीडियासंभाषणं', 'sah': u'Бикипиидийэ ырытыыта', 'sc': u'Wikipedia discussioni', 'scn': u'Discussioni Wikipedia', Modified: trunk/pywikipedia/families/wiktionary_family.py =================================================================== --- trunk/pywikipedia/families/wiktionary_family.py 2009-02-14 12:45:41 UTC (rev 6352) +++ trunk/pywikipedia/families/wiktionary_family.py 2009-02-14 14:36:27 UTC (rev 6353) @@ -167,7 +167,7 @@ 'mn': u'Wiktionary-н хэлэлцүүлэг', 'mr': u'Wiktionary चर्चा', 'ms': u'Perbincangan Wiktionary', - 'mt': u'Wiktionary diskuti', + 'mt': u'Wiktionary diskussjoni', 'nah': u'Wiktionary tēixnāmiquiliztli', 'nap': [u'Wiktionary chiàcchiera', u'Discussioni Wiktionary'], 'nds': u'Wiktionary Diskuschoon', Modified: trunk/pywikipedia/family.py =================================================================== --- trunk/pywikipedia/family.py 2009-02-14 12:45:41 UTC (rev 6352) +++ trunk/pywikipedia/family.py 2009-02-14 14:36:27 UTC (rev 6353) @@ -53,7 +53,7 @@ -2: { '_default': u'Media', 'ab': u'Медиа', - 'am': u'ፋይል', + 'am': u'ፋይል', 'ar': u'ميديا', 'arz': u'ميديا', 'as': u'মাধ্যম', @@ -129,6 +129,7 @@ 'qu': u'Midya', 'rmy': u'Mediya', 'ru': u'Медиа', + 'sa': u'माध्यम', 'scn': u'Mèdia', 'sd': u'ذريعات', 'si': u'මාධ්‍යය', @@ -283,6 +284,7 @@ 'qu': u'Sapaq', 'rmy': u'Uzalutno', 'ru': u'Служебная', + 'sa': u'विशेष', 'sah': u'Аналлаах', 'sc': u'Speciale', 'scn': u'Spiciali', @@ -1238,6 +1240,7 @@ 'pa': u'ਮੀਡੀਆਵਿਕਿ', 'ps': u'ميډياويکي', 'rmy':u'MediyaViki', + 'sa':u'मिडीयाविकी', 'sd': u'ذريعات وڪي', 'si': [u'මාධ්‍යවිකි', u'විකිමාධ්‍ය'], 'sr': u'МедијаВики', @@ -1381,6 +1384,7 @@ 'rmy':[u'MediyaViki vakyarimata', u'Discuţie MediaWiki'], 'ro': u'Discuţie MediaWiki', 'ru': u'Обсуждение MediaWiki', + 'sa': u'मिडियाविकीसंभाषणं', 'scn': u'Discussioni MediaWiki', 'sd': u'ذريعات وڪي بحث', 'si': [u'මාධ්‍යවිකි සාකච්ඡාව', u'විකිමාධ්‍ය සාකච්ඡාව'], @@ -1544,6 +1548,7 @@ 'rmy': [u'Sikavno', u'Format'], 'ro': u'Format', 'ru': u'Шаблон', + 'sa': u'बिंबधर', 'sah': u'Халыып', 'sd': u'سانچو', 'si': u'සැකිල්ල', @@ -1709,6 +1714,7 @@ 'rmy': [u'Sikavno vakyarimata', u'Discuţie Format'], 'ro': u'Discuţie Format', 'ru': u'Обсуждение шаблона', + 'sa': u'बिंबधर संभाषणं', 'sah': u'Халыып ырытыыта', 'scn': u'Discussioni template', 'sd': u'سنچو بحث', @@ -1879,7 +1885,7 @@ 'rmy':[u'Zhutipen', u'Ajutor'], 'ro': u'Ajutor', 'ru': u'Справка', - 'sa': u'उपकारः', + 'sa': u'सहाय्य', 'sah': u'Көмө', 'scn': u'Aiutu', 'sd': u'مدد', @@ -2051,7 +2057,7 @@ 'rmy':[u'Zhutipen vakyarimata', u'Discuţie Ajutor'], 'ro': u'Discuţie Ajutor', 'ru': u'Обсуждение справки', - 'sa': u'उपकारसंभाषणं', + 'sa': u'सहाय्यसंभाषणं', 'sah': u'Көмө ырытыыта', 'scn': u'Discussioni aiutu', 'sd': u'مدد بحث',

1 0

SVN: [6352] trunk/pywikipedia/login.py
by valhallasw＠svn.wikimedia.org 14 Feb '09

14 Feb '09

Revision: 6352 Author: valhallasw Date: 2009-02-14 12:45:41 +0000 (Sat, 14 Feb 2009) Log Message: ----------- Bugfix: was broken *without* verbose >_< Modified Paths: -------------- trunk/pywikipedia/login.py Modified: trunk/pywikipedia/login.py =================================================================== --- trunk/pywikipedia/login.py 2009-02-14 00:05:02 UTC (rev 6351) +++ trunk/pywikipedia/login.py 2009-02-14 12:45:41 UTC (rev 6352) @@ -269,6 +269,8 @@ sysop = False logall = False forceLogin = False + verbose = False + for arg in wikipedia.handleArgs(): if arg.startswith("-pass"): if len(arg) == 5:

1 0

← Newer
1
...
14
15
16
17
18
19
20
...
23
Older →

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l February 2009