Pywikipedia-l November 2007

pywikipedia-l@lists.wikimedia.org

29 participants
285 discussions

[ pywikipediabot-Bugs-1837304 ] No featured articles for pages with slash
by SourceForge.net 25 Nov '07

25 Nov '07

Bugs item #1837304, was opened at 2007-11-23 23:26 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1837304&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: André Malafaya Baptista (malafaya) Assigned to: Nobody/Anonymous (nobody) Summary: No featured articles for pages with slash Initial Comment: Every time a featured article contains a slash (/), that page is not processed. For example, while processing featured article in en.wiki: (...) >>> A. E. J. Collins <<< No corresponding page in wikipedia:io AC/DC is a subpage >>> AHS Centaur <<< No corresponding page in wikipedia:io (...) AC/DC is not processed because it contains a slash and thus it's considered a subpage. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2007-11-25 14:25 Message: Logged In: YES user_id=1327030 Originator: NO Fixed in r4589. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1837304&group_…

1 0

SVN: [4589] trunk/pywikipedia/featured.py
by rotem＠svn.wikimedia.org 25 Nov '07

25 Nov '07

Revision: 4589 Author: rotem Date: 2007-11-25 12:24:46 +0000 (Sun, 25 Nov 2007) Log Message: ----------- (bug 1837304) Don't skip a page with slash if it is in the main namespace, which usually doesn't contain subpages (anyway, if it is a featured subpage, why not adding Link FA despite it?). Modified Paths: -------------- trunk/pywikipedia/featured.py Modified: trunk/pywikipedia/featured.py =================================================================== --- trunk/pywikipedia/featured.py 2007-11-25 12:02:05 UTC (rev 4588) +++ trunk/pywikipedia/featured.py 2007-11-25 12:24:46 UTC (rev 4589) @@ -253,7 +253,7 @@ for a in arts: if a.title()<afterpage: continue - if u"/" in a.title(): + if u"/" in a.title() and a.namespace() != 0: wikipedia.output(u"%s is a subpage" % a.title()) continue if a.title() in cc:

1 0

[ pywikipediabot-Bugs-1834705 ] redirect.py doesn't use localized version of #REDIRECT
by SourceForge.net 25 Nov '07

25 Nov '07

Bugs item #1834705, was opened at 2007-11-19 20:35 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1834705&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: other Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: André Malafaya Baptista (malafaya) Assigned to: Nobody/Anonymous (nobody) Summary: redirect.py doesn't use localized version of #REDIRECT Initial Comment: replace.py always uses the magic word #REDIRECT when resolving double-redirects. I tried it on a page which had a localized version of the #REDIRECT magic word and the changes suggested by it include replacing the already localized version back to #REDIRECT . The affected language (ka) has #REDIRECT localized in family.py. I believe the problem in at line 288 of redirect.py where you can find #REDIRECT hard-coded. Thanks. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2007-11-25 14:04 Message: Logged In: YES user_id=1327030 Originator: NO Fixed in r4588. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1834705&group_…

1 0

SVN: [4588] trunk/pywikipedia
by rotem＠svn.wikimedia.org 25 Nov '07

25 Nov '07

Revision: 4588 Author: rotem Date: 2007-11-25 12:02:05 +0000 (Sun, 25 Nov 2007) Log Message: ----------- (bug 1834705) Properly use localized redirect text in redirect.py. Modified Paths: -------------- trunk/pywikipedia/redirect.py trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/redirect.py =================================================================== --- trunk/pywikipedia/redirect.py 2007-11-25 11:02:52 UTC (rev 4587) +++ trunk/pywikipedia/redirect.py 2007-11-25 12:02:05 UTC (rev 4588) @@ -285,7 +285,7 @@ % (secondRedir.aslink(), secondTargetPage.aslink())) continue oldText = redir.get(get_redirect=True) - text = mysite.redirectRegex().sub('#REDIRECT [[%s]]' % secondTargetPage.title(), oldText) + text = mysite.redirectRegex().sub('#%s [[%s]]' % ( mysite.redirect( True ), secondTargetPage.title() ), oldText) wikipedia.showDiff(oldText, text) if self.prompt(u'Do you want to accept the changes?'): try: Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2007-11-25 11:02:52 UTC (rev 4587) +++ trunk/pywikipedia/wikipedia.py 2007-11-25 12:02:05 UTC (rev 4588) @@ -4464,7 +4464,7 @@ """ if default: - return self.family.redirect.get(self.lang, "REDIRECT") + return self.family.redirect.get(self.lang, [u"REDIRECT"])[0] else: return self.family.redirect.get(self.lang, None)

1 0

SVN: [4587] trunk/pywikipedia
by rotem＠svn.wikimedia.org 25 Nov '07

25 Nov '07

Revision: 4587 Author: rotem Date: 2007-11-25 11:02:52 +0000 (Sun, 25 Nov 2007) Log Message: ----------- Adding new languages. Modified Paths: -------------- trunk/pywikipedia/families/wikinews_family.py trunk/pywikipedia/families/wikipedia_family.py trunk/pywikipedia/families/wikiquote_family.py trunk/pywikipedia/families/wikisource_family.py trunk/pywikipedia/family.py Modified: trunk/pywikipedia/families/wikinews_family.py =================================================================== --- trunk/pywikipedia/families/wikinews_family.py 2007-11-24 14:38:50 UTC (rev 4586) +++ trunk/pywikipedia/families/wikinews_family.py 2007-11-25 11:02:52 UTC (rev 4587) @@ -53,6 +53,7 @@ 'ca': u'Viquinotícies Discussió', 'de': u'Wikinews Diskussion', 'es': u'Wikinoticias Discusión', + 'fi': u'Keskustelu Wikinewsistä', 'fr': u'Discussion Wikinews', 'he': u'שיחת ויקיחדשות', 'it': u'Discussioni Wikinotizie', Modified: trunk/pywikipedia/families/wikipedia_family.py =================================================================== --- trunk/pywikipedia/families/wikipedia_family.py 2007-11-24 14:38:50 UTC (rev 4586) +++ trunk/pywikipedia/families/wikipedia_family.py 2007-11-25 11:02:52 UTC (rev 4587) @@ -113,6 +113,7 @@ 'ba': u'Wikipedia б-са фекер алышыу', 'bar': u'Wikipedia Diskussion', 'bat-smg': u'Vikipedėjės aptarėms', + 'bcl': u'Olay sa Wikipedia', 'be': u'Вікіпедыя размовы', 'be-x-old': u'Абмеркаваньне Вікіпэдыя', 'bg': u'Уикипедия беседа', @@ -714,6 +715,7 @@ 'ay' : u'Main Page', 'az' : u'Main Page', 'ba' : u'Баш бит', + 'bcl': u'Pangenot na Pahina', 'be' : u'Галоўная старонка', 'be-x-old': u'Галоўная старонка', 'bg' : u'Начална страница', Modified: trunk/pywikipedia/families/wikiquote_family.py =================================================================== --- trunk/pywikipedia/families/wikiquote_family.py 2007-11-24 14:38:50 UTC (rev 4586) +++ trunk/pywikipedia/families/wikiquote_family.py 2007-11-25 11:02:52 UTC (rev 4587) @@ -85,6 +85,7 @@ 'be': u'Wikiquote размовы', 'bg': u'Уикицитат беседа', 'bm': u'Discussion Wikiquote', + 'br': u'Kaozeadenn Wikiquote', 'bs': u'Razgovor s Wikicitatima', 'ca': u'Viquidites Discussió', 'cs': u'Wikicitáty diskuse', @@ -116,6 +117,7 @@ 'ku': u'Wikiquote nîqaş', 'la': u'Disputatio Vicicitationis', 'lb': u'Wikiquote Diskussion', + 'li': u'Euverlèk Wikiquote', 'lt': u'Wikiquote aptarimas', 'ml': u'വിക്കി ചൊല്ലുകള്‍ സംവാദം', 'mr': u'Wikiquote चर्चा', Modified: trunk/pywikipedia/families/wikisource_family.py =================================================================== --- trunk/pywikipedia/families/wikisource_family.py 2007-11-24 14:38:50 UTC (rev 4586) +++ trunk/pywikipedia/families/wikisource_family.py 2007-11-25 11:02:52 UTC (rev 4587) @@ -84,6 +84,7 @@ 'hr': u'Razgovor o Wikizvoru', 'ht': u'Diskisyon Wikisòrs', 'hu': u'Wikiforrás vita', + 'hy': u'Wikisource քննարկում', 'id': u'Pembicaraan Wikisource', 'is': u'Wikiheimildspjall', 'it': u'Discussioni Wikisource', Modified: trunk/pywikipedia/family.py =================================================================== --- trunk/pywikipedia/family.py 2007-11-24 14:38:50 UTC (rev 4586) +++ trunk/pywikipedia/family.py 2007-11-25 11:02:52 UTC (rev 4587) @@ -12,7 +12,7 @@ self.alphabetic = [ 'aa','af','ak','als','am','ang','ab','ar','an','arc','roa-rup','frp','as', 'ast','gn','av','ay','az','bm','bn','zh-min-nan','map-bms','ba','be','be-x-old', - 'bh','bi','bar','bo','bs','br','bg','bxr','ca','cv','ceb','cs','ch', + 'bh','bcl','bi','bar','bo','bs','br','bg','bxr','ca','cv','ceb','cs','ch', 'ny','sn', 'tum','cho','co','za','cy','da','pdc','de','dv','nv','dz','mh', 'et','el','eml','en','es','eo','eu','ee','fa','fo','fr','fy','ff','fur','ga', @@ -49,6 +49,7 @@ 'az': u'Mediya', 'ba': u'Медиа', 'bat-smg':u'Medija', + 'bcl': u'Medio', 'be': u'Мультымедыя', 'be-x-old': u'Мэдыя', 'bg': u'Медия', @@ -120,6 +121,7 @@ 'ba': u'Ярҙамсы', 'bar': u'Spezial', 'bat-smg':u'Specēlos', + 'bcl': u'Espesyal', 'be': u'Адмысловае', 'be-x-old': u'Спэцыяльныя', 'bg': u'Специални', @@ -244,6 +246,7 @@ 'ba': u'Фекер алышыу', 'bar': u'Diskussion', 'bat-smg':u'Aptarėms', + 'bcl': u'Olay', 'be': u'Размовы', 'be-x-old': u'Абмеркаваньне', 'bg': u'Беседа', @@ -378,6 +381,7 @@ 'ba': u'Ҡатнашыусы', 'bar': u'Benutzer', 'bat-smg':u'Nauduotuos', + 'bcl': u'Paragamit', 'be': u'Удзельнік', 'be-x-old': u'Удзельнік', 'bg': u'Потребител', @@ -511,6 +515,7 @@ 'ba': u'Ҡатнашыусы м-н фекер алышыу', 'bar': u'Benutzer Diskussion', 'bat-smg':u'Nauduotuojė aptarėms', + 'bcl': u'Olay kan paragamit', 'be': u'Размовы з удзельнікам', 'be-x-old': u'Гутаркі ўдзельніка', 'bg': u'Потребител беседа', @@ -651,6 +656,7 @@ 'ba': u'Рәсем', 'bar': u'Bild', 'bat-smg':u'Abruozdielis', + 'bcl': u'Ladawan', 'be': u'Выява', 'be-x-old': u'Выява', 'bg': u'Картинка', @@ -780,6 +786,7 @@ 'ba': u'Рәсем б-са фекер алышыу', 'bar': u'Bild Diskussion', 'bat-smg':u'Abruozdielė aptarėms', + 'bcl': u'Olay sa ladawan', 'be': u'Размовы пра выяву', 'be-x-old': u'Абмеркаваньне выявы', 'bg': u'Картинка беседа', @@ -904,6 +911,7 @@ '_default': u'MediaWiki', 'ar': u'ميدياويكي', 'az': u'MediyaViki', + 'bcl': u'MediaWiki', 'bg': u'МедияУики', 'bpy': u'মিডিয়াউইকি', 'bs': u'MedijaViki', @@ -950,6 +958,7 @@ 'ba': u'MediaWiki б-са фекер алышыу', 'bar': u'MediaWiki Diskussion', 'bat-smg':u'MediaWiki aptarėms', + 'bcl': u'Olay sa MediaWiki', 'be': u'Размовы пра MediaWiki', 'be-x-old': u'Абмеркаваньне MediaWiki', 'bg': u'МедияУики беседа', @@ -1079,6 +1088,7 @@ 'ba': u'Ҡалып', 'bar': u'Vorlage', 'bat-smg':u'Šabluons', + 'bcl': u'Plantilya', 'be': u'Шаблон', 'be-x-old': u'Шаблён', 'bg': u'Шаблон', @@ -1203,6 +1213,7 @@ 'ba': u'Ҡалып б-са фекер алышыу', 'bar': u'Vorlage Diskussion', 'bat-smg':u'Šabluona aptarėms', + 'bcl': u'Olay sa plantilya', 'be': u'Размовы пра шаблон', 'be-x-old': u'Абмеркаваньне шаблёну', 'bg': u'Шаблон беседа', @@ -1332,6 +1343,7 @@ 'ba': u'Белешмә', 'bar': u'Hilfe', 'bat-smg':u'Pagelba', + 'bcl': u'Tabang', 'be': u'Даведка', 'be-x-old': u'Дапамога', 'bg': u'Помощ', @@ -1460,6 +1472,7 @@ 'ba': u'Белешмә б-са фекер алышыу', 'bar': u'Hilfe Diskussion', 'bat-smg':u'Pagelbas aptarėms', + 'bcl': u'Olay sa tabang', 'be': u'Размовы пра даведку', 'be-x-old': u'Абмеркаваньне дапамогі', 'bg': u'Помощ беседа', @@ -1590,6 +1603,7 @@ 'ba': u'Категория', 'bar': u'Kategorie', 'bat-smg':u'Kateguorėjė', + 'bcl': u'Kategorya', 'be': u'Катэгорыя', 'be-x-old': u'Катэгорыя', 'bg': u'Категория', @@ -1720,6 +1734,7 @@ 'ba': u'Категория б-са фекер алышыу', 'bar': u'Kategorie Diskussion', 'bat-smg':u'Kateguorėjės aptarėms', + 'bcl': u'Olay sa kategorya', 'be': u'Размовы пра катэгорыю', 'be-x-old': u'Абмеркаваньне катэгорыі', 'bg': u'Категория беседа',

1 0

Fwd: [Wikitech-l] New wikis created
by Bryan Tong Minh 24 Nov '07

24 Nov '07

Family files should be updated. Bryan ---------- Forwarded message ---------- From: Jens Frank <jf(a)mormo.org> Date: Nov 24, 2007 11:21 PM Subject: [Wikitech-l] New wikis created To: wikitech-l(a)lists.wikimedia.org Hello, five new wikis have been created: fiwikinews http://bugzilla.wikimedia.org/show_bug.cgi?id=12052 hywikisource http://bugzilla.wikimedia.org/show_bug.cgi?id=12017 brwikiquote http://bugzilla.wikimedia.org/show_bug.cgi?id=11949 bclwiki http://bugzilla.wikimedia.org/show_bug.cgi?id=11840 liwikiquote http://bugzilla.wikimedia.org/show_bug.cgi?id=11760 Best regards, jens _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org http://lists.wikimedia.org/mailman/listinfo/wikitech-l

1 0

[ pywikipediabot-Bugs-1837716 ] crash with cosmetic_change.py
by SourceForge.net 24 Nov '07

24 Nov '07

Bugs item #1837716, was opened at 2007-11-24 19:44 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1837716&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: other Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: David Crochet (crochet_david) Assigned to: Nobody/Anonymous (nobody) Summary: crash with cosmetic_change.py Initial Comment: The python verbose : dcrochet@linux-fxgk:~/pywikipedia> python cosmetic_changes.py -new Checked for running processes. 1 processes currently running, including the current process. ATTENTION: You can run this script as a stand-alone for testing purposes. However, the changes are that are made are only minor, and other users might get angry if you fill the version histories and watchlists with such irrelevant changes. Do you really want to continue? ([y]es, [N]o) y Getting 60 pages from wikiversity:fr... >>> Vocabulaire/Portugais/Prérequis conseillés <<< Traceback (most recent call last): File "cosmetic_changes.py", line 400, in ? main() File "cosmetic_changes.py", line 396, in main bot.run() File "cosmetic_changes.py", line 361, in run self.treat(page) File "cosmetic_changes.py", line 342, in treat changedText = ccToolkit.change(page.get()) File "cosmetic_changes.py", line 94, in change text = self.translateAndCapitalizeNamespaces(text) File "cosmetic_changes.py", line 154, in translateAndCapitalizeNamespaces wrongNamespaces.append(defaultNs[0].lower() + defaultNs[1:]) IndexError: string index out of range dcrochet@linux-fxgk:~/pywikipedia> ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1837716&group_…

1 0

SVN: [4586] trunk/pywikipedia/welcome.py
by filnik＠svn.wikimedia.org 24 Nov '07

24 Nov '07

Revision: 4586 Author: filnik Date: 2007-11-24 14:38:50 +0000 (Sat, 24 Nov 2007) Log Message: ----------- This patch will make the build of some strings less buggy and should be more elegant too Modified Paths: -------------- trunk/pywikipedia/welcome.py Modified: trunk/pywikipedia/welcome.py =================================================================== --- trunk/pywikipedia/welcome.py 2007-11-21 22:48:58 UTC (rev 4585) +++ trunk/pywikipedia/welcome.py 2007-11-24 14:38:50 UTC (rev 4586) @@ -363,7 +363,7 @@ # and i put them in a list (i find it more easy and secure). while 1: # FIXME: That's the regex, if there are problems, take a look here. - reg = r'\(<a href=\"/w/index.php\?title=' + talk + r'(.*?)&(amp;|)action=edit\"' + reg = r'\(<a href=\"/w/index.php\?title=%s(.*?)&(amp;|)action=edit\"' % talk p = re.compile(reg, re.UNICODE) x = p.search(raw, pos) if x == None: @@ -378,10 +378,10 @@ if username not in done: done.append(username) userpage = wikipedia.Page(wsite, username) - usertalkpage = wikipedia.Page(wsite, talk + username) + usertalkpage = wikipedia.Page(wsite, str(talk) + str(username)) # Defing the contrib's page of the user. pathWiki = wsite.family.nicepath(wsite.lang) - con = pathWiki + 'Special:Contributions/'+ userpage.urlname() + con = '%sSpecial:Contributions/%s' % (pathWiki, userpage.urlname()) # Getting the contribs... contribs = wsite.getUrl(con) contribnum = contribs.count('<li>') # Maxes at 50, but not important. @@ -485,9 +485,9 @@ else: safety.append(u'{|border="2" cellpadding="4" cellspacing="0" style="margin: 0.5em 0.5em 0.5em 1em; padding: 0.5em; background: #bfcda5; border: 1px #b6fd2c solid; border-collapse: collapse; font-size: 95%;"') # The string below show how the "Usernames" will be notified. - safety.append('\n!' + usernam) + safety.append('\n!%s' % usernam) # The string below show how the "Contribs" will be notified. - safety.append(u'\n!' + contrib) + safety.append(u'\n!%s' % contrib) for found_result in welcomed_users: # Adding the log... (don't take care of the variable's name...). @@ -613,7 +613,7 @@ contrib = string.capitalize(wsite.mediawiki_message('contribslink')) # The talk_page's variable gives "Talk page". talk_page = wsite.namespace(3) - talk = urlname(talk_page, wsite) + ':' + talk = '%s:' % urlname(talk_page, wsite) # Some project of the same language, have different settings. (this is the place to add them). if wsite.family.name == "wikinews" and wsite.lang == "it": @@ -709,7 +709,7 @@ # The URL for new users is the same in every project. It should not be changed. URL = "/w/index.php?title=Special:Log&type=newusers&limit=%d&offset=%d" % (limit, offset_variable) log = wsite.getUrl(URL) - wikipedia.output(u'Loading latest ' + str(limit) + u' new users from ' + (wsite.hostname()) + u'...\n') + wikipedia.output(u'Loading latest %s new users from %s...\n' % (limit, wsite.hostname())) # Determine which signature to use if random == True: try: @@ -727,9 +727,9 @@ number_user = 0 yield number_user if wsite.family.name == "wikipedia" and wsite.lang == "zh": - welcom = welcomer % signList[number_user] + timeselected + '<small>(via ~~~)</small>' + welcom = welcomer % signList[number_user] + timeselected + '<small>(via ~~~)</small>' else: - welcom = welcomer % signList[number_user] + timeselected + welcom = welcomer % signList[number_user] + timeselected else: welcom = welcomer % sign username = str(found_result[0]) @@ -753,7 +753,7 @@ if word.lower() in username.lower(): baduser = True if wsite.lang == 'it': - final_rep = rep_text + word + '}}' + final_rep = "%s%s}}" % (rep_text, word) break else: final_rep = rep_text

1 0

Rewrite project: A summary of discussions
by Huji 23 Nov '07

23 Nov '07

Hello all, A while ago, a discussion was started about the rewrite project, bug was left unfinished. In order to help it reach a consensus, I'm summarizing the discussion up to here, with the hope that you'll read this rather long email and comment about the uncertainities left. Merlijn proposed thees four to be taken into account prior to starting the rewrite project: a) to restructure the framework b) to have consistent formatting (including coding style) and documentation c) to move to the API d) to add i18n support He suggested PEP 8 for coding style, while X other people commented in favor of camelCase. He also suggested using u'' for all strings, Epydoc for inline documentation and __version__ in every file; no one argued against any of these. Not much discussion took place about items c and d. (Having read all that, I'm still not sure if we reached an agreement about moving to API totally -- and solely -- or not, though). Item a, on the other hand, seems to be approached differently by different persons. Merlijn suggested use of unit testing, which was supported by some others. He also suggested a one-module-per-class style, keeping it thread safe. Some people depicted disadvantages of (and ambiguities of) one-module-per-class style, and I see no final decission. Bryan took a different approach and proposed separation of the code to different levels as such: * High-level * Middleware * Lowware or core He also proposed some connections between each part of the current code, and the desired "level" in the above classification. Bryan later shared some thoughts about the GZip module. He also suggested having a code name for our rewrite project (rather than, for example, "pywikipedia 2.0" which was perhaps coined by Misza). That's all. It's your comments which can drive it more ahead. I'm not a professional programmer, nor can I call myself an expert in Python. So please excuse me if I misunderstood something and reflected it incorrectly in the above. Cheers, Hojjat (aka Huji)

1 0

[ pywikipediabot-Bugs-1831698 ] Partial pages saved on connection reset
by SourceForge.net 23 Nov '07

23 Nov '07

Bugs item #1831698, was opened at 2007-11-14 11:44 Message generated for change (Comment added) made by btongminh You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1831698&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None Status: Open Resolution: Fixed Priority: 8 Private: No Submitted By: siebrand (siebrand) Assigned to: Nobody/Anonymous (nobody) Summary: Partial pages saved on connection reset Initial Comment: I have gotten 2 reports of CommonsDelinker saving incomplete pages: http://bg.wikipedia.org/w/index.php?title=19_%D0%BD%D0%BE%D0%B5%D0%BC%D0%B2… and http://ru.wikipedia.org/w/index.php?title=%D0%93%D0%BB%D0%B0%D0%B7%D0%B3%D0… Discussing this on IRC it was thought to originate from a connection reset. My question was why the wiki would save a page that was not sent completely. This appears to have to do with sending an 'edit token' before the edit data. If possible, this should be reversed so these mistakes cannot happen (worst case is the edit is not made). IRC chat (freenode #pywikipediabot): [11:57] <siebrand> Bryan: big "oops": <URL at ru.wp> [11:58] <valhallasw> siebrand: looks like some connection reset [..] [11:58] <Bryan> what valhallasw said [..] [11:58] <Bryan> maybe we should change wikipedia.py such that it sends wpEditToken as last item [11:59] <Bryan> so stuff like this doesn't happen [11:59] <siebrand> Connection reset sounds logical, although, why would MediaWiki accept that? [11:59] <valhallasw> because connection closed is connection closed [11:59] <siebrand> ah, I see bryan explained that :) [12:00] <valhallasw> Bryan: sounds like a good idea in any case :) [12:00] <siebrand> indeed the bot needs to signal in some way that it is actually "done submitting" before the wiki accepts its changes. If that is the "edit token", then it may be a good idea to send that as the last item. [12:00] <valhallasw> well, mediawiki won't accept an edit without edit token [12:00] <valhallasw> and it has no way to check if the complete request has been sent [12:00] <valhallasw> so the only way to prevent saving is sending some required header last [12:01] <valhallasw> Bryan: are we not using some content-length header? that should fix the problem, too [12:01] <Bryan> no idea ---------------------------------------------------------------------- >Comment By: Bryan (btongminh) Date: 2007-11-23 23:36 Message: Logged In: YES user_id=1806226 Originator: NO I looked some more into this and the problem seems that you can't rely on the server to send the Content-Length header. Something else that might be worthwhile is to have the gzip module raise an error if the content is incomplete. ---------------------------------------------------------------------- Comment By: Bryan (btongminh) Date: 2007-11-19 21:42 Message: Logged In: YES user_id=1806226 Originator: NO Reopened: Fix only works when using persistent_http = True. A similar solution must come up for persistent_http = False. ---------------------------------------------------------------------- Comment By: Bryan (btongminh) Date: 2007-11-15 20:18 Message: Logged In: YES user_id=1806226 Originator: NO Fixed in r4560. ---------------------------------------------------------------------- Comment By: Bryan (btongminh) Date: 2007-11-15 19:12 Message: Logged In: YES user_id=1806226 Originator: NO Since it is also happening to SieBot, I assume that it is an error in the framework. I think that it originates from the function that gets the data from the server. As valhallasw points out, the server would just reject incomplete postdata, as we do set content-length. The last character from http://ru.wikipedia.org/w/index.php?title=%D0%93%D0%BB%D0%B0%D0%B7%D0%B3%D0… is '\xef\xbf\xbd' or u'\ufffd', more commonly known 'Unicode replace character'. This character is inserted when an invalid unicode sequence is read. I think we should very thoroughly look at the get routines and add more checks, such as a check for content-length, in order to prevent stuff like this from happening. ---------------------------------------------------------------------- Comment By: siebrand (siebrand) Date: 2007-11-15 13:49 Message: Logged In: YES user_id=1107255 Originator: YES Two more: http://es.wikipedia.org/w/index.php?title=Argentina&curid=10&diff=12811540&… http://es.wikipedia.org/w/index.php?title=Argentina&curid=10&diff=12811713&… ---------------------------------------------------------------------- Comment By: siebrand (siebrand) Date: 2007-11-15 10:50 Message: Logged In: YES user_id=1107255 Originator: YES A very recent one: http://it.wikipedia.org/w/index.php?title=Discussione:Socialdemocrazia&diff… ---------------------------------------------------------------------- Comment By: siebrand (siebrand) Date: 2007-11-15 08:51 Message: Logged In: YES user_id=1107255 Originator: YES Additional report: http://fr.wikipedia.org/w/index.php?title=Guerre_de_Cent_Ans&diff=22942716&… ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1831698&group_…

1 0

← Newer
1
...
5
6
7
8
9
10
11
...
29
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l November 2007