Pywikipedia-l November 2007

pywikipedia-l@lists.wikimedia.org

29 participants
285 discussions

[ pywikipediabot-Bugs-1740863 ] pagefromfile.py -summary:xyz does not work any more
by SourceForge.net 20 Nov '07

20 Nov '07

Bugs item #1740863, was opened at 2007-06-21 13:16 Message generated for change (Settings changed) made by cosoleto You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1740863&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: other Group: None >Status: Closed >Resolution: Fixed Priority: 5 Private: No Submitted By: Purodha B Blissenbach (purodha) Assigned to: Nobody/Anonymous (nobody) Summary: pagefromfile.py -summary:xyz does not work any more Initial Comment: "pagefromfile.py -summary:xyz" does not work any more. Rather, the standard message is used for newly generated pages. Note, bug #1736292 has a patch re-enabling it. ---------------------------------------------------------------------- Comment By: Francesco Cosoleto (cosoleto) Date: 2007-10-01 20:17 Message: Logged In: YES user_id=181280 Originator: NO Fixed in r4397. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1740863&group_…

1 0

SVN: [4576] trunk/pywikipedia/family.py
by rotem＠svn.wikimedia.org 20 Nov '07

20 Nov '07

Revision: 4576 Author: rotem Date: 2007-11-20 12:18:01 +0000 (Tue, 20 Nov 2007) Log Message: ----------- mowiki was closed, it should probably not be used as a hint. Modified Paths: -------------- trunk/pywikipedia/family.py Modified: trunk/pywikipedia/family.py =================================================================== --- trunk/pywikipedia/family.py 2007-11-19 20:36:34 UTC (rev 4575) +++ trunk/pywikipedia/family.py 2007-11-20 12:18:01 UTC (rev 4576) @@ -2322,7 +2322,7 @@ # languages that use the cyrillic alphabet 'cyril': [ 'ab', 'ba', 'be', 'be-x-old', 'bg', 'ce', 'cv', 'kk', 'kv', 'ky', 'mk', - 'mn', 'mo', 'os', 'ru', 'sr', 'tg', 'tk', 'udm', 'uk', 'xal' + 'mn', 'os', 'ru', 'sr', 'tg', 'tk', 'udm', 'uk', 'xal' ], 'scand': [ 'da', 'fo', 'is', 'nb', 'no', 'sv'

1 0

[ pywikipediabot-Bugs-1831698 ] Partial pages saved on connection reset
by SourceForge.net 19 Nov '07

19 Nov '07

Bugs item #1831698, was opened at 2007-11-14 11:44 Message generated for change (Comment added) made by btongminh You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1831698&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: General Group: None >Status: Open Resolution: Fixed Priority: 8 Private: No Submitted By: siebrand (siebrand) Assigned to: Nobody/Anonymous (nobody) Summary: Partial pages saved on connection reset Initial Comment: I have gotten 2 reports of CommonsDelinker saving incomplete pages: http://bg.wikipedia.org/w/index.php?title=19_%D0%BD%D0%BE%D0%B5%D0%BC%D0%B2… and http://ru.wikipedia.org/w/index.php?title=%D0%93%D0%BB%D0%B0%D0%B7%D0%B3%D0… Discussing this on IRC it was thought to originate from a connection reset. My question was why the wiki would save a page that was not sent completely. This appears to have to do with sending an 'edit token' before the edit data. If possible, this should be reversed so these mistakes cannot happen (worst case is the edit is not made). IRC chat (freenode #pywikipediabot): [11:57] <siebrand> Bryan: big "oops": <URL at ru.wp> [11:58] <valhallasw> siebrand: looks like some connection reset [..] [11:58] <Bryan> what valhallasw said [..] [11:58] <Bryan> maybe we should change wikipedia.py such that it sends wpEditToken as last item [11:59] <Bryan> so stuff like this doesn't happen [11:59] <siebrand> Connection reset sounds logical, although, why would MediaWiki accept that? [11:59] <valhallasw> because connection closed is connection closed [11:59] <siebrand> ah, I see bryan explained that :) [12:00] <valhallasw> Bryan: sounds like a good idea in any case :) [12:00] <siebrand> indeed the bot needs to signal in some way that it is actually "done submitting" before the wiki accepts its changes. If that is the "edit token", then it may be a good idea to send that as the last item. [12:00] <valhallasw> well, mediawiki won't accept an edit without edit token [12:00] <valhallasw> and it has no way to check if the complete request has been sent [12:00] <valhallasw> so the only way to prevent saving is sending some required header last [12:01] <valhallasw> Bryan: are we not using some content-length header? that should fix the problem, too [12:01] <Bryan> no idea ---------------------------------------------------------------------- >Comment By: Bryan (btongminh) Date: 2007-11-19 21:42 Message: Logged In: YES user_id=1806226 Originator: NO Reopened: Fix only works when using persistent_http = True. A similar solution must come up for persistent_http = False. ---------------------------------------------------------------------- Comment By: Bryan (btongminh) Date: 2007-11-15 20:18 Message: Logged In: YES user_id=1806226 Originator: NO Fixed in r4560. ---------------------------------------------------------------------- Comment By: Bryan (btongminh) Date: 2007-11-15 19:12 Message: Logged In: YES user_id=1806226 Originator: NO Since it is also happening to SieBot, I assume that it is an error in the framework. I think that it originates from the function that gets the data from the server. As valhallasw points out, the server would just reject incomplete postdata, as we do set content-length. The last character from http://ru.wikipedia.org/w/index.php?title=%D0%93%D0%BB%D0%B0%D0%B7%D0%B3%D0… is '\xef\xbf\xbd' or u'\ufffd', more commonly known 'Unicode replace character'. This character is inserted when an invalid unicode sequence is read. I think we should very thoroughly look at the get routines and add more checks, such as a check for content-length, in order to prevent stuff like this from happening. ---------------------------------------------------------------------- Comment By: siebrand (siebrand) Date: 2007-11-15 13:49 Message: Logged In: YES user_id=1107255 Originator: YES Two more: http://es.wikipedia.org/w/index.php?title=Argentina&curid=10&diff=12811540&… http://es.wikipedia.org/w/index.php?title=Argentina&curid=10&diff=12811713&… ---------------------------------------------------------------------- Comment By: siebrand (siebrand) Date: 2007-11-15 10:50 Message: Logged In: YES user_id=1107255 Originator: YES A very recent one: http://it.wikipedia.org/w/index.php?title=Discussione:Socialdemocrazia&diff… ---------------------------------------------------------------------- Comment By: siebrand (siebrand) Date: 2007-11-15 08:51 Message: Logged In: YES user_id=1107255 Originator: YES Additional report: http://fr.wikipedia.org/w/index.php?title=Guerre_de_Cent_Ans&diff=22942716&… ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1831698&group_…

1 0

SVN: [4575] trunk/pywikipedia/clean_sandbox.py
by warddr＠svn.wikimedia.org 19 Nov '07

19 Nov '07

Revision: 4575 Author: warddr Date: 2007-11-19 20:36:34 +0000 (Mon, 19 Nov 2007) Log Message: ----------- added italian version, Kaloo 123 (JIRA) asked it at [pywikipedia-l]. Modified Paths: -------------- trunk/pywikipedia/clean_sandbox.py Modified: trunk/pywikipedia/clean_sandbox.py =================================================================== --- trunk/pywikipedia/clean_sandbox.py 2007-11-18 21:11:12 UTC (rev 4574) +++ trunk/pywikipedia/clean_sandbox.py 2007-11-19 20:36:34 UTC (rev 4575) @@ -29,6 +29,7 @@ 'de': u'{{Bitte erst NACH dieser Zeile schreiben! (Begrüßungskasten)}}\r\n', 'en': u'{{Please leave this line alone (sandbox heading)}}\n ', 'he': u'{{ארגז חול}}\n', + 'it': u'{{sandbox}} ', 'ko': u'{{연습장 안내문}}', 'nl': u'{{subst:Wikipedia:Zandbak/schoon zand}}', 'no': u'{{Sandkasse}}\n}}', @@ -43,6 +44,7 @@ 'de': u'Bot: Setze Seite zurück.', 'en': u'Robot: This page will automatically be cleaned.', 'he': u'בוט: דף זה ינוקה אוטומטית.', + 'it': u'Bot: pulitura sandbox', 'ja': u'BOT: 砂場ならし', 'ko': u'로봇: 연습장 비움', 'nl': u'Robot: Automatisch voorzien van schoon zand.', @@ -57,6 +59,7 @@ 'de': u'Wikipedia:Spielwiese', 'en': u'Wikipedia:Sandbox', 'he': u'ויקיפדיה:ארגז חול', + 'it': u'Project:Sandbox', 'ko': u'위키백과:연습장', 'nl': u'Wikipedia:Zandbak', 'no': u'Wikipedia:Sandkasse',

1 0

[ pywikipediabot-Bugs-1834705 ] redirect.py doesn't use localized version of #REDIRECT
by SourceForge.net 19 Nov '07

19 Nov '07

Bugs item #1834705, was opened at 2007-11-19 18:35 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1834705&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: other Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: André Malafaya Baptista (malafaya) Assigned to: Nobody/Anonymous (nobody) Summary: redirect.py doesn't use localized version of #REDIRECT Initial Comment: replace.py always uses the magic word #REDIRECT when resolving double-redirects. I tried it on a page which had a localized version of the #REDIRECT magic word and the changes suggested by it include replacing the already localized version back to #REDIRECT . The affected language (ka) has #REDIRECT localized in family.py. I believe the problem in at line 288 of redirect.py where you can find #REDIRECT hard-coded. Thanks. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1834705&group_…

1 0

Whatever happened to understanding accented letters in commands?
by Damokos Bence 19 Nov '07

19 Nov '07

HI! I'm having the following problem, with the newer versions of Pywikipediabot: Previously if you entered a command, that included special characters (like éáúüöó), the bot would execute it finely (maybe except the letters ű and ő), now, it doesn't seem to do anymore. For example, this command would have just run fine without error previously, and now it results in the following errors: C:\p>category.py move -from:"Nemzeti labdarúgó szövetségek" -to:"Nemzeti labdarúgó-szövetségek" Checked for running processes. 1 processes currently running, including the current process. Getting Kategória:Nemzeti labdarˇg? sz÷vets?gek <http://botwiki.sno.cc/w/index.php?title=Kateg%C3%B3ria:Nemzeti_labdar%CB%87…> ... Target link 'wikt:Kategória:Nemzeti_labdarˇg?_sz÷vets?gek' has different family 'wikt' Getting 1 pages from wikipedia:hu... Getting 1 pages from wiktionary:hu... ERROR: <http://botwiki.sno.cc/w/index.php?title=Speci%C3%A1lis:Search/Nemzeti_labda…> Speciális:Search/Nemzeti labdarˇg? sz÷vets?gek <http://botwiki.sno.cc/w/index.php?title=Speci%C3%A1lis:Search/Nemzeti_labda…> is not in category Kategória:Nemzeti labdarˇg? sz÷vets?gek! ERROR: <http://en.wiktionary.org/wiki/hu:Kateg%C3%B3ria:Nemzeti_labdar%CB%87g%3F_sz…> wiktionary:hu:Kategória:Nemzeti labdarˇg? sz÷vets?gek <http://en.wiktionary.org/wiki/hu:Kateg%C3%B3ria:Nemzeti_labdar%CB%87g%3F_sz…> is not in category Kategória:Nemzeti labdarˇg? sz÷vets?gek! There are no subcategories in category Kategória:Nemzeti labdarˇg? sz÷vets?gek Dumping to category.dump.bz2 , please wait... If I remember the trick was to set the console encoding to utf-8, but it doesn't seem to solve the problem anymore. I've asked for help on the Botwiki, but unfortunately Filnik, who was very helpful, couldn't help ( http://botwiki.sno.cc/wiki/Botwiki:Bot_helpboard#Whatever_happened_to_under… ) Your help is much appreciated, Regards, Dami [[hu:User:Bdamokos]]

1 0

[ pywikipediabot-Bugs-1831153 ] interwiki.py enters loop when getting pages from ru-sib:
by SourceForge.net 19 Nov '07

19 Nov '07

Bugs item #1831153, was opened at 2007-11-13 13:04 Message generated for change (Settings changed) made by leogregianin You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1831153&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None >Status: Pending >Resolution: Invalid Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki.py enters loop when getting pages from ru-sib: Initial Comment: interwiki.py keeps waiting for pages from ru-sib: and stalls. Here's the relevant log: Getting 1 pages from wikipedia:ru-sib... Traceback (most recent call last): File "C:\Bot\pywikipedia\wikipedia.py", line 2347, in run data = self.getData() File "C:\Bot\pywikipedia\wikipedia.py", line 2502, in getData response, data = self.site.postForm(address, predata) File "C:\Bot\pywikipedia\wikipedia.py", line 3719, in postForm raise ServerError(e) ServerError: (11001, 'getaddrinfo failed') DBG> got network error in _GetAll.run. Sleeping for 15 seconds... Traceback (most recent call last): File "C:\Bot\pywikipedia\wikipedia.py", line 2347, in run data = self.getData() File "C:\Bot\pywikipedia\wikipedia.py", line 2502, in getData response, data = self.site.postForm(address, predata) File "C:\Bot\pywikipedia\wikipedia.py", line 3719, in postForm raise ServerError(e) ServerError: (11001, 'getaddrinfo failed') DBG> got network error in _GetAll.run. Sleeping for 30 seconds... Traceback (most recent call last): File "C:\Bot\pywikipedia\wikipedia.py", line 2347, in run data = self.getData() File "C:\Bot\pywikipedia\wikipedia.py", line 2502, in getData response, data = self.site.postForm(address, predata) File "C:\Bot\pywikipedia\wikipedia.py", line 3719, in postForm raise ServerError(e) ServerError: (11001, 'getaddrinfo failed') DBG> got network error in _GetAll.run. Sleeping for 45 seconds... ---------------------------------------------------------------------- >Comment By: Leonardo Gregianin (leogregianin) Date: 2007-11-19 09:28 Message: Logged In: YES user_id=1136737 Originator: NO ru-sib already closing, see: http://meta.wikimedia.org/wiki/Proposals_for_closing_projects/Closure_of_Si… ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1831153&group_…

1 0

SVN: [4574] trunk/pywikipedia/maintenance/preferences.py
by btongminh＠svn.wikimedia.org 18 Nov '07

18 Nov '07

Revision: 4574 Author: btongminh Date: 2007-11-18 21:11:12 +0000 (Sun, 18 Nov 2007) Log Message: ----------- Add logging Modified Paths: -------------- trunk/pywikipedia/maintenance/preferences.py Modified: trunk/pywikipedia/maintenance/preferences.py =================================================================== --- trunk/pywikipedia/maintenance/preferences.py 2007-11-18 20:47:59 UTC (rev 4573) +++ trunk/pywikipedia/maintenance/preferences.py 2007-11-18 21:11:12 UTC (rev 4574) @@ -117,18 +117,35 @@ return s def set_all(keys, values, verbose = False): - import wikipedia, config + import wikipedia, config, time + + log = open('preferences.txt', 'w') + log.write('PREFERENCES\t%s\n' % time.gmtime()) + log.write('KEYS\t%s\n' % keys) + log.write('VALUES\t%s\n' % values) + for family in config.usernames: for lang in config.usernames[family]: - site = wikipedia.getSite(lang, family, persistent_http = True) - prefs = Preferences(site) - for key, value in zip(keys, values): - prev = unicode(prefs.get(key, '')) + try: if verbose: wikipedia.output(u"Setting '%s' on %s from '%s' to '%s'." % \ - (key, site, prev, value)) - prefs.set(key, value) - prefs.save() - site.conn.close() + (key, site, prev, value)) + set_for(lang, family) + except Exception, e: + output(u'Warning! An exception occured! %s: %s' % (e.__class__.__name__, str(e))) + log.write('FAILED\t%s\t%s\n' % (family, lang)) + else: + log.write('SUCCESS\t%s\t%s\n' % (family, lang)) + log.close() + +def set_for(lang, family): + site = wikipedia.getSite(lang, family, persistent_http = True) + prefs = Preferences(site) + for key, value in zip(keys, values): + prev = unicode(prefs.get(key, '')) + prefs.set(key, value) + prefs.save() + site.conn.close() + def main(): import wikipedia, config

1 0

SVN: [4573] trunk/pywikipedia/maintenance/preferences.py
by btongminh＠svn.wikimedia.org 18 Nov '07

18 Nov '07

Revision: 4573 Author: btongminh Date: 2007-11-18 20:47:59 +0000 (Sun, 18 Nov 2007) Log Message: ----------- fix getting site Modified Paths: -------------- trunk/pywikipedia/maintenance/preferences.py Modified: trunk/pywikipedia/maintenance/preferences.py =================================================================== --- trunk/pywikipedia/maintenance/preferences.py 2007-11-18 20:42:23 UTC (rev 4572) +++ trunk/pywikipedia/maintenance/preferences.py 2007-11-18 20:47:59 UTC (rev 4573) @@ -120,7 +120,7 @@ import wikipedia, config for family in config.usernames: for lang in config.usernames[family]: - site = wikipedia.getSite(family, lang, persistent_http = True) + site = wikipedia.getSite(lang, family, persistent_http = True) prefs = Preferences(site) for key, value in zip(keys, values): prev = unicode(prefs.get(key, '')) @@ -135,7 +135,7 @@ wikipedia.output(u'Warning! This script will set preferences on all configured accounts!') wikipedia.output(u'You have %s accounts configured.' % \ - len(map(len, filter(None, config.usernames.itervalues())))) + sum(map(len, filter(lambda key: bool(config.usernames[key]), config.usernames.iterkeys())))) if wikipedia.inputChoice(u'Do you wish to continue?', ['no', 'yes'], ['n', 'y'], 'n') == 'n': return

1 0

SVN: [4572] trunk/pywikipedia/wikipedia.py
by btongminh＠svn.wikimedia.org 18 Nov '07

18 Nov '07

Revision: 4572 Author: btongminh Date: 2007-11-18 20:42:23 +0000 (Sun, 18 Nov 2007) Log Message: ----------- More helpful family does not exist error message Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2007-11-18 15:07:02 UTC (rev 4571) +++ trunk/pywikipedia/wikipedia.py 2007-11-18 20:42:23 UTC (rev 4572) @@ -3389,7 +3389,7 @@ traceback.print_stack() sys.exit(1) else: - raise ValueError("Family does not exist") + raise ValueError("Family %s does not exist" % repr(fam)) return myfamily.Family()

1 0

← Newer
1
...
8
9
10
11
12
13
14
...
29
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l November 2007