Bugs item #1817623, was opened at 2007-10-22 08:40
Message generated for change (Comment added) made by a_engels
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
>Status: Closed
>Resolution: Fixed
Priority: 5
Private: No
Submitted By: AnMaster (anmaster)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py crash "Language aa does not exist..."
Initial Comment:
$ python -O interwiki.py -start:! -whenneeded
Checked for running processes. 1 processes currently running, including the current process.
Missing main page name
NOTE: Number of pages queued is 0, trying to add 60 more.
Retrieving Allpages special page for gentoo:en from %21, namespace 0
Getting 60 pages from gentoo:en...
Sleeping for 27.1 seconds, 2007-10-22 08:37:17
NOTE: [[en:2005-08 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-09 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-10 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-11 Screenshots]] does not have any interwiki links
<snip>
NOTE: [[en:Admin Support Systems]] does not have any interwiki links
NOTE: [[en:Advanced Emerge World]] does not have any interwiki links
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
======Post-processing [[en:Ae-current-ebuilds]]======
Updating links on page [[en:Ae-current-ebuilds]].
No changes needed
Dump en (gentoo) saved
Traceback (most recent call last):
File "interwiki.py", line 1580, in ?
bot.run()
File "interwiki.py", line 1357, in run
self.queryStep()
File "interwiki.py", line 1336, in queryStep
subj.finish(self)
File "interwiki.py", line 904, in finish
site = wikipedia.getSite(code = siteCode)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 4922, in getSite
_sites[key] = Site(code=code, fam=fam, user=user, persistent_http=persistent_http)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 3566, in __init__
raise KeyError("Language %s does not exist in family %s"%(self.lang,self.family.name))
KeyError: 'Language aa does not exist in family gentoo'
And indeed gentoo-wiki.com does not have such a language.
----------------------------------------------------------------------
>Comment By: Andre Engels (a_engels)
Date: 2007-10-24 17:40
Message:
Logged In: YES
user_id=843018
Originator: NO
Solved this in interwiki.py (revision 4478). The reason I did not get the
same bug was that I forgot to use the -whenneeded option. -whenneeded used
family.knownlanguages to go through the languages that are not in
family.languages_by_size; this has now been changed to family.langs.keys()
which is usually adapted to the local language set.
----------------------------------------------------------------------
Comment By: AnMaster (anmaster)
Date: 2007-10-24 09:26
Message:
Logged In: YES
user_id=1370979
Originator: YES
my user-config.py:
mylang = 'en'
family = 'gentoo'
usernames['gentoo']['en'] = u'AnMasterBot'
console_encoding = 'utf-8'
cosmetic_changes = True
minthrottle = 30
maxthrottle = 35
put_throttle = 60
----------------------------------------------------------------------
Comment By: AnMaster (anmaster)
Date: 2007-10-24 09:24
Message:
Logged In: YES
user_id=1370979
Originator: YES
I have current version (last svn), and I checked that there are no obvious
errors in user-conig.py. Not sure what to check user-conig.py for though.
----------------------------------------------------------------------
Comment By: Andre Engels (a_engels)
Date: 2007-10-22 12:16
Message:
Logged In: YES
user_id=843018
Originator: NO
Works correctly for me:
<snip>
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
=====Post-processing [[en:Ae-current-ebuilds]]=====
=====Post-processing [[en:Advanced Emerge World]]=====
=====Post-processing [[en:Admin Support Systems]]=====
<snip>
Please:
1. Ensure you have a current version, at least of interwiki.py and
wikipedia.py, but preferably of the whole framework
2. Check your user-conig.py
And send a reaction back if that does not solve the problem.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…
Revision: 4478
Author: a_engels
Date: 2007-10-24 15:38:24 +0000 (Wed, 24 Oct 2007)
Log Message:
-----------
Use family.langs.keys() instead of family.knownlanguages for the 'not largest' languages of -whenneeded option. Solves bug 1817623.
Modified Paths:
--------------
trunk/pywikipedia/interwiki.py
Modified: trunk/pywikipedia/interwiki.py
===================================================================
--- trunk/pywikipedia/interwiki.py 2007-10-23 13:43:14 UTC (rev 4477)
+++ trunk/pywikipedia/interwiki.py 2007-10-24 15:38:24 UTC (rev 4478)
@@ -901,7 +901,7 @@
lclSite = self.originPage.site()
lclSiteDone = False
frgnSiteDone = False
- for siteCode in lclSite.family.languages_by_size + [s for s in lclSite.family.knownlanguages if (not s in lclSite.family.languages_by_size and not s in lclSite.family.obsolete)]:
+ for siteCode in lclSite.family.languages_by_size + [s for s in lclSite.family.langs.keys() if (not s in lclSite.family.languages_by_size and not s in lclSite.family.obsolete)]:
site = wikipedia.getSite(code = siteCode)
if (not lclSiteDone and site == lclSite) or (not frgnSiteDone and site != lclSite and new.has_key(site)):
if site == lclSite:
Bugs item #1817623, was opened at 2007-10-22 08:40
Message generated for change (Comment added) made by anmaster
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: Works For Me
Priority: 5
Private: No
Submitted By: AnMaster (anmaster)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py crash "Language aa does not exist..."
Initial Comment:
$ python -O interwiki.py -start:! -whenneeded
Checked for running processes. 1 processes currently running, including the current process.
Missing main page name
NOTE: Number of pages queued is 0, trying to add 60 more.
Retrieving Allpages special page for gentoo:en from %21, namespace 0
Getting 60 pages from gentoo:en...
Sleeping for 27.1 seconds, 2007-10-22 08:37:17
NOTE: [[en:2005-08 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-09 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-10 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-11 Screenshots]] does not have any interwiki links
<snip>
NOTE: [[en:Admin Support Systems]] does not have any interwiki links
NOTE: [[en:Advanced Emerge World]] does not have any interwiki links
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
======Post-processing [[en:Ae-current-ebuilds]]======
Updating links on page [[en:Ae-current-ebuilds]].
No changes needed
Dump en (gentoo) saved
Traceback (most recent call last):
File "interwiki.py", line 1580, in ?
bot.run()
File "interwiki.py", line 1357, in run
self.queryStep()
File "interwiki.py", line 1336, in queryStep
subj.finish(self)
File "interwiki.py", line 904, in finish
site = wikipedia.getSite(code = siteCode)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 4922, in getSite
_sites[key] = Site(code=code, fam=fam, user=user, persistent_http=persistent_http)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 3566, in __init__
raise KeyError("Language %s does not exist in family %s"%(self.lang,self.family.name))
KeyError: 'Language aa does not exist in family gentoo'
And indeed gentoo-wiki.com does not have such a language.
----------------------------------------------------------------------
>Comment By: AnMaster (anmaster)
Date: 2007-10-24 09:26
Message:
Logged In: YES
user_id=1370979
Originator: YES
my user-config.py:
mylang = 'en'
family = 'gentoo'
usernames['gentoo']['en'] = u'AnMasterBot'
console_encoding = 'utf-8'
cosmetic_changes = True
minthrottle = 30
maxthrottle = 35
put_throttle = 60
----------------------------------------------------------------------
Comment By: AnMaster (anmaster)
Date: 2007-10-24 09:24
Message:
Logged In: YES
user_id=1370979
Originator: YES
I have current version (last svn), and I checked that there are no obvious
errors in user-conig.py. Not sure what to check user-conig.py for though.
----------------------------------------------------------------------
Comment By: Andre Engels (a_engels)
Date: 2007-10-22 12:16
Message:
Logged In: YES
user_id=843018
Originator: NO
Works correctly for me:
<snip>
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
=====Post-processing [[en:Ae-current-ebuilds]]=====
=====Post-processing [[en:Advanced Emerge World]]=====
=====Post-processing [[en:Admin Support Systems]]=====
<snip>
Please:
1. Ensure you have a current version, at least of interwiki.py and
wikipedia.py, but preferably of the whole framework
2. Check your user-conig.py
And send a reaction back if that does not solve the problem.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…
Bugs item #1817623, was opened at 2007-10-22 08:40
Message generated for change (Comment added) made by anmaster
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
>Status: Open
Resolution: Works For Me
Priority: 5
Private: No
Submitted By: AnMaster (anmaster)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py crash "Language aa does not exist..."
Initial Comment:
$ python -O interwiki.py -start:! -whenneeded
Checked for running processes. 1 processes currently running, including the current process.
Missing main page name
NOTE: Number of pages queued is 0, trying to add 60 more.
Retrieving Allpages special page for gentoo:en from %21, namespace 0
Getting 60 pages from gentoo:en...
Sleeping for 27.1 seconds, 2007-10-22 08:37:17
NOTE: [[en:2005-08 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-09 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-10 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-11 Screenshots]] does not have any interwiki links
<snip>
NOTE: [[en:Admin Support Systems]] does not have any interwiki links
NOTE: [[en:Advanced Emerge World]] does not have any interwiki links
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
======Post-processing [[en:Ae-current-ebuilds]]======
Updating links on page [[en:Ae-current-ebuilds]].
No changes needed
Dump en (gentoo) saved
Traceback (most recent call last):
File "interwiki.py", line 1580, in ?
bot.run()
File "interwiki.py", line 1357, in run
self.queryStep()
File "interwiki.py", line 1336, in queryStep
subj.finish(self)
File "interwiki.py", line 904, in finish
site = wikipedia.getSite(code = siteCode)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 4922, in getSite
_sites[key] = Site(code=code, fam=fam, user=user, persistent_http=persistent_http)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 3566, in __init__
raise KeyError("Language %s does not exist in family %s"%(self.lang,self.family.name))
KeyError: 'Language aa does not exist in family gentoo'
And indeed gentoo-wiki.com does not have such a language.
----------------------------------------------------------------------
>Comment By: AnMaster (anmaster)
Date: 2007-10-24 09:24
Message:
Logged In: YES
user_id=1370979
Originator: YES
I have current version (last svn), and I checked that there are no obvious
errors in user-conig.py. Not sure what to check user-conig.py for though.
----------------------------------------------------------------------
Comment By: Andre Engels (a_engels)
Date: 2007-10-22 12:16
Message:
Logged In: YES
user_id=843018
Originator: NO
Works correctly for me:
<snip>
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
=====Post-processing [[en:Ae-current-ebuilds]]=====
=====Post-processing [[en:Advanced Emerge World]]=====
=====Post-processing [[en:Admin Support Systems]]=====
<snip>
Please:
1. Ensure you have a current version, at least of interwiki.py and
wikipedia.py, but preferably of the whole framework
2. Check your user-conig.py
And send a reaction back if that does not solve the problem.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…
Support Requests item #1813173, was opened at 2007-10-14 13:22
Message generated for change (Comment added) made by malafaya
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1813173&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Priority: 5
Private: No
Submitted By: André Malafaya Baptista (malafaya)
Assigned to: Nobody/Anonymous (nobody)
Summary: 'Title ... not found in list. Expected one of ...'
Initial Comment:
I'm constantly getting this message while processing [[en:Democratic Republic of the Congo]]:
---
Getting 1 pages from wikipedia:ka...
BUG>> title kongos demokratiuli respublika ([[ka:kongos demokratiuli respublika]]) not found in list
Expected one of: [[ka:kongos demokratiuli respublika?]]
---
The ka article (title is yellow/transliterated) existswithout the '?'. Why does the bot expect the page title to have that '?' at the end?
----------------------------------------------------------------------
>Comment By: André Malafaya Baptista (malafaya)
Date: 2007-10-24 00:14
Message:
Logged In: YES
user_id=1037345
Originator: YES
It seems interwiki.py itself is adding those invisible characters.
Take a look at:
http://en.wikipedia.org/w/index.php?title=Williamsburg%2C_Colorado&diff=166…
There you can see a first bot add (by Rei-bot) which adds a pt interwiki
with invisible character.
The next change by MalafayaBot happens after I manually correct one of the
interwikis by removing the invisible character.
----------------------------------------------------------------------
Comment By: Daniel Herding (wikipedian)
Date: 2007-10-14 23:48
Message:
Logged In: YES
user_id=880694
Originator: NO
This happens with titles that include invisible left-to-right or
right-to-left control characters. These are omitted in Special:Export or
something like that, I have forgotten what exactly happens.
----------------------------------------------------------------------
Comment By: André Malafaya Baptista (malafaya)
Date: 2007-10-14 14:05
Message:
Logged In: YES
user_id=1037345
Originator: YES
I think I got to a conclusion:
there seemed to be an invisible character in the ka interwiki in all
Wikipedias. After deleting and retyping the interwiki in English Wikipedia
(http://en.wikipedia.org/w/index.php?title=Democratic_Republic_of_the_Congo&…),
the bot now says there are 2 interwikis while processing: one plain title
and the other one with the yellow '?'.
The problem is that apparently when the bot fetches the page 'kongos
demokratiuli respublika?' it actually works and fetches the page 'kongos
demokratiuli respublika' (as if it were an implicit redirect).
Another problem is that the bot tries to replace the bad interwiki (the
one with '?') by the correct one (without it), MediaWiki detects 'no
changes' and just ignores the page update. So the incorrect interwiki will
still prevail until a major update to the page by the bot is made.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1813173&group_…
Revision: 4475
Author: russblau
Date: 2007-10-23 12:34:02 +0000 (Tue, 23 Oct 2007)
Log Message:
-----------
Clean up replaceCategoryInPlace()
Modified Paths:
--------------
trunk/pywikipedia/wikipedia.py
Modified: trunk/pywikipedia/wikipedia.py
===================================================================
--- trunk/pywikipedia/wikipedia.py 2007-10-21 14:58:06 UTC (rev 4474)
+++ trunk/pywikipedia/wikipedia.py 2007-10-23 12:34:02 UTC (rev 4475)
@@ -3089,11 +3089,10 @@
return text.strip()
def replaceCategoryInPlace(oldtext, oldcat, newcat, site=None):
- """Replace the category oldcat with the category newcat and then return
- the modified Wiki source.
+ """Replace the category oldcat with the category newcat and return
+ the modified text.
+
"""
- #Note that this doesn't work yet and it has some very strange side-effects.
-
if site is None:
site = getSite()
@@ -3111,10 +3110,14 @@
categoryR = re.compile(r'\[\[\s*(%s)\s*:\s*%s\s*((?:\|[^]]+)?\]\])'
% (catNamespace, title))
if newcat is None:
- text = replaceExcept(oldtext, categoryR, '', ['nowiki', 'comment', 'math', 'pre'])
+ text = replaceExcept(oldtext, categoryR, '',
+ ['nowiki', 'comment', 'math', 'pre'])
else:
- text = replaceExcept(oldtext, categoryR, '[[Category:%s\\2' % newcat.titleWithoutNamespace(), ['nowiki', 'comment', 'math', 'pre'])
- return text.strip()
+ text = replaceExcept(oldtext, categoryR,
+ '[[Category:%s\\2'
+ % newcat.titleWithoutNamespace(),
+ ['nowiki', 'comment', 'math', 'pre'])
+ return text
def replaceCategoryLinks(oldtext, new, site=None):
"""Replace the category links given in the wikitext given
Bugs item #1809216, was opened at 2007-10-08 11:17
Message generated for change (Comment added) made by swind_ja
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1809216&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: other
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: Update Message Translation
Initial Comment:
clean_sandbox.py :Add Japanese.
interwiki:Add Chinese and Japanese
----------------------------------------------------------------------
Comment By: Swind_ja (swind_ja)
Date: 2007-10-23 03:29
Message:
Logged In: YES
user_id=1919098
Originator: NO
Hello, I'm Swind_ja, a Japanese Wikipedian. I think that the following
translations are more suitable.
*clean_sandbox.py
'ja': u'BOT: 砂場ならし',
*interwiki.py
'ja': (u'BOTによる', u'追加', u'除去', u'変更'),
----------------------------------------------------------------------
Comment By: Leonardo Gregianin (leogregianin)
Date: 2007-10-11 02:14
Message:
Logged In: YES
user_id=1136737
Originator: NO
I don't understand Japanese and Chinese, somebody here could confirm this
translation?
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1809216&group_…
Bugs item #1817623, was opened at 2007-10-22 08:40
Message generated for change (Comment added) made by a_engels
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
>Status: Pending
>Resolution: Works For Me
Priority: 5
Private: No
Submitted By: AnMaster (anmaster)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py crash "Language aa does not exist..."
Initial Comment:
$ python -O interwiki.py -start:! -whenneeded
Checked for running processes. 1 processes currently running, including the current process.
Missing main page name
NOTE: Number of pages queued is 0, trying to add 60 more.
Retrieving Allpages special page for gentoo:en from %21, namespace 0
Getting 60 pages from gentoo:en...
Sleeping for 27.1 seconds, 2007-10-22 08:37:17
NOTE: [[en:2005-08 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-09 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-10 Screenshots]] does not have any interwiki links
NOTE: [[en:2005-11 Screenshots]] does not have any interwiki links
<snip>
NOTE: [[en:Admin Support Systems]] does not have any interwiki links
NOTE: [[en:Advanced Emerge World]] does not have any interwiki links
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
======Post-processing [[en:Ae-current-ebuilds]]======
Updating links on page [[en:Ae-current-ebuilds]].
No changes needed
Dump en (gentoo) saved
Traceback (most recent call last):
File "interwiki.py", line 1580, in ?
bot.run()
File "interwiki.py", line 1357, in run
self.queryStep()
File "interwiki.py", line 1336, in queryStep
subj.finish(self)
File "interwiki.py", line 904, in finish
site = wikipedia.getSite(code = siteCode)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 4922, in getSite
_sites[key] = Site(code=code, fam=fam, user=user, persistent_http=persistent_http)
File "/home/arvid/wikibots/gentoo-wiki/wikipedia.py", line 3566, in __init__
raise KeyError("Language %s does not exist in family %s"%(self.lang,self.family.name))
KeyError: 'Language aa does not exist in family gentoo'
And indeed gentoo-wiki.com does not have such a language.
----------------------------------------------------------------------
>Comment By: Andre Engels (a_engels)
Date: 2007-10-22 12:16
Message:
Logged In: YES
user_id=843018
Originator: NO
Works correctly for me:
<snip>
NOTE: [[en:Ae-current-ebuilds]] does not have any interwiki links
=====Post-processing [[en:Ae-current-ebuilds]]=====
=====Post-processing [[en:Advanced Emerge World]]=====
=====Post-processing [[en:Admin Support Systems]]=====
<snip>
Please:
1. Ensure you have a current version, at least of interwiki.py and
wikipedia.py, but preferably of the whole framework
2. Check your user-conig.py
And send a reaction back if that does not solve the problem.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1817623&group_…