[ pywikipediabot-Bugs-3007179 ] UnicodeDecodeError in pywikibot/textlib.py - Pywikipedia-bugs

26 May 2010

Bugs item #3007179, was opened at 2010-05-26 08:18
Message generated for change (Comment added) made by silvonen
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=300717…

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: General
Group: None
Status: Open
Resolution: None
Priority: 7
Private: No
Submitted By: Mikko Silvonen (silvonen)
Assigned to: Nobody/Anonymous (nobody)
Summary: UnicodeDecodeError in pywikibot/textlib.py

Initial Comment:
...
  python interwiki.py -autonomous -log -lang:fi
-namespace:0 -start:"Japanin jeni" ...
======Post-processing [[fi:Japanin talousihme]]======
Updating links on page [[lt:Japonijos pokario ekonominis stebuklas]].
No changes needed
Updating links on page [[id:Keajaiban ekonomi Jepang pascaperang]].
No changes needed
Updating links on page [[en:Japanese post-war economic miracle]].
No changes needed
Updating links on page [[fi:Japanin talousihme]].
No changes needed
Updating links on page [[es:Milagro japonés]].
No changes needed
Updating links on page [[ja:??????]].
No changes needed
Updating links on page [[fr:Miracle économique japonais]].
No changes needed
Updating links on page [[bg:Yaponsko ikonomichesko chudo]].
No changes needed
Updating links on page [[ru:Yaponskoe èkonomicheskoe chudo]].
No changes needed
Getting 3 pages  from wikipedia:lad...
c:\svn\pywikipedia\family.py:3376: UnicodeWarning: Unicode equal comparison failed to
convert both arguments to Unicode - interpreting them as being unequal
  if ns not in namespaces:
Dump fi (wikipedia) appended.
Traceback (most recent call last):
  File "interwiki.py", line 2426, in <module>
    main()
  File "interwiki.py", line 2400, in main
    bot.run()
  File "interwiki.py", line 2160, in run
    self.queryStep()
  File "interwiki.py", line 2133, in queryStep
    self.oneQuery()
  File "interwiki.py", line 2129, in oneQuery
    subject.batchLoaded(self)
  File "interwiki.py", line 1340, in batchLoaded
    if page.isEmpty() and not page.isCategory():
  File "c:\svn\pywikipedia\wikipedia.py", line 1031, in isEmpty
    txt = removeCategoryLinks(txt, site = self.site())
  File "c:\svn\pywikipedia\pywikibot\textlib.py", line 529, in
removeCategoryLinks
    catNamespace = '|'.join(site.category_namespaces())
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 7:
ordinal not in range(128)

...
  python version.py Pywikipedia [http]
trunk/pywikipedia (r8215, 2010/05/26, 02:41:31)
Python 2.5.4 (r254:67916, Jan 29 2009, 12:02:11) [MSC v.1310 32 bit (Intel)]
config-settings:
use_api = True
use_api_login = True

----------------------------------------------------------------------

...
 Comment By: Mikko Silvonen (silvonen) Date:
2010-05-26 08:34

Message:
Some namespace names added to family.py in r8203 were not marked as
Unicode. See the attached patch.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=300717…