[Pywikipedia-l] [ pywikipediabot-Bugs-2770568 ] interwiki.py Error messages & more

[SourceForge.net]

Bugs item #2770568, was opened at 2009-04-17 14:40
Message generated for change (Tracker Item Submitted) made by tabazzz
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2770568&group_id=93107

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: TaBaZzz (tabazzz)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py Error messages & more

Initial Comment:
hello.

performing the following command on the hebrew wikipedia:
python interwiki.py -confirm תקשורת_נתונים

gives some error messages, and displaying lots of garbage (probably the coded contents of the article). here is the error message:

Getting 1 pages from wikipedia:he...
Traceback (most recent call last):
  File "/home/tal/pywikipedia/pagegenerators.py", line 790, in __iter__
    for loaded_page in self.preload(somePages):
  File "/home/tal/pywikipedia/pagegenerators.py", line 809, in preload
    wikipedia.getall(site, pagesThisSite)
  File "/home/tal/pywikipedia/wikipedia.py", line 3141, in getall
    _GetAll(site, pages, throttle, force).run()
  File "/home/tal/pywikipedia/wikipedia.py", line 2952, in run
    data = self.getData()
  File "/home/tal/pywikipedia/wikipedia.py", line 3124, in getData
    response, data = self.site.postForm(address, predata)
  File "/home/tal/pywikipedia/wikipedia.py", line 4580, in postForm
    cookies=self.cookies(sysop = sysop))
  File "/home/tal/pywikipedia/wikipedia.py", line 4638, in postData
    data = data.decode(self.encoding())
  File "/usr/lib64/python2.5/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xd7 in position 3131: unexpected end of data
'utf8' codec can't decode byte 0xd7 in position 3131: unexpected end of data

version:
Pywikipedia nightly:pywikipedia (r6611, Apr 16 2009, 15:41:15)
Python 2.5.1 (r251:54863, Jun 15 2008, 18:24:56) 
[GCC 4.3.0 20080428 (Red Hat 4.3.0-8)]


----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2770568&group_id=93107