Just a try: what happens for pywikibot.output(page.get()) instead of print?

2013/7/28 Adrián Chaves Fernández adriyetichaves@gmail.com

I have written the following script:

# -*- coding: utf-8 -*-

import pywikibot

site = pywikibot.Site("gl", "wiktionary") page = pywikibot.Page(site, u"𐌰𐌽𐌳𐌰𐌿𐍂𐌰") print page.get()

It fails with the following output:

[gallaecio@afonso fontes]$ python2 test.py Traceback (most recent call last): File "test.py", line 7, in <module> print page.get() File "/usr/lib/python2.7/site-packages/pywikibot/__init__.py", line 249, in wrapper return method(*__args, **__kw) File "/usr/lib/python2.7/site-packages/pywikibot/__init__.py", line 249, in wrapper return method(*__args, **__kw) File "/usr/lib/python2.7/site-packages/pywikibot/page.py", line 278, in get self._getInternals(sysop) File "/usr/lib/python2.7/site-packages/pywikibot/page.py", line 302, in _getInternals self.site.loadrevisions(self, getText=True, sysop=sysop) File "/usr/lib/python2.7/site-packages/pywikibot/page.py", line 96, in site return self._link.site File "/usr/lib/python2.7/site-packages/pywikibot/page.py", line 3080, in site self.parse() File "/usr/lib/python2.7/site-packages/pywikibot/page.py", line 3037, in parse u"contains illegal char(s) '%s'" % m.group(0)) pywikibot.exceptions.InvalidTitle: contains illegal char(s) '𐌰'

---

Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Hi Adrián,

On 28 July 2013 09:01, Adrián Chaves Fernández adriyetichaves@gmail.comwrote:

page = pywikibot.Page(site, u"𐌰𐌽𐌳𐌰𐌿𐍂𐌰")

The problem is with our detection of illegal titles - it only OK's characters up to \uFFFF (i.e. the BMP[1]), which does not include Gothic, which is in the SMP[2]. I've changed our whitelist (which whitelisted up to \uFFFF) to a blacklist in https://gerrit.wikimedia.org/r/78525 , which should fix this issue.

[1] https://en.wikipedia.org/wiki/Plane_(Unicode)#Basic_Multilingual_Plane [2] https://en.wikipedia.org/wiki/Plane_(Unicode)#Supplementary_Multilingual_Pla...

Best, Merlijn