https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
Web browser: --- Bug ID: 56524 Summary: pywikibot transliteration should support more scripts Product: Pywikibot Version: unspecified Hardware: All OS: All Status: NEW Severity: normal Priority: Unprioritized Component: General Assignee: Pywikipedia-bugs@lists.wikimedia.org Reporter: ebraminio@gmail.com Classification: Unclassified Mobile Platform: ---
https://github.com/wikimedia/pywikibot-core/blob/master/pywikibot/userinterf... should support more scripts like Korean, Chinese or ml. jQuery.ime https://github.com/wikimedia/jquery.ime/tree/master/rules transliteration keyboards can be used for developing it like https://github.com/wikimedia/jquery.ime/blob/master/rules/ml/ml-transliterat...
I am using output of code on my gadget http://www.wikidata.org/wiki/MediaWiki:Gadget-SimpleTransliterate.js (http://commons.wikimedia.org/wiki/File:Wikidata_Transliteration_Gadget.png) that is why I like it is be developed a little more
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
ebraminio ebraminio@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- Priority|Unprioritized |Lowest Severity|normal |enhancement
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
ebraminio ebraminio@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- CC| |andreengels@freemail.nl, | |andreengels@gmail.com, | |malafaya@clix.pt, | |valhallasw@arctus.nl
--- Comment #1 from ebraminio ebraminio@gmail.com --- CCing original authors of transliteration code per http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/userinterfaces... http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/userinterfaces...
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #2 from ebraminio ebraminio@gmail.com --- I've added http://www.wikidata.org/w/index.php?title=MediaWiki%3AGadget-SimpleTranslite... Malayalam, Gurmukhi, Gujarati and Oriya for my gadget.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #3 from ebraminio ebraminio@gmail.com --- This can be ported for Chinese support http://cpansearch.perl.org/src/KAWASAKI/Lingua-ZH-Romanize-Pinyin-0.23/
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #4 from Gerrit Notification Bot gerritadmin@wikimedia.org --- Change 97040 had a related patch set uploaded by Ladsgroup: Improving transliteration support
https://gerrit.wikimedia.org/r/97040
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
Gerrit Notification Bot gerritadmin@wikimedia.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |PATCH_TO_REVIEW
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #5 from Gerrit Notification Bot gerritadmin@wikimedia.org --- Change 97044 had a related patch set uploaded by Ladsgroup: Improving transliteration support
https://gerrit.wikimedia.org/r/97044
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #6 from Gerrit Notification Bot gerritadmin@wikimedia.org --- Change 97040 merged by jenkins-bot: Improving transliteration support
https://gerrit.wikimedia.org/r/97040
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #7 from Gerrit Notification Bot gerritadmin@wikimedia.org --- Change 97044 merged by jenkins-bot: Improving transliteration support
https://gerrit.wikimedia.org/r/97044
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
Amir Ladsgroup ladsgroup@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|PATCH_TO_REVIEW |RESOLVED Resolution|--- |FIXED
--- Comment #8 from Amir Ladsgroup ladsgroup@gmail.com --- Both of patches got merged.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
ebraminio ebraminio@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |REOPENED Resolution|FIXED |---
--- Comment #9 from ebraminio ebraminio@gmail.com --- Reopened for Chinese transliteration
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #10 from Amir Ladsgroup ladsgroup@gmail.com --- Can you give me list of Chinese characters that needed to be added to this list?
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #11 from Andre Klapper aklapper@wikimedia.org --- (For future reference, defining the exact scripts to be supported in a bug request is welcome. If it's just about "support more" than a report can easily get unfixable by comments broadening the scope of a bug report.)
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #12 from ebraminio ebraminio@gmail.com --- #c3
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #13 from Amir Ladsgroup ladsgroup@gmail.com --- I checked that source but I couldn't find the dictionary file, [1] syas there is file named CTLauBig5.tit, but there isn't. Can you tell me more precise about the dictionary?
[1] http://cpansearch.perl.org/src/KAWASAKI/Lingua-ZH-Romanize-Pinyin-0.23/lib/L...
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
ebraminio ebraminio@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- Summary|pywikibot transliteration |pywikibot transliteration |should support more scripts |should support chinese | |transliteration
--- Comment #14 from ebraminio ebraminio@gmail.com --- There is not a one-to-one "dictionary" there, that is why I CCd original writer of the transliteration. Also have a look at https://github.com/axgle/pinyin
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
zhuyifei1999 zhuyifei1999@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- CC| |zhuyifei1999@gmail.com
--- Comment #15 from zhuyifei1999 zhuyifei1999@gmail.com --- Created attachment 16327 --> https://bugzilla.wikimedia.org/attachment.cgi?id=16327&action=edit Python translation of https://github.com/axgle/pinyin
(In reply to [no longer active user] from comment #14)
There is not a one-to-one "dictionary" there, that is why I CCd original writer of the transliteration. Also have a look at https://github.com/axgle/pinyin
{{done}} translation of the four scripts to python. See attachment.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #16 from zhuyifei1999 zhuyifei1999@gmail.com ---
Created attachment 16327 [details] Python translation of https://github.com/axgle/pinyin
However there is some bug that caused 6651 Chinese characters getting 'zuo'.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #17 from Merlijn van Deen valhallasw@arctus.nl --- I suppose we can add this, but what's the intended use case? We support full unicode console output (and input, but transliteration is output-only) on all systems.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #18 from Gerrit Notification Bot gerritadmin@wikimedia.org --- Change 157498 had a related patch set uploaded by Zhuyifei1999: Improving transliteration support for Chinese
https://gerrit.wikimedia.org/r/157498
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
Gerrit Notification Bot gerritadmin@wikimedia.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|REOPENED |PATCH_TO_REVIEW
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #19 from zhuyifei1999 zhuyifei1999@gmail.com --- (In reply to Merlijn van Deen from comment #17)
I suppose we can add this, but what's the intended use case? We support full unicode console output (and input, but transliteration is output-only) on all systems.
Yes, that is indeed a hard question. Why do we still have transliteration.py?
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #20 from Gerrit Notification Bot gerritadmin@wikimedia.org --- Change 157498 merged by jenkins-bot: Improving transliteration support for Chinese
https://gerrit.wikimedia.org/r/157498
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
John Mark Vandenberg jayvdb@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|PATCH_TO_REVIEW |RESOLVED CC| |jayvdb@gmail.com Resolution|--- |FIXED
--- Comment #21 from John Mark Vandenberg jayvdb@gmail.com --- Reopen if there is more to be done.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
zhuyifei1999 zhuyifei1999@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |REOPENED Resolution|FIXED |---
--- Comment #22 from zhuyifei1999 zhuyifei1999@gmail.com --- (In reply to John Mark Vandenberg from comment #21)
Reopen if there is more to be done.
zh-hant (Traditional Chinese) needed.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #23 from Merlijn van Deen valhallasw@arctus.nl --- I will repeat my question:
I suppose we can add this, but what's the intended use case? We support full unicode console output (and input, but transliteration is output-only) on all systems.
/why/ is it needed?
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #24 from zhuyifei1999 zhuyifei1999@gmail.com --- (In reply to Merlijn van Deen from comment #23)
I will repeat my question:
I suppose we can add this, but what's the intended use case? We support full unicode console output (and input, but transliteration is output-only) on all systems.
/why/ is it needed?
I suppose, that when the output is somehow ASCII-limited (for some reason the log files by the grid engine on tool labs is an example of this), transliterated output could be more useful than a pile of question marks or other non-readable code.
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
--- Comment #25 from zhuyifei1999 zhuyifei1999@gmail.com --- Some transliteration data exist at https://www.wikidata.org/wiki/MediaWiki:Gadget-SimpleTransliterate.js
https://bugzilla.wikimedia.org/show_bug.cgi?id=56524
John Mark Vandenberg jayvdb@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugzilla.wikimedia. | |org/show_bug.cgi?id=73410
pywikipedia-bugs@lists.wikimedia.org