Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

List overview All Threads
Download

newer

older

Picasa batch upload script

Re: [Pywikipedia-l] Using...

Merlijn van Deen

26 Mar 2012 26 Mar '12

12:06 a.m.

On 26 March 2012 02:01, <valhallasw(a)svn.wikimedia.org> wrote:

...

Revision: 10043 Author: valhallasw Date: 2012-03-26 00:01:16 +0000 (Mon, 26 Mar 2012) Log Message: -----------

(...)

...

Behavioural change: windows now either inputs/outputs ascii (without ctypes) or full unicode (with ctypes). Yes, no more chcp crap!

Update to r10043 to feel the magic! (I have tested windows XP using python 2.5.4 and 2.7.2 and linux using python 2.7.1. Unicode command-line arguments are not supported (yet), as this requires reworking all sys.argv to pywikipedia-managed code. If stuff breaks, go back to r10042 and send an e-mail). Best, Merlijn

Show replies by date

Merlijn van Deen

26 Mar 26 Mar

12:16 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 26 March 2012 02:06, Merlijn van Deen <valhallasw(a)arctus.nl> wrote:

...

Update to r10043 to feel the magic!

Make that r10044. Merlijn

Bináris

6:15 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

My bot on Hungarian toolserver is broken. First script: Traceback (most recent call last): File "pywikipedia/frissdump.py", line 43, in <module> pywikibot.output(u'A legfrissebb dump dĂĄtuma: ' + friss) File "/home/binaris/pywikipedia/wikipedia.py", line 7986, in output ui.output(text, toStdout = toStdout) File "/home/binaris/pywikipedia/userinterfaces/terminal_interface_base.py", line 102, in output self._print(text, targetStream) File "/home/binaris/pywikipedia/userinterfaces/terminal_interface_base.py", line 59, in _print self.printNonColorized(text, targetStream) File "/home/binaris/pywikipedia/userinterfaces/terminal_interface_base.py", line 51, in printNonColorized targetStream.write(line.encode(self.encoding, 'replace')) AttributeError: UnixUI instance has no attribute 'encoding' Second script: Traceback (most recent call last): File "pywikipedia/toc.py", line 124, in <module> pywikibot.output('Initializing (getting month names takes a while)') File "/home/binaris/pywikipedia/wikipedia.py", line 7986, in output ui.output(text, toStdout = toStdout) File "/home/binaris/pywikipedia/userinterfaces/terminal_interface_base.py", line 102, in output self._print(text, targetStream) File "/home/binaris/pywikipedia/userinterfaces/terminal_interface_base.py", line 59, in _print self.printNonColorized(text, targetStream) File "/home/binaris/pywikipedia/userinterfaces/terminal_interface_base.py", line 51, in printNonColorized targetStream.write(line.encode(self.encoding, 'replace')) AttributeError: UnixUI instance has no attribute 'encoding' Version.py: Pywikipedia [http] trunk/pywikipedia (r10045, 2012/03/26, 00:17:53) Python 2.7.2+ (default, Aug 16 2011, 09:23:59) [GCC 4.6.1] config-settings: use_api = True use_api_login = True unicode test: ok Linux version 2.6.32-5-openvz-amd64 (Debian 2.6.32-39squeeze1) ( dannf(a)debian.org) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Mon Jan 9 21:16:36 UTC 2012 -- Bináris

Merlijn van Deen

8:15 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

2012/3/26 Bináris <wikiposta(a)gmail.com>om>:

...

My bot on Hungarian toolserver is broken. First script: Traceback (most recent call last): File "/home/binaris/pywikipedia/userinterfaces/terminal_interface_base.py", line 51, in printNonColorized

Oops. Even with all the different versions, I had not tested with all the different config options, such as config.colorized_output. This is fixed in r10046, as well as a related win32 bug. Thanks for reporting! Merlijn

Bináris

8:21 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

Thanks. *Replace.py* is broken totally. I am not sure it is connected to this, but nothing else has been changed. Whatever I press in replace (yes, no, browser, edit, quit) it is NOT DONE, and an additional enter has to be pressed, after what the bot shows the next article to be corrected. It edits nothing, launches nothing. Quitting can be done by ctrl C. -- Bináris

Merlijn van Deen

8:29 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 26 March 2012 10:21, Bináris <wikiposta(a)gmail.com> wrote:

...

Whatever I press in replace (yes, no, browser, edit, quit) it is NOT DONE, and an additional enter has to be pressed, after what the bot shows the next article to be corrected. It edits nothing, launches nothing. Quitting can be done by ctrl C.

Windows? Linux? If it's on windows, it's the second bug I fixed in r10046, which caused a double readline() - and only the second one was interpreted. If it's on Linux... no clue. Could you press ctrl-c in the input window and mail the stack trace? Sigh. This is what you get when you edit code without automated tests ;-) Merlijn

Bináris

8:49 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

2012/3/26 Merlijn van Deen <valhallasw(a)arctus.nl>

...

Windows? Linux? If it's on windows, it's the second bug I fixed in r10046, which caused a double readline() - and only the second one was interpreted.

This one was Windows, and both problems corrected successfully, thanks. I am afraid to ask, what is the magic I should see? -- Bináris

Merlijn van Deen

8:56 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 26 March 2012 10:49, Bináris <wikiposta(a)gmail.com> wrote:

...

This one was Windows, and both problems corrected successfully, thanks. I am afraid to ask, what is the magic I should see?

It solves your € sign problem. In addition, the bot should now output <russian, hebrew, hindi, ...> without any yellow texts. For instance, interwiki.py now outputs: [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[bn:দিবালোক সংরক্ষণ সময় ]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[yi:זומער זייגער]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[de:Sommerzeit]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[uk:Літній час]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[ba:Йәйге ваҡыт]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[hr:Ljetno računanje vre mena]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[da:Sommertid]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[be:Летні час]] [[nl:Zomertijd]]: [[nl:Zomertijd]] gives new interwiki [[pt:Horário de verão]] Best, Merlijn

Merlijn van Deen

8:58 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 26 March 2012 10:56, Merlijn van Deen <valhallasw(a)arctus.nl> wrote:

...

It solves your € sign problem. In addition, the bot should now output <russian, hebrew, hindi, ...> without any yellow texts. For instance, interwiki.py now outputs:

(on windows - this is not news for unix, of course). Screenshot: http://i.imgur.com/H92Or.png Merlijn

Bináris

9:07 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

2012/3/26 Merlijn van Deen <valhallasw(a)arctus.nl>

...

It solves your € sign problem.

Not really. :-((( This was the first I have tried. The attached screenshot shows the yesterday and the today state each under other (as the window was left open for night fortunately). Euro is still ? and yen became a simple Y. -- Bináris

Merlijn van Deen

9:30 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 26 March 2012 11:07, Bináris <wikiposta(a)gmail.com> wrote:

...

Try switching your font for the console (from 'raster fonts' to 'lucida console', or better yet: consolas) (right-click on the icon on the top left, properties, fonts). Merlijn

Bináris

9:37 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

2012/3/26 Merlijn van Deen <valhallasw(a)arctus.nl>

...

Try switching your font for the console (from 'raster fonts' to 'lucida console', or better yet: consolas) (right-click on the icon on the top left, properties, fonts).

This one works, Thank you!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! You earned a beer whenever we meet. :-) -- Bináris

Andre Engels

9:43 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

n Mon, Mar 26, 2012 at 11:30 AM, Merlijn van Deen <valhallasw(a)arctus.nl> wrote:

...

On 26 March 2012 11:07, Bináris <wikiposta(a)gmail.com> wrote:

Try switching your font for the console (from 'raster fonts' to 'lucida console', or better yet: consolas) (right-click on the icon on the top left, properties, fonts).

I had multiple problems on Windows too, but those seem to have been resolved with your advise. We should really be putting this somewhere noticeable for people using Windows, if only I had known this before... -- André Engels, andreengels(a)gmail.com

Bináris

9:53 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

2012/3/26 Andre Engels <andreengels(a)gmail.com>

...

Soemwhere under http://www.mediawiki.org/wiki/Manual:Pywikipediabot (I have already written it to Hungarian version but now I have to leave). -- Bináris

Merlijn van Deen

11:32 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 26 March 2012 11:43, Andre Engels <andreengels(a)gmail.com> wrote:

...

I've been playing around with some more Windows API functions. For Vista and above, we could detect the font (and set it or emit a warning); this is not possible for XP (and I don't have a Vista+ windows computer available at the moment). Best, Merlijn

Bináris

27 Mar 27 Mar

7:29 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

Please try this command without saving: replace.py -lang:hu -page:Stereopony Kiszecu kiszecu I see a lot of rectangles in ''Szajonara no Kiszecu''|さよならの季節}} (but copied from DOS screen to here it appears correctly). Is that intentional? -- Bináris

Merlijn van Deen

8:28 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 27 March 2012 09:29, Bináris <wikiposta(a)gmail.com> wrote:

...

They are displayed this way because the font doesn't have these glyphs. Choosing another font (which is difficult for cmd, but possible [1]) which does have these glyphs would fix it. However, I think copyable squares that work when you paste them in a browser are more useful than transliterated text. Best, Merlijn [1] http://www.johndcook.com/blog/2009/07/24/windows-console-fonts/

Bináris

9:17 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

2012/3/27 Merlijn van Deen <valhallasw(a)arctus.nl>

...

However, I think copyable squares that work when you paste them in a browser are more useful than transliterated text.

OK. thanks. Alltogether it is much better now (especially that I can type accented letters freely). -- Bináris

Bináris

12 Apr 12 Apr

10:29 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

Merlijn, do you think this may be connected to this complaint of Jan Dudík or are they independent? https://www.mediawiki.org/wiki/Pywikipediabot/Survey2012#ISO_8859-2 I really DO hate all character encoding problems. This is the biggest mess of informatics. :-( -- Bináris

Merlijn van Deen

16 Apr 16 Apr

9:52 a.m.

New subject: [Pywikipedia-svn] SVN: [10043] trunk/pywikipedia/userinterfaces

On 12 April 2012 12:29, Bináris <wikiposta(a)gmail.com> wrote:

...

Merlijn, do you think this may be connected to this complaint of Jan Dudík or are they independent? https://www.mediawiki.org/wiki/Pywikipediabot/Survey2012#ISO_8859-2

That complaint is fixed now (I confirmed his problem; my solution works for all the more recent python versions)

...

I really DO hate all character encoding problems. This is the biggest mess of informatics. :-(

It's not that bad - it's just the backwards compatibility (and thus the windows console) that sucks. best, Merlijn

4393

days inactive

4414

days old

pywikipedia-l@lists.wikimedia.org

Manage subscription

19 comments

3 participants

tags (0)

participants (3)

Andre Engels
Bináris
Merlijn van Deen