[Labs-l] Scripts which adds template to articles created by ContentTranslation tool do not work on the grid

MarcoAurelio strigiwm at gmail.com
Fri Jun 16 17:03:50 UTC 2017


It's being some time I was not in the list and I've missed important
announcements for sure but last time I checked Python 3 was still not
supported by Labs. I mean, the shared pywikibot files where still in Python
2. Not sure if this is still the case but could you please try to run in on
the grid with python instead of python3 and see if that solves the issue?
Regards.

El El vie, 16 jun 2017 a las 18:16, Martin Urbanec <
martin.urbanec at wikimedia.cz> escribió:

> Hello,
>
> I have a script which should add a template to articles which are created
> by the ContentTranslation tool (the template has parameters which depends
> on language and revision which were used as the source one; this is the
> reason why I use separate script). It may be found at
> https://github.com/urbanecm/addPrekladCT/blob/master/addmissing.py. The
> script work perfectly on my local PC and on bastion host but I can't get it
> work on the grid.
>
> The script itself is run by *python3 addmissing.py -always
> -file:pages.txt -search:'-insource:/\{\{[Pp]řeklad/'* and require
> pages.txt file and preklads.txt file at
> https://tools.wmflabs.org/urbanecmbot/test/preklads.txt. The first
> contains pages that should be processed and act as the generator, the
> second one is something like a database with exact templates which should
> be inserted. Both files are as an example in the attachments.
>
> When I try to run it at toollabs bastion, all works as it should. When I
> send the script to grid, it do not work (see sample output below). Why? Can
> somebody help me with it?
>
> Thank you in advance,
> Martin Urbanec / Urbanecm
>
> ; Output
>
> urbanecm at tools-bastion-02 ~/Documents/cswiki/addPrekladCT
> $ cat test.sh
> python3 addmissing.py -always -file:pages.txt
> -search:'-insource:/\{\{[Pp]řeklad/'
> urbanecm at tools-bastion-02 ~/Documents/cswiki/addPrekladCT
> $ jsub bash test.sh
> Your job 6201363 ("bash") has been submitted
> urbanecm at tools-bastion-02 ~/Documents/cswiki/addPrekladCT
> $ qstat
> job-ID  prior   name       user         state submit/start at     queue
>                        slots ja-task-ID
>
> -----------------------------------------------------------------------------------------------------------------
> 6201363 0.30000 bash       urbanecm     r     06/16/2017 18:14:42
> task at tools-exec-1404.eqiad.wmf     1
> urbanecm at tools-bastion-02 ~/Documents/cswiki/addPrekladCT
> $ ls ~/bash.*
> /home/urbanecm/bash.err  /home/urbanecm/bash.out
> urbanecm at tools-bastion-02 ~/Documents/cswiki/addPrekladCT
> $ cat ~/bash.*
> Traceback (most recent call last):
>   File "addmissing.py", line 223, in <module>
>     main()
>   File "addmissing.py", line 183, in main
>     local_args = pywikibot.handle_args(args)
>   File "/shared/pywikipedia/core/pywikibot/bot.py", line 954, in
> handle_args
>     writeToCommandLogFile()
>   File "/shared/pywikipedia/core/pywikibot/bot.py", line 1128, in
> writeToCommandLogFile
>     command_log_file.write(s + os.linesep)
>   File "/usr/lib/python3.4/codecs.py", line 711, in write
>     return self.writer.write(data)
>   File "/usr/lib/python3.4/codecs.py", line 368, in write
>     data, consumed = self.encode(object, self.errors)
> UnicodeEncodeError: 'utf-8' codec can't encode character '\udcc5' in
> position 67: surrogates not allowed
> CRITICAL: Closing network session.
> <class 'UnicodeEncodeError'>
> urbanecm at tools-bastion-02 ~/Documents/cswiki/addPrekladCT
> $
> _______________________________________________
> Labs-l mailing list
> Labs-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/labs-l
>
-- 
M. A.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-l/attachments/20170616/60ce9155/attachment.html>


More information about the Labs-l mailing list