Bugs item #3419295, was opened at 2011-10-06 12:14
Message generated for change (Tracker Item Submitted) made by tmasao
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3419295&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Masao Takaku (tmasao)
Assigned to: Nobody/Anonymous (nobody)
Summary: Python 2.4 incompatibile at wikipedia.py
Initial Comment:
Hi,
I've been using pywikipediabot for maintenance of categories and geocoding etc at my wiki site for half a year.
Thanks for this nifty tool.
I'm using trunk HEAD of pywikipedia bot library for my own script.
I noticed several recent updates are incompatible for Python 2.4.
For example: my script stopped with the following error:
====
Traceback (most recent call last):
File "createpage.py", line 22, in ?
import wikipedia as pywikibot
File "/home/masao/cvswork/savemlak/../pywikipedia/wikipedia.py", line 4422
% (len(pages), u'via API ' if site.has_api() and debug else u'', site))
^
SyntaxError: invalid syntax
===
Similar syntax error occurs at pywikibot/plural.py as well.
This error is caused by a new conditional expression introduced in Python 2.5.
cf. http://docs.python.org/whatsnew/2.5.html#pep-308
When I run my script under Python2.7, it works well.
If Python 2.4 is no longer supported, documentation is needed.
My running environment are as follows:
Pywikipedia [http] trunk/pywikipedia (r9587, 2011/10/05, 06:06:07)
Python 2.4.3 (#1, Sep 21 2011, 19:55:41)
[GCC 4.1.2 20080704 (Red Hat 4.1.2-51)]
config-settings:
use_api = True
use_api_login = True
unicode test: ok
Best Regards,
Masao
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3419295&group_…
Bugs item #3009336, was opened at 2010-05-30 23:34
Message generated for change (Comment added) made by russblau
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3009336&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: rewrite
Group: None
>Status: Pending
>Resolution: Works For Me
Priority: 5
Private: No
Submitted By: NicDumZ — Nicolas Dumazet (nicdumz)
Assigned to: Russell Blau (russblau)
Summary: badtoken: invalid token during Page.put
Initial Comment:
From time to time I get token errors
File "/home/nicdumz/python/dumzibot/statistics.py", line 24, in putNb
page.put(str(nb))
File "/home/nicdumz/.local/lib/python2.6/site-packages/pywikibot/page.py", line 767, in put
async, callback)
File "/home/nicdumz/.local/lib/python2.6/site-packages/pywikibot/page.py", line 726, in save
self._save(comment, minor, watchval, async, callback)
File "/home/nicdumz/.local/lib/python2.6/site-packages/pywikibot/page.py", line 749, in _save
raise pywikibot.PageNotSaved("%s: %s" %(link, err))
pywikibot.exceptions.PageNotSaved: [[Projet:Maritime/Total]]: badtoken: Invalid token
I (re-)activated debug output and will try to look more carefully for this error. The (ugly) script causing this is available at http://bitbucket.org/nicdumz/wikipedia-dumzibot/src/tip/statistics.py but it is clearly not doing anything crazy on the pywikibot side, other than what I included in the traceback.
----------------------------------------------------------------------
>Comment By: Russell Blau (russblau)
Date: 2011-10-05 13:42
Message:
Does this issue still exist? I haven't seen such errors.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3009336&group_…
Bugs item #3414669, was opened at 2011-09-27 21:50
Message generated for change (Comment added) made by xqt
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3414669&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: hiw (hiw)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py removing page text
Initial Comment:
Following edit on NL-disamb. page, the page got emptied, only the interwiki link remained. Interwiki.py should not have touched the page in the first place, since the interwiki link was already set earlier.
Diff-link: http://nl.wikipedia.org/w/index.php?title=Blankenbach&diff=next&oldid=10676…
Active Python on Microsoft Windows XP [Version 5.1.2600]
Pywikipedia [http] trunk/pywikipedia (r9558, 2011/09/25, 20:30:54)
Python 2.7.2 (default, Jun 24 2011, 12:21:10) [MSC v.1500 32 bit (Intel)]
config-settings:
use_api = True
use_api_login = True
unicode test: ok
----------------------------------------------------------------------
>Comment By: xqt (xqt)
Date: 2011-10-04 16:15
Message:
We cannot exclude empty category pages :(
----------------------------------------------------------------------
Comment By: xqt (xqt)
Date: 2011-10-03 21:23
Message:
r9580 prohibits editing empty pages. This should prevent problems but it
does not solve the bug itself.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 22:09
Message:
relevant wikitech-l thread:
http://lists.wikimedia.org/pipermail/wikitech-l/2011-September/055420.html
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 21:34
Message:
Confirmed on eowiki, 25 suspected pages
http://eo.wikipedia.org/w/index.php?title=Anton%C3%ADn_Kl%C3%A1%C5%A1tersk%…
Confirmed on simplewiki, 3 suspected pages
itwiki: no results
ptwiki: no results
dewiki: no results
frwiki: results, but all from the same antivandalism bot
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 21:14
Message:
Using the following query to find suspected edits...
select rc_cur_time, rc_user, rc_namespace, rc_title, rc_old_len,
rc_new_len from recentchanges left join user_groups on ug_user=rc_user
where rc_new_len < rc_old_len * 0.1 and ug_group = 'bot' and
rc_namespace=0;
(note: this will not find *all* bad edits, but at least some)...
http://nl.wikipedia.org/w/index.php?title=Alexander_Gottfried&diff=prev&old…http://nl.wikipedia.org/w/index.php?title=Angerapp&diff=27329689&oldid=1157…http://nl.wikipedia.org/w/index.php?title=Partjessnijder&diff=27331463&oldi…http://nl.wikipedia.org/w/index.php?title=Atax&diff=27330470&oldid=11968796http://nl.wikipedia.org/w/index.php?title=Medinilla&diff=27328890&oldid=110…http://nl.wikipedia.org/w/index.php?title=Merklin&diff=27330198&oldid=11821…http://nl.wikipedia.org/w/index.php?title=Pion&diff=27327730&oldid=14796262http://nl.wikipedia.org/w/index.php?title=Vossenplein&diff=27327943&oldid=1…http://nl.wikipedia.org/w/index.php?title=Walser&diff=27329293&oldid=118420…
so.. at least the specificity is good, even if the sensitivity is not.
I'll try and see what happens on different wikis. Hopefully this will give
some hint whether it's 1.18 related or not.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 20:39
Message:
At the moment: no. In theory, the special:export function could probably be
replaced by one or more API calls, but I have no reason to assume this
actually solves the problem...
----------------------------------------------------------------------
Comment By: hiw (hiw)
Date: 2011-09-29 04:58
Message:
Can you force the script to use API to get the page text?
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-28 21:47
Message:
I did some more testing, using
python interwiki.py -lang:de
-page:Blankenbach%20%28Begriffskl%C3%A4rung%29 -async -cleanup -auto
-async
note that these findings are not necessarily true for running on full
auto...
in this setup, the bot ALWAYS uses special:export to get page text. It
does use the API to write the pages. It only retrieves the pages ONCE, at
the start of the run.
sigh.
----------------------------------------------------------------------
Comment By: hiw (hiw)
Date: 2011-09-28 00:31
Message:
Pffff, I believe it was:
interwiki.py -all -async -cleanup -log -auto -start:
I would think I used -ns:0 also, nut sure.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:53
Message:
Question to both committer and myst: what was the exact command line you
were using?
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:49
Message:
Last note for tonight: quickly reviewing the diff to r9500 (2011-09-03) did
not yield anything really change. Note: I did this in one bunch. Reviewing
commits from the mailinglist one at a time might still be a good plan...
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:42
Message:
Last three edits of interwiki.py are all quite old:
------------------------------------------------------------------------
r9407 | xqt | 2011-07-16 23:35:06 +0200 (Sat, 16 Jul 2011) | 1 line
trailing space for list elements (readability)
------------------------------------------------------------------------
r9387 | amir | 2011-07-16 12:05:50 +0200 (Sat, 16 Jul 2011) | 1 line
adding fa for exception templates
------------------------------------------------------------------------
r9308 | xqt | 2011-06-24 19:14:40 +0200 (Fri, 24 Jun 2011) | 1 line
do not follow static redirects which means do not change the target links
like -noredirect does (with -cleanup option. -force removes that link -
maybe this should be fixed)
------------------------------------------------------------------------
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:37
Message:
This has also happened with Myst's bot on simplewiki:
http://simple.wikipedia.org/w/index.php?title=Mettau%2C_Switzerland&action=…
Increasing priority, rephrased title.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3414669&group_…
Bugs item #3414669, was opened at 2011-09-27 21:50
Message generated for change (Comment added) made by xqt
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3414669&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
>Priority: 5
Private: No
Submitted By: hiw (hiw)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py removing page text
Initial Comment:
Following edit on NL-disamb. page, the page got emptied, only the interwiki link remained. Interwiki.py should not have touched the page in the first place, since the interwiki link was already set earlier.
Diff-link: http://nl.wikipedia.org/w/index.php?title=Blankenbach&diff=next&oldid=10676…
Active Python on Microsoft Windows XP [Version 5.1.2600]
Pywikipedia [http] trunk/pywikipedia (r9558, 2011/09/25, 20:30:54)
Python 2.7.2 (default, Jun 24 2011, 12:21:10) [MSC v.1500 32 bit (Intel)]
config-settings:
use_api = True
use_api_login = True
unicode test: ok
----------------------------------------------------------------------
>Comment By: xqt (xqt)
Date: 2011-10-03 21:23
Message:
r9580 prohibits editing empty pages. This should prevent problems but it
does not solve the bug itself.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 22:09
Message:
relevant wikitech-l thread:
http://lists.wikimedia.org/pipermail/wikitech-l/2011-September/055420.html
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 21:34
Message:
Confirmed on eowiki, 25 suspected pages
http://eo.wikipedia.org/w/index.php?title=Anton%C3%ADn_Kl%C3%A1%C5%A1tersk%…
Confirmed on simplewiki, 3 suspected pages
itwiki: no results
ptwiki: no results
dewiki: no results
frwiki: results, but all from the same antivandalism bot
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 21:14
Message:
Using the following query to find suspected edits...
select rc_cur_time, rc_user, rc_namespace, rc_title, rc_old_len,
rc_new_len from recentchanges left join user_groups on ug_user=rc_user
where rc_new_len < rc_old_len * 0.1 and ug_group = 'bot' and
rc_namespace=0;
(note: this will not find *all* bad edits, but at least some)...
http://nl.wikipedia.org/w/index.php?title=Alexander_Gottfried&diff=prev&old…http://nl.wikipedia.org/w/index.php?title=Angerapp&diff=27329689&oldid=1157…http://nl.wikipedia.org/w/index.php?title=Partjessnijder&diff=27331463&oldi…http://nl.wikipedia.org/w/index.php?title=Atax&diff=27330470&oldid=11968796http://nl.wikipedia.org/w/index.php?title=Medinilla&diff=27328890&oldid=110…http://nl.wikipedia.org/w/index.php?title=Merklin&diff=27330198&oldid=11821…http://nl.wikipedia.org/w/index.php?title=Pion&diff=27327730&oldid=14796262http://nl.wikipedia.org/w/index.php?title=Vossenplein&diff=27327943&oldid=1…http://nl.wikipedia.org/w/index.php?title=Walser&diff=27329293&oldid=118420…
so.. at least the specificity is good, even if the sensitivity is not.
I'll try and see what happens on different wikis. Hopefully this will give
some hint whether it's 1.18 related or not.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-29 20:39
Message:
At the moment: no. In theory, the special:export function could probably be
replaced by one or more API calls, but I have no reason to assume this
actually solves the problem...
----------------------------------------------------------------------
Comment By: hiw (hiw)
Date: 2011-09-29 04:58
Message:
Can you force the script to use API to get the page text?
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-28 21:47
Message:
I did some more testing, using
python interwiki.py -lang:de
-page:Blankenbach%20%28Begriffskl%C3%A4rung%29 -async -cleanup -auto
-async
note that these findings are not necessarily true for running on full
auto...
in this setup, the bot ALWAYS uses special:export to get page text. It
does use the API to write the pages. It only retrieves the pages ONCE, at
the start of the run.
sigh.
----------------------------------------------------------------------
Comment By: hiw (hiw)
Date: 2011-09-28 00:31
Message:
Pffff, I believe it was:
interwiki.py -all -async -cleanup -log -auto -start:
I would think I used -ns:0 also, nut sure.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:53
Message:
Question to both committer and myst: what was the exact command line you
were using?
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:49
Message:
Last note for tonight: quickly reviewing the diff to r9500 (2011-09-03) did
not yield anything really change. Note: I did this in one bunch. Reviewing
commits from the mailinglist one at a time might still be a good plan...
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:42
Message:
Last three edits of interwiki.py are all quite old:
------------------------------------------------------------------------
r9407 | xqt | 2011-07-16 23:35:06 +0200 (Sat, 16 Jul 2011) | 1 line
trailing space for list elements (readability)
------------------------------------------------------------------------
r9387 | amir | 2011-07-16 12:05:50 +0200 (Sat, 16 Jul 2011) | 1 line
adding fa for exception templates
------------------------------------------------------------------------
r9308 | xqt | 2011-06-24 19:14:40 +0200 (Fri, 24 Jun 2011) | 1 line
do not follow static redirects which means do not change the target links
like -noredirect does (with -cleanup option. -force removes that link -
maybe this should be fixed)
------------------------------------------------------------------------
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-09-27 22:37
Message:
This has also happened with Myst's bot on simplewiki:
http://simple.wikipedia.org/w/index.php?title=Mettau%2C_Switzerland&action=…
Increasing priority, rephrased title.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3414669&group_…
Bugs item #3415488, was opened at 2011-09-30 00:26
Message generated for change (Comment added) made by xqt
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3415488&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
>Status: Pending
>Resolution: Invalid
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
>Assigned to: xqt (xqt)
Summary: movepages.py doesn't move when target names don't exist
Initial Comment:
movepages.py fails to move pages and files when target names no longer exist (they exited but were deleted)
C:\pywikipedia>movepages.py -pairs:move.txt
unicode test: triggers problem #3081100
Moving page [[File:Manta2.png]] to [[File:Manta7.png]]
WARNING: Your account on thailogssandbox:en does not have a bot flag. Its edits
will be visible in the recent changes and it may get blocked.
Sleeping for 8.1 seconds, 2011-09-29 23:20:16
Unknown Error: {u'error': {u'info': u"The page you requested doesn't exist", u'c
ode': u'missingtitle'}}
Moving page [[16]] to [[17]]
Sleeping for 8.4 seconds, 2011-09-29 23:20:26
Page move failed: Target page [[17]] already exists.
----------------------------------------------------------------------
>Comment By: xqt (xqt)
Date: 2011-10-03 13:44
Message:
You bot has no bot flag and I guess this account is not autoconfirmed which
is required for that action
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3415488&group_…
Bugs item #3416854, was opened at 2011-10-01 17:46
Message generated for change (Comment added) made by xqt
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3416854&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: other
Group: None
>Status: Closed
>Resolution: Fixed
Priority: 5
Private: No
Submitted By: Mercy (wikimercy)
>Assigned to: xqt (xqt)
Summary: commonscat.py update
Initial Comment:
Hello, please add the following line for the "commonscatTemplates" variable:
'ca' : (u'Commonscat', [u'Commons cat', u'Commons category']),
Thank you!
----------------------------------------------------------------------
>Comment By: xqt (xqt)
Date: 2011-10-03 10:34
Message:
done in r9567, mercy ;)
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3416854&group_…
Patches item #3416207, was opened at 2011-09-30 21:53
Message generated for change (Comment added) made by xqt
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3416207&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
>Status: Closed
>Resolution: Fixed
Priority: 5
Private: No
Submitted By: dmitrynikitin ()
>Assigned to: xqt (xqt)
Summary: wikipedia_family.py update for ruwiki
Initial Comment:
fix warnings in ruwiki
«Missing namespace in family file Wikipedia: namespace ['ru'][102] <it is set to 'Инкубатор'>»
«Missing namespace in family file Wikipedia: namespace ['ru'][102] <it is set to 'Обсуждение Инкубатор'>»
----------------------------------------------------------------------
>Comment By: xqt (xqt)
Date: 2011-10-03 10:21
Message:
Fixed in r9563
----------------------------------------------------------------------
Comment By: dmitrynikitin ()
Date: 2011-10-02 11:52
Message:
ganz-ru, hey.
It's just PATCH for wikipedia_family.py.
All your suggestion please file in Tracker->Feature Request.
----------------------------------------------------------------------
Comment By: GanZ (ganz-ru)
Date: 2011-09-30 23:00
Message:
two comments:
1) This new namespace should be completely disconnected by interwikis (e.
g. the option "-force" should remove interwikis from and to this
namespace).
2) There some aliases:
http://ru.wikipedia.org/w/api.php?action=query&meta=siteinfo&siprop=namespa…
. Please add them.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3416207&group_…
Patches item #3416207, was opened at 2011-09-30 19:53
Message generated for change (Comment added) made by
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3416207&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: dmitrynikitin ()
Assigned to: Nobody/Anonymous (nobody)
Summary: wikipedia_family.py update for ruwiki
Initial Comment:
fix warnings in ruwiki
«Missing namespace in family file Wikipedia: namespace ['ru'][102] <it is set to 'Инкубатор'>»
«Missing namespace in family file Wikipedia: namespace ['ru'][102] <it is set to 'Обсуждение Инкубатор'>»
----------------------------------------------------------------------
>Comment By: dmitrynikitin ()
Date: 2011-10-02 09:52
Message:
ganz-ru, hey.
It's just PATCH for wikipedia_family.py.
All your suggestion please file in Tracker->Feature Request.
----------------------------------------------------------------------
Comment By: GanZ (ganz-ru)
Date: 2011-09-30 21:00
Message:
two comments:
1) This new namespace should be completely disconnected by interwikis (e.
g. the option "-force" should remove interwikis from and to this
namespace).
2) There some aliases:
http://ru.wikipedia.org/w/api.php?action=query&meta=siteinfo&siprop=namespa…
. Please add them.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3416207&group_…
Bugs item #3416854, was opened at 2011-10-01 17:46
Message generated for change (Tracker Item Submitted) made by wikimercy
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3416854&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: other
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Mercy (wikimercy)
Assigned to: Nobody/Anonymous (nobody)
Summary: commonscat.py update
Initial Comment:
Hello, please add the following line for the "commonscatTemplates" variable:
'ca' : (u'Commonscat', [u'Commons cat', u'Commons category']),
Thank you!
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3416854&group_…