https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
Bug ID: 65981 Summary: WARNING: API warning (categorymembers): Too many values supplied for parameter 'gcmnamespace': the limit is 50 Product: Pywikibot Version: unspecified Hardware: All OS: All Status: NEW Severity: blocker Priority: Unprioritized Component: General Assignee: Pywikipedia-bugs@lists.wikimedia.org Reporter: bugzilla.wikimedia@publi.purodha.net Web browser: --- Mobile Platform: ---
Various bot commands end with the message: WARNING: API warning (categorymembers): Too many values supplied for parameter 'gcmnamespace': the limit is 50
Trying to find the reason in the code, grep does not find various pieces of that message. Thus I was not able to locate its origin in the code. :-(
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
xqt info@gno.de changed:
What |Removed |Added ---------------------------------------------------------------------------- CC| |info@gno.de
--- Comment #1 from xqt info@gno.de --- I guess the method is site.categorymembers which launches the request. With Namespace Parameter the Maximum values to be returned is limited to 500 for bots and 50 for others. Are you running a bot or without bot flag when that error occurs. Could you give an example to reproduce that bug?
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
xqt info@gno.de changed:
What |Removed |Added ---------------------------------------------------------------------------- Priority|Unprioritized |High Severity|blocker |major
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
xqt info@gno.de changed:
What |Removed |Added ---------------------------------------------------------------------------- Priority|High |Normal Severity|major |normal
--- Comment #2 from xqt info@gno.de --- Seems this is a warning only due to $wgMiserMode Parameter and does not affect the results.
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
--- Comment #3 from Gerrit Notification Bot gerritadmin@wikimedia.org --- Change 136632 had a related patch set uploaded by Xqt: (bug 65981) reduce limit if $wgMiserMode is set and generator is affected
https://gerrit.wikimedia.org/r/136632
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
Gerrit Notification Bot gerritadmin@wikimedia.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |PATCH_TO_REVIEW
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
Purodha Blissenbach bugzilla.wikimedia@publi.purodha.net changed:
What |Removed |Added ---------------------------------------------------------------------------- URL| |http://wiki.piratenpartei.d | |e/wiki/index.php
--- Comment #4 from Purodha Blissenbach bugzilla.wikimedia@publi.purodha.net --- (In reply to xqt from comment #1)
I guess the method is site.categorymembers which launches the request. With Namespace Parameter the Maximum values to be returned is limited to 500 for bots and 50 for others. Are you running a bot or without bot flag when that error occurs. Could you give an example to reproduce that bug?
Yes, running a test on categories with -simulate and without bot flag.
The wiki is at http://wiki.piratenpartei.de/wiki/index.php and not available in git. It is fairly standard but has tons of local name spaces.
In my test, I do not refer to name spaces explicitly, but of course, category is one of them.
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
--- Comment #5 from Purodha Blissenbach bugzilla.wikimedia@publi.purodha.net --- (In reply to xqt from comment #2)
Seems this is a warning only due to $wgMiserMode Parameter and does not affect the results.
The bot terminates after the warning. While I guess it might generally be able to continue, it does nothing and at least not what it is expected to do.
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
--- Comment #6 from Purodha Blissenbach bugzilla.wikimedia@publi.purodha.net --- (In reply to Gerrit Notification Bot from comment #3)
Change 136632 had a related patch set uploaded by Xqt: (bug 65981) reduce limit if $wgMiserMode is set and generator is affected
I tried the patch. It seems not to solve the problem in one instance, but creates more output:
... max WARNING: API warning (categorymembers): Too many values supplied for parameter 'gcmnamespace': the limit is 50 max max Dropped throttle(s). ...
The "max" are new.
In another test, the patch seems to avoid the error - maybe because another error is hit earlier:
- - - cut - - - $ python pwb.py category -family:piratewiki -lang:de move -nodelete -inplace -from:ababa -to:abba -simulate -v === Pywikibot framework v2.0 -- Logging header === COMMAND: ['category', '-family:piratewiki', '-lang:de', 'move', '-nodelete', '-inplace', '-from:ababa', '-to:abba', '-simulate', '-v'] VERSION: ('[ssh] pywikibot-core.git (3615274, g3256, 2014/06/01, 13:13:55, OUTDATED)', 'b807b4f704dbfd042b2c1ae0b362a5b04093750e', (1, 22, u'.7')) SYSTEM: ('Linux', 'tools-login', '3.2.0-59-virtual', '#90-Ubuntu SMP Tue Jan 7 23:02:33 UTC 2014', 'x86_64') MODULES: pywikibot/comms/http.py affc571 2014-06-01 00:29:06.175927 pywikibot/data/api.py 1a1ae93 2014-06-01 12:39:25.389090 pywikibot/textlib.py 43dc65b 2014-06-01 00:29:06.535937 pywikibot/i18n.py a7dd59b 2014-06-01 00:29:06.439934 pywikibot/comms/threadedhttp.py 5dd0840 2014-06-01 00:29:06.187927 pywikibot/date.py a1b85ad 2014-02-21 14:38:22 pywikibot/exceptions.py d9e869a 2014-06-01 00:29:06.291930 pywikibot/site.py 3d3f2cf 2014-06-01 00:29:06.515936 pywikibot/bot.py 2e7e859 2014-06-01 00:29:06.159927 pywikibot/throttle.py 1d8da7a 2014-06-01 00:29:06.543937 pywikibot/page.py 01efdf2 2014-06-01 00:29:06.475935 pywikibot/family.py 75ed448 2014-06-01 00:29:06.411933 pywikibot/plural.py 2b02046 2014-02-21 14:38:22 pywikibot/version.py 6d0d30d 2014-06-01 00:29:06.615939 pywikibot/userinterfaces/terminal_interface.py 0e8db29 2014-02-21 14:38:23 pywikibot/userinterfaces/terminal_interface_base.py 745aa26 2014-06-01 00:29:06.579938 pywikibot/config2.py 18b9ca6 2014-06-01 00:29:06.231929 pywikibot/pagegenerators.py 87472d0 2014-06-01 00:29:06.491935 pywikibot/userinterfaces/terminal_interface_unix.py 30e64ec 2014-06-01 00:29:06.591938 pywikibot/tools.py 31ca0ef 2014-06-01 00:29:06.567937 pywikibot/login.py 8f167ac 2014-06-01 00:29:06.455935 pywikibot/userinterfaces/transliteration.py 288348d 2014-06-01 00:29:06.607939 MESSAGES: unknown (not logged in) === === === === === === === === === === === === === === Pywikibot ra774f3344f63c8a549779793c192b517e0866527 Python 2.7.3 (default, Feb 27 2014, 19:58:35) [GCC 4.6.3] Found 1 piratewiki:de processes running, including this one. Password for user Purbo_T on piratewiki:de (no characters will be shown): Logging in to piratewiki:de as Purbo_T Should be logged in now WARNING: deleteEmptySourceCat argument of __init__ is deprecated; use delete_oldcat instead. WARNING: titleRegex argument of __init__ is deprecated; use title_regex instead. WARNING: withHistory argument of __init__ is deprecated; use history instead. Moving text from Kategorie:Ababa to Kategorie:Abba. ERROR: Fatal error: Traceback (most recent call last): File "scripts/category.py", line 1089, in <module> main() File "scripts/category.py", line 1059, in main bot.run() File "scripts/category.py", line 473, in run self._movecat() File "scripts/category.py", line 517, in _movecat authors = ', '.join(self.oldcat.contributingUsers()) File "/home/purodha/pywikibot/pywikibot/page.py", line 1297, in contributingUsers edits = self.getVersionHistory(step=step, total=total) File "/home/purodha/pywikibot/pywikibot/__init__.py", line 418, in wrapper return method(*__args, **__kw) File "/home/purodha/pywikibot/pywikibot/__init__.py", line 418, in wrapper return method(*__args, **__kw) File "/home/purodha/pywikibot/pywikibot/__init__.py", line 418, in wrapper return method(*__args, **__kw) File "/home/purodha/pywikibot/pywikibot/page.py", line 1244, in getVersionHistory step=step, total=total) File "/home/purodha/pywikibot/pywikibot/site.py", line 1935, in loadrevisions raise NoPage(page) NoPageDropped throttle(s). Waiting for 1 network thread(s) to finish. Press ctrl-c to abort All threads finished. max $ - - - cut - - -
But here: wiki.piratenpartei.de/Spezial:Kategorien/Ababa you see that the category has one page, so here is something wrong.
https://bugzilla.wikimedia.org/show_bug.cgi?id=65981
xqt info@gno.de changed:
What |Removed |Added ---------------------------------------------------------------------------- Assignee|Pywikipedia-bugs@lists.wiki |info@gno.de |media.org |
pywikipedia-bugs@lists.wikimedia.org