https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 Mpaa <mpaa.wiki(a)gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mpaa.wiki(a)gmail.com --- Comment #2 from Mpaa <mpaa.wiki(a)gmail.com> --- I think you should split this is several bugs. -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #4 from Mpaa <mpaa.wiki(a)gmail.com> --- Regarding point 1) In textlib.py, in timestripper(self, line), line should be stripped of all items where a valid date cannot be (comments, links, external links, etc.). Esp. external links might be deceptive, saw some like this in cswp: [https://lists.wikimedia.org/pipermail/mobile-l/2014-August/007927.html] Best way to reuse already available textlib functions with minimum code duplication TBD. Some regexes might become global constants, maybe? -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #6 from Mpaa <mpaa.wiki(a)gmail.com> --- Point 2) I think template is just misused. Field maxarchivesize is empty. See https://cs.wikipedia.org/w/index.php?title=Diskuse_s_wikipedistou:JeremySil… -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #8 from Mpaa <mpaa.wiki(a)gmail.com> --- Uploaded patch https://gerrit.wikimedia.org/r/#/c/167406/ Please report if errors are still present after this is approved. -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #9 from JAn Dudík <jan.dudik(a)gmail.com> --- (In reply to Mpaa from comment #8) Prefixes c:, outreach: and d: are still problematic. here are errors from log: Processing [[cs:Diskuse s wikipedistou:JeremySil]] 19 Threads found on [[cs:Diskuse s wikipedistou:JeremySil]] Looking for: {{archivace}} in [[cs:Diskuse s wikipedistou:JeremySil]] ERROR: Error occured while processing page [[cs:Diskuse s wikipedistou:JeremySil ]] ERROR: ValueError: invalid literal for int() with base 10: '' Traceback (most recent call last): File "I:\py\rewrite\scripts\archivebot.py", line 615, in main archiver.run() File "I:\py\rewrite\scripts\archivebot.py", line 493, in run whys = self.analyze_page() File "I:\py\rewrite\scripts\archivebot.py", line 454, in analyze_page arch_counter = int(self.get_attr('counter', '1')) ValueError: invalid literal for int() with base 10: '' Processing [[cs:Wikipedie:Nástěnka správců]] 55 Threads found on [[cs:Wikipedie:Nástěnka správců]] Looking for: {{archivace}} in [[cs:Wikipedie:Nástěnka správců]] Processing 55 threads 127 Threads found on [[cs:Wikipedie:Nástěnka správců/Archiv58]] Archiving 29 thread(s). ERROR: Error occured while processing page [[cs:Wikipedie:Nástěnka správců]] ERROR: SiteDefinitionError: :c:User:Martinnovacek.cz is not a local page on wiki pedia:cs, and the interwiki prefix c is not supported by PyWikiBot! Traceback (most recent call last): File "I:\py\rewrite\scripts\archivebot.py", line 615, in main archiver.run() File "I:\py\rewrite\scripts\archivebot.py", line 509, in run self.archives[a].update(comment) File "I:\py\rewrite\scripts\archivebot.py", line 358, in update self.save(summary) File "I:\py\rewrite\pywikibot\tools.py", line 529, in wrapper return obj(*__args, **__kw) File "I:\py\rewrite\pywikibot\page.py", line 982, in save **kwargs) File "I:\py\rewrite\pywikibot\page.py", line 990, in _save comment = self._cosmetic_changes_hook(comment) or comment File "I:\py\rewrite\pywikibot\page.py", line 1037, in _cosmetic_changes_hook self.text = ccToolkit.change(old) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 228, in change new_text = self._change(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 221, in _change text = self.safe_execute(method, text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 199, in safe_execute result = method(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 548, in cleanUpLinks 'startspace']) File "I:\py\rewrite\pywikibot\textlib.py", line 224, in replaceExcept replacement = new(match) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 442, in handleOneLink namespace = page.namespace() File "I:\py\rewrite\pywikibot\page.py", line 158, in namespace return self._link.namespace File "I:\py\rewrite\pywikibot\page.py", line 4141, in namespace self.parse() File "I:\py\rewrite\pywikibot\page.py", line 4057, in parse self._text, self._site, prefix)) SiteDefinitionError: :c:User:Martinnovacek.cz is not a local page on wikipedia:c s, and the interwiki prefix c is not supported by PyWikiBot! Processing [[cs:Wikipedie:Pod lípou]] 32 Threads found on [[cs:Wikipedie:Pod lípou]] Looking for: {{archivace}} in [[cs:Wikipedie:Pod lípou]] Processing 32 threads 63 Threads found on [[cs:Wikipedie:Pod lípou/Archiv 2014/02]] 13 Threads found on [[cs:Wikipedie:Pod lípou/Archiv 2014/03]] Archiving 22 thread(s). ERROR: Error occured while processing page [[cs:Wikipedie:Pod lípou]] ERROR: SiteDefinitionError: :c:Category:2014 events in Brno is not a local page on wikipedia:cs, and the interwiki prefix c is not supported by PyWikiBot! Traceback (most recent call last): File "I:\py\rewrite\scripts\archivebot.py", line 615, in main archiver.run() File "I:\py\rewrite\scripts\archivebot.py", line 509, in run self.archives[a].update(comment) File "I:\py\rewrite\scripts\archivebot.py", line 358, in update self.save(summary) File "I:\py\rewrite\pywikibot\tools.py", line 529, in wrapper return obj(*__args, **__kw) File "I:\py\rewrite\pywikibot\page.py", line 982, in save **kwargs) File "I:\py\rewrite\pywikibot\page.py", line 990, in _save comment = self._cosmetic_changes_hook(comment) or comment File "I:\py\rewrite\pywikibot\page.py", line 1037, in _cosmetic_changes_hook self.text = ccToolkit.change(old) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 228, in change new_text = self._change(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 221, in _change text = self.safe_execute(method, text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 199, in safe_execute result = method(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 548, in cleanUpLinks 'startspace']) File "I:\py\rewrite\pywikibot\textlib.py", line 224, in replaceExcept replacement = new(match) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 442, in handleOneLink namespace = page.namespace() File "I:\py\rewrite\pywikibot\page.py", line 158, in namespace return self._link.namespace File "I:\py\rewrite\pywikibot\page.py", line 4141, in namespace self.parse() File "I:\py\rewrite\pywikibot\page.py", line 4057, in parse self._text, self._site, prefix)) SiteDefinitionError: :c:Category:2014 events in Brno is not a local page on wiki pedia:cs, and the interwiki prefix c is not supported by PyWikiBot! Processing [[cs:Wikipedie:Pod lípou (návrhy)]] 15 Threads found on [[cs:Wikipedie:Pod lípou (návrhy)]] Looking for: {{archivace}} in [[cs:Wikipedie:Pod lípou (návrhy)]] Processing 15 threads 14 Threads found on [[cs:Wikipedie:Pod lípou (návrhy)/Archiv 2014-01]] Archiving 5 thread(s). ERROR: Error occured while processing page [[cs:Wikipedie:Pod lípou (návrhy)]] ERROR: SiteDefinitionError: :outreach:Welcome to Wikipedia (Bookshelf)/2013 edit ion/text is not a local page on wikipedia:cs, and the interwiki prefix outreach is not supported by PyWikiBot! Traceback (most recent call last): File "I:\py\rewrite\scripts\archivebot.py", line 615, in main archiver.run() File "I:\py\rewrite\scripts\archivebot.py", line 509, in run self.archives[a].update(comment) File "I:\py\rewrite\scripts\archivebot.py", line 358, in update self.save(summary) File "I:\py\rewrite\pywikibot\tools.py", line 529, in wrapper return obj(*__args, **__kw) File "I:\py\rewrite\pywikibot\page.py", line 982, in save **kwargs) File "I:\py\rewrite\pywikibot\page.py", line 990, in _save comment = self._cosmetic_changes_hook(comment) or comment File "I:\py\rewrite\pywikibot\page.py", line 1037, in _cosmetic_changes_hook self.text = ccToolkit.change(old) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 228, in change new_text = self._change(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 221, in _change text = self.safe_execute(method, text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 199, in safe_execute result = method(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 548, in cleanUpLinks 'startspace']) File "I:\py\rewrite\pywikibot\textlib.py", line 224, in replaceExcept replacement = new(match) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 442, in handleOneLink namespace = page.namespace() File "I:\py\rewrite\pywikibot\page.py", line 158, in namespace return self._link.namespace File "I:\py\rewrite\pywikibot\page.py", line 4141, in namespace self.parse() File "I:\py\rewrite\pywikibot\page.py", line 4057, in parse self._text, self._site, prefix)) SiteDefinitionError: :outreach:Welcome to Wikipedia (Bookshelf)/2013 edition/tex t is not a local page on wikipedia:cs, and the interwiki prefix outreach is not supported by PyWikiBot! Processing [[cs:Wikipedie:Pod lípou (technika)]] 61 Threads found on [[cs:Wikipedie:Pod lípou (technika)]] Looking for: {{archivace}} in [[cs:Wikipedie:Pod lípou (technika)]] Processing 61 threads ERROR: Error occured while processing page [[cs:Wikipedie:Pod lípou (technika)]] ERROR: IsRedirectPage: Page [[cs:Wikipedie:Pod lípou (technika)/Archiv 2014-01]] is a redirect page. Traceback (most recent call last): File "I:\py\rewrite\scripts\archivebot.py", line 615, in main archiver.run() File "I:\py\rewrite\scripts\archivebot.py", line 493, in run whys = self.analyze_page() File "I:\py\rewrite\scripts\archivebot.py", line 481, in analyze_page if self.feed_archive(archive, t, max_arch_size, params): File "I:\py\rewrite\scripts\archivebot.py", line 449, in feed_archive self.archives[title] = DiscussionPage(archive, self, params) File "I:\py\rewrite\scripts\archivebot.py", line 293, in __init__ self.load_page() File "I:\py\rewrite\scripts\archivebot.py", line 308, in load_page lines = self.get().split('\n') File "I:\py\rewrite\pywikibot\tools.py", line 529, in wrapper return obj(*__args, **__kw) File "I:\py\rewrite\pywikibot\page.py", line 332, in get self._getInternals(sysop) File "I:\py\rewrite\pywikibot\page.py", line 364, in _getInternals raise self._getexception IsRedirectPage: Page [[cs:Wikipedie:Pod lĂ­pou (technika)/Archiv 2014-01]] is a redirect page. Processing [[cs:Wikipedie:Potřebuji pomoc]] 44 Threads found on [[cs:Wikipedie:Potřebuji pomoc]] Looking for: {{archivace}} in [[cs:Wikipedie:Potřebuji pomoc]] Processing 44 threads 7 Threads found on [[cs:Wikipedie:Potřebuji pomoc/Archiv14]] Archiving 20 thread(s). ERROR: Error occured while processing page [[cs:Wikipedie:Potřebuji pomoc]] ERROR: SiteDefinitionError: d:Q252189 is not a local page on wikipedia:cs, and t he interwiki prefix d is not supported by PyWikiBot! Traceback (most recent call last): File "I:\py\rewrite\scripts\archivebot.py", line 615, in main archiver.run() File "I:\py\rewrite\scripts\archivebot.py", line 509, in run self.archives[a].update(comment) File "I:\py\rewrite\scripts\archivebot.py", line 358, in update self.save(summary) File "I:\py\rewrite\pywikibot\tools.py", line 529, in wrapper return obj(*__args, **__kw) File "I:\py\rewrite\pywikibot\page.py", line 982, in save **kwargs) File "I:\py\rewrite\pywikibot\page.py", line 990, in _save comment = self._cosmetic_changes_hook(comment) or comment File "I:\py\rewrite\pywikibot\page.py", line 1037, in _cosmetic_changes_hook self.text = ccToolkit.change(old) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 228, in change new_text = self._change(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 221, in _change text = self.safe_execute(method, text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 199, in safe_execute result = method(text) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 548, in cleanUpLinks 'startspace']) File "I:\py\rewrite\pywikibot\textlib.py", line 224, in replaceExcept replacement = new(match) File "I:\py\rewrite\scripts\cosmetic_changes.py", line 442, in handleOneLink namespace = page.namespace() File "I:\py\rewrite\pywikibot\page.py", line 158, in namespace return self._link.namespace File "I:\py\rewrite\pywikibot\page.py", line 4141, in namespace self.parse() File "I:\py\rewrite\pywikibot\page.py", line 4057, in parse self._text, self._site, prefix)) SiteDefinitionError: d:Q252189 is not a local page on wikipedia:cs, and the inte rwiki prefix d is not supported by PyWikiBot! -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #11 from Mpaa <mpaa.wiki(a)gmail.com> --- Processing [[cs:Diskuse s wikipedistou:JeremySil]] ... arch_counter = int(self.get_attr('counter', '1')) ValueError: invalid literal for int() with base 10: '' counter parameter is malformed. It is empty while an int is expected. -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #13 from Fabian <CommodoreFabianus(a)gmx.de> --- Okay maybe the families are not loaded properly? Have you changed the "installed" families? With the following code line (in the shell like before) it'll list all families: print("\n".join("{}: {}".format(*i) for i in sorted(pywikibot.config2.family_files.items()))) The default installation should contain at least outreach, wikidata and commons. -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #15 from Mpaa <mpaa.wiki(a)gmail.com> --- Works for me. Pywikibot: pywikibot-core.git (bc34a4a, g4328, 2014/10/20, 18:56:56, OUTDATED) Release version: 2.0b2 Python: 2.7.6 (default, Mar 22 2014, 22:59:38) unicode test: ok httplib2 version: 0.9 The only difference I can spot is httplib2. No idea if it could explain it. Might be worth while updating it and retry. -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 --- Comment #17 from Mpaa <mpaa.wiki(a)gmail.com> --- (In reply to Mpaa from comment #8) BTW, patch https://gerrit.wikimedia.org/r/#/c/167406/ is Merged. -- You are receiving this mail because: You are the assignee for the bug.

https://bugzilla.wikimedia.org/show_bug.cgi?id=72047 John Mark Vandenberg <jayvdb(a)gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|PATCH_TO_REVIEW |RESOLVED CC| |jayvdb(a)gmail.com Resolution|--- |FIXED --- Comment #19 from John Mark Vandenberg <jayvdb(a)gmail.com> --- It looks like this is fixed. -- You are receiving this mail because: You are the assignee for the bug.