Pywikibot-commits February 2016

pywikibot-commits@lists.wikimedia.org

2 participants
74 discussions

[Gerrit] site.py: Use api.UploadWarning instead of pywikibot.UploadWa... - change (pywikibot/core)

by jenkins-bot (Code Review)

jenkins-bot has submitted this change and it was merged. Change subject: site.py: Use api.UploadWarning instead of pywikibot.UploadWarning ...................................................................... site.py: Use api.UploadWarning instead of pywikibot.UploadWarning site.py recognize pywikibot as the actual module, not the ModuleDeprecationWrapper. api.UploadWarning is also used elsewhere in this script instead of pywikibot.UploadWarning. Bug: T125777 Change-Id: I3b06825fb6ed87a1d0e5f8e5d4b1873c450b9b36 --- M pywikibot/site.py 1 file changed, 4 insertions(+), 4 deletions(-) Approvals: Xqt: Looks good to me, approved jenkins-bot: Verified diff --git a/pywikibot/site.py b/pywikibot/site.py index 369972c..10099e1 100644 --- a/pywikibot/site.py +++ b/pywikibot/site.py @@ -5887,10 +5887,10 @@ UserWarning, 3) warning = list(result["warnings"].keys())[0] message = result["warnings"][warning] - raise pywikibot.UploadWarning(warning, upload_warnings[warning] - % {'msg': message}, - file_key=_file_key, - offset=result.get('offset', False)) + raise api.UploadWarning(warning, upload_warnings[warning] + % {'msg': message}, + file_key=_file_key, + offset=result.get('offset', False)) elif "result" not in result: pywikibot.output(u"Upload: unrecognized response: %s" % result) if result["result"] == "Success": -- To view, visit https://gerrit.wikimedia.org/r/268355 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I3b06825fb6ed87a1d0e5f8e5d4b1873c450b9b36 Gerrit-PatchSet: 1 Gerrit-Project: pywikibot/core Gerrit-Branch: master Gerrit-Owner: Zhuyifei1999 <zhuyifei1999(a)gmail.com> Gerrit-Reviewer: John Vandenberg <jayvdb(a)gmail.com> Gerrit-Reviewer: Merlijn van Deen <valhallasw(a)arctus.nl> Gerrit-Reviewer: XZise <CommodoreFabianus(a)gmx.de> Gerrit-Reviewer: Xqt <info(a)gno.de> Gerrit-Reviewer: jenkins-bot <>

8 years, 2 months

Failed: wikimedia/pywikibot-core#3220 (master - 0eeb568)

by Travis CI

Build Update for wikimedia/pywikibot-core ------------------------------------- Build: #3220 Status: Failed Duration: 44 minutes and 7 seconds Commit: 0eeb568 (master) Author: jenkins-bot Message: Merge "Identify master as 3.0-dev" View the changeset: https://github.com/wikimedia/pywikibot-core/compare/a426e4fb738b...0eeb5682… View the full build log and details: https://travis-ci.org/wikimedia/pywikibot-core/builds/106538800 -- You can configure recipients for build notifications in your .travis.yml file. See https://docs.travis-ci.com/user/notifications

8 years, 2 months

[Gerrit] Identify master as 3.0-dev - change (pywikibot/core)

by jenkins-bot (Code Review)

jenkins-bot has submitted this change and it was merged. Change subject: Identify master as 3.0-dev ...................................................................... Identify master as 3.0-dev Change-Id: I52433771bf89080770936218d3017943992401e8 --- M pywikibot/__init__.py M setup.py 2 files changed, 2 insertions(+), 2 deletions(-) Approvals: John Vandenberg: Looks good to me, but someone else must approve Xqt: Looks good to me, approved jenkins-bot: Verified diff --git a/pywikibot/__init__.py b/pywikibot/__init__.py index ba3aae3..eb39955 100644 --- a/pywikibot/__init__.py +++ b/pywikibot/__init__.py @@ -7,7 +7,7 @@ # from __future__ import absolute_import, unicode_literals -__release__ = '2.0b3' +__release__ = '3.0-dev' __version__ = '$Id$' __url__ = 'https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Pywikibot' diff --git a/setup.py b/setup.py index fe4b1b1..5c23226 100644 --- a/setup.py +++ b/setup.py @@ -179,7 +179,7 @@ from setuptools import setup, find_packages name = 'pywikibot' -version = '2.0rc1.post2' +version = '3.0-dev' github_url = 'https://github.com/wikimedia/pywikibot-core' setup( -- To view, visit https://gerrit.wikimedia.org/r/243343 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I52433771bf89080770936218d3017943992401e8 Gerrit-PatchSet: 1 Gerrit-Project: pywikibot/core Gerrit-Branch: master Gerrit-Owner: John Vandenberg <jayvdb(a)gmail.com> Gerrit-Reviewer: John Vandenberg <jayvdb(a)gmail.com> Gerrit-Reviewer: Ladsgroup <ladsgroup(a)gmail.com> Gerrit-Reviewer: XZise <CommodoreFabianus(a)gmx.de> Gerrit-Reviewer: Xqt <info(a)gno.de> Gerrit-Reviewer: jenkins-bot <>

8 years, 2 months

[Gerrit] Fix textlib 'file' exception regex - change (pywikibot/core)

by jenkins-bot (Code Review)

jenkins-bot has submitted this change and it was merged. Change subject: Fix textlib 'file' exception regex ...................................................................... Fix textlib 'file' exception regex Also replace the custom 'file' exception in cc with the standard fixed exception in textlib. Change-Id: If2a0827df1a0f83afd3c23e57bb841929ed1399c --- M pywikibot/cosmetic_changes.py M pywikibot/textlib.py M tests/textlib_tests.py 3 files changed, 132 insertions(+), 9 deletions(-) Approvals: Xqt: Looks good to me, approved jenkins-bot: Verified diff --git a/pywikibot/cosmetic_changes.py b/pywikibot/cosmetic_changes.py index 8aabc09..e8f8972 100755 --- a/pywikibot/cosmetic_changes.py +++ b/pywikibot/cosmetic_changes.py @@ -833,6 +833,7 @@ return exceptions = [ 'gallery', + 'file', 'hyperlink', 'interwiki', # FIXME: but changes letters inside wikilinks @@ -856,16 +857,9 @@ new = digits.pop(self.site.code) # This only works if there are only two items in digits dict old = digits[digits.keys()[0]] - # do not change inside file links - namespaces = list(self.site.namespace(6, all=True)) - pattern = re.compile( - u'\\[\\[(%s):.+?\\.\\w+? *(\\|((\\[\\[.*?\\]\\])|.)*)?\\]\\]' - % u'|'.join(namespaces), - re.UNICODE) # not to let bot edits in latin content exceptions.append(re.compile(u"[^%(fa)s] *?\"*? *?, *?[^%(fa)s]" % {'fa': faChrs})) - exceptions.append(pattern) text = textlib.replaceExcept(text, u',', u'،', exceptions) if self.site.code == 'ckb': text = textlib.replaceExcept(text, diff --git a/pywikibot/textlib.py b/pywikibot/textlib.py index 54d20eb..16f5222 100644 --- a/pywikibot/textlib.py +++ b/pywikibot/textlib.py @@ -99,6 +99,21 @@ (?P<unhandled_depth>{{\s*[^{\|#0-9][^{\|#]*?\s* [^{]* {{ .* }}) """, re.VERBOSE) +# The following regex supports wikilinks anywhere after the first pipe +# and correctly matches the end of the file link if the wikilink contains +# [[ or ]]. +# The namespace names must be substituted into this regex. +# e.g. FILE_LINK_REGEX % 'File' or FILE_LINK_REGEX % '|'.join(site.namespaces) +FILE_LINK_REGEX = r""" +\[\[\s*(?:%s)\s*:[^|]*?\s* + (\| + ( \[\[ [^[]*? \[\[ [^]]*? \]\] [^]]*? \]\] # capture invalid syntax + | ( \[\[ .*? \]\] )? [^[]*? + | \[ [^]]*? \] + )* + )? +\]\] +""" NON_LATIN_DIGITS = { 'ckb': u'٠١٢٣٤٥٦٧٨٩', @@ -180,7 +195,7 @@ 'category': ('\[\[ *(?:%s)\s*:.*?\]\]', lambda site: '|'.join(site.namespaces[14])), # files - 'file': ('\[\[ *(?:%s)\s*:.*?\]\]', + 'file': (FILE_LINK_REGEX, lambda site: '|'.join(site.namespaces[6])), }) @@ -208,7 +223,7 @@ if (exc, site) not in _regex_cache: re_text, re_var = _regex_cache[exc] _regex_cache[(exc, site)] = re.compile( - re_text % re_var(site)) + re_text % re_var(site), re.VERBOSE) result.append(_regex_cache[(exc, site)]) else: diff --git a/tests/textlib_tests.py b/tests/textlib_tests.py index 762f62d..a1e51be 100644 --- a/tests/textlib_tests.py +++ b/tests/textlib_tests.py @@ -1134,17 +1134,131 @@ self.assertEqual(textlib.replaceExcept('{{#invoke:x}}', 'x', 'y', ['invoke'], site=self.site), '{{#invoke:x}}') + + def test_replace_tag_category(self): + """Test replacing not inside category links.""" for ns_name in self.site.namespaces[14]: self.assertEqual(textlib.replaceExcept('[[%s:x]]' % ns_name, 'x', 'y', ['category'], site=self.site), '[[%s:x]]' % ns_name) + + def test_replace_tag_file(self): + """Test replacing not inside file links.""" for ns_name in self.site.namespaces[6]: self.assertEqual(textlib.replaceExcept('[[%s:x]]' % ns_name, 'x', 'y', ['file'], site=self.site), '[[%s:x]]' % ns_name) + self.assertEqual( + textlib.replaceExcept( + '[[File:x|foo]]', + 'x', 'y', ['file'], site=self.site), + '[[File:x|foo]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:x|]]', + 'x', 'y', ['file'], site=self.site), + '[[File:x|]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:x|foo|bar x]] x', + 'x', 'y', ['file'], site=self.site), + '[[File:x|foo|bar x]] y') + + self.assertEqual( + textlib.replaceExcept( + '[[File:x|]][[File:x|foo]]', + 'x', 'y', ['file'], site=self.site), + '[[File:x|]][[File:x|foo]]') + + self.assertEqual( + textlib.replaceExcept( + '[[NonFile:x]]', + 'x', 'y', ['file'], site=self.site), + '[[NonFile:y]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:]]', + 'File:', 'NonFile:', ['file'], site=self.site), + '[[File:]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:x|[[foo]].]]', + 'x', 'y', ['file'], site=self.site), + '[[File:x|[[foo]].]]') + + # ensure only links inside file are captured + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]].x]][[y]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]][[bar]].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]][[bar]].x]][[y]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]][[bar]].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]][[bar]].x]][[y]]') + + # Correctly handle single brackets in the text. + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]] [bar].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]] [bar].x]][[y]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[bar] [[foo]] .x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[bar] [[foo]] .x]][[y]]') + + def test_replace_tag_file_invalid(self): + """Test replacing not inside file links with invalid titles.""" + # Correctly handle [ and ] inside wikilinks inside file link + # even though these are an invalid title. + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]] [[bar [invalid] ]].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]] [[bar [invalid] ]].x]][[y]]') + + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]] [[bar [invalid ]].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]] [[bar [invalid ]].x]][[y]]') + + # Even handle balanced [[ ]] inside the wikilink. + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]] [[bar [[invalid]] ]].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]] [[bar [[invalid]] ]].x]][[y]]') + + @unittest.expectedFailure + def test_replace_tag_file_failure(self): + """Test showing limits of the file link regex.""" + # When the double brackets are unbalanced, the regex + # does not correctly detect the end of the file link. + self.assertEqual( + textlib.replaceExcept( + '[[File:a|[[foo]] [[bar [[invalid ]].x]][[x]]', + 'x', 'y', ['file'], site=self.site), + '[[File:a|[[foo]] [[bar [invalid] ]].x]][[y]]') + def test_replace_tags_interwiki(self): """Test replacing not inside interwiki links.""" if 'es' not in self.site.family.langs or 'ey' in self.site.family.langs: -- To view, visit https://gerrit.wikimedia.org/r/246802 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: If2a0827df1a0f83afd3c23e57bb841929ed1399c Gerrit-PatchSet: 6 Gerrit-Project: pywikibot/core Gerrit-Branch: master Gerrit-Owner: John Vandenberg <jayvdb(a)gmail.com> Gerrit-Reviewer: John Vandenberg <jayvdb(a)gmail.com> Gerrit-Reviewer: Ladsgroup <ladsgroup(a)gmail.com> Gerrit-Reviewer: XZise <CommodoreFabianus(a)gmx.de> Gerrit-Reviewer: Xqt <info(a)gno.de> Gerrit-Reviewer: jenkins-bot <>

8 years, 2 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

Pywikibot-commits February 2016