jayvdb created this task.
jayvdb added a subscriber: jayvdb.
jayvdb added a project: Pywikibot-Other-scripts.
TASK DESCRIPTION
imagetransfer support three main modes:
1. an image page
2. images on a page
3. images on interwikis of a page
Only the first mode works in core.
Using "images on a page" mode creates an exception:
```
$ python pwb.py scripts/imagetransfer.py -family:wikipedia -lang:en "Foobar"
...
Traceback (most recent call last):
File "pwb.py", line 222, in <module>
run_python_file(filename, argv, argvu, file_package)
File "pwb.py", line 81, in run_python_file
main_mod.__dict__)
File "./scripts/imagetransfer.py", line 356, in <module>
main()
File "./scripts/imagetransfer.py", line 353, in main
bot.run()
File "./scripts/imagetransfer.py", line 278, in run
{'title': page.title(), 'ns': pywikibot.Site().image_namespace()})
File "/home/jvanden3/projects/pywiki/test-core/pywikibot/data/api.py", line 1680, in result
p = PageGenerator.result(self, pagedata)
File "/home/jvanden3/projects/pywiki/test-core/pywikibot/data/api.py", line 1662, in result
update_page(p, pagedata, self.props)
File "/home/jvanden3/projects/pywiki/test-core/pywikibot/data/api.py", line 1844, in update_page
"Page %s has neither 'pageid' nor 'missing' attribute" % pagedict['title'])
AssertionError: Page Foobar has neither 'pageid' nor 'missing' attribute
Found 1 commons:commons processes running, including this one.
Dropped throttle(s).
<type 'exceptions.AssertionError'>
```
The code from https://gerrit.wikimedia.org/r/#/c/101623/1 is very bizarre.
```
imagePage = (page.imagelinks(followRedirects=True)).result(
{'title': page.title(), 'ns': pywikibot.Site().image_namespace()})
```
imagelinks() returns a ImagePageGenerator, which does have a result() method which does not need to be called, as it has already been called within imagelinks() before the page is yielded.
Because of T86623, using -interwiki fails
```
$ python pwb.py scripts/imagetransfer.py -family:wikipedia -lang:en "File:1801-2001_population_change_of_Astley_Abbotts.jpg" -interwiki
...
Traceback (most recent call last):
File "pwb.py", line 222, in <module>
run_python_file(filename, argv, argvu, file_package)
File "pwb.py", line 81, in run_python_file
main_mod.__dict__)
File "./scripts/imagetransfer.py", line 353, in <module>
main()
File "./scripts/imagetransfer.py", line 350, in main
bot.run()
File "./scripts/imagetransfer.py", line 269, in run
imagelist.append(linkedPage.imagelinks(followRedirects=True))
AttributeError: 'Link' object has no attribute 'imagelinks'
Found 1 wikipedia:mk processes running, including this one.
Dropped throttle(s).
<type 'exceptions.AttributeError'>
```
However even with that fixed, -interwiki also uses list.append to add a generator, instead of an item, to the list.
TASK DETAIL
https://phabricator.wikimedia.org/T86627
REPLY HANDLER ACTIONS
Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>.
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: jayvdb
Cc: Aklapper, jayvdb, pywikipedia-bugs
JAnD created this task.
JAnD added a subscriber: JAnD.
JAnD added a project: pywikibot-core.
TASK DESCRIPTION
zh-min-nan wiktionary returns different names of pages:
I:\py\rewrite>pwb.py interwiki -family:wiktionary -subcats:Gí-giân -cleanup -lang:zh-min-nan -async -whenneeded:5 -untranslated
```
NOTE: Number of pages queued is 0, trying to add 50 more.
Retrieving 36 pages from wiktionary:zh-min-nan.
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Bân-lâm-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Hôa-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Eng-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Ji?t-gí'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Hui-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Hoat-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Tek-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Se-pan-gâ-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Phux-tô-gâ-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:O?at-lâm-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:A-la-pek-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Ke-te-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Dan-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Hun-lân-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:In-nî-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Í-tai-li-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Lo -se-a-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Hi-lia?p-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:La-teng-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Pe?h lo -se-a-
gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Hi-pek-lâi-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Se-kai-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Peng-te-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Pho-lân-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Lâm-hui-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Bông-kó -gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Pho-su-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Thai-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Má-lâi-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Ido-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Hân-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Thó -ní-kî-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Mî-iux?-tó-gú'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Bân-tang-oe'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Kheh-oe'
WARNING: preloadpages: Query returned unexpected title 'Lui-pia?t:Tagalog-gú'
Dump nan (wiktionary) appended.
Traceback (most recent call last):
File "I:\py\rewrite\pwb.py", line 222, in <module>
run_python_file(filename, argv, argvu, file_package)
File "I:\py\rewrite\pwb.py", line 81, in run_python_file
main_mod.__dict__)
File ".\scripts\interwiki.py", line 2647, in <module>
main()
File ".\scripts\interwiki.py", line 2622, in main
bot.run()
File ".\scripts\interwiki.py", line 2365, in run
self.queryStep()
File ".\scripts\interwiki.py", line 2338, in queryStep
self.oneQuery()
File ".\scripts\interwiki.py", line 2334, in oneQuery
subject.batchLoaded(self)
File ".\scripts\interwiki.py", line 1321, in batchLoaded
elif page.isRedirectPage() or page.isCategoryRedirect():
File "I:\py\rewrite\pywikibot\page.py", line 644, in isCategoryRedirect
for (template, args) in self.templatesWithParams():
File "I:\py\rewrite\pywikibot\tools.py", line 711, in wrapper
return obj(*__args, **__kw)
File "I:\py\rewrite\pywikibot\page.py", line 1869, in templatesWithParams
templates = textlib.extract_templates_and_params(self.text)
File "I:\py\rewrite\pywikibot\page.py", line 440, in text
self._text = self.get(get_redirect=True)
File "I:\py\rewrite\pywikibot\tools.py", line 711, in wrapper
return obj(*__args, **__kw)
File "I:\py\rewrite\pywikibot\page.py", line 349, in get
self._getInternals(sysop)
File "I:\py\rewrite\pywikibot\page.py", line 373, in _getInternals
self.site.loadrevisions(self, getText=True, sysop=sysop)
File "I:\py\rewrite\pywikibot\site.py", line 3167, in loadrevisions
% (page, pagedata['title']))
pywikibot.exceptions.Error: loadrevisions: Query on [[zh-min-nan:ňłćÚí×:L┼źi-pia
╠Źt:A-la-pek-g├║]] returned data on 'L┼źi-pia╠Źt:L┼źi-pia╠Źt:A-la-pek-g├║'
<class 'pywikibot.exceptions.Error'>
CRITICAL: Waiting for 1 network thread(s) to finish. Press ctrl-c to abort
```
I:\py\rewrite>
TASK DETAIL
https://phabricator.wikimedia.org/T86696
REPLY HANDLER ACTIONS
Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>.
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: JAnD
Cc: Aklapper, JAnD, jayvdb, pywikipedia-bugs