Bugs item #2198717, was opened at 2008-10-26 21:34
Message generated for change (Comment added) made by a_engels
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2198717&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: General
Group: None
Status: Open
>Resolution: Accepted
Priority: 5
Private: No
Submitted By: maksim j (maksimpp)
Assigned to: Nobody/Anonymous (nobody)
Summary: Cannot read AllPages
Initial Comment:
Cannot read all categories from it.wikipedia
nsp=14
start=u''
for page in mysite.allpages(start = start, namespace = nsp):
wikipedia.output(page.title())
After Categoria:Progetto:Biografie/Tabella monitoraggio automatico - scrittura nc
It get Categoria:Birmingham
with infinite loop.
----------------------------------------------------------------------
>Comment By: Andre Engels (a_engels)
Date: 2008-11-03 08:38
Message:
This seems to be a problem not with the bug code, but with the Mediawiki
API. I have submitted a bug report at
https://bugzilla.wikimedia.org/show_bug.cgi?id=16225 which, when resolved,
should correct this issue.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2198717&group_…
Bugs item #2217846, was opened at 2008-11-03 04:31
Message generated for change (Comment added) made by a_engels
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217846&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
>Status: Closed
>Resolution: Fixed
Priority: 5
Private: No
Submitted By: Purodha B Blissenbach (purodha)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py: BUG: Non-unicode (<type 'str'>) passed to wiki
Initial Comment:
Mon Nov 3 03:24:21 UTC 2008
python /home/purodha/pywikipedia/interwiki.py -v -putthrottle:1 -start:Saachjropp:A
Checked for running processes. 1 processes currently running, including the current process.
Pywikipediabot (r6025 (wikipedia.py), Oct 26 2008, 14:51:32)
Python 2.5.2 (r252:60911, Sep 29 2008, 21:10:35)
[GCC 4.3.2]
Retrieving mediawiki messages from Special:Allmessages
WARNING: No character set found.
NOTE: Number of pages queued is 0, trying to add 60 more.
Getting 60 pages from wikipedia:ksh...
[[ several 100 messages skipped ]]
Stopping work on [[Saachjrupp:Esse & Drinke]] because duplicate pages [[zh:Category:??]] and [[zh:Category:??]] are found
DBG> BUG: Non-unicode (<type 'str'>) passed to wikipedia.output without decoder!
File "/home/purodha/pywikipedia/interwiki.py", line 1797, in <module>
bot.run()
File "/home/purodha/pywikipedia/interwiki.py", line 1532, in run
self.queryStep()
File "/home/purodha/pywikipedia/interwiki.py", line 1511, in queryStep
subj.finish(self)
File "/home/purodha/pywikipedia/interwiki.py", line 1019, in finish
wikipedia.output("Stopping work on %s."%self.originPage)
File "/home/purodha/pywikipedia/wikipedia.py", line 6440, in output
print traceback.print_stack()
None
DBG> Attempting to recover, but please report this problem
Stopping work on [[Saachjrupp:Esse & Drinke]].
----------------------------------------------------------------------
>Comment By: Andre Engels (a_engels)
Date: 2008-11-03 07:59
Message:
Fixed in version 6051
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217846&group_…
Bugs item #2217938, was opened at 2008-11-03 05:17
Message generated for change (Comment added) made by a_engels
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217938&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
>Status: Closed
>Resolution: Fixed
Priority: 5
Private: No
Submitted By: Marc-Etienne Vargenau (vargenau)
Assigned to: Nobody/Anonymous (nobody)
Summary: Bot no longer writes file autonomous_problem.dat
Initial Comment:
Hello,
Since recently, the bot no longer writes file autonomous_problem.dat in case of conflict.
So you cannot run the bot manually afterwards to correct conflicts.
python version.py
Pywikipedia [http] trunk/pywikipedia (r6049, Nov 01 2008, 23:20:35)
Python 2.5.1 (r251:54869, Apr 18 2007, 22:08:04)
[GCC 4.0.1 (Apple Computer, Inc. build 5367)]
----------------------------------------------------------------------
>Comment By: Andre Engels (a_engels)
Date: 2008-11-03 07:59
Message:
Fixed in version 6051
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217938&group_…
Revision: 6051
Author: a_engels
Date: 2008-11-03 06:59:10 +0000 (Mon, 03 Nov 2008)
Log Message:
-----------
1. Fixed bug 2217846 (non-unicode)
2. Used a more standard message when skipping a page autonomous
3. Makes autonomous_problems.dat work again (bug 2217938)
4. Removes the exception for lmo: wikipedia - those removals for the greater part have been done months ago already
Modified Paths:
--------------
trunk/pywikipedia/interwiki.py
Modified: trunk/pywikipedia/interwiki.py
===================================================================
--- trunk/pywikipedia/interwiki.py 2008-11-02 21:09:58 UTC (rev 6050)
+++ trunk/pywikipedia/interwiki.py 2008-11-03 06:59:10 UTC (rev 6051)
@@ -840,6 +840,20 @@
otherpage = [p for p in self.done if p.site() == page.site() and p != page and p.exists() and not p.isRedirectPage()][0]
wikipedia.output(u"Stopping work on %s because duplicate pages %s and %s are found"%(self.originPage.aslink(),otherpage.aslink(True),page.aslink(True)))
self.makeForcedStop(counter)
+ try:
+ f = codecs.open(
+ wikipedia.config.datafilepath('autonomous_problems.dat'),
+ 'a', 'utf-8')
+ f.write("* %s {Found more than one link for %s}" % (self.originPage.aslink(True), page.site()))
+ if config.interwiki_graph and config.interwiki_graph_url:
+ filename = interwiki_graph.getFilename(self.originPage, extension = config.interwiki_graph_formats[0])
+ f.write(" [%s%s graph]" % (config.interwiki_graph_url, filename))
+ f.write("\n")
+ f.close()
+ except:
+ #raise
+ wikipedia.output(u'File autonomous_problem.dat open or corrupted! Try again with -restore.')
+ sys.exit()
iw = ()
elif page.isEmpty() and not page.isCategory():
wikipedia.output(u"NOTE: %s is empty; ignoring it and its interwiki links" % page.aslink(True))
@@ -881,21 +895,6 @@
self.confirm = True
if createneed:
self.problemfound = True
- if globalvar.autonomous:
- try:
- f = codecs.open(
- wikipedia.config.datafilepath('autonomous_problem.dat'),
- 'a', 'utf-8')
- f.write("* %s {%s}" % (self.originPage.aslink(True), txt))
- if config.interwiki_graph and config.interwiki_graph_url:
- filename = interwiki_graph.getFilename(self.originPage, extension = config.interwiki_graph_formats[0])
- f.write(" [%s%s graph]" % (config.interwiki_graph_url, filename))
- f.write("\n")
- f.close()
- except:
- #raise
- wikipedia.output(u'File autonomous_problem.dat open or corrupted! Try again with -restore.')
- sys.exit()
def whereReport(self, page, indent=4):
for page2 in sorted(self.foundIn[page]):
@@ -1012,7 +1011,7 @@
if not self.isDone():
raise "Bugcheck: finish called before done"
if self.forcedStop:
- wikipedia.output("Stopping work on %s."%self.originPage)
+ wikipedia.output(u"======Aborted processing %s======" % self.originPage.aslink(True))
return
if self.originPage.isRedirectPage():
return
@@ -1197,16 +1196,8 @@
# Determine whether we need permission to submit
ask = False
if removing and removing != [page]: # Allow for special case of a self-pointing interwiki link
- ##########
- # temporary hard-coded special case to get rid of thousands of broken links to the Lombard Wikipedia,
- # where useless bot-created articles were mass-deleted. See for example:
- # http://meta.wikimedia.org/wiki/Proposals_for_closing_projects/Closure_of_Lo…
- if len(removing) == 1 and removing[0].site() == wikipedia.getSite('lmo', 'wikipedia'):
- wikipedia.output('Found bad link to %s. As many lmo pages were deleted, it is assumed that it can be safely removed.' % removing[0].aslink())
- else:
- ##########
- self.problem('Found incorrect link to %s in %s'% (",".join([x.site().lang for x in removing]), page.aslink(True)), createneed = False)
- ask = True
+ self.problem('Found incorrect link to %s in %s'% (",".join([x.site().lang for x in removing]), page.aslink(True)), createneed = False)
+ ask = True
if globalvar.force:
ask = False
if globalvar.confirm:
Bugs item #2217846, was opened at 2008-11-03 04:31
Message generated for change (Settings changed) made by a_engels
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217846&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Purodha B Blissenbach (purodha)
Assigned to: Nobody/Anonymous (nobody)
Summary: interwiki.py: BUG: Non-unicode (<type 'str'>) passed to wiki
Initial Comment:
Mon Nov 3 03:24:21 UTC 2008
python /home/purodha/pywikipedia/interwiki.py -v -putthrottle:1 -start:Saachjropp:A
Checked for running processes. 1 processes currently running, including the current process.
Pywikipediabot (r6025 (wikipedia.py), Oct 26 2008, 14:51:32)
Python 2.5.2 (r252:60911, Sep 29 2008, 21:10:35)
[GCC 4.3.2]
Retrieving mediawiki messages from Special:Allmessages
WARNING: No character set found.
NOTE: Number of pages queued is 0, trying to add 60 more.
Getting 60 pages from wikipedia:ksh...
[[ several 100 messages skipped ]]
Stopping work on [[Saachjrupp:Esse & Drinke]] because duplicate pages [[zh:Category:??]] and [[zh:Category:??]] are found
DBG> BUG: Non-unicode (<type 'str'>) passed to wikipedia.output without decoder!
File "/home/purodha/pywikipedia/interwiki.py", line 1797, in <module>
bot.run()
File "/home/purodha/pywikipedia/interwiki.py", line 1532, in run
self.queryStep()
File "/home/purodha/pywikipedia/interwiki.py", line 1511, in queryStep
subj.finish(self)
File "/home/purodha/pywikipedia/interwiki.py", line 1019, in finish
wikipedia.output("Stopping work on %s."%self.originPage)
File "/home/purodha/pywikipedia/wikipedia.py", line 6440, in output
print traceback.print_stack()
None
DBG> Attempting to recover, but please report this problem
Stopping work on [[Saachjrupp:Esse & Drinke]].
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217846&group_…
Bugs item #2214050, was opened at 2008-11-01 23:22
Message generated for change (Comment added) made by kwj2772
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2214050&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Woo-Jin Kim (kwj2772)
Assigned to: Nobody/Anonymous (nobody)
Summary: checkimages.py - failed to load category on ko.wp
Initial Comment:
revision:6048
On ko.wikipedia, I tried to run this bot, but the bot has failed to load category which including license tags.
Note:Korean Wikipedia does not use Latin alphabet.
Error message:
C:\Python25\checkimage>checkimages.py -limit:200
Checked for running processes. 1 processes currently running, including the curr
ent process.
Retrieving the latest 200 files for checking...
...Loading the licenses allowed...
Loading 분류:그림 저작권 틀...
Execution time: 1
Traceback (most recent call last):
File "C:\Python25\checkimage\checkimages.py", line 1707, in <module>
checkbot()
File "C:\Python25\checkimage\checkimages.py", line 1615, in checkbot
mainClass = main(site, sendemailActive = sendemailActive, duplicatesReport =
duplicatesReport)
File "C:\Python25\checkimage\checkimages.py", line 575, in __init__
self.list_licenses = self.load_licenses()
File "C:\Python25\checkimage\checkimages.py", line 1087, in load_licenses
list_licenses = categoryAllPageObjects(catName)
File "C:\Python25\checkimage\checkimages.py", line 537, in categoryAllPageObje
cts
for element in categoryAllElements(CatName):
File "C:\Python25\checkimage\checkimages.py", line 515, in categoryAllElements
members = data['query']['categorymembers']
KeyError: 'query'
----------------------------------------------------------------------
Comment By: Woo-Jin Kim (kwj2772)
Date: 2008-11-03 15:45
Message:
I tried to changing line 508. Another problem raised:
C:\Python25\checkimage>checkimages.py -limit:250
Checked for running processes. 1 processes currently running, including
the curr
ent process.
Retrieving the latest 250 files for checking...
...Loading the licenses allowed...
Loading 분류:그림 저작권 틀...
NOTE: You have new messages on wikipedia:ko
WARNING: Your account on wikipedia:ko does not have a bot flag. Its edits
will b
e visible in the recent changes and it may get blocked.
>> No additional settings found! <<
WARNING: Your account on wikipedia:ko does not have a bot flag. Its edits
will b
e visible in the recent changes and it may get blocked.
WARNING: Your account on wikipedia:ko does not have a bot flag. Its edits
will b
e visible in the recent changes and it may get blocked.
Execution time: 7
Traceback (most recent call last):
File "C:\Python25\checkimage\checkimages.py", line 1707, in <module>
checkbot()
File "C:\Python25\checkimage\checkimages.py", line 1692, in checkbot
resultCheck = mainClass.checkStep()
File "C:\Python25\checkimage\checkimages.py", line 1412, in checkStep
(license_found, hiddenTemplateFound) = self.smartDetection()
File "C:\Python25\checkimage\checkimages.py", line 1154, in
smartDetection
self.licenses_found = self.image.getTemplates()
File "C:\Python25\checkimage\wikipedia.py", line 937, in getTemplates
pageid = data['query']['pages'].keys()[0]
KeyError: 'query'
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2008-11-03 05:29
Message:
The api raises an error:
{u'error': {u'info': u'cmlimit may not be over 500 (set to 5000) for
users', u'code': u'cmlimit'}}
As a workaround, you could try changing line 508:
'cmlimit' :'5000',
to:
'cmlimit' :'500',
But the code /should/ just use continuation which is supported in the
api...
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2214050&group_…
Bugs item #2217938, was opened at 2008-11-03 05:17
Message generated for change (Tracker Item Submitted) made by Item Submitter
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217938&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Marc-Etienne Vargenau (vargenau)
Assigned to: Nobody/Anonymous (nobody)
Summary: Bot no longer writes file autonomous_problem.dat
Initial Comment:
Hello,
Since recently, the bot no longer writes file autonomous_problem.dat in case of conflict.
So you cannot run the bot manually afterwards to correct conflicts.
python version.py
Pywikipedia [http] trunk/pywikipedia (r6049, Nov 01 2008, 23:20:35)
Python 2.5.1 (r251:54869, Apr 18 2007, 22:08:04)
[GCC 4.0.1 (Apple Computer, Inc. build 5367)]
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2217938&group_…
Feature Requests item #2168298, was opened at 2008-10-15 12:00
Message generated for change (Comment added) made by purodha
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2168298&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
Status: Pending
Priority: 5
Private: No
Submitted By: Purodha B Blissenbach (purodha)
Assigned to: Purodha B Blissenbach (purodha)
Summary: add -hint:latin to interwiki.py
Initial Comment:
interwiki.py already supports -hint:cyril so as to select all wikis of a familiy using the cyrillic script.
Adding -hint:latin only appears logical, an will be useful e.g. when dealing with proper names that
can most often be expected to be spellt alike in almost all languages using the Latin script.
----------------------------------------------------------------------
Comment By: Purodha B Blissenbach (purodha)
Date: 2008-11-03 03:35
Message:
Done with R5978.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2168298&group_…
Feature Requests item #2168298, was opened at 2008-10-15 12:00
Message generated for change (Settings changed) made by purodha
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2168298&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
>Status: Pending
Priority: 5
Private: No
Submitted By: Purodha B Blissenbach (purodha)
>Assigned to: Purodha B Blissenbach (purodha)
Summary: add -hint:latin to interwiki.py
Initial Comment:
interwiki.py already supports -hint:cyril so as to select all wikis of a familiy using the cyrillic script.
Adding -hint:latin only appears logical, an will be useful e.g. when dealing with proper names that
can most often be expected to be spellt alike in almost all languages using the Latin script.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2168298&group_…