Bugs item #1914786, was opened at 2008-03-15 12:13 Message generated for change (Settings changed) made by filnik You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1914786...
Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None
Status: Closed
Resolution: Out of Date Priority: 8 Private: No Submitted By: Filnik (filnik) Assigned to: Nobody/Anonymous (nobody) Summary: Great Waste of CPU and/or RAM on interwiki.py and replace.py
Initial Comment: Hello, I have a lot of regex to run with replace.py and I've group them in the fixes.py file and make it run through the whole italian wikipedia. But, after 1-2 days of running, the program was wasting this amount of resources:
filnik 32709 8.9 11.1 1074936 903376 pts/113 Sl+ Mar12 357:09 python2.5 pynik <etc...>
Re-running the bot (from the page that it has reached) I have that:
filnik 31372 2.8 0.2 193564 21992 pts/113 Sl+ 11:58 0:17 python2.5 pynik <etc...>
That's A LOT less than before! So, what the hell is happening? why the Bot doesn't release the resources that it uses when they aren't need any more?
The same appends for interwiki.py, I have tried to use python2.5 instead of 2.4 but without any results. I've also tried to use "del" on python but no results also with that.
So, any Idea? Filnik
P.S. Fix that bug would improve the use of interwiki.py on the toolserver and of replace.py, I think the most used scripts, so I've set 8 as importance.
----------------------------------------------------------------------
Comment By: Filnik (filnik)
Date: 2009-12-31 13:15
Message: Sorry, it's a old bug, that I've already fixed (but I've forgotten to close the request).
----------------------------------------------------------------------
Comment By: xqt (xqt) Date: 2009-12-28 11:21
Message: Since there are a lot of changes at the related scripts. Is this bug still valid? Otherwise it could be closed due to out of date.
----------------------------------------------------------------------
Comment By: lusum (lusum) Date: 2008-03-23 20:06
Message: Logged In: YES user_id=642982 Originator: NO
I have done some tests: the problem seem caused by some del statement in code it seem mostly due to the del instruction in def replaceLinks(self, page, newPages, bot): I have tried to fix it, using a new.remove instead del new... but without success
----------------------------------------------------------------------
You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1914786...
pywikipedia-bugs@lists.wikimedia.org