Bugs item #1914786, was opened at 2008-03-15 13:13 Message generated for change (Comment added) made by lusum You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1914786...
Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 8 Private: No Submitted By: Filnik (filnik) Assigned to: Nobody/Anonymous (nobody) Summary: Great Waste of CPU and/or RAM on interwiki.py and replace.py
Initial Comment: Hello, I have a lot of regex to run with replace.py and I've group them in the fixes.py file and make it run through the whole italian wikipedia. But, after 1-2 days of running, the program was wasting this amount of resources:
filnik 32709 8.9 11.1 1074936 903376 pts/113 Sl+ Mar12 357:09 python2.5 pynik <etc...>
Re-running the bot (from the page that it has reached) I have that:
filnik 31372 2.8 0.2 193564 21992 pts/113 Sl+ 11:58 0:17 python2.5 pynik <etc...>
That's A LOT less than before! So, what the hell is happening? why the Bot doesn't release the resources that it uses when they aren't need any more?
The same appends for interwiki.py, I have tried to use python2.5 instead of 2.4 but without any results. I've also tried to use "del" on python but no results also with that.
So, any Idea? Filnik
P.S. Fix that bug would improve the use of interwiki.py on the toolserver and of replace.py, I think the most used scripts, so I've set 8 as importance.
----------------------------------------------------------------------
Comment By: lusum (lusum) Date: 2008-03-23 21:06
Message: Logged In: YES user_id=642982 Originator: NO
I have done some tests: the problem seem caused by some del statement in code it seem mostly due to the del instruction in def replaceLinks(self, page, newPages, bot): I have tried to fix it, using a new.remove instead del new... but without success
----------------------------------------------------------------------
You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1914786...