Bugs item #1914786, was opened at 2008-03-15 13:13
Message generated for change (Comment added) made by lusum
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=191478…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 8
Private: No
Submitted By: Filnik (filnik)
Assigned to: Nobody/Anonymous (nobody)
Summary: Great Waste of CPU and/or RAM on interwiki.py and replace.py
Initial Comment:
Hello, I have a lot of regex to run with replace.py and I've group them in the
fixes.py file and make it run through the whole italian wikipedia. But, after 1-2 days of
running, the program was wasting this amount of resources:
filnik 32709 8.9 11.1 1074936 903376 pts/113 Sl+ Mar12 357:09 python2.5 pynik
<etc...>
Re-running the bot (from the page that it has reached) I have that:
filnik 31372 2.8 0.2 193564 21992 pts/113 Sl+ 11:58 0:17 python2.5 pynik
<etc...>
That's A LOT less than before! So, what the hell is happening? why the Bot doesn't
release the resources that it uses when they aren't need any more?
The same appends for interwiki.py, I have tried to use python2.5 instead of 2.4 but
without any results. I've also tried to use "del" on python but no results
also with that.
So, any Idea? Filnik
P.S. Fix that bug would improve the use of interwiki.py on the toolserver and of
replace.py, I think the most used scripts, so I've set 8 as importance.
----------------------------------------------------------------------
Comment By: lusum (lusum)
Date: 2008-03-23 21:06
Message:
Logged In: YES
user_id=642982
Originator: NO
I have done some tests: the problem seem caused by some del statement in
code it seem mostly due to the del instruction in def replaceLinks(self,
page, newPages, bot):
I have tried to fix it, using a new.remove instead del new... but without
success
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=191478…