Bugs item #1771889, was opened at 2007-08-10 19:20 Message generated for change (Comment added) made by wikipedian You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=177188… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Falk Steinhauer (falk_steinhauer) Assigned to: Nobody/Anonymous (nobody) Summary: Problems with namespaces in wikipedia.py Initial Comment: I am using snapshot 2007-06-19: In our wiki we are using title prefixes for articles that are not in german. They are Fr: (French) and En: (Englisch). One of our French articles marks the end of a subarticle of [[Special:All Pages]] (see here: http://www.wiki-aventurica.de/index.php?title=Spezial:Alle_Seiten) If I am using commandline option -start:! the script runs into a recursion. After Fr:xxxx is yielded the script whishes to continue with article xxxx, which is in my case alphabetically before Fr:xxxx. You can see, that this leads to a recursion. If xxxx is after Fr:xxxx, some articles might be skipped. I detected the reponsible line of code: wikipedia.py line 3504 # save the last hit, so that we know where to continue when we # finished all articles on the current page. Append a '!' so that # we don't yield a page twice. start = Page(self,hit).titleWithoutNamespace() + '!' Maybe this can also be fixed in titleWithoutNamespace() Is it necessary to cut off the namespace? ---------------------------------------------------------------------- Date: 2007-08-13 12:20 Message: Logged In: YES user_id=880694 Originator: NO The timeouts are a way to reduce database server load during peak times. See: http://www.mediawiki.org/wiki/Manual:Maxlag_parameter Maybe your server is generally a bit slow, so try to increase the maxlag parameter in your user-config.py, for example: maxlag = 10 ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2007-08-11 13:48 Message: Logged In: NO I stepped back to snapshot 2007-06-19 because of several problems with nightly build 2007-08-10 08:39:28. With this version my scripts were not able to change pages with wikipedia.Page.put(). Server timeout was reported frequently, but the server was not down. ---------------------------------------------------------------------- Comment By: Falk Steinhauer (falk_steinhauer) Date: 2007-08-11 01:34 Message: Logged In: YES user_id=1810075 Originator: YES Something is still disturbing. Our language prefixes are still cut off. But so such pages cannot be found in namespace 0. ---------------------------------------------------------------------- Comment By: Falk Steinhauer (falk_steinhauer) Date: 2007-08-11 01:26 Message: Logged In: YES user_id=1810075 Originator: YES Thanks now it works. Some strange thing is, that no redirects are yielded, but parameter includeredirects of AllpagesPageGenerator() is default set to True. ---------------------------------------------------------------------- Comment By: Merlijn S. van Deen (valhallasw) Date: 2007-08-10 20:55 Message: Logged In: YES user_id=687283 Originator: NO Strange, as these prefixes should not be interpreted as namespaces. For now, please update to SVN or the latest nightly ( http://tools.wikimedia.de/~valhallasw/pywiki/ ), and test if the issue still exists. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=177188…