[Pywikipedia-l] [ pywikipediabot-Bugs-1771889 ] Problems with namespaces in wikipedia.py

[SourceForge.net]

Bugs item #1771889, was opened at 2007-08-10 17:20
Message generated for change (Comment added) made by falk_steinhauer
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1771889&group_id=93107

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Bernhard Mayr (falk_steinhauer)
Assigned to: Nobody/Anonymous (nobody)
Summary: Problems with namespaces in wikipedia.py

Initial Comment:
I am using snapshot 2007-06-19:

In our wiki we are using title prefixes for articles that are not in german. They are Fr: (French) and En: (Englisch).

One of our French articles marks the end of a subarticle of [[Special:All Pages]] (see here: http://www.wiki-aventurica.de/index.php?title=Spezial:Alle_Seiten)

If I am using commandline option -start:! the script runs into a recursion. After Fr:xxxx is yielded the script whishes to continue with article xxxx, which is in my case alphabetically before Fr:xxxx. You can see, that this leads to a recursion. If xxxx is after Fr:xxxx, some articles might be skipped. 


I detected the reponsible line of code:
wikipedia.py   line 3504
                # save the last hit, so that we know where to continue when we
                # finished all articles on the current page. Append a '!' so that
                # we don't yield a page twice.
                start = Page(self,hit).titleWithoutNamespace() + '!'

Maybe this can also be fixed in titleWithoutNamespace() 


Is it necessary to cut off the namespace?



----------------------------------------------------------------------

>Comment By: Bernhard Mayr (falk_steinhauer)
Date: 2007-12-29 12:28

Message:
Logged In: YES 
user_id=1810075
Originator: YES

This item can be closed. 

The problem was caused through wrong entries in wikiaventurica_family.py

----------------------------------------------------------------------

Comment By: Bernhard Mayr (falk_steinhauer)
Date: 2007-08-13 22:54

Message:
Logged In: YES 
user_id=1810075
Originator: YES

I don't have these problems with the actual release. That's why I stepped
back. 

We worked around the initial problem within our wiki.

----------------------------------------------------------------------

Comment By: Daniel Herding (wikipedian)
Date: 2007-08-13 10:20

Message:
Logged In: YES 
user_id=880694
Originator: NO

The timeouts are a way to reduce database server load during peak times.
See: http://www.mediawiki.org/wiki/Manual:Maxlag_parameter

Maybe your server is generally a bit slow, so try to increase the maxlag
parameter in your user-config.py, for example:

maxlag = 10

----------------------------------------------------------------------

Comment By: Nobody/Anonymous (nobody)
Date: 2007-08-11 11:48

Message:
Logged In: NO 

I stepped back to snapshot 2007-06-19 because of several problems with
nightly build 2007-08-10 08:39:28.

With this version my scripts were not able to change pages with
wikipedia.Page.put(). Server timeout was reported frequently, but the
server was not down.

----------------------------------------------------------------------

Comment By: Bernhard Mayr (falk_steinhauer)
Date: 2007-08-10 23:34

Message:
Logged In: YES 
user_id=1810075
Originator: YES

Something is still disturbing. Our language prefixes are still cut off.
But so such pages cannot be found in namespace 0.

----------------------------------------------------------------------

Comment By: Bernhard Mayr (falk_steinhauer)
Date: 2007-08-10 23:26

Message:
Logged In: YES 
user_id=1810075
Originator: YES

Thanks now it works. 

Some strange thing is, that no redirects are yielded, but parameter
includeredirects of AllpagesPageGenerator() is default set to True.

----------------------------------------------------------------------

Comment By: Merlijn S. van Deen (valhallasw)
Date: 2007-08-10 18:55

Message:
Logged In: YES 
user_id=687283
Originator: NO

Strange, as these prefixes should not be interpreted as namespaces. For
now, please update to SVN or the latest nightly (
http://tools.wikimedia.de/~valhallasw/pywiki/ ), and test if the issue
still exists.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1771889&group_id=93107