On Thu, Feb 4, 2010 at 6:40 PM, Tim Landscheidt tim@tim-landscheidt.de wrote:
Is there any reason not to have a flatted structure some- where on the toolserver (or, in the long run, in MediaWiki)? A quick look at recentchanges for dewp shows about 22000 changes per month, about one every two minutes. With about 80000 categories in all, it should be feasible to up- date the structure incrementally, with daily/weekly/monthly clean new full "dumps" (or even dispense with up-to-the-se- cond data and just dump the flat structure hourly).
Incremental updates for a 'flattened copy' aren't especially realistic... as one user operation can produce millions of operations on the server.
I won't bother saying much more, Daniel Schwen pretty much speaks for my view.