On Apr 2, 2004, at 00:53, Jimmy Wales wrote:

...

It shouldn't run more than once per day at first. I'm not sure what their goals are with respect to how often they would *like*

to receive

...

it, but daily is a fine start.

It would take hours just to run a complete dump, which would be the equivalent of a sizeable fraction of our total daily page views. (Best case might be 100ms per page for 240,000 pages =~ 6 hours 40 minutes)

If we're going to run something like this daily, some sort of incremental updates are a must, though we can probably get away with stuffing the saved data per page in a database or such and slurping it back out fairly quickly.

-- brion vibber (brion @ pobox.com)

Incremental need to check in the database each time if this is the last version, no ?

Why not using a slave db server on less loaded server ? (like zwinger for example (need to add another ide drive))

Shaihulud