On Tue, 08 May 2007 15:14:52 -0400, Jay R. Ashworth wrote:
On Tue, May 08, 2007 at 11:13:07AM -0700, Evan Martin wrote:
I think the best solution for vandalism is to set up a system that allows pages to be marked as needing expedited recrawling. This wouldn't be for every updated page -- just those that someone with sufficient access (an admin?) had explicitly marked. (It'd be best if this information were *not* pushed directly to Google, because ideally every search engine would be able to make use of it.)
I concur that it would be useful if everyone could make use of it, but, given the target problem, if it *wasn't* pushed to the engines, I don't see how it would be useful... unless you pinged it every 15 minutes or so. And of course, there is a potential for abuse, no matter how it's implemented. Balancing the attendant risks is the underlying problem, as it always is.
I'd think letting sites ping it as often as they want to update should be feasible. An extra request every 15 minutes isn't so much. If we were to do a push model, I think it'd be better to let anyone subscribe to the feed.