Perhaps its time to think about rolling our own
fulltext indexing
mechanism?
Just the opposite! Let's just use mysql's fulltext search the way it
was intended. It is precisely designed for an application like ours,
and they say they optimized the parameters for large databases.
I'm sure we could not hack together anything comparable. (See also my
last post on wikipedia-l.)
Axel