Hmmm. Searching for "Noam Chomsky" gives me a rather strange result.
Why is [[Noam Chomsky]] only at #4 in the results?
Hmm, good, this made me rethink the scoring, so I made some adjustments that favors larger articles a bit more, and favors more exact title matches. So now Noam Chomsky is in the right first place. :)
Otherwise, the search engine is fast and the results are overall
promising. Are you considering adding snippets of the search results?
Highlighting is a very cpu and memory consuming thingy. You need to fetch all articles in search results (i.e. 20 per page), retokenize them, fragment them in snippets, and score each snippet so you can show the best. I'm currently working on an distributed implementation for this, but it might still put too heavy load on the cluster.
r.