howard chen wrote:
Hello,
One of my interest is how Wikipedia's Lucene implmentation can be used to tackle foreign languages such as Chinese or Japanese, where tokenization is more complex.
Besides, will the search engine be open sourced later?
It's always been open source.
http://svn.wikimedia.org/svnroot/mediawiki/trunk/lucene-search-2/
and further refactoring and work is going on on branch:
http://svn.wikimedia.org/svnroot/mediawiki/branches/lucene-search-2.1/
-- brion vibber (brion @ wikimedia.org)