Hello,
I wrote a MediaWiki extension to search wikicontent using Hyper Estraier, a full-text search engine.
Description has been posted at http://meta.wikimedia.org/wiki/Hyper_Estraier_extension
About Hyper Estraier: * Sourceforge: http://hyperestraier.sourceforge.net/ * OS Reviews: http://www.osreviews.net/reviews/misc/hyperestraier
And I set up a demo site uses this extension to search Japanese Wikipedia content. http://ja.wikipedia.tietew.jp/wiki/Special:Search
Look'n'feel is derived from LuceneSearch.php. Search results and content summary are generated by Hyper Estraier search server.
== Background == Current wikipedia's lucene-search is tooo bad about searching Japanese. I think Hyper Estraier is better for languages whose sentence is not separated by space, such as Japanese and Chinese.
see also: http://meta.wikimedia.org/wiki/Summer_of_Code_2006#I18n_search_index
## I have no idea which engine is better for europian languages.
== Request == I want to test and demo real-time index update from live Wikipedia. Could you please give me a permittion to access OAIRepository?
== Comparation ==
word: "ウィキペディア" (Wikipedia) Hyper Estraier: 490 hits http://ja.wikipedia.tietew.jp/w/index.php?title=%E7%89%B9%E5%88%A5:Search&am... http://ja.wikipedia.tietew.jp/w/index.php?title=%E7%89%B9%E5%88%A5:Search&am... Lucene: 397 hits ... but only 40 documents are shown http://ja.wikipedia.org/w/index.php?title=%E7%89%B9%E5%88%A5:Search&sear... http://ja.wikipedia.org/w/index.php?title=%E7%89%B9%E5%88%A5:Search&sear...
word: "百科事典" (hyakka-jiten; encyclopedia) Hyper Estraier: 352 hits http://ja.wikipedia.tietew.jp/w/index.php?title=%E7%89%B9%E5%88%A5:Search&am... http://ja.wikipedia.tietew.jp/w/index.php?title=%E7%89%B9%E5%88%A5:Search&am... Lucene: 171 hits ... but only 23 documents are shown http://ja.wikipedia.org/wiki/%E7%89%B9%E5%88%A5:Search?search=%E7%99%BE%E7%A... http://ja.wikipedia.org/wiki/%E7%89%B9%E5%88%A5:Search?search=%E7%99%BE%E7%A...
Thank you.