[Mediawiki-l] HELP: MediaWiki & Lucene-Search+MWSearch = ZERO search results ??!

agent dale cooper agentdcooper at gmail.com
Mon May 12 10:52:22 UTC 2008 

HELP: MediaWiki & Lucene-Search+MWSearch = ZERO search results ??!

Can someone '''please''' assist me?   Here's what I've got running;;

   - Slackware 12.0 <http://www.slackware.com/> on i686 Pentium III
   [Linux 2.6.21.5]
   - MediaWiki: 1.9.1
   - PHP: 5.2.5
   - MySQL: 5.0.37
   - MediaWiki Extension(s):
MWSearch<http://www.mediawiki.org/wiki/Extension:MWSearch>
   SVN<http://svn.wikimedia.org/svnroot/mediawiki/trunk/extensions/MWSearch/>(05122008),
and
   Lucene-search <http://www.mediawiki.org/wiki/Extension:Lucene-search>
   SVN<http://svn.wikimedia.org/svnroot/mediawiki/trunk/lucene-search-2/>(05122008),
+ I downloaded & installed
   mwdumper.jar <http://download.wikimedia.org/tools/mwdumper.jar> into
   the Lucene2 lib dir
   - Other tools: jre-6u2-i586-1, jdk-1_5_0_09-i586-1,
   apache-ant-1.7.0-i586-1bj, rsync-2.6.9-i486-1

I've followed the steps per
MWSearch<http://www.mediawiki.org/wiki/Extension:MWSearch>and
Lucene-search <http://www.mediawiki.org/wiki/Extension:Lucene-search> pages,
to the T - I've gone over and over them several times, I've tried to search
these forums <http://www.mwusers.com/%20MediaWiki%20Forums>, and the
MediaWiki-L
mailing list <http://lists.wikimedia.org/pipermail/mediawiki-l> ... please
help me! =)

*;; My Local LuceneSearch configuration ;;*
LuceneSearch SVN<http://svn.wikimedia.org/svnroot/mediawiki/trunk/lucene-search-2>Install
dir: /usr/local/search/lucene-search-2svn05112008
Indexes stored: /usr/local/search/indexes

*  ;;  my /etc/lsearch.conf ;;*
<pre>
MWConfig.global=file:///etc/lsearch-global.conf
MWConfig.lib=/usr/local/search/lucene-search-2svn05112008/lib
Indexes.path=/usr/local/search/indexes
Search.updateinterval=1
Search.updatedelay=0
Search.checkinterval=30
Index.snapshotinterval=5
Index.maxqueuecount=5000
Index.maxqueuetimeout=12
Storage.master=localhost
Storage.username=wikiuser
Storage.password=mypass
Storage.useSeparateDBs=false
Storage.defaultDB=wikidb
Storage.lib=/usr/local/search/lucene-search-2svn05112008/sql
Localization.url=file:///var/www/htdocs/wiki/languages/messages
Logging.logconfig=/etc/lsearch.log4j
Logging.debug=true
</pre>


    *;; my /etc/lsearch-global.conf ;;*
<pre>
[Database]
wikidb : (single) (language,en) (warmup,10)
[Search-Group]
nen-tftp : wikidb
[Index]
nen-tftp : wikidb
[Index-Path]
<default> : /usr/local/search/indexes
[OAI]
wiktionary : http://$lang.wiktionary.org/w/index.php
wikilucene : http://localhost/wiki-lucene/phase3/index.php
<default> : http://$lang.wikipedia.org/w/index.php
[Properties]
Database.suffix=wiki wiktionary wikidb
KeywordScoring.suffix=wikidb wiki wikilucene wikidev
ExactCase.suffix=wikidb wiktionary wikilucene
[Namespace-Prefix]
all : <all>
[0] : 0
[1] : 1
[2] : 2
[3] : 3
[4] : 4
[5] : 5
[6] : 6
[7] : 7
[8] : 8
[9] : 9
[10] : 10
[11] : 11
[12] : 12
[13] : 13
[14] : 14
[15] : 15
</pre>


*     ;; my /etc/lsearch.log4j ;;*
<pre>
log4j.rootLogger=INFO, A1
log4j.appender.A1=org.apache.log4j.ConsoleAppender
log4j.appender.A1.layout=org.apache.log4j.PatternLayout
log4j.appender.A1.layout.ConversionPattern=%-4r [%t] %-5p %c %x - %m%n
</pre>

*    ;; relevant /var/www/htdocs/wiki/LocalSettings.php settings ;;*
<pre>
$wgSearchType = 'LuceneSearch';
$wgLuceneHost = 'localhost';
$wgLucenePort = 8123;
require_once("extensions/MWSearch/MWSearch.php");
</pre>

*;; Building the index works running dumpBackup(Init).php ;;*
<pre>
> php maintenance/dumpBackupInit.php --current --quiet > wikidb.xml && java
-cp /usr/local/search/lucene-search-2svn05112008/LuceneSearch.jar
org.wikimedia.lsearch.importer.Importer -s /var/www/htdocs/wiki/wikidb.xml
wikidb
MediaWiki Lucene search indexer - index builder from xml database dumps.

Trying config file at path /root/.lsearch.conf
Trying config file at path /var/www/htdocs/wiki/lsearch.conf
Trying config file at path /etc/lsearch.conf
log4j: Trying to find [log4j.xml] using context classloader
sun.misc.Launcher$AppClassLoader at 133056f.
log4j: Trying to find [log4j.xml] using
sun.misc.Launcher$AppClassLoader at 133056f class loader.
log4j: Trying to find [log4j.xml] using ClassLoader.getSystemResource().
log4j: Trying to find [log4j.properties] using context classloader
sun.misc.Launcher$AppClassLoader at 133056f.
log4j: Trying to find [log4j.properties] using
sun.misc.Launcher$AppClassLoader at 133056f class loader.
log4j: Trying to find [log4j.properties] using
ClassLoader.getSystemResource().
log4j: Could not find resource: [null].
log4j: Parsing for [root] with value=[INFO, A1].
log4j: Level token is [INFO].
log4j: Category root set to INFO
log4j: Parsing appender named "A1".
log4j: Parsing layout options for "A1".
log4j: Setting property [conversionPattern] to [%-4r [%t] %-5p %c %x -
%m%n].
log4j: End of parsing for "A1".
log4j: Parsed "A1" options.
log4j: Finished configuring.
0    [main] INFO  org.wikimedia.lsearch.util.UnicodeDecomposer  - Loaded
unicode decomposer
18   [main] INFO  org.wikimedia.lsearch.util.Localization  - Reading
localization for En
434  [main] INFO  org.wikimedia.lsearch.ranks.RankBuilder  - First pass,
getting a list of valid articles...
94 pages (99.576/sec), 94 revs (99.576/sec)
1527 [main] INFO  org.wikimedia.lsearch.ranks.RankBuilder  - Second pass,
calculating article links...
94 pages (326.389/sec), 94 revs (326.389/sec)
1928 [main] INFO  org.wikimedia.lsearch.importer.Importer  - Third pass,
indexing articles...
94 pages (24.588/sec), 94 revs (24.588/sec)
6005 [main] INFO  org.wikimedia.lsearch.importer.Importer  -
Closing/optimizing index...
Finished indexing in 5s, with final index optimization in 0s
Total time: 6s
6530 [main] INFO  org.wikimedia.lsearch.index.IndexThread  - Making snapshot
for wikidb
6582 [main] INFO  org.wikimedia.lsearch.index.IndexThread  - Made snapshot
/usr/local/search/indexes/snapshot/wikidb/20080512024654</pre>

*The above creates a 277KB file @ /var/www/htdocs/wiki/wikidb.xml , which
looks just fine to me...*

*;; Starting the lsearch daemon is working ;;*
When I run my script */usr/local/search/lucene-search-2svn05112008* - which
starts the lsearch deamon, I get the following, which *ALSO* *looks fine* ;
<pre>
java
-Djava.rmi.server.codebase=file:///usr/local/search/lucene-search-2svn05112008/LuceneSeah.jar
-Djava.rmi.server.hostname=nen-tftp -jar
/usr/local/search/lucene-search-2svn05112008/LuceneSearch.jar $*
RMI registry started.
Trying config file at path /root/.lsearch.conf
Trying config file at path
/usr/local/search/lucene-search-2svn05112008/lsearch.conf
log4j: Parsing for [root] with value=[INFO, A1].
log4j: Level token is [INFO].
log4j: Category root set to INFO
log4j: Parsing appender named "A1".
log4j: Parsing layout options for "A1".
log4j: Setting property [conversionPattern] to [%-4r [%t] %-5p %c %x -
%m%n].
log4j: End of parsing for "A1".
log4j: Parsed "A1" options.
log4j: Finished configuring.
0    [main] INFO  org.wikimedia.lsearch.util.Localization  - Reading
localization for En
2351 [main] INFO  org.wikimedia.lsearch.util.UnicodeDecomposer  - Loaded
unicode decomposer
2600 [main] INFO  org.wikimedia.lsearch.interoperability.RMIServer  -
RMIMessenger bound
2882 [main] INFO  org.wikimedia.lsearch.interoperability.RMIServer  -
RemoteSearchable<wikidb> bound
2914 [main] INFO  org.wikimedia.lsearch.search.Warmup  - Warming up index
wikidb ...
2928 [Thread-2] INFO  org.wikimedia.lsearch.frontend.HTTPIndexServer  -
Started server at port 8321
2929 [Thread-3] INFO  org.wikimedia.lsearch.frontend.SearchServer  - Binding
server to port 8123
4246 [main] INFO  org.wikimedia.lsearch.search.Warmup  - Warmed up wikidb in
1331 ms
4246 [main] INFO  org.wikimedia.lsearch.search.Warmup  - Warming up index
wikidb ...
5079 [main] INFO  org.wikimedia.lsearch.search.Warmup  - Warmed up wikidb in
833 ms
5079 [main] INFO  org.wikimedia.lsearch.search.Warmup  - Warming up index
wikidb ...
5861 [main] INFO  org.wikimedia.lsearch.search.Warmup  - Warmed up wikidb in
782 ms
</pre>

*From here*, I pull up my normal wiki, which has been working fine ALL along
- but now, I get ZERO search results, no matter what I do! I know I am
searching correctly, I just type in 1 single word for searching (that I
'''know''' is on several pages in the wiki) I've even tried to ''edit'' the
file before and after building the index, and starting/stoping the lsearch
daemon, yet I get this error in my MediaWiki search results page;
<pre>
Search results

More information about the MediaWiki-l mailing list