On Fri, Feb 21, 2003 at 01:05:46PM +0100, Dan Koehl wrote: It's not that they do that. This may be automatically done by their browser. BTW, we should add proper html's http-equiv meta Content-Type for charset to all wiki pages, so that page saved to disk has charset information too.

On Fri, 21 Feb 2003, Tomasz Wegrzanowski wrote: And by Tomasz's email program too... Andre

What's this all about? $wgDBminWordLen = 3; # Match this to your MySQL fulltext Fred

Ok, well the problem is not that great, I have corrected two files in two months, which is nothing. If theres nothing to do, its not the end of the world. Strange though, that the browser accept ä and ö but not å. I suppose its because a large number of european users are German, while theres too less of the old Swedes, thats why å was not implemented. Nothing to do, and its not a big problem anyhow. Over and Out.- Dan ----- Original Message ----- From: "Andre Engels" <engels(a)uni-koblenz.de> To: <wikitech-l(a)wikipedia.org> Sent: Friday, February 21, 2003 2:53 PM Subject: Re: [Wikitech-l] Re: [Wikitech-l] Swedish umlaut å, ä, and ö. to easy?? while stille and makes ä is fault. set, PHP happens given

On Fri, 21 Feb 2003, Fred Bauder wrote: MySQL's FULLTEXT indexing is used for the search function; the index by default ignores words shorted than some number of letters (3 or 4?). Our search function does a primitive boolean search by parsing the search query into words (eg, "dime a dozen" -> "dime", "a", "dozen") and doing separate MATCH queries on each one using the index, then ANDing the results together logically. So an article has to match all words to come up in the results. But, the "a" is too short (and anyway a stopword -- another issue itself) and so ignored by the search; it doesn't match *any* articles. So, we have to know which words are going to be ignored by MySQL's fulltext search so we can skip them. "dime a dozen" -> "dime" and "dozen". This would go away using MySQL 4, which has a boolean search mode for its fulltext searching, but since there are a lot of mysql3 installations out there we'd have to keep this around as an option. See the mySQL docs: http://www.mysql.com/doc/en/Fulltext_Search.html -- brion vibber (brion @ pobox.com)

On Mon, 24 Feb 2003, Lars Aronsson wrote: Yup. All I know is I hear complaints when I change to the straight search method as a performance hack and people find that "John Smith" turns up mostly results like "John Wigglesworth" and "Michael Smith". -- brion vibber (brion @ pobox.com)

On Mon, 24 Feb 2003, Lee Daniel Crocker wrote: Well, yes and no. If we don't parse the query into separate words, it doesn't matter how much we hand to it: a MATCH AGAINST( "Windows XP" ) will still turn up all the results for "Windows", whereas MATCH AGAINST( "Windows" ) AND MATCH AGAINST ("XP") returns nothing at all -- that's why we need to be aware of it and remove the too-short words from the search using our hackish boolean system. However, it would be nice to spit out a little message to the effect of "The word 'XP' has been ignored in your search because MySQl doesn't like it," whatever the search method. -- brion vibber (brion @ pobox.com)

On Mon, 24 Feb 2003, Lee Daniel Crocker wrote: Still doesn't help with "vitamin E" or "C sharp"... Any reason we can't take it down to 1? -- brion vibber (brion @ pobox.com)

On Mon, 24 Feb 2003, Lee Daniel Crocker wrote: 24/26ths less confusion than none of them working, I'd wager. In most cases they'd be meaningful _enough_ though, for two reasons: a) alphabetical lists, "I", and "a" are very rare in article titles, which we search separately from body text. Yes, there's going to be the occasional spurious "Biographical index -- C through G", but does that negate the utilitity of returning "C programming language" (and a few other pages) instead of nothing to the hapless kid searching for that hip programming language? b) in most cases such searches will be in conjunction with other words. "Vitamin C" or "Malcom X" will appear more often in conjunction when they are in fact mentioned together than in random unrelated lists. There will be some false positives, but that's better than many many false negatives. -- brion vibber (brion @ pobox.com)

On Sat, Mar 08, 2003 at 06:26:00AM -0700, Fred Bauder wrote: You should put "sysop" there to become a sysop.