On Wed, 03 Dec 2008 16:48:39 +0100, Roan Kattouw <roan.kattouw@home.nl
wrote:
We had a pretty lengthy discussion about this before the summer, and the consensus seemed to be that a fulltext-based approach looked most viable. I actually wrote an extension that does that, and promised to release it soon; that was quite a few months ago, and I never got around to it. I'll release it properly when I have time, which will hopefully be before Christmas :D
The code needs some tweaking and refactoring, though. It's pretty tightly integrated with the article text search (both functions in one form) and has all kinds of weird features, because the guy who paid me to write it wanted them. It also doesn't support three-letter word searching (which core does these days, using a prefix hack), which is pretty bad since categories with short titles (or stopword titles) won't be found either.
Roan Kattouw (Catrope)
Hey Roan, does your code use the a new table for the category search (with fulltext index) and do you have the hooks for maintaining that table? Do you display the the results on a new search results page, or did you hack the existing one? Basically, I'm thinking that even if your stuff isn't ready for prime time, you may have already done a lot of the heavy lifting... can we get our hands on it?
Thanks! Aerik
Aerik Sylvan schreef:
Hey Roan, does your code use the a new table for the category search (with fulltext index)
Yes
and do you have the hooks for maintaining that table?
Yes. I even have a maintenance script to populate it.
Do you display the the results on a new search results page, or did you hack the existing one?
I use a new search interface, which has all kinds of weird features.
Basically, I'm thinking that even if your stuff isn't ready for prime time, you may have already done a lot of the heavy lifting... can we get our hands on it?
Sure. You'll have to strip out most of the crazy features and you'll probably want to write a new UI and refactor some stuff here and there, but it's quite usable. I'll upload it tomorrow, gotta go get some sleep now.
Roan Kattouw (Catrope)
Roan Kattouw schreef:
Sure. You'll have to strip out most of the crazy features and you'll probably want to write a new UI and refactor some stuff here and there, but it's quite usable. I'll upload it tomorrow, gotta go get some sleep now.
Uploaded it at last. It's in the SVN extensions repository [1]. Feel free to completely overhaul the code and repurpose it to be a generic category intersection framework, or to just steal bits of code and use them elsewhere.
Roan Kattouw (Catrope)
[1] http://svn.wikimedia.org/viewvc/mediawiki/trunk/extensions/AdvancedSearch/
I just read the last category intersection discussion from December to see, what's the latest state of it. While doing that, I saw, that the last message in that thread was this post from Roan Kattouw, providing his extension. Oddly, nobody reacted on it. After 65 posts on that thread somebody posted a solution and nobody reacted.....
Can this extension be seen live anywhere?
Marcus Buck
Roan Kattouw hett schreven:
Roan Kattouw schreef:
Sure. You'll have to strip out most of the crazy features and you'll probably want to write a new UI and refactor some stuff here and there, but it's quite usable. I'll upload it tomorrow, gotta go get some sleep now.
Uploaded it at last. It's in the SVN extensions repository [1]. Feel free to completely overhaul the code and repurpose it to be a generic category intersection framework, or to just steal bits of code and use them elsewhere.
Roan Kattouw (Catrope)
[1] http://svn.wikimedia.org/viewvc/mediawiki/trunk/extensions/AdvancedSearch/
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Fri, Jan 30, 2009 at 10:04 PM, Marcus Buck wiki@marcusbuck.org wrote:
I just read the last category intersection discussion from<snip> After 65 posts on that thread somebody posted a solution and nobody reacted.....
They got exhausted?
(p m, c r)
-- --alnokta
Marcus Buck schreef:
I just read the last category intersection discussion from December to see, what's the latest state of it. While doing that, I saw, that the last message in that thread was this post from Roan Kattouw, providing his extension. Oddly, nobody reacted on it. After 65 posts on that thread somebody posted a solution and nobody reacted.....
Can this extension be seen live anywhere?
Yes, actually, at http://mixesdb.com/db/index.php/Special:AdvancedSearch (the site I was hired to write it for in the first place).
Roan Kattouw (Catrope)
2009/1/31 Roan Kattouw roan.kattouw@home.nl:
Marcus Buck schreef:
I just read the last category intersection discussion from December to see, what's the latest state of it. While doing that, I saw, that the last message in that thread was this post from Roan Kattouw, providing his extension. Oddly, nobody reacted on it. After 65 posts on that thread somebody posted a solution and nobody reacted..... Can this extension be seen live anywhere?
Yes, actually, at http://mixesdb.com/db/index.php/Special:AdvancedSearch (the site I was hired to write it for in the first place).
Win!
So what's in the way of this going live on Wikimedia?
(Commons first?)
- d.
David Gerard schreef:
Win!
So what's in the way of this going live on Wikimedia?
(Commons first?
As I said before, the extension was written especially for MixesDB, and has all kinds of features WMF wikis don't need or don't want for performance reasons. Also, the UI is pretty crude (note that all the pretty colors and help stuff was added by the MixesDB guy). The most useful part is the code that builds, maintains and searches a category index, but it hasn't been updated to include Andrew's hack for short words yet, and it should probably be ported to use Lucene for use on WMF wikis.
Roan Kattouw (Catrope)
wikitech-l@lists.wikimedia.org