Yep, but you can work out the url from the title: ------------------------------ function titleToUrl(title) { var chr, url = ""; for (var i=0; i<title.length; i++) { chr = title.charCodeAt(i); url += (chr == 32 ? "_" : escape(String.fromCharCode(chr))); } return url; } // quick test: var test_data = ["Roman Catholic Church", "cat (disambig)", "\"!@$^&*))(_--{}"]; for (var i=0; i<test_data.length; i++) { document.write(test_data[i] + " equals: " + titleToUrl(test_data[i]) + " <br>\n"); } ------------------------------ Output is: ------------------------------ Roman Catholic Church equals: Roman_Catholic_Church <br> cat (disambig) equals: cat_%28disambig%29 <br> "!@$^&amp;*))(_--{} equals: %22%21@%24%5E%26*%29%29%28_--%7B%7D <br> ------------------------------ (which seems identical to what the Wikipedia gives too). Don't have to do it this way though, and if you'd prefer to do it on the server side, then do that. I just thought that transmitting less data and potentially storing less data might help. Nah, I just make this stuff up as I go along. ;-) Should work fine though: ------------------------------ var json_data = eval("[\"cat\",[\"Catholics\", 7505, \"Roman Catholic Church\"],[\"Catholic Archibishop\", 4484, \"Bishop\"],[\"Catholic\", 4200, ],[\"Catholic\", 3269, ][\"CATV\", 2347, \"Cable television\"],[\"Catalogue astrographique\", 2095, \"Star catalogue\"],[\"Catholic Encyclopedia\", 1956, ],[\"Catalonia\", 1740, ],[\"Cattle\", 1604, ],[\"Catholicism\", 1527, ]]"); alert("length: " + json_data.length + " data: " + json_data); ------------------------------ I.e. you may have to get rid of the newlines in the data stream. All the best, Nick.

... ... Julien, I've been working on a project that's required me to both resolve links and get the target of redirections for the whole summer. Let me see if I can combine the SQL commands I've found, and come up with one to give you the target of all redirects in the database... Here we go: SELECT from_page.page_title AS from_title, to_page.page_title AS to_title FROM page from_page INNER JOIN pagelinks pl ON pl.pl_from = from_page.page_id INNER JOIN page to_page ON to_page.page_namespace = pl.pl_namespace AND to_page.page_title = pl.pl_title WHERE from_page.page_is_redirect=1; I hope that helps! Sincerely, Eric Astor P.S. My original SQL commands follow. To resolve links: CREATE TABLE resolvedlinks ( rl_from INT(8) UNSIGNED NOT NULL, rl_to INT(8) UNSIGNED NOT NULL, PRIMARY KEY (rl_from, rl_to) ) SELECT from_page.page_id AS rl_from, to_page.page_id AS rl_to FROM pagelinks INNER JOIN page from_page ON from_page.page_id=pl_from INNER JOIN page to_page ON to_page.page_namespace=pl_namespace AND to_page.page_title=CONCAT(UPPER(SUBSTRING(pl_title,1,1)),SUBSTRING(pl_title, 2)); To re-resolve the links to their actual targets (eliminating one level of redirects): DROP TEMPORARY TABLE IF EXISTS dl; CREATE TEMPORARY TABLE dl ( dl_from INT(8) UNSIGNED NOT NULL, dl_to INT(8) UNSIGNED NOT NULL ) SELECT rl_from AS dl_from, rl_to AS dl_to FROM resolvedlinks; UPDATE dl INNER JOIN page ON page.page_id=dl.dl_to INNER JOIN resolvedlinks links ON links.rl_from=dl.dl_to SET dl.dl_to=links.rl_to WHERE page.page_is_redirect=1; DROP TABLE IF EXISTS directlinks; CREATE TABLE directlinks ( dl_from INT(8) UNSIGNED NOT NULL, dl_to INT(8) UNSIGNED NOT NULL, PRIMARY KEY (dl_from, dl_to) ) SELECT DISTINCT dl_from, dl_to FROM dl; -- No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.1.405 / Virus Database: 268.10.9/416 - Release Date: 8/10/2006

Thank you Eric for your SQL queries. I will try them. Best Regards. Julien Lemoine. Eric Astor wrote:

Hi Nick, Nick Jenkins wrote: Very good job, I will integrate your patch in the 0.4 version that I will release tomorrow. Thank you very much. Best Regards. Julien

On 8/15/06, Julien Lemoine &lt;speedblue(a)happycoders.org&gt; wrote: This is nice, but I want it integrated into Wikipedia. How do we do that? Steve

Hi Julien, I was wondering if it had an extension to keep its index up to date - an "OnArticleSave" hook. With that a really useful place to hook it in would not be just the search, but also the edit box. Little bit of js that checks for the user inputting [[, and then the suggest code kicks in with possible article matches. It would make article linking a lot easier. One problem with it is I don't know how to work out where the text cursor is in a textarea from JS, but I guess you could just have it pop up somewhere, ready for people to click. Obviously to make it all work seemlessly the index would need to be up to date... Best regards, Alex Powell On 8/16/06, Julien Lemoine &lt;speedblue(a)happycoders.org&gt; wrote:

On 8/16/06, Alex Powell &lt;alexp700(a)gmail.com&gt; wrote: That would be cool. Only three cases would need to be treated: - brand new article: update the index taking into account that the new article may be a redirect - article that was a redirect is now a real article - article that was a real article is now a redirect This would affect a very small number of article saves, maybe like 1 in 100 or less? Obviously this level of integration is going to require serious support from the developers. This sounds like something better left for the likes of Wikiwyg? Steve

On 8/16/06, Alex Powell &lt;alexp700(a)gmail.com&gt; wrote: Just FYI, there are Word macro scripts that successfully translate to/from Word/MediaWiki tables. Nice, would be fantastic if we had a formalised way of documenting parameters. Then it could, for example, scan the <NOINCLUDE> part of the template page for some special code and provide that too. Otherwise, most templates could only tell you how many parameters to provide, by scanning for {{{1}}}, {{{2}}} etc. May be impossible in JavaScript? Not sure what hotkeys are permitted. It's a work in progress. I see that straight indents aren't currently implemented. Obvioussly they'll convert to stacked :::'s. Indent works on lists. That may continue to be the case. Tools for beginners and experts alike should be encouraged. Like good code IDE's. These days you can code in a language you don't know at all just by relying on the online "prodding". Nice. Suggest it. :) Steve

On 8/16/06, Alex Powell &lt;alexp700(a)gmail.com&gt; wrote: Doesn't Julien's program run independently of MediaWiki itself? That is, I got the impression that the client wasn't sending a request to index.php, it was sending it to Julien's program, so startup time for MediaWiki doesn't matter.

On 8/16/06, Julien Lemoine &lt;speedblue(a)happycoders.org&gt; wrote: Hi, I mean, integrated with *Wikipedia*, not integrated with MediaWiki - this needs cooperation with various people, not least of whom is Brion. In the meantime, can anyone think of how to make this work as a javascript hack? Would it be possible to make the interface compatible (same size etc) with the monobook search box, so it could be included somehow in a custom monobook.js script? Steve

On 8/16/06, Julien Lemoine &lt;speedblue(a)happycoders.org&gt; wrote: Ok, so that rules out integrating via a user script until the search database is hosted at wikipedia? In the meantime, I think you can achieve that with GreaseMonkey. Steve

On 8/16/06, Julien Lemoine &lt;speedblue(a)happycoders.org&gt; wrote: Looks like it: http://diveintogreasemonkey.org/api/gm_xmlhttprequest.html In particular: Unlike the XMLHttpRequest object, GM_xmlhttpRequest is not restricted to the current domain; it can GET or POST data from any URL. It's very easy to convert any arbitrary javascript to be a greasemonkey script that can be run on any page. You say it would be inefficient to run the script from a server other than the one where the compiled database is stored? Is that because the "TCP/IP server" has a lot of communication with the database? Does that mean that there is only a single, low volume request back and forth between the client and the "TCP/IP server" each time the user presses a key? If so, a grease monkey script sounds quite feasible... Steve

Sure, and I can even show you screenshots of me using it. Like the saying goes, "the future is already here, it's just not widely distributed yet" :-) You can check out the experimental screenshots, and an explanation of how it was done, here: http://nickj.org/Experiment_with_Suggestion_Searching_on_Wikipedia As you can see, it definitely has rough edges, but the basic concept works well. The main obstacles to normal people using it are the JavaScript cross-domain restrictions (details below), and updating the current MediaWiki search area to have the option of using suggestion searching. Yes, that is a problem, and to get around it I configured my proxy to silently rewrite certain requests so that they look like they come from en.wikipedia.org, but in reality they come from Julien's site. That allows me to get around this restriction (and probably GreaseMonkey would let you do something similar), but it won't be a viable option for 99.9% of people. For them, the suggestions need to come from the wikipedia (even if it's just a temporary two line script which bounces the request straight off to Julien's site). All the best, Nick.

Hi Julien, Sounds good, and I really like it having the top 10 languages. I think _maybe_ though it could be useful to have two variations of the Analyzer (like you have two variations of TcpQuery - one that uses DiskQuery, and one that uses MemoryQuery). With Analyzer though, it could be good to have one that connects to MySQL and gets the data directly from the database, and one that uses the downloaded XML dumps. This way, people can use whichever one is most appropriate for them. For example, for someone running a big MediaWiki site who wanted to look at the possibility of using suggestion searching, they probably wouldn't want to create an XML dump, then run Analyzer on the XML dump (this would be too slow, and too many steps, and take a lot of disk space). Rather, if possible, in that situation it would be nice to create the compiled files directly from the database. To try and help with this, I've modified a copy of Analyzer.cpp to add basic importing (but just of the article names, not redirects or article counts) from MySQL (i.e. does not use any downloaded files). The rough file (which still needs work for redirects + article counts) is here: http://files.nickj.org/MediaWiki/MysqlAnalyzerCmd.cpp Please note that I have not used C or C++ in a _very_ long time, so if looks like I have done something silly then that is almost certainly correct. :-) To use compile and run this, on a Debian/Ubuntu system, I did this: # Install required MySQL libraries apt-get install libmysqlclient15-dev cd cmd # Compile: g++ -DHAVE_CONFIG_H -I. -I. -I.. -I../expat/lib -g -O2 -O3 -MT MysqlAnalyzerCmd.o -MD -MP -MF ".deps/MysqlAnalyzerCmd.Tpo" -c -o MysqlAnalyzerCmd.o MysqlAnalyzerCmd.cpp # Link: (Note: needs " -lmysqlclient" parameter) g++ -g -O2 -O3 -o MysqlAnalyzer -L../tools -L../serialization -L../analyzer MysqlAnalyzerCmd.o -lanalyzer -lserialization -ltools -lexpat -lglib-2.0 -lmysqlclient # Run (change hostname / username / password / database-name params as required) : ./MysqlAnalyzer localhost wikiuser FakePasswd wikidb If it is working, it should print out something like this: ----------------------------- Connection success Found 12345 articles ----------------------------- Then use the .bin files as per usual on TcpQuery. Also there is a small diff for WSuggest.js to fix a small problem in my autocomplete stuff. For example, suppose the user typed "Aer", then moved the text cursor back to be between the 'A' and the 'e', typed 'm' (to make "Amer") then typed 'p' (to try and spell 'Amper'). However in-between typing the 'm' and the 'p', the cursor position will jump to the end of the text box to try and autocomplete "American", so the result of pressing 'p' will be 'Amerp', not 'Amper'. To prevent this, will now only try to autocomplete if the cursor position is at the end of the text field. Diff is here: http://files.nickj.org/MediaWiki/WSuggest.js-0.4-autocomplete-update.txt All the best, Nick.

Nick Jenkins wrote: Dear Nick! Thank you for the Web-Adress, very useful. But how can we install the Suggest to the Wikipedia, and if we will, why not also install it to other sister Projects. Greetings, de.wikipedia.org/wiki/Benutzer:Abzt

I finally got around to logging a request for this - it's at: http://bugzilla.wikimedia.org/show_bug.cgi?id=7288 Includes a summary description of what's being requested, some potential screenshots to illustrate, info about and link to Julien Lemoine's site and source code, and my "devil's advocate" list of things that ideally would behave differently so as to help integration with MediaWiki. Comments and technical feedback welcome. All the best, Nick.

I knew there was a reason it felt a bit wrong, and that example is probably it! ;-) And by the way, if I copy and paste in the "←↓↑→" (i.e. the 4 arrow symbols in case an email system munges it), then the search suggest does give the "Dance Dance Revolution" redirect as it's suggestion ;-) All the best, Nick.