Hello, everyone. I'm writing to this group because Wayne Saewyc tells me that you might be interested in what I'm trying to present. My name is Robert Rapplean, and I'm a software engineer and political analyst. You can understand that I've spent an immense amount of time attempting to get ideas across in the massively multiuser asynchronous world of the Internet. Over the years I've developed a detailed understanding of the problems inherent in trying to persue a logical argument in this kind of environment, and I've used that understanding to design a tool that addresses these problems.
I am a Wikipedia user, and make it a point to contribute to the articles when I find I have more expertise than those who have already presented information. After spending quite a bit of time unwinding the sometimes barely comprehensible dialogs that have occured on the discussion pages of the articles, I've concluded that this particular environment would benefit greatly from the implemenation of exactly the kind of tool that I've designed.
With that in mind, I'm going to attempt to describe the idea to you. The remains of this email is a short description of the design of the tool and its reason for being structured the way it is.
In my examination of online debates, I've noted a small bestiary of bad debating habits, almost all of which fall under the categories of "casual debater" or "hostile debater". Casual debaters are those that don't take the time to paruse the previous debate that has occured on a topic. They tend to re-submit points that have already been debated ad-nausum and require re-iteration of important talking points. Everyone starts out in this category, but the casual debater gets bored before they get beyond that point. Because online debating tools are very poor at organizing previous information, it quickly becomes a prodigious effort to get up to speed on a debate. This means that any forum which has enough contributors to form a decent consensus also has a steady stream of neophytes clogging the communication streams with off-the-cuff comments and other distractions.
An unfortunate side effect of this is that many of the good debaters get to the point where they're tired of re-arguing the same points over and over again. When the debate follows those lines yet again, they tend to quit contributing, and may leave the forum entirely.
Hostile debaters are those who aren't there to exchange ideas so much as to spout them. In other words, they're all mouth and no ears. They don't want to find the truth, they want everyone to accept their personal truth. Their entire purpose on the forum is to get a personal thrill from defeating the opposition through wit, strategy, and tactics. As a result, they persue an argument via the well-worn tactics of attacking where the enemy is weak and retreating where the enemy is strong. If they can't win a particular point, they'll shift the topic to something that they think the opponent might be less strong on. They'll continue stringing their opponents on a line of topics until they can find one that the opponent isn't as well versed on, and then stand on it like a bastion of safety, insisting that it's the only valid perspective from which to view the concept. If they can't find a weak point, they'll circle back around to the original topic hoping for a second try or resort to standard logic errors like ad-hominen attacks or faulty analogies.
Although the design of the tool addresses many other issues (like ballot box stuffing and squeaky wheel effects), these should be adequate to understand the reasoning behind the basic structure I'm about to explain. As I go along, I'm going to compare my design to existing online collaborative tools, like wikis and forums.
In order to deal with a lot of the tactics of the hostile debater, I started by removing the linear nature of wikis and forums. You can't lead a person in circles if you're glued to the spot. With this in mind, the base unit of this tool is a conjecture, something like "alcoholism is a disease". Each person may (not must) make one statement about the conjecture. They can change the statement any time that they like, but that one statement must be a summation of their entire opinion on that conjecture. Then everyone gets to vote on the statement that best matches their personal opinion. If none of them match closely enough, they can make their own statement.
Statements are ranked based on popularity. Additionally, the writer of the statement indicates the bias of their statement. A bias states that the conjecture is:
1. factual (based on repeatable phenomena) 2. true (not based on repeatable phenomena, but enough evidence exists) 3. unproven (enough evidence does not exist one way or the other) 4. unprovable (the conjecture requires evidence that is not obtainable) 5. unsupported (the evidence suggests that the conjecture is not true) 6. false (repeatable phenomena disproves the conjecture conclusively)
For the purposes of determining the validity of a conjecture, all statements with 1 & 2 add their votes together, all with 3 & 4 go together, and all with 5 & 6 go together. This creates a distinct identification of the participant's current consensus on the matter.
Since people need a place to ask questions and discuss ideas, a standard message list should be matched with the conjecture, but it is strongly suggested that all messages on the list group expire and vanish after 30 days or so to encourage the participants to embody their ideas in their statements, not in their messages.
There's a further aspect of this. Every conjecture debated tends to result in child conjectures, for instance "a disease is anything which effects the wellness of an individual". These become their own conjectures, with their own statements and (importantly) its own message list. It is voted on to determine its individual validity, and it gets linked to the parent conjecture. Participants in the parent conjecture can then rate the relevance of the child conjecture to the parent conjecture, and take into account the most relevant child conjectures when voting on a statement.
Taking this a step further, the conjectures can then be all reused. For instance, a conjecture like "the will of god is unknowable" could be used again and again, being attached to a very wide range of parent conjectures without having to re-create it and re-argue it every time.
The final result would be that, for each conjecture, all of the reasoning behind the current decision would be laid out in a readily examinable format, ordered by relevance. This makes things much, much easier for the casual arguer. The modular format also makes it extremely easy to slap a "logic foul" conjecture on anyone who presents falacious arguments. The non-linear format totally wrecks topic-shifting tactics, and the voting system indicates not just how people feel about something, but how firmly they feel about it.
I think that'll do it for an introduction. If this is interesting to you, please let me know and I can provide you with more details.
Yours,
Robert Rapplean
Robert Rapplean wrote:
I think that'll do it for an introduction. If this is interesting to you, please let me know and I can provide you with more details.
This would make a great submission to the 2006 Wikimedia conference, where it could be discussed by users and the core MediaWiki developers.
Please visit http://cfp.wikimania.wikimedia.org and submit a talk!
On 3/31/06, Robert Rapplean mythobeast@gmail.com wrote:
I think that'll do it for an introduction. If this is interesting to you, please let me know and I can provide you with more details.
It sounds great, but for widespread acceptance you're going to have to dumb it down. Avoid words like "conjecture" and "debate". Maybe "idea" and "discussion" or something :)
Do you have any working prototypes?
Steve
It sounds great, but for widespread acceptance you're going to have to dumb it down. Avoid words like "conjecture" and "debate". Maybe "idea" and "discussion" or something :)
I couldn't agree with you more. I've actually gone through many iterations of descriptive words for the elements, including changing the structure so that a conjecture was actually a question (because some people think it's impossible to improve on socratic method). The current set of words are specifically for describing the idea to people who might be able to actually implement it, not for describing it to people who might want to use it. They most specifically convey the meaning. For a working version, I expect things to be described by people who know how to teach ideas to people, not those who know how to implement them.
Do you have any working prototypes?
I wish I did. For the past two years I've had so much on my plate that the edges of the plate have been cracking off. I've started and stalled the project several times in the past five years, and I just had to admit that I'll never get it done on my own. However, I continue to have great faith in this tool's ability to help people achieve greater harmony, so I continue to look around for others who might be able to help.
On 3/31/06, Robert Rapplean mythobeast@gmail.com wrote:
I couldn't agree with you more. I've actually gone through many iterations of descriptive words for the elements, including changing the structure so that a conjecture was actually a question (because some people think it's impossible to improve on socratic method). The current set of words are specifically for describing the idea to people who might be able to actually implement it, not for describing it to people who might want to use it. They most specifically convey the meaning. For a working version, I expect things to be described by people who know how to teach ideas to people, not those who know how to implement them.
Perhaps the best idea for the end product would use no words at all...it would be totally intuitive. I'm having trouble visualising this in a wiki environment though. Sort of seems like anyone sophisticated enough to use such a tool is probably capable of arguing coherently in the first place :) Also, for your "hostile debaters", they would probably attack the credibility of such a tool. And for the "casual debaters", perhaps they would just look at it, go "too complicated", and move on.
I wish I did. For the past two years I've had so much on my plate that the edges of the plate have been cracking off. I've started and stalled the project several times in the past five years, and I just had to admit that I'll never get it done on my own. However, I continue to have great faith in this tool's ability to help people achieve greater harmony, so I continue to look around for others who might be able to help.
Pity, a concrete prototype would be great. Personally I find Wiki very badly suited to the sort of discussion that has to happen at WP. Very frequently, I find that someone makes a point, and the first person to respond pretty much monopolises the conversation. If anyone else attempts to respond to the initial point, they get lost in the flow.
For example, this sort of structure: Point :Response1 ::SubResponse ::SubSubResponse ...
Now, where does Response2 go? Immediately below "Point", or where the ... are? Perhaps it would be helpful if the age of each response could be shown (newest stuff highlighted) or something, but as it stands, Response2 will rarely attract a reply. Similar problems surround signing, and the lack of a convenient, coherent way of replying individually to points made by a single person. Once a third person joins in, it becomes an unmanageable mess.
By contrast, email allows the focus of the conversation to be constantly redefined. Each email, by quoting selectively, draws the reader's attention to a single part of the dialogue. However email lacks permanence - all the replies that will ever be made to an email will be made within a week or so. Whereas it's not uncommon to see replies on wiki made a year or more after the original post, with the presumption that some time later someone else will take up the original viewpoint.
Ok, enough rambling, this is the tech list after all. :)
Steve
On 3/31/06, Steve Bennett stevage@gmail.com wrote:
Perhaps the best idea for the end product would use no words at all...it would be totally intuitive.
In a perfect world, tools would be unnecessary.
I'm having trouble visualising this in a wiki environment though.
This isn't a new use for a wiki, it's a replacement for the discussion pages in a wiki that I believe will better suit Wikipedia. Your discussion below indicates how a wiki environment is barely able to contain, much less make sense of, the kind of exchange that goes on when people attempt to debate complicated and hotly debated concepts.
Sort of seems like anyone sophisticated enough to use such a tool is
probably capable of arguing coherently in the first place :)
If that's true, then the user interface would be badly designed. I'm specifically hoping that using this tool will teach people how to argue more coherently.
Also, for your "hostile debaters", they would probably attack the
credibility of such a tool.
I agree. If they can't play their games, then they won't participate and they'll try to degrade the validity of the results. In my experience, though, hostile debaters rarely provide any substance. They provide a lot of conjecture, and tend to point to that one author that agrees with them a lot. This tool will divide them into two groups (1) those who can play nice and are willing to contribute what they know to the debate, and (2) those who can't play nice and probably wouldn't have contributed anything to the conversation in any case.
If the majority of your users are hostile debaters then your conversations are probably mostly stagnated and stymied, but the only way you'll get them to use this tool is to make it the only way to get their opinions heard. The unfortunate truth is that it just plain ruins their fun, but if a person's fun involves befuddling the opposition, it's a behavior that must be curbed for effective communication to occur.
And for the "casual debaters", perhaps they would just look at it, go "too
complicated", and move on.
Again, that's a user interface thing. Creating an effective user interface was always my biggest obstacle in creating this. I've done sketches and mockups, but I think that the only way that an effective UI can be designed will be to create one for a set of early adopters, watch it get used, and then incrementally redesign the UI to make it easier to use based on the input from the test group.
The reason the UI is such a challenge is because this entire pattern of debate is foreign to most people. We're used to thinking in documents and lists, not ranked statements and tree structures.
I wish I did. For the past two years I've had so much on my plate that the
edges of the plate have been cracking off. I've started and stalled the project several times in the past five years, and I just had to admit
that
I'll never get it done on my own. However, I continue to have great
faith
in this tool's ability to help people achieve greater harmony, so I
continue
to look around for others who might be able to help.
Pity, a concrete prototype would be great. Personally I find Wiki very badly suited to the sort of discussion that has to happen at WP. Very frequently, I find that someone makes a point, and the first person to respond pretty much monopolises the conversation. If anyone else attempts to respond to the initial point, they get lost in the flow. .... By contrast, email allows the focus of the conversation to be constantly redefined. Each email, by quoting selectively, draws the reader's attention to a single part of the dialogue. However email lacks permanence - all the replies that will ever be made to an email will be made within a week or so. Whereas it's not uncommon to see replies on wiki made a year or more after the original post, with the presumption that some time later someone else will take up the original viewpoint.
Thank you, Steve. You've very effectively summed up why I feel that the development of a new tool is warranted. Threaded blogs are very slightly better than email, but any significant volume will bury the most elequently made point in no time. None of our current conflict resolution mechanisms is effective for tracking large, prolonged conversations.
I want to thank everyone who's responded to me here. I'll be sure to write up a presentation and submit it for the conference. Your questions and comments here are helping me better identify what kind of content I need to include in the presentation.
-Robert
IBIS (Issue-Based Information System) can be used to structure discussions and cut down on repetition, while allowing everyone to have their say.
http://www3.iath.virginia.edu/elab/hfl0104.html http://www-iurd.ced.berkeley.edu/pub/WP-131.pdf
-r
Hello Robert and all,
I have an IBIS-based "tool" for debates in Wikis.
Technically, it's only set of conventions how to structure a wiki page, in order to use IBIS. It's super simple. I works like this, and requires NO changes to wiki software.
------------- issue based argumentation in a wiki (ibaw)
issue based information management uses the following keywords: * issue - a problem in the world, which a group of people or a person on its own tries to solve * idea - a possible solution to a problem * pro - a pro-argument for an idea, possibly raising one or several new issues * con - a contra-argument for an idea, possibly raising one or several new issues * see - a reference to evidence for an argument (website, person, paper, or the name of another issue...). Instead of 'see' you can also use Wiki-links or weblinks.
=== note === this documentation is a guideline to understand IBAW documents. It's not strict and may always evolve
=== syntax in a wiki ===
ibaw works well in a wiki, with support for indented lists. if inndented lists are supported, but with a different syntax, the wiki syntax for indented lists should be used.
the basic syntax for an ibaw is (listitem) (keyword) ':' text
=== the 'grammar' of ibaw === ibaw --> issue* issue --> (name?, text, idea*) idea --> (text,(pro|con)*,decision?) pro --> (text, see* (issue|idea)*) con --> (text, see* (issue|idea)*) see --> (text) decision --> ('ACCEPT' | 'REJECT') name --> [a-zA-Z0-9]* text --> any text string is permitted here
pro and con can be considered subclasses of issue.
=== syntax example ===
issue: our coffee machine is broken * idea: fix it * pro: cheap * con: takes too much time, we can't live so long without coffee * idea: buy a new one * pro: fast * con: expensive * issue: we need approval form our director * idea: we collect money ourselves ACCEPT -------------
Kind regards,
Max Völkel -- Dipl.-Inform. Max Völkel, Universität Karlsruhe / FZI nepomuk.semanticdesktop.org voelkel@fzi.de +49 721 9654-854 www.xam.de
First Workshop on Semantic Wikis: http://semwiki.org
On 4/3/06, Max Völkel voelkel@fzi.de wrote:
Hello Robert and all,
I have an IBIS-based "tool" for debates in Wikis.
Hi, do you have any publicly visible implementations?
Steve
Hello Steve,
I have an IBIS-based "tool" for debates in Wikis.
Hi, do you have any publicly visible implementations?
Hmm, so you don't got my joke. The description how to structure the page, as shown in the email, *is* the tool. That's all one needs. I used it myself, found a solution to a problem. We also used it in a discussion between 6 people to structure the results of a face2face meeting and then continued the discussion in a wiki.
;-) Max
On 4/3/06, Max Völkel voelkel@fzi.de wrote:
Hmm, so you don't got my joke. The description how to structure the page, as shown in the email, *is* the tool. That's all one needs. I used it myself, found a solution to a problem. We also used it in a discussion between 6 people to structure the results of a face2face meeting and then continued the discussion in a wiki.
Yeah, I understood that it's just a formalized way of using wiki, but wondered if we could see any concrete examples of it in use.
Steve
Hi, Max. What you're describing is a cooperative tool based on formatting tags. While this does work for small groups, it fails the requirements for an effective tool in four areas.
First, its basis on formatting tags requires a learning curve. Although the wiki-savy have become accustomed to formatting tags, most people cringe at the thought of sorting them out. They may seem simple, and truly they are simple, but they still take a little time to get used to. This creates a barrier for entry for users, both in reading and entering new ideas.
Second, the nature of a cooperative tool is that everyone puts in a bit of effort in order to get things moved to where they're supposed to be, prioritizes things, deletes garbage, that kind of thing. This essentially requires a moderator - someone with enough time to oversee things. Moderators are usually pretty unbiased, but even obvious bias can be hidden simply because something has to come first, so it might as well be the moderator's stuff. No matter how dedicated a moderator is, he's only human.
Also, as has been demonstrated in discussion after discussion on Wikipedia, a large volume of comments can readily swamp a human moderator, or even a group of them.
Third, forums suffer from the recency effect, and wikis suffer from the inverse. Nobody wants to slog through a thousand lines of argument in order to find the good stuff, so whatever's on top generally gets priority for how people think about it. My tool avoids this by segmenting all of the information and having it reorder itself through heuristics, usage statics, and advanced voting algorythms. In addition, it's designed to display pro/con(/neg) arguments in separate columns so the users don't get any one side's arguments ahead of the other's. (neg comments are those that state that a supposition is unprovable).
Fourth, the tool lacks any kind of rating system for concept validity. It's nice to believe that all concepts should be considered freshly by each individual, but that leaves a page where "everybody should worship my god" stands toe-to-toe with "there are 12 inches in a foot". If we're actually going to provide information to people it's important to also provide them with some measure of that information's validity.
So for small fixed groups arguing limited topics your system can work just fine, but it isn't scalable for population size or concept complexity, it doesn't allow for a dynamically changing population, and it provides limited facilities for the tracking of the reasoning behind the group's conclusions.
Steve, there was an implementation of Max's tool, minus his tagging structure. It was effectively how this Wikipedia page evolved:
http://en.wikipedia.org/wiki/Arguments_for_and_against_drug_prohibition
This was one of the things that I was looking at while coming up with some of my tool's more advanced features. It started out as a tedious argument on the original War on Drugs page, then moved to the arguments for and against page, then was moved to the discussion of that page, then was pared down through the intervention of some enlightened moderation. In the final revision, the most senseless argument stands toe-to-toe with the most supported by fact, and it takes intervention by an intelligent agent to examine everything and sort it all out.
On 4/3/06, Max Völkel voelkel@fzi.de wrote:
Hello Steve,
I have an IBIS-based "tool" for debates in Wikis.
Hi, do you have any publicly visible implementations?
Hmm, so you don't got my joke. The description how to structure the page, as shown in the email, *is* the tool. That's all one needs. I used it myself, found a solution to a problem. We also used it in a discussion between 6 people to structure the results of a face2face meeting and then continued the discussion in a wiki.
;-) Max
Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
I suggest you have a look at http://meta.wikimedia.org/wiki/Talk:Wikibate I particularily think you should read the Format subheading, to which I contributed the following (which I think is similar to your idea):
- A general idea of what the debate is about would head the page, along with necessary background info. At the end of this header, an assertion will be made and this is what the debate is about. - The Background of the debate need only be a sentance or two long, anything longer and the debate header itself will be contested. - Two sided debates would be split into two columns. - The left column would have the original assertion that starts off the debate, along with a few seed assertions on each side. - If you had something to add to one side or the other, you would click a button to add an assertion(for lack of better word; this could instead be a peice of evidence, past history, an analogy to help explain the argument, etc). - If an argument is in responce to another, instead of clicking add an assertion, you would click on the argument that it is in responce to and have the options to - - Support the argument - Give a counter argument - This new argument would be then lined up with the one it is respopnding to so that the debate can be easily viewed and so each side can easily see both sides of every shred of evidence. - If you wanted to contest the validity of someone elses assertion you would click on contest and add your argument in repeal to the other. - This in turn would turn the contested argument into its own debate that can have its own sub assertions. - Throughout the process (through a method yet unkown to me, maybe voting?) every assertion would have a score that decided how much it actually supported one side or the other, if it adequatly countered any other assertions, etc.
I also suggest checking out OpenCyc (http://www.opencyc.org). It is a knowledge based AI with all kinds of assertions about real world things. This might be usable as a backend when forming arguments. You could make assertions to the AI when adding to the debate, the AI could then use them to check the validity of other assertions made in the current or even other debates. I definately thinking rating system should be added so that specific arguments can carry more weight over others.
/Nathan Spaeth
-- If you have a penny and I have a penny, and we exchange pennies, we both have one penny but if you have an idea and I have an idea and we exchange ideas, then, we will both have two ideas.
Thank you, Nathan. This is very much what I'm trying to accomplish, and incorporates a lot of the elements that have gone into my design. It appears to mimic the actual process that my tool is designed to implement. I particularly like that it takes advantage of the wiki's cross linking ability to allow the users to dig deeper into a more complex issue. As an overall tool, though, it is still locked into a wiki model, which results in certain inherent limitations. Your comment here illustrates this pretty well.
On 4/3/06, Nathan Spaeth loplin@gmail.com wrote:
- Throughout the process (through a method yet unkown to me, maybe
voting?) every assertion would have a score that decided how much it actually supported one side or the other, if it adequatly countered any other assertions, etc.
For each assertion to be voted on, this would require that some metadata be maintained about that assertion. How many votes, direction of votes, who has already voted and in what direction so that they might change their vote later, that kind of thing. Wikis are largely self moderated, so this metadata would need to be tracked and stored by each of the participants or by a central authority.
By stepping out of the wiki model we can embody each of the assertions as its own data object. Assertion, creator, votes, links, the whole nine yards, stored as a living object in the database. This solves the metadata problem and allows you to automate the entire process. My design correlates to Wikibates the same way that dynamic pages correlate to static ones.
I also suggest checking out OpenCyc (http://www.opencyc.org). It is a
knowledge based AI with all kinds of assertions about real world things. This might be usable as a backend when forming arguments. You could make assertions to the AI when adding to the debate, the AI could then use them to check the validity of other assertions made in the current or even other debates. I definately thinking rating system should be added so that specific arguments can carry more weight over others.
I'll have to look deeper into OpenCyc. A quick glance suggests that it could be a very powerful back end resource, and may even provide a good data model to work with.
Thanks again,
Robert
Hello Robert,
By stepping out of the wiki model we can embody each of the assertions as its own data object. Assertion, creator, votes, links, the whole nine yards, stored as a living object in the database. This solves the metadata problem and allows you to automate the entire process. My design correlates to Wikibates the same way that dynamic pages correlate to static ones.
I'll have to look deeper into OpenCyc. A quick glance suggests that it could be a very powerful back end resource, and may even provide a good data model to work with.
For a flexible data model, consider looking at RDF [1]. When programming in Java, a tool such as RDFReactor [2] can give you an object-oriented access. A similar tool exists for Ruby [3].
[1] http://www.w3.org/TR/rdf-primer/ [2] http://rdfreactor.ontoware.org [3] http://activerdf.m3pe.org/
Hoi, This message is late in the already long line of messages on this subject. I do not know if Robert looked at LiquidThreads. http://meta.wikimedia.org/wiki/LiquidThreads It may seem like an old article, it is around since 2004, but the likelihood of it being developed is better than 90% at this time. If you are looking for a tool for more structured debate, have a look and if you have questions of remarks please let them be known.
Thanks, GerardM
Thanks, Gerard. I took a look at the tool you mentioned. I'm sure that it would be very effective in encouraging multi-directional free form discussion. It looks extremely flexible.
Unfortunately, this wouldn't solve the problems that I'm trying to address. Not on its own, anyway. The consensus engine I designed is specifically targeted towards limiting people's ability to "worm away" from an argument that heads in a direction that's uncomfortable for them. They either have to counter their opponent's evidence, admit defeat, or resign the argument. I personally think that it's terribly unfortunate that I have to use the term "admit defeat" when refering to someone who has been presented with adequate information to change their mind, but that's the way the majority of arguers on the web think.
In order to do this, every person needs to be able to make one solid statement of opinion on each issue presented. These statements act as an achor and focal point for all evidence to be presented for and against the issue. As an argument matures, these arguments will change. However, and this is a big however, each author must have ownership of their opinion. It's acceptable to allow others to add suplementary opinions, but I'm banking on the idea that the highest ranked opinion for a specific viewpoint will take into account all other opinions both for and against. Whether they do or don't, these suplemental opinions will be displayed below the highest rank, also for consideration. In this way, we avoid the editing wars that make Wikipedia such unfirm ground.
I do have plans to incorporate many of the features in LiquidThreads in the "forum" section of the CE. It's important to be able to follow people's train of thought, and a lot of that helps. Much of it, in fact, has been included in various blog formats that I've seen, and even in various email clients. I also intend to include a new design for popularity ranking system (tentatively refered to as "half-life popularity ranking) for both posts in the forum and for individuals. As evidenced on Slashdot, this produces a very effective pre-sifting of content.
Again, thanks for showing me this, Gerard. I always enjoy seeing what others are doing in this direction.
-Robert Rapplean
On 4/6/06, Gerard Meijssen gerard.meijssen@gmail.com wrote:
Hoi, This message is late in the already long line of messages on this subject. I do not know if Robert looked at LiquidThreads. http://meta.wikimedia.org/wiki/LiquidThreads It may seem like an old article, it is around since 2004, but the likelihood of it being developed is better than 90% at this time. If you are looking for a tool for more structured debate, have a look and if you have questions of remarks please let them be known.
Thanks, GerardM _______________________________________________ Wikitech-l mailing list Wikitech-l@wikimedia.org http://mail.wikipedia.org/mailman/listinfo/wikitech-l
wikitech-l@lists.wikimedia.org