Visual Editor uses Parasoid to covert markup to HTML. It could then be possible to strip the HTML with a standard library.  <a href="https://m.mediawiki.org/wiki/Parsoid">https://m.mediawiki.org/wiki/Parsoid</a><div><br></div><div>There are some alternative parsers listed here, but I have no idea on how well any perform/scale.</div><a href="https://m.mediawiki.org/wiki/Alternative_parsers">https://m.mediawiki.org/wiki/Alternative_parsers</a><div><div><br></div><div>Would love to hear if anyone has a better answer. Obviously a plain text dump or even an HTML dump could save a good amount of processing.</div><div><br></div><div>Cheers,</div><div>Scott</div><div><br><br><div class="gmail_quote"><div dir="ltr">On Mon, Feb 22, 2016, 15:18 Bruno Goncalves &lt;<a href="mailto:bgoncalves@gmail.com">bgoncalves@gmail.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>I was wondering if there is any place where I can find text (without markup, etc) only versions of wikipedia suitable for NLP tasks? I&#39;ve been able to find a couple of old ones for the english wikipedia but I would like to analyze different languages (mandarin, arabic, etc...). </div><div><br></div><div>Of course, any pointers to software that I can use to convert the usual XML dumps to text would be great as well. </div><div><br></div><div>Best,</div><div><br></div><div>Bruno</div><div><br clear="all"><div><div>*******************************************<br>Bruno Miguel Tavares Gonçalves, PhD<div>Homepage: <a href="http://www.bgoncalves.com" target="_blank">www.bgoncalves.com</a><br>Email: <a href="mailto:bgoncalves@gmail.com" target="_blank">bgoncalves@gmail.com</a><br>*******************************************</div></div></div>
</div></div>
_______________________________________________<br>
Wiki-research-l mailing list<br>
<a href="mailto:Wiki-research-l@lists.wikimedia.org" target="_blank">Wiki-research-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/wiki-research-l" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/wiki-research-l</a><br>
</blockquote></div></div></div><div dir="ltr">-- <br></div><div dir="ltr"><div><div><div>Dr. Scott Hale<br></div>Data Scientist<br></div>Oxford Internet Institute<br>University of Oxford<br></div><a href="http://www.scotthale.net/">http://www.scotthale.net/</a><br></div>