[MediaWiki-l] Import Performance Issue/Question

Chap Jones lcjones at jonesipedia.com
Thu Dec 31 15:22:47 UTC 2015


Performance Issue/Question

MediaWiki:1.26.2 :: Apache:2.4.16 (Ubuntu) ::
MySQL:5.6.27-0ubuntu0.14.04.1-log :: Processor:Intel Xeon QuadCore X3210
:: Memory: 3 Gig
HD: 1.5Tb @ 126g usage :: 64Bit System

I have a very small single user(me) wiki in use for genealogy work. I
have very little traffic visiting the site. I keep the wiki updated
fairly religiously, including extensions as well as the physical server
itself. I have Zend OPCache running on this server as well.

My issue has always been a speed issue in importing XML files that have
been exported from Wikipedia. As an example, I may export a wikipedia
page about a particular town or county that is relevant to my genealogy
research and import the XML into my wiki. It takes an excruciatingly
long time to import even a relatively small wikipedia page into my wiki.
I'm talking 5+ minutes to import a single page such as this,
https://en.wikipedia.org/wiki/Guilford_County,_North_Carolina, into my wiki.

I've been trying to fix this issue for a couple of years and have not
figured out why it takes so long to import the wikipedia pages.

I'd like to mention here that my physical server is located in a full
blown data center with 100Mb switch ports on a gigabit fiber network and
out through a 10 gig pipe to the world. Network access is not a problem.

I guess my question is, what can I do to improve the import process?



More information about the MediaWiki-l mailing list