Great, I'll check in with Tim.
I did some more digging and something odd came up. I loaded the same set of 100 pages in 1.9 and 1.12 with profiling enabled, and in the profiling data, on average in 1.12 Database::doQuery took up 42.48% of the total time to process the page view, while in 1.9 it was more like 11.56%. This seems like a big jump. Is this expected for the new version?
1.12 seemed also to have more DB calls per page view, I put in some debugging info and 1.12 made about 72 calls on average while 1.9 made 60. I don't think this accounts for the big percentage jump though in time spent in Database::doQuery.
I repaired all of the tables in the 1.12 database and looked through the tables and they appear to have the proper indices set. To create the 1.12 db, I just dumped the 1.9 db, imported it into a new db, and ran the config/index.php. This page did time out occasionally on longer tasks, like setting rev_len in revision, so I'm wondering if some key element was skipped when the db was upgraded? It does look like rev_len is NULL for most of the entries, maybe there's something else during the upgrade that was missed?
I don't know if this is a valid test, but I captured about 100 queries that 1.9 made, and ran them against both the 1.12 db an the 1.9 db:
# time mysql wikidb_19 < /tmp/queries.sql > /dev/null real 0m0.055s
# time mysql wikidb_112 < /tmp/queries.sql > /dev/null real 0m0.092s
It seemed to take about twice as long on 1.12, so maybe this is an environmental issue?
Travis
On Wed, Jun 25, 2008 at 9:46 AM, Simetrical <Simetrical+wikilist@gmail.comSimetrical%2Bwikilist@gmail.com> wrote:
On Tue, Jun 24, 2008 at 8:57 PM, Travis (wikiHow) travis@wikihow.com wrote:
Removing the kaltura extension though doesn't make any significant improvements, pages still take on average 0.5 seconds to generate. I'm
still
seeing a lot of time being spent in those other areas like Parser::parse, outputWikiText, etc.
If anyone has any suggestions, it'd be appreciated!
Tim Starling would be the most knowledgeable, I guess. The major change in the 1.12 parser is the addition of the new preprocessor, and that specifically revamps replaceVariables() et al. However, on Wikimedia it showed a considerable *decrease* in the time taken to render pages. Perhaps there's a configuration difference, or it might be something else entirely that's causing it. You could try switching to Parser_OldPP, which should work correctly in 1.12, to see if that makes a difference. However, Parser_OldPP appears to no longer be maintained to any significant extent, so it probably isn't advisable to use it indefinitely, at least not in 1.13. The ParserDiffTest extension can be used to systematically compare the performance (and output) of the old and new parsers.
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l