When you say "frozen", you mean the site takes a long time to load?
I wouldn't necessarily assume that the reason was high insert rate into job table. That's an issue that Wikimedia experienced, but Wikimedia is very big and highly optimized, and performance bottlenecks for Wikimedia don't necessarily correspond to the performance bottlenecks that ordinary installs might experience.
My gut reaction is that maybe your install is being overloaded not from the queueing of all the jobs but just from the execution of all of them. Possibly combined with caches being cleared resulting in lots of activity next view (If this was the case, top should also show a lot of time spent in the php process too).
However, its always best to measure performance problems before trying to optimize the situation. So I guess some questions: * How is your job queue setup (are you running the CLI runJobs.php script or just the default. What is $wgJobRunRate? If running from the CLI script you may want to consider setting --maxjobs and sleeping between invocations of the runner script, to slow things down). * Try and figure out why MySQL is being slow. A good place to start here is enabling the slow query log - https://dev.mysql.com/doc/refman/8.0/en/slow-query-log.html which will tell you what queries are slow (This is certainly not the be all and end all of mysql performance, and I am definitely not an expert on optimizing DBs, but it seems like a decent place to start) * Try and figure out why MW is slow. Its a little annoying to setup, but if you can setup profiling ( https://www.mediawiki.org/wiki/Manual:Profiling) that can tell you what mediawiki is doing, which can confirm if its just waiting on db, or if its spending its time doing something else.
Hope that helps -- Brian On Wed, Mar 6, 2019 at 8:08 PM Eduardo Elias Camponez < camponez@eduardoelias.com> wrote:
Hi,
I have this problem where my Mediawiki gets frozen after I edit a Template that is used in a lot of pages. I understand from here [0] that the problem could be because of lots of inserts made in the jobs table. From `top`, MySQL is used a lot for a while which froze the site during few minutes.
Because of that I started using Redis for Jobqueue in order to avoid that. However the problem is still happening. I'm not sure how to make sure Redis is being used. Although I have made some tests turning redis on and off, I'm not 100% sure is properly working. I'm assuming it is.
Is is possible to know for sure what (if not the inserts) is causing the freeze?
How do I make sure that Redis and no MySQL is being used for the JobQueue.
Thank you,
Eduardo
[0] https://www.mediawiki.org/wiki/Redis#MediaWiki_&_Wikimedia_use_cases_for...
MediaWiki-l mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-l